Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Translation and performance of the Finnish Diabetes Risk Score for detecting undiagnosed diabetes and dysglycaemia in the Indonesian population

  • M. Rifqi Rokhman ,

    Contributed equally to this work with: M. Rifqi Rokhman, Bustanul Arifin

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Validation, Visualization, Writing – original draft, Writing – review & editing

    r.rokhman@rug.nl, m_rifqi_rokhman@ugm.ac.id (MRR); bustanul.arifin.ury@unhas.ac.id, b.arifin@umcg.nl (BA)

    Affiliations Department of Health Sciences, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands, Institute of Science in Healthy Ageing & healthcaRE (SHARE), University Medical Center Groningen, University of Groningen, Groningen, The Netherlands, Faculty of Pharmacy, Universitas Gadjah Mada, Yogyakarta, Indonesia

  • Bustanul Arifin ,

    Contributed equally to this work with: M. Rifqi Rokhman, Bustanul Arifin

    Roles Conceptualization, Data curation, Investigation, Methodology, Project administration, Resources, Validation, Visualization, Writing – original draft, Writing – review & editing

    r.rokhman@rug.nl, m_rifqi_rokhman@ugm.ac.id (MRR); bustanul.arifin.ury@unhas.ac.id, b.arifin@umcg.nl (BA)

    Affiliations Department of Health Sciences, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands, Faculty of Pharmacy, Universitas Hasanuddin, Makassar, Indonesia, Faculty of Medicine, Public Health and Nursing, Universitas Gadjah Mada, Yogyakarta, Indonesia, Unit of PharmacoTherapy, Epidemiology and Economics (PTE2), Department of Pharmacy, University of Groningen, Groningen, The Netherlands

  • Zulkarnain Zulkarnain,

    Roles Data curation, Investigation, Resources, Writing – review & editing

    Affiliations Faculty of Medicine, Universitas Syiah Kuala, Banda Aceh, Indonesia, Thyroid Center, Zainoel Abidin Hospital, Banda Aceh, Indonesia

  • Satibi Satibi,

    Roles Data curation, Investigation, Resources, Writing – review & editing

    Affiliation Faculty of Pharmacy, Universitas Gadjah Mada, Yogyakarta, Indonesia

  • Dyah Aryani Perwitasari,

    Roles Data curation, Funding acquisition, Investigation, Methodology, Resources, Supervision, Writing – review & editing

    Affiliation Faculty of Pharmacy, Universitas Ahmad Dahlan, Yogyakarta, Indonesia

  • Cornelis Boersma,

    Roles Supervision, Writing – review & editing

    Affiliations Department of Health Sciences, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands, Institute of Science in Healthy Ageing & healthcaRE (SHARE), University Medical Center Groningen, University of Groningen, Groningen, The Netherlands, Faculty of Management Sciences, Open University, Heerlen, The Netherlands

  • Maarten J. Postma,

    Roles Funding acquisition, Supervision, Writing – review & editing

    Affiliations Department of Health Sciences, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands, Institute of Science in Healthy Ageing & healthcaRE (SHARE), University Medical Center Groningen, University of Groningen, Groningen, The Netherlands, Unit of PharmacoTherapy, Epidemiology and Economics (PTE2), Department of Pharmacy, University of Groningen, Groningen, The Netherlands, Department of Pharmacology and Therapy, Faculty of Medicine, Universitas Airlangga, Surabaya, Indonesia, Department of Economics, Econometrics and Finance, Faculty of Economics & Business, University of Groningen, Groningen, The Netherlands

  • Jurjen van der Schans

    Roles Formal analysis, Supervision, Writing – review & editing

    Affiliations Department of Health Sciences, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands, Institute of Science in Healthy Ageing & healthcaRE (SHARE), University Medical Center Groningen, University of Groningen, Groningen, The Netherlands, Department of Economics, Econometrics and Finance, Faculty of Economics & Business, University of Groningen, Groningen, The Netherlands

Abstract

A diabetes risk score cannot directly be translated and applied in different populations, and its performance should be evaluated in the target population. This study aimed to translate the Finnish Diabetes Risk Score (FINDRISC) instrument and compare its performance with the modified version for detecting undiagnosed type 2 diabetes mellitus (T2DM) and dysglycaemia among the Indonesian adult population. Forward and backward translations were performed and followed by cultural adaptation. In total, 1,403 participants were recruited. The FINDRISC-Bahasa Indonesia (FINDRISC-BI) was scored according to the original FINDRISC instrument, while a Modified FINDRISC-BI was analyzed using a specific body mass index and waist circumference classification for Indonesians. The area under the receiver operating characteristic curve, sensitivity, specificity, and the optimal cut-offs of both instruments were estimated. The area under the receiver operating characteristic curve for detecting undiagnosed T2DM was 0.73 (0.67–0.78) for the FINDRISC-BI with an optimal cut-off score of ≥9 (sensitivity = 63.0%; specificity = 67.3%) and 0.72 (0.67–0.78) for the Modified FINDRISC-BI with an optimal cut-off score of ≥11 (sensitivity = 59.8%; specificity = 74.9%). The area under the receiver operating characteristic curve for detecting dysglycaemia was 0.72 (0.69–0.75) for the FINDRISC-BI instrument with an optimal cut-off score of ≥8 (sensitivity = 66.4%; specificity = 67.0%), and 0.72 (0.69–0.75) for the Modified FINDRISC-BI instrument with an optimal cut-off score ≥9 (sensitivity = 63.8%; specificity = 67.6%). The Indonesian version of the FINDRISC instrument has acceptable diagnostic accuracy for screening people with undiagnosed T2DM or dysglycaemia in Indonesia. Modifying the body mass index and waist circumference classifications in the Modified FINDRISC-BI results in a similar diagnostic accuracy; however, the Modified FINDRISC-BI has a higher optimal cut-off point than the FINDRISC-BI. People with an above optimal cut-off score are suggested to take a further blood glucose test.

Introduction

The International Diabetes Federation estimates that the number of people living with diabetes was approximately 537 million in 2021, and this number is expected rise to almost 637 million at the end of 2030 [1]. Globally, the annual health expenditure to treat diabetes and its complications was at least USD 966 million. Indonesia ranks fifth among countries with the largest number of people with diabetes, and it was estimated 19.5 million people had diabetes in 2021 [1]. If the trend continues, the number is projected to reach 28.6 million in 2045. Worldwide, almost 50% of adults with diabetes are undiagnosed which represents the necessity of screening for diabetes [2].

Type 2 diabetes mellitus (T2DM) is a metabolic disorder due to progressive β-cell malfunction and insulin resistance characterized by multi-stimuli factors [3] and involving complex molecular mechanisms caused by mitochondrial, endothelial dysfunctions, and various inflammatory mechanisms [4, 5]. Prediabetes, as the early stage of diabetes, is characterized by a long asymptomatic stage with elevated blood glucose levels, leading to an increased risk of developing T2DM in the future [6]. Patients with abnormalities in their blood glucose levels including prediabetes and T2DM, defined as dysglycaemia [7], are generally associated with increased risk of death due to stroke, coronary heart disease, and peripheral vascular disease [8, 9].

Detection of dysglycaemia can substantially prevent or delay T2DM through intensive lifestyle modifications, long-term diet-based therapy [10] and/or pharmacological interventions [1114], while early detection and treatment of people with T2DM are effective to reduce T2DM complications and the burden of disease [8, 15]. Many approaches have been developed and used to detect patients with T2DM including novel technologies based on metabolomics and genetic screening [16]. In the clinical setting, T2DM can be diagnosed based on plasma glucose criteria, either utilizing the fasting plasma glucose value, the oral glucose tolerance test, or the glycated haemoglobin (HbA1c) criteria [6]. However, these diagnostic methods are invasive and not suitable for screening the whole population since they are costly and time-consuming [17]. The identification of T2DM can be better addressed using a two-step approach, in which the use of diabetes risk scores as the first step is followed by a blood glucose test [17, 18]. Diabetes risk scores are expected to increase the cost-effectiveness of screening by significantly reducing the number of people who have to undergo invasive blood glucose tests [18, 19].

Several factors have been found to play important roles contributing to the risk of people for developing T2DM, such as obesity, poor diet, and low physical activity [20]. Based on these risk factors, a diabetes risk score was developed for detecting people with high risk of developing diabetes. The Finnish Diabetes Risk Score (FINDRISC) is a questionnaire used to identify individuals at risk of developing T2DM. In recent studies, the FINDRISC has also been evaluated as a tool to identify undiagnosed T2DM, dysglycaemia and metabolic syndrome [2123]. Although the FINDRISC has been translated and validated in several languages [2426], it was originally developed in Caucasian populations [27]. T2DM develops in East Asian populations at a lower mean body mass index (BMI) compared with those of other populations, for example, European descent [28]. In addition, the Asian populations have a higher body fat percentage at a lower BMI compared to Caucasians [28, 29]. Diabetes develops at a younger age in Asian patients, and is characterized by early β-cell dysfunction in the setting of insulin resistance [28]. Therefore, a diabetes risk score cannot be directly adopted and applied in different populations or ethnic groups, and its applicability should be evaluated in the target population, because modifications may be required [30, 31].

Modification of the FINDRISC is possible by revising the scoring system [32] or simplifying the instrument by selecting only the most relevant items based on logistic regression [22, 26]. To our knowledge, there are no existing translations of the FINDRISC nor the modifications of FINDRISC as diabetes risk scores for detecting diabetes in the Indonesian population. Therefore, the main aim of this study was to translate the FINDRISC instrument and compare its performance with the modified version for detecting undiagnosed T2DM and dysglycaemia among the Indonesian adult population. The second aim was to determine the association between the FINDRISC components with the detection of T2DM and dysglycaemia.

Material and methods

Study setting

The translation, cultural adaptation, and testing the performance of the FINDRISC instrument were conducted in two regions in Java Island (Yogyakarta Province and Malang, East Java Province) and a regency in Sulawesi Island (Banggai Laut, Central Sulawesi Province). Of the 34 provinces in Indonesia, there are 12 provinces where the prevalence of patients with T2DM is higher than the national average prevalence level, including Yogyakarta, East Java, and Central Sulawesi [33]. We conducted the translation phase in the last week of April 2019, the cultural adaptation phase in May 2019, and the performance test of FINDRISC from June to November 2019.

Participants

Our target population were community members and government employees. We contacted them by asking permission from the head of the institution or community leader followed by an explanation of the objectives, procedures and research ethics. Participants were people who had never been diagnosed with diabetes mellitus (types 1 and 2) and aged minimum 18 years. After receiving information about this study, all prospective participants should provide written informed consent in order to participate in this study. A day before, we reminded all potential participants to fast for 8 hours and only allowed to drink plain water before we assessed their fasting blood glucose (FBG). Exclusion criteria were participants who were using drugs that could affect blood glucose levels (i.e., thiazides, beta-blockers, and steroids) or participants with diseases or clinical conditions that affected blood glucose levels (i.e., anorexia nervosa, hepatitis and pancreatic tumors). Participant selection happened in the same manner in each separate phase.

In the performance test, the minimum number of participants was determined based on the Burderer’s formula for sensitivity in diagnostic health studies and incorporated the prevalence of the disease in the formula 1 [34, 35].

(1)

For the level of confidence of 95% (α = 0.05), the value of Z∝/2 is 1.96. Based on a previous study, the sensitivity of FINDRISC for undiagnosed diabetes based on FBG () was 0.81 [36]. The maximum acceptable width of the 95% confidence interval (W) was set to 10%. The prevalence of diabetes in Indonesia is 6.2% [2]. Therefore, a minimum total of 954 participants was required for the performance test.

Instrument

The research instruments consisted of a socio-demographic form and the Bahasa Indonesia version of the original FINDRISC. Socio-demographic data included age, sex, and education level. The original FINDRISC instrument consists of 8 items concerning risk-factors related to T2DM, namely age, BMI, waist circumference, daily physical activity, consumption of vegetables and fruit, consumption of hypertension drugs, history of high blood glucose and family history of diabetes. Each item consists of several answer choice scales [27].

Study procedure and data collection

Translation and cultural adaptation.

The translation stage consisted of both a forward and backward translation [37, 38]. In the forward translation, the original FINDRISC instrument was translated from English to Bahasa Indonesia by two Indonesian professional translators working independently. Then, in the backward translation, the translated document was sent to two native speakers of English (also fluent in Bahasa Indonesia) to translate the instrument from Bahasa Indonesia to English. The main purpose of backward translation is to ensure that the translation in the forward translation phase was correct and accurate [39]. The final document of each step was reviewed and discussed by the Indonesian research team. If there were differences of opinion including with and between the translators, the final version was decided upon by consensus.

The initial FINDRISC in Bahasa Indonesia was tested on 10 participants in Sulawesi and 10 participants in Java [39]. The participants were asked whether the items were understandable to them and what their opinion was on each instrument item. At this stage, we replaced the word ‘berries’ with ‘fruits’ because berries are not a popular product in Indonesia, and this might not be understood by Indonesian people. The final product from this phase was the result of an agreement of the Indonesian research team. This version was labelled ‘FINDRISC-Bahasa Indonesia (FINDRISC-BI)’.

Data collection for performance test.

The FINDRISC-BI was distributed among study participants in this phase. The study instrument was filled in by the participants themselves followed by the measurement of participants’ FBG, height, weight and waist circumference.

FBG was measured by a physician or nurse using a finger-stick blood glucose test (Easy Touch®GCU), while the measurements of weight, height and waist circumference were carried out by trained research assistants. Participants’ weight was measured in kilograms using electronic scales with a precision of 0.1 kg, while their height was measured in centimeters with a precision of 0.1 centimeters. When weighing, we asked participants to take off their footwear and only wear light clothing. BMI was measured based on the weight and height of each participant. Waist circumference was measured using a non-stretchy tape with a precision of 0.1 centimeters.

Definition of undiagnosed T2DM and dysglycaemia

The Indonesian Society of Endocrinology divides FBG into 3 categories, namely: normal (FBG <100mg/dL), prediabetes (100-125mg/dL) and T2DM (≥126mg/dL) [40]. In this study, participants with abnormal FBG were defined as dysglycaemia (prediabetes and T2DM combined) while participants with FBG higher than 126mg/dL were labelled as undiagnosed T2DM.

Definition of the FINDRISC-BI and Modified FINDRISC-BI

The FINDRISC instrument uses BMI and waist circumference based on the Caucasian ethnic group [27]. In the FINDRISC, BMI was classified into 3 groups (0 points for BMI <25kg/m2, 1 point for BMI 25-30kg/m2, and 3 points for BMI >30kg/m2), while waist circumference was categorised into 3 groups (for males 0 points <94cm, 3 points 94–102, 4 points >102cm; for female 0 points <80cm, 3 points 80–88, 4 points >88cm). Besides scoring the FINDRISC-BI based on the scoring of the original FINDRISC, we also classified the BMI and waist circumference item of the FINDRISC using the classification from the Indonesian Health Ministry. In this Modified FINDRISC-BI, BMI was classified into 3 groups (0 points for BMI <25kg/m2, 1 point for BMI 25-27kg/m2, and 3 points for >27kg/m2), with only 2 groups for waist circumference classification (for males 0 points <90cm, 4 points ≥90cm; for females 0 points <80cm, 4 points ≥80cm). The comparison of scoring between the FINDRISC-BI and Modified FINDRISC-BI can be seen in S1 Table, while S2 Table presents the Modified FINSRISC-BI instrument.

Data analysis

Participants’ characteristics were described as frequencies and percentages for categorical data, while means ± standard deviations (SD) for continuous data were presented. Comparisons between the groups were analyzed with Chi-square tests for categorical data and unpaired t-tests for continuous data.

The accuracy of the FINDRISC-BI was analyzed using the area under the receiver operating characteristic (ROC) curve. The sensitivity, specificity, false positive, false negative, positive predictive value, and negative predictive value were calculated for both the FINDRISC-BI and Modified FINDRISC-BI. The optimal cut-offs for detecting undiagnosed T2DM and dysglycaemia were calculated by estimating the point with the shortest distance to (0,1) in the ROC curve that maximizes both the sensitivity and specificity. The distance for each observed cut-off was determined as the square root of [(1-Sensitivity)2 + (1-Specificity)2] [21, 41].

The associations of the FINDRISC-BI and Modified FINDRISC-BI components with undiagnosed T2DM or dysglycaemia were analyzed using multivariate logistic regression analysis. Independent variables were all components of the FINDRISC-BI or Modified FINDRISC-BI, while undiagnosed T2DM and dysglycaemia were defined as dependent variables. All statistical analyses were performed using the Statistical Package for Social Sciences (SPSS Inc., Chicago, IL, USA), version 26.0. The level of statistical significance was set at p < .05.

Ethics statement

The study was approved by the Ethics Committee of the Faculty of Dentistry of Universitas Gadjah Mada, Yogyakarta, Indonesia in document number 0095/KKEP/FKG-UGM/ES/2019 on April 25, 2019. Permission to develop and publish an Indonesian version of the FINDRISC instrument was obtained from Jaana Lindström, MSC and Jaakko Tuomilehto, MD, PHD, and the American Diabetes Association as the copyright holder.

Results

No significant changes were made from the original FINDRISC English version in the translation process. In the cultural adaptation step, twenty participants participated. Some of the participants questioned item number 4 ‘do you usually have at least 30 minutes of daily physical activity at work or during leisure time (including normal daily activity)?’. They asked for further explanation regarding ‘daily physical activity’ and whether this referred to ‘minimal 30 minutes exercise in a day’ or ‘all kind of activities for 30 minutes in a day’?. To address this issue, this specific item was discussed with the original author, who stated that ‘daily physical activity’ referred to ‘all kind of activities for 30 minutes in a day’.

Furthermore, some participants also had difficulty in differentiating between answer choice “Yes: grandparent, aunt, uncle, or first cousin (but no own parent, brother, sister, or child) (3 points)” and “Yes: parent, brother, sister, or own child (5 points)” of the last question of the FINDRISC. Therefore, we agreed to change the order of answer choices to “No (0 points)”; “Yes: parent, brother, sister, or own child (5 points)”; and “Yes: grandparent, aunt, uncle, or first cousin (but no own parent, brother, sister, or child) (3 points). This change aimed to facilitate communication between researchers and participants when explaining this item. Participants will more easily remember the history of their immediate family illness (parents and siblings) compared to the history of their grandparents.

Characteristics of study participants

Table 1 shows the descriptive characteristics of 1,403 participants. The majority of the participants were women (61.4%), had a mean age of 41.9 years old (SD = 15.4), education of diploma or higher (51.2%), average waist diameter of 86.0 cm (SD = 12.1), BMI of 24.5 (SD = 4.5), and FBG of 97.5 mg/dL (SD = 29.8). The number of participants with dysglycaemia was 426 (30.4%), and 92 participants (6.6%) were labelled as undiagnosed T2DM. In general, participants with dysglycaemia had a higher risk factor profile in terms of their age, waist circumference, BMI, history of antihypertensive medication use, history of high blood glucose and having a first-degree relative with diabetes compared to those without dysglycaemia. Similarly, participants with undiagnosed T2DM had a higher risk factor profile compared to participants without undiagnosed T2DM.

thumbnail
Table 1. Descriptive characteristics of study participants (n = 1,403).

https://doi.org/10.1371/journal.pone.0269853.t001

Diagnostic accuracy

The diagnostic accuracy between the FINDRISC-BI and Modified FINDRSC-BI was similar (Figs 1 and 2). The area under the ROC curve for detecting undiagnosed T2DM was 0.73 (0.67–0.78) for the FINDRISC-BI with an optimal cut-off score of ≥9 (sensitivity = 63.0%; specificity = 67.3%) and 0.72 (0.67–0.78) for the Modified FINDRISC-BI with an optimal cut-off score of ≥11 (sensitivity = 59.8%; specificity = 74.9%) (Table 2). The area under the ROC curve for detecting dysglycaemia was 0.72 (0.69–0.75) for the FINDRISC-BI with an optimal cut-off score of ≥8 (sensitivity = 66.4%; specificity = 67.0%), and 0.72 (0.69–0.75) for the Modified FINDRISC-BI with an optimal cut-off score of ≥9 (sensitivity = 63.8%; specificity = 67.6%). S3 Table provides information about the characteristics of the FINDRISC-BI and Modified FINDRISC-BI using different cut-offs for detecting dysglycaemia and undiagnosed T2DM.

thumbnail
Fig 1. ROC curves for undiagnosed T2DM.

FINDRISC-BI: Finnish Diabetes Risk Score-Bahasa Indonesia; T2DM: type 2 diabetes mellitus; ROC curve: receiver operating characteristic curve.

https://doi.org/10.1371/journal.pone.0269853.g001

thumbnail
Fig 2. ROC curves for dysglycaemia.

FINDRISC-BI: Finnish Diabetes Risk Score-Bahasa Indonesia; T2DM: type 2 diabetes mellitus; ROC curve: receiver operating characteristic curve.

https://doi.org/10.1371/journal.pone.0269853.g002

thumbnail
Table 2. Characteristics of FINDRISC-BI and Modified FINDRISC-BI using the optimal cut-off scores to detect undiagnosed T2DM and dysglycaemia.

https://doi.org/10.1371/journal.pone.0269853.t002

FINDRISC components and undiagnosed T2DM or dysglycaemia

Table 3 describes the associations of the FINDRISC-BI and Modified FINDRISC-BI with undiagnosed T2DM or dysglycaemia from the multivariate logistic regression analysis. For the FINDRISC-BI, components that were associated with undiagnosed T2DM were age, waist circumference, consumption of vegetables and fruit and history of high blood glucose, while in the Modified FINDRISC-BI only age and history of high blood glucose were associated with undiagnosed T2DM. For both the FINDRISC-BI and Modified FINDRISC-BI, components that were associated with dysglycaemia were age, BMI, taking antihypertensive medication, history of high blood glucose and family members with diabetes mellitus. One component, namely physical activity, was not significant in both of the models for detecting undiagnosed T2DM and dysglycaemia.

thumbnail
Table 3. Multivariate logistic regression model of association between the FINDRISC-BI and Modified FINDRISC-BI, and undiagnosed T2DM or dysglycaemia in total participants (n = 1,403).

https://doi.org/10.1371/journal.pone.0269853.t003

Discussion

Our study shows that both the FINDRISC-BI and Modified FINDRISC-BI instruments have acceptable diagnostic accuracy in the Indonesian population to detect people with T2DM or dysglycaemia. The area under the ROC curve of both instruments is in the range of 0.7–0.8, which is considered as acceptable for an instrument to discriminate between people with and without undiagnosed T2DM or with and without dysglycaemia [42]. Our study showed a higher diagnostic accuracy compared to two previous studies of diabetes risk assessment tools in Indonesia with an area under the ROC of 0.65 and 0.64 for detecting prediabetes and T2DM patients respectively [43, 44]. The finding is also comparable with other studies in the Asian setting using the FINDRISC instrument, reporting an area under the ROC of 0.78 in the rural population of China [45], 0.74 in the Philippines [46], 0.77 in India [47], and 0.76 (undiagnosed T2DM) and 0.79 (dysglycaemia) in Malaysia [32].

Daily physical activity was not significantly associated with both undiagnosed T2DM and dysglycaemia. In the development of the original FINDRISC, this variable did not significantly increase the predictive power but was still included among the modifiable variables [27]. In our study, the absence of an association for physical activity could also be related to the fact that our participants potentially incorrectly responded to this question and needed a more detailed question. Two meta-analysis studies showed that the intensity of physical activity (moderate to high) was associated with reductions in HbA1C [48, 49], which could indicate a stricter definition of the daily physical activity item. Therefore, future studies in Indonesia should demonstrate whether the incorporation and clearer definitions of the minimum intensity of physical activity add to the distinctive power of the FINDRISC instrument.

The diagnostic accuracy of both the FINDRISC-BI and Modified FINDRISC-BI for screening undiagnosed T2DM and dysglycaemia is similar. Modifying the BMI and waist circumference classifications did not significantly impact the area under the ROC curve. This finding was similar to two other studies that reported that adjusting the BMI and waist circumference according to the specific Asia-Pacific population did not show significant differences between the FINDRISC and the modified version in the Philippines and Malaysia [32, 46].

Although the performance of both instruments is similar, we suggest the use of the Modified FINDRISC-BI over the FINDRISC-BI, since lower obesity cut-off points are needed in South Asians to detect an equivalent level of dysglycaemia as observed in Caucasian Europeans for which the FINDRISC was first developed [50, 51]. The Modified FINDRISC-BI with a cut-off point of 11 had a slightly lower sensitivity than FINDRISC-BI with a cut-off point of 9 in detecting undiagnosed T2DM, but the Modified FINDRISC-BI had higher specificity, positive predictive value, and negative predictive value. As a result, the Modified FINDRISC-BI offered a lower proportion of the participants with the FINDRISC score above the cut-off point or lower proportion of people that should undergo further diagnostic testing. For practical reasons, the classification of BMI and waist circumference in the Modified FINDRIC-BI will ease the education or counselling to the community since the classifications are similar to the health campaigns promoted by the Indonesian Ministry of Health.

The findings of our study will guide future studies in adopting and evaluating the use of diabetes risk scores in the Indonesian health care system. The Modified FINDRISC-BI can be used in several ways to support the national strategy for reducing the incidence of diabetes. This instrument can be incorporated with the Mobile Jaminan Kesehatan Nasional, a mobile screening application launched by the Indonesian national health insurance system. This instrument can also be used by healthcare professionals to screen high-risk people at low costs. Further diagnostic testing, such as oral glucose tolerance tests, should be conducted for people with a Modified FINDRISC-BI score of 11 or higher for detecting undiagnosed T2DM, while people with a Modified FINDRISC-BI score of 9 or higher should be tested for possible abnormality of their blood glucose level. Incorporating a risk score with a diagnostic test, which could enhance the cost-effectiveness of the population-based screening, is considered more efficient than screening using the diagnostic test alone [52]. Therefore, it is also important for future studies to evaluate the cost-effectiveness of screening for diabetes using a combination of FINDRISC and blood glucose testing.

The remaining pivotal issue for using the FINDRISC score is the impact of the false-positive and false-negative groups. The number of people in the false-positive group can be significantly minimized through further blood glucose tests as the next step of diagnosis. However, for people in the false-negative group, there are potential risks of adverse outcomes in individuals with undiagnosed diabetes who would not be detected by a risk score approach [53]. This can be minimized by conducting repeated testing at a regular interval [54].

The prevalence of undiagnosed T2DM in this study was 6.6%, which is close to the estimation of the prevalence of diabetes in Indonesia estimated by the International Diabetes Federation in 2019 (6.2%) and by the National Baseline Health Research in 2018 (8.5%) [2, 33]. Our findings also demonstrated that the prevalence of dysglycaemia in the participants was high (30.4%). This is slightly below the estimated prevalence of dysglycaemia (impaired fasting glucose and diabetes) in the Indonesian adult population (34.8%) in 2018 [33]. The finding suggests more intensive screening is needed to detect people with dysglycaemia.

To our knowledge, this is the first study to evaluate the performance of the FINDRISC instrument in the Indonesian population. The strength of this research is that participants were taken from two big islands with the highest prevalence of patients with T2DM in Indonesia. Sampling was done so that our study population was representative for the whole of Indonesia, with Java representing the population of the western part of Indonesia and Sulawesi representing the central and eastern part of Indonesia. This study also covered a broad range of participants in terms of age and education.

The results should be interpreted in the light of the study’s limitations. In this research, the parameter to define a participant having prediabetes or T2DM was solely based on the participant’s capillary FBG level using a finger-stick blood glucose test. However, this method was the only reliable method available since we collected data not only in participants from rural areas but also those who lived in very remote areas. Although the performance of a FBG test is less sensitive compared to an oral glucose tolerance test [55], the Indonesian Society of Endocrinology and the American Diabetes Association still include this method as a valid tool for the diagnosis of diabetes mellitus [6, 40]. Another limitation is the use of a cross-sectional study design, which means that the study is limited to detecting people with existing T2DM or dysglycaemia.

Conclusions

The Indonesian version of the FINDRISC instrument has acceptable diagnostic accuracy for screening people with undiagnosed T2DM or dysglycaemia in Indonesia. Modifying the BMI and waist circumference classifications in the Modified FINDRISC-BI results in a similar diagnostic accuracy; however, the Modified FINDRISC-BI has a higher optimal cut-off point than the FINDRISC-BI. People with an above optimal cut-off score are suggested to take a further blood glucose test. The associations between the FINDRISC-BI and Modified FINDRISC-BI components with undiagnosed T2DM or dysglycaemia demonstrate that daily physical activity was not significantly associated with both undiagnosed T2DM and dysglycaemia.

Supporting information

S1 Table. Scoring of FINDRISC-BI and Modified FINDRISC-BI.

https://doi.org/10.1371/journal.pone.0269853.s002

(DOCX)

S2 Table. The Modified FINDRISC-Bahasa Indonesia instrument.

https://doi.org/10.1371/journal.pone.0269853.s003

(DOCX)

S3 Table. Characteristics of FINDRISC-BI and Modified FINDRISC-BI using different cut-offs for detecting undiagnosed T2DM and dysglycaemia.

https://doi.org/10.1371/journal.pone.0269853.s004

(DOCX)

Acknowledgments

We acknowledge the help of all the participants, Prof. Jaakko Tuomilehto (University of Helsinki), American Diabetes Association (ADA), Pemerintah Daerah Kabupaten Banggai Laut—Sulawesi Tengah, Muh. Ramlan Budikusuma, Friyanti Zaman, Karsih, Endang Frihatin, Wayan Sadnyana, Trisno Rusli, Nurjanah M Udi, Andi Faizal Fachlevy, Abdul Kahar, Deby Veranasari, Ninda Sari Wahyuningtyas, Putri Pertiwi, Ananda Febrianty, Nurses of Griya Bromo Clinic in Malang, Arly Tania Putri, Dian Pita Sabella, Ni Putu Ayu Crismayani, Febriyanti Siahaan, Sifa Aula Putri, Kresentia Vanda, Saskia, and Merry Yustika.

References

  1. 1. International Diabetes Federation. IDF Diabetes Atlas tenth edition 2021: Global Diabetes Data Report 2000–2045. 2021 [cited 2021 Nov 30]. Available from: https://diabetesatlas.org/data/en/world/
  2. 2. International Diabetes Federation. IDF Diabetes Atlas ninth edition 2019. Brussels: International Diabetes Federation; 2019.
  3. 3. Akash MSH, Rehman K, Liaqat A. Tumor necrosis factor-alpha: role in development of insulin resistance and pathogenesis of type 2 diabetes mellitus. J Cell Biochem. 2018;119(1):105–10. https://doi.org/10.1002/jcb.26174 pmid:28569437
  4. 4. Rehman K, Haider K, Jabeen K, Akash MSH. Current perspectives of oleic acid: regulation of molecular pathways in mitochondrial and endothelial functioning against insulin resistance and diabetes. Rev Endocr Metab Disord. 2020;21(4):631–43. https://doi.org/10.1007/s11154-020-09549-6 pmid:32125563
  5. 5. Akash MSH, Rehman K, Chen S. Role of inflammatory mechanisms in pathogenesis of type 2 diabetes mellitus. J Cell Biochem. 2013;114(3):525–31. https://doi.org/10.1002/jcb.24402 pmid:22991242
  6. 6. American Diabetes Association. Standards of medical care in diabetes 2019. Diabetes Care. 2019;42:S13–8. https://care.diabetesjournals.org/content/42/Supplement_1 pmid:30559228
  7. 7. Mcdonald SD, Yusuf S, Sheridan P, Anand SS, Gerstein HC. Dysglycemia and a history of reproductive risk factors. Diabetes Care. 2008;31(8):1635–8. https://doi.org/10.2337/dc08-0621 pmid:18458144
  8. 8. American Diabetes Association. Screening for type 2 diabetes. Diabetes Care. 2003;26:1–4. https://doi.org/10.2337/diacare.26.2007.S21
  9. 9. Nakagami T. Hyperglycaemia and mortality from all causes and from cardiovascular disease in five populations of Asian origin. Diabetologia. 2004;47(3):385–94. https://doi.org/10.1007/s00125-004-1334-6 pmid:14985967
  10. 10. Rehman K, Akash MSH. Nutrition and diabetes mellitus: how are they interlinked? Crit Rev Eukaryot Gene Expr. 2016;26(4):317–32. https://doi.org/10.1615/critreveukaryotgeneexpr.2016016782 pmid:27910746
  11. 11. Toumillehto J, Lindström J, Eriksson JG, Valle TT, Uusitupa M. Prevention of type 2 diabetes mellitus by changes in lifestyle among subjects with impaired glucose tolerance. N Engl J Med. 2001;344(18):1343–50. https://doi.org/10.1056/nejm200105033441801 pmid:11333990
  12. 12. Knowler WC, Barrett-Connor E, Fowler SE, Hamman RF, Lachin JM, Walker EA, et al. Reduction in the incidence of type 2 diabetes with lifestyle intervention or metformin. N Engl J Med. 2002;346(6):393–403. https://doi.org/10.1056/NEJMoa012512 pmid:11832527
  13. 13. Costa B, Barrio F, Cabré JJ, Piñol JL, Cos X, Solé C, et al. Delaying progression to type 2 diabetes among high-risk Spanish individuals is feasible in real-life primary healthcare settings using intensive lifestyle intervention. Diabetologia. 2012;55(5):1319–28. https://doi.org/10.1007/s00125-012-2492-6 pmid:22322921
  14. 14. Selph S, Dana T, Blazina I, Bougatsos C, Patel H, Chou R. Screening for type 2 diabetes mellitus: a systematic review for the U.S. preventive services task force. Ann Intern Med. 2015;162(11):765–76. https://doi.org/10.7326/M14-2221 pmid:25867111
  15. 15. Mortaz S, Wessman C, Duncan R, Gray R, Badawi A. Impact of screening and early detection of impaired fasting glucose tolerance and type 2 diabetes in Canada: a Markov model simulation. Clinicoecon Outcomes Res. 2012;4:91–7. https://doi.org/10.2147/CEOR.S30547 pmid:22553425
  16. 16. Akash M, Rehman K, Chen S. An overview of valuable scientific models for diabetes mellitus. Curr Diabetes Rev. 2013;9(4):286–93. https://doi.org/10.2174/15733998113099990062 pmid:23597390
  17. 17. Barengo NC, Tamayo DC, Tono T, Tuomilehto J. A Colombian diabetes risk score for detecting undiagnosed diabetes and impaired glucose regulation. Prim Care Diabetes. 2017;11(1):86–93. https://doi.org/10.1016/j.pcd.2016.09.004 pmid:27727004
  18. 18. Tankova T, Chakarova N, Atanassova I, Dakovska L. Evaluation of the Finnish Diabetes Risk Score as a screening tool for impaired fasting glucose, impaired glucose tolerance and undetected diabetes. Diabetes Res Clin Pract. 2011;92(1):46–52. https://doi.org/10.1016/j.diabres.2010.12.020 pmid:21242013
  19. 19. Mohan V, Deepa R, Deepa M, Somannavar S, Datta M. A simplified Indian Diabetes Risk Score for screening for undiagnosed diabetic subjects. J Assoc Physicians India. 2005;53:759–63. pmid:16334618
  20. 20. Weisman A, Fazli GS, Johns A, Booth GL. Evolving trends in the epidemiology, risk factors, and prevention of type 2 diabetes: a review. Can J Cardiol. 2018;34(5):552–64. https://doi.org/10.1016/j.cjca.2018.03.002 pmid:29731019
  21. 21. Mavrogianni C, Lambrinou CP, Androutsos O, Lindström J, Kivelä J, Cardon G, et al. Evaluation of the Finnish Diabetes Risk Score as a screening tool for undiagnosed type 2 diabetes and dysglycaemia among early middle-aged adults in a large-scale European cohort. The Feel4Diabetes-study. Diabetes Res Clin Pract. 2019;150:99–110. https://doi.org/10.1016/j.diabres.2019.02.017 pmid:30796939
  22. 22. Salinero-Fort MA, Burgos-Lunar C, Lahoz C, Mostaza JM, Abánades-Herranz JC, Laguna-Cuesta F, et al. Performance of the Finnish Diabetes Risk Score and a simplified Finnish Diabetes Risk Score in a community-based, cross-sectional programme for screening of undiagnosed type 2 diabetes mellitus and dysglycaemia in Madrid, Spain: the SPREDIA-2 study. PLoS ONE. 2016;11(7):1–17. https://doi.org/10.1371/journal.pone.0158489 pmid:27441722
  23. 23. Janghorbani M, Adineh H, Amini M. Evaluation of the Finnish Diabetes Risk Score (FINDRISC) as a screening tool for the metabolic syndrome. Rev Diabet Stud. 2013;10(4):283–92. https://doi.org/10.1900/RDS.2013.10.283 pmid:24841881
  24. 24. Zhang M, Zhang H, Wang C, Ren Y, Wang B, Zhang L, et al. Development and validation of a risk-score model for type 2 diabetes: a cohort study of a rural adult Chinese population. PLoS ONE. 2016;11(4):1–13. https://doi.org/10.1371/journal.pone.0152054 pmid:27070555
  25. 25. Štiglic G, Fijačko N, Stožer A, Sheikh A, Pajnkihar M. Validation of the Finnish Diabetes Risk Score (FINDRISC) questionnaire for undiagnosed type 2 diabetes screening in the Slovenian working population. Diabetes Res Clin Pract. 2016;120:194–7. https://doi.org/10.1016/j.diabres.2016.08.010 pmid:27592167
  26. 26. Bernabe-Ortiz A, Perel P, Miranda JJ, Smeeth L. Diagnostic accuracy of the Finnish Diabetes Risk Score (FINDRISC) for undiagnosed T2DM in Peruvian population. Prim Care Diabetes. 2018;12(6):517–25. https://doi.org/10.1016/j.pcd.2018.07.015 pmid:30131300
  27. 27. Lindström J, Tuomilehto J. The diabetes risk score: a practical tool to predict type 2 diabetes risk. Diabetes Care. 2003;26(3):725–31. https://doi.org/10.2337/diacare.26.3.725 pmid:12610029
  28. 28. Ma RCW, Chan JCN. Type 2 diabetes in East Asians: similarities and differences with populations in Europe and the United States. Ann N Y Acad Sci. 2013;1281(1):64–91. https://doi.org/10.1111/nyas.12098 pmid:23551121
  29. 29. Deurenberg P, Deurenberg-Yap M, Guricci S. Asians are different from Caucasians and from each other in their body mass index/body fat per cent relationship. Obes Rev. 2002;3(3):141–6. https://doi.org/10.1046/j.1467-789X.2002.00065.x pmid:12164465
  30. 30. Glümer C, Vistisen D, Borch-Johnsen K, Colagiuri S. Risk scores for type 2 diabetes can be applied in some populations but not all. Diabetes Care. 2006;29(2):410–4. https://doi.org/10.2337/diacare.29.02.06.dc05-0945 pmid:16443896
  31. 31. Barber SR, Davies MJ, Khunti K, Gray LJ. Risk assessment tools for detecting those with pre-diabetes: a systematic review. Diabetes Res Clin Pract. 2014;105(1):1–13. https://doi.org/10.1016/j.diabres.2014.03.007 pmid:24694663
  32. 32. Lim HM, Chia YC, Koay ZL. Performance of the Finnish Diabetes Risk Score (FINDRISC) and Modified Asian FINDRISC (ModAsian FINDRISC) for screening of undiagnosed type 2 diabetes mellitus and dysglycaemia in primary care. Prim Care Diabetes. 2020;14(5):494–500. https://doi.org/10.1016/j.pcd.2020.02.008 pmid:32156516
  33. 33. Indonesia Ministry of Health. National Basic Health Survey. Jakarta: Indonesia Ministry of Health; 2018. Available from: http://labdata.litbang.kemkes.go.id/images/download/laporan/RKD/2018/Laporan_Nasional_RKD2018_FINAL.pdf
  34. 34. Buderer NMF. Statistical methodology: incorporating the prevalence of disease into the sample size calculation for sensitivity and specificity. Acad Emerg Med. 1996;3(9):895–900. https://doi.org/10.1111/j.1553-2712.1996.tb03538.x pmid:8870764
  35. 35. Hajian-Tilaki K. Sample size estimation in diagnostic test studies of biomedical informatics. J Biomed Inform. 2014;48:193–204. https://doi.org/10.1016/j.jbi.2014.02.013 pmid:24582925
  36. 36. Dugee O, Janchiv O, Jousilahti P, Sakhiya A, Palam E, Nuorti JP, et al. Adapting existing diabetes risk scores for an Asian population: a risk score for detecting undiagnosed diabetes in the Mongolian population. BMC Public Health. 2015;15:1–9. https://doi.org/10.1186/s12889-015-2298-9 pmid:26395572
  37. 37. Sperber AD. Translation and validation of study instruments for cross-cultural research. Gastroenterology. 2004;126:124–8. https://doi.org/10.1053/j.gastro.2003.10.016 pmid:14978648
  38. 38. Koller M, Aaronson NK, Blazeby J, Bottomley A, Dewolf L, Fayers P, et al. Translation procedures for standardised quality of life questionnaires: The European Organisation for Research and Treatment of Cancer (EORTC) approach. Eur J Cancer. 2007;43(12):1810–20. https://doi.org/10.1016/j.ejca.2007.05.029 pmid:17689070
  39. 39. Arifin B, Perwitasari DA, Thobari JA, Cao Q, Krabbe PFM, Postma MJ. Translation, revision, and validation of the Diabetes Distress Scale for Indonesian type 2 diabetic outpatients with various types of complications. Value Health Reg Issues. 2017;12:63–73. https://doi.org/10.1016/j.vhri.2017.03.010 pmid:28648318
  40. 40. Tim Penyusun. Pedoman pengelolaan dan pencegahan diabetes melitus tipe 2 dewasa di Indonesia. PB Perkeni; 2019.
  41. 41. Perkins NJ, Schisterman EF. The inconsistency of “optimal” cut-points using two ROC based criteria. Am J Epidemiol. 2006;163(7):670–5. https://doi.org/10.1093/aje/kwj063 pmid:16410346
  42. 42. Hosmer DW, Lemeshow S. Applied Logistic Regression. 2nd ed. Canada: John Wiley & Sons; 2000.
  43. 43. Pramono LA, Setiati S, Soewondo P, Subekti I, Adisasmita A, Kodim N, et al. Prevalence and predictors of undiagnosed diabetes mellitus in Indonesia. Acta Med Indones. 2010;42(4):216–23. pmid:21063043
  44. 44. Fujiati II, Damanik HA, Bachtiar A, Nurdin AA, Ward P. Development and validation of prediabetes risk score for predicting prediabetes among Indonesian adults in primary care: cross-sectional diagnostic study. Interv Med Appl Sci. 2017;9(2):76–85. https://doi.org/10.1556/1646.9.2017.2.18 pmid:28932501
  45. 45. Jiang H, Xu H, Xiao S, Li G. Performance of 3 diabetes screening questionnaires for a rural sample in China. J Cent South Univ (Medical Sci). 2012;37(11):1108–11. https://doi.org/10.3969/j.issn.1672-7347.2012.11.005 pmid:23202620
  46. 46. Ku GMV, Kegels G. The performance of the Finnish Diabetes Risk Score, a modified Finnish Diabetes Risk Score and a simplified Finnish Diabetes Risk Score in community-based cross-sectional screening of undiagnosed type 2 diabetes in the Philippines. Prim Care Diabetes. 2013;7(4):249–59. https://doi.org/10.1016/j.pcd.2013.07.004 pmid:23953706
  47. 47. Pawar S, Naik J, Prabhu P, Jatti G, Jadhav S, Radhe B. Comparative evaluation of Indian Diabetes Risk Score and Finnish Diabetes Risk Score for predicting risk of diabetes mellitus type II: a teaching hospital-based survey in Maharashtra. J Fam Med Prim Care. 2017;6(1):120–5. https://doi.org/10.4103/2249-4863.214957 pmid:29026763
  48. 48. Boulé NG, Kenny GP, Haddad E, Wells GA, Sigal RJ. Meta-analysis of the effect of structured exercise training on cardiorespiratory fitness in type 2 diabetes mellitus. Diabetologia. 2003;46(8):1071–81. https://doi.org/10.1007/s00125-003-1160-2 pmid:12856082
  49. 49. Grace A, Chan E, Giallauria F, Graham PL, Smart NA. Clinical outcomes and glycaemic responses to different aerobic exercise training intensities in type II diabetes: a systematic review and meta-analysis. Cardiovasc Diabetol. 2017;16(1):1–10. https://doi.org/10.1186/s12933-017-0518-6 pmid:28292300
  50. 50. Gray LJ, Yates T, Davies MJ, Brady E, Webb DR, Sattar N, et al. Defining obesity cut-off points for migrant South Asians. PLoS One. 2011;6(10):4–10. https://doi.org/10.1371/journal.pone.0026464 pmid:22039493
  51. 51. Nishida C, Barba C, Cavalli-Sforza T, Cutter J, Deurenberg P, Darnton-Hill I, et al. Appropriate body-mass index for Asian populations and its implications for policy and intervention strategies. Lancet. 2004;363(9403):157–63. https://doi.org/10.1016/S0140-6736(03)15268-3 pmid:14726171
  52. 52. Toi PL, Wu O, Thavorncharoensap M, Srinonprasert V, Anothaisintawee T, Thakkinstian A, et al. Economic evaluation of population-based type 2 diabetes mellitus screening at different healthcare settings in Vietnam. PLoS ONE. 2021;16(12):1–18. https://doi.org/10.1371/journal.pone.0261231 pmid:34941883
  53. 53. Brown N, Critchley J, Bogowicz P, Mayige M, Unwin N. Risk scores based on self-reported or available clinical data to detect undiagnosed type 2 diabetes: a systematic review. Diabetes Res Clin Pract. 2012;98(3):369–85. https://doi.org/10.1016/j.diabres.2012.09.005 pmid:23010559
  54. 54. American Diabetes Association. Classification and diagnosis of diabetes. Diabetes Care. 2017;40:S11–24. https://doi.org/10.2337/dc15-S005 pmid:27979889
  55. 55. Aekplakorn W, Tantayotai V, Numsangkul S, Sripho W, Tatsato N, Burapasiriwat T, et al. Detecting prediabetes and diabetes: agreement between fasting plasma glucose and oral glucose tolerance test in Thai adults. J Diabetes Res. 2015;1–5. https://doi.org/10.1155/2015/396505 pmid:26347060