Browse Subject Areas

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Validation of Brunei’s Malay EQ-5D Questionnaire in Patients with Type 2 Diabetes

  • David Koh,

    Affiliations PAPRSB Institute of Health Sciences, Universiti Brunei Darussalam, Bandar Seri Begawan, Brunei, SSH School of Public Health, National University of Singapore, Singapore, Singapore

  • Awg Muhammad Khairulamin bin Abdullah,

    Affiliation PAPRSB Institute of Health Sciences, Universiti Brunei Darussalam, Bandar Seri Begawan, Brunei

  • Pei Wang,

    Affiliation SSH School of Public Health, National University of Singapore, Singapore, Singapore

  • Naing Lin,

    Affiliation PAPRSB Institute of Health Sciences, Universiti Brunei Darussalam, Bandar Seri Begawan, Brunei

  • Nan Luo

    Affiliation SSH School of Public Health, National University of Singapore, Singapore, Singapore

Validation of Brunei’s Malay EQ-5D Questionnaire in Patients with Type 2 Diabetes

  • David Koh, 
  • Awg Muhammad Khairulamin bin Abdullah, 
  • Pei Wang, 
  • Naing Lin, 
  • Nan Luo



The Malay spoken in Brunei a South East Asian country where Malay is the national language is distinctive and different from Malay spoken in Malaysia, Singapore and Indonesia. This study aimed to develop a Brunei Malay version of the 5-level EQ-5D questionnaire (EQ-5D-5L) and to assess its psychometric properties among patients with type 2 diabetes mellitus (T2DM).


The Brunei Malay EQ-5D-5L was developed by culturally adapting two existing Malay versions. A total of 154 Bruneians with T2DM completed the questionnaire in two different points of time with one week apart. Known-groups validity of the utility-based EQ-5D-5L index and visual analogue scale (EQ-VAS) was evaluated by comparing subgroups of patients known to differ in health status. Test-retest reliability was assessed using the intraclass correlation coefficient (ICC) or Cohen’s kappa.


As hypothesized, patients known to have ‘better’ health had higher EQ-5D-5L index scores than those having ‘worse’ health in all 7 known-groups comparisons. The hypothesized difference in the EQ-VAS scores was observed in only 4 of the 7 known-groups comparisons. Kappa values ranged from 0.206 to 0.446 for the EQ-5D-5L items; the ICC value for the EQ-5D-5L index and EQ-VAS was 0.626 and 0.521, respectively.


The utility-based EQ-5D-5L index appears to be valid and reliable for measuring the health of Brunei patients with T2DM. The validity of the EQ-VAS in Brunei requires further investigation.


Type 2 diabetes mellitus (T2DM) is a common disease in Brunei, a South East Asian country. It affects 11% of the Bruneian population [1] and is the third leading cause of mortality after cancer and coronary heart diseases [2]. Given its popularity and association with impaired health-related quality of life (HRQoL) [3], it is important to assess HRQoL of T2DM patients in Brunei using an instrument which has been cross-culturally adapted for use in local context.

The 5-level EQ-5D questionnaire (EQ-5D-5L) is a new version of the EQ-5D [4] which has been the most widely utilised generic HRQoL instrument in diabetes patients [5]. The EQ-5D-5L has exhibited higher sensitivity than the original version of EQ-5D in T2DM patients [6]. It provides a multidimensional profile, a single utility-based index, and an overall self-assessment of health. At present, the EQ-5D-5L has been available in over 100 languages, including Malay for use in the Malay-speaking populations of Singapore and Malaysia but not of Brunei Darussalam [7].

Malay spoken in Brunei is distinctive and different from Malay spoken in Malaysia, Singapore and Indonesia. It has a lexical difference of 18–20% with Standard Malay spoken in neighbouring Malaysia and Singapore [8]. We aimed to develop a Malay version of the EQ-5D-5L for Brunei and to assess its psychometric properties in patients with type 2 diabetes mellitus (T2DM).


This study used the design of cross-sectional survey, adhered to the tenets of the Helsinki Declaration, and was approved by the Medical and Health Research Ethics Committee, Ministry of Health, Brunei.


Purposive sampling was employed to obtain a heterogeneous sample of T2DM patients. Patients were recruited from the endocrine wards Raja Isteri Pengiran Anak Saleha (RIPAS) Hospital, the specialist diabetic outpatient clinic in RIPAS Hospital, Sengkurong Primary Health Centre and Rimba Primary Health. RIPAS is the national hospital of Brunei, which has more than 600 beds and offers a wide range of health services to the indigenous population.

The inclusion criteria were a diagnosis of T2DM, age above 20 years, and ability to read and communicate in Brunei spoken Malay. The exclusion criteria included inability to answer questions due to debilitating health conditions and the main reason for admission or visit not being T2DM or related health problems.

Data collection procedure

After informed consent was obtained, all patients were asked to complete the EQ-5D-5L and questions assessing their demographic and diabetic status in the ward or clinic where they were recruited. Assistance from a trained research assistant was provided whenever necessary. After the questionnaire survey, a saliva sample was taken from each patient and subsequently analysed using a commercial test kit for the concentration of cortisol, a biomarker for the level of stress [9].

All patients were invited to complete the EQ-5D-5L again one week after the baseline survey via telephone, post, email, test messaging or Whatsapp communication, depending on patients’ own preferences. Up to three reminders were sent to non-respondents.


The EQ-5D-5L consists of five Likert-type items and a visual analogue scale (aka EQ-VAS). Each item asks respondents to rate their HRQol in a different dimension (mobility, self-care, usual activities, pain/discomfort, or anxiety/depression) as having no problems, slight problems, moderate problems, severe problems, or extreme problems. Responses to the 5 items can be used to calculate a single index score anchored by 0 (dead) and 1 (full health). This score indicates the utility or value of the respondent’s health from the perspective of the general public [10]. The EQ-VAS is a 20cm, vertical scale numbered from 0 to 100 for respondents to assess their overall health on the day of the survey, where 0 and 100 are labelled with ‘the worst imaginable health state’ and ‘the best imaginable health state’, respectively.

The Brunei Malay version of the EQ-5D-5L questionnaire was developed using the cultural adaptation procedure recommended by the EuroQol Group. It involved firstly proposing the wording for a Brunei Malay EQ-5D-5L based on the Singapore and Malaysia Malay versions of the questionnaire [11] by one of the investigators of this study and researchers from the Malay Language and Linguistics Department of University Brunei Darussalam who had experience in questionnaire translation. Secondly, an independent reviewer with a health background checked the Brunei Malay version for the appropriateness for use in the clinical setting. Thirdly, a pilot study was conducted with 16 Brunei Malay-speaking persons whose professions were not health related. The feedback collected from the pilot study was used to finetune the wording of the questionnaire. Lastly, the entire process was documented in a report which was subsequently reviewed and approved by a translation consultant appointed by the EuroQol Group. This was to ensure that the Brunei Malay version is semantically equivalent to the original English version of the questionnaire.

Data analysis

The study sample was described in terms of frequency and proportion for categorical variables and mean and standard deviation for continuous variables. The EQ-5D-5L health index score was calculated by first mapping the EQ-5D-5L health profiles to EQ-5D-3L profiles using an algorithm developed by van Hout et al [12] and then applying the EQ-5D-3L value set of Singapore [13], which is a neighbouring country of Brunei.

Known-groups validity of the EQ-5D-5L health index and EQ-VAS was evaluated by comparing subgroups of patients known to differ in health status. The known groups were defined according to smoking status (yes versus no) [14], body mass index (obese versus non-obese) [15], use of insulin (yes versus no) [16], duration of diabetes (<10 years versus 10 or more years) [17], presence of diabetes-related complications (yes versus no) [17], presence of comorbidity (yes versus no) [17], and level of cortisol concentration (<0.10 versus ≥0.10), which is a predictor of depression [9]. We hypothesized that both scores would be lower in patients known to have 'worse' health than those who had 'better' health. Taking insulin usage as an example, we hypothesized that patient who used insulin (the group in ‘worse’ health) would have lower health index and EQ-VAS scores than those who did not use insulin (the group in ‘better’ health’). Linear regression models were used to examine the differences in EQ-5D health index and EQ-VAS scores between each pair of known-groups with the adjustment of age, gender, and race.

Test-retest reliability was assessed for the EQ-5D-5L health index and EQ-VAS using intraclass correlation coefficient (ICC) and for the five EQ-5D-5L items using Cohen’s kappa. For both the two measures [18, 19], values being 0–0.20, 0.21–0.40, 0.41–0.60, 0.61–0.80, and 0.81–1 indicate slight agreement, fair agreement, moderate agreement, substantial agreement, and almost perfect agreement, respectively. All statistical tests were two-sided with the significance level set at 0.01.

All analyses were conducted using SAS (version 9.3).


One hundred and fifty-four patients completed the baseline survey, and among those, 116 also completed the follow-up survey during the period of February to June 2014.

The patients’ socio-demographic and clinical characteristics and responses to the EQ-5D-5L items are summarized in Tables 1 and 2. The majority of patients were middle aged (45–64 years) [20], female, and ethnic Malay. A significant proportion of the patients reported having at least one complication and no less than two comorbidities. Most patients reported “no problems” with each of the five EQ-5D-5L items.

Table 1. Patients’ characteristics for the baseline (n = 154) and follow-up (n = 116) surveys.

Table 2. Self-reported EQ-5D-5L problems in the baseline and follow-up surveys.


The validity analyses were based on all the 154 patients. In all known-groups comparisons, the ‘better’ group was found to have a higher mean EQ-5D-5L index score than the ‘worse’ group (Table 3). Statistical significance was reached in 4 of the 7 comparisons (i.e. smoking status, years of DM, complications, and comorbidities). Nevertheless, the mean EQ-VAS score was higher for the ‘better’ group than for the ‘worse’ group in only 4 of the 7 comparisons (i.e. insulin, complications, comorbidities, and cortisol concentration), and none of the comparisons showed a statistical significant difference (Table 3).

Table 3. Association of health and clinical variables with EQ-5D-5L health index and EQ-VAS (n = 154).

Test-retest reliability

The reliability analyses were based on the 116 patients who completed both the baseline and follow-up survey. Cohen’s kappa value was 0.340 for the mobility item, 0.440 for the self-care item, 0.446 for the usual activities item, 0.206 for the pain/discomfort item, and 0.367 for the anxiety/depression item. The ICC value for the EQ-5D-5L health index and EQ-VAS was 0.626 and 0.521, respectively.


Any health questionnaire must be assessed when it is introduced to a new socio-cultural setting for which it is not originally developed. Therefore, we developed the EQ-5D-5L questionnaire into Brunei Malay and tested it in this Southeast Asian country. To the best of our knowledge, no instruments for outcomes research were validated for use in Brunei.

Known-groups validity is a form of construct validity which is assessed when there is no a gold standard measure available for validating new HRQoL instruments [21]. Our a-priori hypotheses for the pre-defined known groups were all fulfilled for the EQ-5D-5L health index, indicating construct validity of this measure. This result suggests that the validity of Singapore Malay version of the EQ-5D-5L [22] was not lost after it was adapted for use in a different Malay-speaking population. It should be noted that statistical significance was not used as prerequisite for the fulfilment of the hypotheses. Statistical significance is not the primary consideration in construct validity testing; instead, it is more important to make and test as many hypotheses as possible with the available data [23], which may lead to insignificant results for some tests due to insufficient statistical power. On the other hand, the validity of the EQ-VAS cannot be confirmed as the hypotheses were not fulfilled in some known groups. It was not very surprising as similar results were reported in Singapore [24, 25]. Hence, the validity of the EQ-VAS in Brunei warrants further investigation.

Based on recommended interpretation guide for Cohen’s kappa and ICC values [22], the test-retest reliability of the EQ-5D-5L items, index, and EQ-VAS are acceptable. However, the degree of reliability exhibited in our study was lower than that reported for Chinese (kappa value: 0.73 to 0.98) and Korean (kappa value: 0.41 to 0.69) versions of the EQ-5D-5L [26, 27]. The inferior test-retest reliability results in our study could be due to the different administration modes and locations of the baseline and follow-up surveys. It is possible that the health status of some patients changed from baseline to follow-up surveys. Theoretically, such patients should be excluded from the test-retest reliability assessment; however, we could not identify them. Hence, the actual reliability of the Brunei Malay EQ-5D-5L questionnaire could be underestimated. It should be noted that slightly lower reliability would not negatively affect the validity of the measures but would affect its sensitivity or discriminatory power [28]. This means that a less reliable measure requires a larger sample size than a more reliable measure to achieve certain statistical power when they are used to detect a difference between two populations.

The limitations of the study included the use of foreign algorithms for calculating the EQ-5D-5L index score and that the responsiveness of the EQ-5D-5L measures was not assessed. Also, the moderate sample size may have limited statistical power to detect differences for known-groups comparisons.


In conclusion, the utility-based health index generated from the Brunei Malay EQ-5D-5L questionnaire has acceptable validity and reliability in measuring the health status of type 2 diabetes patients, supporting its use in this population. However, the validity of the EQ-VAS in Brunei type 2 diabetes patients requires further investigation in future studies.


We wish to thank Dr Hajah Dayang Fatimah binti Haji Awang Chuchu, Senior Lecturer, Malay Language and Linguistics and Dr James Howard Mclellan, Senior Lecturer from the Faculty of Arts and Social Sciences UBD for their help in translation of the questionnaire into Brunei Malay, as well as Irmawati Hj Ahmad for her role as an independent reviewer for the Brunei Malay questionnaire. We also wish to thank Alice Lim and Siti Nur Basirah binti Bujang for their help in the fieldwork, and all participants for agreeing to take part in this study.

Author Contributions

  1. Conceptualization: DK N. Luo.
  2. Data curation: N. Luo PW.
  3. Formal analysis: DK AMKA N. Lin PW.
  4. Funding acquisition: DK.
  5. Investigation: DK AMKA N. Lin.
  6. Methodology: DK AMKA N. Lin N. Luo.
  7. Project administration: DK AMKA N. Lin.
  8. Resources: DK.
  9. Supervision: DK AMKA.
  10. Validation: DK AMKA N. Lin.
  11. Writing – original draft: DK N. Lin N. Luo.
  12. Writing – review & editing: DK AMKA N. Lin PW N. Luo.


  1. 1. Brunei Times. (2011). 11% of Bruneian are diabetic. Available at: Accessed 12 October 2015.
  2. 2. Brunei Ministry of Health Statistics. (2011). Health Information Booklet. Available at: Accessed 12 October 2015.
  3. 3. Coffey JT, Brandle M, Zhou H, Marriott D, Burke R, Tabaei BP, et al. Valuing health-related quality of life in diabetes. Diabetes Care. 2002;25:2238–43. pmid:12453967.
  4. 4. Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011; 20:1727–36. pmid:21479777. PubMed Central PMCID: PMC3220807.
  5. 5. Janssen MF, Lubetkin EI, Sekhobo JP, Pickard AS. The use of the EQ-5D preference-based health status measure in adults with type 2 diabetes mellitus. Diabet Med. 2011;28:395–413. pmid:21392061.
  6. 6. Pan CW, Sun HP, Wang X, Ma Q, Xu Y, Luo N, et al. The EQ-5D-5L index score is more discriminative than the EQ-5D-3L index score in diabetes patients. Qual Life Res. 2015;24:1767–74. pmid:25540029.
  7. 7. EuroQol Group. EQ-5D-5L. Available at: Accessed 12 October 2015.
  8. 8. Lewis MP, Gary FS, Charles DF (eds) Ethnologue: Languages of the world, eighteenth editing. 2015. Available at:
  9. 9. Mizawa M, Yamaguchi M, Ueda C, Makino T, Shimizu T. Stress Evaluation in Adult Patients with Atopic Dermatitis Using Salivary Cortisol. BioMed Res Int. 2013. pmid:23971022. PubMed Central PMCID: PMC3736503.
  10. 10. Brooks R. EuroQol: The current state of play. Health Policy. 1996;37:53–72. pmid:10158943.
  11. 11. EuroQol Group. EQ-5D-5L. Available at: Accessed 12 August 2016.
  12. 12. van Hout B, Janssen MF, Feng YS, Kohlmann T, Busschbach J, Golicki D, et al. Interim scoring for the EQ-5D-5L: Mapping the EQ-5D-5L to EQ-5D-3L value sets. Value Health. 2012;15: 708–15. pmid:22867780.
  13. 13. Luo N, Wang P, Thumboo J, Lim YW, Vrijhoef HJ. Valuation of EQ-5D-3L health states in Singapore: Modeling of time trade-off values for 80 empirically observed health states. Pharmacoeconomics. 2014;30:495–507. doi: 10.1007/s40273-014-0142-1 PMID: 24519603.
  14. 14. Gulliford MC, Sedgwick JE, Pearce AJ. Cigarette smoking, health status, socioeconomic status and access to health care in diabetes mellitus: a cross-sectional survey. BMC Health Serv Res. 2003;3:4. pmid:12589709.
  15. 15. Jerant A, Bertakis KD, Franks P. Body mass index and health status in diabetic and non-diabetic individuals. Nutrition & Diabetes. 2015;5:e152. pmid:25915741. PubMed Central PMCID: PMC4423198.
  16. 16. Shim YT, Lee J, Toh MP, Tang WE, Ko Y. Health-related quality of life and glycaemic control in patients with type 2 diabetes mellitus in Singapore. Diabet Med. 2012;29: 241–8. pmid:22507291.
  17. 17. Pan CW, Sun HP, Zhou HJ, Ma Q, Xu Y, Luo N, et al. Valuing health-related quality of life in type 2 diabetes patients in China. Med Decis Making. 2016;36: 234–41. pmid:26400873.
  18. 18. Landis JR, Koch GG. The measurement of observer agreement for categorical data. 1977;33: 159–74. pmid:843571.
  19. 19. Shrout PE, Fleiss JL. Intraclass correlations: Uses in assessing rater reliability. Psychol Bull. 1979;86: 420–8. pmid:18839484.
  20. 20. Luo N, Johnson JA, Shaw JW, Feeny D, Coons SJ. Self-reported health status of the general adult U.S. population as assessed by the EQ-5D and Health Utilities Index. Med Care. 2005;43:1178–86. pmid:16224300.
  21. 21. Davidson Megan. Know-Groups Validity. In: Encyclopedia of Quality of Life and Well-Being Research. Springer Netherlands; 2014. pp.3481–3482.
  22. 22. Wang Y, Tan NC, Tay EG, Thumboo J, Luo N. Cross-cultural measurement equivalence of the 5-level EQ-5D (EQ-5D-5L) in patients with type 2 diabetes mellitus in Singapore. Health Qual Life Outcomes. 2015;13:103. pmid:26179285. PubMed Central PMCID: PMC4502594.
  23. 23. Fayers PM, Machin D. Quality of life: Assessment, Analysis and Interpretation. Chichester: John Wiley & Sons; 2000.
  24. 24. Luo N, Cang SQ, Quah HM, How CH, Tay EG. The discriminative power of the EuroQol visual analog scale is sensitive to survey language in Singapore. Health Qual Life Outcomes. 2012;10:32. pmid:22429829. PubMed Central PMCID: PMC3365872.
  25. 25. Ang M, Fenwick E, Wong TY, Lamoureux E, Luo N. Utility of EQ-5D to assess patients undergoing cataract surgery. Optom Vis Sci. 2013;90:861–6. pmid:23851304.
  26. 26. Kim TH, Jo MW, Lee SI, Kim SH, Chung SM. Psychometric properties of the EQ-5D-5L in the general population of South Korea. Qual Life Res. 2013:22: 2245–53. pmid:23224560.
  27. 27. Jia YX, Cui FQ, Li L, Zhang DL, Zhang GM, Wang FZ, et al. Comparison between the EQ-5D-5L and the EQ-5D-3L in patients with hepatitis B. Qual Life Res. 2014:23; 2355–63. pmid:24627090.
  28. 28. Kanyongo GY, Brooks GP, Kyei-Blankison L, Goceman G. Reliability and statistical power: How measurement fallibility affects power and required sample sizes for several parametric and nonparametric statistics. JMASM. 2007:1; 81–90.