Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Convergent validity of 12-item World Health Organization Disability Assessment Schedule (WHODAS 2.0) among people with neck pain

Abstract

Objective

To explore the convergent validity of 12-item World Health Organization Disability Assessment Schedule (WHODAS 2.0) comparing it to Neck Disability Index (NDI).

Design

Cross-sectional cohort study.

Subjects/Patients

962 patients visiting a university outpatient Physical and Rehabilitation Medicine Clinic due to musculoskeletal complaints.

Methods

Spearman´s rank correlation between WHODAS 2.0 and NDI.

Results

The average age was 49.2 (SD 14.5) years, 67% were women. Of all the possible 143 correlations between WHODAS 2.0 and NDI, 99 (69%) were positive, significant and strong or, at least, moderate. The correlation between the composite scores of two scales was strong. The weakest correlations were seen for the NDI items ‘pain intensity and ‘headaches’.

Conclusion

Most of the items and the composite scores of the WHODAS and the NDI demonstrated significant positive correlations. Pain intensity, as defined by the NDI, did not correlate with disability severity measured by the WHODAS 2.0. Also, the NDI items ‘headaches’ and ‘sleeping’ were associated with the WHODAS 2.0 only loosely. It seems that one of these two scales may not directly be substituted by another. When used simultaneously, The WHODAS and the NDI may complement each other covering comprehensively the different dimensions of functioning among people with neck pain.

Introduction

The World Health Organization Disability Assessment Schedule (WHODAS 2.0) has been introduced as a generic scale to measure disability among adults across all cultures and settings regardless of the specific cause of disability [1]. The WHODAS 2.0 has been found to be a reliable and valid tool to assess disability in patients with musculoskeletal pain [2,3]. It has demonstrated excellent psychometric properties including factor structure, test-retest reliability, high internal consistency and good discrimination ability [4]. The WHODAS 2.0 has been found to be well associated with the WHO minimal generic data set and different patient-reported outcome measures (PROMs), such as the Bath Ankylosing Spondylitis Functional Index (BASFI), the Dougados Functional Index (DFI), the SF-36, a pain numeric rating scale (NRS) and the EQ-5D-5L among others [510]. The WHODAS 2.0 has quickly become a familiar easy-to-use scale among both researchers and clinicians working with very different health disorders. In turn, the Neck Disability Index (NDI) is a disease-specific tool for measuring disability in patients with neck pain [1113]. Through the last three decades, the properties of the NDI have extensively been studied confirming its high test-retest reliability and internal consistency and good construct validity [12].

As the WHODAS 2.0 is a relatively new scale, its convergent validity should be confirmed comparing it with other PROMs across different populations and settings. By assessing the convergent validity of a scale, one may assure that the scores obtained from a newer scale are in line with older scales measuring similar constructs. Additionally, if two scales – a newer and an older one – are quite similar, then the question arises – could it be possible to substitute one by another avoiding redundant composite tests. If, on the other hand, two scales assess different domains of a same construct, then should they be used together complementing each other?

Although the NDI and the WHODAS 2.0 are widely used among pain patients, the joint use of these two measures in the same research setting is either rare or completely absent. However, it can be assumed that these situations will occur more frequently as the WHODAS 2.0 becomes more common. The NDI and WHODAS 2.0 measure the same area of functional ability that the ICF classification calls performance - the person’s functioning in their usual environment. However, they largely cover different dimensions of this concept – the NDI is more physically focused while the WHODAS 2.0 measures much more broadly the person’s participation limitations. Because of these differences, the hypothesis of this study was that although some items of the measures correlate well, others show only weak correlations, if at all.

The objective of this study was to explore the convergent validity of the WHODAS 2.0 compared to the NDI. The results may help to choose the right set of scales for a particular situation. If the association between the two scales will appear to be close to perfect, then in some situations, the disease-specific NDI may possibly be substituted by the generic WHODAS 2.0.

Methods

This was a cross-sectional cohort study of consecutive patients who had visited a university outpatient clinic of Physical and Rehabilitation Medicine between 2014 and 2017 [14,15]. The survey included the 12-item self-administered WHODAS 2.0, the NDI, and questions on demographics and pain intensity. The survey was sent in a paper-version to all the patients visiting the clinic. The patients filled out the survey before they visited a clinic. Of 3,150 patients, 1,988 responded to a questionnaire (response rate 63%). Of 1,988 patients, 962 responded to both the WHODAS 2.0 and the NDI and, were included in this study. The diagnoses were gathered from electronic patient records. The study protocol was approved by the Ethics committee of Hospital District of Southwest Finland (ETMK 60/180/2012).

The self-administered 12-item WHODAS 2.0 contains 12 items, covering the most common limitations of functioning presented during the last 30 days. A Likert-like five-level ordinal scale is used to define the severity of limitation with ‘zero’ denoting ‘no limitation’ and ‘four’ denoting ‘extreme limitation or inability to function’. A simple scoring approach was used and a total score was the sum of all item scores [1]. The score of 0 points denoted the best possible functioning and total independence, while the score of 48 points denoted the worst possible disability and total dependence [4,15].

The NDI includes 10 items covering activities of daily living, pain, and concentration. A Likert-like six-level ordinal scale was used to define the severity of disability caused by neck pain with ‘zero’ denoting ‘no pain or disability’ and ‘five’ denoting ‘most severe pain or disability’. The total score was expressed in points and calculated as [(sum of all item scores)/(number of items with non-missing responses *  5)] * 100. The higher the NDI score, the worse disability perceived by a respondent.

Pain was measured in points of numeric rating scale from 0 (‘no pain’) to 10 (‘worst possible pain’) during the last 30 days. Age was defined in full years at the time of response to a questionnaire. Body mass index (BMI) was self-reported, calculated as body weight divided by squared height and expressed in kg/m2. Sex was defined as biological sex men vs. women. The respondents were asked concerning their marital status as ‘living alone’ vs. ‘living with family’ and the responses were reported as ‘single’ vs. ‘co-habiting’. Smoking status was understood as current smoking at the time of response and dichotomized as ‘yes’ vs. ‘no’

Statistical analysis

All the descriptive statistics were presented as absolute numbers and percentage or as means and standard deviations (SDs), when appropriate. Correlations between the WHODAS 2.0 and the NDI were assessed by using a Spearman’s rank correlation coefficient: 0.40-0.69 was considered ‘strong’; 0.30-0.39 ‘moderate’; 0.20-0.29 ‘weak’; and < 0.20 ‘none or negligible correlation’ [16]. Two-tailed p-values were reported considering values < 0.05 to be statistically significant. There are no commonly recommended thresholds for the strength of correlation. In this study, recommendations by Quinnipiac University (USA) were used as they were considered having more levels to describe the strength of correlations (very strong – strong – moderate – weak – negligible) than, e.g., a gradation system by Dancy & Reidy, used mostly in psychology (strong – moderate – weak) [17]. A sensitivity analysis was performed using the gradation system by Dancy & Reidy and the results were presented as a supplementary table (S1 Table).

Considering the uneven sex distribution, a sensitivity test was applied calculating correlation coefficients for men and women (S2 Table).

Of the 962 observations, there were 436 incomplete responses to the WHODAS 2.0 and 348 to the NDI. Considering that the main objective of the study was to assess the correlations between individual items, all the available data were used, including complete and incomplete responses. All the demographic data were available for all the respondents

All the analyses were conducted using Stata/IC Statistical Software: Release 17, College Station (StataCorp LP, TX, USA).

Results

The mean age of 962 patients was 49.2 (SD 14.5) years. Of them, 647 (67%) were women (Table 1). The average BMI was 26.8 (SD 6.5) kg/m2. Of the patients, 669 (74%) were co-habiting and 237 (26%) were smoking. The mean severity of ‘steady’ pain was 6.5 (SD 1.9) points. Respectively the ‘worst’ pain severity was 8.2 (SD 1.6) points. The mean WHODAS 2.0 total score was 14.4 (SD 9.6) points (Fig 1). The mean NDI total score was 37.5% (SD 17.5%). In total, 828 (86%) patients had main diagnoses of ‘M’ domain of the International Classification of Diseases, 10th Edition, with the most frequent diagnosis M54 ‘Dorsalgia’ in 34%.

thumbnail
Table 1. Descriptive characteristics of the sample.

https://doi.org/10.1371/journal.pone.0315676.t001

thumbnail
Fig 1. Box plots – distributions of composite scores of WHODAS 2.0 and NDI.

https://doi.org/10.1371/journal.pone.0315676.g001

Of all the possible 143 correlations, 45 (32%) were moderate and 44 (31%) strong (Table 2). The lowest Spearman´s rank correlations between the WHODAS 2.0 total score and the NDI items were observed for ‘pain intensity’ 0.25, ‘headaches’ 0.27 and ‘sleeping’ 0.39. The associations between items with similar expressions were high: correlation between ‘concentration’ and ‘concentrating’ was 0.64 and between ‘work’ and ‘work or school’ 0.66. All the correlation coefficients were positive and significant with p-values < 0.0001.

thumbnail
Table 2. Spearman´s rank correlations between the 12-item WHO Disability Assessment Schedule 2.0 and the Neck Disability Index. All the p-values < 0.0001.

https://doi.org/10.1371/journal.pone.0315676.t002

When applying a correlation gradation by Dancy & Reidy, of all the possible 143 correlations, 41 (29%) were moderate and the rest were weak (S1 Table). While the strength of correlations according to this gradation was considered overall weaker than one used as a main assessment approach, the results otherwise showed similar trends. When calculating correlation coefficients separately for men and women, despite some differences the correlation matrices were, however, alike for both sexes (S2 Table).

Discussion

In this cross-sectional study of 962 patients with neck pain, moderate or strong, positive, and significant correlations were observed in about two thirds of all the possible associations between the WHODAS 2.0 and the NDI. Respectively, another one third of all the possible associations were weak or negligible. Two NDI items ‘pain intensity and ‘headaches’ had only negligible or weak correlations with the items of the WHODAS 2.0. The NDI item ‘sleeping’ had weak to moderate correlation with any of the WHODAS 2.0 items. Similarly expressed items were strongly correlated, e.g., ‘concentration’ vs. ‘concentrating’, or ‘work’ vs. ‘work or school’. The correlations between the total scores of the two studied scales were strong.

The generalization of the results might be weakened by the demographics of the study sample – a particular age group around 50 years predominated by women. The patients were visiting a highly specialized university clinic and therefore, the results might not be applicable to the entire population of people with neck pain or to primary care patients with neck problems. It should also be considered that some of the patients were visiting the clinic for another main reason than neck pain. Some of the items presented in both the WHODAS 2.0 and the NDI are very similar. For example, “personal care” (NDI) vs. “washing” and “dressing” (WHODAS 2.0) or “work” vs “work or school”. Answering to similar questions during the same survey might influence the psychometrics of responses. The results were limited to the self-administered short 12-item WHODAS 2.0, and they might be different for other versions of the WHODAS 2.0.

While no previous studies assessing the direct interrelations of the WHODAS 2.0 and the NDI could be identified, the present results could, however, be indirectly compared with some previous research. Similarly to the present findings, strong correlations between the WHODAS 2.0 and almost 20 other scales have been reported earlier [18]. Interestingly, the WHODAS 2.0 has previously demonstrated a weaker association with the Barthel index [18]. This observation may reflect the difference between concepts of capacity (what a person is able to do in the best-arranged conditions) and performance (how well a person is performing in their usual environment). While the WHODAS 2.0 exclusively measures performance, Barthel index is a measure of capacity. Taking that into consideration, the strong correlations between the WHODAS 2.0 and the NDI was expected as both scales are the measures of capacity with partially overlapping questions. Previous research has also noticed that the WHODAS 2.0 might show different strength of correlations for physical and mental domains of functioning when comparing with other scales. For example, the WHODAS 2.0 has demonstrated strong correlation with the physical component score of SF-36 but only moderate with its mental component score [5,10].

The composite scores of questionnaires are without a doubt of great importance in research. They are useful when evaluating the prevalence or incidence of an event, or when comparing, e.g., changes in disability severity across a large sample or an entire population. However, a composite score says little when describing severity of disability of a particular person. It is self-evident that the individual items of the WHODAS 2.0 or the NDI may contribute differently to their composite scores. For example, the composite score may mostly come from the “physical” domain of the WHODAS 2.0, or it may exclusively be the sum of “psychosocial” items scores, resulting in similar summary scores in both cases, which are not, however, comparable. Thus, when describing the functioning level of an individual, it would be more informative (and more in the spirit of the ICF classification) to describe disability severity for each individual item, resulting in a functional profile rather than in a single number. However, only a few studies have assessed the associations between the individual items of the WHODAS 2.0 and the individual items of other scales.

Probably, the most comparable with the present results are the results of studies comparing the WHODAS 2.0 with pain NRS and the Oswestry Disability Index (the NDI is a modification of the later) [19,20]. One third of all the estimated correlations between the Oswestry Disability Index and the WHODAS 2.0 have demonstrated strong correlations while items defining physical functioning seem to correlate more strongly than items defining social or psychological functioning.

Previous studies on the correlation between the WHODAS 2.0 and pain NRS have demonstrated indecisive results [3,5,8,10,21]. In line with the present results, mostly only weak associations have been observed between the WHODAS 2.0 and pain NRS among patients with chronic musculoskeletal pain [20]. For low back pain, correlations between pain and functioning in longitudinal studies seemed to correlate more strongly than in cross-sectional studies [21].

In this study, the NDI items ‘sleeping’, ‘headaches’, ‘reading’ and ‘pain intensity’ did not strongly correlate with any of the single items of the WHODAS 2.0. Neck pain has often been associated with disability and some of the items of the WHODAS 2.0 defining physical functioning could be expected to have stronger correlations with ‘pain intensity’ than they had in the present study [22,23]. On the other hand, even more often, previous studies have observed only loose association between pain severity and disability level [2427]. Among patients with osteoarthritis, pain itself has not been predictive for disability, but rather obesity, older age, and living in urban area [27]. This dissociation between pain severity and disability might be explained through the ICF framework – while pain is a symptom of physical damage of the body, disability is a much wider sum of many biopsychosocial factors that affect the perceived limitation of functioning. Age-related dependency of perceiving pain and disability might play some role here – a relationship between pain intensity and disability has been shown to be weaker among older people [24]. Additionally, such generic scale as the WHODAS includes broad questions on quality of life and participation, which might distort the correlation between pain and disability as well [26]. One previous study has not found strong correlations among disability, pain and physical impairments among people with neck pain concluding that “clinicians should address as many relevant aspects of a presenting clinical entity as possible in the management of neck pain” [28].

Nevertheless, the exact reasons for the weak correlation between disability and pain remain largely unknown and they might be an important topic for further investigation. Also, future research on age-related differences in this correlation might be important.

Conclusions

Most of the items and the composite scores of the WHODAS and the NDI demonstrated significant positive correlations. Pain intensity, as defined by the NDI, did not correlate with disability severity measured by the WHODAS 2.0. Also, the NDI items ‘headaches’ and ‘sleeping’ were associated with the WHODAS 2.0 only loosely. It seems that one of these two scales may not directly be substituted by another. When used simultaneously, The WHODAS and the NDI may complement each other covering comprehensively the different dimensions of functioning among people with neck pain.

Supporting information

S1 Table. Spearman´s rank correlations between the 12-item WHO Disability Assessment Schedule 2.0 and the Neck Disability Index.

Dancy & Reidy gradation of correlation strength. All the p-values < 0.0001.

https://doi.org/10.1371/journal.pone.0315676.s001

(DOCX)

S2 Table. Correlations between WHODAS 2.0 and NDI items by sex.

https://doi.org/10.1371/journal.pone.0315676.s002

(DOCX)

References

  1. 1. World Health Organization. Measuring Health and Disability: manual for WHO Disability Assessment Schedule (WHODAS 2.0). World Health Organization; 2010. Available from: https://apps.who.int/iris/rest/bitstreams/52276/retrieve
  2. 2. Howell ER. The association between neck pain, the Neck Disability Index and cervical ranges of motion: a narrative review. J Can Chiropr Assoc. 2011;55(3):211–21. pmid:21886283
  3. 3. Silva C, Coleta I, Silva AG, Amaro A, Alvarelhão J, Queirós A, et al. Adaptation and validation of WHODAS 2.0 in patients with musculoskeletal pain. Rev Saude Publica. 2013;47(4):752–8. pmid:24346666
  4. 4. Ustun T, Chatterji S, Kostanjsek N, Rehm J, Kennedy C, Epping-Jordan J. Developing the World Health Organization Disability Assessment Schedule 2.0. B World Health Organ. 2010;88(11):815–23.
  5. 5. Baron M, Schieir O, Hudson M, Steele R, Kolahi S, Berkson L, et al. The clinimetric properties of the World Health Organization Disability Assessment Schedule II in early inflammatory arthritis. Arthritis Rheum. 2008;59(3):382–90. pmid:18311751
  6. 6. Fujiwara A, Ida M, Kimoto K, Watanabe K, Kawaguchi M. Feasibility, reliability, and validity of the 12-item World Health Organization Disability Assessment Schedule 2.0 in patients attending the pain clinic. J Anesth. 2021;35(1):81–5. pmid:33151411
  7. 7. Garin O, Ayuso-Mateos JL, Almansa J, Nieto M, Chatterji S, Vilagut G, et al. Validation of the “World Health Organization Disability Assessment Schedule, WHODAS-2” in patients with chronic diseases. Health Qual Life Outcomes. 2010;8:51. pmid:20482853
  8. 8. Saltychev M, Bärlund E, Laimi K. Correlation between the pain numeric rating scale and the 12-item WHO Disability Assessment Schedule 2.0 in patients with musculoskeletal pain. Int J Rehabil Res. 2018;41(1):87–91. pmid:29049125
  9. 9. Tarvonen-Schröder S, Kaljonen A, Laimi K. Comparing functioning in spinal cord injury and in chronic spinal pain with two ICF-based instruments: WHODAS 2.0 and the WHO minimal generic data set covering functioning and health. Clin Rehabil. 2019;33(7):1241–51. pmid:30935211
  10. 10. van Tubergen A, Landewé R, Heuft-Dorenbosch L, Spoorenberg A, van der Heijde D, van der Tempel H, et al. Assessment of disability with the World Health Organisation Disability Assessment Schedule II in patients with ankylosing spondylitis. Ann Rheum Dis. 2003;62(2):140–5. pmid:12525383
  11. 11. Cramer H, Lauche R, Langhorst J, Dobos GJ, Michalsen A. Validation of the German version of the Neck Disability Index (NDI). BMC Musculoskelet Disord. 2014;15:91. pmid:24642209
  12. 12. Vernon H. The Neck Disability Index: state-of-the-art, 1991-2008. J Manipulative Physiol Ther. 2008;31(7):491–502. pmid:18803999
  13. 13. Yates M, Shastri-Hurst N. The Oswestry Disability Index. Occup Med. 2017;67(3):241–2.
  14. 14. Saltychev M, Bärlund E, Mattie R, McCormick Z, Paltamaa J, Laimi K. A study of the psychometric properties of 12-item World Health Organization Disability Assessment Schedule 2.0 in a large population of people with chronic musculoskeletal pain. Clin Rehabil. 2017;31(2):262–72. pmid:26851249
  15. 15. Saltychev M, Mattie R, McCormick Z, Laimi K. Confirmatory factor analysis of 12-Item World Health Organization Disability Assessment Schedule in patients with musculoskeletal pain conditions. Clin Rehabil. 2017;31(5):702–9. pmid:27260763
  16. 16. Akoglu H. User’s guide to correlation coefficients. Turk J Emerg Med. 2018;18(3):91–3. pmid:30191186
  17. 17. Dancey CP, Reidy J. Statistics without maths for psychology. 4th ed. Edinburgh, UK: Pearson Education Limited; 2007.
  18. 18. Saltychev M, Katajapuu N, Bärlund E, Laimi K. Psychometric properties of 12-item self-administered World Health Organization disability assessment schedule 2.0 (WHODAS 2.0) among general population and people with non-acute physical causes of disability - systematic review. Disabil Rehabil. 2021;43(6):789–94. pmid:31335215
  19. 19. Bärlund ET, Katajapuu NK, Paltamaa JP, Saltychev MM. Correlation between Oswestry disability index and 12-item self-administered version of World Health Organization Disability Assessment Schedule (WHODAS 2.0) in patients with chronic low back pain. Int J Rehabil Res. 2021;44(2):170–2. pmid:33724972
  20. 20. Saltychev M, Mattie R, McCormick Z, Laimi K. Psychometric properties of the neck disability index amongst patients with chronic neck pain using item response theory. Disabil Rehabil. 2018;40(18):2116–21. pmid:28503961
  21. 21. McGorry RW, Shaw WS, Lin J-H. Correlations between pain and function in a longitudinal low back pain cohort. Disabil Rehabil. 2011;33(11):945–52. pmid:20840017
  22. 22. Harahap IA, Huda SN, Tanjung D, Siregar CT, Nasution SZ, Ariga RA, et al. Relationship between pain intensity and disability in chronic low back pain patients. Enfermería Clínica. 2021;31553–5.
  23. 23. Sirbu E, Onofrei RR, Szasz S, Susan M. Predictors of disability in patients with chronic low back pain. Arch Med Sci. 2020;19(1):94–100. pmid:36817655
  24. 24. Houde F, Cabana F, Léonard G. Does age affect the relationship between pain and disability? A descriptive study in individuals suffering from chronic low back pain. J Geriatr Phys Ther. 2016;39(3):140–5. pmid:25973569
  25. 25. Kovacs F, Abraira V, Cano A, Royuela A, Gil del Real MT, Gestoso M, et al. Fear avoidance beliefs do not influence disability and quality of life in Spanish elderly subjects with low back pain. Spine (Phila Pa 1976). 2007;32(19):2133–8. pmid:17762816
  26. 26. Kovacs FM, Abraira V, Zamora J, Teresa Gil del Real M, Llobera J, Fernández C, et al. Correlation between pain, disability, and quality of life in patients with common low back pain. Spine (Phila Pa 1976). 2004;29(2):206–10. pmid:14722416
  27. 27. Shakibi M-R,. GR , . JA . Relationship between pain and disability in osteoarthritis patients: Is pain a predictor for disability?. J Med Sci. 2004;4(2):115–9.
  28. 28. Chiu TT, Lam T-H, Hedley AJ. Correlation among physical impairments, pain, disability, and patient satisfaction in patients with chronic neck pain. Arch Phys Med Rehabil. 2005;86(3):534–40. pmid:15759241