19 Feb 2016: Ray Chaudhuri K, Rojo JM, Schapira AHV, Brooks DJ, Stocchi F, et al. (2016) Correction: A Proposal for a Comprehensive Grading of Parkinson's Disease Severity Combining Motor and Non-Motor Assessments: Meeting an Unmet Need. PLOS ONE 11(2): e0150130. https://doi.org/10.1371/journal.pone.0150130 View correction
Non-motor symptoms are present in Parkinson's disease (PD) and a key determinant of quality of life. The Non-motor Symptoms Scale (NMSS) is a validated scale that allows quantifying frequency and severity (burden) of NMS. We report a proposal for using NMSS scores to determine levels of NMS burden (NMSB) and to complete PD patient classification.
This was an observational, cross-sectional international study of 935 consecutive patients. Using a distribution of NMSS scores by quartiles, a classification based on levels from 0 (no NMSB at all) to 4 (very severe NMSB) was obtained and its relation with Hoehn and Yahr (HY) staging, motor and health-related quality of life scales was analyzed. Concordance between NMSB levels and grouping based on clinician's global impression of severity, using categorical regression, was determined. Disability and HRQoL predictors were identified by multiple regression models.
The distribution of motor and QoL scales scores by HY and NMSB levels was significantly discriminative. The difference in the classification of cases for both methods, HY and NMSB, was significant (gamma = 0.45; ASE = 0.032). Concordance between NMSB and global severity-based levels from categorical regression was 91.8%, (kappaw = 0.97). NMS score was predictor of disability and QoL.
Current clinical practice does not address a need for inclusion of non-motor scores in routine assessment of PD in spite of the overwhelming influence of NMS on disability and quality of life. Our data overcome the problems of “pure motor assessment” and we propose a combined approach with addition of NMSB levels to standard motor assessments.
Citation: Ray Chaudhuri K, Rojo JM, Schapira AHV, Brooks DJ, Stocchi F, Odin P, et al. (2013) A Proposal for a Comprehensive Grading of Parkinson's Disease Severity Combining Motor and Non-Motor Assessments: Meeting an Unmet Need. PLoS ONE 8(2): e57221. https://doi.org/10.1371/journal.pone.0057221
Editor: Christian Wider, Centre Hospitalier Universitaire Vaudois (CHUV), Switzerland
Received: November 29, 2012; Accepted: January 18, 2013; Published: February 27, 2013
Copyright: © 2013 Ray Chaudhuri et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: Funding for this study came from various sources and includes peer reviewed funding from Parkinson's disease non motor group, a non profit academic society as well as Parkinson's UK through support of steering group meetings and data collection. The study had also been supported by unrestricted academic educational grants from Britannia Pharma, Boehriger-Ingelheim, Abbott and UCB pharma. No additional external funding was received for this study. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have the following interests. This study was partly supported by unrestricted academic educational grants from Britannia Pharma, Boehriger-Ingelheim, Abbott and UCB pharma. There are no patents, products in development or marketed products to declare. This does not alter the authors' adherence to all the PLOS ONE policies on sharing data and materials, as detailed online in the guide for authors.
Parkinson's disease (PD) is a progressive, complex disorder characterised by motor symptoms, such as bradykinesia, rest tremor, and rigidity but also a wide range of non-motor symptoms (NMS) that contribute to significant morbidity and disability. NMS such as sleep dysfunction, dementia and depression are key determinants of patients' health-related quality of life (HRQoL) , . Furthermore, while motor heterogeneity of PD is well established, clinical subtyping of Parkinson's based on non-motor symptoms has not been clearly established –. A pathological basis of non-motor endophenotypes has been suggested while subtyping of PD using latent class analysis indicate clusters with varying and sometimes dominant non-motor load , , . Furthermore, a distinct phase (phase 2) associated with specific non-motor symptoms has been proposed in the natural history of PD , .)
Currently, PD severity is often rated using Hoehn and Yahr staging (HY) which purely reflects the motor severity of disease and compromise of balance/gait. The diagnosis of PD is made using the UK Parkinson's Disease Society Brain Bank clinical diagnostic criteria based exclusively on specific motor symptoms, mainly related to substantia nigra pathology , . Interestingly, NMS such as sleep, autonomic and executive dysfunction, pain, and fatigue, may occur early or at a pre-motor phase and increase in prevalence and severity over time –. Importantly, it is not one NMS but a combination of several NMS that may serve in future to underpin refining diagnosis and management of PD .
In the clinic, current practice does not include obligatory assessment of non-motor scores using validated scales in spite of the overwhelming effect of NMS on quality of life. As a result, many NMS may remain undetected and lead to suboptimal care as reported from a recent European survey . In this article, we provide the framework for improving our clinical assessment of PD in the clinic by incorporating a “snapshot” burden of NMS score to the existing motor assessments. Specific levels of burden of NMS (NMSB) are described based on an analysis of detailed NMS data available from an international database of consecutive PD cases. This pragmatic and score-based assessment paradigm can be easily adopted in the clinic taking into account both the severity of the motor and non-motor burden to improve the current system of classification.
Data from 951 consecutive PD patients diagnosed by a neurologist/geriatrician (movement disorders specialists) according to international recognized diagnostic criteria ,  were included in the multipurpose database built and secured in the Alzheimer Centre Reina Sofia Foundation, Carlos III Institute of Health, Madrid.
Exclusion criteria were: Atypical and secondary parkinsonism (multiple system atrophy, progressive supranuclear palsy, etc); concomitant severe systemic disease (e.g., clinically severe organ failure such as cardiac failure, hepatic failure) or condition interfering with assessments required for study (e.g., blindness); inability to read, understand, or answer written questionnaires, or inability to provide informed consent. Overt dementia impeding evaluation, as per the clinical judgment, was a specific exclusion criterion.
The data were collected from two independent series collected by the main authors (KRC and PMM) using a common protocol for clinical assessments and data capture. The bulk of the data used for the present study arose from a cross-sectional study designed to validate the NMS scale and data at baseline from a long-term international longitudinal study addressing the natural history of PD non-motor symptoms and has been published previously , .
Setting and locations.
Departments of Neurology and Movement Disorder Units from centres in 15 countries of America, Asia, and Europe (ref. 17 and Annex S1).
The non-motor scale validation studies received ethical approval from Carlos III Institute of Health, Madrid, Spain ,  and research ethics committee at University Hospital Lewisham, London, UK . The longitudinal NMS natural history study has been approved in all relevant institutions and is included in UK Department of Health portfolio of approved studies. All participant researchers obtained approval from their respective local EC/IRB and patients signed their informed consent before inclusion.
In addition to socio-demographic and historical data, the following instruments were applied:
The Scales for Outcomes in Parkinson's Disease-Motor (SCOPA-Motor), has 3 sections: A. Examination (10 items); B. Activities of daily living (ADL, 7 items); and C. Complications (4 items). Possible responses per item range from 0 (normal) to 3 (severe) with total score between 0 and 75 , .
The Non-Motor Symptoms Scale (NMSS) has 30 items, nine domains: cardiovascular (2 items), sleep/fatigue (4 items), mood/cognition (6 items), perceptual problems/hallucinations (3 items), attention/memory (3 items), gastrointestinal tract (3 items), urinary function (3 items), sexual function (2 items), and miscellaneous (4 items). Each item scores on a multiple of severity (from 0 to 3) and frequency scores (from 1 to 4) and the theoretical range of the NMSS total score is 0 to 360 , . We refer to this score as “burden” (NMSB) since values integrate frequency and severity.
The original Hoehn and Yahr (HY) classification was used in this study .
The Clinical Impression of Severity Index (CISI-PD) addresses: motor signs; disability; motor complications; and cognitive status. Items are rated on a 7-point scale (from 0, normal, to 6, very severe) and total score, ranges from 0 to 24 , .
The EQ-5D is a generic, preference-based HRQoL measure , . It includes a descriptive part of 5 items (profile), that can then be converted into an EQ-Index (from 1, perfect health state, to 0, death), and a visual analogue scale (EQ-VAS) for assessment of current health state (from 0, the worse imaginable health state, to 100, best imaginable health state).
The PDQ-8 is a specific instrument for assessment of HRQoL in PD . It includes 8 items, each one scoring from 0 to 4. The PDQ-8 Summary Index is expressed as percentage of the sum of the items scores on the maximum possible scale score. Both, EQ-5D and PDQ-8 are instruments recommended for use in PD by an ad hoc Movement Disorder Society task force .
For all the aforementioned scales, with the exception of the EQ-5D index and VAS, the higher the score, the worse the assessed construct. The NMSS captures symptoms over the last month and, in patients with fluctuations, the motor and non-motor evaluations were carried out in an “on” state.
Descriptive statistics were used to determine the characteristics of the sample in relation to socio-demographic aspects, historical data, and evaluations.
Using the cut-off points of the interquartile range (centiles 25, 50, and 75), the following NMSS score limits and NMSB levels were established: 0 (no NMS); 1–20 (Mild); 21–40 (Moderate); 41–70 (Severe); and ≥71 (Very severe). Once categories of the NMSS total score were established, the ability of that grouping to discriminate among patients according to the other variables in the study was determined (Kruskal-Wallis test). The difference in proportions between NMSB levels and HY stages was tested using the Goodman and Kruskal's gamma. Agreement between classifications was explored using weighted kappa with quadratic weights. Correlation between scale scores were determined by Spearman rank correlation coefficients and the difference between correlation coefficients was tested through the two tailed Fisher's z transformation. Multiple regression models were built to identify disability (SCOPA-Motor, Part B. ADL) and quality of life (EQ-5D, PDQ-8) predictors.
A post-hoc analysis was carried out using the CISI-PD as a criterion for global PD severity . CISI-PD total scores have been previously categorized in global levels of PD severity (1–7 points = mild; 8–14: moderate; and ≥15 points = severe)  and this classification was used to create NMSS score categories to be compared with those obtained by means of centiles. Due to skewed distribution of the NMSS scores and the CISI-PD ordinal level of measure a categorical regression analysis was used to determine the association between NMSS scores and CISI-PD severity levels.
Data analysis was carried out using Stata 11.2 (StataCorp, College Station, Texas).
Nine hundred and fifty one patients, 62.6% males, were included in the study. The clinical characteristics of the sample are displayed in the Table 1. The distribution of patients by HY ratings was (n = 949): stage 1, 125 (13.2%); stage 2, 412 (43.4%); stage 3, 284 (29.9%); stage 4, 108 (11.4%); and stage 5, 20 (2.1%). Of the 835 patients with available data on treatment, 81.0% received treatment with levodopa; 58.3%, dopamine agonists; 8.0%, selegiline; 15.0%, rasagiline; 15.6%, amantadine; and 1.1%, apomorphine. Levodopa and dopamine agonists were combined in 47.3%; 44 patients (5.3%) were untreated; and 35 (3.7%) had undergone deep brain stimulation surgery for PD.
There were 19 missing scores in NMSS domains from sixteen patients (1.7%). Due to the structure of the scale, imputation was not carried out and NMSS total score refers to the 935 patients (98.3%) with full data. The number of NMS and the NMSS scores related to each NMSB level are shown in Table 2.
Table 3 shows scores from other disease-related variables in the study broken down by NMSB levels. As a whole, figures indicate a significant worse state in all aspects as the NMSB level increases. The same performance was obtained with grouping by HY stages, but figures were clearly different between both methods (Table 3).
The correlation coefficient between motor disturbance ratings (SCOPA-Motor) and the non-motor symptoms (Non-Motor Symptoms Scale) was 0.43 (p<0.0001) in the series, ranging from 0.18 to 0.36 (weak correlation; p = 0.01–0.0001) for patients in HY stages 1 to 4 and only showing a high correlation for patients in stage 5 (rS = 0.65; p<0.0001).
The corresponding distribution of patients by HY stages and NMSB levels is shown in Table 4. The agreement between these ratings of severity was weak (kappa = 0.39; CI95%: 0.37–042) and the difference in the classification of cases was statistically significant (gamma = 0.45, ASE = 0.032).
The following ranges and categories were obtained from the categorical regression between NMSS score and CISI-PD severity levels: 0 (absence of NMS); 1 to 15 points (mild NMS burden); 16 to 40 points (moderate NMS burden); 41 to 65 (severe NMS burden); and ≥66 points (very severe NMS burden). The coincidence between classification of patients by these levels from categorical regression and those based on the interquartile range was 858/935 (91.8%), with an agreement (kappa) = 0.97 (CI95%: 0.96–0.97). Discrepancies (8.2%) were restricted to the NMSB levels 1 (n = 55) and 3 (n = 22).
Disability, as per the SCOPA-Motor, Part B. ADL scores, was closely associated to motor impairment (motor examination + motor complications (rS = 0.76), but correlated moderately with NMSS scores (rS = 0.47) (Fisher's z = −11.83, 2-tailed p<0.0001). Concerning HRQoL, EQ-5D index correlated with motor impairment (rS = −0.53) and NMSS (rS = −0.50) (Fisher's z = 0.55; p = 0.29) and PDQ-8 scores correlated with both motor impairment and NMSS scores (rS = 0.48 and 0.51, respectively; Fisher's z = 0.86; 2-tailed; p = 0.38).
After exclusion of interaction and co-linearity, age, sex, motor impairment (SCOPA-Motor, Part A. Examination), and NMSS scores were introduced as independent variables in a multiple regression model with SCOPA-Motor, Part B. ADL as dependent variable (F = 436.77; adjusted R2 = 0.65; p<0.0001) while similar regression models examined EQ-5D (F = 169.17; adjusted R2 = 0.43; p<0.0001) and PDQ-8 (F = 150.20; adjusted R2 = 0.39; p<0.0001) as dependent variable. The most powerful independent predictors were: for ADL, motor impairment (standardized beta = 0.68) followed by NMS (beta = 0.20); for PDQ-8 scores, NMSS scores (beta = 0.39) followed by motor impairment (beta = 0.37); and for EQ-5D motor disorder followed by NMS (motor = 0.39; NMS = 0.37). In all models, age and sex had a null or weak influence (beta<0.10).
The key outcomes of this study are:
- A new strategy for clinical classification of PD patients using the NMSS in 5 stratified levels of burden (0–4 = no NMS, 4 = very severe load of NMS, Tables 2 and 3). This simple assessment could be added to existing motor-based staging (i.e., HY) to complement PD assessment and avoid overlooking the weight of the NMS.
- Confirmation of the significant influence of NMSB on disability and quality of life, highlighting the need to include a NMS evaluation for a complete assessment of PD patients.
This paper is aimed to propose a pragmatic, data driven clinical assessment system for PD to meet a key unmet need and a clinical challenge. We are not trying to discriminate PD patients from a control population neither is the study designed to address causation of NMS such as the role of drug therapy and pathogenesis of NMS. Instead, the NMSB classification would flag up the level of NMS load using a numerical cutoff along with motor staging to describe better the patient situation. In addition, the NMSB classification will help the physician to establish priorities in patients management taking into account disease manifestations which importance may be overlooked , .
Although NMS burden increases with increasing severity of other domains affected by PD, the correlation between motor disorder, as rated by the SCOPA-Motor, and NMS was moderate (rS = 0.43), showing a loose association in all stages except the most advanced one. Most importantly, a clear discordance between motor and non-motor disturbance exists, with patients in the milder stages of motor disorder having considerable non-motor burden. For example, over one third (34.5%) of patients in HY stage 1 and 2 had severe or very severe NMSB in the present study (Table 4). This fact justifies the need, for a more complete assessment, of a specific method for classification of PD patients according to NMSB.
The proposed classification was supported by a benchmark based on clinician's global impression of severity (CISI-PD). Categorical regression allowed assignment of NMSS scores to CISI-PD ordinal categories of severity  and this distribution showed an excellent concordance with the proposed classification based on quartiles (agreement, 91.8%; kappaw = 0.97, “almost perfect”) .
The importance of NMS in PD is well established and several observational and controlled studies have reported the high prevalence of NMS in PD , –. Patients, irrespective of early or advanced disease, rate NMS as one of their “first choice” symptoms of concern  and untreated PD patients show a high burden of NMS , . These observations and our data confirm the fact that when questioned systematically very few patients are free of any NMS. Our cohort of patients included drug naive and advanced cases on a range of drug therapies and all HY stages (Tables 1 and 3). A wide range of patients' age was spanned in our study, although the relatively low mean age (64 years) reflects the fact that the oldest PD patients are typically not referred to the movement disorders clinics and, therefore, were under-represented in this cohort. We feel this is a reasonably representative cohort of PD patients assisted in departments of neurology and specialized units and shows how NMS occurs in early, moderately advanced and advanced PD, as also reported by the PRIAMO study .
We also corroborate that the burden of NMS is a key determinant of quality of life in PD , , ,  and indeed this is one of the key outcomes of this work. This is illustrated by the regression models where the burden of NMS appears to be as important a predictor of quality of life (EQ-5D and PDQ-8) as is motor impairment. Interestingly, when both motor and non-motor impairment are taken into account, age had a negligible influence on quality of life, a finding that emphasises the considerable impact of both motor and non-motor disabilities on patients. These are important issues as the basis of assessment and therapeutic strategies in PD should be driven by impact on quality of life , .
What then could be the clinical implications if NMSB classification as proposed in this paper is adopted in “real life” practice? Firstly the proposed numerical grading should help improved patient care by alerting the clinician for the need for addressing treatable NMS . In current clinical practice, NMS burden is often not assessed and a European study reported that various NMS were never declared to health care professionals in 60% of cases compromising care . Secondly, the statistical concordance between HY staging and NMS classification denotes only weak agreement (when k = 0.21 to 0.40)  between these two assessment paradigms. For instance, as shown in Table 4, only 5 patients in HY stages 1 or 2 reported no NMSB whereas 76 experienced NMSB grade 4 (very severe). Conventionally, HY stage 1 and 2 represent mild PD, but this qualification cannot be supported attending the load of NMS, any domain/s they belong. The non-motor manifestations present in PD may be very variable in number and type and they maintain only a moderate association with the motor disturbances. Clinical and neuropathological data are now emerging supporting our concept of the aforementioned non-motor dominant endophenotype and the clinical heterogeneity of PD , , .
The strength of this analysis is the large number of patients included spanning early and untreated to very advanced motor disease and a range of therapies. However, there are obvious limitations to this exploratory work. Firstly we do not have control data for this study although in the validation of our NMS instruments a collection of healthy control data was obtained showing that while some NMS such as insomnia, nocturia and pain may be common amongst controls, the severity of these symptoms is considerably greater in PD . Additionally, the proposed classification is not aimed at discrimination of PD from controls and it would not be feasible to apply the HY classification to a control population.
An important limitation of the study is its selection bias, as patients were recruited from specialized units of tertiary centres and, therefore, findings may not be generalizable to the entire PD population. The most advanced phases of disease were under-represented and this may have influenced results leading, for example, to false high correlations between motor and non-motor problems for HY stage 5.
Like many studies evaluating symptoms, we used a relatively “cognitively intact” cohort. As such one may argue that lack of inclusion of patients with dementia would be a drawback of this study. We would, however, point out that only patients with “overt” dementia were excluded and the sample studied includes patients with cognitive impairment and would be reflective of PD population normally seen in clinics spanning untreated to advanced PD. This approach was required as the NMSS and other scales would be difficult to complete in patients with frank dementia.
NMSS relates to symptoms over the “last month”. The assessments are done largely in “on” state and reflect the fact that this work is aimed at a “global” assessment which encapsulates “on” and “off” phases while recording NMS. Furthermore, also were included patients in early disease states who are either untreated or do not have clearly defined on and off fluctuations. Nonetheless, in the present study, comparison between the NMS levels and the motor HY staging (Table 4) is only valid for patients "on" medication, as the "off" medication state was not considered and this fact could substantially modify the results.
It is possible that NMS recorded may be modified by dopaminergic therapies however, in this study as we are evaluating motor and NMS at the point of examination, it is irrelevant if the patient has drug related NMS as this study cannot identify the cause of the NMS. Additionally, the identification of a high NMS load in such a case, for instance, may allow the clinician to address drug related causation.
We, therefore, propose that a combined motor staging (with HY) and NMS burden classification (from grade 0–4) be adopted for use in clinical practice. Further large scale longitudinal and clinico-pathological correlation studies are now required to define the prognostic and clinical value of the NMSB grading strategy.
We acknowledge all contributors to the non-motor scale validation programmes which generated the data for this analytical study (Annex S1). The original non-motor symptoms scale was developed by the international Parkinson's disease non-motor group also supported by Parkinson's UK and the Movement Disorders Society. Current work was also supported by the European Parkinson's Disease Association. The work has also been reviewed as relevant to patient lives and management by an expert patient group CRISP recognised by the UK Department of Health research network. We thank Miss Kristina Røkenes Karlsen for editorial help with manuscript and figures. We would also like to thank Dr. Antoniya Todorova for her help with references and submission of the manuscript.
Review of the manuscript: DJB RJB. Conceived and designed the experiments: KRC PMM. Performed the experiments: KRC PMM AHVS FS PO AA. Analyzed the data: PMM JMR. Contributed reagents/materials/analysis tools: PMM. Wrote the paper: KRC PMM.
- 1. Chaudhuri KR, Schapira AHV (2009) The non motor symptoms of Parkinson's disease: dopaminergic pathophysiology and treatment. Lancet Neurol 8: 464–474.
- 2. Martinez-Martin P, Rodriguez-Blazquez C, Kurtis MM, Ray Chaudhuri K (2011) on behalf of the NMSS Validation Group (2011) The Impact of Non Motor Symptoms on Health-Related Quality of Life of Patients with Parkinson's Disease. Mov Disord 26: 399–406.
- 3. Wickremaratchi MM, Knipe MD, Sastry BS, Morgan E, Jones A, et al. (2011) The motor phenotype of Parkinson's disease in relation to age at onset. Mov Disord 26: 457–463.
- 4. Jellinger KA (2012) Neuropathology of sporadic Parkinson's disease: evaluation and change of concepts. Mov Disord 27: 8–30.
- 5. Van Rooden SM, Colas F, Martinez-Martin P, Visser M, Verbaan D, et al. (2011) Clinical subtypes of Parkinson's disease. Mov Disord 26: 51–58.
- 6. Stern MB, Lang A, Poewe W (2012) Toward a Redefinition of Parkinson's Disease. Mov Disord 27: 54–60.
- 7. Mavandadi S, Nazem S, Ten Have TR, Siderowf AD, Duda JE, et al. (2009) Use of Latent Variable Modeling to Delineate Psychiatric and Cognitive Profiles in Parkinson Disease. Am J Geriatr Psychiatry 17: 986–995.
- 8. Schapira AHV, Schrag A (2011) Parkinson's disease, clinical subtypes and their implications. Nat Rev Neurol 7: 247–248.
- 9. Hoehn MM, Yahr MD (1967) Parkinsonism: onset, progression, and mortality. Neurology 17: 427–442.
- 10. Hughes AJ, Daniel SE, Blankson S, Lees AJ (1993) A clinicopathological study of 100 cases of Parkinson's disease. Archives of Neurology 50: 140–148.
- 11. Calne D (2005) A definition of Parkinson's disease. Parkinsonism Relat Disord 11 (Suppl 1)S39–S40.
- 12. Chaudhuri KR, Healy D, Schapira AHV (2006) The non-motor symptoms of Parkinson's disease. Diagnosis and management. Lancet Neurol 5: 235–245.
- 13. Hely MA, Reid WG, Adena MA, Halliday GM, Morris JG (2008) The Sydney multicentre study of Parkinson's disease: the inevitability of dementia at 20 years. Mov Disord 23: 837–844.
- 14. Lees AJ, Hardy J, Revesz T (2009) Parkinson's Disease. Lancet 373: 2055–2066.
- 15. Berg D (2012) Is pre-motor diagnosis possible? The European experience. Parkinsonism & related disorders 18 Suppl 1S195–8.
- 16. Chaudhuri KR, Prieto-Jurcynska C, Naidu Y, Mitra T, Frades-Payo B, et al. (2010) The non declaration of non motor symptoms of Parkinson's disease to health care professionals: an international study using the non motor symptoms questionnaire. Mov Disord 25: 704–709.
- 17. Martinez-Martin P, Rodriguez-Blazquez C, Abe K, Bhattacharyya KB, Bloem BR, et al. (2009) International study on the psychometric attributes of the Non-Motor Symptoms Scale in Parkinson disease. Neurology 73: 1584–1591.
- 18. Chaudhuri KR, Martinez-Martin P, Brown RG, Sethi K, Stocchi F, et al. (2007) The metric properties of a novel non-motor symptoms scale for Parkinson's disease: results from an international pilot study. Mov Disord 22: 1901–1911.
- 19. Marinus J, Visser M, Stiggelbout AM, Rabey JM, Martinez-Martin P, et al. (2004) A short scale for the assessment of motor impairments and disabilities in Parkinson's disease: the SPES/SCOPA. J Neurol Neurosurg Psychiatry 75: 388–395.
- 20. Martinez-Martin P, Benito-León J, Burguera JA, Castro A, Linazasoro G, et al. (2005) The SCOPA-Motor Scale for assessment of Parkinson's disease is a consistent and valid measure. J Clin Epidemiol 58: 674–679.
- 21. Martinez-Martin P, Forjaz MJ, Cubo E, Frades B, de Pedro Cuesta J, et al. (2006) Global versus factor-related impression of severity in Parkinson's disease: A new clinimetric index (CISI-PD). Mov Disord 21: 208–214.
- 22. Martinez-Martin P, Rodriguez-Blazquez C, Forjaz MJ, de Pedro J (2009) on behalf of the Spanish-American Longitudinal PD Patient Study Group (2009) The Clinical Impression of Severity Index for Parkinson's disease: International Validation Study. Mov Disord 24: 211–217.
- 23. EuroQol Group (1990) EuroQol–a new facility for the measurement of health-related quality of life. Health Policy 16: 199–208.
- 24. Schrag A, Selai C, Jahanshahi M, Quinn NP (2000) The EQ-5D —a generic quality of life measure-is a useful instrument to measure quality of life in patients with Parkinson's disease. J Neurol Neurosurg Psychiatry 69: 67–73.
- 25. Jenkinson C, Fitzpatrick R, Peto V, Greenhall R, Hyman N (1997) The PDQ-8: Development and validation of a short-form Parkinson's Disease Questionnaire. Psychol Health 12: 805–814.
- 26. Martinez-Martin P, Jeukens-Visser M, Lyons KE, Rodriguez Blazquez C, Selai C, et al. (2011) Health-related Quality of Life Scales in Parkinson's Disease: Critique and Recommendations. Mov Disord 26: 2371–2380.
- 27. Shulman LM, Taback RL, Rabinstein AA, Weiner WJ (2002) Non-recognition of depression and other non-motor symptoms in Parkinson's disease. Parkinsonism Relat Disord. 8(3): 193–197.
- 28. Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33: 159–174.
- 29. Antonini A, Barone P, Marconi R, Morgante L, Zappulla S, et al. (2012) The progression of non-motor symptoms in Parkinson's disease and their contribution to motor disability and quality of life. J Neurol 259: 2621–2631.
- 30. Müller B, Larsen JP, Wentzel-Larsen T, Skeie GO, Tysnes OB, et al. (2011) Autonomic and sensory symptoms and signs in incident, untreated Parkinson's disease: frequent but mild. Mov Disord. 26: 65–72.
- 31. Martinez-Martin P, Schapira AHV, Stocchi F, Sethi K, Odin P, et al. (2007) Prevalence of non motor symptoms in Parkinson's disease in an international setting; study using non-motor symptoms questionnaire in 545 patients. Mov Disord 22: 1623–1629.
- 32. Politis M, Wu K, Molloy S, G Bain P, Chaudhuri KR, et al. (2010) Parkinson's disease symptoms: the patient's perspective. Mov Disord 25: 1646–51.
- 33. Kingsbury AE, Bandopadhyay R, Silveira-Moriyama L, Ayling H, Kallis C, et al. (2010) Brain stem pathology in Parkinson's disease: an evaluation of the Braak staging model. Mov Disord 25: 2508–2515.
- 34. Damiano AM, Snyder C, Strausser B, Willian MK (1999) A review of Health-related quality-of-life concepts and measures for Parkinson's disease. Qual Life Res 8: 235–243.
- 35. Schrag A, Jahansahi M, Quinn NP (2000) What contributes to quality of life in patients with Parkinson's disease? J Neurol Neurosurg Psychiatry 69: 308–312.
- 36. Sherbourne CD, Sturm R, Wells KB (1999) What outcomes matter to patients?. J Gen Intern Med 14: 357–363.
- 37. Bowling A, Bowling A (2005) Measuring health. A review of quality of life measurement scales. Open University Press, Berkshire, England.
- 38. Burn DJ, Landau S, Hindle J, Samuel M, Wilson K, et al. (2012) Parkinson's Disease Motor Subtypes and Mood. Mov Disord 27(3): 379–386.
- 39. Chaudhuri KR, Martinez-Martin P, Schapira AHV, Stocchi F, Sethi K, et al. (2006) An international, multicenter pilot study of the the first comprehensive self-completed non motor symptoms questionnaire for Parkinson's disease: the NMSQuest Study. Mov Disord 21: 916–923.