In Parkinson's disease (PD), the complex relationship between motor symptoms, affective states, and contextual factors remains to be elucidated. The Experience Sampling Method provides (ESM) a novel approach to this issue. Using a mobile device with a special purpose application (app), motor symptoms, affective states and contextual factors are assessed repeatedly at random moments in the flow of daily life, yielding an intensive time series of symptoms and experience. The aim of this study was to study the feasibility of this method.
We studied the feasibility of a five-day period of ESM in PD and its ability to objectify diurnal fluctuations in motor symptom severity and their relation with affect and contextual factors in five PD patients with motor fluctuations.
Participants achieved a high compliance, with 84% of assessment moments completed without disturbance of daily activities. The utility of the device was rated 8 on a 10-point scale. We were able to capture extensive diurnal fluctuations that were not revealed by routine clinical assessment. In addition, we were able to detect clinically relevant associations between motor symptoms, emotional fluctuations and contextual factors at an intra-individual level.
Citation: Broen MPG, Marsman VAM, Kuijf ML, Van Oostenbrugge RJ, van Os J, Leentjens AFG (2016) Unraveling the Relationship between Motor Symptoms, Affective States and Contextual Factors in Parkinson’s Disease: A Feasibility Study of the Experience Sampling Method. PLoS ONE 11(3): e0151195. https://doi.org/10.1371/journal.pone.0151195
Editor: Igor Branchi, Istituto Superiore di Sanità, ITALY
Received: August 31, 2015; Accepted: February 24, 2016; Published: March 10, 2016
Copyright: © 2016 Broen et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The authors have no support or funding to report.
Competing interests: M. Broen, V. Marsman, M. Kuijf and R. Van Oostenbrugge have nothing to disclose. J. van Os has potential financial competing interests since he received unrestricted investigator-led research grants or recompense for presenting research at meetings from Eli Lilly, Bristol-Myers Squibb, Lundbeck, Organon, Takeda, Janssen-Cilag, GlaxoSmithKline, AstraZeneca, Pfizer and Servier. This does not alter the authors' adherence to PLOS ONE policies on sharing data and materials. A.F.G. Leentjens has potential financial competing interests since he received research grants from the Michael J Fox Foundation and the Stichting Internationaal Parkinson Fonds, as well as royalties from Reed-Elsevier, de Tijdstroom and Van Gorcum publishers. In addition he receives payment from Elsevier Inc as Editor-in-Chief of the Journal of Psychosomatic Research. This does not alter the authors' adherence to PLOS ONE policies on sharing data and materials.
Parkinson disease is a complex neurodegenerative disease with both motor and nonmotor symptoms. In time, most patients with Parkinson's disease (PD) eventually develop motor fluctuations such as “wearing-off” and “on-off” fluctuations. It has been estimated that two thirds of these patients also experience mood fluctuations [1, 2] and that these fluctuations are often more disabling and distressing to patients than motor symptoms . Moreover, it is increasingly recognized that personal circumstances and contextual factors may also impact the severity of motor symptoms as well as the well-being of PD patients. However, the relationship between affect, motor fluctuations and their social context remains to be elucidated . Traditional research methods are unlikely to provide sufficiently detailed and personal information to provide insight into the relationship between these variables. Assessing subjects several times a day during their normal daily activities, which is possible with the Experience Sampling Method (ESM), may not only provide information about the frequency and severity of emotions or motor fluctuations, but also provide valuable information on situational and behavioural moderators driving these fluctuations [5–8].
The ESM approach is gaining terrain in the study of psychopathology, [5, 6, 9, 10] and is previously used among others, in studies on depression , asthma , irritable bowel syndrome  and migraine . To date, this approach had not yet been used in a PD population. The well known, but complex relation between the severity of motor symptoms in PD with affect and contextual factors, varying during the course of the disease, represents a particularly good target for ESM. The method assesses symptoms, contextual factors and other variables several times a day at random intervals in the subject’s natural environment [5, 6]. The primary aim of this study was to assess the feasibility of ESM in PD. In addition, we present an overview of the utility of ESM in 5 PD patients with motor fluctuations for detecting intra-individual associations between motor fluctuations, affective states and contextual factors.
This study was part of a clinical initiative to assess the feasibility of ESM for routine outcome monitoring in a psychiatric outpatient population . The parent study was exempt from ethical approval since it concerns routine clinical follow-up measurements. For our pilot study five consecutive PD patients with motor fluctuations from the multidisciplinary movement disorder clinic were asked to participate in this initiative to assess the feasibility of the ESM method to detect intra-individual fluctuations. PD was diagnosed according to the Queens Square Brain Bank criteria . Subjects with known cognitive impairment, operationalized as an MMSE <24, were excluded given anticipated difficulties in working with the mobile ESM application (PsyMate device). All approached subjects gave written informed consent. The parent study was approved by the Institutional Review Board of Maastricht University Medical Center.
The Experience Sampling Method (ESM)
ESM is based on multiple repeated (within-subject) mini-measurements of experience (motor symptoms, anxiety, affect, wellbeing, motivation, stress) and context (medication use, stressors, situations, activities) at unselected semi-random moments in daily life. Within-subject data provide subjects and health professionals with the opportunity to follow intra-individual changes in relation to in-the-moment daily life situations and experiences. As it assesses the occurrence of motor symptoms, mental states and contexts in the flow of daily life, ESM Is a validated, structured diary technique to assess subjects in their daily living environment [5, 16]. ESM is able to follow the impact of motor and mental states, as well as their context, on each other over time.
The PsyMate device used in this study , was an iPod touch with a special ESM app installed. The device is programmed to generate 10 beeps per day at semi-random moments in 90-minutes time blocks between 7:30 and 22.30, for 5 consecutive days (total of 50 measurement points). At each beep, the PsyMate presents a number of questions on the experience of motor symptoms, affective states and contextual factors, which are recorded through a touch screen (Fig 1, screenshot question). First, subjects were asked if they felt in their “on” or “off” state, the latter being a state where in their opinion the dopaminergic medication was not working anymore (due to the short half-time of levodopa preparations). For example, when just before the next medication gift the subject experienced more motor- (return of parkinsonism), sensory- or autonomic symptoms, they answered they were in an “off” state. On the contrary, when subjects experienced few complaints during dopaminergic treatment, they answered “on”. We included 5 Parkinson-specific questions, rating the symptoms ‘tremor’, ‘rigidity’, ‘problems with walking’, ‘balance problems’ and ‘dyskinesia’. These questions were selected from the Unified Parkinson Disease Rating Scale (UPDRS) which is a commonly used scale in PD . Since this was a pilot study we only included general motor symptoms and not more specific motor symptoms such as freezing, which is only present in a small proportion of PD patients. All of the included motor symptoms are strongly correlated with quality of life . To assess affect state we used a constructed composite score for positive affect (PA) and negative affect (NA) , in line with previous studies [20, 21]. PA comprised the weighted average of scores on the affect adjectives: ‘happy’, ‘satisfied’, ‘relaxed’ and ‘feeling well’ and for NA: ‘insecure’, ‘lonely’, ‘anxious’, ‘irritated’, ‘guilty’, ‘suspicious’ and ‘threatened’. As contextual factors, the whereabouts, presence of others, and activities of the subject were registered, as well as how comfortable the subject felt in these circumstances. All PD symptoms and affect adjectives were rated by subjects on a 7-point Likert scale ranging from 1 = ‘not at all’ to 7 = ‘very’. A complete overview of the questions is given in S1A Table. The questions were the same for each measurement point. In addition, once in the morning and once in the evening, subjects had to fill in additional ‘morning’ and ‘evening’ questionnaires (S1B Table). The application uploaded the responses in an anonymized central database, from which they were analyzed. The data collection method can be considered ecologically valid measures of the subject’s circumstances and affective fluctuations in the flow of daily life [5, 6, 22].
Baseline demographic and disease-related characteristics were collected during a visit at the outpatient clinic (MPGB). In addition, the following scales were applied: the Hoehn and Yahr stage , the UPDRS to quantify motor symptoms, the Mini-Mental State Examination (MMSE) to assess global cognitive function , the Beck Depression Inventory II (BDI-II) to assess depressive symptoms , the Parkinson Anxiety Scale (PAS)  to assess anxiety symptoms and the Parkinson Disease Questionnaire-8 (PDQ-8)  to assess quality of life. During the assessment subjects received oral information on how to interpret the question about the “on” or “off” state. On the same day, information about the PsyMate as well as a demonstration was given in person (VAM). Subjects were given the option to either download and use the PsyMate on their own smartphone (iOS or Android), or to use an iPod touch provided by Maastricht University Medical Centre for the duration of the study. During the following five consecutive days the PsyMate generated a total of 50 semi-random measurement points, 10 per day. At day two, subjects were called to check whether everything was clear and functioning correctly. At any time during the study period, subjects could ask for help by calling one of the investigators (VAM). After five days, they returned the device and the data were collected in an anonymized central database. Two weeks later, the subjects were interviewed by telephone about their experiences with the device (see S1C Table for evaluation questions).
Before running the analysis, missing items due to technical issues of the device were excluded from the data set. First, descriptive statistics were calculated for all PD symptom variables, as well as PA and NA. Since all variables were not normally distributed (kurtosis values ranging from 2.9 to 28.7), correlations were computed with Spearman’s rho. Strength of the correlation was defined as r < 0.3 very small, r = 0.3–0.5 small, r = 0.5–0.7 moderate and r > 0.7 strong. Additionally, effect sizes were calculated by calculating Cohen’s d, e.g. a 1 point change on the scale has an effect size of 1/standard deviation of the variable. Strength of the effect size was defined as medium d = 0.3–0.6 and large d > 0.6. Analyses were done using the statistical software program STATA (version 13.1 for Mac).
Table 1 shows baseline characteristics of the 5 subjects. The mean age was 60.4yr (SD 6.1). All subjects had a Hoehn and Yahr stage of 2–2.5, which indicates bilateral or midline involvement of the disease, without impairment of balance or a recovery on the pull test. The mean UPDRS III score was 22 (SD 6.2). On the PAS, subject 1 and 4 scored above the cut-off point of 13/14 indicating clinically relevant anxiety. Subject 4 also scored above the cut off score of 14/15 on the BDI-II, which fits with a mild depression. Quality of life of the subjects was relatively good with a maximum score of 13 out of 32, with higher scores indicating a lesser quality of life.
A mean total of 84% (range 76–96%) of all 50 measurement points were completed correctly. Previous research has shown that ESM data validity is compromised if less than one third of beeps yield data . All subjects in met this requirement. Subject 2 and 3 both missed three beeps because they did not hear the sound of the alarm and subject 4 went swimming several times and missed four beeps when she was in the water. Unfortunately, when transferring data from the device of subject 1, data of fifteen measurement points were lost due to connection malfunction. The exact cause of this malfunction remains unclear. There was no significant difference in terms of compliance between the three subjects using their own smartphone and the two using an Ipod (89% vs 83%).
User friendliness, evaluation and feedback
All subjects found the information about the PsyMate device clear and concise. None of them said they changed their daily behaviour. This occasionally led to a missed assessment point when they were showering, swimming, riding a bike or driving a car. Three subjects used their own smartphone and two used an iPod. These two were not inconvenienced by having to carry the iPod device with them. Beep assessments never took more than 5 minutes, with a mean completion time between 2 and 3 minutes. The mean utility score that the subjects gave the device was 8 on a 10-point scale. Some subjects suggested also including questions about exercise, since in their own experience this also influences their affect. Three subjects mentioned that repetitive assessments tended to get boring. However, studying the relationship between affect and motor fluctuations and contextual factors was considered very meaningful by all subjects and they all would participate in future ESM studies.
Ability to detect diurnal fluctuations in motor symptom severity at an individual level
Fig 2 shows the overall motor symptom severity and the real-time diurnal fluctuations in motor symptom severity of subject 4. Cohen’s d for tremor was .75 and 1.28 for PA, with indicates a large, meaningful effect size of a 1 point change on the Likert scale. Similar patterns were found in all subjects. These figures show that ESM is sensitive enough to capture clinically relevant diurnal fluctuations of motor symptom severity.
a and b. Cross-sectional overall daily assessment (Fig 2a) versus real-time measurements (Fig 2b) of motor symptoms in subject 4. Legend: Y-axis: item score (1 = not all, 7 = very much); X-axis: time. Blue solid line: Tremor; Orange line: Dyskinesia; Red line: Trouble Walking; Green line: Rigidity.
Ability to detect intra-individual relationships between motor symptoms, affect and contextual factors in 5 PD subjects with motor fluctuations
First, since subjects with mood fluctuations are more likely to have higher scores on psychiatric rating scales , we expected that subjects 1 and 4, which had the highest scores on the anxiety and depression rating scales, would also have the strongest correlation between motor symptoms, affect and possibly contextual factors. This was especially true for the severity of the tremor; both subject 1 and 4 had a moderate negative correlation between positive affect and the severity of the tremor (r = -0.5, p < .01). For subject 1, Cohen’s d for tremor was .57 and 2.63 for PA, indicating a large effect size for a 1-point change on the Likert scale. See Figs 3 and 4 for an example of the fluctuations of tremor and affect during the day. In Fig 3, one can see that the severity of the tremor fluctuates heavy, but the positive affect line shows only minor changes. This is most likely because the PA is a weighted average of 4 affect adjectives and when looking closer at the data it turned out that mainly the variable “satisfied” had a correlation with tremor (r = -0.6, p < .01). In subject 4, feeling relaxed (r = -0.6, p < .01), satisfied (r = -0.6, p < .01) and feeling happy (r = -0.4, p < .01) all had a negative correlation with tremor severity, visible as a more fluctuating PA pattern in the diagram. On the contrary, subject 5 had the lowest scores on the rating scales and we were unable to find a significant correlation between affect and any of the motor or contextual factors.
Second, we evaluated the influence of context on the severity of motor symptoms. Again, in subject 1, the effect was most impressive. Fig 5 shows that all motor symptoms were more severe when he was not at home but in public. In the other subjects it was difficult to find a correlation between contextual factors and symptom severity, mainly because the measurement point were not evenly distributed, e.g. most of the measurements were taken at home, or in company with their spouses with only a few measurements taken in the opposite situation which makes a statistical comparison difficult.
Legend: Y-axis: item score (1 = not all, 7 = very much); X-axis: motor symptoms.
Third, to test whether individual motor symptoms were logically correlated, e.g. improved rigidity will normally lead to impaired balance or walking difficulties, we calculated these correlations in subject 3, who had a moderate score on the UPDRS III. We found a strong correlation between rigidity and the severity of walking difficulties (r = 0.8, p < .01). Balance problems were moderate correlated with dyskinesia (r = 0.6, p < .01) and also strongly correlated with walking difficulties (r = 0.8, p < .01). For subject 3 Cohen’s d for balance problems was 1.90, for walking difficulties 1.26 and 3.51 for dyskinesia. Similar correlation coefficients were found in the other subjects, which indicated that their symptoms were logically scored.
Last, we tried to detect effects of dopaminergic treatment on the motor symptoms or affect fluctuations. However, in this pilot application subjects were not asked to mark at what exact time they took their medication, so we were only able to visible link their prescription time with the severity of their symptoms. For example, according to her prescription time subject 4 took levodopa medication at 7 and 11 o’clock in the morning, three o’clock in the afternoon and 7 and ten o’clock in the evening. Looking at her severity of the tremor (Fig 4), it seems that the tremor was worse just before she took her medication (point 3, 10:56) and less severe just after her medication (point 6, 15:08). Since the tremor severity and positive affect were correlated, this was also true for her affective state, having a more positive affect just after the medication gift. However, we realize this is not very accurate, since actual medication times can differ notoriously from prescription times.
This pilot study shows that ESM is a viable and promising method for evaluating affect and motor fluctuations in relation to contextual factors in PD. Subjects achieved a high compliance rate without disturbance of normal daily activities. The average rating of the utility of the device was an 8 on a 10-point scale. Subjects were confident that ESM had the potential of revealing meaningful information of factors associated with fluctuations in motor symptom severity. ESM proved to be sensitive enough to capture extensive diurnal fluctuations in motor symptom severity, affective states and contextual factors.
The advantage of ESM is that assessments take place in the flow of daily life, in the natural environment of the subject. This is important since contextual factors play an important role in motor symptom severity, affect and behavior [29, 30]. By assessing subjects during normal activities in their natural environments, ESM avoids some of the methodological problems commonly encountered in research, which has implications for treatment. First, it reduces recall bias. Current assessments in clinical settings often rely on retrospective questionnaires and this possible leads to several sources of recall bias. It has been shown in depressed subjects that there is a high discrepancy between retrospective ratings and actual experiences . Another advantage is that by using an electronic device, investigators can be confident that the ratings were actually completed at the time specified by the research design, which one cannot be sure of when using repeated paper questionnaires. This avoids the problem of “back-filling” the diaries when subjects neglect to make ratings at the scheduled time. A clinical advantage of the ESM approach is that multiple repeated assessments within each subject, forming an intensive time series of symptoms, context and experience, increases the power of the data to such an extent that analysis of single subject time series becomes possible. This enables the recognition of highly individual patterns of reactivity to contextual factors, and may facilitate the prediction of ‘off’-periods and other important transitions . Person-specific patterns may be fed back to the subject to enhance insight into factors associated with symptom severity and facilitate self-management. Behavioural insight may enhance feelings of mastery over the symptoms, and facilitate coping or adjustment of activities. Providing feedback may also lead to an increased sense of involvement in treatment, better adherence and better treatment outcome, as was previously reported in other subject populations, such as subjects with depression, migraine and asthma [33–35].
The monitoring of treatment progress is also a promising clinical application. ESM may reveal relatively small treatment effects by avoiding clouding due to recall bias when using retrospective self-report measures . This would allow for more targeted and individualized pharmacotherapy. A practical advantage is that ESM software is freeware and can be downloaded for free as an app on smart phones or iPods.
A possible limitation of ESM used in our study is that it needs a certain level of motor function to use the telephone device but also a sufficient cognitive level to understand the information and learn to use the PsyMate program. For this reason, the use of ESM is limited to a selected population with sufficient cognitive and motor function, which in future studies could lead to selection and lack of generalizability. However, in most PD studies a certain level of cognitive function is already required. Second, the presence of motor fluctuations was based on self-reports, i.e. were not observer-rated, which may differ objective ratings of fluctuations. Previous studies on motor and mood fluctuations reported a discrepancy between self-reported and physician-documented motor fluctuations, which could be due to “over reporting” of fluctuations by subjects but also by the tendency of neurologists to continue to view subjects who have developed motor fluctuations as “fluctuators”, regardless of how well controlled their symptoms are at a given time . Such overestimation of fluctuations could be a problem, especially when treatment modifications are made due to ESM results. To further objectify the motor fluctuations additional use of an accelerometer is a possible solution, a method that is currently finding its way in studies of movement and gait disorders in PD [37, 38]. With respect to the overestimation of emotional fluctuations, previous research has shown that self-reports are an useful source of data when dealing with immediate experiences such as affective states [16, 39]. In our study it seems that the self-reports on emotional items are plausible representations of reality. However, this needs to be validated further. Last, our study was part of a larger study on ESM in a psychiatric population. Further studies are needed to validate our preliminary findings on the ability of ESM to detect meaningful intra-individual relationships. These future studies should implement an ESM questionnaire optimized for PD patients, e.g. more questions about motor symptoms and a more precise medication time queue which enables researches to better detect medication influences. In addition, PD patients with different stages of the disease should be included, to extend our findings in subjects who are more disabled. However, taken all these limitations into account, we think that ESM is a feasible method in PD and holds promises for future scientific and clinical implications.
ESM may be a viable and useful method in PD. Subjects reached a high compliance rate and were able to rate multiple symptoms simultaneously in a brief period of time, without disturbance of daily activities. The study shows that ESM technology is sensitive enough to capture extensive diurnal fluctuations of motor symptom severity, affective states and contextual factors in individual subjects. Therefore ESM could be a useful tool for fine grained analyses of how these variables impact each other in the flow of daily life in individual subjects, and how these patterns may be altered as a function of treatment. Detailed feedback to the subject may enhance insight and facilitate self-management, shared decision making and compliance.
Conceived and designed the experiments: JvO AL. Performed the experiments: MB VM. Analyzed the data: MB VM AL. Contributed reagents/materials/analysis tools: JvO AL VM. Wrote the paper: RvO MK JvO AL MB VM.
- 1. Nissenbaum H, Quinn NP, Brown RG, Toone B, Gotham AM, Marsden CD. Mood swings associated with the 'on-off' phenomenon in Parkinson's disease. Psychol Med. 1987;17(4):899–904. pmid:3432464
- 2. Richard IH, Justus AW, Kurlan R. Relationship between mood and motor fluctuations in Parkinson's disease. J Neuropsychiatry Clin Neurosci. 2001;13(1):35–41. pmid:11207327
- 3. Cantello R, Gilli M, Riccio A, Bergamasco B. Mood changes associated with "end-of-dose deterioration" in Parkinson's disease: a controlled study. J Neurol Neurosurg Psychiatry. 1986;49(10):1182–90. pmid:3783180
- 4. Leentjens AF, Dujardin K, Marsh L, Martinez-Martin P, Richard IH, Starkstein SE. Anxiety and motor fluctuations in Parkinson's disease: a cross-sectional observational study. Parkinsonism Relat Disord. 2012;18(10):1084–8. pmid:22771284
- 5. Delespaul P. Assessing Schizophrenia in Daily Life. The Experience Sampling Method. Delespaul P, editor. Maastricht: Maastricht University Press; 1995.
- 6. Myin-Germeys I, Oorschot M, Collip D, Lataster J, Delespaul P, van Os J. Experience sampling research in psychopathology: opening the black box of daily life. Psychol Med. 2009;39(9):1533–47. pmid:19215626
- 7. Sotgiu I, Rusconi ML. Investigating emotions in Parkinson's disease: what we know and what we still don't know. Front Psychol. 2013;4:336. pmid:23772218
- 8. Walz LC, Nauta MH, Aan Het Rot M. Experience sampling and ecological momentary assessment for studying the daily lives of patients with anxiety disorders: a systematic review. J Anxiety Disord. 2014;28(8):925–37. pmid:25445083
- 9. van Os J, Delespaul P, Barge D, Bakker RP. Testing an mHealth momentary assessment Routine Outcome Monitoring application: a focus on restoration of daily life positive mood states. PLoS One. 2014;9(12):e115254. pmid:25513813
- 10. van Os J, Delespaul P, Wigman J, Myin-Germeys I, Wichers M. Beyond DSM and ICD: introducing "precision diagnosis" for psychiatry using momentary assessment technology. World Psychiatry. 2013;12(2):113–7. pmid:23737412
- 11. Hartmann JA, Wichers M, Menne-Lothmann C, Kramer I, Viechtbauer W, Peeters F, et al. Experience sampling-based personalized feedback and positive affect: a randomized controlled trial in depressed patients. PLoS One. 2015;10(6):e0128095. pmid:26034983
- 12. Dunton GF, Liao Y, Intille S, Huh J, Leventhal A. Momentary assessment of contextual influences on affective response during physical activity. Health Psychol. 2015;34(12):1145–53. pmid:26053885
- 13. Mujagic Z, Leue C, Vork L, Lousberg R, Jonkers DM, Keszthelyi D, et al. The Experience Sampling Method—a new digital tool for momentary symptom assessment in IBS: an exploratory study. Neurogastroenterol Motil. 2015;27(9):1295–302. pmid:26100684
- 14. Houtveen JH, Sorbi MJ. Prodromal functioning of migraine patients relative to their interictal state—an ecological momentary assessment study. PLoS One. 2013;8(8):e72827. pmid:23977358
- 15. de Rijk MC, Rocca WA, Anderson DW, Melcon MO, Breteler MM, Maraganore DM. A population perspective on diagnostic criteria for Parkinson's disease. Neurology. 1997;48(5):1277–81. pmid:9153457
- 16. Csikszentmihalyi M, Larson R. Validity and reliability of the Experience-Sampling Method. J Nerv Ment Dis. 1987;175(9):526–36. pmid:3655778
- 17. http://www.psymate.eu.
- 18. Fahn S, Elton RL. Members of the UPDRS Committee. Unified Parkinson's Disease Rating Scale. In: Fahn S, Marsden CD, Goldstein M, Calne DB, editors. Recent Developments in Parkinson's Disease. Florham Park, NJ: MacMillan Health Care; 1987. p. 153–63.
- 19. Rahman S, Griffin HJ, Quinn NP, Jahanshahi M. Quality of life in Parkinson's disease: the relative importance of the symptoms. Mov Disord. 2008;23(10):1428–34. pmid:18543333
- 20. Jacobs N, van Os J, Derom C, Thiery E, Delespaul P, Wichers M. Neuroticism explained? From a non-informative vulnerability marker to informative person-context interactions in the realm of daily life. Br J Clin Psychol. 2011;50(1):19–32. pmid:21332518
- 21. Wichers MC, Barge-Schaapveld DQ, Nicolson NA, Peeters F, de Vries M, Mengelers R, et al. Reduced stress-sensitivity or increased reward experience: the psychological mechanism of response to antidepressant medication. Neuropsychopharmacology. 2009;34(4):923–31. pmid:18496519
- 22. Wichers M, Simons CJ, Kramer IM, Hartmann JA, Lothmann C, Myin-Germeys I, et al. Momentary assessment technology as a tool to help patients with depression help themselves. Acta Psychiatr Scand. 2011;124(4):262–72. pmid:21838742
- 23. Hoehn MM, Yahr MD. Parkinsonism: onset, progression and mortality. Neurology. 1967;17(5):427–42. pmid:6067254
- 24. Folstein MF, Folstein SE, McHugh PR. "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12(3):189–98. pmid:1202204
- 25. Beck AT, Steer RA, Ball R, Ranieri W. Comparison of Beck Depression Inventories -IA and -II in psychiatric outpatients. J Pers Assess. 1996;67(3):588–97. pmid:8991972
- 26. Leentjens AF, Dujardin K, Pontone GM, Starkstein SE, Weintraub D, Martinez-Martin P. The Parkinson Anxiety Scale (PAS): Development and validation of a new anxiety scale. Mov Disord. 2014;29(8):1035–43. pmid:24862344
- 27. Jenkinson C, Fitzpatrick R, Peto V, Greenhall R, Hyman N. The Parkinson's Disease Questionnaire (PDQ-39): development and validation of a Parkinson's disease summary index score. Age Ageing. 1997;26(5):353–7. pmid:9351479
- 28. Richard IH, Frank S, McDermott MP, Wang H, Justus AW, LaDonna KA, et al. The ups and downs of Parkinson disease: a prospective study of mood and anxiety fluctuations. Cogn Behav Neurol. 2004;17(4):201–7. pmid:15622015
- 29. Hufford MR, Shiffman S, Paty J, Stone AA. Ecological momentary assessment: Real-world, real-time measurement of subject experience. In: Fahrenberg J, Myrtek M, editors. Progress in ambulatory assessment: Computer-assisted pscyhological and psychophysiological methods in monitoring and field studies. Seattle, WA: Hogrefe & Huber; 2001. p. 69–92.
- 30. Peeters F, Berkhof J, Delespaul P, Rottenberg J, Nicolson NA. Diurnal mood variation in major depressive disorder. Emotion. 2006;6(3):383–91. pmid:16938080
- 31. Kizilbash AH, Vanderploeg RD, Curtiss G. The effects of depression and anxiety on memory performance. Arch Clin Neuropsychol. 2002;17(1):57–67. pmid:14589753
- 32. van de Leemput IA, Wichers M, Cramer AO, Borsboom D, Tuerlinckx F, Kuppens P, et al. Critical slowing down as early warning for the onset and termination of depression. Proc Natl Acad Sci U S A. 2014;111(1):87–92. pmid:24324144
- 33. Kramer I, Simons CJ, Hartmann JA, Menne-Lothmann C, Viechtbauer W, Peeters F, et al. A therapeutic application of the experience sampling method in the treatment of depression: a randomized controlled trial. World Psychiatry. 2014;13(1):68–77. pmid:24497255
- 34. Mulvaney SA, Ho YX, Cala CM, Chen Q, Nian H, Patterson BL, et al. Assessing adolescent asthma symptoms and adherence using mobile phones. J Med Internet Res. 2013;15(7):e141. pmid:23864345
- 35. Odawara M, Hashizume M, Yoshiuchi K, Tsuboi K. Real-Time Assessment of the Effect of Biofeedback Therapy with Migraine: A Pilot Study. Int J Behav Med. 2015.
- 36. Barge-Schaapveld DQ, Nicolson NA. Effects of antidepressant treatment on the quality of daily life: an experience sampling study. J Clin Psychiatry. 2002;63(6):477–85. pmid:12088158
- 37. Benka Wallen M, Franzen E, Nero H, Hagstromer M. Levels and Patterns of Physical Activity and Sedentary Behavior in Elderly Individuals With Mild to Moderate Parkinson Disease. Phys Ther. 2015.
- 38. Louter M, Maetzler W, Prinzen J, van Lummel RC, Hobert M, Arends JB, et al. Accelerometer-based quantitative analysis of axial nocturnal movements differentiates patients with Parkinson's disease, but not high-risk individuals, from controls. J Neurol Neurosurg Psychiatry. 2015;86(1):32–7. pmid:24777169
- 39. de Vries M. The Experience of Psychopathology: Investigating Mental Disorders in their Natural Settings. Cambridge: Cambridge University Press; 2006.