Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Neurofeedback As a Treatment for Major Depressive Disorder – A Pilot Study

  • Frenk Peeters ,

    f.peeters@maastrichtuniversity.nl

    Affiliation Department of Psychiatry and Psychology, South Limburg Mental Health Research and Teaching Network, EURON, Maastricht University, Maastricht, The Netherlands

  • Mare Oehlen,

    Affiliation Department of Psychiatry and Psychology, South Limburg Mental Health Research and Teaching Network, EURON, Maastricht University, Maastricht, The Netherlands

  • Jacco Ronner,

    Affiliation Department of Instrumentation, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands

  • Jim van Os,

    Affiliations Department of Psychiatry and Psychology, South Limburg Mental Health Research and Teaching Network, EURON, Maastricht University, Maastricht, The Netherlands, King's College London, King's Health Partners, Department of Psychosis Studies, Institute of Psychiatry, London, United Kingdom

  • Richel Lousberg

    Affiliation Department of Psychiatry and Psychology, South Limburg Mental Health Research and Teaching Network, EURON, Maastricht University, Maastricht, The Netherlands

Abstract

Background

There is growing interest in neurofeedback as a treatment for major depressive disorder. Reduction of asymmetry of alpha-activity between left and right prefrontal areas with neurofeedback has been postulated as effective in earlier studies. Unfortunately, methodological shortcomings limit conclusions that can be drawn from these studies. In a pilot-study, we investigated the effectiveness of reduction of asymmetry of alpha-activity with neurofeedback in depressed participants with the use of a stringent methodological approach.

Methods

Nine participants meeting DSM-IV criteria for major depressive disorder were treated with a maximum of 30 neurofeedback-sessions, aimed at reducing asymmetry of alpha-activity, over a 10-week period. No changes in the use of antidepressants were allowed 6 weeks before and during the intervention. Changes in depressive symptomatology were assessed with the Quick Inventory of Depressive Symptoms, self-report version.

Results

We observed response in 1 and remission in 4 out of a total of 9 participants. The effectiveness appeared largest in female participants. The mean asymmetry of alpha-activity decreased significantly over sessions in a quadratic fashion. This decrease was associated with clinical response.

Conclusions

This pilot study suggests that neurofeedback aimed at a reduction of frontal asymmetry of alpha-activity may be effective as a treatment for depression. However, this was an open label pilot study. Non-specific effects of the procedure and/or a beneficial natural course may have confounded the results. Randomized controlled trials will have to establish the efficacy of neurofeedback for depression.

Trial Registration

Nederlands Trial Register NTR1629

Introduction

There is growing interest in neurofeedback (NF) as a treatment for a variety of mental disorders including ADHD, anxiety, and depression [1], [2]. It is postulated that this technique, within an operant conditioning framework, helps individuals to regulate cortical electroencephalographic (EEG) activity while receiving feedback from a visual or acoustic signal. The resulting change in EEG activity is associated with a change in underlying cortical activation, and subsequently to result in a reduction of associated symptoms [3], [4].

On an electrophysiological level, major depressive disorder (MDD) appears to be associated with relatively more left than right resting (alpha, 8–13 Hz) activity in prefrontal regions [5][8], although some inconclusive studies exist (e.g., [9][11]. This difference in alpha activity between both prefrontal regions, has become known as alpha-asymmetry (AA) in MDD. To avoid confusion, it should be underlined that increased alpha activity in cortical structures is indicative of decreased cortical activation in those areas. AA is thought to represent reduced approach-related behaviours and reduced sensitivity to rewards in MDD [12]. Current research is equivocal as to whether AA in MDD represents a state-marker, an endophenotype related to risk for MDD, or both [8], [13][19]. As extensively discussed by Thibodeau and colleagues [15], methodological issues, sample-specific factors like gender distribution, and publication bias may explain inconsistencies in the current literature.

Notwithstanding these uncertainties, the premise that an episode of current MDD is associated with AA has been the starting point for AA manipulation with the application of NF as a treatment for MDD.

To date, case studies [1], [20][22], and a small randomized open trial [23] indicate that the increase of right relatively to left alpha activity at F3-F4 with the use of neurofeedback (alpha-asymmetry protocol) may be associated with a reduction in depressive symptomatology. This previous work has several limitations. First, NF treatment in the case studies was combined with psychotherapeutical sessions and lacked the use of state-of-the-art clinical instruments to assess psychiatric diagnoses and clinical change. The study by Choi et al [23], delivered only a total of 10 NF sessions during 5 weeks, which is considerably lower and less frequent than typically offered in the case studies and by NF practioners. Additionally, their participants suffered from subclinical levels of depression severity. Although the authors concluded that significant clinical change occurred in their active treatment group, clear criteria were not defined.

We decided to carry out a pilot study to address several questions. First, we aimed to examine whether NF is effective in the treatment of moderate severe MDD using current clinical instruments based on clearly defined response and remission criteria. Second, we investigated whether AA indeed decreased during the course of the NF sessions. Third, we examined the association between changes in clinical state and changes in AA. Lastly, the optimal duration of a single NF session for depressed subjects is unknown. Given fatigue and difficulties in concentration in MDD, we investigated the time-course of changes in AA during NF sessions to assess optimal session duration.

Methods

Ethics Statement

The protocol for this trial and supporting TREND checklist are available as supporting information; see Checklist S1 and Protocol S1. The Ethics Committee of Maastricht University approved the study. All participants provided written informed consent. The trial was registered by the Nederlands Trial Register, trial number NTR1629.

Participants

The study sample consisted of self-referred treatment-seeking patients presenting at the mood disorders treatment program of an outpatient mental health care center in Maastricht, the Netherlands. While on a waiting list for treatment, patients were asked if they could be contacted by telephone by the first author about possible participation in the study. Recruitment started in March 2010 and ended in April 2012. Figure 1 shows the flow of participants through the study.

The inclusion criteria were a primary diagnosis of non-chronic MDD as assessed with the Structured Clinical Interview for DSM-IV Axis I (SCID-I; First, Spitzer, Gibbon & Williams, 1995) and right-handedness. Trained mental health care professionals conducted the SCID-I assessments. Exclusion criteria were 1) a primary axis-1 diagnosis other than MDD, 2) chronic MDD, 3) current or past brain lesions, 4) use of antipsychotics, mood stabilisers or benzodiazepines, 5) pregnancy, 6) elevated acute suicide risk and 7) insufficient command of the Dutch language. The use of anti-depressants was permitted when type and dosage were not changed 6 weeks before and during the study. Co-morbid axis I diagnoses were allowed.

Instruments

The severity of MDD was measured with the 16-item Quick Inventory of Depressive Symptoms self-report version [24](QIDS- SR16). The QIDS- SR16 is a self-report questionnaire consisting of 16-items resulting in a total score between 0 and 27. Participants filled out the QIDS- SR16 prior to each NF-session. We defined response as a reduction of at least 50% on the QIDS- SR16 score, and remission as a QIDS- SR16score of ≤6 (www.ids-qids.org).

Procedure, EEG recording and quantification

All EEG recordings took place in an electrically shielded room. While participants were seated in a chair, Ag/AgCl electrodes were placed on Fz, F3, F4, Cz, C3, C4, T3, T4, Pz, P3 and P4, Oz, O1 en O2 using the international 10–20 system [25]. The central, parietal, temporal, occipital and eye signal activity were only measured at the first and last NF-session. During the other sessions, electrodes were placed only on F3 and F4. To control for possible vertical eye movements, an electro-oculogram (EOG) electrode was placed 1 cm under the midline of the left eye. EEG electrodes were referenced with averaged earlobes (A1 and A2). A ground electrode was placed at the forehead. In order to reduce skin resistance, Nuprep scrub gel was used. All electrodes were fixed using 10–20 conductive paste. Impedances were kept below 5 kΩ.

Data collection was channelled through an acquisition PC with a BrainAmp DC EEG amplifier (Brain Products) using a 1000 Hz sample frequency. Online calculations were done by a filter written for BrainVision RecView. The data was epoched online into 2.048-s epochs that overlapped by 75% and then transformed by a fast Fourier transform (FFT) to the frequency domain (frequency resolution 0.488 Hz). Every 0.512 second, the power within the alpha frequency band (7.8 Hz–13.1 Hz) of both F3 and F4 was calculated. AA was computed as the difference of the natural log-transformed F3 and F4-alpha power: Ln(F3-alpha) – Ln(F4-Alpha). Present asymmetry was subsequently compared to the personal mean baseline asymmetry. The result of the calculation was sent to a stimulus PC running Presentation stimulus delivery software (Neurobehavioral Systems) with an 8-bit parallel port (LPT-port) to control a paradigm showing a visual representation of the asymmetry. In the Presentation paradigm, the last 20 values of the asymmetry are used in a moving average to prevent ‘jitter’ in the feedback. Participants received feedback with visual feedback; they were instructed to increase the level of a thermometer that was shown on a flatscreen. Additionally, a numerical score below the thermometer indicated their actual total performance. This score was adjusted (i.e. increased) continuously by a number ranging from 0 and 128, depending on the level of the thermometer. In this way a good actual performance (a shift in asymmetry in the desired direction) resulted in an increasing total score. A big shift in the desired direction resulted in a rapidly increasing total score, whereas a small shift in the desired direction resulted in a slow increasing total score. A shift in the undesired direction produced no change in total score. The purpose of this total performance score was to give participants feedback on the differential effect of the sessions.

Upon arrival in our laboratory, subjects were shown the facility and the monitor that displays the thermometer and the numerical score. After we had established a good EEG signal, they were just instructed to try to increase the level of the thermometer by trial and error. A typical response of subjects was the question if we could provide any detailed instructions that could be helpful in increasing the thermometer level. We outlined that there are no specific strategies (relaxation, thinking about positive experiences in the past or imagining experiences like being on a sunny tropical island) known to be helpful in this respect based on our experience; we had tested this with healthy volunteers (unpublished data). Moreover, there is concurrent empirical work showing that specific strategies used by participants are not beneficial in improving the magnitude of the effect of NF in targeted brains areas [26], [27]

Participants were treated with a maximum of 30 NF sessions that each consisted of 3 feedback-blocks of 8 minutes duration. These were separated by two blocks of 5 minutes rest. Block-duration was based on information in previous reports and information from NF-practitioners. Sessions took place 3 times a week. Before and after each session baseline activity was measured during 5 and 3 minutes respectively. If no clinical improvement was observed after 30 sessions, the participants were offered standard evidence-based treatment for MDD.

Statistical Analysis

All statistical analyses were performed with SPSS version 20. Every block during the NF-sessions (baseline, feedback-block 1 to 3, and a post-NF baseline) was cut into 0.5 second segments: baseline was cut into 565 segments, feedback-block 1 to 3 into 916, and post-NF baseline into 331 segments. For each segment, AA was computed as the difference of the natural log-transformed F3 and F4-alpha power: Ln (F3-alpha) – Ln (F4-Alpha). All segments with eye blink activity (EOG > = 50 microVolt) were removed from the dataset.

Electrophysiological data have a hierarchical structure. Thus, multiple EEG observations (level 1) are clustered within participants (level 2). Multilevel analyses take the variability associated with each level of nesting into account [28]. Multilevel linear regression analyses were applied to the EEG data. The difference between conditions was analysed by use of multilevel regression with the dummy variables for condition as the independent predictor variables and AA as the dependent variable.

To examine linear and non-linear decreases in AA during each session, a multilevel regression analysis, with random intercept and random slopes, was conducted using time and its quadratic term as independent variables and AA as dependent variable. The optimum for every feedback condition was determined by calculating the top of the fitted parabola. Linear regression was used to assess the change in QIDS- SR16 scores during the course of the NF sessions.

The relation between QIDS- SR16 and AA over time was analysed by use of multilevel regression, using AA as dependent variable and QIDS- SR16, session and their interaction term as independent variables.

Results

Clinical outcome

Nine participants, 4 female, were included in this pilot-study. Mean age was 46.6 years (S.D. 11.7); mean baseline QIDS- SR16 score was 18.4 (S.D. 7.2), indicative of moderate to severe MDD. Female participants were significantly less depressed than males both before (QIDSfemale  = 12.5; QIDSmale  = 23.2; 95%-CI: 3.6–17.9; p = .01) and after (QIDSfemale  = 5.25; QIDSmale  = 19.2; 95%-CI: 6.7–21.2; p = .004) treatment with NF. Table 1 shows demographic and clinical information about the individual participants. Five participants (4 female) met the criteria for response and/or remission after treatment. During treatment, mean QIDS- SR16 scores decreased significantly (B = −.15, p = .048, 95%-CI: −0.30– −0.002).

thumbnail
Table 1. Demograpic and clinical characteristics of participants.

https://doi.org/10.1371/journal.pone.0091837.t001

The experiences from the participants were mixed depending on their ability to increase the level of the thermometer. Most of them engaged in a competitive effort to surpass results from previous NF-sessions by striving for a higher numerical score (indicative of their actual total performance during the current session) that was displayed below the thermometer. Participants reported feelings of competence and pride alternated with frustration depending on their performance. Besides these affective responses, no sudden gains in mood were reported during or directly after NF sessions. The participants did not report any additional specific thoughts or feelings during the sessions that could be related to their performance during the session. Although not formally assessed with any questionnaire, participants did not spontaneously report any side-effects during NF treatment.

As can be seen in Table 1, the number of NF sessions varied between participants. Two subjects (numbers 6 and 7) withdrew participation due to a lack of any clinical effect, one subject (number 2) terminated the treatment upon achieving full remission.

Electrophysiological outcome

The mean baseline AA decreased significantly over sessions in a quadratic fashion (B = −.00007, t = −2.64, p = .008, 95%-CI: −0.00012– −0.00002). This decrease is graphically displayed in Figure 2. With respect to the random effects, both the intercept as the time effect were significant (p<.05). The intra-class correlation of this model was 0.012. QIDS- SR16 scores were significantly correlated with AA at baseline (r = .008, p = .004). QIDS- SR16 scores were significantly correlated with AA at baseline (r = .008, p = .004). We also examined whether decreases in mean QIDS- SR16 scores were associated with a decrease in mean AA. This association was significant (B = −0.0002, t = −8.15, p<.001, 95%-CI: −0.0002– −0.0001).

thumbnail
Figure 2. Change in mean baseline frontal alpha-asymmetry during NF treatment.

https://doi.org/10.1371/journal.pone.0091837.g002

Next, we examined changes in AA during the 3 consecutive feedback-blocks (8 minutes each) within each NF session. The decrease of AA within the three 8-minutes blocks showed significant linear and quadratic effects (see Table 2). It should be noted that the beta's in Table 2 are small as a result of the logtransformation. Given the uncertainty about optimal length of NF-blocks, we also assessed the time-course of the change in AA during the blocks. The decrease of AA stopped after 5.18 (feedback block 1), 5.01 (feedback block 2), and 7.02 (feedback block 3) minutes respectively. This is graphically displayed in Figure 3. The optimal duration of NF-sessions is apparently shorter than the 8 minutes that we had chosen based on previous reports.

thumbnail
Figure 3. Time-course of the change in AA during the blocks during the NF sessions.

https://doi.org/10.1371/journal.pone.0091837.g003

Discussion

This NF pilot study into the effectiveness of NF as a treatment for MDD showed response in 1 and remission in 4 out of a total of 9 participants. This clinical change is in line with those from previous reports showing that neurofeedback, aimed at reducing AA, may be associated with a reduction in depressive symptomatology [1], [20][23]. We extended these studies by examining, i) a sample with moderately severe depressive symptomatology, ii) with the use of a structured clinical interview, iii) a robust instrument to measure clinical change with clearly defined outcome criteria, iv) a high number of NF sessions reflecting normal NF practice, and v) without additional therapeutic interventions.

During the treatment course with NF, resting-state AA significantly decreased and was associated with a reduction of depressive symptomatology. In the literature, there is uncertainty whether AA is a state-marker for MDD or should be considered a stable endofenotype for MDD [8], [13][19]. The current results provide support for the view that AA is a state-marker. Our methodology and statistical analysis may explain differences with some of the existing literature. In contrast to previous studies that tested changes in AA only before and after treatment (e.g., [17][19], we analyzed changes in AA continuously during the NF sessions, and analyzed within-persons changes with multilevel analyses. Such strategy makes it possible to analyse datasets with missing values (in this case due to invalid segments due to large EOG activity) and increases statistical power even when a small sample like ours is examined. It could be argued that the decrease in AA was small and reached significance due to high statistical power. However, there is no literature that indicates which magnitude of changes in resting-state AA should be considered as meaningful in an electrophysiological and biobehavorial respect. Future work will have to provide more information about this issue.

Each NF session consisted of 3 feedback blocks with a duration of 8 minutes separated by 5 minutes rest. However, decreases of AA were observed only during the first 5 minutes in blocks 1 and 2, and the first 7 minutes of the last block. The pattern did not change over the course of the NF sessions indicating that our depressed participants did not improve their ability to influence AA over time even when their clinical condition improved. Future studies will have to examine whether the optimal duration of NF blocks is less than the 8 minute blocks used in our study or that longer periods of rest between blocks increase this optimal duration.

It should be noted that the largest clinical effects were observed in the female participants. Earlier studies did not address the effect of gender in the effectiveness of NF for MDD, although in the study by Choi et al [23] 8 out of 10 participants were female. This gender difference may be explained by several reasons. First, the female participants entered the study with significantly less severe depressive symptoms. Given abundant evidence that lower baseline levels of depression severity are associated with better therapeutic outcome (e.g., [29], their less severe symptomatology will have made it more likely that female participants would meet criteria for clinical remission. Second, recent work has indicated that in females MDD is stronger linked to relatively less left- than right frontal activity than men, which makes them potentially better candidates for a treatment that aims at a reduction of AA [12], [15]. This notion is indirectly supported by the finding that only in women treatment response to antidepressants appears related to the presence of AA [18], [19].

Our conclusions are limited for several reasons. First, this was a small, open pilot study. The clinical effects may be confounded by non-specific effects of the procedure (e.g., contact with investigators, behavioural activation as a result of participation) and/or a beneficial natural course. To examine whether this NF treatment is efficacious in MDD, a randomized controlled trial is necessary. This trial should include a credible sham-NF arm to which participants and investigators are blind. If proven efficacious, it is highly unlikely that all depressed patients will respond equally well to NF. Future work will have to address which patients profit most from an intervention aimed at reducing their AA.

Author Contributions

Conceived and designed the experiments: FP JR RL. Performed the experiments: FP MO RL. Analyzed the data: FP MO RL. Contributed reagents/materials/analysis tools: JR JO. Wrote the paper: FP MO JR JO RL. Designed software: FP JR RL.

References

  1. 1. Hammond DC (2005) Neurofeedback Treatment of Depression and Anxiety. Journal of Adult Development 12: 131–138.
  2. 2. Lofthouse N, Arnold LE, Hurt E (2012) Current status of neurofeedback for attention-deficit/hyperactivity disorder. Curr Psychiatry Rep 14: 536–542.
  3. 3. Evans JR, Abarbanel A (1999) Introduction to quantitative EEG and neurofeedback. San Diego: Academic Press.
  4. 4. Peeters F, Ronner J, Bodar L, van Os J, Lousberg R (in press) Validation of a neurofeedback paradigm: manipulating frontal EEG alpha-activity and its impact on mood. Int J Psychophysiol.
  5. 5. Davidson RJ, Pizzagalli D, Nitschke JB, Putnam K (2002) Depression: perspectives from affective neuroscience. Annu Rev Psychol 53: 545–574.
  6. 6. Coan JA, Allen JJ (2004) Frontal EEG asymmetry as a moderator and mediator of emotion. Biol Psychol 67: 7–49.
  7. 7. Herrington JD, Heller W, Mohanty A, Engels AS, Banich MT, et al. (2010) Localization of asymmetric brain function in emotion and depression. Psychophysiology 47: 442–454.
  8. 8. Stewart JL, Coan JA, Towers DN, Allen JJ (2011) Frontal EEG asymmetry during emotional challenge differentiates individuals with and without lifetime major depressive disorder. J Affect Disord 129: 167–174.
  9. 9. Bruder GE, Fong R, Tenke CE, Leite P, Towey JP, et al. (1997) Regional brain asymmetries in major depression with or without an anxiety disorder: a quantitative electroencephalographic study. Biol Psychiatry 41: 939–948.
  10. 10. Pizzagalli DA, Nitschke JB, Oakes TR, Hendrick AM, Horras KA, et al. (2002) Brain electrical tomography in depression: the importance of symptom severity, anxiety, and melancholic features. Biol Psychiatry 52: 73–85.
  11. 11. Reid SA, Duke LM, Allen JJ (1998) Resting frontal electroencephalographic asymmetry in depression: inconsistencies suggest the need to identify mediating factors. Psychophysiology 35: 389–404.
  12. 12. Stewart JL, Bismark AW, Towers DN, Coan JA, Allen JJ (2010) Resting frontal EEG asymmetry as an endophenotype for depression risk: sex-specific patterns of frontal brain asymmetry. J Abnorm Psychol 119: 502–512.
  13. 13. Debener S, Beauducel A, Nessler D, Brocke B, Heilemann H, et al. (2000) Is resting anterior EEG alpha asymmetry a trait marker for depression? Findings for healthy adults and clinically depressed patients. Neuropsychobiology 41: 31–37.
  14. 14. Allen JJ, Urry HL, Hitt SK, Coan JA (2004) The stability of resting frontal electroencephalographic asymmetry in depression. Psychophysiology 41: 269–280.
  15. 15. Thibodeau R, Jorgensen RS, Kim S (2006) Depression, anxiety, and resting frontal EEG asymmetry: a meta-analytic review. J Abnorm Psychol 115: 715–729.
  16. 16. Allen JJ, Cohen MX (2010) Deconstructing the “resting” state: exploring the temporal dynamics of frontal alpha asymmetry as an endophenotype for depression. Front Hum Neurosci 4: 232.
  17. 17. Bruder GE, Sedoruk JP, Stewart JW, McGrath PJ, Quitkin FM, et al. (2008) Electroencephalographic alpha measures predict therapeutic response to a selective serotonin reuptake inhibitor antidepressant: pre- and post-treatment findings. Biol Psychiatry 63: 1171–1177.
  18. 18. Bruder GE, Stewart JW, McGrath PJ, Deliyannides D, Quitkin FM (2004) Dichotic listening tests of functional brain asymmetry predict response to fluoxetine in depressed women and men. Neuropsychopharmacology 29: 1752–1761.
  19. 19. Bruder GE, Stewart JW, Tenke CE, McGrath PJ, Leite P, et al. (2001) Electroencephalographic and perceptual asymmetry differences between responders and nonresponders to an SSRI antidepressant. Biol Psychiatry 49: 416–425.
  20. 20. Baehr E, Rosenfeld JP, Baehr R (1997) The clinical use of an alpha asymmetry protocl in the neurofeedback treatment of depression: two case studies. Journal of neurotherapy 2: 10–23.
  21. 21. Baehr E, Rosenfeld JP, Baehr R (2001) Clinical use of an alpha asymmetry neurofeedback protocol in the treatment of mood disorders: follow-up study one to five years post therapy. Journal of neurotherapy 4: 11–18.
  22. 22. Rosenfeld JP, Baehr E, Baehr R, Gotlib IH, Ranganath C (1996) Preliminary evidence that daily changes in frontal alpha asymmetry correlate with changes in affect in therapy sessions. Int J Psychophysiol 23: 137–141.
  23. 23. Choi SW, Chi SE, Chung SY, Kim JW, Ahn CY, et al. (2011) Is alpha wave neurofeedback effective with randomized clinical trials in depression? A pilot study. Neuropsychobiology 63: 43–51.
  24. 24. Rush AJ, Trivedi MH, Ibrahim HM, Carmody TJ, Arnow B, et al. (2003) The 16-Item Quick Inventory of Depressive Symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): a psychometric evaluation in patients with chronic major depression. Biol Psychiatry 54: 573–583.
  25. 25. Niedermeyer E, Lopes da Silva F (2004) Electroencephalography: Basic Principles, Clinical Applications, and Related Fields: Lippincott Williams & Wilkins.
  26. 26. Birbaumer N, Lang PJ, Cook E 3rd, Elbert T, Lutzenberger W, et al. (1988) Slow brain potentials, imagery and hemispheric differences. Int J Neurosci 39: 101–116.
  27. 27. Hardman E, Gruzelier J, Cheesman K, Jones C, Liddiard D, et al. (1997) Frontal interhemispheric asymmetry: self regulation and individual differences in humans. Neurosci Lett 221: 117–120.
  28. 28. Snijders TAB, Bosker RJ (1999) Multilevel analysis: an introduction to basic and advanced multilevel modeling. London: Sage Publications.
  29. 29. Blom MB, Spinhoven P, Hoffman T, Jonker K, Hoencamp E, et al. (2007) Severity and duration of depression, not personality factors, predict short term outcome in the treatment of major depression. J Affect Disord 104: 119–126.