Skip to main content
Browse Subject Areas

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Understanding the Impact of Brain Disorders: Towards a ‘Horizontal Epidemiology’ of Psychosocial Difficulties and Their Determinants

  • Alarcos Cieza ,

    Affiliations Faculty of Social and Human Sciences, School of Psychology, University of Southampton, Southampton, United Kingdom, Department of Medical Informatics, Biometry and Epidemiology (IBE), Chair for Public Health and Health Services Research, Research Unit for Biopsychosocial Health, Ludwig-Maximilians-University (LMU), Munich, Germany, Swiss Paraplegic Research, Nottwil, Switzerland

  • Marta Anczewska,

    Affiliation Department of Psychiatry, Institute of Psychiatry and Neurology, Warsaw, Poland

  • Jose Luis Ayuso-Mateos,

    Affiliation Instituto de Salud Carlos III, Centro de Investigación Biomédica en Red de Salud Mental (CIBERSAM), Department of Psychiatry, Universidad Autónoma de Madrid, Psychiatry Service, Instituto de Investigación del Hospital Universitario de La Princesa (IIS-IP), Madrid, Spain

  • Mary Baker,

    Affiliation European Brain Council, Brussels, Belgium

  • Jerome Bickenbach,

    Affiliation Swiss Paraplegic Research, Nottwil, Switzerland

  • Somnath Chatterji,

    Affiliation Multi-Country Studies, Department of Measurement and Health Information Systems, World Health Organization, Geneva, Switzerland

  • Sally Hartley,

    Affiliations Faculty of Medicine and Health Sciences, University of East Anglia, Norwich, United Kingdom, Faculty of Health Sciences, University of Sydney, Sydney, New South Wales, Australia, The London School of Hygiene and Tropical Medicine, London, United Kingdom

  • Matilde Leonardi,

    Affiliation Neurology, Public Health and Disability Unit, Scientific Directorate, Neurological Institute Carlo Besta IRCCS Foundation, Milan, Italy

  • Tuuli Pitkänen,

    Affiliation A-Clinic Foundation, Helsinki, Finland

  • PARADISE Consortium

    Membership of the PARADISE Consortium is listed in the Acknowledgments.



To test the hypothesis of ‘horizontal epidemiology’, i.e. that psychosocial difficulties (PSDs), such as sleep disturbances, emotional instability and difficulties in personal interactions, and their environmental determinants are experienced in common across neurological and psychiatric disorders, together called brain disorders.

Study Design

A multi-method study involving systematic literature reviews, content analysis of patient-reported outcomes and outcome instruments, clinical input and a qualitative study was carried out to generate a pool of PSD and environmental determinants relevant for nine different brain disorders, namely epilepsy, migraine, multiple sclerosis, Parkinson’s disease, stroke, dementia, depression, schizophrenia and substance dependency. Information from these sources was harmonized and compiled, and after feedback from external experts, a data collection protocol including PSD and determinants common across these nine disorders was developed. This protocol was implemented as an interview in a cross-sectional study including a convenience sample of persons with one of the nine brain disorders. PSDs endorsed by at least 25% of patients with a brain disorder were considered associated with the disorder. PSD were considered common across disorders if associated to 5 out of the 9 brain disorders and if among the 5 both neurological and psychiatric conditions were represented.


The data collection protocol with 64 PSDs and 20 determinants was used to collect data from a convenience sample of 722 persons in four specialized health care facilities in Europe.


57 of the PSDs and 16 of the determinants included in the protocol were found to be experienced across brain disorders.


This is the first evidence that supports the hypothesis of horizontal epidemiology in brain disorders. This result challenges the brain disorder-specific or vertical approach in which clinical and epidemiological research about psychosocial difficulties experienced in daily life is commonly carried in neurology and psychiatry and the way in which the corresponding health care delivery is practiced in many countries of the world.


Psychosocial difficulties (PSDs), such as sleep disturbances, emotional instability and difficulties in personal interactions and in work are prevalent in people with neurological and psychiatric disorders–which we here call ‘brain disorders’. PSDs are commonly used to estimate disease severity in neurological disorders [1]. In psychiatric disorders they are also used as diagnostic criteria [2]. Information about the PSDs people with brain disorders experience is as a result routinely obtained both in clinical practice and research.

Information about PSDs—whether it comes from clinical practice or research—is typically reported for each brain disorder in particular and only in exceptional cases are comparisons across brain disorders made. In a multi-method review, Wittchen et al. tellingly found that only with very few exceptions European studies concentrate on single disorders [3]. They found no study that systematically examined the difficulties associated with the full range of brain disorders. Where comparisons across brain disorders are targeted, these are usually restricted to single PSD, mostly body functions such as fatigue [4] or pain [5].

A focus on single conditions, in a silo-like manner is in some cases justifiable and necessary. For example, biomedical research must focus on the differential brain mechanisms that cause condition-specific symptoms. Similarly, life course approaches targeting shedding light on the epidemiology of different disorders, i.e. risk factors for depression, or on disorder-specific outcomes, i.e. impact of anxiety disorders in the adolescence on education achievement, are inevitably disorder-specific [6, 7]. The question is whether a disease-specific approach is also appropriate when identifying, understanding the impact of and treating the PSDs that people with brain disorders experience in their daily lives.

There is no good reason to believe that PSDs are fundamentally different between brain disorders, especially if we operationalize PSDs in terms of the World Health Organisation’s International Classification of Functioning, Disability and Health (ICF) [8]. Based on its conceptual model of functioning and disability, impairments in body functions and structures, activity limitations and participation restrictions are not a direct consequence of biological mechanisms of the health condition, but rather an outcome of the interaction between those mechanisms and features of the person’s environment and personal factors [8].

Relying on this understanding, we hypothesize that there are PSDs—defined as impairments of mental functions and impairments of body functions under central nervous system control, activity limitations and participation restrictions—that are common in people with brain disorders despite variations in symptomatology, aetiology, and the biochemical basis of their disorders.

There are several reasons that intuitively support the hypothesis of commonalities in PSDs across brain disorders. People with different brain disorders are subject to similar physical, social, and attitudinal influences, such as the built environment, support of the family, attitudes about their illnesses, and views about personal responsibility. Even though intensity can vary, the kinds of PSDs people experience in their lives, and which are influenced by these factors, are probably similar. Clinicians working with patients with neurological and psychiatric disorders are familiar with the fact that there are some common difficulties that their patients experience, such as sleep problems, difficulties with affect, maintaining personal relationships and holding a job. There is also research that supports this clinical experience [4, 5, 911]. Finally, it is well known that co-morbidity within brain disorders is very high, making it more intuitive to detach PSD from specific brain disorders [3].

If common PSDs are experienced by people with different brain disorders, it is reasonable to assume that there are also cross-cutting determinants of these PSDs. Using these determinants as a basis for developing interventions or strategies targeting PSDs across brain disorders would be more cost-effective than is currently the case. In fact, promising cross-cutting strategies are already recommended for instance for improving the experience of care for people using mental health services [12]. Lessons could be learned from the effectiveness of such strategies. The marginal utility of investing in common interventions and strategies further increases their cost-effectiveness to society.

The project called PARADISE (Psychosocial fActors Relevant to BrAin DISorders in Europe, funded under the FP7 by the European Commission, gave us the opportunity to test the hypothesis of commonalities across brain disorders. The PARADISE consortium was composed of 10 partners across Europe with clinical, epidemiological and public health expertise. Patients’ organizations were informed about the project and involved in it through the European Brain Council. In the present study we use a multi-method approach to test the hypothesis that people with different brain disorders experience PSDs and determinants in common. This hypothesis was called ‘horizontal epidemiology’ to highlight the difference from the standard, brain disorder-specific approach.

Material and Methods

Ethics statement

All study-relevant documentation and the written informed consent forms provided to the participants were approved by the Ethics Committees of the Neurological Institute Carlo Besta IRCCS Foundation in Milan, Italy, the Institute of Psychiatry and Neurology in Warsaw, Poland, the teaching hospital La Princesa of the University of Madrid in Madrid, Spain and the Järvenpää Addiction Hospital in Haarajoki, Finland. The present study has therefore been performed in accordance with the ethical standards laid down in the 1964 Declaration of Helsinki and its later amendments.

The present study has two parts. In the first one, PSDs and their determinants relevant across brain disorders were identified, while in the second part the hypothesis of ‘horizontal epidemiology’ was challenged. Each part is described in detail as follows.

Identifying PSDs and their determinants relevant across brain disorders

To challenge the hypothesis of horizontal epidemiology we first needed to select brain disorders sufficiently diverse in terms of aetiology, biochemical bases, signs and symptoms. The selected brain disorders were: dementia, depression, epilepsy, migraine, multiple sclerosis (MS), Parkinson´s disease (PD), schizophrenia, stroke and substance dependency. These disorders have been selected for: 1) Being among the most burdensome disorders according to the Global Burden of Disease study [13]; 2) Occurring throughout Europe and across demographic and socio-economic categories; 3) Including disorders that have both intermittent (epilepsy and depression) and continuous (dementia and substance use disorders) symptomatology and consequences.

Secondly, we followed a multi-method approach depicted in Fig 1: (1) systematic literature reviews, (2) content analysis of patient-reported outcomes (PROs) and outcome instruments, (3) clinical input and (4) a qualitative study. Information from all sources was (5) harmonized and compiled and (6) a data collection protocol developed also including feedback from an external expert consultation. The protocol included all potentially relevant PSDs and their determinants across brain disorders. (7) This protocol was implemented in a cross-sectional study.

Fig 1. PARADISE approach with literature reviews, content analysis of outcome instruments, clinical input and qualitative study.

PARADISE multi-method approach with systematic literature reviews, content analysis of patient-reported outcomes (PROs) and outcome instruments, clinical input and a qualitative study. Information from all sources was harmonized and compiled and a data collection protocol developed also including feedback from an external expert consultation. The protocol included all potentially relevant PSDs and their determinants across brain disorders. This protocol was implemented in a cross-sectional study.

(1) Systematic literature reviews

Nine systematic literature reviews, one for each brain disorder were carried out, and have been published separately [1418]. The literature between 2005 and 2010 was searched to identify PSDs and their determinants reported in intervention studies, longitudinal observational and qualitative studies (S1 File, S2 File). The PSDs and determinants reported were extracted as well as all Patient Reported Outcomes (PROs) and any other outcome instrument used. A detail description of the approach followed in the PARADISE literature reviews is presented in Świtaj et al. [15].

(2) PROs

Clinical researchers who carried out the brain disorder-specific reviews selected the three PROs or outcome instruments that, in their experience treating patients with the disorders in the project, best captured the PSDs their patients experienced. Twenty-seven PROs and outcome instruments were selected.

(3) Clinical input

The clinical researchers, on the basis of the results of their literature reviews, and their own clinical expertise, provided for each brain disorder determined which PSDs were the most salient for their patients.

(4) Qualitative study

Focus groups and patient interviews gathered information about PSDs and their determinants. One focus group was conducted for each brain disorder, with three exceptions: for substance dependency two gender-specific groups were held to facilitate the discussion of gender-specific issues; two focus groups were conducted for stroke to accommodate different cognitive levels of stroke patients; and for dementia individual interviews were conducted, or, for very severely compromised patients, interviews with their caregivers were substituted.

(5) Compilation and selection for data collection protocol

The extracted PSDs and determinants from the literature reviews and the qualitative study were grouped by underlying concept and named using ICF terms during a two-day workshop, in which all researchers participated. The items or content of the 27 PROs and outcome measures as well as the PSDs and determinants resulting from the clinical input were also grouped using ICF terms after applying standardized linking rules described by Cieza et al. [19]. Using the ICF as a standard language made it possible to compare PSDs and determinants from the literature reviews, PROs and outcome measures, the expert input and the qualitative studies.

Potentially relevant PSDs and determinants had to be selected for inclusion in the data collection protocol. This was done separately for PSDs and determinants. Since we wanted to test the hypothesis of horizontal epidemiology we had to make sure that even PSDs and determinants relevant to small group of disorders were included. At the same time we had to keep the balance between comprehensiveness and practicability. The procedure for selecting PSDs is shown in Fig 2. We included in the data collection protocol those determinants identified in at least two of the literature reviews or in at least two brain disorders in the qualitative study.

Fig 2. Decision tree used for selecting relevant psychosocial difficulties across brain disorders.

The starting point of the decision tree was the list of psychosocial difficulties (PSD) addressed in the 27 patient reported outcome (PRO) or outcome instruments identified in the literature reviews. If a PSD was addressed in at least one of the PROs or outcome instruments and had also been identified in at least two of the three sources of information (literature reviews, qualitative study and clinical input), this PSD was selected for inclusion into the data collection protocol. If a PSD had only been included in one of the sources of information, then if it had been identified in the literature reviews of at least two brain disorders and in those in > 20% of the studies included in the reviews, then the PSD was also included in the PARADISE protocol. If not, then if it had been included in the patient input studies for more than three brain disorders, or in the clinical input for more than three brain disorders, in both cases it was included in the protocol.

The selection of PSDs and determinants was critically evaluated by a panel of six external experts. The members of this independent panel were selected based on their outstanding expertise as clinicians and researchers and for holding leadership positions in Europe in the field of brain disorders. The experts were asked to provide additional PSDs and determinants they thought were missing in the protocol based on their experience of patients with the selected brain disorders.

(6) Construction and piloting of the data collection protocol

For most of the PSDs and determinants, questions from questionnaires and clinical instruments and national and international health surveys were identified and used for the data collection protocol. Instruments used were: WHO World Health Survey (; WHO Composite International Diagnostic Interview (CIDI) [20]; WHO Disability Assessment Schedule 2.0 (WHODAS II) [21]; Hospital Anxiety and Depression Scale (HADS) [22]; Quality of Life Instrument for Young Hemorrhagic Stroke Patients (HSQuale) [23]; Sickness Impact Profile (SIP) [24]; Symptom Checklist (SCL-90) [25]; Schedule for Clinical Assessment in Neuropsychiatry (SCAN) [26]; Stroke Adapted-Sickness Impact Profile (SA-SIP) [27]; Stroke Impact Scale (SIS) [28]; WHO Survey on Health and Health System Responsiveness (HSQR) (; WHO Quality of Life (WHOQoL) [29]. In a few cases, where no standard question was available, new questions were developed. The response options were homogenized to be the same for all PSDs questions, namely None, Mild, Moderate, Severe, Extreme, Don’t know and not applicable. The response options for environmental determinants ranged from No positive influence to Strong positive influence and from No negative influence to Strong negative influence. The determinants referring to personal characteristics, such as personality or self-efficacy, were collected with standard questionnaires, such as the 10-item short version of the Big Five Inventory [30] and items of the General Self-Efficacy Scale [31]. For those instruments the original questions and response options were kept. The data from these questionnaires were not analyzed for this paper.

The protocol also contained a section in which participants were asked 1) whether there are problems or difficulties not mentioned during the interview but which they would like to add and 2) to mention up to five problems or difficulties in areas of life that are the most troubling or burdensome for them. For these, the participants were also asked when it was that they first occurred, how they had changed over time, and whether something influenced their change.

The feasibility and clarity of the protocol were piloted in interviews with four patients, two with depression, one with schizophrenia and one with Parkinson’s disease.

(7) Implementation of the data collection protocol

The data collection protocol was implemented in a cross-sectional study on a convenience sample of 80 persons per brain disorder. Patients were interviewed by a trained clinical researcher using the protocol. For the purpose of describing the study population, demographic information, age, the impact of comorbidities and a general health question were asked. Comorbidities were accessed with the Self-reported Comorbidities Questionnaire (SCQ) [32]. Using the SCQ a summary score on the impact of comorbidity is derived by adding the up to three points obtained from each of the included 12 health conditions: one point for its presence, one if treatment is received, and one if it causes decrements in functioning. In addition, to determine the severity of the brain disorder, standard disease-specific measures routinely used in the recruiting centres, were used. In the case of epilepsy, no instrument was routinely used, so severity of epilepsy was assessed by frequency of seizures in the last year and the number of anti-epileptic drugs taken.

Patient inclusion criteria were that the main diagnosis was one of the nine brain disorders and the patient was at least 18 years old with sufficient facility with the language of the country to understand the purposes of consent. The patient was asked to agree to participate and to sign the informed consent form. For dementia patients not able to provide consent, the caregivers were asked to give consent and to participate in the interviews as proxies.

The data of the patients with dementia and schizophrenia were collected at the Instytut Psychiatrii i Neurologii in Warsaw, Poland, the data of those with epilepsy, migraine, multiple sclerosis, Parkinson´s disease and stroke at the Instituto Nazionale Neurologico “Carlo Besta” in Milan, Italy, of those with substance dependency at the Järvanpää Addiction Hospital, Haarajoki, Finland and of those with depression at the the Hospital Universitario de La Princesa in Madrid, Spain.

Testing the hypothesis of ‘horizontal epidemiology’

It was previously decided that a PSD was associated with a brain disorder if at least 25% of patients reported it as a difficulty, independently of the severity (Mild, Moderate, Severe or Extreme). It was also decided that a PSD could be said to be commonly experienced across brain disorders if 1) the PSD was associated to 5 out of the 9 brain disorders and 2) among the 5 both neurological conditions (epilepsy, migraine, multiple sclerosis, Parkinson’s disease, stroke) and psychiatric conditions (dementia, depression, schizophrenia, substance dependency) were represented. Even though it could be questioned whether dementia is a neurological or a psychiatric condition, we followed the ICD-10 and classified it as psychiatric. The same criteria were used for testing whether there are environmental determinants with cross-cutting influence, either positive or negative. For the calculation of the percentages the response option don’t know and not applicable were considered missing data.

To describe our sample we also used descriptive statistics. The severity of the brain disorder was determined by dividing each patient group into categories of mild, moderate and severe according to standardized cut-offs found in the literature for the corresponding instruments.


The multi-method approach used to identify potentially relevant PSDs and their determinants across brain disorders resulted in the so called PARADISE data collection protocol, which includes 64 PSDs and 59 determinants of PSD. Columns one to three of Table 1 present the PSDs included in the protocol by name, by ICF code, and the question used to operationalize them. Columns 4 to 12 of Table 1 summarize the results of the cross-sectional study and present for each PSD and each brain disorder, the percentage of people who had reported difficulties. Those cells above 25% are marked in bold. Table 2 shows demographic characteristics as well as the allocation to severity group of the 722 people participating in the cross-sectional study.

Table 1. Psychosocial difficulties (PSD) included in the PARADISE data collection protocol.

Table 2. Demographic characteristics of the persons participating in the study implementing the PARADISE data collection protocol.

In 57 of the 64 PSDs more than 25% of the sample of at least 5 brain disorders reported difficulties. In all 57 both neurological and psychiatric brain disorders were represented. Problems with mental functions like being emotionally affected, depressive mood, worry and anxiety, stress and pain were, however, meaningfully more frequently than our 25% cut-off: these PSDs were endorsed by more than 45% of all persons with brain disorders independently of the underlying condition. Problems with the level of energy and tiredness were even more frequent and endorsed for all included brain disorders by more than 70% of the different samples. Regarding activities and participation domains, problems in carrying out daily routine were endorsed by more than 40% of the persons with any condition, followed by problems in mobility, lifting and carrying objects, walking and economic sufficiency, endorsed by more than ca. 40% of all subsamples but epilepsy and PD.

Table 3 presents environmental determinants with percentage of people who felt that these determinants influenced their PSDs, either positively or negatively. Seventeen of the 20 environmental determinants fulfil our criteria as common influences of PSDs. Extremely important determinants across conditions were both care and attitudes of health professionals, and help and assistance as well as attitudes of the family, endorsed by more than 80% and 70% of the sample regardless of brain disorder, respectively. More than 84% of persons with any condition endorsed the impact of medication in their PSD, with the exception of substance dependency (50% endorsement rate). The four environmental determinants not fulfilling our criteria were ‘costs of the medication’, ‘assistive devices’, ‘access to alcohol’ and ‘access to illegal drugs’. As can be seen from Table 3, in general terms the percentages of people endorsing the influence of environmental determinants on their PSD were very high in all groups.

Table 3. Environmental determinants included in the data collection protocol and the percentage of persons who experienced them as having a positive or negative influence in their psychosocial difficulties.


The hypothesis of horizontal epidemiology in brain disorders, namely, that there are PSDs and determinants experienced in common across brain disorders was supported by the evidence in this paper. This finding challenges the brain disorder-specific, silo-like, or vertical approach in which clinical and epidemiological research about psychosocial difficulties is commonly carried out and corresponding health care delivery practiced in many countries of the world.

To our knowledge this is the first time that this hypothesis has been formulated and tested by means of an approach integrating information from literature, PROs and clinical instruments, expert clinical knowledge and most importantly the involvement of persons with brain disorders themselves. Results of the steps that led to the development of the PARADISE data collection protocol and determinants have been recently published [14, 1618, 3335]. Here we concentrate exclusively on the results and discussion of the testing of the hypothesis of horizontal epidemiology.

We were surprised by the result that 56 of 64 PSDs fulfilled the criteria we established to test the hypothesis of horizontal epidemiology and that for several PSD much larger rates of endorsement across brain conditions were observed. As expected due to the overlap with symptoms of mental and neurological disorders, PSDs related to mental health functions, especially being emotionally affected, depressive mood, worry and anxiety, and coping with stress were highly relevant and affected nearly half of our participants independently of their brain disorder. The same pattern was observed for pain, with extremely high endorsement rates in persons with migraine (94%) but also in persons with depression and substance dependency (over 80%). Further highly relevant PSD across disorders were problems in carrying out daily routine, in mobility and in keeping economic sufficiency. These results confirm, first of all, the impact of brain disorders on people’s lives. This impact goes beyond impairments, such as sleep disturbances, to fundamental difficulties in major life areas, such as keeping economic sufficiency. Similar results have already been shown for single conditions such as migraine, PD, MS, stroke, Dementia, depression or epilepsy [8,1722]. Similarities regarding PSD have also been shown in studies across mental disorders applying the WHO Disability Assessment Schedule (WHODAS 2.0), a generic instrument for health and disability valid across diseases and disorders, also mental disorders [21]. Exemplary articles report that problems are experienced to different extents in all six WHODAS domains (cognition, mobility, self-care, getting along with others, participation in society, and life activities) by persons with any mood, anxiety or substance use disorder [36] or persons with bipolar affective disorder and schizophrenia [37]. The novelty of our work consists of showing that people experience the same kind of difficulties regardless of the brain disorder they have, in a broad range of brain disorders specific PSD selected in a multi-step process and in altogether nine brain disorders very different regarding aetiology, symptoms and progression.

Similarly surprising clear results were observed for environmental determinants: 16 from 20 determinants fulfilled the criteria we established a priori, and the endorsement rates for these determinants were generally much higher than the 25% criteria, regardless of brain condition. Extremely high endorsement rates across brain disorders for care and attitudes of health professionals, and help and assistance as well as attitudes of the family stress the importance of these relationships for PSD. These results are in line with the acknowledged importance of family support in different brain disorders, for instance in PD and Dementia [38], and in line with current efforts to improve service user experience in adult mental health, where one quality statement is assuring that users “and their families or carers, are treated with empathy, dignity and respect” [12]. Again, the novelty of our work consists rather of showing that these determinants are valid across brain disorders.

Our results were unexpected because we included a large number of PSDs and determinants in the data collection protocol so as not to miss potentially relevant PSDs and determinants. One may object that the result was affected by the overly lenient cut-off of 25% for relevant PSD and 5 out of 9 brain disorders. But, one out of four is already highly significant, and we had no reason to set that threshold higher. In the case of using 5 out of 9 brain disorders as the threshold for commonality, we feel very confident that this was sufficient since the results would have been unchanged if a higher cut-off 7 out of 9 brain disorders was used.

One might object as well that a major limitation of our study was the lack of a comparison of PSDs experienced by persons with disorders that cause chronic ill health, other than brain disorders. It is certainly our hypothesis that many of the PSDs shared by brain conditions would be shown to be experienced by persons with other chronic health conditions, even those that are not brain disorders. A recent study to create a 'generic ICF core set' found that for a large clinical population (N = 9863) with very diverse health conditions, several functioning domains–mobility, self-care and interpersonal relationships, among others–were experienced in common and explained their general health status [39]. Many of these categories were indeed the same as the PSDs reported in this study. At the same time, for some health conditions such as asthma, or disease groups, such as lung diseases, it is likely that there are fairly specific PSD that are highly relevant both to research and treatment, but might not be common problems across all chronic health conditions. Analogously, we assume that for brain disorders, despite the overlap with other chronic health conditions, there may well be specific PSD that are more closely linked to these disorders than to other health conditions.

Now that we have evidence in support of the hypothesis of horizontal epidemiology, what are the consequences? We see consequences in clinical practice, research and policy making.

While highly specialized brain-disorder knowledge and specific diagnostic criteria are required for diagnosis, a broader, more cross-cutting approach is necessary to understand the impact of brain disorders in daily life and to develop and implement interventions and strategies that directly address this impact. Applying interventions across brain disorders opens the door to a more efficient health care provision in which health professionals can rely on common clinical experience and knowledge transfer to address similar PSD. The Canadian experience in increasing access to cognitive-behavioural therapy irrespective of the disorder, is an example of how to achieve cost-effectiveness with a horizontal approach [40].

There is also some evidence that a cross-cutting strategy to health care in brain disorders is cost-effective especially in low resource settings where every effort needs to be made to spread limited care resources [41, 42]. The results of the PARADISE project suggest that in the care of persons with brain disorders high resource countries might well learn from the experience of implementing cross-cutting intervention strategies in low resource settings.

In research, we see in light of our results the need for studies that capture the impact of brain disorders horizontally. As noted, Wittchen et al. found no European study that systematically examined impact across brain disorders [3] and in PARADISE we widened that search to include international studies and found the same results (the database for this work can be obtained from the corresponding author). As we have seen with the surprising results of PARADISE, cross-cutting horizontal research in PSD in brain disorders pays off in terms of broadening our understanding of the impact of these disorders in daily life, and on what are important determinants of this impact.

We also see the need for an outcome measure to describe the impact of living with a brain disorder that is sensitive to change over time and able to capture similarities and differences between disorders. This is required to evaluate effectiveness and cost-effectiveness of interventions across brain disorders, as has been pointed out by other authors. The widely-used Short Form-36 [43] and the EQ-5D [44] have been shown not to be sensitive to people with mental disorders [45, 46]. While there are many condition-specific PROs addressing problems in functioning and health-related quality of life in persons with specific brain disorders, there is no generic instrument addressing difficulties that persons with brain disorders experience in their life. The results of the PARADISE project form the ideal basis to develop a generic, brain disorder outcome measure, as recently reported [47, 48].

Health policy-makers, unlike clinicians and researchers, now recognize the importance of brain disorders as a whole, in order to understand the genetic, biochemical and structural impairments behind brain disorders [49]. In addition, a better and broader understanding of PSDs that people with these disorders confront daily is needed. Knowledge about the environmental determinants of those difficulties, as well as the determinants of their deterioration or improvement, can lead to a wide range of interventions that can truly make a difference to people’s lives. Investments in research focusing on the development of social and psychological interventions are urgently needed. People with brain disorders themselves need to hear that exhaustion of medical interventions does not mean that nothing else can be done. The results of this study show that much more can be done to improve the lives of persons with brain disorders with interventions targeting PSDs as well as the environment. As has been shown in previous research, interventions targeting both affected persons and the environment can be extremely effective [50]. Theoretically the scale of the benefit of these interventions can be enlarged if they are implemented across disorders.

This project has limitations that must be considered while interpreting our results. Firstly, it has been carried out from a solely European perspective and data was collected in four European countries, even though the literature reviewed in the preparation phase was international. This may speak against the generalizability of its results that should be validated with data of other regions of the world. Secondly, in some steps of our multi-method approach we relied solely on our research group, for instance to select PROs and salient PSDs. Although all partners participating in the study are acknowledged experts in their areas, we recognize a risk of having prioritized their preferences, and considering a broader expert pool could have led to a different selection of PROs and salient PSDs. We have been, however, very conservative throughout the study and paid attention to include even PSDs and determinants relevant to small group of disorders. Our selection of PSDs and determinants was also critically evaluated by a panel of six external experts, who did not belong to our consortium. Thirdly, it has to be taken into account that the sample included in our study was a convenience one and that the relationship between the severity of a disorder and endorsement rates of PSD and determinants could not be explored, among others. Studies with larger and representative samples, balanced regarding disease severity, are therefore required to confirm our results, and to explore their robustness when disease severity is considered. Fourth, determinants not fulfilling our criteria were access to alcohol and illegal drugs. We acknowledge that these factors involve very sensitive issues that are difficult to address in an interview and that we have here a risk of social desirability bias. Last but not least, and as mentioned before, our criteria for deciding whether the hypothesis of horizontal epidemiology, though intuitive, were nevertheless neither supported by evidence nor verified with any statistical tests. We welcome arguments from readers suggesting more appropriate criteria.


In conclusion, our study provides first evidence that supports the hypothesis of horizontal epidemiology in brain disorders: Psychosocial difficulties and environmental determinants of those difficulties are experienced in common across brain disorders. This result challenges the brain disorder-specific or vertical approach in which clinical and epidemiological research about psychosocial difficulties experienced in daily life is commonly carried in neurology and psychiatry and the way in which the corresponding health care delivery is practiced in many countries of the world.

Supporting Information

S1 File. Summary PRISMA-like flow chart of the nine systematic reviews.


S2 File. PRISMA-like flow chart covering the nine systematic reviews.



Our special thanks go to the participants in the studies reported in this investigation, as well as to all the researchers of the PARADISE Consortium: Ludwig-Maximilians-University: Alarcos Cieza (lead author,, Michaela Coenen, Heinrich Gall, Barbara Kollerits, Carla Sabariego; Universidad Autonoma de Madrid: Jose Luis Ayuso-Mateos, Maria Cabello, Blanca Mellor, Jordi Vigil; Neurological Institute Carlo Besta: Matilde Leonardi, Milda Cerniauskaite, Venusia Covelli, Ambra Giovannetti, Rui Quintas, Alberto Raggi, Silvia Schiavolin; World Health Organisation: Somnath Chatterji; Swiss Paraplegic Research: Jerome Bickenbach, Carolina Ballert, Mirjam Brach, Miriam Lückenkemper; European Brain Council: Mary Baker, Alastair Benbow, Tadeusz Hawrot; Universtiy of East Anglia: Sally Hartley; Instytut Psychiatrii i Neurologii: Marta Anczewska, Katarzyna Charzyńska, Anna Chrostek, Piotr Świtaj, Joanna Roszczyńska-Michta, Justyna Waszkiewicz; CF consulting Finanziamenti Unione europea: Carla Finocchiaro, Serena Cogoni; A-klinikkasäätiö: Tuuli Pitkänen, Antti Holopainen, Kirsi Jokela, Teemu Kaskela, Jonna Levola, Jouni Tourunen. Their contributions and extensive hours of work have made the PARADISE project possible. We would also like to thank Cornelia Oberhauser for reviewing all statistical calculations and Ulrich Hegerl, Jürg Kesselring, Victor Perez, Martin J. Prince, Pekka Rapeli and Richard Williams for their valuable contributions and feedback during the expert meeting held in Geneva on September 23rd, 2011.

Author Contributions

Conceived and designed the experiments: AC MA JLAM MB JB SC SH ML TP. Performed the experiments: MA JLAM ML TP. Analyzed the data: AC. Wrote the paper: AC MA JLAM MB JB SC SH ML TP.


  1. 1. WHO. Neurological Disorders: Public Health Challenges Geneva2006.
  2. 2. Reed GM SW, Bufka LF. The relevance of the International Classification of Functioning, Disability and Health (ICF) to mental disorders and their treatment. ALTER, European Journal of Disability Research. 2009;3(4):340–59.
  3. 3. Wittchen HU, Jacobi F, Rehm J, Gustavsson A, Svensson M, Jonsson B, et al. The size and burden of mental disorders and other disorders of the brain in Europe 2010. European neuropsychopharmacology: the journal of the European College of Neuropsychopharmacology. 2011 Sep;21(9):655–79. pmid:21896369.
  4. 4. Finsterer J, Mahjoub SZ. Fatigue in Healthy and Diseased Individuals. The American journal of hospice & palliative care. 2013 Jul 26. pmid:23892338.
  5. 5. Nandi PR. Pain in neurological conditions. Current opinion in supportive and palliative care. 2012 Jun;6(2):194–200. pmid:22498834.
  6. 6. Colman I, Ataullahjan A. Life course perspectives on the epidemiology of depression. Canadian journal of psychiatry Revue canadienne de psychiatrie. 2010 Oct;55(10):622–32. pmid:20964941.
  7. 7. Woodward LJ, Fergusson DM. Life course outcomes of young people with anxiety disorders in adolescence. Journal of the American Academy of Child and Adolescent Psychiatry. 2001 Sep;40(9):1086–93. pmid:11556633.
  8. 8. WHO. International Classification of Functioning, Disability and Health: ICF. Geneva: World Health Organization. 2001.
  9. 9. Iosifescu DV. The relation between mood, cognition and psychosocial functioning in psychiatric disorders. European neuropsychopharmacology: the journal of the European College of Neuropsychopharmacology. 2012;22 Suppl 3:S499–504. pmid:22959115.
  10. 10. Leonardi M, Meucci P, Ajovalasit D, Albanesi F, Cerniauskaite M, Invernizzi V, et al. ICF in neurology: functioning and disability in patients with migraine, myasthenia gravis and Parkinson's disease. Disability and rehabilitation. 2009;31 Suppl 1:S88–99. pmid:19968543.
  11. 11. Cieza A, Bostan C, Oberhauser C, Bickenbach JE. Explaining functioning outcomes across musculoskeletal conditions: a multilevel modelling approach. Disability and rehabilitation. 2010;32 Suppl 1:S85–93. pmid:20937001.
  12. 12. NICE. Service user experience in adult mental health: improving the experience of care for people using adult NHS mental health services. NICE clinical guideline 136. 2011.
  13. 13. Murray CJ, Vos T, Lozano R, Naghavi M, Flaxman AD, Michaud C, et al. Disability-adjusted life years (DALYs) for 291 diseases and injuries in 21 regions, 1990–2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2012 Dec 15;380(9859):2197–223. pmid:23245608.
  14. 14. Cabello M, Mellor-Marsa B, Sabariego C, Cieza A, Bickenbach J, Ayuso-Mateos JL. Psychosocial features of depression: a systematic literature review. Journal of affective disorders. 2012 Dec 1;141(1):22–33. pmid:22209189. Epub 2012/01/03. eng.
  15. 15. Switaj P, Anczewska M, Chrostek A, Sabariego C, Cieza A, Bickenbach J, et al. Disability and schizophrenia: a systematic review of experienced psychosocial difficulties. BMC psychiatry. 2012;12:193. pmid:23137171. Pubmed Central PMCID: 3539983. Epub 2012/11/10. eng.
  16. 16. Levola J, Kaskela T, Holopainen A, Sabariego C, Tourunen J, Cieza A, et al. Psychosocial difficulties in alcohol dependence: a systematic review of activity limitations and participation restrictions. Disability and rehabilitation. 2014;36(15):1227–39. pmid:24079366.
  17. 17. Quintas R, Raggi A, Giovannetti AM, Pagani M, Sabariego C, Cieza A, et al. Psychosocial difficulties in people with epilepsy: a systematic review of literature from 2005 until 2010. Epilepsy & behavior: E&B. 2012 Sep;25(1):60–7. pmid:22749606. Epub 2012/07/04. eng.
  18. 18. Raggi A, Giovannetti AM, Quintas R, D'Amico D, Cieza A, Sabariego C, et al. A systematic review of the psychosocial difficulties relevant to patients with migraine. The journal of headache and pain. 2012 Nov;13(8):595–606. pmid:23001069. Pubmed Central PMCID: 3484254. Epub 2012/09/25. eng.
  19. 19. Cieza A, Geyh S, Chatterji S, Kostanjsek N, Ustun B, Stucki G. ICF linking rules: an update based on lessons learned. Journal of rehabilitation medicine: official journal of the UEMS European Board of Physical and Rehabilitation Medicine. 2005 Jul;37(4):212–8. pmid:16024476.
  20. 20. Tacchini G, Coppola MT, Musazzi A, Altamura AC, Invernizzi G. [Multinational validation of the Composite International Diagnostic Interview (CIDI)]. Minerva psichiatrica. 1994 Jun;35(2):63–80. pmid:7934738. Validazione multinazionale della composite international diagnostic interview (CIDI).
  21. 21. WHO. Measuring Health and Disability: Manual for WHO Disability Assessment Schedule (WHODAS 2.0)2010.
  22. 22. Snaith RP, Zigmond AS. The hospital anxiety and depression scale. Br Med J (Clin Res Ed). 1986 Feb 1;292(6516):344. pmid:3080166. Pubmed Central PMCID: 1339318. Epub 1986/02/01. eng.
  23. 23. Hamedani AG, Wells CK, Brass LM, Kernan WN, Viscoli CM, Maraire JN, et al. A quality-of-life instrument for young hemorrhagic stroke patients. Stroke. 2001 Mar;32(3):687–95. pmid:11239188. Epub 2001/03/10. eng.
  24. 24. Bergner M, Bobbitt RA, Carter WB, Gilson BS. The Sickness Impact Profile: development and final revision of a health status measure. Medical care. 1981 Aug;19(8):787–805. pmid:7278416. Epub 1981/08/01. eng.
  25. 25. Schauenburg H, Strack M. [The Symptom Checklist-90-R (SCL-90-R) for presenting statistically and clinically significant psychotherapy outcome]. Psychotherapie, Psychosomatik, medizinische Psychologie. 1998 Jul;48(7):257–64. pmid:9739190. Die Symptom Checklist-90-R (SCL-90-R) zur Darstellung, von statistisch und klinischsignifikanten Psychotherapieergebnissen.
  26. 26. Wing JK, Babor T, Brugha T, Burke J, Cooper JE, Giel R, et al. SCAN. Schedules for Clinical Assessment in Neuropsychiatry. Arch Gen Psychiatry. 1990 Jun;47(6):589–93. pmid:2190539. Epub 1990/06/01. eng.
  27. 27. van Straten A, de Haan RJ, Limburg M, Schuling J, Bossuyt PM, van den Bos GA. A stroke-adapted 30-item version of the Sickness Impact Profile to assess quality of life (SA-SIP30). Stroke. 1997 Nov;28(11):2155–61. pmid:9368557. Epub 1997/11/22. eng.
  28. 28. Duncan PW, Wallace D, Lai SM, Johnson D, Embretson S, Laster LJ. The stroke impact scale version 2.0. Evaluation of reliability, validity, and sensitivity to change. Stroke. 1999 Oct;30(10):2131–40. pmid:10512918. Epub 1999/10/08. eng.
  29. 29. WHO. Development of the World Health Organization WHOQOL-BREF quality of life assessment. Psychol Med. 1998 May;28(3):551–8. pmid:9626712. Epub 1998/06/17. eng.
  30. 30. Rammstedt B, John OP. Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and German. Journal of Research in Personality. 2007;41:203–12.
  31. 31. Luszczynska A, Scholz U, Schwarzer R. The general self-efficacy scale: multicultural validation studies. J Psychol. 2005 Sep;139(5):439–57. pmid:16285214. Epub 2005/11/16. eng.
  32. 32. Sangha O, Stucki G, Liang MH, Fossel AH, Katz JN. The Self-Administered Comorbidity Questionnaire: a new method to assess comorbidity for clinical and health services research. Arthritis and rheumatism. 2003 Apr 15;49(2):156–63. pmid:12687505.
  33. 33. Hartley S, McArthur M, Coenen M, Cabello M, Covelli V, Roszczynska-Michta J, et al. Narratives reflecting the lived experiences of people with brain disorders: common psychosocial difficulties and determinants. PloS one. 2014;9(5):e96890. pmid:24805128. Pubmed Central PMCID: 4013080.
  34. 34. Levola J, Aalto M, Holopainen A, Cieza A, Pitkanen T. Health-related quality of life in alcohol dependence: a systematic literature review with a specific focus on the role of depression and other psychopathology. Nordic journal of psychiatry. 2014 Aug;68(6):369–84. pmid:24228776.
  35. 35. Coenen M, Cabello M, Umlauf S, Ayuso-Mateos JL, Anczewska M, Tourunen J, et al. Psychosocial difficulties from the perspective of persons with neuropsychiatric disorders. Disability & Rehabilitation. 2015; Epub ahead of print:
  36. 36. Scott KM, Collings SC. Gender and the association between mental disorders and disability. Journal of affective disorders. 2010 Sep;125(1–3):207–12. pmid:20637507. Pubmed Central PMCID: 3807583.
  37. 37. Adegbaju DA, Olagunju AT, Uwakwe R. A comparative analysis of disability in individuals with bipolar affective disorder and schizophrenia in a sub-Saharan African mental health hospital: towards evidence-guided rehabilitation intervention. Social psychiatry and psychiatric epidemiology. 2013 Sep;48(9):1405–15. pmid:23385802.
  38. 38. Habermann B, Davis LL. Caring for family with Alzheimer's disease and Parkinson's disease: needs, challenges and satisfaction. Journal of gerontological nursing. 2005 Jun;31(6):49–54. pmid:16138530.
  39. 39. Cieza A, Oberhauser C, Bickenbach J, Chatterji S, Stucki G. Towards a minimal generic set of domains of functioning and health. BMC public health. 2014;14:218. pmid:24588794. Pubmed Central PMCID: 3973890.
  40. 40. Payne KA, Myhr G. Increasing Access to Cognitive-Behavioural Therapy (CBT) for the Treatment of Mental Illness in Canada: A Research Framework and Call for Action. Healthcare policy = Politiques de sante. 2010 Feb;5(3):e173–85. pmid:21286263. Pubmed Central PMCID: 2831741.
  41. 41. Cohen A, Raja S, Underhill C, Yaro BP, Dokurugu AY, De Silva M, et al. Sitting with others: mental health self-help groups in northern Ghana. International journal of mental health systems. 2012;6(1):1. pmid:22436354. Pubmed Central PMCID: 3366888.
  42. 42. McKenzie K, Patel V, Araya R. Learning from low income countries: mental health. Bmj. 2004 Nov 13;329(7475):1138–40. pmid:15539667. Pubmed Central PMCID: 527688.
  43. 43. Ware JE Jr, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Medical care. 1992 Jun;30(6):473–83. pmid:1593914.
  44. 44. EuroQol—a new facility for the measurement of health-related quality of life. The EuroQol Group. Health policy. 1990 Dec;16(3):199–208. pmid:10109801.
  45. 45. Brazier J. Is the EQ-5D fit for purpose in mental health? The British journal of psychiatry: the journal of mental science. 2010 Nov;197(5):348–9. pmid:21037210.
  46. 46. Papaioannou D, Brazier J, Parry G. How valid and responsive are generic health status measures, such as EQ-5D and SF-36, in schizophrenia? A systematic review. Value in health: the journal of the International Society for Pharmacoeconomics and Outcomes Research. 2011 Sep-Oct;14(6):907–20. pmid:21914513. Pubmed Central PMCID: 3179985.
  47. 47. Cieza A, Sabariego C, Anczewska M, Ballert C, Bickenbach J, Cabello M, et al. PARADISE 24: A Measure to Assess the Impact of Brain Disorders on People's Lives. PloS one. 2015;10(7):e0132410. pmid:26147343. Pubmed Central PMCID: 4492620.
  48. 48. Sabariego C, Coenen M, Ballert C, Cabello M, Leonardi M, Anczewska M, et al. Determinants of psychosocial difficulties experienced by persons with brain disorders: towards a ‘horizontal epidemiology’ approach. Under peer review.
  49. 49. National Institutes of Health N. Brain Research through Advancing Innovative Neurotechnologies (BRAIN) Initiative. Available: Accessed: 8 January 2013.
  50. 50. Matsubayashi T, Ueda M. The effect of national suicide prevention programs on suicide rates in 21 OECD nations. Social science & medicine. 2011 Nov;73(9):1395–400. pmid:21940085.