Refugee patients with severe traumatic experiences may need mental health treatment, but treatment results vary, and there is scarcity of studies demonstrating refugees’ long-term health and well-being after treatment. In a 10-year naturalistic and longitudinal study, 54 multi-origin traumatized adult refugee patients, with a background of war and persecution, and with a mean stay in Norway of 10.5 years, were recruited as they entered psychological treatment in mental health specialist services. The participants were interviewed face-to-face with multiple methods at admittance, and at varying points in time during and after psychotherapy. The aim was to study the participants’ trajectories of symptoms of post-traumatic stress, anxiety and depression, four aspects of quality of life, and two aspects of exile life functioning. Linear mixed effects analyses included all symptoms and quality of life measures obtained at different times and intervals for the participants. Changes in exile life functioning was investigated by exact McNemar tests. Participants responded to the quantitative assessments up to eight times. Length of therapy varied, with a mean of 61.3 sessions (SD = 74.5). The participants improved significantly in symptoms, quality of life, and exile life functioning. Improvement in symptoms of posttraumatic stress, anxiety, and depression yielded small effect sizes (r = .05 to .13), while improvement in quality of psychological and physical health yielded medium effect sizes (r = .38 and .32). Thus, long-time improvement after psychological therapy in these severely traumatized and mostly chronified refugee patients, was more notable in quality of life and exile life functioning than in symptom reduction. The results imply that major symptom reduction may not be attainable, and may not be the most important indication of long-term improvement among refugees with long-standing trauma-related suffering. Other indications of beneficial effects should be applied as well.
Citation: Opaas M, Wentzel-Larsen T, Varvin S (2020) The 10-year course of mental health, quality of life, and exile life functioning in traumatized refugees from treatment start. PLoS ONE 15(12): e0244730. https://doi.org/10.1371/journal.pone.0244730
Editor: James Curtis West, Uniformed Services University of the Health Sciences, UNITED STATES
Received: May 3, 2020; Accepted: December 15, 2020; Published: December 31, 2020
Copyright: © 2020 Opaas et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Research among refugees hosted in Europe, North-America, and Australia has shown an overrepresentation of mental health suffering among individuals with a refugee background compared to the majority populations [1–3], even after many years in the host country . This implies a challenge to the mental health system. In this paper, we examine the long-term trajectories of mental health, quality of life, and two aspects of functioning in exile of resettled refugees who sought treatment for trauma-related disorders in Norwegian mental health settings more than 10 years ago. At that time, there were only about 125 000 individuals with a refugee background in Norway, and the largest groups originated from Iraq, Somalia, Bosnia-Hercegovina, and Iran. Now the number is almost twice as high .
Refugees flee from conflict, persecution, violence, imprisonment, torture, and other human rights violations—sometimes from experiences beyond our imagination. Moreover, they often cope with severe dangers and obstacles, and mobilize substantial resources, strength, and adaptability on their way to refuge [6, 7]. Some are able to maintain their psychological equilibrium after adverse and dramatic experiences and may show considerable resilience [8, 9]. However, the multiple losses inherent in having to leave all that is known behind, adverse experiences during flight, and the challenges and hardships in exile add to the burden refugees need to cope with . Together, this seriously challenges afflicted refugees’ capacity for resilience. A sizeable proportion develop symptoms of posttraumatic stress, depression and other mental health disorders, and may be in need of mental health treatment, but still, most traumatized refugees go untreated .
In addition to war-related trauma preceding flight, many refugees have suffered adverse and potentially traumatic experiences during childhood and adolescence [12, 13]. Many refugees have thus been exposed to what is referred to as complex trauma , which includes exposure to multiple, cumulative, and prolonged human-caused potentially traumatic experiences such as childhood abuse, domestic violence, sexual and physical assault, persecution, torture, combat, and other life threatening experiences. Exposure to complex trauma may lead to a decreased threshold for PTSD, and problems of personality functioning, such as affect dysregulation, relational difficulties, identity disturbance, and problematic behaviour . The ACE (Adverse Childhood Experiences) study has convincingly demonstrated that childhood adversities above a certain level predict psychological and physical health problems, reduced prosperity, and premature death .
Research has shown that a higher exposure to traumatic experiences before and after migration is associated with PTSD, depression and anxiety . Up to one third of the refugee population may have posttraumatic stress disorder (PTSD), often comorbid with other anxiety-related disorders and depression . Physical health disorders [18, 19] and physical pain  are also frequent among refugees. Berthold et al.  found that the number of physical health problems was doubled in refugees with PTSD and depression, compared to refugees without these mental health disorders. Furthermore, chronic pain was found to be frequent among multi-traumatized refugees in outpatient mental health clinics in Norway, and the level of pain was positively related to their symptomatology and severity of psychiatric morbidity . The extent of mental and physical symptoms and problems of living in exile have severe consequences for the refugees’ wellbeing and capacity to function [23, 24].
Studies including measures of quality of life (QOL) have shown that refugees’ QOL is lower , and in clinical samples way below international population norms [12, 26]. Furthermore, a significant negative relationship between PTSD symptoms and subjective QOL has been demonstrated [27, 28]. The more severe the refugees’ mental health symptoms, the poorer their quality of life . Refugees’ frequent psychosocial problems and exposure to post-migration stressors, such as unemployment, poverty, unstable housing, discrimination, social marginalisation, exclusion, and weak social network, impact negatively on their mental health, adaptation and well-being , and may diminish their ability to recover from pre-migration trauma . Among multi-traumatized refugee patients, Teodorescu et al.  found that unemployment, weak social network and weak social integration into the Norwegian community were significantly associated with more psychiatric morbidity and poorer quality of life.
Several studies have shown the interdependence between mastering the language of the host country, completing education or holding employment and mental health, well being, and functioning well in exile [31–33]. After resettlement, refugees are expected to attend programs to learn the exile language and then get financially independent, but refugees with mental health problems may have difficulties fulfilling these expectations. In a Swiss study, difficulties with communication and employment, together with isolation, were found to be among the most serious difficulties for traumatized refugee patients . The authors proposed a circular association between mental disorders connected with posttraumatic and postmigratory stress, functional impairment, and postmigration living difficulties.
Reviews, meta-studies, and systematic reviews of mental health treatment outcome among refugees with trauma-related disorders, have shown positive mean effects on mental health symptoms [34–39], although within studies variation in individual participants’ improvement is commonly great [40, 41]. What most reviews have in common is a compilation of studies with relative short follow-up after termination of the intervention (usually up to a few months) and with outcome measures restricted to mental health symptoms (and sometimes somatic symptoms). A few single clinical studies with longer follow-up, report improved outcome with time. A 10-year follow-up  of traumatized refugee patients evidenced a 30% decrease in participants qualifying for a PTSD diagnosis. The study demonstrated that improvement in this patient group may take time, and continue over time, but at the same time, it is noteworthy that 56% retained their diagnosis of PTSD and 69% their diagnosis of depression, evidencing significant chronicity. Correspondingly, Buhmann et al.  found no significant effect immediately following intervention, but the six and 18 months follow-ups of their study  demonstrated a small improvement over time in PTSD, depression and anxiety symptoms, and in level of functioning. However, the majority of the participants still had symptom scores above clinical cut-off. These studies indicate that many or most refugee patients retain their diagnosis/-es after treatment and only some improve clinically significantly–that is–to an amount that makes a difference to their lives. Therefore, longer follow-up is necessary to study improvement after therapy in this patient group.
The comorbidity of refugees’ mental health problems and physical ailments, the daily life struggles in exile, and the complex needs of refugees and asylum seekers are acknowledged among refugee researchers [17, 38]. To reach clinically significant improvement, patients with complex disorders and difficult psychosocial living conditions need longer duration of therapy than what is ordinarily offered , and many may not improve to the level that is expected in other patient groups . There is, however, no simple relationship between mental health improvement and therapeutic dose (e.g., number of sessions). Thus, studies on refugee patients investigating the effect of therapeutic dose on outcome showed only weak and inconsistent findings [47, 48]. Psychotherapy research in general  has demonstrated that after the first few sessions, other factors within and outside therapy begin to merge with sheer exposure to therapy in terms of number of sessions.
According to researchers in the refugee field, treatment approaches need special tailoring and additional approaches to be of benefit to the complex trauma and life situations of refugees [17, 29, 43]. The potential helpfulness of psychotherapy for traumatized refugees rests, at a basic level, then, on having enough therapy resources to be able to offer the necessary amount of sessions, having a reservoir of interventions that can be adjusted to individual needs, and on the therapist’s skills in engaging the patient so that he or she remains in therapy until positive change is accomplished.
The short- and long-term effects of psychological treatment for refugees and what constitutes positive outcomes are only starting to be investigated . Of note is also that patients’ evaluations of “good outcome” or “no change” may not coincide with therapists’ evaluations or with symptoms changes . Researchers in the field of refugee mental health have underlined the need to do more research into refugees’ optimal health outcomes, the mechanisms of improvement and chronicity, the durability of treatment effects, and to not only focus on PTSD, but to study a wider scope of therapy outcome, including improvement in other aspects of mental health, functioning, relational security, and quality of psychological, physical, and social well-being [35, 51, 52]. More knowledge is thus needed about whether and how psychological therapies can be helpful, about outcomes in addition to symptoms improvement, such as psychological and physical wellbeing, relational and exile life functioning, and about the effect of treatment over time. The present study is an attempt to fill this knowledge gap. The aim was to examine the long-term changes in mental health, quality of life, and in two aspects of exile life functioning (exile language competence and employment/study status) among refugee patients in a naturalistic follow-up study from treatment start in mental health treatment units, through treatment, and for some time after termination.
In this study, individuals with backgrounds as asylum seekers or refugees will briefly be termed refugees. Moreover, the term ‘traumatized’ generically refers to having experienced severe, repeated, diverse, and potentially traumatizing events, preceding the development of mental health disorder.
In a longitudinal and naturalistic study from 2006 to 2017, 54 traumatized refugee patients responded to repeated interviews comprising qualitative and quantitative research methods assessing the course of their mental health, quality of life, and exile life functioning. Their therapists were also interviewed one or more times. The study was designed to obtain a comprehensive understanding of refugee patients’ mental health and wellbeing over time, in context of their past and present life circumstances, their traumatic experiences, and their therapy experience. The treatment consisted of psychological therapy/psychotherapy and was conducted under naturalistic conditions in publicly funded, outpatient mental health services in the Oslo area, Norway. There are no specialized treatment units for traumatized refugees in Norway; treatment is provided within the general mental health services.
Participants were consecutively recruited into the study during the years 2006 to 2009. Inclusion criteria were: patients with severe mental health problems, age 18 to 65, with a history as refugee/asylum seeker with potentially traumatic experiences related to war, persecution, torture and other severe human rights violations, newly accepted for mental health treatment. A PTSD diagnosis was not required as the study sought to include various mental health problems that might ensue among refugees in the aftermath of potentially traumatic events. An ability to communicate in Norwegian was not required. Exclusion criteria were presence of psychosis or drug abuse, if severe enough to hinder research assessment.
The study was approved by the Norwegian South-East Regional Committee for Medical and Health Research Ethics  and therapy was conducted according to the Declaration of Helsinki: Ethical Principles for Medical Research Involving Human Subjects . Participants’ written, informed consent was required to take part in the study. The first consent was limited to three years. After three years, the participants were asked if they wanted to continue taking part in the study, and those who accepted, gave a new, non-time-limited informed and written consent.
Results from intake assessment [12, 55] and from 1- and 3-year follow-up  have previously been published. The pre-treatment analyses demonstrated that the participants had suffered extensive potentially traumatic events related to war and persecution  as well as adverse and potentially traumatic events during childhood . The three-year follow-up study , including symptoms of posttraumatic stress disorder (PTSD), anxiety, and depression, and four aspects of quality of life (QOL) revealed significant group-level improvement in Depression, Anxiety, PTSD Arousal symptoms, and in the QOL domains Physical Health, Psychological Health, and Social Relationships. Length of treatment varied, and at the three-year follow-up, 29% of the therapies were still not terminated. For further details and a discussion of the findings, see [56, 57].
By 2017, all therapies were terminated, and most of them had been terminated for five or more years. The current study encompasses all quantitative follow-up data from the ten-year data collection period.
The participants, 35 men and 19 women, came from 15 different countries in Asia, Europe, and Africa. Of these, 57.4% (n = 31) came from countries in the Middle East, 16.7% (n = 9) came from other Asian countries, 16.7% (n = 9) came from countries in the Balkans, and 9.3% (n = 5) came from various African countries. According to their responses to the Harvard Trauma Questionnaire checklist (HTQ, Part 1)  on traumatic events, the participants had experienced a mean of more than 16 different kinds of potentially traumatic events related to war, persecution and human rights violations, mostly in early adulthood, including exposure to torture in 52.8%, and rape in 20.8% of the participants. In addition, 92% of the participants had suffered various adverse and potentially traumatic experiences during their childhood, such as loss of parents, severe illness or accidents, domestic violence, and witnessing violence and killings outside the home . At the time of intake to the study, mean age was 39.3 (SD = 8.2), mean stay in Norway was 10.5 years (SD = 6.5), 50.0% of the group could communicate in Norwegian, and 22.2% held employment, though on sick leave at treatment start. None was engaged in formal studies. One participant lived in a refugee reception centre. The others lived in ordinary flats in the community. Two persons did not hold a Norwegian citizenship or a non-time-limited permission to stay in Norway. Two of the participants had completed secondary education in Norway . See Table 1 for demographics and scores on mental health, QOL, host country language competence and work/study status upon entering the study.
For the study, we collaborated with two outpatient clinics and six psychotherapists with publicly funded, independent practices, all part of the specialist mental health services in Norway. During the 3-year intake period in these services, all patients who were eligible according to the inclusion criteria, were asked to participate in the study. Potential participants were carefully informed, in writing and verbally, about the purpose of the study, about confidentiality, that participation in the study was voluntary, that rejecting was of no consequence for their treatment, and that, if they signed up for the study, they could withdraw at any time. Seventy-two patients were asked to participate in the study, and 54 accepted and gave their written consent (75% inclusion).
The participants were interviewed face-to-face throughout the study by two researchers who were also clinical specialists, and who were external to the services where the participants received their therapy. Information on the language ability of participants was provided by the mental health clinics, and interpreters were summoned accordingly. For participants who were expected to master the Norwegian language (or English), we arranged a first meeting without an interpreter, but if mutual understanding and expressive capacity in a common language was not sufficient, the meeting was rescheduled, and later research interviews were conducted with the help of an interpreter. In later years of the study, interpreters were cancelled if participants demonstrated increased Norwegian skills by understanding and responding to our questions and comments in Norwegian before the interpreter had time to translate.
The participants were assessed with quantitative and qualitative methods, including symptom checklists and quality of life questionnaires, structured interviews assessing personality functioning and attachment history (Rorschach and Adult Attachment Interview), and open-ended qualitative interviews about past and present aspects of their lives. As recommended by Mollica et al. , the checklists and questionnaires were completed in the presence of the researchers, who offered assistance and explanations when needed, and who listened and responded in an atmosphere of empathy. Most of the participants preferred that researchers read the questionnaire and checklist items to them and noted their responses.
At inclusion into the study, interviews were conducted over 5–6 sessions (7–10 full hours) in order to complete all the planned parts of the assessment. The appointments to the research interviews were free of charge, while payment for therapy sessions in the treatment unit followed ordinary rules. In agreement with the participants, the treatment unit was informed about the results of the study intake assessment. Number of research follow-ups depended on the participants’ length of treatment and their continued response to and acceptance of invitations to participate in research interviews after termination. Mental health symptoms (symptoms of PTSD, anxiety and depression) and quality of life (QOL, four domains) were thus recorded several times, about yearly or bi-yearly, and then more infrequently, before, during, at the end of, and after therapy. The participants were included into the study over a three-year period (2006–2009), and follow-up assessments were performed at varying times and frequencies between the participants. At each follow-up, one, two, or more meetings were required, depending on the respondent’s health status, extensiveness of their responses, and the use of an interpreter. Therapists were also interviewed about their professional background, their experience working with refugees, and about the specific therapy process with the patient participating in the study.
Treatment consisted of psychological therapies of various lengths and theoretical orientations, including trauma-directed and psycho-social interventions, and was provided mostly by specialists in clinical psychology (58.8%) and psychiatry (25.5%), in the outpatient clinics also by a few psychologists and medical doctors in specialist training, and a couple of social workers and nurses with specialization in psychotherapy. The therapies in the outpatient clinics mostly had a one to two year limit, while therapists in independent practices could offer longer-term psychotherapy. The longer lasting psychotherapies in this study were mainly relational in orientation, working with alliance, relational safety, and with the traumatic experiences themselves. Each patient had to pay co-payments adding up to equivalent to 240 Euro at the beginning of each year of treatment. The rest of the year treatment was free of charge.
The Harvard Trauma Questionnaire -Trauma Events (HTQ, Part 1; ), is a checklist of potentially traumatic experiences (PTEs) related to war, persecution, and other human rights violations (HRVs). The revised Cambodian version was modified, as recommended by Mollica et al., to encompass the PTEs most relevant to the group in question–here, a multinational sample. Our list thus consisted of 37 different types of PTEs related to war and HRVs such as armed attacks, persecution, and lethal danger, killings of loved ones, imprisonment, and torture. There were no age requirements to scoring of these experiences. Each confirmed type of experience is scored 1.
The Harvard Trauma Questionnaire, Symptoms of PTSD (HTQ, Part IV, Questions 1–16) , is a symptom checklist consisting of 16 items derived from the criteria for PTSD in the Diagnostic and statistical manual of mental disorders, fourth edition (DSM-IV) , which was the edition in use when this study started. The presence and severity of each item/symptom is scored from 1 (not at all) to 4 (extremely). Mollica et al’s  validation study resulted in a clinical cutoff of ≥ 2.5, with a sensitivity of 78% and a specificity of 65% for PTSD. Scores ≥ 2.5 were considered checklist positive for PTSD. The mean of all 16 items (PTSD-Total), and the means of the three symptom clusters; PTSD-Reexperiencing (Questions 1, 2, 3, and 16), PTSD-Arousal (Questions 6, 7, 8, 9, and 10), and PTSD-Avoidance (Questions 4, 5, 11, 12, 13, 14, and 15) were used in the analyses.
The Hopkins Symptom Checklist-25 (HSCL-25 ) consists of 10 items tapping symptoms of anxiety (non-specific) and 15 items tapping symptoms of depression. The presence and severity of each item/symptom is scored from 1 (not at all) to 4 (extremely). Mean scores above 1.75 on the 10 items tapping anxiety and on the 15 items tapping depression was found consistent with clinically significant anxiety (generalized anxiety disorder) and major depression, respectively, with high sensitivity and specificity. Clinical cutoff was thus set to > 1.75. . According to Mollica et al.  the HTQ and the HSCL- 25 were not designed as a self-report, but should always be administered to traumatized refugees by health care workers, in an atmosphere of empathy.
The World Health Organisation Quality of Life Bref (WHOQOL-Bref) [59, 61] consists of 26 items organized into Domain 1, Physical Health (7 items); Domain 2, Psychological Health (6 items); Domain 3, Social Relationships (3 items); and Domain 4, Environment/Environmental Conditions (8 items). Each item is scored on a Likert scale from 1 (not at all/very dissatisfied/ disagree strongly) to 5 (completely/very satisfied/agree strongly). Following the most commonly used option in the WHOQOL-Bref Manual, raw scores were converted to a scale from 0 (very poor) to 100 (excellent). A worldwide field study among rich and poor, sick and healthy individuals by Skevington et al.  resulted in the following means: 64.8 for Physical Health, 60.0 for Psychological Health, 57.2 for Social Relationships, and 54.0 for Environmental Conditions. (For comparison with the initial QOL mean scores of our participants, see Table 1)
Exile life functioning was represented by the variables Communicated in Norwegian, tapping whether or not Norwegian language competence was sufficient to take part in the research interviews in Norwegian, and Employed or Studying, tapping whether or not the participants held employment or were engaged in formal studies, even if on sick-leave at the time of assessment. Both were dichotomously scored 1 (yes) or 0 (no), and expressed by the percentage of participants scoring yes. The scoring of the variable Communicated in Norwegian was based on our experience in the interviews. This was a crude measure. Without our presence, explanations and examples, fewer would have been able to accurately understand and respond to the questionnaire items. The participants’ employment or student status was based on their report, and was merged into one variable. We see exile language acquisition, ability to work and study as partly dependent on a tolerable level of anxiety and intrusive thoughts, and thus possible signs of increased mental well-being, as well as prerequisites to function as integrated members of the society.
The number of therapy sessions and treatment length in years, were calculated from information in the treatment records and from therapists’ reports in our interviews with them. When there was more than one treatment episode during the study, the sessions and months in each of the treatments were added.
Descriptive analyses were included for research participation, questionnaire completion, and treatment dose. The outcomes studied during follow-up included posttraumatic stress symptoms, anxiety and depression symptoms, and QOL in four domains assessed through the 10 years of follow-up. Also included were two areas of exile life functioning, the variables Communicated in Norwegian (ability to take part in the research interviews in Norwegian) and Employed or Studying (holding employment or a student status). Changes from intake to the situation at the last research contact were investigated by exact McNemar tests. To examine changes in mental health symptoms and QOL, including all measures obtained at different times and intervals for the 54 participants over the 10 years of study, we used linear mixed effects (lme). lme is a statistical method suited to analyse repeated measurements in longitudinal studies, even when number of observations and the observation times differ among subjects [62, 63]. Time was modelled as continuous from T1. All measures over the entire research period were utilized to estimate the progress. Missing data were left missing. Random effects were included for intercept and slope, and the random structure was simplified as recommended by Pinheiro and Bates , if confidence intervals for random effects were not estimable or confidence limits were severely small or large. Thus, for QOL Environmental Conditions, the random structure had to be simplified by including random variation for the intercept only. Analyses of changes in symptoms of PTSD, anxiety, depression and QOL over time were performed. Marginal R2 was computed as a measure of effect size for general linear mixed effects models by a method developed by Nakagawa and Schielzeth . Marginal R2 is defined as the proportion of variance attributed to the fixed factors, compared with the sum of variances for random effects. Further, we computed an effect size measure r defined as the square root of the marginal R2. Cohen’s  benchmarks were used to evaluate the effect sizes: a correlation coefficient r = .10 represented a small effect, r = .30 a medium effect, and r = .50 a large effect. Descriptive statistics and t-tests were analysed by IBM SPSS Statistics, version 26. Mixed effects models were analyzed by the R package nlme and exact McNemar tests by the R package exact 2x2 .
Fifty-four participants met for the intake interviews. One of them did not wish to respond to the questionnaires at intake, but did so at later follow-ups. During the first three years of follow-up, we only lost three participants from the study; and among these three, we were able to obtain information on language and work status for one of them about three years after intake . Almost three fourths (74.1%) of the participants chose to continue taking part in the study after three years, when participants were asked for a renewed written consent. After this time, research participation dropped little by little, usually some time after therapy termination. When data collection was terminated in 2017, participants’ total time taking part in the study was from 1 year up to 10.9 years (We have rounded down to 10 years in description of the study because only two participants took part in the study more than 10.49 years. Mean duration of participation in the study was 5.2 years (SD = 2.7). One third of the participants (33.3%) took part in the study for six or more years. One participant met with us only at one assessment-point, seven participants met only at two assessment points, 41 participants met with us at three to five assessment-points, and 5 participants met with us at six to seven assessment points. Over the entire study, the researchers spent from about 12 to 24 full hours interviewing each participant.
Questionnaire completion: Over the years, 54 participants completed altogether 201 HSCL-25 questionnaires, tapping anxiety and depression, varying from 1 to 7 times each between the participants, with a mean of 3.7 times each. Due to lack of endurance, time restraints and prioritizing of the qualitative aspects of the main study, the participants responded slightly less to the other questionnaires; 54 participants completed 160 HTQ Part IV questionnaires (varying from 1 to 7 times, with a mean of 3.0 times each), tapping symptoms of PTSD, and 53 participants completed 156 WHOQOL-Bref questionnaires (varying from 1 to 7 times, with a mean of 2.9 times each), tapping four domains of quality of life. The follow-up assessments over the 10 years of study were obtained at different times and frequencies, i.e. were not synchronized between participants, and can therefore not be shown in a table.
Among the refugee patients, 34 started in the outpatient mental health clinics, and 20 in individual psychotherapy practices with public funding. For some participants, research follow-up some time after termination of treatment in the outpatient clinics showed that participants were still greatly suffering, and often they were not admitted for further therapy in the outpatient clinics. The researchers were then able to allocate some to individual practitioners. This included six of the participants.
Mean length of the participants’ therapies during the whole study period was 61.3 sessions (SD = 74.5) over 3.4 years (SD = 3.1). Among the participants, 31.5% had 1 year of treatment or less, 22.6% had 6 years of treatment or more. Furthermore, 24.1% (n = 13) of the participants had less than 11 sessions, 38.9% (n = 21) had more than 45 sessions, and 25.9% of the participants had 100 or more sessions. The few patients terminating therapy after only a few sessions had various reasons for this. In a qualitative interview, one of these patients told that he terminated his contact with the therapist in the specialist service, as he felt sufficiently helped by the T1 research interviews. A couple of patients terminated prematurely for economic reasons, but took part in research interviews, which were free of charge. Some of the therapists, especially in the “private” practices, were able to keep on working with their patients for several years, in the hope that a fuller recovery would be possible. An ad hoc computation of the relationship between length of research contact and length of treatment showed that participants with longer treatments also took part in research follow-ups over a longer period of time (r = .536, p < .001).
Changes in mental health and quality of life
The mixed effects analyses showed that over time, the participants improved significantly in symptoms of PTSD, anxiety and depression, and in three aspects of QOL. Among them, significance ranged from p ≤ .001 to p = .030, and effect sizes ranged from r = .05 to r = .38. The effect sizes were small for all the symptom changes (r = .05 to .13) and for the QOL variables Social Relationships (r = .07) and Environmental Conditions (r = .13), while the changes in the QOL variables Psychological Health (r = .38) and Physical Health (r = .32) were of medium effect size (see Table 2).
The lme modelled linear trajectories. Non-linearity was checked, but there were no clear indications of non-linear trajectories (see S1 Fig). At intake, 78.9% (n = 41) qualified for a PTSD diagnosis, 96.2% (n = 51) for an anxiety diagnosis, and 98.1% (n = 52) for major depression, while at the last meeting with each of the participants, 59.3% (n = 32) qualified for a PTSD diagnosis, 81.5% (n = 44) for an anxiety diagnosis, and 85.2% (n = 46) for major depression, according to the clinical cutoff of the symptom checklists (see Table 1, S1 and S2 Data).
The trajectories of symptom improvement in PTSD Total, PTSD Reexperiencing, PTSD Arousal, PTSD Avoidance, Anxiety, and Depression are illustrated in Fig 1.
All reductions in symptoms were significant. Symptoms of PTSD were measured by the Harvard Trauma Questionnaire (HTQ Part IV) . Anxiety and Depression were measured by the Hopkins Symptom Checklist (HSCL-25) . The plot illustrates the trajectories over 10 years from study inclusion/treatment start.
The participants’ improved quality of life is illustrated by the trajectories of the four domains in Fig 2.
Improvements in Quality of Life were significant in the domains Physical Health and Psychological Health (p < .001), and Environment (p = .025). Quality of Life: WHOQOL-Bref . The plot illustrates the trajectories over 10 years from study inclusion/treatment start.
Changes in exile life functioning
The last time each of the 54 participants met with us, 9 more participants (5 females, 4 males) could communicate in Norwegian during interviews, and 8 more of the participants (2 females, 6 males) had gotten employed or started studying during follow-up. However, one participant stopped working due to increasing mental health problems. Thus, the number of participants who could communicate in Norwegian increased significantly (p = .004) from 50.0% (n = 17) to 66.7% (n = 36), and the number of participants who were engaged in paid work or formal studies increased significantly (p = .039) from 22.2% (n = 12) at intake to the study, when all of 12 who held work were on sick-leave, to 35.2% (n = 19) at our last meeting. None of them were at this point on sick-leave. A supplementary independent samples t-test of the difference in “Length of stay in Norway at our last meeting” between those who changed from not being able to communicate in Norwegian at the beginning of the study to being able to communicate in Norwegian at our last meeting, and those who did not change status concerning language competence, revealed a significant difference of about six years (p = .003), indicating that the shorter the stay in Norway, the greater the likelihood of a change from not being able to communicate in Norwegian to being able to do so. A corresponding supplementary independent samples t-test of the difference in “Length of stay in Norway at our last meeting” between those who changed from not being employed or enganged in formal studies at the beginning of our study to having gotten employed or entered formal studies at our last meeting. revealed no significant difference (p = .598). However, an ad hoc exact chi-square test showed that 44.4% of those who learned to communicate during the study, also got employed or started in formal studies, and 50% of those who got employed or started in formal studies had also learned to communicate in Norwegian during the course of the study (p = .033).
With repeated interviews and assessments over 10 years, this study examined the mental health trajectories of 54 (former) patients with refugee background and trauma related mental health disorders. The research interviews started at the time of the participants’ entrance into psychological treatment, continued through their time attending treatment, and followed up through variable lengths of time after termination. The therapies were of differing lengths and theoretical approaches, but all addressed to some extent the patients’ traumatic experiences. The mean duration of the therapies was 61 sessions over about three years. Although most therapies were planned as weekly, the average, holidays deducted, turned out to be roughly two sessions per month. According to the therapists, some patients cancelled sessions for physical health reasons, some to follow family members to various appointments, and some were absent without notice due to having forgotten sessions or overslept after sleepless nights.
The linear mixed effects analyses including measurements over the entire research period, demonstrated that the participants’ long-time improvement, at the mean level, was significant but modest in symptoms of PTSD, anxiety and depression. Moreover, the participants improved significantly, and more decisively, in subjectively felt quality of life in the psychological and physical health domains. The linear mixed effects results may not be reliable during late follow-up since only a small group of participants had long follow-up times. Many of these received long-term therapy. The substantial uncertainty during late follow-up can also be seen from the size of the grey, trumpet-like shadows on the smooth curves towards the 10-year mark [S1 Fig]. We found significant improvement in exile life functioning among the participants, in terms of the number of participants who, at the end of follow-up, could communicate in Norwegian and in the number who were employed or had entered formal studies.
The modest symptom improvement can be attributed to the protracted, severe, and complex condition of the refugee patients at treatment start. In the introduction, we reported on the chronic trajectories of many refugee patients. The mean duration of residence in Norway when entering treatment and this study, was 10.5 years. Many clinical studies, in addition to ours, have found that refugee participants have stayed for several years–with means from five up to 16 years–in the host country before entering mental health treatment [27, 67]. The late entrance to mental health services may be part of the reason for the chronicity of many of these patients’ mental health disorders, despite therapy. According to the findings by Haagen et al. , another factor contributing to the modest improvement, may be the high level of comorbid depression at treatment start. Comorbidity and psychosocial problems in general clinical populations predict poorer treatment response, and among patients with complex presentations of PTSD, with comorbidity, and with chronic conditions at the outset of therapy, many continue to have substantial symptoms after termination [46, p. 174]. Thus, the longitudinal, small, average symptom reduction found in this study may be as good as it gets, considering the complexity and chronicity of many of these patients’ mental health disorders in combination with psychosocial problems and an often marginalized position in society.
Concerning the participants’ mental health changes, symptoms of anxiety decreased the most, then the arousal and avoidance clusters of PTSD, thereafter depression. The reduction in symptoms was lowest within the reexperiencing cluster of PTSD. This implies that even if the participants were still bothered by recurring thoughts related to the traumatic events, reexperiencing did not evoke as much anxiety. The decrease in arousal and avoidance can be interpreted in the same direction: trauma memories persist, or are easily evoked, but the participants do not engage in as much avoidance behaviour, and there is not as much evidence of bodily or emotional upheaval. The decrease in depression can be understood as a sum effect of general symptom improvement and improved functioning. Even if the changes are of small effect, these seem to be important results. However, as noted by Lambert , symptom reduction may not be the most important sign of improvement with severely traumatized patients and may not be the best way to evaluate outcome. Furthermore, for this patient group, a full recovery in terms of symptom removal may not be a realistic treatment goal. The greater effect size of improvement in quality of life relative to symptom reduction among the participants in this study could indicate that the participants coped with their symptoms with greater strength or less suffering.
The participants’ perceived quality of their psychological health improved the most, but was closely followed by their subjectively felt quality of physical health. The joint initial low level of, and subsequent joint improvement in the participants’ experience of the quality of their psychological and their physical health indicates the close relationship between physical and psychological well-being, and resonates well with the finding by e.g. Berthold et al. , of the connection between physical and mental health problems among refugees. The participants’ perceived quality of their environmental conditions improved somewhat less, but then their initial score was not as low as other aspects of quality of life at intake to the study–“probably owing to the relatively good welfare system in Norway” [57, p. 40]. Finally, the participants’ subjective experience of their quality of social relationships also improved, although less than other aspects of quality of life. Our impression from the qualitative interviews was that many of our informants struggled with relating socially to anyone outside the immediate family. A separate study of children in refugee families, including several children of participants in this study, showed that the children took much responsibility for parents’ social function, including relations outside the family [68, 69]. Among the adult participants in the present study, however, some appeared to become more socially confident after the benign experience of talking with their therapist, and when the pressure of their trauma-related and depressive ruminations decreased.
The significant increase, during the study, in the number of participants who could communicate in Norwegian during interviews, was, according to the supplementary analysis, partly related to being newer in the country, so that some more years of stay made a positive difference. Other not-investigated factors must also have been of importance to the result. The increase in the number of participants who were employed or engaged in formal studies was also significant. Here, the supplementary analysis showed no significant association between change in job/study status and number of years spent in Norway. It may be worth noting that in addition to the relatively small increase in participants who became employed or started studying, all except one of those who already held employment (although on sick-leave) when they entered treatment and the study, managed to get back to work and stay employed. Our belief is that therapy was important to take the step into employment or studies, as well as recuperating and holding onto jobs. Considering the participants’ mean age of nearly 40 years, their mean decade long stay in Norway, and their likely chronic mental health condition at entry to therapy and the study, the results are relatively encouraging. The improvement in exile life functioning together with the improved quality of life, may demonstrate that even small effect changes in symptoms can have important consequences for the participants’ lives. According to Schick et al.’s  proposal of a circular association between mental health, wellbeing, and exile life functioning, positive change in any of these areas may also fuel improvement in other areas.
Not as easily measured as items on a checklist, but supported by our impressions from the qualitative interviews, we believe that the contact over time with a benign, empathising and interested therapist gives hope, alleviates stress, encourages the patient to move on in life, and thus contributes to increased tolerance of symptoms, greater well-being, and improved functioning.
In the participants’ therapies, the number of therapy sessions was not set in advance, but was dependent in part by each participant’s needs and course of improvement. In the mental health outpatient clinics participating in this study, few patients were allowed more than 1–2 years of treatment. The individual practice specialists, however, could work with their patients over several years. The results showed that about one fourth of the participants had less than 11 therapy sessions, a non-therapeutic number of sessions according to the studies of Lambert and of Hansen et al. [47, 48]. On the other hand, almost 39 percent of the patients had more than 45 sessions, the minimum number of sessions that were estimated to be required for improvement among patients with comorbid disorders and psychosocial problems [47, 48]. In our study, nearly 26 percent of the participants had 100 or more therapy sessions, a number of sessions that will only infrequently be offered to refugee patients in Norway, and probably also in most other countries. We have not examined the relationship between therapy dose (number of sessions) and improvement in mental health symptoms and QOL in the present study. In general, there is little correlation between number of sessions and outcome, as discussed in the introduction . However, from the qualitative interviews with patients and with their therapists, we could see that for some patients, the long-term therapy over several years resulted in great steps forward, while for others, their suffering seemed to be as severe when the therapy was terminated. Still, one of the patients, who after many years of therapy seemed not to have progressed, said to his therapist in the last session: “You have helped me much more than you think”. In line with De Smet et al.  we suggest that discerning what constitutes good treatment and beneficial outcome for this patient group warrants closer study.
The changes observed in this study may be attributed to a combined effect of the personal qualities of the participants, the therapy experience, including the therapist’s personal qualities, therapeutic style, and interventions, the match between therapist and patient, the comprehensive research interviews, experienced by many of the participants as therapeutic in themselves, life events outside therapy, and the passing of time. We tentatively refer to the previously offered suggestion [57, p. 56], that the long stay in Norway, the longevity of functional impairment, and the severe load of anxiety, depression and posttraumatic stress symptoms upon entering therapy, makes it unlikely that significant improvement during the next years was due to time alone.
The significant improvements found over the entire 10 years of data collection, indicated that gains obtained at the three-year follow-up  were more or less maintained. However, we observed extensive individual differences in treatment response/long-term outcome among the participants at the end of the study, and many of the participants still had a high symptom burden. Therefore, predicting who in refugee patient groups can benefit from therapy in general, and long-term treatment in particular, may be difficult. Nevertheless, leaning on a conclusion by Bager et al.  about the positive family level cost-benefit effect of psychosocial rehabilitation for severely traumatized refugees, we consider it well worth the effort to invest in the wellbeing of the individual patient, with the anticipated spin-off effect upon the patient’s spouse and children.
Strengths and limitations
This study, with its longitudinal design including several outcome measures, may contribute to knowledge regarding the long-term course during and after psychological treatment, of traumatized refugees’ mental health, well-being and functioning in exile. The broad inclusion criteria and the high acceptance rate in the study imply that the participants can be seen as representative of the clinical population of trauma-affected refugees being accepted for psychological treatment in and around the Oslo area of Norway at the time of inclusion. The patients received treatment of varying theoretical orientations and lengths, according to the patients’ needs, the therapists’ appraisal of appropriateness and effect, and the policy of the treatment units.
A limitation of the study is that we did not perform a pre-study power calculation in 2006. Furthermore, without a controlled design, we cannot claim that any positive changes can be attributed to the treatment received. However, the participants’ mean stay in Norway was more than 10 years when they entered the study, indicating increased or continued suffering rather than improvement over time. Likewise, the long duration of follow-up, with repeated measurements, and the statistical method employed, which made use of all the measuring points, speak against the notion that we might have captured a top in suffering at inclusion, and at later measurements a bottom of the wavelike ups and downs of mental health suffering found in refugee studies. A limitation is that using linear mixed effects analysis did not allow us to see when changes appeared, as they were modelled linearly. The great variation in national origins, time of stay in Norway, length and type of therapy, and number and frequencies of research follow-ups, limit what analyses can be made and what conclusions can be drawn. We have not yet examined the trajectories of different subgroups among the participants, for example of the third among the participants who continued to take part in research assessments the last few years. Looking into this subgroup could inform us whether they were among cases with less or more improvement, causing the long-term mental health trajectory to inflate or deflate.
The participants did not respond to all the questionnaires at each point in time. We may have wanted to do too much at each research meeting with the refugees. Due to the participants’ many strains of living, their difficult social situation, and their mental and physical problems, many of the participants did not have the time or strength to respond to all of the questionnaires and the semi-structured qualitative interview questions each time. Many preferred to talk freely about their life situation and experiences.
Conclusion and implications
During this 10-year follow-up study, the traumatized refugees had attended psychotherapy of varying length and content in publicly funded, specialist mental health services in Norway. The participants improved significantly and modestly in mental health symptoms, but more in experienced quality of psychological and physical health. Thus, how one lives with ones symptoms may be more important than the level of symptoms themselves. Some were able to start formal education, some who had not previously been employed, started working, and some learned to communicate in Norwegian during the course of the study. The results hide substantial individual variation in improvement. As evidenced in the quantitative data and our repeated meetings with the participants, some benefited to a great extent, others moderately, and a few, left untouched by the therapy experience, just continued on a downwards spiral. Discerning which characteristics impact on the degree of benefit from psychotherapy, and which barriers may be at play for those who do not seem to benefit, is vital to be able to help as many of these patients as possible and to use existing resources in a good way. Major symptom reduction may not be attainable, and may not be the most important indication of long-term improvement among refugees with long-standing and trauma-related suffering. In addition to symptoms mitigation, evaluation of treatment effects should take into consideration a broad array of outcomes, including physical and psychological well-being, exile life functioning, relational security, and social network. Furthermore, individuals or subgroups should be studied in detail to learn more about factors related to change.
Preventive efforts and mental health interventions at an earlier time, as in a stepped care approach [71, 72], could counteract the chronicity of mental health suffering in this at-risk group. For refugees in need of mental health treatment, we suggest that working simultaneously with mental health problems, host language acquisition, and employment may increase gains and benefit all of these areas. Finally, in accordance with Hynie  we propose that the whole person, embedded in his or her familial and societal context, and examination of ongoing stress factors that need to be alleviated, should be included in approaches to promote health and restore functioning for traumatized refugees.
S1 Fig. Smooth curves to check for non-linearity.
- 1. Bogic M, Njoku A, Priebe S. Long-term mental health of war-refugees: a systematic literature review. BMC Int Health Hum Rights. 2015; 15: 29. pmid:26510473
- 2. Fazel M, Wheeler J, Danesh J. Prevalence of serious mental disorder in 7000 refugees resettled in western countries: A systematic review. Lancet. 2005; 365: 1309–1314. pmid:15823380
- 3. Li SSY, Liddell BJ, Nickerson A. The Relationship between post-migration stress and psychological disorders in refugees and asylum seekers. Curr Psychiatry Rep. 2016; 18: 82. pmid:27436307
- 4. Vaage AB, Thomsen PH, Silove D, Wentzel-Larsen T, Van Ta T, Hauff E. Long-term mental health of Vietnamese refugees in the aftermath of trauma. Br J Psychiatry. 2010; 196: 122–125. pmid:20118457
- 5. Statistics Norway, 2008. https://www.ssb.no/en/befolkning/statistikker/flyktninger/aar/2008-09-15
- 6. Bäärnhielm S, Laban K, Schouler-Ocak M, Rousseau C, Kirmayer LJ. Mental health for refugees, asylum seekers and displaced persons: A call for a humanitarian agenda. Transcult Psychiatry. 2017; 54: 565–574. pmid:29226788
- 7. Simich L, Andermann L, editors. Refuge and Resilience: Promoting resilience and mental health among resettled refugees and forced migrants (Vol. 7). Dordrecht, the Netherlands: Springer; 2014.
- 8. Papadopoulos RK. Refugees, trauma and Adversity-Activated Development. Eur J Psychother Couns. 2007; 9: 301–312.
- 9. Southwick SM, Bonanno GM, Masten AS, Panter-Brick C, Yehuda R. Resilience definitions, theory, and challenges: interdisciplinary perspectives. Eur J Psychotraumatol. 2014; 5: 25338. pmid:25317257
- 10. Hollifield M, Warner TD, Krakow B, Westermeyer J. Mental Health Effects of Stress over the Life Span of Refugees. J Clin Med. 2018; 7, 25. pmid:29415443
- 11. Pumariega AJ, Rothe E, Pumariega JB. Mental Health of Immigrants and Refugees. Community Ment Health J. 2005; 41: 581–597. pmid:16142540
- 12. Opaas M, Varvin S. Relationships of childhood adverse experiences with mental health and quality of life at treatment start for adult refugees traumatized by pre-flight experiences of war and human right violations. J Nerv Ment Dis. 2015; 203: 684–695. pmid:26103604
- 13. Riber K. Trauma complexity and child abuse: A qualitative study of attachment narratives in adult refugees with PTSD. Transcult Psychiatry. 2017; 54: 840–869. pmid:29130379
- 14. Courtois CA. Complex trauma, complex reactions: Assessment and treatment. Psychotherapy: Theory, research, practice, training. 2004; 41: 412–425.
- 15. Briere J, Scott C. Complex trauma in adolescents and adults. Effects and treatment. Psychiatr Clin North Am. 2015; 38: 515–527. pmid:26300036
- 16. Anda RF, Felitti VJ, Bremner JD, Walker JD, Whitfield C, Perry BD, et al. The enduring effects of abuse and related adverse experiences in childhood. A convergence of evidence from neurobiology and epidemiology. Eur Arch Psychiatry Clin Neurosci. 2006; 256: 174–186. pmid:16311898
- 17. Carlsson J, Sonne C, Silove D. From pioneers to scientists: challenges in establishing evidence-gathering models in torture and trauma mental health services for refugees. J Nerv Ment Dis. 2014; 202: 630–637. pmid:25167130
- 18. Pavli A, Maltezou H. Health problems of newly arrived migrants and refugees in Europe. J Travel Med. 2017; 24. pmid:28426115
- 19. van Melle MA, Lamkaddem M, Stuiver MM, Gerritsen AA, Devillé WL, Essink-Bot ML. Quality of primary care for resettled refugees in the Netherlands with chronic mental and physical health problems: A cross-sectional analysis of medical records and interview data. BMC Fam Pract. 2014; 15: 160. pmid:25249345
- 20. El Sount CRO, Windthorst P, Denkinger J, Ziser K, Nikendei C, Kindermann D, et al. Chronic pain in refugees with posttraumatic stress disorder (PTSD): A systematic review on patients' characteristics and specific interventions. J Psychosom Res. 2019; 118: 83–97. pmid:30078503
- 21. Berthold SM, Kong S, Mollica RF, Kuoch T, Scully M, Franke T. Comorbid mental and physical health and health access in Cambodian refugees in the US. J Community Health. 2014; 39: 1045–1052. pmid:24651944
- 22. Teodorescu DS, Heir T, Siqveland J, Hauff E, Wentzel-Larsen T, Lien L. Chronic pain in multi-traumatized outpatients with a refugee background resettled in Norway: a cross-sectional study. BMC Psychol. 2015; 3: 7, 1–12. pmid:25815196
- 23. Momartin S, Silove D, Manicavasagar V, Steel Z. Comorbidity of PTSD and depression: associations with trauma exposure, symptom severity and functional impairment in Bosnian refugees resettled in Australia. J Affect Disord. 2004; 80: 231–238. pmid:15207936
- 24. van Wyk S, Schweitzer R, Brough M, Vromans L, Murray K. A longitudinal study of mental health in refugees from Burma: The impact of therapeutic interventions. Aust N Z J Psychiatry. 2012; 46: 995–1003. pmid:22431841
- 25. Leiler A, Bjärtå A, Ekdahl J, Wasteson E. Mental health and quality of life among asylum seekers and refugees living in refugee housing facilities in Sweden. Soc Psychiatry Psychiatr Epidemiol. 2019; 54: 543–551. pmid:30580381
- 26. Teodorescu DS, Siqveland J, Heir T, Hauff E, Wentzel-Larsen T, Lien L. Posttraumatic growth, depressive symptoms, posttraumatic stress symptoms, post-migration stressors and quality of life in multi-traumatized psychiatric outpatients with a refugee background in Norway. Health Qual Life Outcomes. 2012; 10: 1–16. pmid:22208808
- 27. Huijts I, Kleijn W, Van Emmerik A, Noordhof A, Smith A. Dealing with man‐made trauma: The relationship between coping style, posttraumatic stress, and quality of life in resettled, traumatized refugees in the Netherlands. J Trauma Stress. 2012; 25: 71–78. pmid:22354510
- 28. Kounou KB, Brodard F, Gnassingbe A, Dogbe Foli AA, Sager JC, Schmitt L, et al. Posttraumatic stress, somatization, and quality of life among Ivorian refugees. J Trauma Stress. 2017; 30: 682–689. pmid:29194763
- 29. Hynie M. The Social Determinants of Refugee Mental Health in the Post-Migration Context: A Critical Review. Canad J Psychiatry. 2018; 63: 297–303. pmid:29202665
- 30. Teodorescu DS, Heir T, Hauff E, Wentzel-Larsen T, Lien L. Mental health problems and post‐migration stress among multi‐traumatized refugees attending outpatient clinics upon resettlement to Norway. Scand J Psychol. 2012; 53: 316–332. pmid:22612589
- 31. Schick M, Zumwald A, Knöpfli B, Nickerson A, Bryant RA, Schnyder U, et al. Challenging future, challenging past: the relationship of social integration and psychological impairment in traumatized refugees. Europ J Psychotraumatology 2016; 1–9. pmid:26886484
- 32. Salvo T, Williams AC. “If I speak English, what am I? I am full man, me”: Emotional impact and barriers for refugees and asylum seekers learning English. Transcultural Psychiatry, 2017; 54: 733–755. pmid:29226796
- 33. Kartal D, Alkemade N, Kiropoulos L. Trauma and mental health in resettled refugees: mediating effect of host language acquisition on posttraumatic stress disorder, depressive and anxiety symptoms. Transcultural psychiatry. 2019; 56: 3–23. pmid:30117781
- 34. Slobodin O, de Jong JT. Mental health interventions for traumatized asylum seekers and refugees: What do we know about their efficacy? Int J Soc Psychiatry. 2015; 61: 17–26. pmid:24869847
- 35. Turrini G, Purgato M, Acarturk C, Anttila M, Au T, Ballette F, et al. Efficacy and acceptability of psychosocial interventions in asylum seekers and refugees: systematic review and meta-analysis. Epidemiol Psychiatr Sci. 2019; 28: 376–388. pmid:30739625
- 36. van Wyk S, Schweitzer RD. A systematic review of naturalistic interventions in refugee populations. J Immigr Minor Health. 2014; 16: 968–977. pmid:23666201
- 37. Nosè M, Ballette F, Bighelli I, Turrini G, Purgato M, Tol W, et al. Psychosocial interventions for post-traumatic stress disorder in refugees and asylum seekers resettled in high-income countries: Systematic review and meta-analysis. PLoS ONE. 2017; 12: 2. pmid:28151992
- 38. McFarlane CA, Kaplan I. Evidence-based psychological interventions for adult survivors of torture and trauma: a 30-year review. Transcult Psychiatry. 2012; 49: 539–567. pmid:23008355
- 39. Thompson CT, Vidgen A, Roberts NP. Psychological interventions for post-traumatic stress disorder in refugees and asylum seekers: A systematic review and meta-analysis. Clin Psychol Rev. 2018; 63: 66–79. pmid:29936342
- 40. Halvorsen JO, Stenmark H. Narrative exposure therapy for posttraumatic stress disorder in tortured refugees: A preliminary uncontrolled trial. Scand J Psychol. 2010; 51: 495–502. pmid:20487410
- 41. Carlsson JM, Olsen DR, Kastrup M, Mortensen EL. Late mental health changes in tortured refugees in multidisciplinary treatment. J Nerv Mental Dis. 2010; 198: 824–828. pmid:21048474
- 42. Carlsson JM., Olsen DR, Mortensen EL, Kastrup M. Mental health and health-related quality of life: a 10-year follow-up of tortured refugees. J Nerv Ment Dis. 2006; 194: 725–731. pmid:17041283
- 43. Buhmann CB, Nordentoft M, Ekstroem M, Carlsson J, Mortensen EL. The effect of flexible cognitive–behavioural therapy and medical treatment, including antidepressants on post-traumatic stress disorder and depression in traumatized refugees: pragmatic randomised controlled clinical trial. Br J Psychiatry. 2016; 208: 252–259. pmid:26541687
- 44. Buhmann CB, Nordentoft M, Ekstroem M, Carlsson J, Mortensen EL. Long-term treatment effect of trauma-affected refugees with flexible cognitive behavioural therapy and antidepressants. Psychiatry Res. 2018; 264: 217–223. pmid:29655114
- 45. Hansen NB, Lambert MJ, Forman EM. The psychotherapy dose-response effect and its implications for treatment delivery services. Clin Psychol: Science and Practice. 2002; 9: 329–343.
- 46. Lambert MJ. The efficacy and effectiveness of psychotherapy. In: Lambert MJ, editor. Bergin and Garfield’s Handbook of psychotherapy and behaviour change. New Jersey: John Wiley & Sons, Inc.; 2013. p. 169–218.
- 47. Carlsson JM, Mortensen EL, Kastrup M. A Follow-Up Study of Mental Health and Health-Related Quality of Life in Tortured Refugees in Multidisciplinary Treatment. J Nerv Ment Dis. 2005; 193: 651–657. pmid:16208160
- 48. Van Wyk S, Schweitzer R, Brough M, Vromans L, Murray K. A longitudinal study of mental health in refugees from Burma: The impact of therapeutic interventions. Aust N Z J Psychiatry. 2012; 46: 995–1003. pmid:22431841
- 49. Haagen JFG, ter Heide FJJ, Mooren TM, Knipscheer JW, Kleber RJ. Predicting post-traumatic stress disorder treatment response in refugees: Multilevel analysis. Br J Clin Psychol. 2017; 56: 69–83. pmid:27900778
- 50. De Smet MM, Meganck R, De Geest R, Norman UA, Truijens F, Desmet M. What “Good Outcome” Means to Patients: Understanding Recovery and Improvement in Psychotherapy for Major Depression From a Mixed Methods Perspective. J Couns Psychol. 2020; 67: 25–39. pmid:31204837
- 51. Gabriel PS, Morgan-Jonker C, Phung CMW, Barrios R, Kaczorowski J. Refugees and Health Care–The need for data: Understanding the health of government-assisted refugees in Canada through a prospective longitudinal cohort. Can J Public Health. 2011; 102: 269–272. pmid:21913581
- 52. Murray KE, Davidson GR. Review of Refugee Mental Health Interventions Following Resettlement: Best Practices and Recommendations. Am J Orthopsychiatry. 2010; 80: 576–585. pmid:20950298
- 53. Norwegian South-East Regional Committee for Medical and Health Research Ethics. https://helseforskning.etikkom.no
- 54. Declaration of Helsinki: Ethical Principles for Medical Research Involving Human Subjects. World Medical Assoc. 2010.
- 55. Opaas M, Hartmann E. Rorschach assessment of traumatized refugees: An exploratory factor analysis. J Pers Assess. 2013; 95: 457–470. pmid:23570250
- 56. Opaas M, Hartmann E, Wentzel-Larsen T, Varvin S. Relationship of pretreatment Rorschach factors to symptoms, quality of life, and real-life functioning in a three-year follow-up of traumatized refugee patients. J Pers Assess. 2016; 98: 247–260. pmid:26528822
- 57. Opaas M. Trauma, personality function, and posttraumatic reactions: a retrospective and prospective study of traumatized refugee patients. Doctoral Thesis, Dep of Psychology, University of Oslo; 2016. DUO: http://urn.nb.no/URN:NBN:no-53824
- 58. Mollica RF, McDonald LS, Massagli MP, Silove DM. Measuring trauma, measuring torture. Instructions and guidance on the utilization of Hopkins Symptom Checklist-25 (HSCL-25) & the Harvard Trauma Questionnaire (HTQ). Harvard program in refugee trauma. 2004; CD retrieved 2006. http://hprt-cambridge.org.
- 59. Group WHOQOL. Development of the World Health Organization WHOQOL-BREF quality of life assessment. Psychol Med. 1998; 28: 551–558. pmid:9626712
- 60. American Psychiatric Association. Diagnostic and statistical manual of mental disorders. Fourth edition. DSM-IV. Washington, DC: American Psychiatric Association; 1994.
- 61. Skevington SM, Lotfy M, O'Connell KA. The World Health Organization's WHOQOL-BREF quality of life assessment: Psychometric Properties and results of the international field trial. A report from the WHOQOL Group. Qual Life Res. 2004; 13: 299–310. pmid:15085902
- 62. Davis CS. Statistical Methods for the Analysis of Repeated Measurements. Springer Texts in Statistics; 2002.
- 63. Pinheiro JC, Bates DM. Linear mixed-effects models: basic concepts and examples. Mixed-effects models in S and S-Plus. New York: Springer; 2000.
- 64. Nakagawa S, Schielzeth H. A general and simple method for obtaining R2 from generalized linear mixed-effects models. Methods Ecol Evol. 2013; 4: 133–142.
- 65. Cohen J. A power primer. Psychol Bull. 1992; 112: 155–159. pmid:19565683
- 66. The R-Foundation for Statistical Computing, Vienna, Austria, 2013.
- 67. Keller A, Lhewa D, Rosenfeld B, Sachs E, Aladjem A, Cohen I, et al. Traumatic experiences and psychological distress in an urban refugee population seeking treatment services. J Nerv Ment Dis. 2006; 194: 188–94. pmid:16534436
- 68. Johansen JD, Varvin S. I tell my mother that… sometimes he didn’t love us–Young adults’ experiences of childhood in refugee families: A qualitative approach. Childhood. 2019; 26: 221–235.
- 69. Johansen JD, Varvin S. Negotiating identity at the intersection of family legacy and present time life conditions: A qualitative exploration of central issues connected to identity and belonging in the lives of children of refugees. J Adolescence. 2020; 80: 1–9. pmid:32044475
- 70. Bager L, Hansen KS, Andersen CJ, Wang SJS. Does multidisciplinary rehabilitation of tortured refugees represent ‘value-for-money’? A follow-up of a Danish case-study. BMC Health Serv Res. 2018; 18: 1–14. pmid:29291745
- 71. Leuzinger-Bohleber M, Rickmeyer C, Tahiri M, Hettich N. Special Communication. What can psychoanalysis contribute to the current refugee crisis? Preliminary reports from Step-By-Step: A psychoanalytic pilot project for supporting refugees in a “first reception camp” and crisis interventions with traumatized refugees. Int J Psychoanal. 2016; 97: 1077–93. pmid:27513984
- 72. Song SJ, Subica A, Kaplan C, Tol W, de Jong J. Predicting the Mental Health and Functioning of Torture Survivors. J Nerv Ment Dis. 2018; 206: 33–39. pmid:28350563