http://orcid.org/0000-0001-8493-6276
Figures
Abstract
Background
Patients with epilepsy (PwE) have an increased risk of active and lifetime depression. Two in 10 patients experience depression. Lack of trained psychiatric staff in low- and middle-income countries (LMIC) creates a need for screening tools that enable detection of depression in PwE. We describe the translation, validity and reliability assessment of the Patient Health Questionnaire-9 (PHQ-9) as a screening tool for depression among PwE in Rwanda.
Method
PHQ-9 was translated to Kinyarwanda using translation-back translation and validated by a discussion group. For validation, PwE of ≥15 years of age were administered the PHQ-9 and Hamilton Depression Rating Scale (HDRS) by trained psychiatry staff at Visit 1. A random sample of 20% repeated PHQ-9 and HDRS after 14 days to assess temporal stability and intra-rater reliability. Internal structure, reliability and external validity were assessed using confirmatory factor analysis, reliability coefficients and HDRS-correlation, respectively. Maximal Youden’s index was considered for cut-offs.
Results
Four hundred and thirty-four PwE, mean age 30.5 years (SD ±13.3), were included of whom 33.6%, 37.9%, 13.4%, and 15.1% had no, mild, moderate and severe depression, respectively. PHQ-9 performed well on a one-factor model (unidimensional model), with factor loadings of 0.63–0.86. Reliability coefficients above 0.80 indicated strong internal consistency. Good temporal stability was observed (0.79 [95% CI: 0.68–0.87]). A strong correlation (R = 0.66, p = 0.01) between PHQ-9 and HDRS summed scores demonstrated robust external validity. The optimal cut-off for the PHQ-9 was similar (≥5) for mild and moderate depression and ≥7 for severe depression.
Conclusion
PHQ-9 validation in Kinyarwanda creates the capacity to screen PwE in Rwanda at scores of ≥5 for mild or moderate and ≥7 for severe depression. The availability of validated tools for screening and diagnosis for depression is a forward step for holistic care in a resource-limited environment.
Citation: Sebera F, Vissoci JRN, Umwiringirwa J, Teuwen DE, Boon PE, Dedeken P (2020) Validity, reliability and cut-offs of the Patient Health Questionnaire-9 as a screening tool for depression among patients living with epilepsy in Rwanda. PLoS ONE 15(6): e0234095. https://doi.org/10.1371/journal.pone.0234095
Editor: Thach Duc Tran, Monash University, AUSTRALIA
Received: December 20, 2019; Accepted: May 18, 2020; Published: June 12, 2020
Copyright: © 2020 Sebera et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data underlying this study have been uploaded to Dryad and are accessible using the following link: https://doi.org/10.5061/dryad.76hdr7stc.
Funding: This study was supported with an unrestricted educational grant from UCB Pharma (website: https://www.ucb.com/). FS received the study funding through the research department of the CARAES hospital, Ndera, Rwanda. JNRV received a consultancy fee for the statistical analysis. The funder provided support in the form of salaries for author DET and consultancy fees for author PD, but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘author contributions’ section.
Competing interests: PD has received consultancy fees from UCB Pharma and Novartis. DET is an employee of UCB Pharma. PEB has received speaker and consultancy fees from UCB Pharma and grants from his institution. JNRV received a consultancy fee for the statistical analysis. This does not alter our adherence to PLOS ONE policies on sharing data and materials. Other authors have nothing to disclose.
Introduction
Depression and epilepsy are each associated with a significant burden of disease globally, and are known to occur together. In fact, depression is the most frequent psychiatric comorbidity reported by patients with epilepsy (PwE). Compared with the general population, PwE have a significantly increased risk of active and lifetime depression [1, 2]. Depression has been shown to exacerbate adverse events associated with antiepileptic drugs, such as suicidal ideation; further, patients with depression experience increased levels of stigma [1, 3–7]. Prevalence of active depression in PwE ranged between 14.6% and 23.1% [2, 8, 9]. Up to 1/3 of PwE may experience a major depressive episode in their lifetime [9].
Although depression has a key position in holistic care for PwEs, many healthcare professionals tend to focus attention predominantly on the medical aspects of epilepsy, often neglecting the psychosocial burden of the disease [10]. Psychiatric comorbidities, therefore, remain under-recognised and undertreated, especially in low- and middle-income countries (LMICs) such as Rwanda [5, 11, 12]. Both diseases are subject to a large diagnosis and treatment gap, and are considered to have a burdensome stigma. This is particularly concerning if the burden of both epilepsy and depression are greatly underestimated or if the prevalence of epilepsy is high. For instance, depressive disorders greatly impact disability in sub-Saharan Africa, and are considered a leading cause of years lost due to disability [13]. In Rwanda, the prevalence of epilepsy is up to 49 per 1,000 individuals [14], amongst the highest in Africa. Moreover, the prevalence of depression in PwE is higher in Africa than in developed countries [15–19].
Central to addressing the gap in depression care in PwE in Africa is the ability to screen patients living with or at risk of depression. A number of screening tools are available to enable healthcare providers to identify depression among PwE, including the Patient Health Questionnaire-9 (PHQ-9).
The PHQ-9 is the nine-item depression module of the full PHQ, the patient-administered version of the Primary Care Evaluation of Mental Disorders (PRIME-MD) screening tool, which is administered by healthcare providers [20]. The PHQ-9 follows the diagnostic criteria for depression of the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV). It can be used as an algorithm to monitor and screen for major depressive disorder (MDD) [20]. The PHQ-9 has been widely studied in developed countries, with optimal cut-off scores to identify MDD varying from 8 to 11 points [21–24]. However, variations of cut-offs have been reported considering the targeted population and setting.
Although developed and validated for diagnosing depression in primary care, the use of PHQ-9 as a screening tool has also been validated in other clinical settings, among patients with different ethnicities and in different countries [25–34]. Some studies reported the applicability of PHQ-9 in sub-Saharan Africa, including Nigeria [35], Ethiopia [36–38], Kenya [39, 40], Malawi [41], Cameroon [42], Uganda [43] and South Africa [44, 45], but none in Rwanda. Psychometric properties of PHQ-9 have been described as a screening tool for depression, and cut-offs of 5–10 were found to be optimal in general populations [35, 38, 42, 43], while cut-offs of 8–9 were optimal in specific populations [36, 41]. Thus only a few countries in Africa have reported the psychometric properties of PHQ-9 for targeted populations and conditions, and how PHQ-9 performs in PwE has not been ascertained. In fact, a recent review revealed only four studies reporting evidence of validity of PHQ-9 for screening for depression in PwE [46]; none were conducted in Africa.
Rwanda is a landlocked country in East Africa and home to 12.63 million inhabitants, mean age 20y, of which less than 20% live in urban areas. A community-based health insurance model provides cost coverage. Its healthcare system operates health centers, health posts, dispensaries, district hospitals and reference hospitals. Access to neurologists is limited with 0.024 neurologists per 100,000 inhabitants. The CARAES Neuropsychiatric Hospital in Ndera is a reference hospital for mental health, both psychiatry and neurology in- and outpatient care. Of the 21,690 neurology outpatient consultations performed in 2018 at the center, epilepsy accounted for 84.6%.
In the current study, the steps taken for the translation, and subsequent assessment of validity and reliability of PHQ-9 as a tool for screening for depression among PwE in Rwanda, are described.
Methods
The study was conducted over a 4-month period at the Neuropsychiatric Hospital in Ndera, just outside of Kigali, Rwanda. The study was approved by the Institutional Review Board of the Rwanda National Health Research Committee and the National Ethics Committee. Written informed consent was obtained from study participants before data collection. For patients aged <18y, an additional assent form was signed by the caregiver.
Study participants
PwE with a clinically confirmed diagnosis by a neurologist and ≥15 years of age, attending the neurology outpatient department of the Neuropsychiatric Hospital, were consecutively enrolled in order of attendance when providing consent. Patients who had a concomitant clinical diagnosis of depression, or reported signs and symptoms of depression, were included. However, those with other psychiatric morbidities were excluded. Presence of co-morbid depression or depressive symptoms as well as other psychiatric diseases was based on assessment by the treating physician following clinical interview.
Procedure
At the first visit, trained medical nurses and healthcare providers administered the PHQ-9. On the same day, the Hamilton Depression Rating Scale (HDRS), validated in Kinyarwanda for diagnosis of depression, was also administered by trained psychiatry nurses, psychologists and psychiatrists. Investigators administering HDRS were blinded throughout the study to the results of PHQ-9 and vice versa. The Kinyarwanda version of the HDRS was used as the comparator/gold standard measure of symptom severity.
A randomly selected sample of 20% of all participants returned after 14 days for a follow-up assessment, and completed the PHQ-9 and HDRS again, administered by the same investigator as on the first visit. This enabled evaluation of its temporal stability and intra-rater reliability. All responses were collected through electronic data capturing and entered into an SQL database.
Sample size calculation
Sample size was estimated using both Gorsuch’s rule and sample sizes from Comrey and Lee. Gorsuch’s rule requires a sample size of five times the number of questions assessed, a total of 36 in this study, resulting in minimal sample of 180 patients. Comrey and Lee consider a sample size >300 as good and >500 as very good. Based on recruitment feasibility at the center, we aimed for a sample size of 400 patients.
Instruments
Translation and adaptation of PHQ-9.
Coordinated by the Integration of HIV Care into Mental Healthcare Services Technical Working Group, the questionnaire was translated from English to Kinyarwanda in 2011. The team was supervised by the International Center for HIV/AIDS Program (ICAP) of the University of Columbia (USA), the Rwanda Biomedical Center/Mental Health division, and the University of Rwanda. A structured approach using a back-translation technique combined with bilingual technique was used [47]. A discussion group, including 10 doctors and psychologists with experience in depression, achieved consensus on the wording of the translated PHQ-9, addressing five major dimensions for cross-cultural equivalence defined by Flaherty [48].
HDRS.
The HDRS has been used for assessing severity of depression, changes in severity over time, and treatment efficacy, with good overall levels of internal consistency, inter-rater and test–retest reliability [49–51]. The HDRS was used as our gold standard anchor to evaluate the screening ability of the Rwandan adapted PHQ-9. The HDRS was translated at the CARAES Neuropsychiatric Hospital in Ndera, Rwanda, in 2013 and found to be associated with reliable internal consistency (Cronbach’s alpha = 0.96) [18].
In a previous analysis, we determined a single HDRS cut-off point for diagnosis of depression in a Rwandan population. This showed that a score of 17 was the optimal cut-off point to diagnose an MDD, based on expert diagnostic assessment. Since we did not establish cut-off points based on intervals of depression severity, for the current study we compared the PHQ-9 diagnostic ability against international standard intervals suggested in the literature (Table 1) [52], in addition to the single Rwandan cut-off defined in our previous study.
Data analysis
Sociodemographic data are presented as means with standard deviations, medians with the interquartile range, or absolute and relative frequencies. All analyses were conducted with R Language for Statistical Computing v. 3.5 using the lavaan and receiver operating characteristic (ROC) packages (R foundation, Vienna) [53]. Given a small number of patients aged <18, we performed a post-hoc sensitivity analysis excluding those.
Evidence of reliability.
As a first step in determining the reliability of the translated PHQ-9, its internal consistency was evaluated. This can be assessed by several coefficients, each with its strengths and limitations [54, 55]. For this study, we report the Cronbach’s alpha and Composite Reliability (CR), with values above 0.70 considered adequate.
Temporal stability was first assessed by calculating the intra-class correlation (ICC) between the scores of the PHQ-9 collected at two time points separated by 14 days. ICC values >0.8 are considered good and values >0.9 are exceptional [56].
Evidence of validity based on internal structure.
To test the internal structure of the PHQ-9, network analysis and confirmatory factor analysis (CFA) was conducted.
For network analysis, graphs of undirected weighted networks were constructed based on a polychoric correlation matrix of PHQ-9 items. Partial correlation coefficients were estimated through nodewise multiple regression, with graphical least absolute shrinkage and selection operator regularisation, or GLASSO [57]. Penalised model selection was made based on extended Bayesian information criteria (EBIC) [58]. Those pairwise partial correlations were depicted as edges connecting nodes. Node size varied according to the mean score for each item. We performed a community structure analysis to identify underlying clusters of items. Community structure analyses are applied to complex networks in which groups of variables are densely interconnected among each other, but sparsely connected to the overall network. The random walks method was incorporated into the Walktrap algorithm, which is suited for weighted networks [59]. With random starts, a limited (in general, three or four) number of steps or “walks” were performed between nodes in such a way that they became “trapped” in high-density subgroups. All analyses were conducted with the R language for Statistical Computing, through the qgraph and igraph packages.
Confirmatory factor analysis was used to determine whether the scores obtained from the nine items of the questionnaire refer to the single construct of depression. Such a single factor, or unidimensional model for PHQ-9, has been reported by others for different populations [37, 60]. The weighted least square means and variance adjusted estimator (WLSMV) was used to test the adequacy of the model. The relationship between each item and depression was determined by its factor loading (values above 0.50 deemed acceptable). Model adjustment, or how well the model fits the data, was evaluated using several goodness-of-fit indices and overall model theoretical interpretation. The fit indices, and the generally accepted reference levels for a good fit (in parentheses), were the following: Chi-square (χ2 and p-value), Root Mean Square Error of Approximation (RMSEA, ≤0.05), Tucker–Lewis index (TLI, >0.95), Comparative Fit Index (CFI, ≥0.95) and Average Variance Extracted (AVE, >0.50) [61–63].
Evidence of validity based on relationship with other constructs.
The validity of the translated PHQ-9 was determined using two methods. For both methods, we used the HDRS as the reference for external validity. First, we evaluated concurrent validity by correlating the scores from PHQ-9 that were associated with the scores of the HDRS. We hypothesised that the PHQ-9 score would positively and strongly predict the HDRS score (R >0.60).
For the second form of external validity, we evaluated the ability of PHQ-9 to identify patients with depressive disorder as defined by the HDRS. We compared the PHQ-9 with two cut-offs defined by the HDRS. Firstly, we evaluated the PHQ-9 parameters to identify a depressive disorder according to the international standards defined as Absence (HDRS <8), Mild (HDRS ≥8), Moderate (HDRS ≥17) and Severe (HDRS ≥24) (Table 1). Secondly, we specified the ability of PHQ-9 to identify moderate to severe depression as defined by the Rwandan cut-off for the HDRS, defined as scores ≥17. We evaluated the screening ability by measuring the sensitivity, specificity and positive and negative predicted values. ROC curves were subsequently generated and the area under the ROC curve (AUROC) was calculated. Using this approach, the optimal cut-off point for the PHQ-9 as a screening tool for the levels of depression as anchored by the HDRS was determined, using both the international cut-offs and the Rwandan cut-off for moderate to severe depression (Table 1). To establish the cut-off, Youden’s index was employed to maximise sensitivity and specificity in detecting patients with moderate to severe depression. As age and level of education may influence PHQ-9 cut-offs, we evaluated the ROC and cut-offs for age groups of <30 years and ≥30 years of age, and by level of education (no schooling/primary schooling and secondary/higher education).
Results
Study participants
Four hundred and thirty-four patients participated in the study. Only 2.1% were younger than 18 years of age (Table 2). Up to two-thirds of patients were unmarried. Most participants were employed (59.2%), and more than half had completed secondary education (50.7%). The average age at epilepsy onset was approximately 21 years. Based on the HDRS, 66.4% of patients were diagnosed as having depression.
Rwandan PHQ-9 characterisation
Overall PHQ-9 score was 5.8 (SD 5.4). All items had a varied distribution of Likert options endorsed (Fig 1A), with higher frequencies for options 3 and 4. Items 2, 4 and 6 had the highest averages among all PHQ-9 items (Fig 1B). Associations between items showed that all items correlated with each other (all correlations had R >0.50). When adjusting for all the correlations (partial correlations) in a network model, items 1 and 5 showed a negative correlation. All items clustered within one community, as expected. Items 1, 3 and 7 had the highest measure of betweenness and expected influence, suggesting that these items are relevant depression symptoms in the behaviour of other depressive symptoms measured using the PHQ-9.
Likert responses distribution (A) and correlation pattern between items (B) of the Rwandan version of the PHQ-9. The size of the nodes (circles) represents the average response in the Likert scale for each item. The thickness of the lines (edges) represents the partial correlation between items. Nta na rimwe = not at all, never; Rimwe na rimwe = several days, sometimes; Birenze igice cy’umunsi = more than half the days; Hafi ya buri munsi = nearly every day.
Internal structure and reliability
Parallel analysis supported the unidimensional structure of the Rwandan version of the PHQ-9. The one-factor model (unidimensional model) performed well using PHQ-9, and displayed a good fit for the data (Table 3). All nine PHQ-9 items were loaded onto one single factor, with factor loadings for all items in the range 0.63–0.86 (Fig 2). For the reliability of the PHQ-9 items, values above 0.80 were obtained for both reliability coefficients, indicating strong internal consistency (Table 3). Analysis of stability over time in the PHQ-9 assessment through the ICC showed good temporal stability with a score of 0.79 (95% CI: 0.68–0.87) (Table 3).
Correlation and diagnostics indicators with HDRS
A strong, positive correlation (R = 0.66, p = 0.01) was observed between PHQ-9 and HDRS summed scores, indicating robust external validity and high agreement between both tools. In terms of the diagnostic validity of PHQ-9 relative to HDRS, the PHQ-9 showed good accuracy (area under the curve [AUC] >0.80) in discriminating between participants who did not have depression and those with mild or moderate and severe depression (Table 4).
Interestingly, the optimal cut-off point for the PHQ-9 was the same for the HDRS groups of mild depression and moderate depression (5 or more). The cut-off for identifying severe depression, as measured by the HDRS was 7 or more (Table 4). The cut-off for the Rwandan version of the HDRS moderate-severe classification was also 7 or more. Detailed values are provided in S1 Table (see Supporting Information). A post-hoc sensitivity analysis, excluding PwE <18y (2.1%), did not affect cut-offs nor validity.
Subgroup analysis by age and education
Subgroup analyses by age and schooling, factors possibly influencing PHQ-9 cut-offs, showed only small differences between groups in optimal cut-offs (Table 5), demonstrating little influence of these factors.
Discussion
The study was conducted to assess the reliability and validity of the PHQ-9 as a screening tool for depression in a population of Rwandan patients with epilepsy. This study is unique because it addresses the gap of evidence with respect to the psychometric properties of the PHQ-9 and confirms its clinical usefulness in Rwandan PwE. The ROC analysis showed that PHQ-9 thresholds of 5 or more and 7 or more offered the optimal discriminatory power in detecting MDD severity levels (mild, moderate or severe) with acceptable sensitivity, specificity and area under the ROC curve. Overall, results indicated that the tool in Kinyarwanda displayed good psychometric properties in this specific population.
The internal structure of the translated PHQ-9 was consistent with a single-factor model, or unidimensional model, similar to that reported in other sub-Saharan countries and LMICs. The observation that all nine items of the questionnaire load onto a single factor is an indication that the PHQ-9 is measuring a coherent, unitary concept of MDD based on the DSM-IV criteria [33]. This single-factor model has also been reported in other studies conducted in different populations [37, 39, 40, 42, 44], supporting the cultural consistency of this measurement. However, this is the first time that this evaluation has been conducted in sub-Saharan Africa and specifically on a population with epilepsy [33, 37, 60]. All goodness-of-fit indices displayed values for a good fit and did not indicate issues with model identification and fitness.
The translated PHQ-9 was reliable, showing a high degree of internal consistency and temporal stability. Values for all reliability coefficients were >0.80. While results for both tests demonstrated good temporal stability, in the sample that was retested after two weeks, there was more variability in the scores obtained at the two time points when the PHQ-9 was administered. The results were similar to other studies conducted in sub-Saharan Africa [35, 38, 42, 43]. In regard to validity, patients’ scores on the PHQ-9 correlated strongly with their scores from the HDRS. The positive correlation confirmed the instrument’s ability to discriminate levels of MDD in comparison with HDRS scores. Similar results were consistently reported in the literature with diverse populations [64] but this is the first study reporting this validity in patients with epilepsy in sub-Saharan Africa.
Our proposed cut-offs are lower than the score of 10 typically suggested as the cut-off point for depression in a general population in developed countries [65]. However, studies in LMICs in different settings and populations have reported cut-offs for any or mild depression of 5 and severe depression of 10 in Nigerian students and in a Malaysian primary care setting [34, 35, 38, 42, 43].
Cut-offs for the PHQ-9 thus vary across populations [22], differing in clinical setting, concomitant disease and culture, and require population specific values rather than inflexibly adhering to a single cut-off point [20]. Studies with targeted specific patient populations recommend highly variable cut-offs, ranging from 6–8 in chronically ill older patients in the Netherlands [66] to 15 in white female psychiatric in-patients [67]. Other studies have reported values in the range 8–12 in targeted populations including traumatic brain injury [68], HIV [39, 45], cancer [40] and diabetes [69].
Our cut-off of ≥5 for moderate and ≥7 for severe depression in PwE is amongst the lowest of targeted populations and lower compared to cut-offs for PwE of 9 [8] in Canada and 10–15 in the United States [9]. To explain heterogeneity between cut-offs, a meta-analysis was conducted to explore possible factors, which found that blind application of a diagnostic gold standard was a predictive source of heterogeneity [22]. In our study, the administrator of the diagnostic gold standard was blinded to the PHQ-9 results. We also explored possible subgroup differences in our own sample, as education level and age have been suggested to influence PHQ-9 [70]. In our sub-group analysis, no clinically relevant differences for PHQ-9 cut-offs between age groups and educational levels were observed.
Underreporting of depressive symptoms is another probable contributor to lower cut-offs. Firstly, the presence of disease specific symptoms that are difficult to disentangle from somatic symptoms of depression, may lead to underreporting of depressive symptoms by patients. Indeed, improved clinical utility of the Beck Depression Inventory has been observed in HIV patients when somatic items were removed from the questionnaire [70]. Concerning our data, epilepsy is often associated with disease related symptoms or treatment side effects such as fatigue and somnolence, poor concentration or appetite and weight changes, which are all the subject of questions on the PHQ-9. The impact of epilepsy specific symptoms on the performance of depression scales has to our knowledge not been studied and requires more research. Second, differences between populations and cultures need to be considered, such as enacted and self-stigma, which negatively affect help- and care-seeking patterns [71]. Underreporting of depressive symptoms due to social and self-stigma has been documented in war veterans, who reported depressive symptoms up to 4 times more frequently during an anonymous paper questionnaire compared to normal routine healthcare visits [72]. A study from India confirmed a relationship between self-stigma and PHQ-9 scores among college students [73]. In Turkish patients, a stigma score combined for enacted and self-stigma, accounted for 26.2% of the variance in the BDI score [74]. In Rwanda, epilepsy-related enacted stigma is significant as nearly two-thirds of the general population would exclude PwE from school, work and social gatherings [14]. Anticipation of a diagnosis of a mental health disorder such as depression, may thus impact PHQ-9 scoring by PwE experiencing any form of stigma. Clearly, the effects of social and self-stigma on PHQ-9 scoring in PwE has not yet clearly been elucidated. We recommend future research addresses factors that influence the variability of the raw scores and cut-offs, including disease related somatic symptoms and stigma as they probably account for the variability observed in recommended cut-offs.
One limitation of this study is that only patients with epilepsy ≥15 years of age were included. Therefore, cut-offs may not be applicable to paediatric PwE, or to the general Rwandan population. We included too few patients of <18 years of age to perform subgroup analysis on this specific subgroup. Further studies should replicate the scales in other samples and other cultures to confirm the psychometric properties in adolescents.
Another limitation is the comparator chosen for confirmation of depression [46]. The gold standard for diagnosis of depression is the structured interview. In this study, we opted for the HDRS as a diagnostic reference because it has already been validated in Rwanda with established cut-offs for depression diagnosis. Although HDRS is not the most common method used as an anchor for accuracy testing, HDRS specific cut-offs and ranges have been previously validated in relation to a clinical interview and have been extensively reported as an accurate measure for depression [28, 52, 75]. We selected HDRS as an anchor because its use can be scaled in Rwanda to medical professionals working in resource-limited environments. When there is limited availability of trained neurological or psychiatric medical staff to conduct a structured interview for diagnosis of depression, psychometric tools are used to support patient care.
For PwE in Rwanda, PHQ-9 and HDRS tools provide screening and diagnostic capabilities, respectively, and will play a role in closing the diagnosis and treatment gap. The decision of whether to screen for moderate/severe or severe depression only using PHQ-9 cut-offs of ≥5 and ≥7, respectively, will require careful consideration in each healthcare setting (healthpost, healthcare center, district hospital) as screening for and diagnosis of depression will increase the burden on mental healthcare.
Conclusion
Considering that depressive disorder is a major cause of comorbidity in epilepsy, this cross-cultural validation further develops the capacity to screen for, measure, and treat depressive disorders in patients with epilepsy in Rwanda. Given that a limited number of studies have validated the use of the PHQ-9 in sub-Saharan Africa, our results allow more evidence-based clinical practices. Cut-off scores of 5 and 7 or more for moderate and severe depression were established. In essence, the availability of validated tools for screening and diagnosis for depression in patients with epilepsy in Rwanda is an important step forward in their holistic care in a resource-limited ecosystem.
Supporting information
S1 Table. PHQ-9 screening parameters for mild, moderate and severe depressive disorder as defined by the international HDRS scores.
Bolded numbers represent the maximal Youden index. Abbreviations: HDRS, Hamilton Depression Rating Scale; PHQ-9, Patient Health Questionnaire-9; NPV, negative predictive value; PPV, positive predictive value; Sens, Sensitivity; Spec, Specificity.
https://doi.org/10.1371/journal.pone.0234095.s001
(DOCX)
Acknowledgments
We acknowledge and thank the patients participating in this study for rising above the stigma associated with both epilepsy and depression. The authors acknowledge Fabien Debailleul, PhD (UCB Pharma, Brussels, Belgium) for managing the development of the manuscript, and Jayna Patel, PhD (Evidence Scientific Solutions, Horsham, UK) for editorial assistance, which was funded by UCB Pharma.
References
- 1. Kanner AM, Barry JJ, Gilliam F, Hermann B, Meador KJ. Depressive and anxiety disorders in epilepsy: do they differ in their potential to worsen common antiepileptic drug-related adverse events? Epilepsia. 2012;53(6):1104–8. pmid:22554067
- 2. Fiest KM, Dykeman J, S.B. P, Wiebe S, Kaplan GG, Maxwell CJ, et al. Depression in epilepsy: a systematic review and meta-analysis. Neurology. 2013;80(6):590–9. pmid:23175727
- 3. Kwon OY, Park SP. Frequency of affective symptoms and their psychosocial impact in Korean people with epilepsy: a survey at two tertiary care hospitals. Epilepsy Behav. 2013;26(1):51–6. pmid:23207517
- 4. Leaffer EB, Hesdorffer DC, Begley C. Psychosocial and sociodemographic associates of felt stigma in epilepsy. Epilepsy Behav. 2014;37:104–9. pmid:25010324
- 5. Kwon OY, Park SP. Depression and anxiety in people with epilepsy. J Clin Neurol. 2014;10(3):175–88. pmid:25045369
- 6. Shi Y, Wang S, Ying J, Zhang M, Liu P, Zhang H, et al. Correlates of perceived stigma for people living with epilepsy: a meta-analysis. Epilepsy Behav. 2017;70(Pt A):198–203. pmid:28431368
- 7. Perucca P, Jacoby A, Marson AG, Baker GA, Lane S, Benn EK, et al. Adverse antiepileptic drug effects in new-onset seizures: a case-control study. Neurology. 2011;76(3):273–9. pmid:21242496
- 8. Fiest KM, Patten SB, Wiebe S, Bulloch AG, Maxwell CJ, Jetté N. Validating screening tools for depression in epilepsy. Epilepsia. 2014;55(10):1642–50. pmid:25169800
- 9. Rathore JS, Jehi LE, Fan Y, Patel SI, Foldvary-Schaefer N, Ramirez MJ, et al. Validation of the Patient Health Questionnaire-9 (PHQ-9) for depression screening in adults with epilepsy. Epilepsy Behav. 2014;37:215–20. pmid:25064739
- 10. Brodtkorb E, Mula M. Optimizing therapy of seizures in adult patients with psychiatric comorbidity. Neurology. 2006;67(12 Suppl 4):S39–44.
- 11. Fiest KM, Patten SB, Jetté N. Screening for depression and anxiety in epilepsy. Neurol Clin. 2016;34(2):351–61. pmid:27086983
- 12. Jones JE, Hermann BP, Woodard JL, Barry JJ, Gilliam F, Kanner AM, et al. Screening for major depression in epilepsy with common self-report depression inventories. Epilepsia. 2005;46(5):731–5. pmid:15857440
- 13.
World Health Organization. Global Health Estimates 2016: disease burden by cause, age, sex, by country and by region, 2000–2016 Geneva, Switzerland: World Health Organization; 2018 [cited 2019 October 30,]. Available from: https://www.who.int/healthinfo/global_burden_disease/estimates/en/index1.html.
- 14. Sebera F, Munyandamutsa N, Teuwen DE, Ndiaye IP, Diop AG, Tofighy A, et al. Addressing the treatment gap and societal impact of epilepsy in Rwanda—Results of a survey conducted in 2005 and subsequent actions. Epilepsy Behav. 2015;46:126–32. pmid:25936276
- 15. Onwuekwe I, Ekenze O, Bzeala-Adikaibe J. E. Depression in patients with epilepsy: a study from enugu, South East Nigeria. Ann Med Health Sci Res. 2012;2(1):10–3. pmid:23209983
- 16. Dessie G, Mulugeta H, Leshargie CT, Wagnew F, Burrowes S. Depression among epileptic patients and its association with drug therapy in sub-Saharan Africa: a systematic review and meta-analysis. PLoS One. 2019;14(3):e0202613. pmid:30870423
- 17. Tsegabrhan H, Negash A, Tesfay K, Abera M. Co-morbidity of depression and epilepsy in Jimma University specialized hospital, Southwest Ethiopia. Neurol India. 2014;62(6):649–55. pmid:25591679
- 18. Sezibera V, Nyirasafari D. Incidence of depression in epilepsy patients. Rwanda Journal, Series F: Health Sciences 2013;1:67–77.
- 19. Nubukpo P, Preux PM, Houinato D, Radji A, Grunitzky EK, Avodé G, et al. Psychosocial issues in people with epilepsy in Togo and Benin (West Africa) I. Anxiety and depression measured using Goldberg's scale. Epilepsy Behav. 2004;5(5):722–7. pmid:15380125
- 20. Kroenke K, Spitzer RL, Williams JB, Löwe B. The Patient Health Questionnaire Somatic, Anxiety, and Depressive Symptom Scales: a systematic review. Gen Hosp Psychiatry. 2010;32(4):345–59. pmid:20633738
- 21. Zuithoff NP, Vergouwe Y, King M, Nazareth I, van Wezep MJ, Moons KG, et al. The Patient Health Questionnaire-9 for detection of major depressive disorder in primary care: consequences of current thresholds in a cross-sectional study. BMC Family Practice. 2010;11:98. pmid:21144018
- 22. Manea L, Gilbody S, McMillan D. Optimal cut-off score for diagnosing depression with the Patient Health Questionnaire (PHQ-9): a meta-analysis. CMAJ. 2012;184(3):E191–E6. pmid:22184363
- 23. Moriarty AS, Gilbody S, McMillan D, Manea L. Screening and case finding for major depressive disorder using the Patient Health Questionnaire (PHQ-9): a meta-analysis. Gen Hosp Psychiatry. 2015;37(6):567–76. pmid:26195347
- 24. Manea L, Boehnke JR, Gilbody S, Moriarty AS, McMillan D. Are there researcher allegiance effects in diagnostic validation studies of the PHQ-9? A systematic review and meta-analysis. BMJ Open. 2017;7:e015247. pmid:28965089
- 25. van Steenbergen-Weijenburg KM, de Vroege L, Ploeger RR, Brals JW, Vloedbeld MG, Veneman TF, et al. Validation of the PHQ-9 as a screening instrument for depression in diabetes patients in specialized outpatient clinics. BMC Health Serv Res. 2010;10:235. pmid:20704720
- 26. Martin A, Rief W, Klaiberg A, Braehler E. Validity of the Brief Patient Health Questionnaire Mood Scale (PHQ-9) in the general population. Gen Hosp Psychiatry. 2006;28(1):71–7. pmid:16377369
- 27. Wulsin L, Somoza E, Heck J. The feasibility of using the Spanish PHQ-9 to screen for depression in primary care in Honduras. Prim Care Companion J Clin Psychiatry. 2002;4(5):191–5. pmid:15014707
- 28. Lotrakul M, Sumrithe S, Saipanish R. Reliability and validity of the Thai version of the PHQ-9. BMC Psychiatry. 2008;8:46.
- 29. Kochhar PH, Rajadhyaksha SS, Suvarna VR. Translation and validation of brief patient health questionnaire against DSM IV as a tool to diagnose major depressive disorder in Indian patients. J Postgrad Med. 2007;53(2):102–7. pmid:17495375
- 30. Zhong Q, Gelaye B, Rondon M, Sánchez SE, García PJ, Sánchez E, et al. Comparative performance of Patient Health Questionnaire-9 and Edinburgh Postnatal Depression Scale for screening antepartum depression. J Affect Disord. 2014;162:1–7. pmid:24766996
- 31. Marc LG, Henderson WR, Desrosiers A, Testa MA, Jean SE, Akom EE. Reliability and validity of the Haitian Creole PHQ-9. J Gen Intern Med. 2014;29(12):1679–86. pmid:25092004
- 32. Gilbody S, Richards D, Brealey S, Hewitt C. Screening for depression in medical settings with the Patient Health Questionnaire (PHQ): a diagnostic meta-analysis. J Gen Intern Med. 2007;22(11):1596–602. pmid:17874169
- 33. Huang FY, Chung H, Kroenke K, Delucchi KL, Spitzer RL. Using the Patient Health Questionnaire-9 to measure depression among racially and ethnically diverse primary care patients. J Gen Intern Med. 2006;21(6):547–52. pmid:16808734
- 34. Azah MN, Shah ME, Shaaban J, Bahri I, Rushidi WM, Yaacob MJ. Validation of the Malay version brief Patient Health Questionnaire (PHQ-9) among adult attending family medicine clinics. International Medical Journal. 2005;12(4):259–63.
- 35. Adewuya AO, Ola BA, Afolabi OO. Validity of the patient health questionnaire (PHQ-9) as a screening tool for depression amongst Nigerian university students. J Affect Disord. 2006;96(1–2):89–93. pmid:16857265
- 36. Woldetensay YK, Belachew T, Tesfaye M, Spielman K, Biesalski HK, Kantelhardt EJ, et al. Validation of the Patient Health Questionnaire (PHQ-9) as a screening tool for depression in pregnant women: Afaan Oromo version. PLoS One. 2018;13(2):e0191782. pmid:29408928
- 37. Gelaye B, Williams MA, Lemma S, Deyessa N, Bahretibeb Y, Shibre T, et al. Validity of the Patient Health Questionnaire-9 for depression screening and diagnosis in East Africa. Psychiatry Res. 2013;210(2):653–61. pmid:23972787
- 38. Hanlon C, Medhin G, Selamu M, Breuer E, Worku B, Hailemariam M, et al. Validity of brief screening questionnaires to detect depression in primary care in Ethiopia J Affect Disord. 2015;186:32–9. pmid:26226431
- 39. Monahan PO, Shacham E, Reece M, Kroenke K, Ong'or WO, Omollo O, et al. Validity/reliability of PHQ-9 and PHQ-2 depression scales among adults living with HIV/AIDS in western Kenya. J Gen Intern Med. 2009;24(2):189–97. pmid:19031037
- 40. Omoro SA, Fann JR, Weymuller EA, Macharia IM, Yueh B. Swahili translation and validation of the Patient Health Questionnaire-9 depression scale in the Kenyan head and neck cancer patient population. Int J Psychiatry Med. 2006;36(3):367–81. pmid:17236703
- 41. Udedi M, Muula AS, Stewart RC, Pence BW. The validity of the patient health Questionnaire-9 to screen for depression in patients with type-2 diabetes mellitus in non-communicable diseases clinics in Malawi. BMC Psychiatry. 2019;19(1):81. pmid:30813922
- 42. Pence BW, Gaynes BN, Atashili J, O'Donnell JK, Tayong G, Kats D, et al. Validity of an interviewer-administered patient health questionnaire-9 to screen for depression in HIV-infected patients in Cameroon. J Affect Disord. 2012;143(1–3):208–13. pmid:22840467
- 43. Nakku JEM, Rathod SD, Kizza D, Breuer E, Mutyaba K, Baron EC, et al. Validity and diagnostic accuracy of the Luganda version of the 9-item and 2-item Patient Health Questionnaire for detecting major depressive disorder in rural Uganda. Glob Ment Health (Camb). 2016;3:e20.
- 44. Bhana A, Rathod SD, Selohilwe O, Kathree T, Petersen I. The validity of the Patient Health Questionnaire for screening depression in chronic care patients in primary health care in South Africa. BMC Psychiatry. 2015;15:118. pmid:26001915
- 45. Cholera R, Gaynes BN, Pence BW, Bassett J, Qangule N, Macphail C, et al. Validity of the Patient Health Questionnaire-9 to screen for depression in a high-HIV burden primary healthcare clinic in Johannesburg, South Africa. J Affect Disord. 2014;167:160–6. pmid:24972364
- 46. Gill SJ, Lukmanji S, Fiest KM, Patten SB, Wiebe S, Jetté N. Depression screening tools in persons with epilepsy: a systematic review of validated tools. Epilepsia. 2017;58(5):695–705. pmid:28064446
- 47. Jones PS, Lee JW, Phillips LR, Zhang XE, Jaceldo KB. An adaptation of Brislin's translation model for cross-cultural research. Nurs Res. 2001;50(5):300–4. Epub 2001/09/26. pmid:11570715.
- 48. Beck CT, Bernal H, Froman RD. Methods to document semantic equivalence of a translated scale. Res Nurs Health. 2003;26(1):64–73. Epub 2003/01/18. pmid:12532368.
- 49. Trajkovic G, Starcevic V, Latas M, Lestarevic M, Ille T, Bukumiric Z, et al. Reliability of the Hamilton Rating Scale for Depression: a meta-analysis over a period of 49 years. Psychiatry Res. 2011;189(1):1–9. Epub 2011/02/01. pmid:21276619.
- 50. Williams JB. Standardizing the Hamilton Depression Rating Scale: past, present, and future. Eur Arch Psychiatry Clin Neurosci. 2001;251 Suppl 2:II6–12. Epub 2002/02/05. pmid:11824839.
- 51. Ruhe HG, Dekker JJ, Peen J, Holman R, de Jonghe F. Clinical use of the Hamilton Depression Rating Scale: is increased efficiency possible? A post hoc comparison of Hamilton Depression Rating Scale, Maier and Bech subscales, Clinical Global Impression, and Symptom Checklist-90 scores. Compr Psychiatry. 2005;46(6):417–27. Epub 2005/11/09. pmid:16275208.
- 52. Zimmerman M, Martinez JH, Young D, Chelminski I, Dalrymple K. Severity classification on the Hamilton Depression Rating Scale. J Affect Disord. 2013;150(2):384–8. pmid:23759278
- 53. Rosseel Y. lavaan: an R package for structural equation modeling. Journal of Statistical Software. 2012;48(2):1–36.
- 54.
DeVellis RF. Scale Development: Theory and Applications. 2nd ed. Thousand Oaks, CA: SAGE Publications, Inc.; 2003.
- 55. Hernández-Padilla J, Suthers F, Fernández-Sola C, Granero-Molina J. Development and psychometric assessment of the Basic Resuscitation Skills Self-Efficacy Scale. Eur J Cardiovasc Nurs. 2016;15(3):e10–8. pmid:25422522
- 56.
Dawson-Sanders B, Trapp RG. Basic and Clinical Biostatistics. Norwalk, CT, USA: Appleton & Lange, Inc; 1994.
- 57. Friedman J, Hastie T, Tibshirani R. Sparse inverse covariance estimation with the graphical lasso. Biostatistics. 2008;9(3):432–41. pmid:18079126
- 58. Chen J, Chen Z. Extended Bayesian information criteria for model selection with large model spaces. Biometrika. 2008;95:759–71.
- 59. Pons P, Latapy M. Computing communities in large networks using random walks. Journal of Graph Algorithms and Applications. 2006;10:191–218.
- 60. Yu X, Tam WW, Wong PT, Lam TH, Stewart SM. The Patient Health Questionnaire-9 for measuring depressive symptoms among the general population in Hong Kong. Compr Psychiatry. 2012;53(1):95–102. pmid:21193179
- 61. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Modeling. 1999;6(1):1–55.
- 62.
Hair JF, Black WC, Anderson RE, Tatham RL. Análise Multivariada de Dados. Porto Alegre, Brazil: Bookman; 2005.
- 63.
Kline RB. Principles and Practice of Structural Equation Modeling. 3rd ed. Little DAKaTD, editor. New York, London: The Guilford Press (a division of Guilford Publications, Inc); 2011.
- 64. Costa MV, Diniz MF, Nascimento KK, Pereira KS, Dias NS, Malloy-Diniz LF, et al. Accuracy of three depression screening scales to diagnose major depressive episodes in older adults without neurocognitive disorders. Braz J Psychiatry. 2016;38(2):154–6. pmid:27304758
- 65. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13. pmid:11556941
- 66. Lamers F, Jonkers CC, Bosma H, Penninx BW, Knottnerus JA, van Eijk JT. Summed score of the Patient Health Questionnaire-9 was a reliable and valid method for depression screening in chronically ill elderly patients. J Clin Epidemiol. 2008;61(7):679–87. pmid:18538262
- 67. Inoue T, Tanaka T, Nakagawa S, Nakato Y, Kameyama R, Boku S, et al. Utility and limitations of PHQ-9 in a clinic specializing in psychiatric care. BMC Psychiatry. 2012;12:73. pmid:22759625
- 68. Fann JR, Bombardier CH, Dikmen S, Esselman P, Warms CA, Pelzer E, et al. Validity of the Patient Health Questionnaire-9 in assessing depression following traumatic brain injury. J Head Trauma Rehabil. 2005;20(6):501–11. pmid:16304487
- 69. Zhang Y, Ting RZ, Lam MH, Lam SP, Yeung RO, Nan H, et al. Measuring depression with CES-D in Chinese patients with type 2 diabetes: the validity and its comparison to PHQ-9. BMC Psychiatry. 2015;15:198. pmid:26281832
- 70. Simoni JM, Safren SA, Manhart LE, Lyda K, Grossman CI, Rao D, et al. Challenges in addressing depression in HIV research: assessment, cultural context, and methods. AIDS Behav. 2011;15(2):376–88. Epub 2010/11/04. pmid:21046221; PubMed Central PMCID: PMC3335263.
- 71. Kane JC, Elafros MA, Murray SM, Mitchell EMH, Augustinavicius JL, Causevic S, et al. A scoping review of health-related stigma outcomes for high-burden diseases in low- and middle-income countries. BMC Med. 2019;17(1):17. Epub 2019/02/16. pmid:30764819; PubMed Central PMCID: PMC6376728.
- 72. Warner CH, Appenzeller GN, Grieger T, Belenkiy S, Breitbach J, Parker J, et al. Importance of anonymity to encourage honest reporting in mental health screening after combat deployment. Arch Gen Psychiatry. 2011;68(10):1065–71. Epub 2011/10/05. pmid:21969463.
- 73. Vankar JR, Prabhakaran A, Sharma H. Depression and stigma in medical students at a private medical college. Indian J Psychol Med. 2014;36(3):246–54. pmid:25035546
- 74. Yildirim Z, Ertem DH, Ceyhan Dirican A, Baybas S. Stigma accounts for depression in patients with epilepsy. Epilepsy Behav. 2018;78:1–6. Epub 2017/11/22. pmid:29161628.
- 75. Hamilton M. A rating scale for depression. J Neurol Neurosurg Psychiatry. 1960;23:56–62. pmid:14399272