Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Cross-cultural evaluation of the French version of the Delusion Assessment Scale (DAS) and Psychotic Depression Assessment Scale (PDAS)

  • Isabelle Jalenques ,

    Roles Conceptualization, Supervision, Validation, Writing – original draft, Writing – review & editing

    ijalenques@chu-clermontferrand.fr

    Affiliation Service de Psychiatrie de l’Adulte et Psychologie Médicale, Centre Mémoire de Ressources et de Recherche, Centre Hospitalier Universitaire Clermont-Ferrand, Université Clermont Auvergne, Clermont-Ferrand, France

  • Chloé Rachez,

    Roles Methodology, Resources, Visualization, Writing – review & editing

    Affiliation Service de Psychiatrie de l’Adulte et Psychologie Médicale, Centre Mémoire de Ressources et de Recherche, Centre Hospitalier Universitaire Clermont-Ferrand, Clermont-Ferrand, France

  • Urbain Tauveron Jalenques,

    Roles Methodology

    Affiliation Université Clermont Auvergne, Clermont-Ferrand, France

  • Silvia Alina Nechifor,

    Roles Conceptualization, Investigation

    Affiliation Centre Hospitalier Spécialisé Sainte-Marie, Clermont-Ferrand, France

  • Lucile Morel,

    Roles Investigation

    Affiliation Centre Hospitalier Spécialisé Sainte-Marie, Le Puy-en-Velay, France

  • Florent Blanchard,

    Roles Investigation

    Affiliation Centre Hospitalier Spécialisé Sainte-Marie, Le Puy-en-Velay, France

  • Bruno Pereira,

    Roles Formal analysis, Software

    Affiliation Direction de la Recherche Clinique et de l’Innovation, Centre Hospitalier Universitaire Clermont-Ferrand, Clermont-Ferrand, France

  • Sophie Lauron,

    Roles Visualization, Writing – review & editing

    Affiliation Service de Psychiatrie de l’Adulte et Psychologie Médicale, Centre Hospitalier Universitaire Clermont-Ferrand, Clermont-Ferrand, France

  • Fabien Rondepierre,

    Roles Conceptualization, Formal analysis, Methodology, Project administration, Resources, Supervision, Writing – original draft

    Affiliation Service de Psychiatrie de l’Adulte et Psychologie Médicale, Centre Mémoire de Ressources et de Recherche, Centre Hospitalier Universitaire Clermont-Ferrand, Clermont-Ferrand, France

  • for the French DAS/PDAS group

    Membership of the French DAS/PDAS Group is provided in the Acknowledgments.

Abstract

Background

Major depressive disorder with psychotic features (MDDPsy), compared to nonpsychotic MDD, involves an increased risk of suicide and failure to achieve treatment response. Symptom scales can be useful to assess patients with MDDPsy. The aim of the present study was to validate French versions of the Delusion Assessment Scale (DAS) and Psychotic Depression Assessment Scale (PDAS).

Methods

One hundred patients were included. The scales were filled out by psychiatrists. Data from participants who accepted a second interview were used for inter-judge reliability. The scalability and psychometric properties of both scales were assessed.

Results

Data from 94 patients were used. Owing to low score variability between patients, the predefined threshold for scalability (≥0.40) was not reached for both scales. Factorial analysis of the DAS identified five factors, different from those of the original version. Five factors were also identified in the PDAS, of which two comprised items from the HDRS and the other three items from the BPRS. Floor and ceiling effects were observed in both scales, due in part to the construction of certain subscales. Unlike the PDAS, the DAS had good internal consistency. Multiple correlations were observed between the DAS dimensions but none between those of the PDAS. Both scales showed good inter-judge reliability. Convergent validity analyses showed correlations with HDRS, BPRS and CGI.

Limitations

Inter-judge reliability was calculated from a relatively small number of volunteers.

Conclusions

The good psychometric properties of the French versions of the DAS and PDAS could help in assessing MDDPsy, in particular its psychotic features, and hence improve response to treatment and prognosis.

Introduction

Major depressive disorder with psychotic features (MDDPsy) is defined by the presence of delusions and/or hallucinations during the episode of major depression [1]. Studies have reported a prevalence rate of psychotic features in MDD ranging from 11 to 18.5% [24]. MDDPsy is characterized by a greater depressive symptom severity and a higher probability of melancholic features. In addition, patients with MDDPsy have a greater risk of suicide than nonpsychotic MDD patients [5, 6]. They also have greater probability of inpatient treatment. Most international guidelines recommend the combination of an antidepressant and an antipsychotic or electroconvulsive therapy for the treatment of MDDPsy [711]. However, MDDPsy patients are more likely not to achieve treatment response than nonpsychotic MDD patients [4]. MDDPsy is associated with greater psychosocial impairment [12] and decreased quality of life [13]. Combined assessment of psychotic characteristics and overall severity is crucial in MDDPsy [14].

Symptom scales can be useful tools for assessment of measurement-based care for the individual patient and for evaluating and monitoring outcomes in research studies. There exist validated scales that can help to assess patients suffering from MDDPsy [14] which could be more widely used if they were made available in the mother tongue of clinician-researchers. We decided therefore to select two scales among validated rating scales measuring psychotic depression, the Delusion Assessment Scale (DAS), designed specifically for the assessment of delusions in MDDPsy [15], and the Psychotic Depression Assessment Scale (PDAS), which assesses the overall severity of depressive and psychotic symptoms in MDDPsy [16] and has also shown promising results in detecting the occurrence of psychotic depression among patients with depressive disorders in general [17, 18]. The present study aimed to validate French versions of the DAS and PDAS after evaluation of their psychometric properties for use in measuring the severity of psychotic depression in MDDPsy patients.

Methods

Study design

The project was approved by the local Ethical Review Board (Comité de Protection des Personnes Sud-Est VI Clermont-Ferrand, IRB 00008526) and conducted according to Good Clinical Practice guidelines and the Declaration of Helsinki. A psychiatrist explained the aims and procedures to the patients and collected their consent to participate in the study. All patients received written information about the study and were entitled to refuse use of the data collected at any time.

The psychiatrist completed the DAS and PDAS scales after a routine interview with patients shortly after hospital admission. Data from patients who accepted an interview with a second psychiatrist were used for the inter-judge reliability assessment.

Participants

Inpatients aged 18 or older with fluent command of French were recruited from the psychiatric units of the university hospital and the psychiatric hospital centres of Clermont-Ferrand and Le Puy en Velay. Inclusion criteria were diagnosis of major depressive disorder with psychotic features on the basis of DSM 5 criteria [1], a delusional idea as defined in DSM-5 with a rating ≥3 (delusion definitely present) on the delusional rating item of the Schedule for Affective Disorders and Schizophrenia [19] and a score of ≥2 on one of the DAS conviction items, and a score of ≥ 21 on the 17-item version of the Hamilton Depression Scale [20].

Exclusion criteria were a history of schizophrenia, schizoaffective disorder, delusional disorder, shared psychotic disorder, mania, dementia, history of drug or alcohol abuse in the past three months, taking medication likely to induce psychiatric symptoms or disorders or having an unstable or life-threatening medical illness, and meeting criteria for obsessive-compulsive disorder and body dysmorphic disorder.

Instruments

The DAS instrument.

The DAS assesses domains of delusional ideation in patients with MDDPsy. It expands the five single-item domains of the DDERS [21]—conviction, pressure, extension, bizarreness and disorganization—into a 14-item scale with each item rated on 1–3 anchor points. The highest score for each item corresponds to greatest disease severity. A fifteenth item was added to assess mood congruence, which corresponds to a single separate dimension. Rating was performed by an assessor after a standard clinical interview, observation of the patient and reading of comments made by the care team or close friends or family. An instruction manual is available to guide the interview and ratings. It is recommended to assess the severity of symptoms over the past week [15].

Instrument translation.

The DAS was cross-culturally adapted from English into French following established guidelines [22], with the kind permission of the author of the original instrument (Barnett S. Meyers, M.D.). Forward translations were independently made by three psychiatrists fluent in English (CR, SN, IJ), and one bilingual translator, naive to the outcome measure (UTJ), all of whom had French as their mother tongue. A native English translator fluent in French (JW) with a medical background blinded to the original English version then made a backward translation. A multidisciplinary expert committee reviewed the process, compared source and target versions, and resolved discrepancies. Item-translation, semantic, idiomatic, experiential, and conceptual equivalents were discussed. Finally, the consensus target version was adopted by the committee as the pre-final cross-cultural adaptation (S1 File).

We then made an evaluation of the psychometric properties of DAS, given in detail below.

The PDAS instrument.

The PDAS was constructed specifically to assess the severity of psychotic depression in patients with MDDPsy [16]. It is composed of six items from the Hamilton Depression Scale (HAM-D6) [20] and five items from the Brief Psychiatric Rating Scale (BPRS5) [23], both of which are publicly available. In addition, there exist validated French versions of these two scales [24, 25]. The total PDAS score is obtained by adding up the sum of the individual item scores after converting the BPRS item scores to a score between 0 and 4 with the formula (BPRS score– 1) x 2/3, and multiplying the score for item 13 on the Hamilton scale (general somatic) by 2 [16]. Rating is performed by the assessor on the basis of a clinical interview and observation of the patient during the conversation. Guidelines recommended assessing the severity of symptoms over the past week [14].

Assessments

The sociodemographic and medical characteristics of all participants were collected. For each patient, the DAS was completed by a psychiatrist. The following scales were also administered by the psychiatrist: the 17-item version of the HDRS [20] and the 18-item BPRS [23] from which were extracted, respectively, the six and five specific items to construct the PDAS, the Scale for the Assessment of Positive Symptoms (SAPS) to classify the type of delusion [26], the Mini Mental State Examination (MMSE) [27], the delusional rating item of the Schedule for Affective Disorders and Schizophrenia [19], and the CGI-S (Clinical Global Impression of severity) [28].

All data are available at Mendeley [29].

Statistical analyses

Statistical analyses were performed with Stata software (version 13, StataCorp, College Station, TX). P-values <0.05 were considered to be statistically significant.

In accordance with recommendations set out by COSMIN [30] and Terwee et al. [31], we included a minimum number of 100 subjects to ensure satisfactory internal consistency evaluation and a sample size of at least 50 patients to guarantee an acceptable estimate of reliability.

In addition to descriptive statistics, the following psychometric properties of the DAS and PDAS scales were evaluated.

  1. Scalability was assessed by Mokken analysis, generating a Loevinger coefficient of homogeneity for the PDAS total score. In Mokken analysis, a Loevinger coefficient of homogeneity ≥0.40 is indicative of scalability [32]. For the present analysis the BPRS scores were converted as follows: 1 = 0, 2–3 = 1, 4–5 = 2, 6 = 3, and 7 = 4.
  2. Descriptive statistics and score distributions. In addition to mean and standard-deviation, score range, closeness of mean to median, and floor and ceiling effects [31] were calculated.
  3. An exploratory factorial analysis (principal components analysis with varimax rotation) was performed to determine the scale structure. The number of factors was chosen according to usual recommendations: Kaiser criteria, plot of eigenvalues, and part of variance expressed by principal components. For items loading on several factors, the decision to do factor attribution was made according to psychometric results and clinical relevance.
  4. Internal consistency was determined through Cronbach’s alpha coefficient (minimum accepted value: 0.70 [33]), the item homogeneity coefficient (criterion value: ≥ 0.30 [34]) and the item-total correlation corrected for overlap (criterion value: ≥ 0.30 [35]).
  5. Internal validity was determined by study of correlation between the domains making up the scale (standard, ƿ = 0.30–0.70 [36]).
  6. Reproducibility. The intraclass correlation coefficient was used to determine inter-judge reliability. Values of concordance correlation coefficient greater than 0.70 were considered to be satisfactory [31].
  7. Convergent validity. The relationships between DAS and PDAS scale scores and other quantitative measurements (HDRS, BPRS, CGI and SAPS) were studied with correlation coefficients (Pearson or Spearman according to statistical distribution). Association was considered to be weak for a correlation coefficient between 0.3 and 0.5, and moderate to high for a correlation coefficient greater than 0.5.

Results

Of the 100 patients initially recruited, 6 were excluded following reassessment of their diagnosis (3 bipolar disorders, 1 psychotic disorder, 1 dementia, and 1 depression caused by somatic disorders). The characteristics of the remaining 94 patients are given in Table 1. Fifty-one (55%) of the patients were female; they had a mean age of 62.2 ± 17.7 years old and 50% were more than 65 years old. Median HDRS and BPRS scores were 25.5 [24–30] and 58 [51–66], respectively. All patients had at least one clearly defined delusion and a score of ≥3 on the delusion severity rating item of the SADS.

Scalability of the DAS and PDAS scales

The Loevinger coefficients of homogeneity derived from the Mokken analyses were 0.39 for DAS and 0.28 for PDAS. The predefined threshold for scalability (≥0.40) was not achieved despite significant results on both scales (p < 0.001). The Loevinger coefficients of homogeneity were 0.39 for HAM-D6 and 0.33 for BPRS5, both composing the PDAS.

Factorial analysis

The 11-item and 15-item structures of the PDAS and DAS, respectively, were tested by factorial analysis with varimax rotation. Five factors accounting for 70.2% of the total variance were extracted and gave the best factor structure solution for PDAS (Table 2). HDRS items loaded on two factors and BPRS items on three. Only the item “Work and activities” (HDRS 7) loaded on two factors (1 and 3, both composed of HDRS items) and was finally associated with factor 3 designated “Fatigue/activities”. Other dimensions were “Depression”, “Emotional withdrawal/Blunted affect”, “Psychotic symptoms” and “Suspiciousness”.

thumbnail
Table 2. Factor loadings from the factor analysis on the PDAS scale.

https://doi.org/10.1371/journal.pone.0250492.t002

For the DAS, four factors accounting for 60.7% of the total variance were extracted (Table 3). Factor 1 grouped together the “Conviction” and “Impact” dimensions of the original DAS and was named “Delusional conviction”. Factor 2 grouped together the “Disorganization” and “Mood congruence” dimensions and item 8 “People/objects involved” of the original DAS. This factor formed the “Disorganization/Mood congruence” dimension. The “Bizarreness” dimension was retained and constituted factor 3. Two items, one negative and one positive, were loaded on factor 4: “Acting irrationally distrustful during the interview” (negative) and “Places/situations involved” (positive). This gave two dimensions “Acting irrationally during interview” and “Places/situations involved”.

thumbnail
Table 3. Factor loadings from the factor analysis on the DAS scale.

https://doi.org/10.1371/journal.pone.0250492.t003

Descriptive statistics and score distributions

The descriptive statistics and score distributions for the PDAS and DAS scales are given in Table 4. No ceiling effect was found for the PDAS. However, a floor effect was observed for the “Psychotic symptoms” and “Suspiciousness” dimensions.

thumbnail
Table 4. Descriptive statistics and score distributions of the PDAS and DAS scales.

https://doi.org/10.1371/journal.pone.0250492.t004

A ceiling effect was observed for the “Places/situations involved” dimension of the DAS and floor effects for the dimensions of “Disorganization/Mood congruence”, “Bizarreness”, “Acting irrationally during interview” and “Places/situations involved”.

Internal consistency

The DAS showed good internal consistency with Cronbach’s α greater than the minimum required coefficient of 0.70 for all dimensions (Table 5). The PDAS showed lower Cronbach’s α (0.29 to 0.59). Only the “Emotional withdrawal/ Blunted affect” dimension had a Cronbach’s α coefficient greater than 0.70.

thumbnail
Table 5. Cronbach’s α and inter-judge reliability for the PDAS and DAS.

https://doi.org/10.1371/journal.pone.0250492.t005

Inter-item correlations

The PDAS showed weak inter-item correlations (from 0.00 à 0.68). Correlations were only good for items belonging to the same dimension. The DAS showed stronger and more significant inter-item correlations (from 0.00 to 0.70) (S1 and S2 Tables).

Item-total correlations

The PDAS showed moderate corrected item-total correlations with a coefficient greater than 0.30 for only three items, whereas the DAS showed good corrected item-total correlations (only three items were lower than 0.30) (S1 and S2 Tables).

Inter-scale correlations

No correlation was observed between the dimensions of the PDAS (Fig 1 and S3 Table). The DAS dimensions had multiple correlations with only the “Acting irrationally during interview” dimension not correlating with any other.

thumbnail
Fig 1. Convergent validity for PDAS and DAS scales.

Correlations represented on a HEATMAP: in red, negative correlations and in green, positive correlations. A graduation of the color indicates the strength of the correlation. PDAS 1 = Depression; PDAS 2 = Emotional withdrawal/ Blunted affect; PDAS 3 = Fatigue/activities; PDAS 4 = Psychotic symptoms; PDAS 5 = Suspiciousness; DAS 1 = Delusional conviction; DAS 2 = Disorganization/ Mood congruence; DAS 3 = Bizarreness; DAS 4 = Acting irrationally during interview; DAS 5 = Places/situations involved; BPRS 1 = BPRS delusions hallucinations; BPRS 2 = BPRS hebephrenic; BPRS 3 = BPRS paranoia; BPRS 4 = BPRS melancholia anxious; BPRS 5 = BPRS acute psychotic; SAPS 1 = SAPS hallucinations; SAPS 2 = SAPS delusions; SAPS 3 = SAPS bizarre behavior; SAPS 4 = SAPS positive formal thought disorder.

https://doi.org/10.1371/journal.pone.0250492.g001

Inter-judge reliability

Twenty-six participants accepted to be assessed by a second psychiatrist. The PDAS and DAS both had good inter-judge reliability. Only one dimension showed an intraclass correlation coefficient lower than 0.70 in each scale: “Fatigue/activities” in PDAS (0.68 [0.46–0.89]) and “Bizarreness” in DAS (0.49 [0.19–0.79]). Others varied from 0.77 to 0.93 for PDAS and from 0.77 to 1.00 for DAS.

Convergent validity

PDAS correlated with all the other scales tested (HDRS, BPRS, CGI and SAPS) and with several subscales (Fig 1 and S3 Table). The strongest correlation was with the total BPRS (r = 0.82, p<0.0001). All PDAS dimensions correlated with the total BPRS, with correlation coefficients varying from 0.25 to 0.51. Only the two dimensions of “Depression” and “Fatigue/activities” from the HDRS correlated with the total HDRS. Certain PDAS dimensions were also associated with BPRS subscales, CGI and SAPS.

The DAS and all its dimensions except “Places/situations involved” correlated with the total BPRS (coefficient correlations from 0.31 to 0.51) and numerous BPRS dimensions. DAS was also associated with HDRS (r = 0.29, p = 0.05). DAS and all its dimensions were also associated with CGI and SAPS.

Discussion

The present study describes the first cross-cultural evaluation of the French versions of the DAS and PDAS, including the first factor analysis of the PDAS, and an assessment of the floor and ceiling effects of the DAS and PDAS, which was not performed in the original studies.

Our study population was comparable to those in other published reports with regard to most sociodemographic and medical characteristics [4, 15, 3739]. Medical treatment of the patients was consistent with guidelines on pharmacotherapy in MDDPsy [711, 40]. The DAS, PDAS, HDRS-17 and BPRS-18 total scores were similar to those observed in studies validating the DAS and PDAS scales [15, 41, 42]. The participants in this multicenter study were recruited from both university and non-university hospitals and assessed by trained psychiatrists.

DAS

The French version of the DAS comprises five dimensions that differ from those of the original version. No item overlapped between the five factors. The first factor included six of the scale items, received the greatest loading, and accounted for 20% of variance. In comparison to the original DAS, the French version groups together the “Conviction” and “Impact” dimensions (except item 4). This is related to the observation of Meyers that there were some overlaps between the items of the “Conviction” and “Impact” dimensions from the original version of the DAS indicating a relationship between the constructs [15]. We decided to name this factor “Delusional conviction” to reflect the strength of the belief and of its emotional and behavioral impact. Factor 3 retains the two items of the “Bizarreness” factor from the original version. Factor 2 from the French version, “Disorganization/Mood congruence”, comprises five items and accounts for 19.5% of variance. Compared to the original version, it includes item 8, “People/objects involved”, and item 15, “Mood congruence” while factors 4 and 5 are each composed of a single item. Factor 4 from the DAS is made up solely of item 4, which assesses whether the patient is distrustful, and factor 5 of the PDAS is made up solely of BPRS item 11, which assesses the suspiciousness of the patient. These two dimensions are fairly independent of the other dimensions that make up the scales to which they belong and are well correlated with each other.

We applied the value of 15% for floor and ceiling effects [31]. The floor effect was observed for certain subscales, due partly perhaps to the absence of certain symptoms in our patients and partly to the construction of the scales: each item was rated from 1 to 3 with factor 3 comprising two items, and factors 4 and 5 one item each. This limits the response options even when responses are well distributed with items rated from 1 to 3.

The DAS had good internal consistency. The results obtained with the French version of the DAS were even better than those of the original version [15]. The internal consistency of the DAS scale as measured by the Cronbach α coefficient (0.81) was considered to be satisfactory and evidence of the good homogeneity of the scale. The Cronbach α coefficient scores of the three dimensions of the French version with enough items for the calculation (0.73, 0.78 and 0.80) were also considered acceptable. By comparison, the original DAS had an overall coefficient of 0.72 with a highest score of 0.85 for the Conviction dimension.

The DAS showed significant inter-item correlations, totaling 30/105 (r>0.30). We observed a satisfactory correlation (>0.60) between items 1 and 2 of dimension 1 of the French version of the DAS, the two items that make up the Conviction dimension of the original version and which were used as inclusion criteria in the STOP-PD therapeutic trial [16, 38, 4346]. We also observed a satisfactory inter-item correlation (from 0.40 to 0.60) between items 10 and 11, which make up the Bizarreness dimension of the original and French versions of the DAS.

The DAS showed good item-total consistency except for item 15, “Mood congruence”, which forms a single dimension in the original version of the DAS and was added to Kendler’s dimensions of delusional experience, which provided the basis of the DAS [15].

Positive relationships were found between four of the five DAS dimensions: only factor 4, composed of the single item “Acting irrationally distrustful during interview”, did not correlate with any other. We cannot make a comparison with the original version of the DAS because, to the best of our knowledge, no such analysis has been published.

The DAS had good inter-judge reliability, with good scores for each of these dimensions. The intraclass correlation coefficient (ICC) was 0.85 for dimension 1, which groups together the dimensions of Conviction and Impact from the original DAS, which in the study of Meyers, had the best ICC (respectively, 0.74 et 0.77). The ICC for dimension 2 was 0.94, which is an excellent score. This dimension groups together Disorganization (ICC of 0.37 in the study of Meyers), Mood Congruence (ICC of 0.51 in the study of Meyers) and one of the two items in Extension (ICC of 0.53 in the study of Meyers). According to Meyers, the reason for the weaker results for the dimensions of Disorganization and Extension was that “the raters have greater difficulty reliably assessing items that rate how delusions may change over time”. He therefore recommended that “future investigators limit the timeframe for the domains of Disorganization and Extension to the week preceding the interview” [15]. Our study was performed in accordance with this recommendation, which could explain the improved ICC score for dimension 2. Dimension 3, which corresponds to the “Bizarreness” factor of the original DAS, was the exception with an ICC score of 0.49, which is nevertheless acceptable, and higher than that of 0.46 recorded in the study of Meyers. It is evidence, as Meyers clearly explained in his study, of the difficulty in assessing this dimension in patients with MDDPsy. The construction of this dimension of the DAS derives from Kendler’s scale of dimensions of delusional experience, which was designed for patients with schizophrenia. Rating bizarreness can be more problematic in patients with MDDPsy and influenced by the investigator’s experience and subjective assessment.

The DAS and all its dimensions except “Places/situations involved” correlated with the total BPRS, with coefficient correlations ranging from 0.31 to 0.51, and with numerous BPRS dimensions. The result for the total DAS was greater than that in the study of Meyers (0.50 as against 0.4) and four of the five dimensions of the French version were significantly correlated with the total score of the BPRS, as against two dimensions in the study of Meyers [15]. The French version of the DAS therefore fully accounted for psychotic symptoms. DAS was also associated with HDRS (r = 0.29, p = 0.005), with a weaker but nevertheless acceptable coefficient.

PDAS

Surprisingly, despite a highly significant result, Mokken analysis did not confirm the scalability of the PDAS (Loevinger coefficient < 0.40). During validation of the semi-structured PDAS interview, Köse Çinar and Østergaard [41] also failed to demonstrate the scalability of the PDAS (Loevinger coefficient 0.17) at baseline. They stated that this could have been due to low variability in the PDAS scores (22.8 ± 5.7). Our data showed a score with low variability (21.8 ± 4.9) close to that in their study [41] whereas the original PDAS validation study showed a higher score and variability (29.5 ± 11.3) [47]. These differences in PDAS score and variability could be due to the population studied. Despite being subject to the same inclusion criteria as in the article of Østergaard [16], our participants had a lower HDRS score, more hallucinations, more suicide attempts and all were inpatients. Another explanation could be the extraction of PDAS items from complete HDRS-17 and BPRS-18. In our study the specific semi-structured interview for the PDAS was not used, which could have affected the rating of the scale. In general, studies assessing the scalability of the PDAS demonstrate its scalability [16, 42, 47] and even Köse Çinar and Østergaard found a Loevinger coefficient > 0.40 at endpoint of their study [41].

With regard to the PDAS, the six items from the HDRS were divided into two dimensions, 1 and 3, which accounted, respectively, for 18.1 and 13.0% of variance while the five items from the BPRS were divided into three dimensions, 2, 4 and 5, which accounted, respectively, for 17.3, 11.8 and 10.0% of variance. Factor 1, which received the greatest loading, is made up of all the items from the “Depression” score of the HDRS. Item HDRS 7 “Work and activities” overlapped between the two factors that make up the HDRS subscale of the PDAS. We decided to place this item in dimension 3 because the psychometric qualities of the scale are better in this configuration.

The moderate results of all internal validity and consistency tests confirmed the construct of the PDAS scale and its scalability.

The PDAS had good inter-judge reliability. Only the “Fatigue/activities” dimension of the PDAS showed an intraclass correlation coefficient very slightly lower than 0.70. The reason could be that, as in the STOP-PD trial, half of our study population were elderly, at an age when they often experience fatigue of various causes, not necessarily imputable to MDDPsy and therefore difficult to assess. Likewise, it is difficult to gauge the impact of MDDPsy on changes in activity of subjects whose habits and behavior are affected by retirement and other age-related factors.

The PDAS correlated with all other scales tested (HDRS, BPRS, CGI and SAPS) and several subscales. The French version of the PDAS reflects the severity of the disease and accounts for both depressive and psychotic symptoms. The strongest correlation was with the total BPRS (r = 0.82, p<0.0001). All the PDAS dimensions correlated with the total BPRS with correlation coefficients varying from 0.25 to 0.51 due to the fact that 5 of the 11 items of the PDAS, i.e. three of the five dimensions, came from the BPRS. Only the two dimensions, “Depression” and “Fatigue/activities”, from the HDRS correlated with the total HDRS, due to the fact that 6 of the 11 items of the PDAS, divided over two dimensions, derived from the HDRS.

One limitation of the present study is its failure to confirm the scalability of the PDAS scale. However, the results of internal validity and consistency tests tend towards confirmation. In addition, the good convergent validity and inter-judge reliability allow the scale to be used. However, inter-judge reliability was calculated from the assessments of only 26 patients, who had consented to a second interview. This relatively small number of volunteers can be explained by the symptoms of MDDPsy.

In conclusion, our study provides evidence of the good psychometric properties of the French versions of the DAS and PDAS. However, other studies are needed to confirm the scalability of the PDAS and the generalisability of the results to a larger population. This should help clinicians and researchers to assess cases of MDDPsy, which is a severe disorder, whose prognosis is marked by the risk of suicide and the lesser likelihood of patients achieving treatment response. The cross-cultural adaptation of this specific instrument should enable clinicians as of now to better assess the symptoms of MDDpsy, particularly psychotic features. It should also enable investigators to propose French-speaking persons with MDDPsy as participants in international collaboration research projects. In both cases, the response to treatment and prognosis of MDDPsy should be improved.

Supporting information

S1 Table. Inter-item and corrected item-total correlations for PDAS.

Spearman correlation coefficients between HDRS and BPRS items making up the PDAS scale. * Corrected item-total correlations. Significant correlations (p<0.05) are in bold.

https://doi.org/10.1371/journal.pone.0250492.s001

(DOCX)

S2 Table. Inter-item and corrected item-total correlations for DAS.

Spearman correlation coefficients between HDRS and BPRS items making up the PDAS scale. * Corrected item-total correlations. Significant correlations (p<0.05) are in bold.

https://doi.org/10.1371/journal.pone.0250492.s002

(DOCX)

S3 Table. Convergent validity for PDAS and DAS scales.

Spearman correlation coefficients between PDAS, DAS, HDRS, BPRS, CGI and SAPS scales. Significant correlations (p<0.05) are in bold. PDAS 1 = Depression; PDAS 2 = Emotional withdrawal/ Blunted affect; PDAS 3 = Fatigue/activities; PDAS 4 = Psychotic symptoms; PDAS 5 = Suspiciousness; DAS 1 = Delusional conviction; DAS 2 = Disorganization/ Mood congruence; DAS 3 = Bizarreness; DAS 4 = Acting irrationally during interview; DAS 5 = Places/situations involved; BPRS 1 = BPRS delusions hallucinations; BPRS 2 = BPRS hebephrenic; BPRS 3 = BPRS paranoia; BPRS 4 = BPRS melancholia anxious; BPRS 5 = BPRS acute psychotic; SAPS 1 = SAPS hallucinations; SAPS 2 = SAPS delusions; SAPS 3 = SAPS bizarre behavior; SAPS 4 = SAPS positive formal thought disorder.

https://doi.org/10.1371/journal.pone.0250492.s003

(DOCX)

Acknowledgments

The authors thank Barnett S. Meyers for allowing them to validate the French version of the DAS scale and the membership of the French DAS/PDAS group: Aziz Amour, Esteban Arango, Florent Blanchard, Lucile Morel and Nadjim Zouaoui (Centre Hospitalier Spécialisé Sainte-Marie Le Puy-en-Velay), Dorothée Dhenain, Isaure Gaume and Silvia Alina Nechifor (Centre Hospitalier Spécialisé Sainte-Marie Clermont-Ferrand), Jonathan. Chabert, Isabelle Jalenques (leader of the group, ijalenques@chu-clermontferrand.fr), Sophie Lauron, Chloé Rachez, Fabien Rondepierre and Pierre-Antoine Thevenet (Centre Hospitalier Universitaire Clermont-Ferrand, Service de Psychiatrie de l’Adulte et Psychologie Médicale), Bruno Pereira (Centre Hospitalier Universitaire Clermont-Ferrand, Direction de la Recherche Clinique et de l’Innovation), Urbain Tauveron Jalenques and Jeffrey Watts (Université Clermont Auvergne).

References

  1. 1. American Psychiatrist Association. Diagnostic and Statistical Manual of Mental Disorders (DSM). Fifth Edition. American Psychiatrist Association; 2013.
  2. 2. Johnson J, Horwath E, Weissman MM. The validity of major depression with psychotic features based on a community study. Arch Gen Psychiatry. 1991;48:1075–81. pmid:1845225
  3. 3. Ohayon MM, Schatzberg AF. Prevalence of depressive episodes with psychotic features in the general population. Am J Psychiatry. 2002;159:1855–61. pmid:12411219
  4. 4. Dold M, Bartova L, Kautzky A, Porcelli S, Montgomery S, Zohar J, et al. Psychotic Features in Patients With Major Depressive Disorder: A Report From the European Group for the Study of Resistant Depression. J Clin Psychiatry. 2019;80.
  5. 5. Zalpuri I, Rothschild AJ. Does psychosis increase the risk of suicide in patients with major depression? A systematic review. J Affect Disord. 2016;198:23–31. pmid:26998793
  6. 6. Gournellis R, Tournikioti K, Touloumi G, Thomadakis C, Michalopoulou PG, Christodoulou C, et al. Psychotic (delusional) depression and suicidal attempts: a systematic review and meta-analysis. Acta Psychiatr Scand. 2018;137:18–29. pmid:29178463
  7. 7. Farahani A, Correll CU. Are antipsychotics or antidepressants needed for psychotic depression? A systematic review and meta-analysis of trials comparing antidepressant or antipsychotic monotherapy with combination treatment. J Clin Psychiatry. 2012;73:486–96. pmid:22579147
  8. 8. Rothschild AJ. Challenges in the treatment of major depressive disorder with psychotic features. Schizophr Bull. 2013;39:787–96. pmid:23599251
  9. 9. Malhi GS, Bassett D, Boyce P, Bryant R, Fitzgerald PB, Fritz K, et al. Royal Australian and New Zealand College of Psychiatrists clinical practice guidelines for mood disorders. Australian & New Zealand Journal of Psychiatry. 2015;49:1087–206. pmid:26643054
  10. 10. Bauer M, Severus E, Köhler S, Whybrow PC, Angst J, Möller H-J, et al. World Federation of Societies of Biological Psychiatry (WFSBP) guidelines for biological treatment of unipolar depressive disorders. part 2: maintenance treatment of major depressive disorder-update 2015. World J Biol Psychiatry. 2015;16:76–95. pmid:25677972
  11. 11. Wijkstra J, Lijmer J, Burger H, Cipriani A, Geddes J, Nolen WA. Pharmacological treatment for psychotic depression. Cochrane Database of Systematic Reviews [Internet]. 2015 [cited 2020 April 21];(7). Available from: https://www.cochranelibrary.com/cdsr/doi/10.1002/14651858.CD004044.pub4/full pmid:26225902
  12. 12. Coryell W, Leon A, Winokur G, Endicott J, Keller M, Akiskal H, et al. Importance of psychotic features to long-term course in major depressive disorder. Am J Psychiatry. 1996;153:483–9. pmid:8599395
  13. 13. Cramer V, Torgersen S, Kringlen E. Mood disorders and quality of life. A community study. Nord J Psychiatry. 2010;64:58–62. pmid:19883189
  14. 14. Østergaard SD, Rothschild AJ, Flint AJ, Mulsant BH, Whyte EM, Leadholm AK, et al. Rating scales measuring the severity of psychotic depression. Acta Psychiatr Scand. 2015;132:335–44. pmid:26016647
  15. 15. Meyers BS, English J, Gabriele M, Peasley-Miklus C, Heo M, Flint AJ, et al. A delusion assessment scale for psychotic major depression: Reliability, validity, and utility. Biol Psychiatry. 2006;60:1336–42. pmid:17046724
  16. 16. Østergaard SD, Meyers BS, Flint AJ, Mulsant BH, Whyte EM, Ulbricht CM, et al. Measuring psychotic depression. Acta Psychiatr Scand. 2014;129:211–20. pmid:23799875
  17. 17. Park S-C, Choi J, Kim J-M, Jun T-Y, Lee M-S, Kim J-B, et al. Is the Psychotic Depression Assessment Scale a useful diagnostic tool? The CRESCEND study. J Affect Disord. 2014;166:79–85. pmid:25012413
  18. 18. Park S-C, Østergaard SD, Choi J, Kim J-M, Jun T-Y, Lee M-S, et al. Is the BPRS-5 subscale of the psychotic depression assessment scale a reliable screening tool for psychotic depression?: Results from the CRESCEND study. J Affect Disord. 2015;174:188–91. pmid:25506755
  19. 19. Endicott J, Spitzer RL. A diagnostic interview: the schedule for affective disorders and schizophrenia. Arch Gen Psychiatry. 1978;35:837–44. pmid:678037
  20. 20. Hamilton M. A rating scale for depression. J Neurol Neurosurg Psychiatr. 1960;23:56–62. pmid:14399272
  21. 21. Kendler KS, Glazer WM, Morgenstern H. Dimensions of delusional experience. Am J Psychiatry. 1983;140:466–9. pmid:6837787
  22. 22. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25:3186–91. pmid:11124735
  23. 23. Overall JE, Gorham DR. THE BRIEF PSYCHIATRIC RATING SCALE. Psychological Reports. 1962;10:799–812.
  24. 24. Guelfi J-D. L’échelle de dépression de Hamilton. In: L’évaluation clinique standardisée en psychiatrie. Nouv. éd. Boulogne: Éd. médicales Pierre Fabre; 1993. p. 187–94.
  25. 25. Pichot P, Overall JE, Samuel-Lajeunesse B, Dreyfus J. Structure factorielle de l’échelle abrégée d’évaluation psychiatrique (BPRS). Revue de Psychologie Appliquée. 1969;19:217–32.
  26. 26. Andreasen N. Scale for the Assessment of Positive Symptoms (SAPS). Iowa City: University of Iowa; 1984.
  27. 27. Molloy DW, Alemayehu E, Roberts R. Reliability of a Standardized Mini-Mental State Examination compared with the traditional Mini-Mental State Examination. Am J Psychiatry. 1991;148:102–5. pmid:1984692
  28. 28. Guy W. Assesment manual for psychopharmacology, revised Ed. Washington DC: US Department of Health, Education and Welfare; 1976.
  29. 29. Jalenques I. Cross-cultural evaluation of the French version of the Delusion Assessment Scale (DAS) and Psychotic Depression Assessment Scale (PDAS) [Internet]. Mendeley; 2020 [cited 2021 February 8]. https://data.mendeley.com/datasets/kw7m5f4sjv/1
  30. 30. COSMIN—Improving the selection of outcome measurement instruments [Internet]. COSMIN. [cited 2020 April 14]. https://www.cosmin.nl/
  31. 31. Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42. pmid:17161752
  32. 32. Loevinger J. The technic of homogeneous tests compared with some aspects of « scale analysis » and factor analysis. Psychological Bulletin. 1948;45:507–29. pmid:18893224
  33. 33. Aaronson N, Alonso J, Burnam A, Lohr KN, Patrick DL, Perrin E, et al. Assessing health status and quality-of-life instruments: attributes and review criteria. Qual Life Res. 2002;11:193–205. pmid:12074258
  34. 34. Eisen M, Ware JE, Donald CA, Brook RH. Measuring components of children’s health status. Med Care. 1979;17:902–21. pmid:480998
  35. 35. Ware JE, Gandek B. Methods for testing data quality, scaling assumptions, and reliability: the IQOLA Project approach. International Quality of Life Assessment. J Clin Epidemiol. 1998;51:945–52. pmid:9817111
  36. 36. Hobart J, Lamping D, Fitzpatrick R, Riazi A, Thompson A. The Multiple Sclerosis Impact Scale (MSIS-29): a new patient-based outcome measure. Brain. 2001;124:962–73. pmid:11335698
  37. 37. Gaudiano BA, Dalrymple KL, Zimmerman M. Prevalence and clinical characteristics of psychotic versus nonpsychotic major depression in a general psychiatric outpatient clinic. Depression and Anxiety. 2009;26:54–64. pmid:18781658
  38. 38. Meyers BS, Flint AJ, Rothschild AJ, Mulsant BH, Whyte EM, Peasley-Miklus C, et al. A double-blind randomized controlled trial of olanzapine plus sertraline vs olanzapine plus placebo for psychotic depression: the study of pharmacotherapy of psychotic depression (STOP-PD). Arch Gen Psychiatry. 2009;66:838–47. pmid:19652123
  39. 39. Jääskeläinen E, Juola T, Korpela H, Lehtiniemi H, Nietola M, Korkeila J, et al. Epidemiology of psychotic depression—systematic review and meta-analysis. Psychol Med. 2018;48:905–18. pmid:28893329
  40. 40. Kennedy SH, Lam RW, McIntyre RS, Tourjman SV, Bhat V, Blier P, et al. Canadian Network for Mood and Anxiety Treatments (CANMAT) 2016 Clinical Guidelines for the Management of Adults with Major Depressive Disorder: Section 3. Pharmacological Treatments. Can J Psychiatry. 2016;61:540–60. pmid:27486148
  41. 41. Köse Çinar R, Østergaard SD. Validation of the semi-structured Psychotic Depression Assessment Scale (PDAS) interview. Acta Neuropsychiatr. 2018;30:175–80. pmid:28535843
  42. 42. Vermeulen T, Lemey L, Van Diermen L, Schrijvers D, Madani Y, Sabbe B, et al. Clinical validation of the Psychotic Depression Assessment Scale (PDAS) against independent global severity ratings in older adults. Acta Neuropsychiatr. 2018;30:203–8. pmid:29501075
  43. 43. Schaffer A, Flint AJ, Smith E, Rothschild AJ, Mulsant BH, Szanto K, et al. Correlates of suicidality among patients with psychotic depression. Suicide Life Threat Behav. 2008;38:403–14. pmid:18724788
  44. 44. Smith E, Rothschild AJ, Heo M, Peasley-Miklus C, Caswell M, Papademetriou E, et al. Weight gain during olanzapine treatment for psychotic depression: effects of dose and age. Int Clin Psychopharmacol. 2008;23:130–7. pmid:18408527
  45. 45. Flint AJ, Peasley-Miklus C, Papademetriou E, Meyers BS, Mulsant BH, Rothschild AJ, et al. Effect of age on the frequency of anxiety disorders in major depression with psychotic features. Am J Geriatr Psychiatry. 2010;18:404–12. pmid:20429084
  46. 46. Blumberger DM, Mulsant BH, Emeremni C, Houck P, Andreescu C, Mazumdar S, et al. Impact of prior pharmacotherapy on remission of psychotic depression in a randomized controlled trial. J Psychiatr Res. 2011;45:896–901. pmid:21300377
  47. 47. Østergaard SD, Pedersen CH, Uggerby P, Munk-Jørgensen P, Rothschild AJ, Larsen JI, et al. Clinical and psychometric validation of the psychotic depression assessment scale. J Affect Disord. 2015;173:261–8. pmid:25462426