Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Reliability and validity of the PORTRAIT-10 tool for assessing complex health care needs in French-speaking people living with chronic pain

  • M. Gabrielle Pagé ,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Writing – original draft

    gabrielle.page@umontreal.ca

    Affiliations Department of Anesthesiology and Pain Medicine, Faculty of Medicine, Université de Montréal, Montreal, Quebec, Canada, Department of Psychology, Faculty of Arts and Sciences, Université de Montréal, Montreal, Quebec, Canada, Research Center, Centre hospitalier de l’Université de Montréal, Montreal, Quebec, Canada

  • Nicole Tremblay,

    Roles Data curation, Funding acquisition, Project administration, Resources, Writing – review & editing

    Affiliation Patient Partner, Research coordination, Réseau universitaire de la santé et des services sociaux, Université de Montréal, Montreal, Quebec, Canada

  • Karen Ghoussoub,

    Roles Methodology, Writing – original draft

    Affiliations Department of Psychology, Faculty of Arts and Sciences, Université de Montréal, Montreal, Quebec, Canada, Research Center, Centre hospitalier de l’Université de Montréal, Montreal, Quebec, Canada

  • Catherine Hudon,

    Roles Conceptualization, Investigation, Writing – review & editing

    Affiliation Department of Family and Emergency Medicine, Faculty of Medicine and Health Sciences, Université de Sherbrooke, Sherbrooke, Quebec, Canada

  • Maud-Christine Chouinard,

    Roles Conceptualization, Validation, Writing – review & editing

    Affiliations Faculty of Nursing, Université de Montréal, Montreal, Quebec, Canada, Research center, Centre universitaire de santé et de services sociaux du Nord-de-l’Île-de-Montréal, Montreal, Quebec, Canada

  • Manon Choinière

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Supervision, Writing – original draft

    Affiliations Department of Anesthesiology and Pain Medicine, Faculty of Medicine, Université de Montréal, Montreal, Quebec, Canada, Research Center, Centre hospitalier de l’Université de Montréal, Montreal, Quebec, Canada

Abstract

Chronic pain (CP) presents multidimensional components, leading individuals to experience complex biopsychosocial needs. However, efficient tools to assess these needs remain scarce. PORTRAIT-10 is a tool designed to measure the complexity of patients’ needs. The present study was aimed at documenting the psychometric properties of this tool in a sample of individuals with CP who completed the INTERMED-Self Assessment (IMSA), PORTRAIT-10, Pain Catastrophizing Scale (PCS), and Pain Self-Efficacy Questionnaire (PSEQ). PORTRAIT-10 was re-administered 3 weeks later. The sample comprised 295 participants. Mean age of the respondents was 53.3 ± 9.3 years; 88.3% were females. The median pain duration was 15 years. Results of an exploratory factor analysis showed that a 4-factor solution best fit the PORTRAIT-10 data, with at least 2 of these factors (psychological and social) being consistent with the conceptual framework of the tool. PORTRAIT-10 also showed acceptable internal consistency (Cronbach α = 0.67, 0.73) and very good reliability over time (ρ = 0.85). Correlation with IMSA was high (ρ = 0.74) and as expected, was low with PCS (ρ = 0.34) suggesting a very good construct validity. A ROC analysis demonstrated that a PORTRAIT-10 cut-off score of 10 displayed good sensitivity (0.86) and specificity (0.71) in detecting complex care needs in this population. This study provides initial validity and reliability of PORTRAIT-10 and suggests that this tool may be helpful in identifying individuals with CP who have complex needs. Further research is needed to explore the psychometric properties of PORTRAIT-10 in large and more diverse chronic pain populations and to evaluate its impact on clinical outcomes.

Introduction

Pain is a multidimensional experience encompassing sensory, affective, and evaluative dimensions, with a biopsychosocial approach being essential in the management of chronic pain [1,2]. Many tools are available to measure these dimensions, both for research and clinical purposes. With some exceptions (e.g., McGill Pain Questionnaire), most instruments focus however on one single dimension of the pain and do not consider the various aspects of people’s experience that can be simultaneously impacted. Furthermore, the use of unidimensional tools does not inform the need for chronic pain management from a biopsychosocial perspective [3].

Failure to consider the global pain experience often leads to suboptimal treatments, such as over-reliance on pharmacological interventions, which may not address the underlying biopsychosocial factors. This can lead to escalation of pharmacological treatments that are often unsuccessful, a failure which is not necessarily strictly due to the lack of drug efficacy, but rather to the complex biopsychosocial factors people must overcome to access care that meet their global, complex needs [4]. There is some evidence, although heterogeneity is great across studies, that complexity of patients’ needs is correlated with some healthcare outcomes [5]. This suggests that better understanding complexity and stratifying patients based on complexity needs might be a clinically-relevant endeavour to pursue.

Pain has historically been conceptualized as a symptom of a disease rather than a disease in and of itself. As a result, specialized care for chronic pain is insufficient to meet the needs of all individuals living with chronic pain both in terms of geographical accessibility and reasonable wait time for patients’ first appointment [68]. There is thus a need to optimally identify those patients who present with complex needs associated with chronic pain and thus whose care can require access to more integrated care. As such, some tools have been developed to measure this complexity and tailor services/treatments based on complexity of needs and experiences [9]. This type of assessment could also be helpful in assessing patients considered for trials given the limited availability of effective therapeutic interventions in chronic pain. One of these tools, INTERMED, aims to identify patients with low back pain having similar biopsychosocial profiles and to link these subgroups to clinically relevant variables [10,11]. INTERMED was presented as a method to organize coordinated and interdisciplinary health care for patients with complex biopsychosocial care needs. The interest in using such tool for chronic pain lies in the possibility to evaluate various dimensions that influence patient trajectories (biological, psychological, social and health care delivery). These dimensions are considered important factors that dictate the patient needs’ level of complexity. For example, among individuals living with rheumatoid arthritis, results showed that a high score on those 4 dimensions was found in approximately 50% of people [12].

While INTERMED is very useful in research, it has important limitations in a clinical practice context: 1) the literacy level required is higher that the recommended Grade 6 reading level and thus inaccessible for many people, 2) it requires a significant amount of time to complete (15−25 minutes), and 3) its scoring system could be too complex for clinicians [9]. In response to these limitations, a new short questionnaire entitled PORTRAIT-10 was developed (Hudon & Chouinard, https://www.portrait-10.ca). It consists of 10 items with a simplified language and scoring system. The goal of the present study was to examine the factor structure and psychometric properties of PORTRAIT-10 among a sample of individuals living with chronic pain.

Materials and methods

Recruitment and participants

Participants were recruited via email from the Quebec Association of Chronic Pain (https://aqdc.info/en/), and inclusion criteria included individuals aged 18 and older with chronic pain lasting more than three months who spoke French and had access to the Internet. The study was approved by the Research Ethics Board of the Centre hospitalier de l’Université de Montréal (22.066-YP). Data collection occurred between February 16th and April 8th 2023, with participants completing online questionnaires on two separate occasions. Informed written consent was obtained from all study participants.

Procedure

After providing written consent, participants were invited to complete the following online self-reported questionnaires: 1) the reference standard INTERMED-Self Assessment, 2) PORTRAIT-10A, 3) the Pain Catastrophizing Scale, and 4) the Pain Self-Efficacy Questionnaire. The order of administration of the questionnaires was randomized (REDCap Version 13.7.17). Participants in this first round were asked to complete PORTRAIT-10B again 3 weeks later. Participants who responded to both rounds were eligible to win one of 5 prepaid VISA™ cards valued at $100 in a random draw.

Questionnaires

INTERMED self assessment.

The INTERMED Self-Assessment (IMSA) is a validated questionnaire which has been designed to assess biopsychosocial complexity and health care needs to optimize care in adult patients [13,14]. The patient’s condition is assessed along four dimensions: biological, psychological, social, and health care delivery. Each dimension is evaluated in terms of time: history, current state, and prognosis. The score for each of the four dimensions is obtained by summing answers to 5 questions with answer choices that range from 0 to 3, for a possible subscale score ranging from 0 to 15. The total score is the sum of the 4 dimensions (0–60) [13,14]. Psychometric properties of the IMSA were assessed in a large and heterogenous international sample of adult hospital inpatients and outpatients. The study revealed good reliability and validity of the instrument across different cultures [14]. In the present study, a French version of the IMSA was used, which can be found online and in the user manual [13].

PORTRAIT-10.

PORTRAIT-10 consists of 10 questions that Hudon and Chouinard proposed in line with INTERMED and their clinical and research expertise with a simplified language and scoring system (Hudon & Chouinard, See S1). Answers to questions are scored from 0 to 4 (Likert type) with a possible total score ranging from 0 to 40. The higher the score, the more complex the patient’s needs. Based on the same conceptual framework of the multidimensionality of healthcare needs than INTERMED [15], the following questionnaire structured was used: a) three questions are associated with physical health (general health, pain and medication), b) two questions address psychological health and alcohol/drug use, c) three questions are related to social status (housing, support, and income), and d) two questions ask about the individual’s perception of their health needs and the complexity of their clinical condition. As with INTERMED, the aim is to obtain an overall score in order to identify patients with complex needs who might versus might not require access to more integrated care.

Pain catastrophizing scale.

Pain catastrophizing is described as the tendency to magnify or exaggerate the threat value or seriousness of pain sensations [1619]. The Pain Catastrophizing Scale (PCS) contains 13 items reflecting the degree to which participants experienced thoughts or feelings when experiencing pain, divided in three sub-scales: rumination, magnification, and helplessness [17]. Each item is scored on a 5-point scale from 0 (not at all) to 4 (all the time). The PCS has been shown to have adequate to excellent internal consistency (Cronbach α: total PCS = 0.87 to 0.95) [16,20,21]. In the present study, a French version of the PCS was used, called PCS-Canadian French (PCS-CF) [22]. Reliability analyses showed that PCS-CF has a high degree of internal consistency (Cronbach α = 0.91) and test-retest reliability (Pearson r = 0.85) that is comparable to the original PCS [22].

Pain self-efficacy questionnaire.

The Pain Self-Efficacy Questionnaire (PSEQ) developed by Nicholas in 2007 [23] is a self-administered, one-dimensional questionnaire designed to assess the degree of confidence a person living with chronic pain has to perform different tasks despite the presence of pain. It consists of 10 items; each item is assessed on a Likert-type scale (0 being “not confident at all” and 6 being “completely confident”). Scores are summed to obtain a total score that can ranges from 0 to 60; a high score representing a high degree of self-efficacy. In the present study, the French version of the PSEQ was used [24]. The PSEQ-F was found to be reliable (intraclass correlation coefficient = 0.96); adequate validity with moderate correlations were reported with an abbreviated version of the Disability of the Arm, Shoulder and Hand Questionnaire (r = −0.63) and the Brief Pain Inventory (r= −0.57) [24].

Statistical analyses

Descriptive statistics.

Descriptive statistics (e.g., mean, median, frequency table) were used to depict the sociodemographic and clinical characteristics of the participants.

Exploratory factor analysis.

Exploratory factor analysis (EFA) was used to examine the factor structure of PORTRAIT-10. Data suitability for factor analysis was assessed using the Bartlett’s test of sphericity [25] and KMO test [26] with suitability set at > 0.50. Polychoric correlation matrix was used as the input to the EFA models given the ordinal nature of the items [2729]. As the intent of the analysis was to identify the data’s latent structure and considering that the factor structure of PORTRAIT-10 had not been previously examined, EFA was favored over confirmatory factor analysis [28]. The number of factors to retain was determined by using multiple retention criteria—i.e., Empirical Kaiser criterion, Hull method, Kaiser-Guttman criterion, Parallel analysis, Scree plot, Sequential chi-square model tests, RMSEA lower bound, and Akaike Information Criterion, with the function N_FACTORS in the EFAtools package in R on the polychoric correlation matrix using maximum likelihood [28]. Theoretical convergence as well as parsimony were also considered. Model fits were also compared across solutions ranging from 1 to 5 factors. Once the number of factors to retain was determined, EFA was performed with the EFA_AVERAGE function of the EFAtools package, using the polychoric correlation matrix, a combination of Principal Axis Factoring, Maximum Likelihood, and Unweighted Least Squares as an extraction method, and oblimin rotation. Factors were assumed to be correlated and as such oblique rotation was used [30,31]. The above analyses were carried out with the R statistical package version 4.2.2 [32] and its EFAtools [33] and psych [34] packages.

PORTRAIT-10 reliability.

Cronbach alphas (α) were used to assess the internal consistency of PORTRAIT-10A (first administration) and PORTRAIT-10B (administered three weeks later). Spearman correlation coefficients were also calculated to assess test-retest reliability.

PORTRAIT-10 construct validity.

Construct validity of PORTRAIT-10 was examined using convergent and discriminant validity. Convergent validity was determined by correlating the PORTRAIT-10 scores with the IMSA ones. Discriminant validity was assessed by correlating PORTRAIT-10 scores with those on the PCS and the PSEQ.

Sensitivity and specificity of PORTRAIT-10.

Receiver operator characteristic (ROC) curves were used to examine possible cut-off scores on PORTRAIT-10 to differentiate people having a complex clinical condition from those who did not. Total score on the PORTRAIT-10 was examined for sensitivity and specificity against the reference point (cut-off score) of 19 on the IMSA (0–18 = no complexity; 19+ = complexity) as the reference value [13,14]. Threshold was determined visually using the ROC curve and by comparing rates of true positive and false positive percentages. Area under the curve (AUC) discrimination measure was also examined as it determines accuracy rate of the questionnaire in discriminating between complex and non-complex cases based on reference point. AUC < 0.70 is considered as poor discrimination; 0.70 < AUC < 0.80 is considered acceptable discrimination; 0.80 < AUC < 0.90 is considered excellent discrimination, and AUC > 0.90 is considered superior discrimination [35]. Analyses were conducted with the R statistical package and its pROC [36] package.

Sample size justification

Sample size was estimated for EFA whose focus was to understand the underlying structure of the data and not computing confidence intervals or p-values. There are no clear rules about sample size requirements. Some authors suggest that 300 participants (fewer are required if correlations are high among variables) are sufficient [37], while others suggest a ratio of number of cases to number of variables (e.g., 10–15 participants per item). Recent recommended practices for EFA suggest that sample size depends in part on nature of the data (e.g., high communalities without cross loadings would require a smaller sample size), minimum item loadings, and a number of items per factor [38]. Based on simulation data, a sample size of 200 (a 20:1 subject to item ratio) would provide correct factor structure 70% of the time, and an average error in factor loadings of 0.16 [38].

Results

Descriptive statistics

A total of 295 participants were enrolled in the study but not all of them provided demographic information; 88.3% of the respondents were women (197/223); mean age (n = 199) was 53.3 ± 9.3 years and pain duration varied from 2 to 65 years (median (n = 222): 15 years, interquartile range: 17). The vast majority of participants (74.7%) had been living with chronic pain for 10 or more years (<5 years: 10.2%; 5–9 years: 15.1%).

Table 1 shows the response rate for each measurement tool. Incomplete questionnaires were excluded from all the analyses. As shown in Table 1, the average IMSA score is far above the cut-off complexity score (≥ 19/60) [13,14]. In fact, more than 80% of the participants had an IMSA score above the cut-off complexity score of 19/60 suggesting that many people who live with chronic pain commonly continue to have complex needs although their pain has been present for many years.

thumbnail
Table 1. Participants’ response rates (n = 295) for each measurement tool and their average scores.

https://doi.org/10.1371/journal.pone.0335734.t001

Factor structure of PORTRAIT-10

The Barlett’s test of sphericity indicated the data was suitable for factor analysis (X2(45) = 381.57, p < 0.001), demonstrating that the items on PORTRAIT-10 are sufficiently correlated to warrant factor analysis. The KMO statistic was 0.73, above the minimum standard indicating suitability of the PORTRAIT-10 data for factor analysis. The polychoric correlation matrix is shown in Table 2.

Number of factors to retain in the EFA using various factor retention criteria are listed in Table 3 and the scree plot of eigenvalues is shown in Fig 1. Overall, a 4-factor solution was suggested using the Hull method with Root Mean Square Error of Approximation (RMSEA), Parallel Analysis, and Akaike Information Criterion (AIC).

thumbnail
Table 3. Retention criteria used to determine the number of factors in the EFA.

https://doi.org/10.1371/journal.pone.0335734.t003

thumbnail
Fig 1. Scree plot of eigenvalues determined by exploratory factor analysis.

https://doi.org/10.1371/journal.pone.0335734.g001

To further validate selection of the final EFA solution, an EFA model was ran to compare fit indices for a 1-factor, a 2-factor, a 3-factor, a 4-factor and a 5-factor solution [39]. As shown in Table 4, the 1-factor and 2-factor solutions were not appropriate as the RMSEA values were above 0.06 and the AIC values were high. The 4-factor solution had a better data fit based on RMSEA compared to the 3-factor solution while the 5-factor solution did not generate further improvement.

The 4-factor solution accounted for 51% of the variance (Factor 1: 15%; Factor 2: 15%; Factor 3: 11%; Factor 4: 10%). Factor loadings and communalities (h2) are shown in Table 5. Mean and minimum/maximum loadings for all items across the four factors are displayed in Fig 2. Factor 1 was comprised of items related to biological and global complexity while Factor 2 related to social dimensions of complexity. Factor 3 contained items related to pain and its management. Finally, Factor 4 related to psychological aspects of complexity. It is interesting to note that Factors 2 and 4 are consistent with the conceptual framework of PORTRAIT-10 namely that items 4–5 were designed to measure psychological complexity while items 6–8 were designed to measure aspects of social complexity. Results of the EFA suggest that items measuring global complexity and biological complexity are loading on Factor 1 (with the exception of medication), while the item measuring pain is also loading on Factor 3 measuring biological complexity. Communalities are acceptable for most items (≥ 0.4), but are signaling potential problems for support and income items. Factor intercorrelation coefficients from the oblique rotation solution ranged from 0.11 (between F2 and F3) to 0.19 (between F2 and F4).

thumbnail
Fig 2. Factor loadings (mean, minimum and maximum) across all four factors.

https://doi.org/10.1371/journal.pone.0335734.g002

Reliability of PORTRAIT-10

Using Cronbach alpha, PORTRAIT-10A (n = 245) and PORTRAIT-10B (n = 159) showed acceptable overall internal consistency (α = 0.67 and 0.73 respectively). Deletion of any one item did not significantly improve the internal consistency of PORTRAIT-10A (α = 0.62–0.70) or PORTRAIT-10B (α = 0.66–0.74). Spearman correlation coefficient also showed excellent test-retest reliability of PORTRAIT-10 (ρ = 0.85, p < .0001).

Construct validity of PORTRAIT-10

Convergent validity.

Spearman correlation coefficient showed that PORTRAIT-10 significantly correlated with IMSA (ρ = 0.74, p < 0.0001) indicating very good convergent validity.

Discriminant validity.

As expected, PORTRAIT-10 was found to poorly correlate with the Pain Catastrophizing Scale (ρ = 0.34) thereby suggesting very good discriminant validity. However, a moderate correlation was found between PORTRAIT-10 and the Pain Self-Efficacy Questionnaire (ρ = −0.54, p < 0.0001). The higher the scores on PORTRAIT-10, the lower was the perceived pain self-efficacy.

Sensitivity and specificity of PORTRAIT-10

Results of the ROC analysis are shown in Fig 3 and Table 6. The AUC measure was 0.88, demonstrating excellent discrimination capacities. Based on visual examination of the ROC curve and on the true positive percentages and false positive percentages shown in Table 6, a cut-off score of 10 on PORTRAIT-10 would offer optimal discrimination of complex vs. non-complex cases. This cut-off score had good sensitivity (0.86) and specificity (0.71) meaning that 86% of correct cases were identified—i.e., people were flagged as complex on both the INTERMED Self-Assessment (IMSA) and PORTRAIT-10. However, 28.6% of cases were flagged as complex with PORTRAIT-10 while they were not with the IMSA (see Table 6). If the PORTRAIT-10 cut-off score is moved to 12, less true complex cases are detected (70.9%) but only 14.3% of individuals are wrongly flagged as complex.

thumbnail
Table 6. True positive percentages and false positive percentages for varying cut-off scores on PORTRAIT-10.

https://doi.org/10.1371/journal.pone.0335734.t006

thumbnail
Fig 3. ROC curve plotting the true positive percentages against the false positive percentages.

ROC area under the curve (AUC) = 0.88.

https://doi.org/10.1371/journal.pone.0335734.g003

Discussion

The goal of this study was to document the factor structure and psychometric properties of a short tool, PORTRAIT-10, designed to assess the complexity of health care needs. The results obtained in a sample of adults living with chronic pain suggest that the instrument is valid and reliable and may be helpful in identifying individuals with complex biopsychosocial needs.

Psychometric properties

The psychometric properties of PORTRAIT-10 indicate its potential for use in both research and clinical practice. Factor analysis, reliability (internal consistency and test-retest reliability), construct validity (convergent and discriminant validity), sensitivity and specificity were examined in this study to determine the tool’s utility in identifying complex health care needs in individuals with chronic pain.

The exploratory factor analysis revealed a 4-factor solution that aligns broadly with the conceptual framework of PORTRAIT-10, although some factors, such as biological and pain-related complexity, do not perfectly correspond with the conceptual model. Two of these factors, psychological and social dimensions, are consistent with the biopsychosocial model of chronic pain. This alignment highlights the validity of PORTRAIT-10 as a measure of multidimensional health care needs. The other two factors, namely the factor 1 that was comprised of items related to biological and global complexity and the factor 3 that was comprised of items related to pain and its management, do not align perfectly with the conceptual framework of INTERMED. However, these two factors account for a non-negligible portion of the variance (15% and 11% respectively), suggesting that these factors capture important aspects of the measured constructs. It is possible that among individuals living with chronic pain, this condition is directly impacting their physical health, but also given its biopsychosocial nature, complexifies the healthcare needs that they have. As such, the distinction between the biological complexity (health, pain, medications) and global complexity (health needs, perceived complexity) becomes more porous. The factors seem interpretable, and the items are loading onto these factors, suggesting that they are measuring coherent constructs [40].

Two items (support and income) had low communalities suggesting that an important amount of variance in these two variables is not explained by the common factors of the EFA. Given that this is a first exploration of PORTRAI-10 in a sample of individuals living with chronic pain and more validation is needed, it could suggest that these two items are not related to the other items, or that the addition of other factors could be considered [38].

The instrument also demonstrated acceptable internal consistency, indicating that its items reliably measure related constructs within each factor. High test-retest reliability was also observed in this study, demonstrating the stability of the tool over time. Despite an attrition rate of 35.1% from the initial assessment to follow-up, the findings suggest that PORTRAIT-10 produces consistent results when applied repeatedly under similar conditions. This reliability is a critical strength, as it supports the use of the tool in clinical monitoring.

PORTRAIT-10 demonstrated strong convergent validity, with a high correlation observed between its scores and those of the INTERMED-Self Assessment (IMSA). This result indicates that PORTRAIT-10 effectively captures the complexity of biopsychosocial needs, comparable to a well-established instrument [10,11]. Its simplicity of administration, short administration time, and easy to understand items make it a good choice of measure to understand complex needs of individuals living with chronic pain.

Discriminant validity was supported by a low correlation between PORTRAIT-10 and the Pain Catastrophizing Scale (PCS), suggesting that PORTRAIT-10 measures a distinct construct. However, the correlation with the Pain Self-Efficacy Questionnaire (PSEQ) was moderate. A possible explanation for this result is that it reflects convergent validity—i.e., individuals with more complex needs are likely to have lower confidence in performing activities while in pain. This finding calls for additional research to clarify the relationship between the complexity of health care needs and pain-related self-efficacy.

Based on ROC analysis, a cut-off score of 10 on PORTRAIT-10 demonstrated good sensitivity (0.86) and specificity (0.71) in distinguishing individuals with complex needs from those without. This means that the tool effectively identifies most individuals with complex needs, although there is room for improvement. Based on these results, a PORTRAIT-10 threshold that is specific to individuals living with chronic pain cannot be suggested. A larger number of individuals with varied clinical profiles would be needed to identify a complexity profile specific to individuals living with chronic pain. Additionally, these sensitivity and specificity findings are preliminary and require replication in other chronic disorders populations. Future research with larger sample sizes and more diverse populations is needed to establish the optimal cut-off score for PORTRAIT-10.

Clinical implications

The study identified a subgroup of individuals with chronic pain who exhibited particularly complex biopsychosocial needs. The total IMSA scores for these individuals align with findings from previous studies, indicating that a significant proportion of individuals with chronic pain exceed the threshold for complexity [14,41,42]. Similarly, most participants had total PORTRAIT-10 scores above the complexity threshold, further highlighting the frequent occurrence of complex needs in this population.

Given the multidimensional nature of chronic pain, it is plausible that daily experience of pain fosters complexity in many individuals. The study participants, primarily long-term members of the Quebec Association of Chronic Pain, likely represent a subgroup of individuals who could benefit from individualized, comprehensive services addressing their multifaceted needs. Using PORTRAIT-10, health care providers could quickly identify individuals with chronic pain who require such services, moving beyond pharmacological pain relief alone, which carries its own risks [43,44].

PORTRAIT-10 offers a quick and efficient way to assess individuals’ complexity in clinical settings. Its brevity makes it feasible for routine use in primary care or specialized clinics, allowing providers to screen for complex needs without imposing significant time burdens. Early identification of individuals with high complexity scores can facilitate timely referrals to multidisciplinary teams, ensuring that these individuals receive comprehensive care.

By identifying individuals with high levels of psychological and social complexity, PORTRAIT-10 can guide the development of personalized treatment plans. For example, individuals with high scores on psychological dimensions may benefit from psychotherapy [45], while those with social challenges may require resources to improve social support or access to community services [46]. The tool’s high reliability enables clinicians to re-administer it to monitor progress over time and adjust interventions as needed.

Efficiently identifying individuals with complex needs can help optimize resource allocation in health care settings. By focusing intensive interventions on those most likely to benefit, health care providers can potentially reduce unnecessary care and associated costs [47,48].

The multidimensional nature of PORTRAIT-10 aligns with the principles of multidisciplinary care, which is recommended for chronic pain management [49,50]. The tool can serve as a common framework for communication among health care providers, facilitating collaboration and ensuring that all aspects of an individual’s complex health care needs are addressed.

Strengths and limitations

This study provides valuable insights into the psychometric properties of a novel questionnaire, PORTRAIT-10. It also explores the possible use of the questionnaire in a clinical setting. However, this study had certain limitations. First, the instrument PORTRAIT-10 was validated in a specific population of people living with chronic pain recruited exclusively online through a patient association, with a high proportion of individuals identifying as women. It is possible that gender, level of education, engagement in patient associations and ease of access to the Internet influence the levels of biopsychosocial complexity. More studies are needed to validate PORTRAIT-10 in larger populations of individuals treated in primary care for various chronic disorders. Second, the attrition rate from the initial assessment to the follow-up was high (35.1%) and may have affected statistical power but it is important to point out that with no attrition rate, we might have found even higher correlation coefficients. Third, the present study assessed the validity and reliability of only the French version of PORTRAIT-10. Further research is needed to confirm the psychometric qualities of the English version. Finally, the Cronbach’s alphas were moderate. Internal consistency ranged from marginal to acceptable and further evaluation of the scale’s psychometric properties is needed.

Conclusion

This study is the first to examine the validity and reliability of PORTRAIT-10 and the results suggest that the tool can be helpful in identifying individuals with chronic pain who have complex biopsychosocial needs. Further research is needed to document the psychometric properties of PORTRAIT-10 in large samples of individuals living with different chronic clinical conditions including chronic pain. Future studies should also address whether the use of PORTRAIT-10 will lead to improved care for complex individuals by early detection of their care needs and implementation of adequate treatment strategies.

Supporting information

S1 File. Link to the PORTRAIT-10 questionnaire.

https://doi.org/10.1371/journal.pone.0335734.s001

(DOCX)

Acknowledgments

The authors wish to thank Mrs. Céline Charbonneau and Mr. Pierre Genest who both live with chronic pain and who kindly reviewed the procedures and questionnaires used in this study. Thanks are also due to the Quebec Association of Chronic Pain Patients for the help in recruiting participants. All patients who took part in the present study also deserve to be thanked. Finally, Mr. Marc Dorais from StatSciences Inc. who conducted the initial statistical analyses merits special thanks.

References

  1. 1. Treede R-D, Rief W, Barke A, Aziz Q, Bennett MI, Benoliel R, et al. Chronic pain as a symptom or a disease: the IASP classification of chronic pain for the international classification of diseases (ICD-11). Pain. 2019;160(1):19–27. pmid:30586067
  2. 2. Merskey H, Bogduk N. Classification of Chronic Pain. 2nd ed. IASP. 1994.
  3. 3. Turk DC, Dworkin RH, Allen RR, Bellamy N, Brandenburg N, Carr DB, et al. Core outcome domains for chronic pain clinical trials: IMMPACT recommendations. Pain. 2003;106(3):337–45. pmid:14659516
  4. 4. Hudon C, Chouinard M-C, Bayliss E, Nothelle S, Senn N, Shadmi E. Challenges and next steps for primary care research. Ann Fam Med. 2018;16(1):85–6.
  5. 5. Kaneko H, Hanamoto A, Yamamoto-Kataoka S, Kataoka Y, Aoki T, Shirai K, et al. Evaluation of complexity measurement tools for correlations with health-related outcomes, health care costs and impacts on healthcare providers: a scoping Review. Int J Environ Res Public Health. 2022;19(23):16113. pmid:36498188
  6. 6. Choinière M, Peng P, Gilron I, Buckley N, Williamson O, Janelle-Montcalm A, et al. Accessing care in multidisciplinary pain treatment facilities continues to be a challenge in Canada. Reg Anesth Pain Med. 2020;45(12):943–8. pmid:33024007
  7. 7. Choinière M, Dion D, Peng P, Banner R, Barton PM, Boulanger A, et al. The Canadian STOP-PAIN project - Part 1: Who are the patients on the waitlists of multidisciplinary pain treatment facilities?. Can J Anaesth. 2010;57(6):539–48. pmid:20393821
  8. 8. Dassieu L, Pagé MG, Lacasse A, Laflamme M, Perron V, Janelle-Montcalm A, et al. Chronic pain experience and health inequities during the COVID-19 pandemic in Canada: qualitative findings from the chronic pain & COVID-19 pan-Canadian study. Int J Equity Health. 2021;20(1):147. pmid:34162393
  9. 9. Marcoux V, Chouinard M-C, Diadiou F, Dufour I, Hudon C. Screening tools to identify patients with complex health needs at risk of high use of health care services: a scoping review. PLoS One. 2017;12(11):e0188663. pmid:29190658
  10. 10. Stiefel FC, de Jonge P, Huyse FJ, Slaets JP, Guex P, Lyons JS, et al. INTERMED--an assessment and classification system for case complexity. Results in patients with low back pain. Spine (Phila Pa 1976). 1999;24(4):378–84; discussion 385. pmid:10065523
  11. 11. Stiefel FC, de Jonge P, Huyse FJ, Guex P, Slaets JP, Lyons JS, et al. “INTERMED”: a method to assess health service needs. II. Results on its validity and clinical use. Gen Hosp Psychiatry. 1999;21(1):49–56. pmid:10068920
  12. 12. Koch N, Stiefel F, de Jonge P, Fransen J, Chamot AM, Gerster JC, et al. Identification of case complexity and increased health care utilization in patients with rheumatoid arthritis. Arthritis Rheum. 2001;45(3):216–21. pmid:11409660
  13. 13. Caarls PC, Boenink A. Manual for interpreting the INTERMED Self-Assessment (IM-SA) Research and practical use of the INTERMED Self-Assessment. https://www.intermedconsortium.com/instrument/2017
  14. 14. van Reedt Dortland AKB, Peters LL, Boenink AD, Smit JH, Slaets JPJ, Hoogendoorn AW, et al. Assessment of Biopsychosocial Complexity and Health Care Needs: Measurement Properties of the INTERMED Self-Assessment Version. Psychosom Med. 2017;79(4):485–92. pmid:28033198
  15. 15. Huyse FJ, Lyons JS, Stiefel FC, Slaets JP, de Jonge P, Fink P, et al. “INTERMED”: a method to assess health service needs. I. Development and reliability. Gen Hosp Psychiatry. 1999;21(1):39–48. pmid:10068919
  16. 16. Sullivan MJL, Bishop SR, Pivik J. The Pain Catastrophizing Scale: Development and validation. Psychological Assessment. 1995;7(4):524–32.
  17. 17. Sullivan MJL. Th Pain Catastrophizing Scale, User Manual. 2009.
  18. 18. Sullivan MJ, Thorn B, Haythornthwaite JA, Keefe F, Martin M, Bradley LA, et al. Theoretical perspectives on the relation between catastrophizing and pain. Clin J Pain. 2001;17(1):52–64. pmid:11289089
  19. 19. Sullivan MJL, Adams H, Sullivan ME. Communicative dimensions of pain catastrophizing: social cueing effects on pain behaviour and coping. Pain. 2004;107(3):220–6. pmid:14736584
  20. 20. Osman A, Barrios FX, Kopper BA, Hauptmann W, Jones J, O’Neill E. Factor structure, reliability, and validity of the Pain Catastrophizing Scale. J Behav Med. 1997;20(6):589–605. pmid:9429990
  21. 21. Osman A, Barrios FX, Gutierrez PM, Kopper BA, Merrifield T, Grittmann L. The Pain Catastrophizing Scale: further psychometric evaluation with adult samples. J Behav Med. 2000;23(4):351–65. pmid:10984864
  22. 22. French DJ, Noël M, Vigneau F, French JA, Cyr CP, Evans RT. L’Échelle de dramatisation face à la douleur PCS-CF: Adaptation canadienne en langue française de l’échelle «Pain Catastrophizing Scale». Canadian Journal of Behavioural Science / Revue canadienne des sciences du comportement. 2005;37(3):181–92.
  23. 23. Nicholas MK. The pain self-efficacy questionnaire: Taking pain into account. Eur J Pain. 2007;11(2):153–63. pmid:16446108
  24. 24. Dubé M-O, Roos M, Desmeules F, Roy J-S. Reliability, validity, and responsiveness of a Canadian French adaptation of the pain self-efficacy questionnaire (PSEQ). Disabil Rehabil. 2023;45(16):2675–82. pmid:35867979
  25. 25. Bartlett MS. A Note on the Multiplying Factors for Various χ2 Approximations. Journal of the Royal Statistical Society Series B: Statistical Methodology. 1954;16(2):296–8.
  26. 26. Kaiser HF. An Index of Factorial Simplicity. Psychometrika. 1974;39(1):31–6.
  27. 27. Bandalos DL, Gerstner JJ. Using factor analysis in test construction. Principles and methods of test construction: Standards and recent advances. Boston, MA: Hogrefe. 2016. p. 26–51.
  28. 28. Fabrigar LR, Wegener DT, MacCallum RC, Strahan EJ. Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods. 1999;4(3):272–99.
  29. 29. Lloret S, Ferreres A, Hernández A, Tomás I. El análisis factorial exploratorio de los ítems: análisis guiado según los datos empíricos y el software. AN PSICOL-SPAIN. 2017;33(2):417.
  30. 30. Carroll JB. How shall we study individual differences in cognitive abilities?—Methodological and theoretical perspectives. Intelligence. 1978;2(2):87–115.
  31. 31. Child D. The essentials of factor analysis. 3rd ed. New York: Continuum. 2006.
  32. 32. Core T. R: A language and environment for statistical computing. Vienna, Austria: Foundation for Statistical Computing. 2022.
  33. 33. Steiner M, Grieder S. EFAtools: An R package with fast and flexible implementations of exploratory factor analysis tools. JOSS. 2020;5(53):2521.
  34. 34. Revelle WR. Psych: Procedures for personality and psychological research. Evanston, Illinois: Northwestern University. 2023.
  35. 35. Hosmer Jr DW, Lemeshow S, Sturdivant RX. Applied logistic regression. John Wiley & Sons. 2013.
  36. 36. Robin X, Turck N, Hainard A, Tiberti N, Lisacek F, Sanchez J-C, et al. pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics. 2011;12:77. pmid:21414208
  37. 37. Harlow LL, Duerr SR. Multivariate Analysis of Variance. Handbook of Quantitative Methods for Educational Research. SensePublishers. 2013. p. 123–43.
  38. 38. Costello AB, Osborne J. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment Res Evaluation. 2019;10(1):7.
  39. 39. Hooper D, Coughlan J, Mullen MR. Structural equation modelling: guidelines for determining model fit. Electronic Journal of Business Research Methods. 2008;6(1):53–60.
  40. 40. Watkins MW. Exploratory factor analysis: a guide to best practice. Journal of Black Psychology. 2018;44(3):219–46.
  41. 41. Eleonora B, Andrea F, Ilaria T, Roberto M, Manuela C, Carmela Tatiana P, et al. Psychological and attitudinal assessment of patients with Fibromyalgia undergoing antalgic management: a short report. Open J Pain Med. 2022;6(1):024–9.
  42. 42. de Jonge P, Hoogervorst ELJ, Huyse FJ, Polman CH. INTERMED: a measure of biopsychosocial case complexity: one year stability in Multiple Sclerosis patients. Gen Hosp Psychiatry. 2004;26(2):147–52. pmid:15038933
  43. 43. Nuckols TK, Anderson L, Popescu I, Diamant AL, Doyle B, Di Capua P, et al. Opioid prescribing: a systematic review and critical appraisal of guidelines for chronic pain. Ann Intern Med. 2014;160(1):38–47. pmid:24217469
  44. 44. Campbell F, Hudspith M, Choinière M, El-Gabalawy H, Laliberté J, Sangster M, et al. Canadian Pain Task Force Report: March 2021. Health Canada. 2021.
  45. 45. Williams AC de C, Fisher E, Hearn L, Eccleston C. Psychological therapies for the management of chronic pain (excluding headache) in adults. Cochrane Database Syst Rev. 2020;8(8):CD007407. pmid:32794606
  46. 46. Gallant MP. The influence of social support on chronic illness self-management: a review and directions for research. Health Educ Behav. 2003;30(2):170–95. pmid:12693522
  47. 47. Straus BN. Chronic pain of spinal origin: the costs of intervention. Spine. 2002;27(22):2614–9. 00007632-200211150-00041
  48. 48. Ekman M, Johnell O, Lidgren L. The economic cost of low back pain in Sweden in 2001. Acta Orthop. 2005;76(2):275–84. pmid:16097556
  49. 49. Gatchel RJ, McGeary DD, McGeary CA, Lippe B. Interdisciplinary chronic pain management: past, present, and future. Am Psychol. 2014;69(2):119–30. pmid:24547798
  50. 50. Gatchel RJ, Okifuji A. Evidence-based scientific data documenting the treatment and cost-effectiveness of comprehensive pain programs for chronic nonmalignant pain. J Pain. 2006;7(11):779–93. pmid:17074616