Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Cancer patients’ experiences with and opinions on the process 'Screening of Distress and Referral Need' (SDRN) in clinical practice: A quantitative observational clinical study

  • Floor M. van Nuenen,

    Roles Data curation, Formal analysis, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Wenckebach Institute, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands

  • Stacey M. Donofrio,

    Roles Investigation, Methodology, Project administration, Validation, Writing – review & editing

    Affiliation Department of Psychology, University of Groningen, Department of Psychology, Groningen, the Netherlands

  • Harry B. M. van de Wiel,

    Roles Writing – review & editing

    Affiliation Wenckebach Institute, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands

  • Josette E. H. M. Hoekstra-Weebers

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    j.hoekstra-weebers@umcg.nl

    Affiliations Wenckebach Institute, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands, Netherlands Comprehensive Cancer Organization, Groningen, the Netherlands

Abstract

Objective

This observational clinical study investigated patients’ experiences with and opinions on the Dutch ‘Screening of Distress and Referral Need’ (SDRN) process implemented in oncology practice. Insight into these can guide improvement of the SDRN process.

Methods

Patients from hospitals that had implemented SDRN for at least a year completed questions on experiences with essential SDRN process steps (1: completion of the Distress Thermometer and Problem List as screening instrument (DT&PL), 2: information on SDRN+DT&PL, 3: information on referral options, 4: discussing DT&PL responses, 5: referral when needed), and on opinions about SDRN and DT&PL. Descriptive and univariate analyses were conducted.

Results

Of the 498 participants (response = 54%), 81% completed a DT&PL, of whom 86–87% was exposed to steps 2–3 and 76% discussed responses; only three needing care were not offered referral. Sixty-one percent encountered all SDRN steps and 78% would recommend SDRN to others. Recommending SDRN is related to more frequent DT&PL completion (t = -2.5; p≤0.01), receipt of information on SDRN+DT&PL and referral options (X2 = 4.9; p≤0.05 and X2 = 5.9; p≤0.05 respectively), discussion of responses (X2 = 10.2; p≤0.001), and fuller exposure to SDRN process steps (X2 = 14.8; p≤0.01). Percentages (strongly) agreeing were highest on the DT&PL being useful (90%) and suitable (88%), and lowest on burdensome (31%) and time-consuming (28%).

Conclusion

The majority of participating patients encountered the steps of the SDRN process considered essential, with 3/5 having encountered all steps. Referral is largely targeted to patients’ need. Patients’ perceived benefit of SDRN increases with fuller exposure to all process steps. Therefore, improvements, particularly in DT&PL completion and discussion of responses should be made.

Introduction

Distress screening was developed to decrease the discrepancy between the percentage of cancer patients experiencing clinically-elevated distress for which professional psychosocial care is warranted (percentages reported range between 25–50% [1,2]) and the percentage of patients actually receiving such care (percentages reported vary between 7–24% [3,4]). Regular screening of level and nature of distress during cancer treatment and follow-up may facilitate appropriate and timely referral to psychosocial and/or allied healthcare professionals, and thus ensure that patients needing additional care receive such care before distress becomes overwhelming.

Randomized controlled trials (RCTs) mostly focus on the effect of a distress screening process on patient-reported outcomes such as quality of life, patient-doctor communication, or on outcomes such as referrals or medical consumption. Results reported are inconsistent and vary from a positive to no effect [513]. Studies examining a more extensive process including triage more often found positive results [5,6,8,9], in contrast to studies investigating a process consisting of giving completed patient-reported outcome measures to a healthcare provider who decided independently what to do with the results [7,1013]. This suggests that triage should be part of a distress screening procedure. It remains unclear from the studies using triage whether communication about responses on a screening instrument took place at all, only with patients who scored above a cutoff, or with all patients.

The literature on patients’ opinions on a distress screening procedure or on the instrument used is sparse, although patients are supposed to benefit from distress screening. According to three (randomized) controlled trials, between 87–99% of patients thought that a screening procedure would have added value in oncologic practice [1416]. Four studies conducted in a routine clinical setting reported that 49–98% of patients replied that the instrument used for screening was useful [1720]. Only one study examined patients’ opinions on the Distress Thermometer (DT) in combination with the Problem List (PL) [20], although this instrument is often used for screening worldwide.

In the Netherlands, a process ‘Screening for Distress and Referral Need’ (SDRN) was developed including the following steps: 1) regular completion of the Dutch DT&PL [21] during curative or palliative treatment and follow-up, 2) discussion of the responses between care provider and patient, regardless of whether the DT-score is below or above the cut-off, and 3) referral if needed or wished by the patient to a psychosocial and/or allied healthcare provider depending on the nature of the problems experienced [22,23]. Additionally, we considered providing 4) information to patients about the goal of SDRN and the DT&PL and 5) about referral options and the specific expertise of psychosocial and allied healthcare professionals to be essential. SDRN has been implemented in routine clinical practice in the majority of the hospitals in the north and east of the Netherlands for at least one group of patients, mostly breast cancer patients. Health care providers of these hospitals find the implementation of this process feasible [24]. However, the extent to which patients experience the different steps in this process in daily oncology practice is unknown and information on patients’ opinions on a screening process is very limited. It may well be that patients who are exposed to relevant steps in an SDRN process have a more positive opinion of the instrument used and perceive the process as more relevant to the quality of the care they receive.

Therefore, this observational clinical study examines: 1) patients’ experiences with the above-mentioned essential steps of the Dutch SDRN process in clinical practice; 2) patients’ opinions on SDRN and on the DT&PL as screening instrument; 3) and relationships between patients’ experiences and opinions.

Materials and methods

Patients

Oncology patients visiting a surgical, medical, gynaecological or urological outpatient department from ten Dutch hospitals that had implemented the SDRN process in routine clinical practice for at least one year, who were aware of their treatment plan, cognitively and physically able to complete a questionnaire, ≥18 of age, and sufficiently fluent in Dutch were eligible for study participation. Hospitals were located in the northeastern part of the Netherlands, the catchment area of the Netherlands Comprehensive Cancer Organization, location Groningen (IKNL-G). IKNL-G supported SDRN implementation in these hospitals and provided centralized project management [24]. Patients from the first 10 of the 21 hospitals in the IKNL-G area that completed SDRN implementation for at least one group of patients for at least a year were invited to participate in the study. Three hospitals had implemented SDRN for breast cancer patients only. One hospital had implemented SDRN for prostate and breast cancer patients. The remaining hospitals had implemented SDRN for patients with breast, digestive, prostate and/or other types of cancer.

Procedure

The medical specialist or nurse informed all eligible patients visiting an outpatient clinic about the study and invited them to participate. Eligible patients were informed that SDRN had been implemented and that we invited them in a study assessing their experiences with SDRN in the hospital. Patients received a package including written information about the study, the questionnaire, an informed consent form and a pre-franked return envelope in which they could return the completed questionnaire to the IKNL-G. In eight hospitals 100 packages were handed out, in one hospital 50 and in the last 66, because the number of new cancer patients in the last two hospitals was lower (Dutch Cancer Registry). Handing out of packages took 2–4 weeks. IKNL-G coordinated the study. No information was given by the hospitals about the patients approached for participation for reasons of anonymity. Consequently, non-responders were not mailed or phoned to remind them to send a completed questionnaire to IKNL-G. The medical ethical committee of the University Medical Centre Groningen exempted the study from full review; no formal approval was needed according to the Dutch Medical Research Involving Human Subjects Act. The study was performed according to the Helsinki Declaration and the ethics committees of the participating hospitals.

Instrument

Patients were asked whether they completed a DT&PL since their diagnosis. Those who answered ‘yes’ responded to a further seven self-developed questions assessing their experiences with SDRN (questions 1–5), and their opinions on the DT&PL (question 6) and SDRN (question 7). Patients were asked to indicate: 1) how often they completed a DT&PL; 2) if they received information about the purpose of SDRN and the DT&PL; 3) if they received information about referral options and the expertise of different healthcare providers; 4) if they discussed responses with a care provider, and if yes, with whom and their satisfaction with the discussion; 5) if they were offered referral according to their need; 6) their agreement on eleven statements about the DT&PL; and 7) if they would recommend SDRN to other cancer patients as a proxy of their general opinion of SDRN as a process (questions and response options in S1 File).

Additionally, patients completed questions on the following socio-demographic and illness-related characteristics; age, gender, education level (low (elementary or low vocational school), middle (secondary or middle vocational education), high (high vocational or university)), cancer type, date of diagnosis, treatment modalities, and treatment phase (watchful waiting, receiving active treatment, follow-up). A medical specialist placed patients in a curative and palliative treatment group based on their cancer type and treatment.

Analyses

Descriptive analyses were computed to examine patients’ answers to the questions. Independent t-tests (continuous variables) and chi-square tests (categorical variables) were performed to investigate differences between respondents who completed a DT&PL since their cancer diagnosis and those who did not. We conducted independent samples t-tests, Mann-Whitney U-tests and Spearman’s rho correlations (continuous variables), and chi-square and Fisher exact tests (categorical variables) to examine univariate relationships between variables. Treatment modalities were dichotomized into non-intensive treatment (watchful waiting, surgery only, and radiotherapy only) and intensive treatment (the remaining modalities) for analysis because of the low numbers in some of the categories. All tests were two-sided. We used SPSS, version 22, for analyses.

Results

Of the 916 questionnaires distributed, 498 were returned (response = 54%). Response was comparable between hospitals. Table 1 shows information on respondents’ socio-demographic and illness-related characteristics. Of the respondents, 78% were women and 24% had completed low level education. Mean age was 59.8 years. Sixty-seven percent had breast cancer and mean time since diagnosis was 1.2 years. Respondents received different types of treatment, of whom 78% intensive treatment, 92% received treatment with a curative intent, and 46% was under active treatment.

thumbnail
Table 1. Socio-demographic and illness-related characteristics and comparison between respondents who completed a DT&PL after diagnosis and those who did not.

https://doi.org/10.1371/journal.pone.0198722.t001

No information was provided by the physician or nurse about patients approached for study participation to the researchers. Consequently, participants could not be compared to non-participants.

Regarding the first SDRN step, 81% (N = 398) of the patients answered that they had completed a DT&PL in clinical practice and 19% (N = 94) (6 missing) that they had not done so. Comparison of those who did and those who did not complete a DT&PL showed significant differences in gender, cancer diagnosis and time since diagnosis (Table 1). The percentages of men and of prostate cancer patients were lower and time since diagnosis was shorter in the group that completed a DT&PL. Twenty-eight of the 77 (36%) men who completed a DT&PL had prostate cancer versus 19 of the 32 (59%) men who did not complete a DT&PL. Excluding the prostate cancer patients from analysis, no gender difference was found between those who completed a DT&PL and those who did not (X2 = 0.9, p = 0.4).

The following results relate to the 398 respondents who completed a DT&PL since diagnosis.

Patients’ experiences with SDRN (Table 2)

Of these 398 respondents, 36% completed the DT&PL once, 35% twice, 20% three times, and 9% between four and eight times. Eighty-six percent received information on the purpose of SDRN and the DT&PL, and 87% received information about referral options and the expertise of psychosocial and allied healthcare professionals.

thumbnail
Table 2. Descriptives on study questions 1–5 and on variable created post-hoc, and univariate effects on respondents’ recommendation (question 7).

https://doi.org/10.1371/journal.pone.0198722.t002

DT&PL responses were discussed with 76% of the respondents. Of these, 93% indicated that the nurse discussed responses with them, and 95% was (very) satisfied with this discussion.

Fifty-four respondents (19%) indicated that they needed care, of whom only three patients (6% (1% of total group)) were not offered a referral. Of the 289 respondents who completed the referral question, eight (3%) answered that the DT&PL was not discussed with them (2 missing), while of the 109 respondents who did not answer it, 90% indicated that responses were not discussed (X2 = 292.6; p≤0.001).

Patients opinions on SDRN and the DT&PL

Of the respondents who completed a DT&PL in the clinic, 78% would recommend SDRN to other cancer patients, while 22% would not (38 missing) (Table 2).

Regarding the first eight statements on the DT&PL, the strongest agreement was found with the DT&PL being: ‘suitable for its purpose’ and ‘useful for my care provider’. The strongest disagreement was found with the statement that DT&PL completion is ‘time-consuming’. Concerning the three statements on patients’ perceptions on the purpose of DT&PL completion, the strongest agreement was found with the statement that it ‘offers insight into the problems I experience’ (Table 3).

thumbnail
Table 3. Descriptives on the DT&PL opinion statements (question 6), and univariate effects of opinions on information received, responses discussed, satisfaction with discussion, and recommending others.

https://doi.org/10.1371/journal.pone.0198722.t003

Relationships between patients’ experiences and their opinions

Regarding SDRN.

Those who would recommend SDRN had completed a DT&PL significantly more often than those who would not recommend SDRN. A significantly higher percentage of those who would recommend SDRN had received information about the purpose of SDRN and the DT&PL, and about referral options and the expertise of different healthcare disciplines, had discussed responses with a care provider, and they were significantly more satisfied with the discussion of the responses than those who would not recommend SDRN. Referral according to need did not significantly affect SDRN recommendation (Table 2). Because of the low numbers in two cells an additional comparison was performed between those needing care and those not needing care. No differences were found between these two groups.

A significantly higher percentage of patients who would recommend SDRN to others was exposed to the full SDRN process (Table 2).

Regarding DT&PL.

Mann-Whitney tests showed five differences between respondents who received information about SDRN and the DT&PL and those who did not, namely the first group perceived completing the DT&PL as significantly more ‘pleasant’, and less ‘difficult’ and ‘time-consuming’ than patients who did not receive information. Additionally, the first group agreed significantly more that completing the DT&PL ‘offers insight into the problems they experience’ and that it ‘helps in the communication with their care provider’. Significant differences were found on six of the 11 DT&PL statements between patients who discussed responses with their care provider and those who did not. Satisfaction with the discussion correlated significantly, but weakly, with nine DT&PL statements. Respondents who would recommend SDRN to others were significantly more positive on ten of the 11 DT&PL statements (Table 3).

Discussion

The present quantitative observational clinical study explored patients’ experiences with the different essential steps of the Dutch Screening for Distress and Referral Need process implemented long-term in everyday oncology practice. Additionally, their opinions on this process and the DT&PL were examined. Overall, a majority of participating patients encountered one or more of the steps considered essential in the Dutch SDRN process and, with the exception of three patients, referral was according to need. Patients exposed to essential SDRN procedure steps are more positive on SDRN and the DT&PL. Fuller exposure is related with higher positivity; patients who experienced more of the SDRN process are more likely to recommend it to others.

Regarding patients’ experience with the first step in the SDRN process, we found that more than four-fifths of the respondents had completed a DT&PL since they were diagnosed with cancer. Given that SDRN had been implemented for at least a year in participating hospitals, the percentage of patients who completed a DT&PL was lower than we expected. Compared to three recent studies, reporting percentages varying between 40–73% [2527], our finding is high, but it is lower than that reported in a fourth study (94%) [28]. Similarly to our study, three of these studies examined the situation in oncology practice after a systematic implementation process [2628]. We found that some patients did not complete the DT&PL. It may be that the instrument was not well introduced for certain patient groups; patients may not have been asked to complete a DT&PL, possibly because of shortage of time [24]. We found that fewer prostate cancer patients and those diagnosed longer ago did so compared to others, possibly because they were not asked to complete it, or they did not feel it necessary because they experienced little distress or less need for additional professional care [1,24,29,30]. Future research could examine patients’ and care providers’ barriers to instrument completion in oncology practice. Interestingly, patients who completed a DT&PL more often were more likely to recommend SDRN to others. This may suggest that patients increasingly understand the benefit of SDRN.

As for the provision of information, the vast majority of patients who completed a DT&PL indicated they received information about the purpose of SDRN and the DT&PL, and about referral options and the professional expertise of those they could be referred to (86% and 87% respectively). Adequate provision of information may increase patients understanding and motivation for adopting appropriate health interventions, such as SDRN. The relevance of providing information is reflected in the findings that opinions on SDRN and on the DT&PL were more positive in patients who received information on SDRN and the DT&PL and on availability and expertise of allied/psychosocial care providers.

Concerning patients’ experience with the fourth SDRN process step, namely communication, we found that DT&PL responses were discussed with three of four patients. This was lower than expected given that communication, regardless of the extent of distress, is an essential step in the Dutch SDRN process [22]. Possible explanations for this finding may be that care providers perceived a lack of time or skills [24,27,31]. Remarkably, 95% of the patients with whom responses were discussed were very satisfied and discussion of responses was most strongly related to recommending SDRN to others. These findings may encourage nurses to discuss responses.

Adequate referral is the fifth essential step in the SDRN process. This study suggests that once SDRN is implemented, it is patient need that dictates referral. Promisingly, only three of those indicating a need for care were not offered a referral; a major aim of distress screening is to ensure that cancer patients needing care are referred. Unfortunately, 25% of the respondents did not indicate whether referral was offered according to need. Of those who did not answer that question, 90% responded that the DT&PL was not discussed with them, while with 97% of those who did answer, responses were discussed. Thus, discussing responses seems instrumental in correctly identifying patients in need of additional care. This was also mentioned by the healthcare providers [24].

One-fifth of patients indicated a need for additional care at the time responses were discussed. This is comparable to some studies but lower than reported in other studies [3235]. This range could be explained by the wording of the question. Studies with higher percentages ask about need in general terms [34,35], while those with lower percentages inquire more specifically about time or type of care [32,33].

All in all, patients’ evaluation of the DT&PL as a tool in the SDRN process is largely positive, though some patients were somewhat critical. This is comparable with studies investigating other instruments [1719], and in line with care providers’ opinion on the DT&PL [24]. Notably, opinions on the DT&PL were also more positive in patients with whom responses were discussed, who were more satisfied with the discussion, and who would recommend SDRN to others. This suggests that incorporating the DT&PL in the SDRN process in a meaningful and clear manner, so that patients feel that instrument completion matters, has a positive effect.

In total, 78% of the respondents who completed a DT&PL would advise others to participate in SDRN. This percentage is somewhat lower than percentages found in (randomized) controlled intervention studies [1416], but in RCTs much attention is given to ensure that the process is executed according to protocol for the duration of the trial. Our study reflects the less controllable situation in real world practice.

Overall, 61% of patients who completed a DT&PL encountered all steps in the process as recommended. We also found that patients are more positive about SDRN the more frequently they completed a DT&PL and the more all steps are followed. In fact, the likelihood of recommending SDRN to other patients increases with fuller exposure to the process. This finding underlines that care providers should adhere to all SDRN process steps, particularly to discussing DT&PL responses with all patients.

This study has a few limitations. The response rate was 54%, which is comparable to mailed questionnaire studies [36]. Due to study design, we cannot compare patients who participated to those who did not. Consequently, we cannot be certain that responders are not a selection of the total population approached. Representativeness and generalizability may be affected. Conclusions are based on the responses of the participating patients. Some of the hospitals implemented SDRN only for breast cancer patients; this is why breast cancer patients are overrepresented in the study. However, the sample is broad, including patients from various departments in 10 different hospitals, with wide variation on demographic and illness-related variables. The cross-sectional design, without control group, means that we cannot state conclusively that the SDRN process is the reason only 3 patients were not referred despite need. Regretfully, 20% of participants did not complete a DT&PL and thus could not answer all questions. This underlines the need for continuing attention to fully implementing SDRN. Also, it is unfortunate that patients who did not complete the DT&PL or with whom responses were not discussed were not asked about the reasons for this not happening.

Conclusions

This study shows that, according to participating patients’ experiences a year after implementation, the majority encountered the steps of the SDRN process considered essential, with 3/5 having encountered all steps. Patients’ views on the DT&PL as tool are mainly positive. Patients’ perceived benefit of SDRN increases with fuller exposure to all steps, especially the discussion. After implementation, referrals are largely targeted to participating patients’ needs. Improvements in the execution of the SDRN process can be made, particularly in ensuring that all patients are regularly offered to complete a DT&PL and that responses are discussed with all patients.

Supporting information

S1 File. Questionnaire original and in english.

https://doi.org/10.1371/journal.pone.0198722.s001

(DOCX)

S2 File. Dataset cancer patients experiences PLOSONE.7z Dataset cancer patients experiencesPLOSONE.7z Questionnaire original Questionnaire original.

https://doi.org/10.1371/journal.pone.0198722.s002

(7Z)

Acknowledgments

The authors acknowledge the contribution of the hospitals for participating in the implementation of SDRN, the specialists and nurses for approaching patients to participate, and patients for completing the questionnaire.

References

  1. 1. Admiraal JM, Reyners AK, Hoekstra-Weebers JE. Do cancer and treatment type affect distress? Psychooncology 2013;22: 1766–1773. pmid:23109282
  2. 2. Carlson LE, Angen M, Cullum J, Goodey E, Koopmans J, Lamont L, et al. High levels of untreated distress and fatigue in cancer patients. Br J Cancer 2004;90: 2297–2304. pmid:15162149
  3. 3. Hewitt M, Rowland JH. Mental health service use among adult cancer survivors: analyses of the National Health Interview Survey. J Clin Oncol 2002;20: 4581–4590. pmid:12454116
  4. 4. Waller A, Williams A, Groff SL, Bultz BD, Carlson LE. Screening for distress, the sixth vital sign: examining self-referral in people with cancer over a one-year period. Psychooncology 2013;22: 388–395. pmid:22135205
  5. 5. Carlson LE, Groff SL, Maciejewski O, Bultz BD. Screening for distress in lung and breast cancer outpatients: a randomized controlled trial. J Clin Oncol 2010;28: 4884–4891. pmid:20940193
  6. 6. Girgis A, Breen S, Stacey F, Lecathelinais C. Impact of two supportive care interventions on anxiety, depression, quality of life, and unmet needs in patients with nonlocalized breast and colorectal cancers. J Clin Oncol 2009;27: 6180–6190. pmid:19917842
  7. 7. Velikova G, Booth L, Smith AB, Brown PM, Lynch P, Brown JM, et al. Measuring quality of life in routine oncology practice improves communication and patient well-being: a randomized controlled trial. J Clin Oncol 2004;22: 714–724. pmid:14966096
  8. 8. Klinkhammer-Schalke M, Koller M, Steinger B, Ehret C, Ernst B, Wyatt JC, et al. Direct improvement of quality of life using a tailored quality of life diagnosis and therapy pathway: randomised trial in 200 women with breast cancer. Br J Cancer 2012;106: 826–838. pmid:22315052
  9. 9. McLachlan SA, Allenby A, Matthews J, Wirth A, Kissane D, Bishop M, et al. Randomized trial of coordinated psychosocial interventions based on patient self-assessments versus standard care to improve the psychosocial functioning of patients with cancer. J Clin Oncol 2001;19: 4117–4125. pmid:11689579
  10. 10. Rosenbloom SK, Victorson DE, Hahn EA, Peterman AH, Cella D. Assessment is not enough: a randomized controlled trial of the effects of HRQL assessment on quality of life and satisfaction in oncology clinical practice. Psychooncology 2007;16: 1069–1079. pmid:17342789
  11. 11. Braeken AP, Lechner L, Eekers DB, Houben RM, van Gils FC, Ambergen T, et al. Does routine psychosocial screening improve referral to psychosocial care providers and patient-radiotherapist communication? A cluster randomized controlled trial. Patient Educ Couns 2013;93: 289–297. pmid:23992914
  12. 12. Hollingworth W, Metcalfe C, Mancero S, Harris S, Campbell R, Biddle L, et al. Are needs assessments cost effective in reducing distress among patients with cancer? A randomized controlled trial using the Distress Thermometer and Problem List. J Clin Oncol 2013;31: 3631–3638. pmid:24002506
  13. 13. Kornblith AB, Dowell JM, Herndon JE 2nd, Engelman BJ, Bauer-Wu S, Small EJ, et al. Telephone monitoring of distress in patients aged 65 years or older with advanced stage cancer: a cancer and leukemia group B study. Cancer 2006;107: 2706–2714. pmid:17078057
  14. 14. Detmar SB, Muller MJ, Schornagel JH, Wever LD, Aaronson NK. Health-related quality-of-life assessments and patient-physician communication: a randomized controlled trial. JAMA 2002;288: 3027–3034. pmid:12479768
  15. 15. Velikova G. Patient benefits from psychosocial care: screening for distress and models of care. J Clin Oncol 2010;28: 4871–4873. pmid:20940195
  16. 16. Hilarius DL, Kloeg PH, Gundy CM, Aaronson NK. Use of health-related quality-of-life assessments in daily clinical oncology nursing practice: a community hospital-based intervention study. Cancer 2008;113: 628–637. pmid:18543317
  17. 17. Snyder CF, Herman JM, White SM, Luber BS, Blackford AL, Carducci MA, et al. When using patient-reported outcomes in clinical practice, the measure matters: a randomized controlled trial. J Oncol Pract 2014;10: e299–306. pmid:24986113
  18. 18. Pruyn JF, Heule-Dieleman HA, Knegt PP, Mosterd FR, van Hest MA, Sinnige HA, et al. On the enhancement of efficiency in care for cancer patients in outpatient clinics: an instrument to accelerate psychosocial screening and referral. Patient Educ Couns 2004;53: 135–140. pmid:15140452
  19. 19. Braeken AP, Lechner L, Houben RM, Van Gils FC, Kempen GI. Psychometric properties of the Screening Inventory of Psychosocial Problems (SIPP) in Dutch cancer patients treated with radiotherapy. Eur J Cancer Care (Engl) 2011;20: 305–314.
  20. 20. Mergenthaler U, Heymanns J, Koppler H, Thomalla J, van Roye C, Schenk J, et al. Evaluation of psychosocial distress in patients treated in a community-based oncology group practice in Germany. Ann Oncol 2011;22: 931–938. pmid:20926545
  21. 21. Tuinman MA, Gazendam-Donofrio SM, Hoekstra-Weebers JE. Screening and referral for psychosocial distress in oncologic practice: use of the Distress Thermometer. Cancer 2008;113: 870–878. pmid:18618581
  22. 22. Netherlands Comprehensive Cancer Organisation. Dutch guideline: Detection of need for psychosocial care, version: 1.0. 2010. Available from: http://oncoline.nl/detecteren-behoefte-psychosociale-zorg.
  23. 23. Hoekstra-Weebers JE. Psychosociale signalering in de regio van het Integraal Kankercentrum Noord Oost (IKNO) [Psychosocial screening in the region of the Comprehensive Cancer Center North East]. Nederlands Tijdschrift voor Oncologie 2010;7:238–246.
  24. 24. van Nuenen FM, Donofrio SM, Tuinman MA, van de Wiel HB, Hoekstra-Weebers JE. Feasibility of implementing the 'Screening for Distress and Referral Need' process in 23 Dutch hospitals. Support Care Cancer 2017;25: 103–110. pmid:27565789
  25. 25. Jacobsen PB, Shibata D, Siegel EM, Lee JH, Fulp WJ, Alemany C, et al. Evaluating the quality of psychosocial care in outpatient medical oncology settings using performance indicators. Psychooncology 2011;20: 1221–1227. pmid:20878724
  26. 26. Zebrack B, Kayser K, Sundstrom L, Savas SA, Henrickson C, Acquati C, et al. Psychosocial distress screening implementation in cancer care: an analysis of adherence, responsiveness, and acceptability. J Clin Oncol 2015;33: 1165–1170. pmid:25713427
  27. 27. Dudgeon D, King S, Howell D, Green E, Gilbert J, Hughes E, et al. Cancer Care Ontario's experience with implementation of routine physical and psychological symptom distress screening. Psychooncology 2012;21: 357–364. pmid:21308858
  28. 28. Watson L, Groff S, Tamagawa R, Looyis J, Farkas S, Schaitel B, et al. Evaluating the Impact of Provincial Implementation of Screening for Distress on Quality of Life, Symptom Reports, and Psychosocial Well-Being in Patients With Cancer. J Natl Compr Canc Netw 2016;14: 164–172. pmid:26850486
  29. 29. Fiszer C, Dolbeault S, Sultan S, Bredart A. Prevalence, intensity, and predictors of the supportive care needs of women diagnosed with breast cancer: a systematic review. Psychooncology 2014;23: 361–374. pmid:24677334
  30. 30. Lam WW, Soong I, Yau TK, Wong KY, Tsang J, Yeo W, et al. The evolution of psychological distress trajectories in women diagnosed with advanced breast cancer: a longitudinal study. Psychooncology 2013;22: 2831–2839. pmid:24038545
  31. 31. Mitchell AJ, Kaar S, Coggan C, Herdman J. Acceptability of common screening methods used to detect distress and related mood disorders?preferences of cancer specialists and non-specialists. Psychooncology 2008;17: 226–236. pmid:17575565
  32. 32. Baker-Glenn EA, Park B, Granger L, Symonds P, Mitchell AJ. Desire for psychological support in cancer patients with depression or distress: validation of a simple help question. Psychooncology 2011;20: 525–531. pmid:20878852
  33. 33. Merckaert I, Libert Y, Messin S, Milani M, Slachmuylder JL, Razavi D. Cancer patients' desire for psychological support: prevalence and implications for screening patients' psychological needs. Psychooncology 2010;19: 141–149. pmid:19382112
  34. 34. Shim EJ, Shin YW, Jeon HJ, Hahm BJ. Distress and its correlates in Korean cancer patients: pilot use of the distress thermometer and the problem list. Psychooncology 2008;17: 548–555. pmid:17957764
  35. 35. Mertz BG, Bistrup PE, Johansen C, Dalton SO, Deltour I, Kehlet H, et al. Psychological distress among women with newly diagnosed breast cancer. Eur J Oncol Nurs 2012;16: 439–443. pmid:22036771
  36. 36. Gazendam-Donofrio S, Hoekstra H, van der Graaf W, van de Wiel H, Visser A, Huizinga G, et al. Parent-child communication patterns during the first year after a parent's cancer diagnosis. Cancer 2009;115: 4227–4237. pmid:19626654