This study aimed to evaluate whether prompting general practitioners (GPs) to routinely assess and manage anxiety and depression in patients consulting with osteoarthritis (OA) improves pain outcomes.
Methods and findings
We conducted a cluster randomised controlled trial involving 45 English general practices. In intervention practices, patients aged ≥45 y consulting with OA received point-of-care anxiety and depression screening by the GP, prompted by an automated electronic template comprising five questions (a two-item Patient Health Questionnaire–2 for depression, a two-item Generalized Anxiety Disorder–2 questionnaire for anxiety, and a question about current pain intensity [0–10 numerical rating scale]). The template signposted GPs to follow National Institute for Health and Care Excellence clinical guidelines for anxiety, depression, and OA and was supported by a brief training package. The template in control practices prompted GPs to ask the pain intensity question only. The primary outcome was patient-reported current pain intensity post-consultation and at 3-, 6-, and 12-mo follow-up. Secondary outcomes included pain-related disability, anxiety, depression, and general health.
During the trial period, 7,279 patients aged ≥45 y consulted with a relevant OA-related code, and 4,240 patients were deemed potentially eligible by participating GPs. Templates were completed for 2,042 patients (1,339 [31.6%] in the control arm and 703 [23.1%] in the intervention arm). Of these 2,042 patients, 1,412 returned questionnaires (501 [71.3%] from 20 intervention practices, 911 [68.0%] from 24 control practices). Follow-up rates were similar in both arms, totalling 1,093 (77.4%) at 3 mo, 1,064 (75.4%) at 6 mo, and 1,017 (72.0%) at 12 mo. For the primary endpoint, multilevel modelling yielded significantly higher average pain intensity across follow-up to 12 mo in the intervention group than the control group (adjusted mean difference 0.31; 95% CI 0.04, 0.59). Secondary outcomes were consistent with the primary outcome measure in reflecting better outcomes as a whole for the control group than the intervention group. Anxiety and depression scores did not reduce following the intervention. The main limitations of this study are two potential sources of bias: an imbalance in cluster size (mean practice size 7,397 [intervention] versus 5,850 [control]) and a difference in the proportion of patients for whom the GP deactivated the template (33.6% [intervention] versus 27.8% [control]).
In this study, we observed no beneficial effect on pain outcomes of prompting GPs to routinely screen for and manage comorbid anxiety and depression in patients presenting with symptoms due to OA, with those in the intervention group reporting statistically significantly higher average pain scores over the four follow-up time points than those in the control group.
ISRCTN registry ISRCTN40721988
Why was this study done?
- Patients with painful conditions, such as osteoarthritis, are at higher risk of experiencing depression and anxiety.
- People with pain and coexisting mood problems are more likely to have a poorer long-term outcome.
- Routine screening for anxiety and depression in higher risk patients is controversial, with conflicting evidence.
What did the researchers do and find?
- We conducted a large cluster randomised trial to investigate the impact on pain of screening and treating people with osteoarthritis for depression and anxiety in the general practice consultation.
- General practices were randomised either to routinely screen patients consulting with osteoarthritis for depression and anxiety or to not screen.
- We found that those screened for depression and anxiety had worse pain outcomes over the following 12 months than those not screened.
Citation: Mallen CD, Nicholl BI, Lewis M, Bartlam B, Green D, Jowett S, et al. (2017) The effects of implementing a point-of-care electronic template to prompt routine anxiety and depression screening in patients consulting for osteoarthritis (the Primary Care Osteoarthritis Trial): A cluster randomised trial in primary care. PLoS Med 14(4): e1002273. https://doi.org/10.1371/journal.pmed.1002273
Academic Editor: Alexander C. Tsai, Massachusetts General Hospital, UNITED STATES
Received: September 23, 2016; Accepted: February 20, 2017; Published: April 11, 2017
Copyright: © 2017 Mallen et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Data are available subject to the study's pre-determined ethics approval and the Centre's data sharing policies (http://www.keele.ac.uk/pchs/publications/datasharingresources/). Applications for access to anonymised data from our research databases can be sent to the Centre's data manager at email@example.com. As per the Participants section of METHODS, code lists are available from www.keele.ac.uk/mrr.
Funding: This study was funded by National Institute for Health Research (NIHR) Programme Grant (RP-PG-0407-10386) and will be published in full and was also funded by Christian Mallen's Arthritis Research UK Clinician Scientist Award (19634). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: CCG and CDM are supported by the NIHR Collaborations for Leadership in Applied Health Research and Care West Midlands. CDM is also funded by the NIHR School for Primary Care Research and an NIHR Research Professorship in General Practice (NIHR-RP-2014-04-026). EMH is a NIHR Senior Investigator. DG was a NIHR School for Primary Care Research Doctoral Training Fellow.
Abbreviations: GAD, Generalized Anxiety Disorder; GP, general practitioner; GPRF, general practitioner research facilitator; NHS, National Health Service; NICE, National Institute for Health and Care Excellence; NRS, numerical rating scale; OA, osteoarthritis; PCRN, Primary Care Research Network; PHQ, Patient Health Questionnaire
Osteoarthritis (OA) is a major cause of persistent pain and years lived with disability , and one of the most common reasons for primary care consultation in the UK, with approximately 1 million adults seeking care each year . Patients with painful, disabling OA constitute a high-risk group for distress, anxiety, and depressive disorders [3–5]. While many of the factors associated with the future course of OA are not modifiable (e.g., age, sex, symptom duration, and severity of underlying structural changes to the joint [6–9]), comorbid depression and anxiety are adversely related to future course [10,11], treatment response , and healthcare use , and show a reciprocal relationship with pain and functional outcomes [12,14,15]. Evidence from a single clinical trial of a collaborative care approach using psychological therapies and medication management for previously diagnosed major depressive disorder in patients with self-reported OA supports the principle of managing comorbid depression as a means of modifying general and OA-specific clinical outcomes, having shown beneficial effects of depression management on pain intensity, pain-related function, and quality of life sustained to 12 mo [16–18]. Similar benefits may accrue from the effective management of comorbid anxiety disorders in patients with persistent painful disorders [19,20].
Yet the proposal of screening for depression in this and other high-risk groups is contentious, despite some evidence that depression is under-recognised in patients presenting to primary care with painful OA [12,21,22]. Screening for anxiety in primary care has been occasionally proposed [23–25], but to our knowledge has not been evaluated in clinical trials in UK primary care. With respect to depression, in both unselected primary care populations and special populations at high risk of depression, several recent systematic reviews by Thombs and colleagues [26–28] and others  have highlighted a lack of direct evidence from appropriately designed clinical trials on the effects of implementing screening for depression, either alone or in the context of accessible, good-quality mental healthcare.
The UK National Institute for Health and Care Excellence (NICE) guidelines for OA are ambiguous on the matter of screening for depression and anxiety, recommending that patients be assessed for the effect of OA on mood, and specifically including “screen for depression” as a topic “worth assessing”, but acknowledging that it may not be of concern for every patient . Similarly, NICE guideline 91  suggests practitioners should be alert to depression in patients with chronic physical problems and should consider asking two short case-finding questions  of patients whom they suspect of having depression. The potential benefits of screening in OA may not just be about the screen–diagnose–treat pathway for patients with anxiety or depression. The recognition of sub-threshold anxiety and depression symptoms—more common and still associated with poorer pain and function outcomes—could “open the door to a dialogue with clinicians who can then determine which unmet needs have contributed to distress” . This could include exploring causes (e.g., poorly controlled pain , sleep disturbance , or inadequate social support ) as well as prompting greater use of pain management strategies and functional rehabilitation options, such as referral to physiotherapy for supervised exercise that is effective for pain , function , and mental health [38,39] but typically underutilised [40,41]. Against these potential benefits can be raised a number of concerns about a systematic approach to screening [28,42–46]: inefficiency, diversion of scarce resources, potential for unnecessary exposure to antidepressant medication side effects, possible nocebo effects, stigma from overt labelling, “psychologising” of the pain problem, and mechanical delivery.
In this study our primary objective was to evaluate the clinical effectiveness of introducing general practitioner (GP) screening for anxiety and depression in older patients consulting for OA. Specifically, we hypothesized that patients undergoing screening for anxiety and depression symptoms in the GP consultation would show greater improvements in current pain intensity and pain interference with daily activity over the 12 mo following their consultation, compared to those having a standard GP consultation.
This was a pragmatic cluster randomised parallel trial in primary care. Randomisation of general practices (rather than individual GPs or individual patients) was chosen because we anticipated GPs would likely find it difficult to ask screening questions of some patients and not others allocated at random, and therefore the potential for contamination between the two arms, as well as between GPs within a practice allocated to different arms, was considered highly likely . Clusters were general practices that were randomly assigned (1:1) in blocks to intervention or control using a balance algorithm based on practice list size, area deprivation, and clinical commissioning group . When patients (45 y and older) consulted for OA during the study period and an OA Read code was recorded in their electronic GP records, a point-of-care electronic template was activated. This template provided a checklist of eligibility criteria and was used to prompt GPs to ask eligible patients the questions and to record the responses. Individual-level patient outcomes were measured by self-complete postal questionnaires administered to patients after their consultation and at 3, 6, and 12 mo follow-up (Fig 1) and by medical record review. The design was a professional-cluster intervention : participating general practices provided informed consent, as “guardians” [50,51] for the patients in their care, that the practices were willing to enter the trial and to be randomised into either arm of the trial.
*The category “other” for ineligibility includes the following: not a GP appointment (administrative/nurse), telephone contact, already in another study, received injection, moving practice/house, working away, and difficulty understanding/communicating in English. GP, general practitioner; OA, osteoarthritis.
Ethical approval for this study was obtained from the Black Country Research Ethics Committee (reference number 11/WM/0093). There were no important changes to the study protocol after trial commencement.
The study comprised Royal College of General Practitioners–approved “research ready” general practices that were using the EMIS consultation system at the time of recruitment and that were located in the West Midlands North region of England. Practices were approached and recruited over a 1-y period by the West Midlands North Primary Care Research Network (PCRN) to participate in the Primary Care Osteoarthritis Screening Trial (POST). Practices were provided with information on the general scope and purpose of the trial (practices were not given the exact nature of the screening in either arm of the trial prior to randomisation), the target population of interest, the anticipated 3- to 4-mo period of patient recruitment per practice, and the procedures that would need to be followed in the event of participating. Practices were provided with written and verbal information and had the opportunity to discuss participation with a GP (researcher facilitator or study principal investigator), research associate, and PCRN clinical studies officer.
Patients in the participating practices were prospectively identified for inclusion if they were aged 45 y or older, they consulted during the study period for clinical OA (defined using a pre-specified list of Read morbidity codes [code lists available from https://www.keele.ac.uk/mrr/]), their GP deemed them eligible and completed the electronic template during the consultation, and they provided full written informed consent to provide study data and to further contact at the time of post-consultation questionnaire completion. Consultations relating to a clinical diagnosis of OA (index consultation) could be first, new episode, or ongoing consultations. Patients with multiple OA consultations during the study period were sampled only once, at their first consultation in the study period. Patients were excluded by their GP at the point of template completion based on the following criteria: under active care for, or having a diagnosis of, depression and/or an anxiety disorder in the past 12 mo; vulnerable patient (on the Quality and Outcomes Framework mental health register or having a dementia diagnosis or terminal illness); nursing home resident; red flag pathology (recent trauma associated with significant injury; acute, red, hot swollen joint); or having inflammatory arthropathy, crystal disease, spondyloarthropathy, or polymyalgia rheumatica.
During the recruitment phase in each participating practice, GPs provided eligible patients in the consultation with a short information postcard introducing the study and notifying them that they would be contacted by the research team. Informatics staff from the PCRN performed weekly downloads of the names and addresses of eligible patients with template data (at least one response recorded) and mailed them a study pack (a letter from their general practice introducing the study, a patient information leaflet, and a self-completion questionnaire, including a consent form). The same information was provided to patients in both arms of the trial to reduce contamination bias . Patients were asked for written informed consent for further contact and for their medical records to be accessed. A standard three-stage mailing approach was used (initial mailing, reminder postcard for non-respondents at 2 wk, and repeat study pack and reminder letter for non-respondents at 4 wk). Respondents consenting to further contact were sent follow-up questionnaires at 3, 6, and 12 mo. The same three-stage mailing procedure was used for follow-up questionnaires, with an additional short postal questionnaire at 6 wk comprising minimal data collection items for non-respondents (3, 6, and 12 mo), and telephone collection of the primary outcome at 8 wk (6 and 12 mo) for those who had not responded to a written questionnaire.
The intervention consisted of point-of-care anxiety and depression screening questions posed by the GP, prompted by the electronic template. The template for the intervention arm comprised five questions: a two-item ultra-brief depression tool (Patient Health Questionnaire [PHQ]–2; each item rated yes/no ) recommended by NICE for initial depression assessment in patients with a chronic physical health condition; a two-item ultra-brief anxiety assessment tool (Generalized Anxiety Disorder [GAD]–2 ), modified to use the same stem as the depression questions (“During the past month have you often been bothered by…”), with yes/no response options; and an item on current pain intensity rated on a 0–10 numerical rating scale (NRS) . The GP recorded patients’ responses on the template. Negative responses to all ultra-brief depression and anxiety questions were used to rule out a potential depression or anxiety diagnosis. The template then signposted and encouraged GPs to follow NICE clinical guidelines on the management of OA, depression in adults with a chronic physical health problem , and anxiety . At a post-randomisation meeting approximately 1 wk prior to the template being activated in the practice, a GP research facilitator (GPRF) employed by the PCRN explained and discussed the study procedures with GPs and practice staff. Brief face-to-face training was provided by the GPRF, explaining NICE-recommended evidence-based approaches to managing comorbid anxiety and depression, and hard copies of the screening questions and quick reference versions of the guidelines were placed in all consulting rooms in the intervention practices. The control condition was not disclosed to intervention practices. Reminder posters were placed in all consulting rooms to act as further prompts to the study.
The control arm received point-of-care pain intensity assessment by the GP, also prompted by the electronic template but containing only the item on current pain intensity. At the post-randomisation meeting with the GPRF, GPs were advised to follow their usual approach for responding to a patient’s pain intensity rating. No additional information or signposting on management was provided. The intervention condition was not disclosed to control practices.
In both arms, no additional treatment resources or services for depression, anxiety, or pain management were provided as part of this study. In pre-randomisation audits, the vast majority of practices in both arms reported having access to physiotherapy, rheumatology, pain clinic, orthopaedics, psychiatry, and cognitive behavioural therapy. Practices in both arms were contacted monthly by email and telephone, and received regular newsletters to encourage trial participation.
We aimed to detect a standardised effect size of 0.2 for the primary outcome of pain intensity time-averaged across all four follow-up time points (post-consultation and 3, 6, and 12 mo). Using ρ = 0.5 as an estimate of the autocorrelation of the primary outcome (current pain intensity) and specification of α = 0.05 and β = 0.10, the number required was 350 per arm (or 700 in total). This was adjusted for clustering effect between practices, taking into account unequal cluster sizes  using an anticipated intraclass correlation coefficient of 0.015 [57–59], average cluster size of approximately 30, and coefficient of variation around 0.5. Assuming 20% dropout, the inflation factor was 1.875, indicating that we would need 1,320 participants in the trial to detect an effect size of 0.2 with 90% power given the specified statistical parameters.
General practices were randomly assigned to intervention or control on a 1:1 basis using a computer random number generator, with minimisation  used to constrict between-cluster variation in region (clinical commissioning group), area-level deprivation (Index of Multiple Deprivation ), and practice list size. General practices were randomised in six blocks of 5–10 practices as they agreed to take part. Final allocations of general practices were randomly selected by the independent statistician on the trial steering committee and passed to the PCRN, who installed the appropriate template into each practice and arranged for a GPRF to meet with each practice to introduce the screening template and study procedures. The chief investigator, principal investigator, trial statistician, and members of the administration team who inputted data from the study questionnaires were blinded to cluster allocation. Individual patients were not informed to which arm of the trial they were in.
Outcome domains and validated measurement instruments were chosen to be consistent with recommendations for trials in OA  and chronic pain [62,63]. Individual patient outcomes were obtained from postal self-complete questionnaires and medical record review (consenting patients) covering the period up to 12 mo post-consultation.
The primary outcome for clinical effectiveness was patient-reported current pain intensity on a 0–10 NRS  across 12 mo post-consultation, i.e., analysis was undertaken across four time points: directly post-consultation and at 3, 6, and 12 mo. The question for this outcome was included in the point-of-care templates for both arms of the study. Secondary patient-reported outcomes measured across 12 mo post-consultation covered the following:
- pain experience: average (0–10 NRS), worst (0–10 NRS), and characteristic (0–100 NRS) pain intensity ; number of pain areas  and widespread pain (American College of Rheumatology definition  and Manchester definition ) as indicated on a blank manikin; patient assessment of change in pain (“Compared with when you first saw your doctor with this pain [X] months ago, how do you feel your pain is now?” [completely recovered, much better, better, same, worse, much worse])
- pain-related disability: interference with daily activities (0–10 NRS), recreational activities (0–10 NRS), and work (0–10 NRS); disability score (0–100) ; disability days from the Chronic Pain Grade (CPG) ; short-form Western Ontario and McMaster Universities Arthritis Index function subscale (for those with hip and/or knee only [0–32]) 
- mood: anxiety (GAD-7 [0–21]) ; depression (PHQ-8 [0–24]) [69,70]
- general health status: Medical Outcomes Study Short Form 12 Physical Component and Mental Component Scores (0–100) 
To evaluate treatment fidelity and acceptability, we asked patients in the post-consultation questionnaire to recall whether specific aspects were covered in their consultation (including discussion of mood and pain intensity), whether they perceived any irrelevant questioning, and whether they were satisfied with the consultation. The post-consultation questionnaire also collected descriptive information on demographic characteristics, socioeconomic status, living arrangement and availability of instrumental and emotional support , comorbidities, pain history, previous consultations (primary and secondary care), previous diagnoses of anxiety or depression, and pain catastrophizing .
To describe the patterns of care and identify any differences in these between the two arms, we collected and analysed healthcare use data using simple descriptive statistics. Information on healthcare use was collected by patient self-report (further GP consultations for the index pain complaint; other healthcare professional consultations for any reason [National Health Service (NHS) and private]; hospital visits for any reason [NHS and private]; and purchases of over-the-counter medicines, treatments, or appliances for any reason) and from information extracted from the primary care medical record (consultations for anxiety, depression, and OA; prescriptions for anxiety, depression, and OA medications; and referrals for counselling, psychology, psychiatry, physiotherapy, osteopathy, chiropractor, massage, orthopaedics, and pain clinic).
After completion of patient recruitment, GPs in each of the intervention and control practices were invited to complete a brief questionnaire that asked about the perceived ease of use of the template, its impact on length of consultation, doctor–patient communication, patient management, and excluding patients from the trial. All GPs consenting to further contact were invited to take part in audio-recorded interviews (group or individual; in person or telephone) with an experienced qualitative researcher (B. B.) to explore their questionnaire responses in greater detail. Full details of this will published separately.
Analysis of all numerical outcomes (including the primary outcome measure—current pain intensity) was by hierarchical linear mixed models with unstructured covariance, including general practice (at level 3) and individual participants (at level 2) as random effect variables (a logistic mixed model was used for categorical variables), with repeated measurements of assessment data per individual at level 1. A number of pre-specified covariates were included in the statistical models to help overcome potential selection and confounding bias. Fixed-effect covariates at level 3 included the three variables used in the minimisation procedure plus practice consultation rate (in the 12 mo prior to randomisation) for OA among patients aged 45+ y. Fixed-effect covariates at level 2 included age, sex, and time to respond following consultation (i.e., days between consultation date and mailing response date). In addition, for the primary analysis, the variable time (of follow-up assessment) was used as a level-1 fixed-effect covariate, as well as the interaction of time and level-2 and level-3 covariates. Analysis was performed on the basis of the intention-to-treat principle: evaluation was undertaken per cluster randomised allocation. Estimated mean responses between the two groups were compared (1) across all follow-up time points simultaneously as an aggregated summary (primary evaluation) and (2) across all time points distinctly (secondary evaluation being to determine whether effect differences were consistent or different at the three follow-up time points).
Sensitivity analyses of the primary outcome were performed on subsets of the study population. First, participants who provided consent to further contact and medical record review and had a recorded consultation pain template score were re-analysed including the electronic template pain score as an additional level-2 covariate. An extension of this model further included the following pre-specified additional baseline covariates: duration of complaint and body mass index (kg/m2). Second, we carried out a complier-average causal effect (CACE) analysis of the between-group differences in the primary outcome to estimate the effect of the intervention for participants whose GPs complied with the screening protocol; compliance was pre-specified as a “yes” response recorded in the template to either of the two depression or either of the two anxiety items or a “no” response across all four depression/anxiety items (all other combinations imply that the template was not sufficiently completed to aid in any diagnostic screening of anxiety/depression). Third, we carried out multiple imputation analysis using a more inclusive list of associated variables, including the same baseline pre-specified covariates but also all secondary outcome responses.
Pre-specified subgroup analyses focused on the interaction effect between study group and (1) age and (2) severity of pain (according to template completion). We hypothesized that, as found by Lin et al. , the effect of our screening intervention on reduction in pain would be less marked in those presenting with more severe pain. A copy of the statistical analysis plan is available on request.
Patient and public involvement and engagement
Research users were involved in all stages of this trial, from grant application to final dissemination of results. Two users (J. B. and C. P.) were members of the trial steering committee, and a wider user group contributed to developing the trial design, study materials (including questionnaire and consent procedure), and intervention package.
Participants were recruited from 4 July 2011 to 19 December 2012. A flow diagram illustrating the flow of practices and individual participants through the trial is given in Fig 1. In all, 45 general practices were randomised, with an overall mean list size of 6,694: 24 practices were randomised to the control group, and 21 practices to the intervention group (one practice in the intervention arm withdrew prior to patient recruitment). A total of 7,279 patients were identified as being potentially eligible (aged ≥45 y and receiving an OA Read code) for the trial by activation of the electronic template; 1,367 were deemed to be ineligible, the GP “escaped” (i.e., deactivated) the template for 2,198 patients, 1,582 were excluded for unknown reasons, and 90 eligible patients declined to take part, leaving 2,042 patients who had a completed template and were mailed a post-consultation questionnaire. The proportion of potentially eligible patients in whom the GP escaped the template was higher in the intervention group (n = 1,021, 33.6%) than in the control group (n = 1,177, 27.8%). In all, 1,412 (69.1%) participants responded to the post-consultation questionnaire: 911 (68.0%) in the control arm and 501 (71.3%) in the intervention arm. The mean time between the date of consultation and date of returning the post-consultation questionnaire was 24 d (interquartile range, 17–35 d; range, 9–149 d) in the control arm and 22 d (16–33; 3–106) in the intervention arm. Follow-up rates were similar in both arms, totalling 1,093 (77.4%) at 3 mo, 1,064 (75.4%) at 6 mo, and 1,017 (72.0%) at 12 mo; loss to follow-up was largely due to non-consent to further follow-up and non-response to mailing, though a small number of participants withdrew from the trial (reasons provided in the flow diagram).
Practice and patient characteristics
Under the minimisation algorithm, more practices were allocated to the control group, and their total average practice list size was also higher than that of practices allocated to the intervention group (Table 1). Individual patients recruited from intervention and control practices had broadly similar characteristics (Table 2). In total, the average age of participants was 65 y, and 57% were female. The largest difference was in the proportion of patients reporting the pain episode to be their first: 40% in the control arm versus 33% in the intervention arm. For the subgroup of 1,035 study patients (644 [71%] in the control arm, 391 [78%] in the intervention arm) who consented to medical record review and had a consultation template pain score, the mean pain score was 6.33 (standard deviation, 2.04) in the intervention arm and 6.30 (2.10) in the control arm. In the intervention arm, 31.9% (125/392) of patients were recorded as having either anxiety or depressive symptoms, 20.2% (79/392) were recorded as saying “yes” to either of the two anxiety template questions, and 26.0% (102/392) were recorded as saying “yes” to either of the two depression template questions.
The results for the analysis of the primary outcome measure (current pain intensity), including primary endpoint and secondary endpoint evaluations along with pre-specified ancillary analysis (sensitivity and subgroup analyses), are shown in Table 3. For the primary endpoint analysis there was a significantly higher average pain score over the four follow up time-points in the intervention group than the control group (mean difference 0.31: 95% CI 0.04, 0.59; effect size 0.15: 0.02, 0.29). The difference was not uniform across individual time-points; the largest difference of 0.52 was observed at 6 mo follow-up. All three sensitivity analyses showed similar results. The estimates for the subgroup analyses showed a statistically non-significant trend for decreasing difference in pain scores between intervention group and control group with increased age, but no statistical evidence of an interaction with pain severity recorded by the GP at the point of care. Secondary outcomes were consistent with the primary outcome measure in reflecting better outcomes as a whole for the control group than the intervention group (Table 4).
The proportion of patients reporting that the GP asked irrelevant questions in the consultation was low and similar in both arms (41 [8.3%] in intervention group, 50 [5.6%] in control group) (Table 5). The proportion of patients not satisfied with the consultation was higher in the intervention group than in the control group (71 [14.5%] and 89 [9.9%], respectively).
Patterns of healthcare use
GP visits for depression, anxiety, and OA were higher among intervention patients, as were visits to other NHS professionals for any reason. However, there were no other significant between-group differences in NHS or private medical resource use (S1 Table).
This pragmatic cluster randomised trial in UK primary care provides no evidence for a beneficial effect on patient-reported outcomes of implementing active screening for anxiety and depression in patients consulting with OA. Participants in the intervention group reported significantly higher average pain scores over the four follow-up time points than participants in the control group, with key secondary outcomes also reflecting better outcomes in the control group.
Despite national guidelines advocating screening for anxiety and depression in high-risk groups , including those with OA and painful conditions, this is the first large pragmatic primary-care-based trial to our knowledge to investigate the utility of this approach. Our findings cast doubt on the validity of national guidance about the usefulness of routine screening for anxiety and depression in people with long-term conditions in primary care. In the absence of direct clinical trial evidence, the introduction in 2006 of financial incentives for annual depression screening in people with coronary heart disease and diabetes in the UK has provided a natural experiment, albeit without random allocation of controls, on the effects of implementing screening in routine care for defined high-risk groups. Modest increases in the rate of new depression diagnoses and in antidepressant prescriptions were observed [74,75], although the impact of these changes and their relation to patient outcomes remain unclear. Screening for depression in patients with diabetes and heart disease has subsequently been withdrawn from the Quality and Outcomes Framework component of the general practice contract.
Strengths and limitations
This study has a number of strengths and adds to the growing literature in this area. This large primary-care-based trial helps address the evidence gap using validated screening tools with established diagnostic accuracy in a high-risk population without a current depression diagnosis. The point-of-care screening was conducted by the patients’ GP during an unsolicited consultation for OA. Methodologically, we had minimal cluster attrition, with only one practice withdrawing from the trial, and had high rates of follow-up from participants.
A number of study limitations need to be noted. This trial experienced an imbalance in allocation to clusters, with the intervention arm being allocated fewer practices that were smaller in size (average practice size for control practices = 7,397, average size for intervention practices = 5,850). However, this did not impact the statistical power of the study and is unlikely to have introduced significant bias. Selection bias is always an important consideration in cluster trials, and the trial was designed to minimise this . Although this study recruited large numbers of patients to both arms, the proportion of potentially eligible patients who were screened by the GP and mailed a post-consultation questionnaire was higher in the control group (n = 1,339, 31.6%) than in the intervention group (n = 703, 23.1%). The differential recruitment between arms was unrelated to patients’ age, sex, or whether their joint problem was given a diagnosis of OA (Read code N05) or a symptom code related to a clinical diagnosis of OA (a proxy for the severity and prognosis of the joint problem) (Table 6). Mean pain score recorded at the time of consultation was similar in both arms. However, we cannot know whether the differences between arms in the distribution of prognostic factors (e.g., longer duration of episode, more previous episodes, more widespread pain, greater interference with daily activities, more severe anxiety and depression symptoms [76,77]) measured for the first time at post-consultation questionnaire were also present at the time of the consultation.
Whilst a degree of selection bias may have occurred, we do not believe it capable of overturning the key finding of this study, namely, a lack of demonstrable benefit from implementing screening for anxiety and depression for patients with OA consulting their GP.
Results in relation to other studies
To date, the evidence supporting screening for anxiety and depression in patients with OA is limited, although evidence from a previous single clinical trial of a collaborative care approach suggests that successfully managing comorbid major depressive disorder in patients with OA can improve pain, function, and quality of life [16–18]. Some caution is needed when directly comparing existing evidence with the current study, which took a different overall approach. In our study, patients consulting with OA were screened to identify depression or anxiety with the intention of providing treatment (if deemed necessary), whilst the study by Lin et al. successfully used a collaborative care approach (an intensive intervention, with case management and active follow-up) in those already identified and diagnosed with depression. As our study failed to improve depression and anxiety outcomes, it would be unlikely to have an impact on pain. Whilst more research has been conducted among those with long-term conditions other than OA, the recommendation of routine depression screening in general  and for case-finding in high-risk patients with diabetes , cancer , and coronary heart disease  has been criticised as premature. As such it is not currently clear that screening, even if conducted alongside collaborative care management of treatment, would be effective.
The findings from the Primary Care Osteoarthritis Screening Trial are generally consistent with the limited effects reported by other studies using point-of-care prompts to influence clinical behaviour [78,79]. A recent study investigating the impact of a pop-up electronic template to collect additional data during GP consultations found considerable variation between individual clinicians and for different quality indicators of OA care . One explanation for these findings is that screening may occur in isolation and not fit naturally into the GP consultation. Furthermore, one study  suggested that, to be successful, screening needs to operate within structured pathways that can be accommodated within available systems and resources. Other evidence suggests that patients may prefer to separate physical and mental health problems within the context of long-term condition management, finding a preference among patients for discussing emotional problems in a separate therapeutic space .
Implications for clinicians, policy makers, and future research
Physician behaviour can be expected to influence the expression of emotional cues and concerns by patients, and there is evidence that both elicitation and recognition are highly variable between practitioners . Closed questions on psychosocial issues may facilitate the expression of emotional cues and concerns [83,84]. In this alternative perspective of screening, in which the purpose is to facilitate a more holistic assessment in order to improve pain and functional outcomes, the beneficial effects of raising the issue of feelings of anxiety and depression within the OA consultation need not be restricted to the relatively small minority of patients ultimately diagnosed with anxiety or depressive disorder who access and receive high-quality mental healthcare (the screen–diagnose–treat pathway). Gask and Coventry  argue that whilst practitioners can be trained to take a more holistic approach, we need to acknowledge the degree of complexity present in the healthcare system that works against achieving satisfactory implementation and outcomes from person-centred mental healthcare.
The results of this study demonstrate that current guidance recommending depression screening of high-risk individuals needs to be questioned, especially given the negative outcome in patients with OA. Such outcomes may also apply to other long-term conditions, although caution is needed before extending our findings to other pain-related conditions, such as fibromyalgia, where the relation between anxiety and depression and the clinical syndrome may be different to that seen in OA.
In this study, we observed that encouraging GPs to routinely ask screening questions for anxiety and depression of patients consulting for clinical OA (and then to follow guideline-recommended care for OA and mental health) had no benefit on patient-reported pain and functional outcomes over 12 mo.
S1 Data. Access to services reported by practices in the pre-audit.
S1 Table. Healthcare-related resource use over 12 mo, by group.
We would like to thank all participating patients and general practices and the Keele Clinical Trials Unit.
The views expressed are those of the authors and not necessarily those of the NHS, the National Institute for Health Research, or the Department of Health.
- Conceptualization: CDM EMH GP ML PC.
- Data curation: BB BN ZL.
- Formal analysis: BB CCG DG JK ML SJ.
- Funding acquisition: CDM GP PC EMH ML.
- Investigation: BB BN ZL.
- Methodology: CDM BN ML BB DG SJ JK JB KC ZL CP CCG PC EMH GP.
- Project administration: BN ZL KC CDM.
- Supervision: CDM EMH GP KC PC.
- Validation: JB.
- Visualization: ML.
- Writing – original draft: CDM GP BB.
- Writing – review & editing: CDM BN ML BB DG SJ JK JB KC ZL CP CCG PC EMH GP.
- 1. Vos T, Flaxman AD, Naghavi M, Lozano R, Michaud C, Ezzati M, et al. Years lived with disability (YLDs) for 1160 sequelae of 289 diseases and injuries 1990–2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2012;380:2163–96. pmid:23245607
- 2. Arthritis Research UK. Osteoarthritis: an information booklet. Chesterfield: Arthritis Research UK; 2004.
- 3. Gureje O, Von Korff M, Simon GE, Gater R. Persistent pain and well-being: a World Health Organization study in primary care. JAMA. 1998;280:147–51. pmid:9669787
- 4. Arnow BA, Hunkeler EM, Blasey CM, Lee J, Constantino MJ, Fireman B, et al. Comorbid depression, chronic pain, and disability in primary care. Psychosom Med. 2006;68:262–8. pmid:16554392
- 5. He Y, Zhang M, Lin EH, Bruffaerts R, Posada-Villa J, Angermeyer MC, et al. Mental disorders among persons with arthritis: results from the World Mental Health Surveys. Psychol Med. 2008;38:1639–50. pmid:18298879
- 6. Mallen CD, Peat G, Thomas E, Dunn KM, Croft PR. Prognostic factors for musculoskeletal pain in primary care: a systematic review. Br J Gen Pract. 2007;57:655–61. pmid:17688762
- 7. Wright AA, Cook C, Abbott JH. Variables associated with the progression of hip osteoarthritis: a systematic review. Arthritis Rheum. 2009;61:925–36. pmid:19565541
- 8. Chapple CM, Nicholson H, Baxter GD, Abbott JH. Patient characteristics that predict progression of knee osteoarthritis: a systematic review of prognostic studies. Arthritis Care Res (Hoboken). 2011;63:1115–25.
- 9. Kwok WY, Plevier JW, Rosendaal FR, Huizinga TW, Kloppenburg M. Risk factors for progression in hand osteoarthritis: a systematic review. Arthritis Care Res (Hoboken). 2013;65:552–62.
- 10. Mallen CD, Peat G, Thomas E, Lacey R, Croft P. Predicting poor functional outcome in community-dwelling older adults with knee pain: prognostic value of generic indicators. Ann Rheum Dis. 2007;66:1456–61. pmid:17456527
- 11. Thomas E, Dunn KM, Mallen C, Peat G. A prognostic approach to defining chronic pain: application to knee pain in older adults. Pain. 2008;139:389–97. pmid:18583051
- 12. Bair MJ, Robinson RL, Katon W, Kroenke K. Depression and pain comorbidity: a literature review. Arch Intern Med. 2003;163:2433–45. pmid:14609780
- 13. Rosemann T, Gensichen J, Sauer N, Laux G, Szecsenyi J. The impact of concomitant depression on quality of life and health service utilisation in patients with osteoarthritis. Rheumatol Int. 2007;27:859–63. pmid:17242902
- 14. Scott KM, Von Korff M, Alonso J, Angermeyer MC, Bromet E, Fayyad J, et al. Mental-physical co-morbidity and its relationship with disability: results from the World Mental Health Surveys. Psychol Med. 2009;39:33–43. pmid:18366819
- 15. Kroenke K, Wu J, Bair MJ, Krebs EE, Damush TM, Tu W. Reciprocal relationship between pain and depression: a 12-month longitudinal analysis in primary care. J Pain. 2011;12:964–73. pmid:21680251
- 16. Unutzer J, Katon W, Callahan CM, Williams JW Jr, Hunkeler E, Harpole L, et al. Collaborative care management of late-life depression in the primary care setting: a randomized controlled trial. JAMA. 2002;288:2836–45. pmid:12472325
- 17. Lin EH, Katon W, Von Korff M, Tang L, Williams JW Jr, Kroenke K, et al. Effect of improving depression care on pain and functional outcomes among older adults with arthritis: a randomized controlled trial. JAMA. 2003;290:2428–9. pmid:14612479
- 18. Lin EH, Tang L, Katon W, Hegel MT, Sullivan MD, Unutzer J. Arthritis pain and disability: response to collaborative depression care. Gen Hosp Psychiatry. 2006;28:482–6. pmid:17088163
- 19. Roy-Byrne P, Craske MG, Sullivan G, Rose RD, Edlund MJ, Lang AJ, et al. Delivery of evidence-based treatment for multiple anxiety disorders in primary care: a randomized controlled trial. JAMA. 2010;303:1921–8. pmid:20483968
- 20. Roy-Byrne P, Sullivan MD, Sherbourne CD, Golinelli D, Craske MG, Sullivan G, et al. Effects of pain and prescription opioid use on outcomes in a collaborative care intervention for anxiety. Clin J Pain. 2013;29:800–6. pmid:23370069
- 21. Freeling P, Rao BM, Paykel ES, Sireling LI, Burton RH. Unrecognised depression in general practice. Br Med J (Clin Res Ed). 1985;290:1880–3.
- 22. Memel DS, Kirwan JR, Sharp DJ, Hehir M. General practitioners miss disability and anxiety as well as depression in their patients with osteoarthritis. Br J Gen Pract. 2000;50:645–8. pmid:11042917
- 23. Lang AJ, Stein MB. Screening for anxiety in primary care: why bother? Gen Hosp Psychiatry. 2002;24:365–6. pmid:12490336
- 24. Katon W, Roy-Byrne P. Anxiety disorders: efficient screening is the first step in improving outcomes. Ann Intern Med. 2007;146:390–2. pmid:17339624
- 25. Buszewicz MJ, Chew-Graham C. Improving the detection and management of anxiety disorders in primary care. Br J Gen Pract. 2011;61:489–90. pmid:21801546
- 26. Meijer A, Roseman M, Delisle VC, Milette K, Levis B, Syamchandra A, et al. Effects of screening for psychological distress on patient outcomes in cancer: a systematic review. J Psychosom Res. 2013;75:1–17. pmid:23751231
- 27. Thombs BD, Roseman M, Coyne JC, de Jonge P, Delisle VC, Arthurs E, et al. Does evidence support the American Heart Association’s recommendation to screen patients for depression in cardiovascular care? An updated systematic review. PLoS ONE. 2013;8:e52654. pmid:23308116
- 28. Thombs BD, Ziegelstein RC, Roseman M, Kloda LA, Ioannidis JP. There are no randomized controlled trials that support the United States Preventive Services Task Force Guideline on screening for depression in primary care: a systematic review. BMC Med. 2014;12:13. pmid:24472580
- 29. Keshavarz H, Fitzpatrick-Lewis D, Streiner DL, Maureen R, Ali U, Shannon HS, et al. Screening for depression: a systematic review and meta-analysis. CMAJ Open. 2013;1:E159–67. pmid:25077118
- 30. National Institute for Health and Care Excellence. Osteoarthritis: care and management. NICE clinical guideline 177. London: National Institute for Health and Care Excellence; 2014.
- 31. National Institute for Health and Care Excellence. Depression in adults with a chronic physical health problem: recognition and management. NICE clinical guideline 91. London: National Institute for Health and Clinical Excellence; 2009.
- 32. Whooley MA, Avins AL, Miranda J, Browner WS. Case-finding instruments for depression. Two questions are as good as many. J Gen Intern Med. 1997;12:439–45. pmid:9229283
- 33. Mitchell AJ. Screening for cancer-related distress: when is implementation successful and when is it unsuccessful? Acta Oncol. 2013;52:216–24. pmid:23320770
- 34. Hawker GA, Gignac MA, Badley E, Davis AM, French MR, Li Y, et al. A longitudinal study to explain the pain-depression link in older adults with osteoarthritis. Arthritis Care Res (Hoboken). 2011;63:1382–90.
- 35. Parmelee PA, Tighe CA, Dautovich ND. Sleep disturbance in osteoarthritis: linkages with pain, disability and depressive symptoms. Arthritis Care Res (Hoboken). 2015;67(3):358–65.
- 36. Rosemann T, Backenstrass M, Joest K, Rosemann A, Szecsenyi J, Laux G. Predictors of depression in a sample of 1,021 primary care patients with osteoarthritis. Arthritis Rheum. 2007;57:415–22. pmid:17394226
- 37. Uthman OA, van der Windt DA, Jordan JL, Dziedzic KS, Healey EL, Peat GM, et al. Exercise for lower limb osteoarthritis: systematic review incorporating trial sequential analysis and network meta-analysis. Br J Sports Med. 2014;48:1579. pmid:25313133
- 38. Bridle C, Spanjers K, Patel S, Atherton NM, Lamb SE. Effect of exercise on depression severity in older people: systematic review and meta-analysis of randomised controlled trials. Br J Psychiatry. 2012;201:180–5. pmid:22945926
- 39. Cooney GM, Dwan K, Greig CA, Lawlor DA, Rimer J, Waugh FR, et al. Exercise for depression. Cochrane Database Syst Rev. 2013;9:CD004366.
- 40. Maserejian NN, Fischer MA, Trachtenberg FL, Yu J, Marceau LD, McKinlay JB, et al. Variations among primary care physicians in exercise advice, imaging, and analgesics for musculoskeletal pain: results from a factorial experiment. Arthritis Care Res (Hoboken). 2014;66:147–56.
- 41. Edwards JJ, Jordan KP, Peat G, Bedson J, Croft PR, Hay EM, et al. Quality of care for OA: the effect of a point-of-care consultation recording template. Rheumatology (Oxford). 2015;54(5):844–53.
- 42. Thombs BD. Routine depression screening for patients with diabetes. JAMA. 2014;312:2412–3. pmid:25490339
- 43. Thombs BD, Coyne JC. Moving forward by moving back: re-assessing guidelines for cancer distress screening. J Psychosom Res. 2013;75:20–2. pmid:23751233
- 44. Thombs BD, Ziegelstein RC. Evidence does matter—and evidence does not support the National Heart Foundation of Australia’s consensus statement on depression screening. J Psychosom Res. 2014;76:173–4. pmid:24439697
- 45. Bland RC, Streiner DL. Why screening for depression in primary care is impractical. CMAJ. 2013;185:753–4. pmid:23670151
- 46. Crombez G, Beirens K, Van Damme S, Eccleston C, Fontaine J. The unbearable lightness of somatisation: a systematic review of the concept of somatisation in empirical studies of pain. Pain. 2009;145:31–5. pmid:19427734
- 47. Brierley G, Brabyn S, Torgerson D, Watson J. Bias in recruitment to cluster randomized trials: a review of recent publications. J Eval Clin Pract. 2012;18:878–86. pmid:21689213
- 48. Carter BR, Hood K. Balance algorithm for cluster randomized trials. BMC Med Res Methodol. 2008;8:65. pmid:18844993
- 49. Eldridge S, Kerry S. A practical guide to cluster randomised trials in health services research. Chichester: John Wiley & Sons; 2012.
- 50. Edwards SJ, Braunholtz DA, Lilford RJ, Stevens AJ. Ethical issues in the design and conduct of cluster randomised controlled trials. BMJ. 1999;318:1407–9. pmid:10334756
- 51. Hutton JL. Are distinctive ethical principles required for cluster randomized controlled trials? Stat Med. 2001;20:473–88. pmid:11180314
- 52. Eldridge SM, Ashby D, Feder GS. Informed patient consent to participation in cluster randomized trials: an empirical exploration of trials in primary care. Clin Trials. 2005;2:91–8. pmid:16279130
- 53. Kroenke K, Spitzer RL, Williams JB, Monahan PO, Lowe B. Anxiety disorders in primary care: prevalence, impairment, comorbidity, and detection. Ann Intern Med. 2007;146:317–25. pmid:17339617
- 54. Von Korff M, Ormel J, Keefe FJ, Dworkin SF. Grading the severity of chronic pain. Pain. 1992;50:133–49. pmid:1408309
- 55. National Institute for Health and Care Excellence. Generalised anxiety disorder in adults: management. NICE clinical guideline 113. London: National Institute for Health and Clinical Excellence; 2011.
- 56. Eldridge SM, Ashby D, Kerry S. Sample size for cluster randomized trials: effect of coefficient of variation of cluster size and analysis method. Int J Epidemiol. 2006;35:1292–300. pmid:16943232
- 57. Campbell M, Grimshaw J, Steen N. Sample size calculations for cluster randomised trials. Changing Professional Practice in Europe Group (EU BIOMED II Concerted Action). J Health Serv Res Policy. 2000;5:12–6. pmid:10787581
- 58. Smeeth L, Ng ES. Intraclass correlation coefficients for cluster randomized trials in primary care: data from the MRC Trial of the Assessment and Management of Older People in the Community. Control Clin Trials. 2002;23:409–21. pmid:12161083
- 59. Adams G, Gulliford MC, Ukoumunne OC, Eldridge S, Chinn S, Campbell MJ. Patterns of intra-cluster correlation from primary care research to inform study design and analysis. J Clin Epidemiol. 2004;57:785–94. pmid:15485730
- 60. Department for Communities and Local Government. The English Index of Multiple Deprivation (IMD) 2015—guidance. London: Department for Communities and Local Government; 2015 [cited 2017 Mar 7]. Available from: https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/464430/English_Index_of_Multiple_Deprivation_2015_-_Guidance.pdf.
- 61. Bellamy N, Kirwan J, Boers M, Brooks P, Strand V, Tugwell P, et al. Recommendations for a core set of outcome measures for future phase III clinical trials in knee, hip, and hand osteoarthritis. Consensus development at OMERACT III. J Rheumatol. 1997;24:799–802. pmid:9101522
- 62. Turk DC, Dworkin RH, Allen RR, Bellamy N, Brandenburg N, Carr DB, et al. Core outcome domains for chronic pain clinical trials: IMMPACT recommendations. Pain. 2003;106:337–45. pmid:14659516
- 63. Dworkin RH, Turk DC, Farrar JT, Haythornthwaite JA, Jensen MP, Katz NP, et al. Core outcome measures for chronic pain clinical trials: IMMPACT recommendations. Pain. 2005;113:9–19. pmid:15621359
- 64. Lacey RJ, Lewis M, Jordan K, Jinks C, Sim J. Interrater reliability of scoring of pain drawings in a self-report health survey. Spine (Phila Pa 1976). 2005;30:E455–8.
- 65. Wolfe F, Smythe HA, Yunus MB, Bennett RM, Bombardier C, Goldenberg DL, et al. The American College of Rheumatology 1990 criteria for the classification of fibromyalgia. Report of the Multicenter Criteria Committee. Arthritis Rheum. 1990;33:160–72. pmid:2306288
- 66. Hunt IM, Silman AJ, Benjamin S, McBeth J, Macfarlane GJ. The prevalence and associated features of chronic widespread pain in the community using the ‘Manchester’ definition of chronic widespread pain. Rheumatology (Oxford). 1999;38:275–9.
- 67. Tubach F, Baron G, Falissard B, Logeart I, Dougados M, Bellamy N, et al. Using patients’ and rheumatologists’ opinions to specify a short form of the WOMAC function subscale. Ann Rheum Dis. 2005;64:75–9. pmid:15608303
- 68. Spitzer RL, Kroenke K, Williams JB, Lowe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166:1092–7. pmid:16717171
- 69. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16:606–13. pmid:11556941
- 70. Lowe B, Spitzer RL, Williams JB, Mussell M, Schellberg D, Kroenke K. Depression, anxiety and somatization in primary care: syndrome overlap and functional impairment. Gen Hosp Psychiatry. 2008;30:191–9. pmid:18433651
- 71. Ware J Jr, Kosinski M, Keller SD. A 12-item short-form health survey: construction of scales and preliminary tests of reliability and validity. Med Care. 1996;34:220–33. pmid:8628042
- 72. Krumholz HM, Butler J, Miller J, Vaccarino V, Williams CS, Mendes de Leon CF, et al. Prognostic importance of emotional support for elderly patients hospitalized with heart failure. Circulation. 1998;97:958–64. pmid:9529263
- 73. Sullivan MJL, Bishop SR, Pivik J. The Pain Catastrophizing Scale: development and validation. 1995;7:524–32.
- 74. Burton C, Simpson C, Anderson N. Diagnosis and treatment of depression following routine screening in patients with coronary heart disease or diabetes: a database cohort study. Psychol Med. 2013;43:529–37. pmid:22804849
- 75. McLintock K, Russell AM, Alderson SL, West R, House A, Westerman K, et al. The effects of financial incentives for case finding for depression in patients with diabetes and coronary heart disease: interrupted time series analysis. BMJ Open. 2014;4:e005178. pmid:25142262
- 76. Von Korff M, Miglioretti DL. A prognostic approach to defining chronic pain. Pain. 2005;117:304–13. pmid:16153772
- 77. Mallen CD, Thomas E, Belcher J, Rathod T, Croft P, Peat G. Point-of-care prognosis for common musculoskeletal pain in older adults. JAMA Intern Med. 2013;173:1119–25. pmid:23699833
- 78. Shojania KG, Jennings A, Mayhew A, Ramsay CR, Eccles MP, Grimshaw J. The effects of on-screen, point of care computer reminders on processes and outcomes of care. Cochrane Database Syst Rev. 2009;3:CD001096.
- 79. Cheung A, Weir M, Mayhew A, Kozloff N, Brown K, Grimshaw J. Overview of systematic reviews of the effectiveness of reminders in improving healthcare professional behavior. Syst Rev. 2012;1:36. pmid:22898173
- 80. Alderson SL, Russell AM, McLintock K, Potrata B, House A, Foy R. Incentivised case finding for depression in patients with chronic heart disease and diabetes in primary care: an ethnographic study. BMJ Open. 2014;4:e005146. pmid:25138803
- 81. Knowles SE, Chew-Graham C, Adeyemi I, Coupe N, Coventry PA. Managing depression in people with multimorbidity: a qualitative evaluation of an integrated collaborative care model. BMC Fam Pract. 2015;16:32. pmid:25886864
- 82. Zimmermann C, Del Piccolo L, Finset A. Cues and concerns by patients in medical consultations: a literature review. Psychol Bull. 2007;133:438–63. pmid:17469986
- 83. Del Piccolo L, Saltini A, Zimmermann C, Dunn G. Differences in verbal behaviours of patients with and without emotional distress during primary care consultations. Psychol Med. 2000;30:629–43. pmid:10883718
- 84. Bensing JM, Verheul W, Jansen J, Langewitz WA. Looking for trouble: the added value of sequence analysis in finding evidence for the role of physicians in patients’ disclosure of cues and concerns. Med Care. 2010;48:583–8. pmid:20508532
- 85. Gask L, Coventry P. Person-centred mental health care: the challenge of implementation. Epidemiol Psychiatr Sci. 2012;21:139–44. pmid:22789160