Offering a modest financial incentive to people with psychosis can promote adherence to depot antipsychotic medication, but the cost-effectiveness of this approach has not been examined.
Economic evaluation within a pragmatic cluster-randomised controlled trial. 141 patients under the care of 73 teams (clusters) were randomised to intervention or control; 138 patients with diagnoses of schizophrenia, schizo-affective disorder or bipolar disorder participated. Intervention participants received £15 per depot injection over 12 months, additional to usual acute, mental and community primary health services. The control group received usual health services. Main outcome measures: incremental cost per 20% increase in adherence to depot antipsychotic medication; incremental cost of ‘good’ adherence (defined as taking at least 95% of the prescribed number of depot medications over the intervention period).
Economic and outcome data for baseline and 12-month follow-up were available for 117 participants. The adjusted difference in adherence between groups was 12.2% (73.4% control vs. 85.6% intervention); the adjusted costs difference was £598 (95% CI -£4 533, £5 730). The extra cost per patient to increase adherence to depot medications by 20% was £982 (95% CI -£8 020, £14 000). The extra cost per patient of achieving 'good' adherence was £2 950 (CI -£19 400, £27 800). Probability of cost-effectiveness exceeded 97.5% at willingness-to-pay values of £14 000 for a 20% increase in adherence and £27 800 for good adherence.
Offering a modest financial incentive to people with psychosis is cost-effective in promoting adherence to depot antipsychotic medication. Direct healthcare costs (including costs of the financial incentive) are unlikely to be increased by this intervention.
Citation: Henderson C, Knapp M, Yeeles K, Bremner S, Eldridge S, David AS, et al. (2015) Cost-Effectiveness of Financial Incentives to Promote Adherence to Depot Antipsychotic Medication: Economic Evaluation of a Cluster-Randomised Controlled Trial. PLoS ONE 10(10): e0138816. https://doi.org/10.1371/journal.pone.0138816
Editor: Katharina Domschke, University of Wuerzburg, GERMANY
Received: February 24, 2015; Accepted: August 26, 2015; Published: October 8, 2015
Copyright: © 2015 Henderson et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: Data underlying the findings are subject to ethical restrictions on public sharing from the Queen Mary University of London regulations. Interested researchers may contact Professor Stefan Priebe at firstname.lastname@example.org to request a de-identified, minimal dataset subject to ethical approval.
Funding: This trial was funded by the National Institute for Health Research Health Technology Assessment (NIHR HTA) Programme (project number 07/60/43) and will be published in full in Health Technology Assessment. The views and opinions expressed therein are those of the authors and do not necessarily reflect those of the HTA programme, NIHR, NHS or the Department of Health. The sponsor of this study had no role in study design, data collection, data analysis, interpretation, writing of the paper, or decision to submit for publication.
Competing interests: ASD has received personal fees from Janssen-Cilag and Eli Lilly, and TB received lecture fees from Janssen and Otsuka during the conduct of the study. CH, MK, KY, SB, SE, NO and SP declare that they have no conflicts of interest. This does not alter the authors' adherence to PLOS ONE policies on sharing data and materials.
Antipsychotic medication for people with psychosis can prevent relapse, reduce hospitalisation and improve quality of life outcomes. Injectable or depot antipsychotic medication may also reduce relapse more effectively than oral medications. Non-adherence to antipsychotic medication by people with psychosis can have negative outcomes, such as relapse and suicide, [3, 4] while adherence is associated with remission from symptoms. Non-adherence is highly prevalent in people with schizophrenia:  about 50% of patients are non-adherent to oral medications and 25% to depot medications.
Non-adherence to antipsychotic medications can lead to higher utilisation of community services and increased health and social care costs. Greater adherence to antipsychotics may decrease the risk of hospital admissions  and may be associated with lower use of other health care resources. Nonetheless, the evidence-base on cost and cost-effectiveness consequences of non-adherence remains slim;  likewise, it remains to be proved that improving adherence to mental health medications reduces health service expenditure.
Programmes to improve adherence include psycho-educational and behavioural interventions that can be delivered to individuals or groups (of patients or family members) in clinical or community settings. Currently the evidence on the effectiveness of therapies to improve adherence in people with schizophrenia is somewhat mixed [12, 13]. However, one strategy for behavioural change that has shown promise in other areas of mental health and substance abuse treatment is to offer a financial reward for adhering to medication.[14–17] New trial evidence suggests that ‘money for medications’–offering a modest financial incentive—is effective in improving adherence to maintenance treatment with depot antipsychotic medications. We investigated the costs and cost-effectiveness of the trial’s financial incentive intervention in the context of community mental health services in England.
Design and methods
The trial design was a cluster-randomised controlled trial of a financial incentive scheme to encourage adherence to maintenance (depot) anti-psychotic medications, with nested economic evaluation. The clinical paper  describes trial recruitment methods and the mental health system context in further detail.
Assertive outreach and community mental health teams and their patients were invited to participate in the study. NHS Mental Health Trusts in England, within which these mental health teams operated, typically ran a number of community and secondary care services but did not provide primary medical services (the latter being provided by general medical practitioners). From the participating teams we recruited patients with poor rates of adherence to long-acting (depot) anti-psychotic medication, of 75% or below over the course of a four-month period prior to screening. In practical terms, patients with a 75% rate of adherence would miss between three and 13 injections in a typical year, depending on the treatment cycle. To be eligible for the trial, patients were to be aged 18 to 65 years, under the care of the team for at least four months, be able to give informed written consent, and have a diagnosis of schizophrenia, schizo-affective psychosis or bipolar affective disorder.
Participants under the care of teams randomised to the intervention received a financial incentive of £15 from the clinician administering the depot injection immediately after the injection was given. Clinicians and participants were for this reason not blinded to allocation. The size of payment was intended to avoid creating financial dependency (the maximum amount of income that could be gained from the incentive being £60 every 4 weeks); it was below the amount which could have negatively impacted on the patient’s entitlement to welfare benefits. Intervention participants received these payments in addition to their standard treatment from their assertive outreach or community mental health team for a period of 12 months.
Control group participants received their usual health care services, including services from their community mental health or assertive outreach teams.
Over the period of the study, research assistants visited the treating assertive outreach and community mental health teams to extract data on outcomes and resource use from the electronic or paper-based case records held by the responsible NHS Mental Health Trusts. The researchers searched the patient records at each data collection point in order to complete a case record form developed for the study, using electronic patient records where available, or paper records if not. This involved searching depot cards and clinical progress notes, and other relevant medical communications and reports on file; in some cases it was necessary to check with clinicians in order to ascertain details of some information held in the records. Roughly a third of extractions relied on a combination of electronic and paper records (38%), while 25% of extractions were by electronic records only and 12% by paper records only; for another 25% of extractions, researchers both consulted records and also involved clinicians to obtain or check information. At baseline, researchers also collected data directly from patients on subjective quality of life and asked patients for permission to be contacted to complete a 12-month follow-up re-assessment. At 12-month follow-up, researchers collected both quality of life data from consenting patients and also asked clinicians to complete a measure of clinical improvement (Clinical Global Impression Scale (CGI)). Case record forms were completed at baseline, at the end of the 12-month study period after randomisation and (not reported here) at 18 and 36 months post-randomisation.
The analysis took an NHS costs perspective, covering services usually commissioned or provided by the NHS. Information was collected on inpatient, outpatient and community mental health services, general hospital and primary care services, prescribed oral medications and prescribed and received depot medications.
At baseline, while service use and oral medications prescriptions were recorded for the 12 months prior to the date of randomisation, antipsychotic depot medications given were recorded over the 12 months prior to the date of screening for trial eligibility. In some cases there was a considerable lag between randomisation and screening dates (36 participants (25.5%) were allocated to groups more than 8 weeks after being screened) (see S1 file). Therefore we adjusted the total pre-baseline depot counts and costs to bring them into line with other costs (i.e., modelling treatment cycle and depot medication use over the same pre-randomisation period as other costs). At 12-month follow-up, researchers recorded all service and medication use over the prior 12 months.
The case record form was piloted using case records of seven patients recruited early in the trial. At that stage it was recognised that only basic information on names and dosage of oral medications prescribed could be located in most of these records. The dates over which medications had been taken were therefore not recorded on subsequent case recording forms. We have assumed for the purpose of the analyses that oral medications recorded were taken over the full 12 months prior to baseline and follow-up points.
Oral and depot medication costs were calculated drawing on the Prescription Cost Analyses. Each study medication code was assigned to the corresponding British National Formulary chemical name. To each depot received we attached the cost of the dosage of injectable medication (e.g. for 25 mg/ml in a 1ml ampule). In a small number of cases, no medication code was given (in 3% (n = 23) of depots in the control sample at baseline, and in 3% (n = 45) of intervention depots at follow-up). In these cases, the average cost of a depot per treatment cycle per data point was assigned. Oral medications were similarly assigned unit costs based on the dosage and medication unit (e.g. milligrams).
Unit costs of services were taken from nationally representative published sources [24, 25] and other published sources (Table 1). The base year was 2010/11. Costs to the NHS at baseline and 12-month follow-up were calculated by applying unit costs to resource use items collected. The following professionals were assumed to form part of the client's involved team (community mental health or assertive outreach): community mental health nurses, occupational therapists, psychiatrists, psychologists, social workers and support workers.[26, 27] Few data on duration of contact with community service personnel were available (about 12–20% of cases, depending on the type of personnel, at baseline and follow-up) so it was not feasible to use per-minute unit costs; instead, we drew on the cost of a contact in any setting (office/service and home/community settings), taken from the NHS reference costs for England.
The intervention cost was calculated as the total number of incentive payments given over the study period. The intervention was administered in a uniform manner: an incentive payment of £15 in cash was provided on each occasion that the depot was given. The number of incentive payments was therefore variable, depending on the number of depot injections given. Researchers working with individual teams reported that there were no additional resources used in producing the intervention. Teams would keep a stock of “petty cash” so that there were no particular additional requirements in terms of securing the incentive payment in the premises. Contacts with nurses, including those giving depot injections, were recorded as part of the data extraction.
A continuous measure of adherence was calculated as the percentage of prescribed injections received in the 12-month study period; also a binary measure of adherence was calculated as whether the percentage of prescribed injections received exceeded 95% of the total prescribed, to represent the ratio of patients with "good adherence" in each group. The study was powered to detect a shift of 20% in mean adherence; operationalizing the trial’s primary outcome for the economic analysis, we have considered the incremental cost of achieving a 20% increase in adherence to prescribed depot injections taken over the prior 12 months. We also examined the incremental cost of achieving the taking of at least 95% of the prescribed number of depot medications over the prior 12 month intervention period.
Other outcomes examined in the economic analysis were: clinical improvement as assessed on the CGI (clinician ratings ranging from 1 (very much improved) to 7 (very much worse)) and subjective quality of life (SQOL), as assessed using the SQOL component of the DIALOG questionnaire. This measures self-reported quality of life in terms of eight satisfaction with life domains (e.g. mental health, accommodation) with a scale score ranging from 1 (lowest satisfaction) to 7 (highest satisfaction) [28, 29].
Cost effectiveness analyses.
An intervention can be considered cost-effective if the intervention is more effective and less costly than the alternative; or if the intervention is more effective and more costly than the alternative, and the purchaser is willing to pay the additional cost to achieve the benefit of the intervention. In the latter case, the incremental cost-effectiveness ratio (ICER), the incremental cost (ΔE) per unit of outcome gain that is associated with the intervention (ΔC), must be less than the purchaser's willingness to pay (λ) for this gain. This decision rule can be written as:
If the purchaser's willingness to pay for a unit of outcome associated with the intervention is less than the cost of achieving that outcome, the NMB must be less than 0, and the intervention should not be adopted.
The cost-effectiveness analysis examined net-benefit through multilevel multivariate regressions adjusting for the following covariates: treatment allocation, baseline measure of outcome (except in the case of the CGI, measured at follow-up only), total cost in the pre-baseline year, high/ low MINI score category, and the average time (in weeks) between prescribed depots (or mean depot treatment cycle) in the year prior to screening. The latter was controlled for as some patients' depot cycles changed over the period. The modelling allowed costs and outcomes to be correlated both within and between clusters, with random effects for the participating team clusters. Descriptive analyses were carried out using Stata 12 ; multilevel modelling was carried out in R using the lme function (part of the nlme package , following methods described in Ng  and Gomes et al. for fitting a bivariate normal response model. Error terms for costs and outcome equations were assumed to be normally distributed. The coefficients on the allocation term in the costs and effects equations (giving the cost and outcome differences, respectively, between groups) were used to derive NMB over a range of willingness to pay (£0 to £30 000) for the additional benefit associated with the intervention. The 95% confidence intervals for the ICER were calculated from the model estimates using Fieller’s method. Cost-effectiveness acceptability curves (CEACs) were constructed from the regression results, depicting the probability of the ICER being less than each willingness-to-pay value in the range. CEACs are useful in quantifying sampling uncertainty  and providing a graphical representation of the uncertainty facing purchasers in deciding whether to adopt an intervention.
We analysed participants’ data in the groups to which they had been randomised. The analyses retained cases where participants had depot data for at least 4 consecutive months in the community (participants could be absent because of long-term hospital or prison stays). We likewise calculated adherence for individuals with a minimum of 4 consecutive months’ data, the same criterion used in the screening period. We were uncertain whether patients who were out of the community for periods longer than one treatment cycle were receiving depots, and so we excluded these periods from the adherence measure’s numerator and denominator. We did not analyse data from participants who withdrew from participating in the trial and withdrew consent for the research team to access their medical records.
Data necessary to calculate both outcomes and costs were missing for some cases. Any cases where insufficient data were available to calculate adherence were counted as missing in the clinical effectiveness analyses. As described above, costs of medications received in the ‘gap’ between screening and trial entry dates were imputed and the number of depots adjusted, based on the estimate of adherence proportion in the pre-baseline period: as a result, the costs of cases lacking sufficient data to calculate baseline adherence were considered to be missing. In addition, where information was missing for all items of hospital or of community service use, the case was considered as missing. Only complete cases were used in the analysis.
Information was also extracted on times when participants 'did not attend' (DNA) sessions with health professionals. However, DNAs could either reflect a session that had been booked with the participant in a service setting but not attended, or an unsuccessful planned or unplanned community visit. Given that no duration information was available for DNAs and that the contact might have taken little staff time, we excluded DNAs from the main analysis. While DNAs possibly may entail substantial resource use, no data was available on the extent to which they consumed health professionals' time. We explored the impact of incorporating DNA costs into total costs in regressions as described for the main analysis, assigning these visits the same unit costs as successful contacts with participants.
As a consequence of using national reference costs for team contacts to value CMHT and assertive outreach team inputs, costs calculated may not reflect actual variability in skill-mix within participating teams; also the costs do not reflect particular team members' duration of contact with each participant. A concern might be that the method for valuing team contacts results in the over- or under-estimation of costs. To investigate this important component of costs’ overall contribution to the ICER, unit costs of assertive outreach and community mental health team contacts were varied by 25%, 50% and 150%.
Recruitment and sample size
One hundred and forty-one patients were recruited to the trial and randomised at the team (cluster) level (78 to intervention from 37 teams, 63 to control from 36 teams). In the intervention group, 73% (27/37) of teams were classified as having high MINI scores; in the control group, the corresponding proportion was 72% (26/36).
Seventy-three teams (141 patients) were randomised and 138 patients participated in the trial (78 intervention and 60 control). Two patients withdrew from the study after learning of their allocation to the control group; also, during data extraction from medical records at baseline, it was discovered that one control participant had not been prescribed depot medication and was withdrawn from the trial as ineligible. Seven intervention and four control participants were found on checks against baseline data to have been adherent over the 4-month period over which they had been screened and were retained in all analyses, as were four patients with excluded diagnoses (e.g. psychosis disorders other than schizophrenia, and schizo-affective or bipolar disorder). While complete or partial resource use data were available at baseline for 138 participants and at follow-up (the end of the 12 month study period) for 137 participants, data sufficient to calculate participants' total costs at both time-points were available for 117. Data sufficient to calculate the primary outcome at both time points were available for 71 intervention and 52 control participants (72 intervention and 55 control participants at baseline; 75 in intervention and 56 in control at follow-up). Economic and outcome data for both time points were available for 117 participants.
Characteristics of trial participants at baseline
Characteristics of participants with both costs and outcomes data available were somewhat balanced in terms of sex, living arrangements, ethnicity, employment status and diagnostic category (S1 Table). Intervention participants were slightly older (2.6 years) than controls. Within this sample, 61% of participants lived alone. Almost all participants were unemployed and on some form of welfare benefit. 40% of participants were from a black or other ethnic minority. Three-quarters of participants lived in independent accommodation, a fifth lived in supported housing, and a small number had only temporary accommodation or were homeless. Baseline characteristics of participants for whom complete costs and outcomes data were available and those of participants for whom any of these data were not available (including those withdrawing/withdrawn from the trial) are presented in S1 Table.
Resource use and costs
The majority of participants were treated by community mental health teams over the study period (40 control and 54 intervention participants were seen by 26 and 24 teams respectively); a smaller number were under the care of assertive outreach teams (9 and 13 teams seeing 17 control and 20 intervention participants respectively). There were few notable differences in resource use between the groups over this time (S2 Table). Intervention participants experienced fewer days in a mental health in-patient bed and more days in a general hospital in-patient bed than controls, but the differences between groups were not statistically significant at the 5% level. The intervention group experienced 0.03 fewer mental health admissions per head than the control group (0.37 (SE 0.1) intervention vs. 0.41 (SE 0.11) control). Admitted intervention participants had shorter stays on average than controls (27 (SE 7.7) days for 16 participants vs. 30.4 (SE 11.5) for 14 participants), a difference of 3.4 days (95% CI -30.7, 23.8). Intervention participants had significantly more contacts than controls with community mental health nurses in service settings (5.2 (95% CI 1, 9.5), p = 0.017). This finding appears consistent with the significantly greater number of depot medications received by intervention participants over the period (20.2 (SE 0.77) intervention vs. 14.9 (SE 0.97) control, a difference of 5.2 (95% CI 2.8, 7.6), t = -4.28, p = 0.000). DNAs associated with community mental health nurses in any setting were also fewer in the intervention group (1.9 (SE 0.4) intervention vs. 3.2 (SE 0.52) control, a difference of 1.4 (95% CI -2.6, -0.1), t = 2.102, p = 0.037)) (S3 Table).
Over pre-baseline and study periods, most participants received relatively low-cost medications, although a substantial minority in both groups received risperidone (S4 Table). The proportions within drug category did not generally differ substantially by group. Somewhat larger proportions of intervention than control patients received 2-week cycle depots of flupentixol in both pre-baseline (20% vs 8.7% respectively) and intervention periods (21.2% vs 12.3% respectively). A larger proportion of control than intervention patients received depots on a 4-week treatment cycle (18/56 (32%) vs. 13/75 (17%) respectively) over the study period.
Community mental health service costs were significantly higher in the intervention than in the control group (Table 2); however, this appears to be a continuation of an imbalance between groups in the number of contacts with these services over the pre-baseline period (S5 Table). The median number of financial incentives given over the study period was 21 (mean 20.2 as reported above; interquartile range 8); the average cost of the incentive itself was £303 (SE £12). Total costs of intervention participants, including the cost of providing the financial incentive, were somewhat higher than those of controls (£9,350 (SE £1,189) vs. £8,8651 (SE £1,890), a difference of £699 (95% CI -£3 535, £4 932). Community mental health services made up almost half (48%), hospital costs more than a third (37%) and medication costs 12%, of the total costs across the follow-up sample where data on all categories were available (n = 125). The average cost of the incentive itself made up only a small proportion (2%) of total intervention group costs.
Data from 60 clusters were analysed (31 intervention and 29 control) (Table A in S2 File). For the 117 participants with both outcomes and costs available, the difference in unadjusted mean proportions adherent was 14.2% and the difference in proportions with good adherence was 23.3% (Table 3). Mean differences in SQOL scores and CGI scores (proportion improved) were 19.3% and 18.2% respectively.
Comparing the costs of all the cases available at each time point (Table 2) to the costs of the sample available for analysis (table 3), the control group costs at both time points were somewhat higher than the corresponding values in the intervention group. It is possible that the adjusted cost difference between groups, if all the cases had sufficient data available at both time points to calculate costs and outcomes, might have been larger. However, given the standard errors of the unadjusted costs at both points, there is little evidence that the baseline and study-period costs of the complete-cases sample were truly different from those in the available cases.
From the multilevel multivariate regressions (Table 3), there was an adherence difference of 12.2% (95% CI 4.6%, 19.8%) on the primary trial outcome of proportion of medications adhered to. The proportion of participants achieving good adherence over the treatment period was 26.5% (95% CI 11.7%, 41.2%) higher in the intervention group than in the controls. The adjusted cost difference between groups was £598 (95% CI -£4 533, £5 730) on the continuous adherence outcome and £780 (95% CI -£4 419, £5 979) on the binary adherence outcome.
The ICER, or incremental cost for an increase in adherence to depot medications of 20%, was £982 (95% CI -£8 020, £14 000), and the probability that the incentive treatment was cost-effective on this measure (Fig 1) exceeded 97.5% at willingness to pay values over £14 000 (the upper confidence limit for the ICER). The incremental cost of achieving good adherence was £2 950 and the probability of cost-effectiveness (Fig 2) was over 97.5% at willingness to pay values for this outcome over £27 800.
The adjusted difference in total costs, if including DNA contact costs, was slightly lower than in the base case, at £432 (£10 054 control vs. £10 486 intervention) (Table 3). The cost of achieving a 20% increase in adherence was £706 (95% CI -£8 300, £13 540); the probability that the incentive treatment was cost-effective in terms of achieving a 20% increase in adherence exceeded 97.5% at a willingness to pay of £13 600.
Exploring the effect of varying the unit costs of team contacts, adjusted cost differences ranged from £90 (95% CI -£4 593, £4 774) if unit costs were 25% of those used in the base case to £1 072 (95% CI -£4 448, £6 592) if unit costs were increased by 150%. While adjusted total cost differences varied widely between the lowest and highest of these alternatives, confidence intervals were wide in all cases. ICERs for variations in unit costs of 25% and 150% were £146 (95% CI -£7 920, £11 160) and £1 770 (95% CI -£7 880, £16 380) respectively. ICERs were fairly insensitive to unit costs used, given that confidence intervals of all point estimates generated in this sensitivity analysis overlap substantially.
We examined two other outcomes: SQOL scores and clinical improvement measured by dichotomising CGI scores into improved and no change/worse. The proportion of missing data was high in both the CGI (19%; 18% of the control and 19% of the intervention group) and the SQOL (28%). In the latter case, considerably more data were missing from the control (39%) than from the intervention group (21%). Adjusted costs and outcomes from the multilevel regressions are given in Table 3; given the extent of missingness for both measures, ICERs have not been calculated. SQOL scores were slightly higher (higher satisfaction) in the intervention group (a difference of 0.698, p = 0.003); the proportion improved according to the dichotomised CGI was 12.5% higher in the intervention group (p = 0.320).
This study provides new evidence on the outcomes, costs and cost-effectiveness of offering a modest financial incentive to people on antipsychotic medication to remain adherent. Adjusting for area-level deprivation, average treatment cycle length, and pre-baseline period costs and adherence, costs were somewhat higher in the intervention group. However, the confidence interval of the difference in costs between groups was wide. The incremental cost of achieving a 20% increase in adherence was estimated to be £982. The financial incentive can be considered cost-effective in achieving this outcome with a very high level of confidence if the purchaser is willing to pay approximately £14 000. The incentive may have increased attendance at appointments with community mental health nurses. There is little evidence that the incentive decreased the costs of psychiatric or general secondary care; however, as the study was not powered to detect differences in hospital utilisation this result should be interpreted with caution. The results of the cluster-randomised trial suggest that the groups did not differ on broader societal outcomes such as police arrests or on take-up of training courses.
Previous studies suggest a relationship between adherence and desirable outcomes such as decreased risk of hospitalisation,  relapse  and more engagement with outpatient psychiatric treatment,  but do not indicate how much purchasers are willing to pay for adherence and what purchasers might hope to expect from improved adherence. Analysis of data from a trial examining the effectiveness of adherence therapy for people with schizophrenia found that non-adherence was not significantly associated with costs of health and social care, nor with use of inpatient hospital services.[38, 39] The link between improved adherence and better outcomes (as opposed to non-adherence and negative outcomes) is not necessarily straightforward—for instance Staring et al. found that improved adherence using a self-report measure did not increase subjective QOL or decrease psychiatric symptoms or hospital readmissions over a period of 6 months. Decision-makers will want to consider whether they are satisfied with the evidence that improving adherence improves other outcomes of interest to them. It should also be acknowledged that public attitudes do not appear to favour the use of financial incentives to improve health behaviours . Likewise, in the face of evidence that supports the use of financial incentives to improve medication adherence in a population with psychotic disorders, the approach remains controversial and clinicians may be reluctant to adopt this strategy [42–44].
The outcome data on clinical improvement and quality of life examined here were not very complete—due to non-completion by health professionals (CGI) or by participants (SQOL). The data collection method was designed to minimise the burden on trial participants imposed by completing questionnaires; such obligations could have deterred 'hard-to-reach' patients with poor adherence from agreeing to participate, posing a risk of selection bias. This collection method also minimised time burden on participating teams imposed by providing information, and enabled the collection of consistent information from a variety of teams across England. That considerable proportions of SQOL and CGI data were missing provides support for the decision to extract data from records, as administering resource use questionnaires to either professionals or participants could have led to similar problems of missing data. Objective measurement of adherence based on patient records was a strength of the study design; few observations were lost due to missing data on medications and depot dates. Nevertheless, cases were lost when insufficient data were available to calculate either cost or outcomes at both assessment points. In carrying out the cost-effectiveness modelling, we assumed that the information missing at follow-up was not different from that observed. The multilevel model employed did adjust for baseline costs/outcomes and deprivation covariates and thus for imbalances that could be related to reasons for loss to follow-up.
The design also limited collection activities to extracting information on NHS service use from participating organisations’ patient records. Records of use of services outside NHS Trusts’ own organisations may vary considerably depending on local information-sharing policy and practice. The extent to which records accurately reflected patients' use of primary care trusts' services is unknown.
We used a national reference cost per contact with mental health team members. Costs did not reflect inter-team variability in duration of contacts, as these data were mostly not available in the records. Consequently, any relationship between contact duration and adherence to depot medication was not reflected in our cost estimates. However using a single unit cost for all members of assertive outreach or community mental health team staff, while not reflecting actual local variations in skill mix in the total costs, may be more generalizable to the national context and reflect the potential variety of skill-mix in these teams across the country.
The results of this study raise further questions about the longer-term outcomes for patients in receipt of financial incentives. The next two phases of the study will provide an opportunity to track participants over a further two years after the end of the intervention period to examine outcomes and also to investigate the relationship between treatment cycles, receipt of incentive payments and adherence. It could be asked whether a larger monetary incentive than £15 per injection might have had a greater impact on medication adherence (a recent meta-analysis of study data drawn largely from fields other than mental health  found that interventions with monetary reinforcements over US $50 had greater efficacy than lower amounts). Or, it could equally be argued, these were substantial payments for patients, given that virtually all were in receipt of welfare benefits. Should financial incentives become routinely available, future research could usefully investigate whether adherent patients with psychosis are incentivised to become non-adherent in order to benefit from this policy. Such concerns have been raised in previous research with clinicians and patients . These situations did arise, according to clinicians in some teams implementing the intervention, but were characterised as short-lived and amenable to swift resolution in the context of a research trial..
While some teams involved in the trial reported the occurrence of these issues, they also described these situations as being resolved quickly in the context of a research trial . Currently there is little empirical evidence to suggest that financial incentives “crowd out”, or undermine, intrinsic motivation for health-related behaviours . We note that a new study in the Netherlands , examining ‘money for medication’ in patients with psychosis, proposes to address this question by explicitly measuring participants’ intrinsic motivation before and after the intervention. Another avenue for future research could be to examine whether patients with a first episode of psychosis are likely to benefit from financial incentives.
In summary, a financial incentive to improve adherence to antipsychotic depot medication had a high probability of cost-effectiveness (exceeding 97.5%), judged on either achieving a 20% increase in adherence or of achieving good adherence, at values of willingness to pay in the region of £14 000 and £27 800 respectively. Decision-makers may also wish to consider that direct healthcare costs (including costs of the financial incentive) are unlikely to be increased by offering a modest financial incentive.
S1 File. Depot medication counts and costs: methods.
S2 File. Cluster sizes and intra-cluster correlation coefficients.
S3 File. CHEERS statement for the FIAT economic evaluation.
S1 Table. Characteristics of participants at baseline.
S2 Table. Resource use at 12 month follow-up.
S3 Table. DNAs in community mental health services, all settings.
S4 Table. Numbers of participants receiving depot injections and average costs of injections, by BNF Chemical Name and treatment cycle, in 12 months prior to baseline and over 12 month intervention period, available cases.
S5 Table. Resource use in 12 months prior to baseline, available cases.
The study received ethical approval by the NRES Ealing and West London Research Ethics Committee, REC reference number 09/H0710/35. Membership of The Full FIAT Research Group is as follows: Richard Ashcroft, Claudia Ashton, Deborah Ashby, Kerri Bailey, Kirsten Barnicot, Stephen Bremner, Tom Burns, Anthony David, Philip Eldridge, Sandra Eldridge, Mike Firn, Alexandra Forrest, Connie Geyer, Elizabeth Highton Williamson, Catherine Henderson, Lauren Kelley, Martin Knapp, Christoph Lauber, Helen Morley, Nicola O’Connell, Stefan Priebe, Sarah Watkins, Elizabeth Williamson Highton, Ksenija Yeeles. The lead author affirms that the manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned (and, if relevant, registered) have been explained.
Conceived and designed the experiments: MK SP KY SB SE ASD TB CH. Performed the experiments: CH. Analyzed the data: CH. Wrote the paper: CH MK SP KY SB SE ASD NO TB. Conducted economic analysis: CH. Data collection and tools design: KY CH (economic data collection). Development of intervention: SP KY TB. Designing and conducting statistical analysis: SB SE. Study management: SP KY TB. Study supervision: SB, ASD, SE. Monitored recruitment and data collection: SP, KY, TB. Study implementation, data management and data cleaning: KY NO.
- 1. Leucht S, Tardy M, Komossa K, Heres S, Kissling W, Salanti G, et al. Antipsychotic drugs versus placebo for relapse prevention in schizophrenia: a systematic review and meta-analysis. Lancet. 2012;379(9831):2063–71. Epub 2012/05/09. pmid:22560607.
- 2. Leucht C, Heres S, Kane JM, Kissling W, Davis JM, Leucht S. Oral versus depot antipsychotic drugs for schizophrenia—a critical systematic review and meta-analysis of randomised long-term trials. Schizophr Res. 2011;127(1–3):83–92. Epub 2011/01/25. pmid:21257294.
- 3. Alvarez-Jimenez M, Priede A, Hetrick SE, Bendall S, Killackey E, Parker AG, et al. Risk factors for relapse following treatment for first episode psychosis: A systematic review and meta-analysis of longitudinal studies. Schizophrenia Research. 2012;139(1–3):116–28. pmid:22658527
- 4. Novick D, Haro JM, Suarez D, Perez V, Dittmann RW, Haddad PM. Predictors and clinical consequences of non-adherence with antipsychotic medication in the outpatient treatment of schizophrenia. Psychiat Res. 2010;176(2–3):109–13. WOS:000276830000003.
- 5. Novick D, Haro JM, Suarez D, Vieta E, Naber D. Recovery in the outpatient setting: 36-month results from the Schizophrenia Outpatients Health Outcomes (SOHO) study. Schizophrenia Research. 2009;108(1–3):223–30. pmid:19070991
- 6. Kreyenbuhl J, Slade EP, Medoff DR, Brown CH, Ehrenreich B, Afful J, et al. Time to discontinuation of first- and second-generation antipsychotic medications in the treatment of schizophrenia. Schizophrenia Research. 2011;131(1–3):127–32. pmid:21576008
- 7. Barnes TR. Evidence-based guidelines for the pharmacological treatment of schizophrenia: recommendations from the British Association for Psychopharmacology. J Psychopharmacol. 2011;25(5):567–620. Epub 2011/02/05. pmid:21292923.
- 8. Knapp M, King D, Pugner K, Lapuerta P. Non-adherence to antipsychotic medication regimens: associations with resource use and costs. Br J Psychiatry. 2004;184:509–16. Epub 2004/06/03. pmid:15172945.
- 9. Lage M, Hassan M. The relationship between antipsychotic medication adherence and patient outcomes among individuals diagnosed with bipolar disorder: a retrospective study. Annals of General Psychiatry. 2009;8(1):7.
- 10. Dilla T, Ciudad A, Alvarez M. Systematic review of the economic aspects of nonadherence to antipsychotic medication in patients with schizophrenia. Patient Prefer Adherence. 2013;7:275–84. Epub 2013/04/17. pmid:23589681; PubMed Central PMCID: PMC3622425.
- 11. Oberje EJ, de Kinderen RJ, Evers SM, van Woerkum CM, de Bruin M. Cost effectiveness of medication adherence-enhancing interventions: a systematic review of trial-based economic evaluations. Pharmacoeconomics. 2013;31(12):1155–68. Epub 2013/11/14. pmid:24222477.
- 12. Barkhof E, Meijer CJ, de Sonneville LMJ, Linszen DH, de Haan L. Interventions to improve adherence to antipsychotic medication in patients with schizophrenia—A review of the past decade. Eur Psychiat. 2012;27(1):9–18.
- 13. Hegedus A, Kozel B. Does adherence therapy improve medication adherence among patients with schizophrenia? A systematic review. Int J Ment Health Nurs. 2014;23(6):490–7. Epub 2014/10/04. pmid:25279684.
- 14. Claassen D, Fakhoury WK, Ford R, Priebe S. Money for medication: financial incentives to improve medication adherence in assertive outreach. Psychiatric Bulletin. 2007;31(1):4–7.
- 15. Burton A, Marougka S, Priebe S. Do financial incentives increase treatment adherence in people with severe mental illness? A systematic review. International Journal for Epidemiology and Psychiatric Sciences. 2010;19(3):233–42. WOS:000283037200010.
- 16. Priebe S, Burton A, Ashby D, Ashcroft R, Burns T, David A, et al. Financial incentives to improve adherence to anti-psychotic maintenance medication in non-adherent patients—a cluster randomised controlled trial (FIAT). BMC Psychiatry. 2009;9(1):61.
- 17. Giles EL, Robalino S, McColl E, Sniehotta FF, Adams J. The effectiveness of financial incentives for health behaviour change: systematic review and meta-analysis. PloS one. 2014;9(3):e90347. pmid:24618584; PubMed Central PMCID: PMC3949711.
- 18. Priebe S, Yeeles K, Bremner S, Lauber C, Eldridge S, Ashby D, et al. Effectiveness of financial incentives to improve adherence to maintenance treatment with antipsychotics: cluster randomised controlled trial. BMJ. 2013;347:f5847. Epub 2013/10/09. pmid:24100934.
- 19. NHS Choices. What are Mental Health Trusts? National Archives snap shot from 04/03/2010. NHS Choices; 2010. Available: http://webarchive.nationalarchives.gov.uk/20100304194334/ http://www.nhs.uk/chq/Pages/1077.aspx?CategoryID=68&SubCategoryID=153. Accessed 22 June 2015.
- 20. Glover GR, Leese M, McCrone P. More severe mental illness is more concentrated in deprived areas. British Journal of Psychiatry. 1999;175:544–8. pmid:10789351.
- 21. Glover GR, Robin E, Emami J, Arabscheibani GR. A needs index for mental health care. Soc Psychiatry Psychiatr Epidemiol. 1998;33(2):89–96. Epub 1998/03/21. pmid:9503992.
- 22. Guy W. National Institute of Mental Health (US). Psychopharmacology Research Branch. Division of Extramural Research Programs. ECDEU Assessment Manual for Psychopharmacology. Rockville, MD: US Dept. of Health, Education, and Welfare, Public Health Service, Alcohol, Drug Abuse, and Mental Health Administration, National Institute of Mental Health, Psychopharmacology Research Branch, Division of Extramural Research Programs; 1976.
- 23. Health and Social Care Information Centre—Prescribing Support Unit. Prescription Cost Analysis, England 2010. 2011 27th April 2011. Report No.
- 24. Curtis L, editor. Unit Costs of Health and Social Care 2011. Canterbury: Personal Social Services Research Unit; 2011.
- 25. Department of Health. Reference Costs 2010–11 Publication London: Department of Health, 2012.
- 26. Nelson T, Johnson S, Bebbington P. Satisfaction and burnout among staff of crisis resolution, assertive outreach and community mental health teams. A multicentre cross sectional survey. Soc Psychiatry Psychiatr Epidemiol. 2009;44(7):541–9. Epub 2008/12/17. pmid:19082906.
- 27. Evans S, Huxley P, Baker C, White J, Madge S, Onyett S, et al. The social care component of multidisciplinary mental health teams: a review and national survey. J Health Serv Res Policy. 2012;17 Suppl 2:23–9. Epub 2012/05/18. pmid:22572713.
- 28. Priebe S, Golden E, McCabe R, Reininghaus U. Patient-reported outcome data generated in a clinical intervention in community mental health care—psychometric properties. Bmc Psychiatry. 2012;12:113. WOS:000311219300001. pmid:22900667
- 29. Priebe S, McCabe R, Bullenkamp J, Hansson L, Lauber C, Martinez-Leal R, et al. Structured patient-clinician communication and 1-year outcome in community mental healthcare: cluster randomised controlled trial. Br J Psychiatry. 2007;191:420–6. Epub 2007/11/06. pmid:17978322.
- 30. Drummond M, Sculpher MJ, Torrance GW, O'Brien B, Stoddart GL. Methods for the Economic Evaluation of Health Care Programmes Third ed. Oxford: Oxford University Press; 2005.
- 31. StataCorp. Stata Statistical Software: Release 12.0. College Station, Texas: StataCorp LP; 2011.
- 32. Pinheiro J, Bates D, DebRoy S, Sarkar D, R Development Core Team. nlme: Linear and Nonlinear Mixed Effects Models. R package version 3.1–111. 2013.
- 33. Ng ESW. A review of mixed-effects models in S-plus (version 6.2). 2005.
- 34. Gomes M, Ng ES-W, Grieve R, Nixon R, Carpenter J, Thompson SG. Developing Appropriate Methods for Cost-Effectiveness Analysis of Cluster Randomized Trials. Medical Decision Making. 2012;32(2):350–61. pmid:22016450
- 35. Glick H. Economic evaluation in clinical trials. Oxford; New York: Oxford University Press; 2007. x, 244 p. p.
- 36. Morken G, Widen J, Grawe R. Non-adherence to antipsychotic medication, relapse and rehospitalisation in recent-onset schizophrenia. BMC Psychiatry. 2008;8(1):32.
- 37. Ascher-Svanum H, Zhu B, Faries D, Furiak N, Montgomery W. Medication adherence levels and differential use of mental-health services in the treatment of schizophrenia. BMC Research Notes. 2009;2(1):6.
- 38. King D, Knapp M, Patel A, Amaddeo F, Tansella M, Schene A, et al. The impact of non-adherence to medication in patients with schizophrenia on health, social care and societal costs. Analysis of the QUATRO study. Epidemiology and Psychiatric Sciences. 2013; FirstView:1–10.
- 39. Patel A, McCrone P, Leese M, Amaddeo F, Tansella M, Kilian R, et al. Cost-effectiveness of adherence therapy versus health education for people with schizophrenia: randomised controlled trial in four European countries. Cost Effectiveness and Resource Allocation. 2013;11(1):12. pmid:23705862
- 40. Staring AB, Van der Gaag M, Koopmans GT, Selten JP, Van Beveren JM, Hengeveld MW, et al. Treatment adherence therapy in people with psychotic disorders: randomised controlled trial. Br J Psychiatry. 2010;197(6):448–55. Epub 2010/12/02. pmid:21119150.
- 41. Promberger M, Brown RC, Ashcroft RE, Marteau TM. Acceptability of financial incentives to improve health outcomes in UK and US samples. Journal of Medical Ethics. 2011;37(11):682–7. WOS:000296202900010. pmid:21670321
- 42. Priebe S, Sinclair J, Burton A, Marougka S, Larsen J, Firn M, et al. Acceptability of offering financial incentives to achieve medication adherence in patients with severe mental illness: a focus group study. Journal of Medical Ethics. 2010;36(8):463–8. WOS:000280313000004. pmid:20581423
- 43. Petry NM, Rash CJ, Byrne S, Ashraf S, White WB. Financial reinforcers for improving medication adherence: findings from a meta-analysis. Am J Med. 2012;125(9):888–96. pmid:22800876; PubMed Central PMCID: PMC3432682.
- 44. Brown E, Gray R. Tackling medication non-adherence in severe mental illness: where are we going wrong? J Psychiatr Ment Health Nurs. 2015;22(3):192–8. pmid:25655400.
- 45. Highton-Williamson E, Barnicot K, Kareem T, Priebe S. Offering financial incentives to increase adherence to antipsychotic medication: the clinician experience. J Clin Psychopharmacol. 2015;35(2):120–7. Epub 2015/02/19. pmid:25692797; PubMed Central PMCID: PMC4352071.
- 46. Promberger M, Marteau TM. When do financial incentives reduce intrinsic motivation? comparing behaviors studied in psychological and economic literatures. Health Psychol. 2013;32(9):950–7. Epub 2013/09/05. pmid:24001245; PubMed Central PMCID: PMC3906839.
- 47. Noordraven EL, Audier CH, Staring A, Wierdsma AI, Blanken P, van der Hoorn B, et al. Money for medication: a randomized controlled study on the effectiveness of financial incentives to improve medication adherence in patients with psychotic disorders. BMC Psychiatry. 2014;14(1):343. Epub 2014/12/03. pmid:25438877; PubMed Central PMCID: PMC4258939.
- 48. Barrett B. Cost of bed day in alternatives to hospital care. Personal communication. 25/2/2013.
- 49. Slade M, Byford S, Barrett B, Lloyd-Evans B, Gilburt H, Osborn DPJ, et al. Alternatives to standard acute in-patient care in England: short-term clinical outcomes and cost-effectiveness. The British Journal of Psychiatry. 2010;197(Supplement 53):s14–s9.
- 50. Byford S, Sharac J, Lloyd-Evans B, Gilburt H, Osborn DPJ, Leese M, et al. Alternatives to standard acute in-patient care in England: readmissions, service use and cost after discharge. The British Journal of Psychiatry. 2010;197(Supplement 53):s20–s5.