Figures
Abstract
Background
Saskatchewan has implemented care pathways for several common health conditions. To date, there has not been any cost-effectiveness evaluation of care pathways in the province. The objective of this study was to evaluate the real-world cost-effectiveness of a chronic obstructive pulmonary disease (COPD) care pathway program in Saskatchewan.
Methods
Using patient-level administrative health data, we identified adults (35+ years) with COPD diagnosis recruited into the care pathway program in Regina between April 1, 2018, and March 31, 2019 (N = 759). The control group comprised adults (35+ years) with COPD who lived in Saskatoon during the same period (N = 759). The control group was matched to the intervention group using propensity scores. Costs were calculated at the patient level. The outcome measure was the number of days patients remained without experiencing COPD exacerbation within 1-year follow-up. Both manual and data-driven policy learning approaches were used to assess heterogeneity in the cost-effectiveness by patient demographic and disease characteristics. Bootstrapping was used to quantify uncertainty in the results.
Results
In the overall sample, the estimates indicate that the COPD care pathway was not cost-effective using the willingness to pay (WTP) threshold values in the range of $1,000 and $5,000/exacerbation day averted. The manual subgroup analyses show the COPD care pathway was dominant among patients with comorbidities and among patients aged 65 years or younger at the WTP threshold of $2000/exacerbation day averted. Although similar profiles as those identified in the manual subgroup analyses were confirmed, the data-driven policy learning approach suggests more nuanced demographic and disease profiles that the care pathway would be most appropriate for.
Conclusions
Both manual subgroup analysis and data-driven policy learning approach showed that the COPD care pathway consistently produced cost savings and better health outcomes among patients with comorbidities or among those relatively younger. The care pathway was not cost-effective in the entire sample.
Citation: Kuwornu JP, Maldonado F, Groot G, Cooper EJ, Penz E, Sommer L, et al. (2024) An economic evaluation of chronic obstructive pulmonary disease clinical pathway in Saskatchewan, Canada: Data-driven techniques to identify cost-effectiveness among patient subgroups. PLoS ONE 19(4): e0301334. https://doi.org/10.1371/journal.pone.0301334
Editor: Kuo-Cherh Huang, Taipei Medical University, TAIWAN
Received: July 24, 2023; Accepted: March 12, 2024; Published: April 1, 2024
Copyright: © 2024 Kuwornu et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The study datasets contain sensitive personal health information of participants and are held in a secure environment at the Saskatchewan Health Quality Council. All data used in this study are protected under the privacy policies of the data stewards of Saskatchewan health administrative data and Saskatchewan Health Quality Council. Signed confidentiality agreements prevent us from sharing the data since they are not publicly available. Access requires the approval of an ethics committee in Saskatchewan and the data custodians. Data access requests can be made to eHealth Saskatchewan through the following email servicedesk@ehealthsask.ca or by filling the form located at Request For Information - Request Form (ehealthsask.ca).
Funding: The study was funded under the 2019-20 Sprout Grant number 5190 by the Saskatchewan Health Research Foundation (SHRF) and Saskatchewan Centre for Patient-Oriented Research (SCPOR). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: Dr. Marciniuk has undertaken consulting with Alberta Health Services, Health Canada, Ontario Ministry of Health and Long-Term Care, Saskatchewan Health Authority, and Yukon Health and Social Services. He has provided research advisory and received research funding (managed and held by University of Saskatchewan) from AstraZeneca, Boehringer Ingelheim, Canadian Institutes of Health Research, GlaxoSmithKline, Grifols, Lung Saskatchewan, Novartis, Sanofi, Saskatchewan Health Research Foundation, and Schering-Plough. Dr. Marciniuk is an employee of the University of Saskatchewan, is a Board Member of the Saskatchewan Health Research Foundation and serves as Deputy Editor, CHEST Journal. Dr. Penz reports grants from Saskatchewan Health Research Foundation SPROUT grant, during the conduct of the study; grants and personal fees from Astra Zeneca, grants and personal fees from GlaxoSmithKline, grants and personal fees from Sanofi, personal fees from COVIS Pharma, personal fees from Boehringer Ingelheim, outside the submitted work; and she is the Co-Chair of the Canadian Thoracic Society COPD Assembly. She is the Co-Chair of the ACTonCOPD National Steering Committee. All other authors have no conflicts to disclose. These competing interests do not alter our adherence to PLOS ONE policies on sharing data and materials.
Introduction
The global economic and health burdens of chronic health conditions are mounting, and there is an urgent need for cost-effective chronic disease management programs. One example of a chronic disease management program that is rising in popularity is the care pathway (also called the clinical pathway). A care pathway is a structured, multidisciplinary care plan with the following characteristics: a) translates guidelines or evidence into local structures, b) details the steps in a course of treatment or care in a plan, guideline, or protocol, and c) aims to standardize care for a specific clinical problem, procedure or episode of healthcare in a specific population [1]. Saskatchewan, a province in Canada with a population of 1.13 million (2021), has implemented care pathways for several common and resource-intensive health conditions, including prostate cancer, acute stroke, and more recently, chronic obstructive pulmonary disease (COPD). Despite the investments since 2009, there has not been a rigorous evaluation of the cost-effectiveness of care pathways in the province [1, 2].
This study focuses on the economic evaluation of the COPD care pathway in Saskatchewan because an important consideration that speaks to the potential benefits and impact of the intervention is the burden of disease. COPD is the third leading cause of death worldwide, causing 3.23 million deaths in 2019 [3], and ranks as the 6th leading cause of global disability-adjusted life years [4]. COPD accounts for over 50% of chronic respiratory disease prevalence among adults [5], and for an astounding 81.7% of the total number of deaths from chronic respiratory diseases [6].
Previous studies that examined the cost-effectiveness of care pathways among individuals living with COPD used different names for the intervention, including integrated care pathway [7], person-centered care [8], integrated disease management program [9, 10], or respiratory coordinated care program [11]. Most of these studies were based on randomized control trials [8, 9], cluster randomized control trials [12, 13], or observational studies [11, 14, 15]. Different types of economic evaluations were used, including cost-effectiveness analysis [9, 12], budget impact analysis [7], and cost-minimization analysis [11, 16]. The most common effects (outcomes) investigated were quality-adjusted life years (QALYs) [8, 9, 13], 90-day mortality [15], patient’s exercise tolerance [14, 16], and frequency of exacerbations [12, 17]. Most of the studies found care pathways to be cost-effective regarding outcomes such as QALYs [8, 9, 13], hospital readmissions [11, 17], or physical activity [14]. Other studies found care pathways not to be cost-effective for reducing the frequency of exacerbations [12] or 90-day mortality [15].
Similar to our previous synthesis of the pertinent literature [1], two main issues crystalize from the overview of previous studies on the cost-effectiveness of COPD care pathways. First, except for one study [12], all previous studies reviewed presented “conventional” cost-effectiveness analyses. These types of cost‐effectiveness analyses compare the mean difference in health outcomes over the mean difference in costs between alternative treatments. However, decisions based on average cost-effectiveness measures may lead to incorrect treatment recommendations for specific subsets of the population and result in inefficient allocation of resources [18]. Accounting for patient heterogeneity (the variability in costs and/or health outcomes that is related to factors such as sociodemographic characteristics of patients) may help policy-makers target implementation strategies toward subgroups with the most advantageous cost‐effectiveness outcomes [19–22]. Second, while a few studies used observational study design methods, the vast majority of the studies we found were based on clinical trials [14, 15]. Care pathway interventions are generally broad, cutting across multiple care settings and are intended to improve the overall health of the patient [10]. These characteristics make care pathways difficult to be amenable to clinical trials, which are more suitable for tightly controlled interventions [10]. Clinical trial evaluations of care pathways reported in the literature usually tend to focus on only one healthcare sector, such as inpatient hospital care. Additional insights may be gained from observational studies that evaluate real-world implementations of COPD care pathways covering the patient’s experiences across the continuum of care [23].
This study improves upon the existing literature by adopting an observational study design to conduct real-world cost-effectiveness analysis of a COPD care pathway program and assessing the heterogeneities in cost-effectiveness across patient demographic and disease characteristics.
Methods
Intervention and study setting
The COPD care pathway began as a collaborative project between various organizations, including the former Regina Qu’Appelle Health Region (RQHR), the Saskatchewan Health Quality Council (HQC), the LiveWELL COPD program [24] in the former Saskatoon Health Region, the University of Saskatchewan, Saskatchewan Ministry of Health, and Lung Saskatchewan. The pathway relies on care coordination between local primary care providers, respirologists, respiratory therapists, pharmacists and nurses; with the goals of increasing quality of care and reducing healthcare utilization [1]. The COPD care pathway was implemented in the former RQHR, now called Regina Area of the Saskatchewan Health Authority (SHA), in September 2017. The COPD care pathway consists of a five-step process to provide coordinated patient navigation, including preventions programs, targeted screening, testing, diagnosis, and clinical management of the disease (Table 1) [1].
After a diagnosis of COPD is confirmed, clinical management of the disease includes both pharmacologic and non-pharmacologic therapies, including oxygen therapy, self-management with COPD Action Plan (developed by a patient and their healthcare provider), medication management, vaccination, and pulmonary rehabilitation. The pulmonary rehabilitation program offers supervised aerobic exercise training and COPD education aimed at relieving symptoms, slowing disease progression, improving quality of life, and decreasing hospital and unscheduled doctor visits, outcomes previously documented to improve with participation in pulmonary rehabilitation [25]. Patients were referred into the COPD care pathway from multiple sources, including family physicians, respirologists, respiratory therapists, internal medicine physicians, acute care nurse navigators, and intermediate care paramedics. Further details on the development and implementation of the COPD care pathway was previously published [1]. Only patients who provided written consent for their records to be linked with other administrative health data were included in the study.
Saskatchewan provides universal health care coverage for acute care visits (emergency department [ED] and hospital) and physician visits for the majority (about 99%) of the population except for persons covered by the federal government (i.e., members of the Canadian Armed Forces and Royal Canadian Mounted Police [RCMP], registered Indigenous status [First Nations and Inuit], people in federal correctional facilities, as well as individuals with refugee/asylum status). The province also provides supplemental prescription drug coverage for eligible individuals over age 65 years and for those with limited incomes.
Data sources
The study used population-based administrative health data from Saskatchewan, including emergency department (ED) records, hospital discharge abstracts, physician billing claims, outpatient prescription drug dispensation records, and population registration files. These data sets cover all residents of Saskatchewan regardless of whether the province or the federal government pays for the care. The data sets were deterministically linked together using an anonymized personal health identification number to create a longitudinal healthcare utilization record across the continuum of care for everyone included in the study. Access to the data sets was granted on June 14, 2021. Analyses were conducted at the secure data laboratory of the HQC, with the analyst having no access to personal identifying information of study participants. Ethics approval for the research was received from the Saskatchewan Health Authority Research Ethics Board (REB-20-69).
Intervention and control groups
The intervention group comprised of individuals aged 35+ years who were diagnosed with COPD and recruited into the COPD care pathway program in Regina (population 226,404) between April 1, 2018 and March 31, 2019. The control group included individuals 35+ years who were diagnosed with COPD and lived in Saskatoon (population 266,141) between April 1, 2018 and March 31, 2019. Both the intervention and the control groups met the criteria of a validated case definition for COPD [26]: (1) a hospital discharge abstract and/or physician visit with a diagnosis of COPD. Individuals with COPD diagnosis were identified using the International Classification of Diseases, 10th Revision, Canada (ICD-10-CA) codes J41, J42, J43 or J44 in the hospital discharge abstracts; whilst ICD-9 codes 491, 492 or 496 were used to identify individuals in the physician billing claims [27]. This case definitions has been used in previous studies [28, 29]. COPD patients residing in Saskatoon were selected as controls because Saskatoon and Regina are the two main urban centers in Saskatchewan (population > 200,000 in each center), and together account for about half of the provincial population.
The index date for patients in the COPD care pathway program was the date of recruitment. Referrals were made during contact with care providers for COPD-related reasons. For patients in the control group, the index date was the earliest hospitalization or physician visit date for COPD-related reasons in the corresponding recruitment period.
Costs
Healthcare costs.
Healthcare costs were calculated for inpatient hospitalizations, ED visits, physician visits (both general practitioners and specialists), and outpatient prescription drug dispensations in the one-year period before and after the index date. Hospital costs were estimated using the provincial average direct costs per weighted case. This standard methodology developed by the Canadian Institute for Health Information for all Canadian provinces, uses the product of resource intensity weights and provincial cost of a standard hospital stay to estimate cost of inpatient hospital stays at the patient level [30]. For the ED cost component, average costs per ED visit were obtained from the Ministry of Health and applied to ED visits during the follow-up period. The cost of a physician visit was the amount billed by the physician to the Saskatchewan Ministry of Health, the sole source of physician fee-for-service reimbursement in the provincial healthcare insurance plan. Prescription drug costs were based on the price of the active substance plus a dispensing fee and any applicable markups.
Costs were adjusted for inflation using the health and personal care (hospitalization, physician visits, ED visits) and the Medicinal and pharmaceutical products (prescription drugs dispensations) items of the Saskatchewan consumer price index [31] and expressed in 2019/20 constant Canadian dollars. The methods we used to estimate healthcare costs were applied in previous studies using Saskatchewan administrative health data [28, 29]. All healthcare costs were calculated from the perspective of a single public payer (i.e., the Saskatchewan Ministry of Health), excluding individual out-of-pocket expenditures such as copayments.
Cost of implementation.
Direct costs related to the development, implementation, and maintenance of the intervention program were tracked and allocated to patients in the COPD care pathway. These costs included patient recruitment, personnel, equipment, and facility rentals (see S1 Table for details). These costs were added to the total healthcare costs of patients who were in the care pathway.
Effects
Similar to costs, we measured effectiveness both in the one-year period before and after the index date. The measure of effectiveness was the number of days patients stayed within one-year period without experiencing acute COPD exacerbation. COPD exacerbations negatively affect patients’ quality of life and increase the risk of death [32]. We calculated the number of days patients experienced acute COPD exacerbations and subtracted these from 365 days. ICD-10-CA codes J41, J42, J43, J44 were used to identify episodes of acute COPD exacerbations in inpatient hospital and ED records, whilst ICD-9 codes 491, 492, 496 were used to identify episodes of acute COPD exacerbations in physician visit records. These codes were validated and previously used to identify episodes of COPD exacerbations from administrative health data in Saskatchewan [29]. The ICD-10-CA codes must be in the most responsible diagnosis field, or a diagnosis of an acute lower respiratory tract infection in the most responsible diagnosis field and a diagnosis of other COPD (ICD-10-CA code J44) in the second diagnosis field. The ICD-9 codes must be accompanied by outpatient dispensation of drugs used to treat acute exacerbations of COPD, including antibiotics, systemic corticosteroids, short-acting beta agonists (SABAs), and SABAs combined with anticholinergics within 2 days of the physician visit. Similarly, the number of days patients stayed in the one-year period prior to the index date without experiencing acute COPD exacerbation was calculated.
Patient and disease characteristics
The patient demographic characteristics included in the analysis were sex (i.e., male or female) and age group (i.e., 35–45, 46–55, 56–65, 66–75, 76+). Patients’ disease characteristics were estimated using a list of the 20 most common health conditions included in the Charlson comorbidity index [33] for our cohort; including health conditions such as congestive heart failure, depression, etc. These comorbid conditions were defined using ICD-9 and ICD-10-CA codes and were based on diagnoses in the hospital discharge abstract and the physician billing claims data. All variables were defined as of the index date except for the comorbid conditions, which were defined using data from the three-year period prior to the index date.
Statistical analysis
Propensity score matching.
We used propensity score matching to control for confounding and minimize the risk of bias in our analyses. All the listed demographic characteristics and 20 health conditions were included in the propensity score models. Individuals in the COPD care pathway group were matched to individuals in the control group using propensity score matching. We used one-to-one matching on the propensity scores with the nearest neighbor matching algorithm without replacement to form matched pairs of treated and untreated individuals. Standardized mean difference (SMD) was used to ascertain balance between groups, with SMD values of 0.1 and lower indicating balance.
Cost-effectiveness analysis.
Various analyses were undertaken to ascertain the effectiveness and cost-effectiveness of the COPD care pathway. Adjusted mean differences were calculated to show the average effect of intervention (i.e., effectiveness) on the outcome and healthcare cost, while the incremental cost-effectiveness ratio (ICER) and average net monetary benefit were used to ascertain cost-effectiveness. Costs and effects were not discounted due to the one-year follow-up used in the study. The cost-effectiveness analyses relied on a causal forest methodology [34] called cost-effectiveness analysis (CEA) forests developed by Bonander and Svensson [35]. The method was used to calculate the average cost-effectiveness in the entire sample and cost‐effectiveness across patient subgroups. While cost-effective subgroups can be identified manually, it may also be advantageous to use data-driven techniques to search for treatment allocation rules. These methods of learning treatment assignment policies, sometimes referred to as policy learning [36], are relatively new yet highly impactful area of research. The CEA forests approach is advantageous because it can (1) learn complex patterns of heterogeneity from the data without explicit assumptions on functional form and (2) identify subgroups automatically. We used both manually defined and data-driven (i.e., policy learning) approaches to identify subgroups where the COPD care pathway is more likely to be cost-effective. We also estimated the expected welfare gain [35] per population member when treatment allocation policy suggested by the data-driven approach were implemented as opposed to giving everyone the (1) control treatment or (2) the COPD care pathway.
Healthcare decision makers might be guided in estimating their willingness-to-pay (WTP) by considering the potential cost savings of the intervention. Previous Canadian studies have estimated an average cost of $955 per day of hospitalization for severe exacerbations [37] or an average of $3,036 for an acute episode of COPD exacerbation [38]. We considered these resource use estimates to select WTP threshold values ranging between $1,000 and $5,000/exacerbation day averted in our study.
Control of confounding and manual subgroup analysis.
The CEA forest model included the following as covariates: age, sex, the Charlson comorbidity score, and the 20 most common health conditions in the study cohort. We included these variables in the models because some of them potentially had residual confounding after matching since the SMD were not zeroes. Also, healthcare costs and the effects (i.e., number of days patients stayed without experiencing acute COPD exacerbation) in the one-year period prior to the index date were included in the CEA forest model as covariates. These latter variables were important because we were unable to measure severity of COPD cases. Controlling for healthcare costs and effects in the one-year period prior to the index date would likely minimize any potential confounding effects that may arise from differences in disease severity between the study groups.
The manually defined subgroup analyses were based on Charlson comorbidity index (score > = 2 vs score < 2), age (age > 65 years vs Age < = 65 years), and sex (male vs female). The cut-point for the comorbidity index allows for comparison between patients who had additional health conditions and those who only had COPD. Statistics Canada usually defines elderly persons as anyone over 65 years of age. Our age cut point allows for comparison between the elderly and younger patients.
Uncertainty and sensitivity analysis.
To quantify uncertainty in the estimates, bootstrapping was applied to the doubly robust scores with replacement after training the forest and was used to construct confidence intervals for ICERs as well as the cost‐effectiveness planes [35]. The cost-effectiveness acceptability curve (CEAC) was also used to quantify uncertainty in the results. CEAC illustrates the probability that the intervention group (i.e., COPD care pathway) is cost-effective compared with the control group.
All analyses were performed using R (version 4.1.0, R Foundation for Statistical Computing, Vienna, Austria). Statistical significance was determined by a p-value of <0.05.
Results
A total of 759 individuals with COPD who had continuous health coverage and met the age requirements between April 1, 2018 and March 31, 2019 were included in the COPD care pathway group. After the exclusion criteria were applied (i.e., not meeting the COPD case definition, not having continuous provincial health insurance coverage, etc.,) the remaining individuals were eligible to be included in the study as controls (Fig 1).
COPD: chronic obstructive pulmonary disease. FY: fiscal year.
Similar to our previous study [1], after one-to-one matching using propensity scores, all individuals in the COPD care pathway group (N = 759) were matched to the control group (N = 759). Overall, 1,518 individuals were included in the analysis (mean [SD] age, 62.6 [13.6] years; 857 females [56.4%]). All covariates except hypertension uncomplicated were balanced between the study groups based on the SMDs after matching (Table 2).
The cost-effectiveness results for the entire sample and sub-groups are reported in Table 3. The estimates indicate that the COPD care pathway was not cost-effective on average in the entire sample; using WTP threshold values ranging between $1,000 and $5,000/exacerbation day averted. The COPD care pathway was dominant among patients with comorbidities whilst the control treatment dominates the care pathway among patients without comorbidities, at the WTP threshold of $2,000/exacerbation day averted. The COPD care pathway was dominant among patients younger than 66 years whilst the control treatment dominates the care pathway among patients aged 66 years and above, at the WTP threshold of $2,000/exacerbation day averted. The control treatment dominates the COPD care pathway in both male and female subgroups, at the WTP threshold of $2,000/exacerbation day averted.
The uncertainty around ICERs reported for the entire sample was plotted on the cost-effectiveness plane using bootstrapping of the doubly robust scores with replacement (Fig 2). As shown in the cost-effectiveness plane, the bootstrapped replicates of ICERs were almost equally located in all four quadrants, with only 55.5% probability that the care pathway was cost-effective at WTP threshold of $2,000/exacerbation day averted (Fig 2). The Cost-effectiveness acceptability curve indicates the probability that the COPD care pathway is cost-effective compared with controls, for a range of WTP values that a decision maker might consider as the maximum cost they are willing to pay to avert one hospital day of acute COPD exacerbation. For example, given a maximum WTP of $10,000/exacerbation day averted, the probability that the COPD care pathway is cost-effective compared with control treatment is 0.58 (Fig 2).
COPD: chronic obstructive pulmonary disease. WTP: willingness to pay.
Similarly, the uncertainties in ICERs by subgroups are reported in the cost-effectiveness planes in Fig 3. Overall, the uncertainties in ICERs varied by patient subgroup.
COPD: chronic obstructive pulmonary disease. WTP: willingness to pay.
CEACs were used to quantify the uncertainties in cost-effectiveness by subgroups and reported in in Fig 4. Overall, the uncertainties in cost-effectiveness differed by patient characteristics.
Cost-effectiveness acceptability curves, by manually defined subgroups of (a) Charlson comorbidity index, (b) age, and (c) sex. COPD: chronic obstructive pulmonary disease.
One of the main rationales of empirical analysis of observational cost-effectiveness studies is to inform policy decisions on personalized treatment allocations based on observable covariates. Fig 5 shows the treatment allocations suggested by the data-driven policy learning approach we implemented, with the accompanying expected welfare gains. The treatment allocation suggested by the algorithm is to allocate the COPD care pathway to patients younger than 71 years with not more than two comorbid conditions or to patients younger than 38 years with more than two comorbid conditions (Fig 5). Compared to recommending the care pathway for all COPD patients, this personalized treatment allocation will allocate 63% of the patients to the care pathway and would result in an estimated welfare gain per population member of $4,901 ($1,807 –$7,996) (Table 4).
COPD: chronic obstructive pulmonary disease.
The results are based on the willingness to pay (WTP) threshold values of $2000. Values are expressed in 2020 Canadian dollars.
Discussion
Main findings
This study provided a comprehensive cost-effectiveness analysis comparing enrollees in a COPD care pathway to an independent control group. In the context of the overall sample, the COPD care pathway was not cost-effective compared to the control treatment, using WTP threshold values ranging between $1,000 and $5,000/exacerbation day averted. The results from the manual subgroup analyses revealed that the COPD care pathway was dominant (i.e., demonstrated cost saving and improved outcomes) among patients with comorbidities and individuals aged 65 years or younger. The data-driven approach recommended the pathway to patients with fairly similar demographic and disease profiles as those identified in the manual subgroup analysis.
The clinical management component of the COPD care pathway contains several interventions, including oral and inhaled medication management, a COPD Action Plan, chronic disease exercise rehabilitation, and oxygen therapy as required. It is probable some of these interventions may have heterogenous effects among individual subgroups. This may in part explain why the COPD care pathway was dominant for subgroups such as those with comorbidities. Older patients usually have more comorbidities compared to younger patients. Thus, since the care pathway was dominant for those with comorbidities, one might expect it to also be dominant for the elderly. However, the COPD pathway was dominant among individuals aged 65 years or younger, not older patients above age 65 years. This finding may be explained by the fact that the relationship between comorbidities and age is not linear in our study sample. In fact, a number of the younger patients (35–65 years) also had comorbidities. Secondly, it is possible younger individuals may be more adherent to the prescribed exercises in the chronic disease exercise rehabilitation component of the care pathway.
Acknowledging the reality that COPD is a heterogenous disease with various severities and patient phenotypes, it is perhaps not unexpected that benefit from the COPD care pathway was similarly heterogenous. These differences deserve further exploration in order to appropriately align benefit from the COPD care pathway with the patient population most likely to benefit. Further understanding these findings would also facilitate optimal use of limited resources and expertise.
Comparison with other studies
High-quality studies that evaluate cost differences and variability in cost-effectiveness in COPD interventions by patient characteristics are lacking, particularly those unique to the Canadian context [39]. These types of studies provide important information on the economic burden of the disease and provide understanding on the variations in resource use by various patient groups; all of which are critical for healthcare planning and health resource allocation. Previous studies that examined the cost-effectiveness of COPD care pathways mostly focused on outcomes such as quality-adjusted life years [8, 9, 13] or exercise tolerance [14, 16]. Majority of the studies found COPD care pathways to be cost-effective in relation to QALYs outcome [8, 9, 13]. The only study we found that examined the cost-effectiveness of care pathways in relation to COPD exacerbations was a Dutch randomized controlled trial [12]. Similar to our conclusion regarding the entire sample, the study [12] did not find the intervention to be cost-effective.
Strengths and weaknesses
This study used advanced statistical methods to conduct real-world cost-effectiveness analysis of a COPD care pathway program and assess the heterogeneities in cost-effectiveness across patient demographic and disease characteristics. Particularly, the use of two complementary approaches (i.e., manual subgroup analysis and data-driven policy learning) provided a nuanced assessment of the heterogeneous effects of the COPD care pathway.
Despite these strengths, the results of the study should be interpreted considering the following limitations. First, a common limitation of studies that use population-based administrative health data is the inability to include all potential confounders such as smoking status, physical activity, body mass index, and spirometry testing results (i.e., FEV1/FVC). The latter is used to assess the severity of airflow obstruction in COPD. Unfortunately, these variables were not routinely collected in the data sources we used, thus could not be included in our study. Notwithstanding, we controlled for a comprehensive list of comorbid conditions that may have differential impacts on health outcomes and healthcare costs.
Second, the study used a one-year follow-up period due to the recency of the COPD care pathway implementation and the lag between processing and release of the administrative health data sets. Because of this practical reality it is likely that some of the benefits of the intervention will accrue over a longer period. With the recent and phased implementation of the intervention (beginning in September 2017) it is possible benefits may further increase and become magnified with time.
Third, it is vital to fully appreciate that there are other endpoints and outcomes associated with optimal management of COPD. While frequency and duration of acute COPD exacerbations are important, other patient-centered symptoms such as shortness of breath and activity limitation are equally important to individual patients. The latter endpoints of shortness of breath and activity limitation were not included in our study because they were not routinely collected in the administrative health databases.
Finally, cost-benefit analysis (CBA) could be an appropriate economic evaluation method for our study, particularly if there were opportunities to broaden the scope of assessment of the costs and benefits of the intervention. CBA answers questions about value for money and provides guidance on deciding priorities for funding at the societal level. Consequently, CBA usually adopts broader societal perspective in assessing the costs and benefits of an intervention. We used CEA as our evaluation method since our study was conceived from the healthcare payer/decision-maker’s perspective, and we were limited to using health outcomes and costs contained in provincial health administrative data in Saskatchewan. For example, we did not have information to include items such as out-of-pocket costs and loss of productivity in our cost estimates. Again, we adopted the CEA over CBA because of challenges of monetizing the outcome of our study. Although we found Canadian studies that estimated average cost per day of hospitalization for severe exacerbations [38] and average cost per episode of COPD exacerbation [39], these do not match our outcome of interest. Our outcome measure was COPD exacerbation days averted, without restriction to severe exacerbations. Instead, we considered these resource use estimates reported in the studies as a guide for selecting the range of the decision maker’s WTP threshold. Similar to a previous study [40], we reasoned that healthcare decision makers might be guided in estimating their WTP by considering the potential cost savings of the intervention, which may be reflected in these cost estimates reported in the two studies cited above. Studies that use the net-benefit framework for CEA adopt different approaches for using WTP thresholds to monetize health benefits. Like our study, some studies selected their WTP thresholds based on resource use [40], whilst others use hypothetical ranges of WTP thresholds [41] or ranges of WTP threshold values close to the ICER [42]. The impacts of these choices on cost-effectiveness conclusions can be examined in future studies. Also, future studies can explore the use of CBA in evaluating interventions such as the COPD care pathway. This will enable value for money comparisons between the intervention and other interventions, even beyond the health sector, in order to facilitate priority setting at the societal level.
Conclusions
Overall, the COPD care pathway was not cost-effective in comparison to the control treatment in the entire sample. However, both manual subgroup analysis and data-driven policy learning approaches showed that the COPD care pathway consistently produced cost savings and better health outcomes among patients with comorbidities or among those relatively younger. This suggests that instead of recommending the care pathway to all COPD patients, personalized treatment allocation may provide greater value. However, the feasibility and practical implications of selectively recommending the care pathway to patient subgroups may require further considerations, which were beyond the scope of this study.
Acknowledgments
The authors are grateful to Patricia Comfort and LaVerne Miller for providing technical advice and participating in overall project planning and execution. The authors are also grateful to Beliz Acan Osman for providing technical expertise in the use of administrative health data housed at the Saskatchewan Health Quality Council. This study is based in part on de-identified data provided by the Saskatchewan Ministry of Health, eHealth Saskatchewan, and Saskatchewan Health Authority. The interpretations and conclusions contained herein do not necessarily represent those of the Government of Saskatchewan, Saskatchewan Ministry of Health, eHealth Saskatchewan, and Saskatchewan Health Authority.
References
- 1. Kuwornu JP, Maldonado F, Cooper EJ, Groot G, Penz E, Reid A, et al. Impacts of Chronic Obstructive Pulmonary Disease Care Pathway on Healthcare Utilization and Costs: A Matched Multiple Control Cohort Study in Saskatchewan, Canada. Value Heal. 2023;26:1334–44. pmid:37187234
- 2. Plishka CT, Rotter T, Penz ED, Hansia MR, Fraser SKA, Marciniuk DD, et al. Effects of Clinical Pathways for COPD on Patient, Professional, and Systems Outcomes: A Systematic Review. Chest. 2019;156:864–77. pmid:31150639
- 3.
Cao Bochen, Gretchen A. Stevens JHand DMF. WHO methods and data sources for country-level causes of death. Geneva: World Health Organization. 2020. http://www.who.int/gho/mortality_burden_disease/en/index.html. Accessed 25 Feb 2023.
- 4. Abbafati C, Abbas KM, Abbasi-Kangevari M, Abd-Allah F, Abdelalim A, Abdollahi M, et al. Global burden of 369 diseases and injuries in 204 countries and territories, 1990–2019: A systematic analysis for the Global Burden of Disease Study 2019. Lancet. 2020;396:1204–22. pmid:33069326
- 5. Soriano JB, Kendrick PJ, Paulson KR, Gupta V, Abrams EM, Adedoyin RA, et al. Prevalence and attributable health burden of chronic respiratory diseases, 1990–2017: A systematic analysis for the Global Burden of Disease Study 2017. Lancet Respir Med. 2020;8:585–96.
- 6. Levine SM, Marciniuk DD. Global Impact of Respiratory Disease: What Can We Do, Together, to Make a Difference? Chest. 2022;161:1153–4. pmid:35051424
- 7. Trout D, Bhansali AH, Riley DD, Peyerl FW, Lee-Chiong TL. A quality improvement initiative for COPD patients: A cost analysis. PLoS One. 2020; 15(7): e0235040. pmid:32628684
- 8. Pirhonen L, Gyllensten H, Olofsson EH, Fors A, Ali L, Ekman I, et al. The cost-effectiveness of person-centred care provided to patients with chronic heart failure and/or chronic obstructive pulmonary disease. Heal Policy OPEN. 2020;1:100005. pmid:37383310
- 9. Scarffe AD, Licskai CJ, Ferrone M, Brand K, Thavorn K, Coyle D. Cost-effectiveness of integrated disease management for high risk, exacerbation prone, patients with chronic obstructive pulmonary disease in a primary care setting. Cost Eff Resour Alloc. 2022;20:1–16.
- 10. George PP, Heng BH, Lim TK, Abisheganaden J, Keong Ng AW, Verma A, et al. Evaluation of a disease management program for COPD using propensity matched control group. J Thorac Dis. 2016;8:1661–71. pmid:27499955
- 11. Aslam S, Man J, Behary J, Riskallah J, Ansary S, CH Kwan B. Outcomes and Cost Effectiveness of a Respiratory Coordinated Care Program in Patients with Severe or Very Severe COPD. Open J Respir Dis. 2016;06:52–7.
- 12. Boland MRS, Kruis AL, Tsiachristas A, Assendelft WJJ, Gussekloo J, Blom CMG, et al. Cost-effectiveness of integrated COPD care: The RECODE cluster randomised trial. BMJ Open. 2015;5. pmid:26525419
- 13. Bourbeau J, Granados D, Roze S, Durand-Zaleski I, Casan P, Köhler D, et al. Cost-effectiveness of the COPD patient management european trial home-based disease management program. Int J COPD. 2019;14:645–57. pmid:30936689
- 14. Tsiachristas A, Burgers L, Rutten-Van Mölken MPMH. Cost-Effectiveness of Disease Management Programs for Cardiovascular Risk and COPD in the Netherlands. Value Heal. 2015;18:977–86. pmid:26686781
- 15. Dixon P, Hollingworth W, Benger J, Calvert J, Chalder M, King A, et al. Observational Cost-Effectiveness Analysis Using Routine Data: Admission and Discharge Care Bundles for Patients with Chronic Obstructive Pulmonary Disease. PharmacoEconomics—Open. 2020;4:657–67. pmid:32215856
- 16. Ninot G, Moullec G, Picot MC, Jaussent A, Hayot M, Desplan M, et al. Cost-saving effect of supervised exercise associated to COPD self-management education program. Respir Med. 2011;105:377–85. pmid:21036024
- 17. Bandurska E, Damps-Konstańska I, Popowski P, Jędrzejczyk T, Janowiak P, Świętnicka K, et al. Cost-effectiveness analysis of integrated care in management of advanced chronic obstructive pulmonary disease (COPD). Med Sci Monit. 2019;25:2879–85. pmid:31002103
- 18. Espinoza MA, Manca A, Claxton K, Sculpher MJ. The value of heterogeneity for cost-effectiveness subgroup analysis: Conceptual framework and application. Med Decis Mak. 2014;34:951–64. pmid:24944196
- 19. Glasgow MJ, Edlin R, Harding JE. Cost burden and net monetary benefit loss of neonatal hypoglycaemia. BMC Health Serv Res. 2021;21:1–13.
- 20. Udeh BL. Economic Evaluation Studies. CHEST. 2020;158:S88–96. pmid:32658657
- 21. Husereau D, Drummond M, Augustovski F, Briggs AH, Carswell C, Caulley L, et al. Consolidated Health Economic Evaluation Reporting Standards 2022 (CHEERS 2022) statement: updated reporting guidance for health economic evaluations. BJOG An Int J Obstet Gynaecol. 2022;129:336–44.
- 22. Bilcke J, Beutels P. Generating, Presenting, and Interpreting Cost-Effectiveness Results in the Context of Uncertainty: A Tutorial for Deeper Knowledge and Better Practice. Med Decis Mak. 2022;42:421–35. pmid:34651515
- 23. Moffatt S, Wildman J, Pollard TM, Penn L, O’Brien N, Pearce MS, et al. Evaluating the impact of a community-based social prescribing intervention on people with type 2 diabetes in North East England: Mixed-methods study protocol. BMJ Open. 2019;9. pmid:30782761
- 24.
The Live Well COPD program. https://www.saskatoonhealthregion.ca/locations_services/Services/cdm/Pages/Programs/COPD.aspx. Accessed 28 Dec 2022.
- 25. Rochester CL, Vogiatzis I, Holland AE, Lareau SC, Marciniuk DD, Puhan MA, et al. An official American Thoracic Society/European Respiratory Society policy statement: Enhancing implementation, use, and delivery of pulmonary rehabilitation. Am J Respir Crit Care Med. 2015;192:1373–86. pmid:26623686
- 26. Camp PG, Levy RD. A snapshot of chronic obstructive pulmonary disease in British Columbia and Canada. BCMJ. 2008;50:80–4.
- 27. Gershon AS, Mecredy GC, Guan J, Victor JC, Goldstein R, To T. Quantifying comorbidity in individuals with COPD: A population study. Eur Respir J. 2015;45:51–9. pmid:25142481
- 28. Kuwornu JP, Teare GF, Quail JM, Forget E, Muthukumarana S, Wang XE, et al. Comparison of the accuracy of classification models to estimate healthcare use and costs associated with COPD exacerbations in Saskatchewan, Canada: A retrospective cohort study. Can J Respir Ther. 2017;53:37–44. pmid:30996632
- 29. Kuwornu JP, Lix LM, Quail JM, Forget E, Muthukumarana S, Wang XE, et al. Identifying distinct healthcare pathways during episodes of chronic obstructive pulmonary disease exacerbations. Med (United States). 2016;95:1–8. pmid:26945376
- 30.
Canadian Institute for Health Information. Cost of a standard hospital stay. https://www.cihi.ca/en/indicators/cost-of-a-standard-hospital-stay. 2022. Accessed 13 Apr 2023.
- 31.
Statistics Canada. The Consumer Price Index. https://www150.statcan.gc.ca/n1/en/catalogue/62-001-X. Accessed 13 Apr 2023.
- 32. May SM, Li JTC. Burden of chronic obstructive pulmonary disease: Healthcare costs and beyond. Allergy Asthma Proc. 2015;36:4–10. pmid:25562549
- 33. Charlson ME, Carrozzino D, Guidi J, Patierno C. Charlson Comorbidity Index: A Critical Review of Clinimetric Properties. Psychother Psychosom. 2022;91:8–35.
- 34. Blakely T, Lynch J, Simons K, Bentley R, Rose S. Reflection on modern methods: When worlds collide—Prediction, machine learning and causal inference. Int J Epidemiol. 2020;49:2058–64.
- 35. Bonander C, Svensson M. Using causal forests to assess heterogeneity in cost‐effectiveness analysis. Health Econ. 2021;30:1818–32. pmid:33942950
- 36. Sverdrup E, Kanodia A, Zhou Z, Athey S, Wager S. policytree: Policy learning via doubly robust empirical welfare maximization over trees. J Open Source Softw. 2020;5:2232.
- 37. Mittmann N, Kuramoto L, Seung SJ, Haddon JM, Bradley-Kennedy C, FitzGerald JM. The cost of moderate and severe COPD exacerbations to the Canadian healthcare system. Respir Med. 2008;102:413–21. pmid:18086519
- 38. Maleki-Yazdi MR, Kelly SM, Lam SYS, Marin M, Barbeau M, Walker V. The burden of illness in patients with moderate to severe chronic obstructive pulmonary disease in Canada. Can Respir J. 2012;19:319–24. pmid:23061077
- 39. Mittmann N, de Oliveira C. Importance of cost estimates and cost studies. Curr Oncol. 2016;23:S6. pmid:26985149
- 40. Jenkyn KB, Hoch JS, Speechley M. How much are we willing to pay to prevent a fall? Cost-effectiveness of a multifactorial falls prevention program for community-dwelling older adults. Can J Aging. 2012;31:121–37. pmid:22621837
- 41. Blæhr EE, Væggemose U, Søgaard R. Effectiveness and cost-effectiveness of fining non-attendance at public hospitals: A randomised controlled trial from Danish outpatient clinics. BMJ Open. 2018;8. pmid:29654019
- 42. Hounton S, Newlands D. Applying the net-benefit framework for analyzing and presenting cost-effectiveness analysis of a maternal and newborn health intervention. PLoS One. 2012; 7(7): e40995. pmid:22829906