Generalized anxiety disorder (GAD) is a debilitating mental health illness that affects approximately 3.1% of U.S. adults and can be treated with cognitive behavioral therapy (CBT). With the emergence of digital health technologies, mobile CBT may be a cost-effective way to deliver care. We developed an analysis framework to quantify the cost-effectiveness of internet-based CBT for individuals with GAD. As a case study, we examined the potential value of a new mobile-delivered CBT program for GAD.
We developed a Markov model of GAD health states combined with a detailed economic analysis for a cohort of adults with GAD in the U.S. In our case study, we used pilot program efficacy data to evaluate a mobile CBT program as either prevention or treatment only and compared the strategies to traditional CBT and no CBT. Traditional CBT efficacy was estimated from clinical trial results. We calculated discounted incremental costs and quality-adjusted life-years (QALYs) over the cohort lifetime.
Case study results
In the base case, for a cohort of 100,000 persons with GAD, we found that mobile CBT is cost-saving. It leads to a gain of 34,108 QALYs and 81,492 QALYs and a cost reduction of $2.23 billion and $4.54 billion when compared to traditional CBT and no CBT respectively. Results were insensitive to most model inputs and mobile CBT remained cost-saving in almost all scenarios.
The case study was conducted for illustrative purposes and used mobile CBT efficacy data from a small pilot program; the analysis should be re-conducted once robust efficacy data is available. The model was limited in its ability to measure the effectiveness of CBT in combination with pharmacotherapy.
Citation: Kumar S, Jones Bell M, Juusola JL (2018) Mobile and traditional cognitive behavioral therapy programs for generalized anxiety disorder: A cost-effectiveness analysis. PLoS ONE 13(1): e0190554. https://doi.org/10.1371/journal.pone.0190554
Editor: Soraya Seedat, Stellenbosch University, SOUTH AFRICA
Received: June 24, 2017; Accepted: December 16, 2017; Published: January 4, 2018
Copyright: © 2018 Kumar et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: Thrive Network, Inc. (DBA, Lantern) supported this study. Lantern employees provided access to Lantern efficacy datasets and answered clarifying questions about the program but were otherwise not involved in the analysis or interpretation of the data. The Lantern efficacy data is automatically stored on HIPAA compliant servers and was shared directly with Evidation Health without any manipulation other than to ensure de-identification of all data.
Competing interests: Dr. Jessie Juusola and Ms. Shefali Kumar are employees of Evidation Health. At the time of this analysis, Dr. Megan Jones Bell was an employee of Lantern. This study was funded by Thrive Network, Inc. (DBA, Lantern). This does not alter our adherence to PLOS ONE policies on sharing data and materials.
Approximately 3.1% of the adult population in the United States (6.8 million adults) is affected by generalized anxiety disorder (GAD), a chronic and debilitating mental health illness that is characterized by low spontaneous remission rates and frequent relapse after remission [1–3]. Individuals with GAD experience persistent worry and anxiety, which often interferes with their ability to perform routine activities and function normally in social settings and the workplace . Studies have shown that GAD is associated with a significant societal burden, including reduced economic productivity and increased healthcare utilization [5, 6]. Up to 60% of individuals with anxiety also experience comorbid mental health illnesses and addictions, particularly major depressive disorder (MDD) and substance abuse, as well as social anxiety disorder and post-traumatic stress disorder [4, 5, 7–9]. This is associated with even worse disability, diminished functioning and impairment .
While GAD can be treated with pharmacotherapy, studies have demonstrated that cognitive behavioral therapy (CBT) is also an effective treatment method for GAD . However, many individuals with GAD in the U.S. do not receive adequate or even any amount of treatment [11, 12]. One analysis using data from the National Comorbidity Survey found that only 20% of individuals with GAD visited a healthcare specialist (e.g., psychologist, psychiatrist) in a given year . This treatment gap is partially due to structural and financial barriers that prevent access to healthcare specialists and traditional face-to-face CBT . Internet-based interventions may provide an effective but more widely-accessible and cost-effective alternative to traditional CBT [14, 15], and may also offer greater opportunity to utilize CBT as prevention, where research indicates it may also be effective .
A recent systematic review showed that internet-based CBT programs were cost-effective when compared to status quo for individuals with broad anxiety disorders . However, most cost-effectiveness analyses and economic evaluations that examine CBT programs have focused on multiple anxiety disorders (e.g., GAD, panic disorder and obsessive compulsive disorder); for models and analyses that do specifically look only at a population with GAD, the intervention(s) being examined are often various pharmacotherapy options, not CBT programs . In addition, despite the value of conducting a cost-effectiveness analysis from both the payer and societal perspective , the majority of economic models and evaluations that examine anxiety interventions do not take the societal perspective . Overall, there is limited research on the cost-effectiveness of internet-based CBT programs specifically for GAD in the U.S., as compared to traditional CBT or no CBT, from both the payer and the societal perspective [6, 17].
In this study, we aimed to develop a model and a framework for analysis that would help researchers quantify the cost-effectiveness of internet-based CBT for individuals with GAD in the U.S. from both a payer and societal perspective. As a case study and as an application of this model, we used this framework to examine the potential value of a new mobile-delivered, guided self-help CBT program for GAD (Thrive Network, Inc. [DBA, Lantern], San Francisco, CA), which we refer to as mobile CBT [19, 20]. We used initial clinical effectiveness data for this mobile CBT program to estimate the program’s potential cost-effectiveness as compared to traditional or no CBT.
Overview and model structure
We designed and built a computer-simulated Markov model of GAD progression and treatment to assess the effectiveness and cost-effectiveness of GAD treatment and prevention programs for a cohort of 100,000 adults with GAD in the U.S. We calibrated the model to published literature reporting the cost of healthcare utilization for GAD [6, 9, 21], and estimated the quality-adjusted life-years (QALYs) gained and the costs of various GAD prevention and treatment strategies over the cohort lifetime. We ran the model with a societal perspective as well as a payer perspective, and discounted costs and QALYs at 3% annually . We implemented the model in TreeAge Pro 2016 (TreeAge Software, Williamstown, Massachusetts). Key model parameters are presented in Table 1.
Structure of GAD model
Our Markov model includes 7 health states (Fig 1) with a 3-month cycle length [30, 31]. The 4 anxiety states are based on the cut-off scores from the Generalized Anxiety Disorder-7 (GAD-7) scale, with the first state being “no anxiety,” defined as GAD-7 of 0 to 4 . In the base case analysis, persons began in the “mild anxiety,” “moderate anxiety” or “severe anxiety” states. Every cycle, persons could transition to a healthier GAD state, progress to a more severe GAD state (e.g., relapse), stay at the same state, or die. In order to measure the full clinical and economic burden of GAD, we included a “moderate anxiety with comorbidities” state and “severe anxiety with comorbidities” state in our model, where comorbidities were defined as MDD and/or substance abuse. These comorbidities occur often with clinically diagnosed GAD and can greatly impact health-related costs and QALYs [5, 8, 9]. Persons could only progress to these states after the first cycle. Transition rates between states were estimated from the published literature (S1 Table). We adhered to guidelines for best practice procedures for economic modeling in designing and parameterizing the model .
This model includes 7 health states where persons can move between states at 3-month intervals. In the base case, all persons begin in the “mild anxiety,” “moderate anxiety” or “severe anxiety” states. In the prevention only case, all persons begin in the “mild anxiety” state. In the treatment only case, all persons begin in the “moderate anxiety” or “severe anxiety” state. Every cycle, persons could transition to a healthier GAD state, progress to a more severe GAD state (e.g., relapse), remain in the same state, or die.
Pharmaceutical drugs are often used to treat GAD alone or in combination with CBT . In our model, we assumed that 58.6% of the cohort was consistently on some form of pharmacotherapy, based on published literature . This proportion remained constant for all strategies examined, and did not change as an individual moved between states, due to a lack of data breaking out GAD progression by whether a person is on medication. Hence, pharmacotherapy was only factored into cost calculations and did not impact transition rates.
Persons with no or mild anxiety (GAD-7 score of 0–9) usually do not have clinically diagnosable anxiety and are not treated [32, 33]. Persons with moderate or severe anxiety (GAD score of 10–21) likely have clinically diagnosable GAD  and are recommended to receive treatment . In order to evaluate an internet-based CBT program as treatment, prevention or both, we examined 3 scenarios for analysis. In the base case, the program was used as both prevention and treatment, and the starting cohort was distributed amongst the “mild anxiety,” “moderate anxiety” and “severe anxiety” states (Table 1). In the prevention-only scenario, the entire cohort started in the “mild anxiety” state with CBT as a preventive intervention. In the treatment-only scenario, the entire starting cohort was either in the “moderate anxiety” or “severe anxiety” states.
GAD prevention and treatment strategies
We considered two options as comparators to internet-based CBT programs for this analysis: traditional face-to-face CBT programs and status quo. Per cost-effectiveness analysis guidelines, considering multiple comparators is beneficial, and comparators should be relevant alternatives to the intervention . Traditional face-to-face CBT is a current alternative to internet-based CBT programs and can be used for GAD prevention and treatment. The status quo strategy assumed that patients did not receive CBT, but potentially received other forms of treatment such as pharmacotherapy.
We assumed that GAD patients receiving either the internet-based or traditional face-to-face CBT program would begin immediately and would participate in the program for 3 months, which is the equivalent to approximately 12–20 CBT sessions as suggested by the Anxiety and Depression American Association treatment guidelines .
For the strategy of traditional face-to-face CBT programs, we assumed standard program characteristics based on available literature. A CBT session is a one-on-one meeting between a patient and a trained therapist that takes place in an in-office setting. Sessions are typically one hour long and cover relaxation techniques, psychoeducation, and problem-solving techniques .
Traditional face-to-face CBT efficacy data came from a published Cochrane review on GAD therapy effectiveness. Results from 6 studies examining CBT as treatment for GAD showed that approximately 42% of study participants clinically responded to CBT (i.e., moved to a lower GAD state) . This clinical response rate was applied to the various anxiety states to match the structure of the state-specific efficacy data of the Markov model (S1 Table). The review did not provide information on completion rates, so we assumed that the clinical response rate reported from these studies was based on an intent-to-treat population, and therefore assumed that program completion rates were already factored into efficacy data .
The model included a time-based linear function to capture both the traditional face-to-face CBT and internet-based CBT strategies’ waning effect over time . The interventions’ effect was fully sustained for the first year, or the first 4 model cycles . This included the first 3 months when persons were receiving the intervention, and the following 9 months after they received the intervention. After this first year, the effectiveness of the intervention gradually decreases over the lifetime of the cohort until the state transition rates are the same as for the status quo at the end of the model timeframe.
Case study: Mobile CBT
To illustrate the potential impact of internet-based CBT programs using our model and proposed analysis, we used pilot program efficacy data for a particular new mobile CBT program. This mobile CBT program for GAD is based on the work of Newman et al. and allows individuals to complete interactive CBT learnings and techniques to help them manage their anxiety and receive individualized support from a coach over a 3-month program [36, 37]. The mobile CBT program is comprised of 8 self-guided CBT-based modules that participants complete, including modules on relaxation, mindfulness, cognitive reframing and behavior change. These modules include a combination of education and practice, including daily audio-guided or self-guided interactive and personalized CBT techniques to help them manage their anxiety. A trained coach, with a health and wellness coaching or psychology background, provides support and motivational enhancement via asynchronous in-app messages. Participants can access the program on a smartphone application. Mobile CBT efficacy data came from a pilot program conducted at a large national employer group of approximately 10,000 employees. Eligible employees were offered access to the mobile CBT program, and 410 enrolled. Of those who enrolled, 89 completed baseline and month 3 GAD-7 questionnaires, and provided consent. Persons provided consent, via the smartphone application, for their data to be used for research purposes prior to participation in the program. The mobile CBT program is HIPAA compliant and de-identified data was provided by the program developer to the researchers using an encrypted, secure data transfer. Given that this initiative was designed as a program evaluation, no institutional review board (IRB) approval was obtained. Data analysis on a sample of 89 individuals from the pilot program was conducted independently by the Evidation Health researchers.
Before enrolling in the mobile CBT program, persons completed a baseline GAD-7 screen. At the end of the 3-month program, persons completed another GAD-7 test . Overall, 70% of participants clinically responded to CBT (i.e., moved to a lower GAD state); state-specific mobile CBT program efficacy was calculated directly from pilot program data (S1 Table). Effect sizes seen in this pilot program were comparable to efficacy demonstrated from other larger, robust studies examining internet-based CBT programs [15, 38]. This mobile CBT efficacy data replaced the transition rates for individuals in the “mild anxiety,” “moderate anxiety,” or “severe anxiety” states. Given the structure and design of the pilot, it can be assumed that the majority of the participants who completed the 3-month GAD-7 test also completed the mobile CBT program, and thus program completion rates were implicitly factored into efficacy data.
Health outcomes and costs
We simulated the population over time and calculated discounted costs, discounted QALYs and cumulative (undiscounted) life years with and without anxiety for each scenario. We estimated quality of life for each health state and adjusted the utilities based on the average age of the modeled population. Quality-of-life data came from a study examining health-related quality of life and utilities for persons with GAD . We used the results of a regression analysis from that study to predict state-specific quality of life, reported using the SF-6D score (Table 1). Age-based mortality rates were used to transition persons to the dead state . Persons in the comorbidities states experienced a higher rate of mortality due to increased suicide risk .
For the societal perspective, we included costs associated with baseline medical care in each state, cost of the interventions, pharmaceutical costs, and costs associated with disability days to calculate total health-related costs. For the payer perspective, we did not include disability day costs. Baseline medical costs and pharmaceutical costs were estimated from the published literature. Physician office visits, emergency room visits and hospitalization costs were estimated using data from the 2013 Medical Expenditure Panel (S2 Table) . Disability days costs were calculated by multiplying the number of disability days by the average daily wage in the U.S., as reported by the U.S. Bureau of Labor Statistics . All costs were adjusted to 2016 U.S. dollars using the overall Consumer Price Index .
We conducted a number of sensitivity analyses to characterize the robustness of the model and examine the findings of our case study. Our sensitivity analyses included varying all healthcare costs and utilization inputs, as well as the cost of disability days, to measure the impact of these inputs on overall model results. We also examined how varying mobile CBT program effectiveness, and the sustained effectiveness of mobile and traditional CBT programs, impacted model results. We also varied the probability of death due to suicide in our sensitivity analyses.
Case study results
In all scenarios examined in the case study, the mobile CBT program for GAD led to improved health outcomes and lower costs than traditional CBT or the status quo. In the base case, for a cohort of 100,000 persons with mild, moderate, or severe anxiety, we found that mobile CBT led to a gain of 34,108 QALYs when compared to traditional CBT and 81,492 QALYs when compared to the status quo (Table 2). Under the mobile CBT strategy, the cohort resulted in 191,000 and 834,000 more cumulative (undiscounted) life years with no anxiety compared to traditional CBT and the status quo respectively (Table 3). The cohort also spent 127,000 and 253,000 fewer cumulative life years in the clinically diagnosable GAD states when compared to traditional CBT and the status quo respectively.
From our analysis in this case study, we estimated that with mobile CBT, the 100,000 person cohort costs approximately $36.5 billion over their lifetime compared to $38.7 billion and $41.0 billion with traditional CBT and status quo (Table 4). Mobile CBT reduced overall costs by approximately $2.23 billion when compared to traditional CBT (Table 2). Approximately 85% of these savings ($1.89 billion) came from reduced disability days and 15% ($340 million) came from healthcare costs (S3 Table). Mobile CBT reduced overall costs by approximately $4.55 billion when compared to the status quo (Table 2). Approximately 87% of these savings ($3.94 billion) came from reduced disability days and the remaining 13% of savings ($604 million) came from healthcare utilization costs (S3 Table). Intervention costs were higher in the mobile CBT scenario than status quo but were outweighed by the savings from disability days and healthcare utilization.
In the prevention-only scenario, mobile CBT resulted in fewer QALYs gained and costs saved than in the base case scenario but was still cost-saving. Mobile CBT increased QALYs by 28,959 and 76,568 and reduced overall costs by $1.93 billion and $4.15 billion when compared to traditional CBT and the status quo respectively. In contrast, in the treatment-only scenario, mobile CBT had a greater impact than in the base case. Mobile CBT increased QALYs by 36,564 and 83,841 and reduced overall costs by $2.38 billion and $4.73 billion when compared to CBT and the status quo respectively (Table 2).
From a payer perspective, the mobile CBT program for GAD also resulted in lower costs compared to traditional CBT or the status quo. In the base case, we estimated that mobile CBT reduces overall costs by approximately $339 million when compared to traditional CBT (Table 2). Approximately 43% ($146 million) of these savings came from reduced physician visits, 41% ($139 million) came from reduced hospitalizations, and 3% ($9.1 million) came from reduced ER visits (S3 Table). Mobile CBT reduced overall costs by approximately $605 million when compared to status quo (Table 2). The majority of these savings came from reduced physician visits ($327 million) and reduced hospitalizations ($280 million) (S3 Table).
From a payer perspective in the prevention-only scenario, mobile CBT also resulted in fewer costs saved than in the base case scenario. When compared to traditional CBT and status quo, mobile CBT reduced overall costs by $297 million and $553 million respectively. In contrast, in the treatment-only scenario, mobile CBT had a greater impact than in the base case. When compared to CBT and the status quo, mobile CBT reduced overall costs by approximately $360 million and $630 million respectively (Table 2).
In sensitivity analysis, we found that results were insensitive to most model inputs and that mobile CBT remained cost-saving compared to traditional CBT and the status quo in almost all scenarios tested. The model parameters adjusted for the sensitivity analysis are summarized in Table 1. We first looked at the effectiveness of the CBT programs. When varying the number of years the mobile and traditional CBT programs’ effectiveness was sustained, mobile CBT was still cost-saving compared to traditional CBT and the status quo. When the effectiveness of both CBT programs gradually decreased over 2 years until it reached the status quo transition rates, versus over the cohort lifetime in the base case, then mobile CBT reduced overall costs by approximately $435 million and $750 million and increased QALYs by 6,297 and 14,180 respectively. Additionally, we varied the clinical response rate of traditional CBT to measure the threshold at which traditional CBT becomes the preferred treatment. When the clinical response rate of traditional CBT was increased to 76%, and the effectiveness of mobile CBT did not change, then traditional CBT becomes cost-effective as compared to mobile CBT. Lastly, we decreased the effectiveness of the mobile CBT program by 20%. We found that mobile CBT was still cost-saving compared to traditional CBT and the status quo, and reduced overall costs by $1.50 billion and $3.81 billion and increased QALYs by 21,116 and 68,500 respectively.
In the base case from the societal perspective, reduction in disability day cost made up much of the savings from mobile CBT. Taking a more conservative approach to measuring cost of disability days and assuming that for a given disability day, an individual is 80% productive (decreasing the costs associated with each disability day by 80%), we then found that mobile CBT still reduced costs compared to traditional CBT (reduction of $719 million) and the status quo (reduction of $1.39 billion).
Lastly, we examined the impact of suicide risk on costs and QALYs. We found that results were insensitive to moderate variations in probability of death due to suicide. In the base case, increased suicide risk was only applied to the “moderate with comorbidities” and “severe with comorbidities” model states. In sensitivity analysis, we applied the same suicide risk used in the “moderate anxiety with comorbidities” and “severe anxiety with comorbidities” states to the “moderate anxiety” and “severe anxiety” states respectively. With these adjustments, we found that mobile CBT still reduced costs and was additive to QALYs. When compared to traditional CBT and status quo, mobile CBT reduced overall costs by approximately $2.20 billion and $4.09 billion and increased QALYs by 35,000 and 83,000 respectively.
We developed a model and framework that can help researchers measure the cost-effectiveness of internet-based CBT for individuals with GAD. Our model is specific to the U.S., and our suggested analysis framework calculates cost-effectiveness from both a payer and a societal perspective.
In our case study analysis, we found that in all three intervention scenarios, the mobile CBT program for GAD would increase QALYs and reduce health-related costs both from a societal and a payer perspective when compared to traditional CBT and the status quo. Using the model, we estimated that, for a cohort of 100,000 adults with GAD, the societal burden associated with GAD could be reduced by $2.23 billion if mobile CBT were to be used instead of traditional CBT and by $4.55 billion if mobile CBT is compared to the status quo of no CBT. Much of this savings came from a reduction in disability days (85% and 87% respectively), but results held from a payer perspective as well, when disability days were excluded. Total savings from mobile CBT were $339 million and $605 million respectively in that case. In this analysis, the mobile CBT was cost-saving primarily due to the better clinical response rate and lower program costs for mobile CBT than for traditional CBT. In the sensitivity analysis, we found that our model was insensitive to most model inputs.
The case study analysis suggested that although mobile CBT is most effective and cost-saving when used only for treatment (i.e., used for individuals with moderate and severe GAD), it may also be beneficial when used for prevention only or both prevention and treatment. This suggests that offering mobile CBT to persons with mild anxiety (not clinically diagnosed GAD) who otherwise would not receive any preventive interventions could provide value to both society and payers. However, in a situation where the ability to deploy the mobile CBT program was limited, perhaps by short-term budget, the most impactful population to target would be moderate and severe GAD patients. This concept should be further developed once more robust efficacy data becomes available.
Online and mobile CBT programs may increase access to treatment for persons with GAD by making CBT more accessible and by removing some structural barriers (e.g., patients do not need to drive to their physician’s office for therapy). The availability of online CBT programs can then theoretically increase the proportion of persons with GAD who initiate therapy and reaps the downstream benefits of less anxiety and associated comorbidities. Although access to treatment is not only impacted by logistical and structural barriers, and our case study analysis does not explicitly quantify this increase in uptake, the comparison of the mobile CBT program and the status quo of no CBT can serve as a proxy for the potential QALYs gained and costs saved by expanded CBT access.
There were a few limitations to our proposed model and framework for analysis. We did not factor the effectiveness of pharmacotherapy in combination with CBT into transition rates due to a lack of GAD progression data specific to whether a person is on medication and how long they have been on medication. We also assumed that persons were on pharmacotherapy for their entire life. However if, as our case study suggested, mobile CBT’s clinical response rate is better than the clinical response rate of traditional CBT, we can assume that mobile CBT would result in more persons discontinuing GAD medications sooner. This could result in a greater reduction in overall costs compared to other strategies. Lastly, we made the conservative assumption that persons are only at increased risk for suicide once they are in one of the comorbidities states. If individuals in the GAD-only states also experience an increased risk of suicide, then even more QALYs would be gained and costs would be further reduced when mobile CBT is compared to traditional CBT and status quo, as shown in our case study sensitivity analysis.
There were several limitations of our case study analysis as well. First, the mobile CBT program effectiveness data came from a small pilot program of 89 individuals from one large national employer group. Therefore, the generalizability of the results is limited. However, results of sensitivity analysis suggest that mobile CBT may be cost-saving even if effectiveness is lower than in the pilot program. Secondly, the effectiveness data used for the traditional CBT intervention was based on an overall clinical response rate, and did not directly provide severity-specific effectiveness rates. The completion rates for mobile and traditional CBT’s effectiveness were also not directly comparable. To address these discrepancies, we varied the clinical response rate of traditional CBT in sensitivity analyses and found that only when traditional CBT’s clinical response rate increases to 76% does it become the preferred intervention over mobile CBT. We also made assumptions on the sustained effectiveness of mobile and traditional CBT. We assumed that both CBT interventions had the same sustained effectiveness, but results may change if there is a large discrepancy in effectiveness length for mobile CBT and traditional CBT. We also assumed that there are always some residual effects of the CBT programs throughout a person’s lifetime. As shown in our sensitivity analysis, if CBT’s effectiveness gradually decreases until it reaches the status quo transition rates in just 2 years, then mobile CBT is still cost-saving compared to traditional CBT and status quo.
The findings of the case study analysis, which are specific to a GAD population, are consistent with the results of other studies that examined the health outcomes and economic benefits of internet-based or mobile app versions of CBT programs for individuals with depressive and anxiety disorders [17, 41]. The estimated QALYs gained and costs saved by deploying this program as prevention, treatment, or both are meaningful. The case study results hold for both a societal perspective, taking into account disability days due to GAD, as well as for a more limited payer perspective, looking only at health-related costs. This suggests that payers, patients, employers and society overall could benefit from using internet-based mobile app CBT programs for GAD. This analysis should be rerun once more robust efficacy data with a larger sample size is made available for the mobile CBT program. In addition, further research on intervention-specific completion rates and long-term effectiveness in broader and more diverse GAD populations would allow for an even better understanding of the value of such programs.
S1 Table. Summary of transition probabilities and intervention effectiveness.
S2 Table. Summary of utilization parameters for 3-month period.
We would like to thank Megan Oser from Lantern, who reviewed the final version of the manuscript for accuracy of information regarding the Lantern program.
- 1. Kessler RC, Chiu WT, Demler O, Walters EE. Prevalence, severity, and comorbidity of twelve-month DSM-IV disorders in the national comorbidity survey replication (NCS-R). Arch Gen Psychiatry. 2005a;62(6):617–27. PubMed Central PMCID: PMCPMID: 15939839.
- 2. Keller MB. The long-term clinical course of generalized anxiety disorder. J Clin Psychiatry. 2002;63:Suppl 8:11–6. PubMed Central PMCID: PMC12044103.
- 3. Anxiety and Depression Association of America. Understanding the Facts: Generalized Anxiety Disorder (GAD) 2016 [12.14.2016]. Available from: https://www.adaa.org/understanding-anxiety/generalized-anxiety-disorder-gad.
- 4. Wittchen HU. Generalized anxiety disorder: prevalence, burden, and cost to society. Depress Anxiety. 2002;16(4):162–71. PubMed Central PMCID: PMC12497648. pmid:12497648
- 5. Grant BF, Stinson FS, Dawson DA, Chou SP, Dufour MC, Compton W, et al. Prevalence and co-occurrence of substance use disorders and independent mood and anxiety disorders: results from the National Epidemiologic Survey on Alcohol and Related Conditions. Arch Gen Psych. 2004;61(8):807–16. PubMed Central PMCID: PMC15289279
- 6. Bereza BG, Machado M, Einarson TR. Systematic review and quality assessment of economic evaluations and quality-of-life studies related to generalized anxiety disorder. ClinTher. 2009;31(6):1279–308. PubMed Central PMCID: PMC19695395.
- 7. Cameron OG. Understanding comorbid depression and anxiety. Psych Times. 2007;24(14):51–6.
- 8. Bruce SE, Yonkers KA, Otto MW, Eisen JL, Weisberg RB, Pagano M, et al. Influence of psychiatric comorbidity on recovery and recurrence in generalized anxiety disorder, social phobia, and panic disorder: a 12-year prospective study. Am J Psych. 2005;162(6):1179–87. PubMed Central PMCID: PMC15930067.
- 9. François C, Despiégel N, Maman K, Saragoussi D, Auquier P. Anxiety disorders, major depressive disorder and the dynamic relationship between these conditions: treatment patterns and cost analysis. J Med Econ 2010;13(1):99–109. PubMed Central PMCID: PMC20078336. pmid:20078336
- 10. Crits-Christoph P, Newman MG, Rickels K, Gallop R, Gibbons MB, Hamilton JL, et al. Combined medication and cognitive therapy for generalized anxiety disorder. J Anxiety Disord. 2011;25(8):1087–94. PubMed Central PMCID: PMC21840164 pmid:21840164
- 11. Kohn R, Saxena S, Levav I, Saraceno B. The treatment gap in mental health care. Bulletin of the World Health Organization. 2004;82:858–66. pmid:15640922
- 12. Kessler RC, Zhao S, Katz SJ, Kouzis AC, Frank RG, Edlund M, et al. Past-year use of outpatient services for psychiatric problems in the National Comorbidity Survey. Am J Psychiatry. 1999;156(1):115–23. pmid:9892306
- 13. Mohr DC, Ho J, Duffecy J, Baron KG, Lehman KA, Jin L, et al. Perceived barriers to psychological treatments and their relationship to depression. J Clin Psychology. 2010;66(4):394–409. PubMed Central PMCID: PMC20127795
- 14. Donker T, Blankers M, Hedman E, Ljótsson B, Petrie K, Christensen H. Economic evaluations of Internet interventions for mental health: a systematic review. Psychol Med. 2015;45(16):3357–76. PubMed Central PMCID: PMC26235445. pmid:26235445
- 15. Richards D, Richardson T, Timulak L, McElvaney J. The efficacy of internet-delivered treatment for generalized anxiety disorder: A systematic review and meta-analysis. Internet Interventions. 2015;2:272–82.
- 16. Higgins DM, Hecker JE. A randomized trial of brief cognitive-behavioral therapy for prevention of generalized anxiety disorder. J Clin Psychiatry. 2008;69(8):1336.
- 17. Ophuis RH, Lokkerbol J, Heemskerk SC, van Balkom AJ, Hiligsmann M, Evers SM. Cost-effectiveness of interventions for treating anxiety disorders: A systematic review. J Affect Disord. 2017;210:1–13. pmid:27988373
- 18. Neumann PJ, Sanders GD, Russell LB, Siegel JE, Ganiats TG. Cost-effectiveness in health and medicine. New York: Oxford Univ Pr; 2016.
- 19. Jones M, editor Enhancing engagement in digital mental health interventions: Exploring predictors and methods of engagement. International Society for Research on Internet Interventions Conference; 2016; Seattle, WA.
- 20. Kanuri N, Newman M, Forsberg S, Cohen J, Kuhn E, Ruzek J, et al. Beyond the barriers to mental health care: the development and implementation of a guided self-help coach training protocol for indian non-professional clinicians. Association for Behavioral and Cognitive Therapies; Nov 12–15,; Chicago, IL2015.
- 21. Marciniak MD, Lage MJ, Dunayevich E, Russell JM, Bowman L, Landbloom RP, et al. The cost of treating anxiety: the medical and demographic correlates that impact total medical costs. Depress Anxiety. 2005;21(4):178–84. PubMed Central PMCID: PMC16075454 pmid:16075454
- 22. Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, EE. W. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005b;62(6):593–602.
- 23. World Health Organization Global Health Observatory Data. United States Life Tables 2016 [10.10.2016]. Available from: http://www.who.int/gho/mortality_burden_disease/life_tables/life_tables/en/.
- 24. Berger A, Edelsberg J, Bollu V, Alvir JMJ, Dugar A, Joshi AV, et al. Healthcare utilization and costs in patients beginning pharmacotherapy for generalized anxiety disorder: a retrospective cohort study. BMC Psych. 2011;11(193). PubMed Central PMCID: PMC22151689
- 25. Revicki DA, Brandenburg N, Matza L, Hornbrook MC, Feeny D. Health-related quality of life and utilities in primary-care patients with generalized anxiety disorder. Qual Life Res. 2008;17(10):1285–94. pmid:18949580
- 26. Meara E WC, Cutler DM. Trends in medical spending by age, 1963–2000. Health Aff (Millwood). 2004;23(4):176–83. PubMed Central PMCID: PMC15318578.
- 27. Healthcare blue book. CAREOperative 2017 [1.10.2017]. Available from: https://healthcarebluebook.com/page_ProcedureDetails.aspx?dataset=md&id=334&g=IndividualPsychotherapy(30Minutes)&directsearch=true.
- 28. Agency for Healthcare Research and Quality. Medical Expenditure Panel Survey: Total Expenses and Percent Distribution for Selected Conditions by Type of Service: United States, 2013 2016 [11.10.2016]. Available from: https://meps.ahrq.gov/data_stats/tables_compendia_hh_interactive.jsp?_SERVICE=MEPSSocket0&_PROGRAM=MEPSPGM.TC.SAS&File=HCFY2013&Table=HCFY2013_CNDXP_C&_Debug=.
- 29. U.S. Department of Labor Bureau of Labor Statistics. Average hourly and weekly earnings of all employees on private nonfarm payrolls by industry sector, seasonally adjusted private nonfarm payrolls by industry sector, seasonally adjusted 2016 [10.24.2016]. Available from: http://www.bls.gov/news.release/empsit.t19.htm.
- 30. Mavranezouli I, Mayo-Wilson E, Dias S, Kew K, Clark DM, Ades AE, et al. The cost effectiveness of psychological and pharmacological interventions for social anxiety disorder: a model-based economic analysis. PLoS One. 2015;10(10):e0140704. PubMed Central PMCID: PMC26506554 pmid:26506554
- 31. Myhr G, Payne K. Cost-effectiveness of cognitive-behavioural therapy for mental disorders: implications for public health care funding policy in Canada. Can J Psychiatry. 2006;51(10):662–70. PubMed Central PMCID: PMC17052034. pmid:17052034
- 32. Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092–7. PubMed Central PMCID: PMC16717171. pmid:16717171
- 33. Anxiety and Depression Association of America. Clinical practive review of GAD 2015 [11.20.2016]. Available from: https://www.adaa.org/resources-professionals/practice-guidelines-gad.
- 34. Hunot V, Churchill R, Silva de Lima M, Teixeira V. Psychological therapies for generalised anxiety disorder. Cochrane Database of Syst Rev. 2007;(1):CD001848. PubMed Central PMCID: PMC17253466.
- 35. DiMauro J, Domingues J, Fernandez G, Tolin DF. Long-term effectiveness of CBT for anxiety disorders in an adult outpatient clinic sample: a follow-up study. Behav Res Ther. 2013;51(2):82–6. pmid:23262115
- 36. Newman MG, Consoli A, Taylor CB. Computers in assessment and cognitive behavioral treatment of clinical disorders: Anxiety as a case in point. Behavior Therapy. 1997;28:211–35.
- 37. Newman MG, Szkodny LE, Llera SJ, Przeworski A. A review of technology-assisted self-help and minimal contact therapies for anxiety and depression: Is human contact necessary for therapeutic efficacy. Clin Psych Review. 2011;31:89–103.
- 38. Newman MG, Kanuri, N., Jacobson, N. C., Ruzek, J. I., Kuhn, E., Thomas, N., Abbott, J. M., Jones, M., Sharma, S., & Taylor, C. B. A randomized controlled trial of feasibility, acceptability, and efficacy of online, CBT-based guided self-help programs to reduce anxiety among Indian universities. Anxiety and Depression Association of America Annual Conference; Philadephia, PA2016.
- 39. Khan A, Khan SR, Leventhal RM, Brown WA. Symptom reduction and suicide risk in patients treated with placebo in antidepressant clinical trials: a replication analysis of the Food and Drug Administration Database. Int J Neuropsychopharmacol. 2001;4(2):113–8. PubMed Central PMCID: PMC11466159 pmid:11466159
- 40. U.S. Bureau of Labor Statistics. Consumer Price Index. Washington DC: U.S. Bureau of Labor Statistics 2016 [11.2.2016]. Available from: http://data.bls.gov/cgi-bin/cpicalc.pl.
- 41. Lokkerbol J, Adema D, Cuijpers P, Reynolds CF, Schulz R, Weehuizen R, et al. Improving the cost-effectiveness of a healthcare system for depressive disorders by implementing telemedicine: a health economic modeling study. Am J Geriatri Psychiatry. 2014;22(3):253–62.