Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Lost in transition: A protocol for a retrospective, longitudinal cohort study for addressing challenges in opioid treatment for transition-age adults

  • Josh Aleksanyan,

    Roles Methodology, Writing – original draft, Writing – review & editing

    Affiliation Department of Population Health, New York University Grossman School of Medicine, New York, New York, United States of America

  • Sugy Choi,

    Roles Methodology, Writing – original draft, Writing – review & editing

    Affiliation Department of Population Health, New York University Grossman School of Medicine, New York, New York, United States of America

  • Patricia Lincourt,

    Roles Resources, Writing – original draft, Writing – review & editing

    Affiliation New York State Office of Addiction Services and Supports (OASAS), Albany, New York, United States of America

  • Constance Burke,

    Roles Resources, Writing – review & editing

    Affiliation New York State Office of Addiction Services and Supports (OASAS), Albany, New York, United States of America

  • Kelly S. Ramsey,

    Roles Writing – review & editing

    Affiliation New York State Office of Addiction Services and Supports (OASAS), Albany, New York, United States of America

  • Shazia Hussain,

    Roles Resources, Writing – review & editing

    Affiliation New York State Office of Addiction Services and Supports (OASAS), Albany, New York, United States of America

  • Ashly E. Jordan,

    Roles Writing – review & editing

    Affiliation New York State Office of Addiction Services and Supports (OASAS), Albany, New York, United States of America

  • Maria Morris,

    Roles Resources, Writing – review & editing

    Affiliation New York State Office of Addiction Services and Supports (OASAS), Albany, New York, United States of America

  • Thomas D’Aunno,

    Roles Writing – review & editing

    Affiliation New York University Wagner School of Public Policy, New York, New York, United States of America

  • Sherry Glied,

    Roles Writing – review & editing

    Affiliation New York University Wagner School of Public Policy, New York, New York, United States of America

  • Jennifer McNeely,

    Roles Writing – review & editing

    Affiliation Department of Population Health, New York University Grossman School of Medicine, New York, New York, United States of America

  • Brian Elbel,

    Roles Writing – review & editing

    Affiliations Department of Population Health, New York University Grossman School of Medicine, New York, New York, United States of America, New York University Wagner School of Public Policy, New York, New York, United States of America

  • Tod Mijanovich,

    Roles Methodology, Writing – review & editing

    Affiliation Department of Applied Statistics, Social Science, and Humanities, New York University Steinhardt School of Culture, Education, and Human Development, New York, New York, United States of America

  • Samrachana Adhikari,

    Roles Writing – review & editing

    Affiliation Department of Population Health, New York University Grossman School of Medicine, New York, New York, United States of America

  • Charles J. Neighbors

    Roles Conceptualization, Funding acquisition, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing

    Charles.neighbors@nyulangone.org

    Affiliations Department of Population Health, New York University Grossman School of Medicine, New York, New York, United States of America, New York University Wagner School of Public Policy, New York, New York, United States of America

Abstract

Background

In the United States, there has been a concerning rise in the prevalence of opioid use disorders (OUD) among transition-age (TA) adults, 18 to 25-years old, with a disproportionate impact on individuals and families covered by Medicaid. Of equal concern, the treatment system continues to underperform for many young people, emphasizing the need to address the treatment challenges faced by this vulnerable population at a pivotal juncture in their life course. Pharmacotherapy is the most effective treatment for OUD, yet notably, observational studies reveal gaps in the receipt of and retention in medications for opioid use disorder (MOUD), resulting in poor outcomes for many TA adults in treatment. Few current studies on OUD treatment quality explicitly consider the influence of individual, organizational, and contextual factors, especially for young people whose social roles and institutional ties remain in flux.

Methods

We introduce a retrospective, longitudinal cohort design to study treatment quality practices and outcomes among approximately 65,000 TA adults entering treatment for OUD between 2012 and 2025 in New York. We propose to combine data from multiple sources, including Medicaid claims and encounter data and a state registry of substance use disorder (SUD) treatment episodes, to examine three aspects of OUD treatment quality: 1) MOUD use, including MOUD option (e.g., buprenorphine, methadone, or extended-release [XR] naltrexone); 2) adherence to pharmacotherapy and retention in treatment; and 3) adverse events (e.g., overdoses). Using rigorous analytical methods, we will provide insights into how variation in treatment practices and outcomes are structured more broadly by multilevel processes related to communities, treatment programs, and characteristics of the patient, as well as their complex interplay.

Discussion

Our findings will inform clinical decision making by patients and providers as well as public health responses to the rising number of young adults seeking treatment for OUD amidst the opioid and polysubstance overdose crisis in the U.S.

Introduction

Transition-age (TA) adulthood—18 to 25-years old—is a distinct developmental phase during which a person’s biological, psychological, and sociological aspects are evolving [14]. TA adults differ from adolescents in that their brain development is further progressed and their social roles allow for more independence. However, TA adults differ from older adults in that their neurocognitive development is not complete, and their social roles and institutional ties remain in flux. TA adults undergo consequential shifts in their circumstances. They experience greater independence from caregivers and childhood support systems, face increasing societal expectations of self-sufficiency, and continue self-exploration and experimentation, as they are yet to take on full adult responsibilities related to lifelong roles in occupations, partnerships, and as caregivers [26].

During this critical life phase, TA adults are more likely to use substances and have higher prevalence of substance use disorder (SUD) than adults aged 26 or older (14.4% vs. 7.2% in 2019). Paradoxically, they are less likely to receive specialty treatment for SUD than adults aged 26 or older (7.4% vs. 14.2% in 2019) [7]. Not only is TA adulthood a time of increased risk of developing SUD but also a time when prolonged exposure to substances can have lasting effects on brain development and future role functioning [8, 9]. Brain development extends into the mid-20s, during which time neurological areas associated with goal-seeking, emotional processing, and self-regulation continue to mature. The brain reward system is more developed than the inhibitory system among TA adults, contributing to potentially more harmful substance use and addiction [1012].

Currently, the United States is experiencing an epidemic of opioid use disorders (OUD), including an opioid and polysubstance overdose crisis, increasingly among TA adults [1315]. OUD are chronic conditions that require long-term treatment engagement for the best prognosis [1620]. Individuals with OUD have high mortality, morbidity, and low remission, with abstinence rates of about 30% ten years after beginning care [21]. Over the past few years, the most significant increase in fatalities due to drug overdose was seen in cases involving illicitly-manufactured fentanyl and its analogues, with an average increase of 71% each year from 2013 to 2017 (whereas overdose deaths caused by prescription opioids and heroin have remained constant or declined, respectively) [22]. Notably, opioid-related mortality is highest among younger individuals (age 20 to 40 years) [23]. Additionally, prevalence of heroin use has more than doubled among TA adults in the past decade [24], with a significant increase in heroin overdose-related hospitalizations among 20–29 year olds in recent years [23]. The median age of onset for first heroin use, dependence, and treatment seeking for OUD patients is between 18–24 years of age, further underscoring the importance of emerging adulthood in OUD progression and treatment [25].

From 2012 to 2019, the number of TA adults receiving OUD treatment under New York State (NYS) Medicaid has increased more than 60%. Yet, TA adults often fall between two distinct treatment systems for SUD, most often placed in settings that are better tailored for adults, and where younger individuals feel out of place due to their unique social circumstances, such as having a shorter history of substance use and disorder [26], contributing to suboptimal treatment outcomes [27, 28].

Both the American Academy of Pediatrics and the American Society of Addiction Medicine recommend that medication be used in the treatment of young people with OUD [2932]. Despite these recommendations, TA adults with OUD are less likely to receive MOUD than older adults [3336]. In studies of young people with a diagnosis of OUD and covered by public and commercial insurance, one in four individuals received medications for OUD within six months of diagnosis [34, 35]. Only two randomized controlled trials of MOUD have been conducted specifically with TA adults and found that longer duration of MOUD (only 8–12 weeks in the trials) had improved outcomes over a shorter duration of MOUD [37, 38]. Studies generally find that longer retention in treatment is associated with improved outcomes [3944], suggesting that stronger engagement in earlier treatment phases can lead to a better prognosis for TA adults [37, 38, 4552].

Within SUD specialty treatment, MOUD increases treatment retention among TA adults [34, 53, 54]. However, TA adults generally have lower retention in specialty treatment than older adults [54, 55]. Even when MOUD is integrated into treatment, younger individuals are less adherent and more likely to leave treatment than older individuals [20, 27, 51, 56, 57]. Recent qualitative research highlights that TA adults acknowledge the life-saving potential of MOUD. Yet, they perceive receiving MOUD as stigmatizing and express ambivalence regarding MOUD, including fear of experiencing withdrawal symptoms, potential adverse effects, uncertainty regarding length of treatment, as well as concerns that MOUD might undermine self-sufficiency [58], which serves as a crucial marker of one’s transition to adulthood. There is a scarcity of studies of OUD treatment quality designed specifically for TA adults [59]. Observational studies of longitudinal cohorts are needed to identify if there are specific factors associated with use of MOUD, retention on MOUD, and adverse events related to treatment among TA adults [60].

Substance use and treatment for SUD occur within a broad social ecological context where the interplay of individual, community, and structural-level (including treatment program organizational) factors impact substance use and SUD treatment outcomes [61, 62]. Factors above the level of the individual, referred to as “social determinants of health,” such as structural racism and poverty, are potent fundamental causes of health inequalities [63].

TA adults have distinct individual-level characteristics that affect treatment engagement [4, 6, 64, 65]. They are more likely to have family members pressuring treatment [4, 64, 66, 67], and/or be involved with the criminal justice system [4, 26, 68, 69]. Criminal justice agencies and actors (e.g., judges and correctional staff) historically have been opposed to MOUD, preferring instead to rely on non-pharmacologic, non-evidence-based treatment approaches [7073]. Furthermore, barriers to engagement, including lack of transportation or treatment programs that are high threshold settings, requiring frequent attendance at clinics and participation in highly structured protocols, challenge TA adults [60, 65, 67, 7476]. TA adults are generally at ease interacting through modern telecommunications [6], with emerging shifts in telehealth that were prompted initially by the COVID-19 pandemic now offering new opportunities for treatment tailoring for this age group [77].

TA adults’ response to treatment also is affected by community-level factors that influence health and how they may engage with systems of care [78]. Variation in use of MOUD is associated with community social capital and local availability of programs offering MOUD [79]. MOUD is less available outside urban areas and often requires longer travel times that can be a barrier [7476]. TA adults often contend with peers who use substances, local easy availability of substances, residential instability, hostile experiences with local law enforcement, and a lack of public transportation [80, 81]. Many TA adults from marginalized communities grapple with disparities in access and quality of care due to socioeconomic privation, racial/ethnic segregation and discrimination, and long-held community mistrust of medical and other institutions [67, 8286].

Organizational-level factors also contribute to quality of care for TA adults [87]. Treatment programs that offer MOUD typically are larger organizations, hospital-affiliated, for-profit, and employ professional staff with advanced degrees (e.g., physicians, master’s level trained staff) [88, 89]. Data indicate that stigma of MOUD by staff in these healthcare settings has an impact on patients’ use of MOUD, even in programs that describe having a person-centered approach [90, 91]. Many specialty programs do not offer pharmacotherapy to youth [92], which has been associated with a lack of understanding of how to respond to the unique needs of these youth as they age into TA adults [93]. The impact of treatment program organization (e.g., program size and type), staffing (e.g., professional degrees), and clinical processes (e.g., use of telehealth, counseling modalities) on treatment quality practices and outcomes remains an area of ongoing exploration.

Considering the distinct circumstances and needs of TA adults, researchers and experts increasingly have called for additional research aimed at enhancing the quality of OUD treatment for this population [57, 60, 64]. Specific areas requiring investigation include strategies to improve MOUD access, engagement, and retention [94]. We extend prior studies by proposing a cohort-specific study that examines these questions using a social-ecological framework encompassing individual, community, and treatment program organization levels [18, 19, 34, 95].

Materials and methods

Conceptual framework

As an interdisciplinary team of social scientists, clinical psychologists, and physicians, we recognize that the quality of treatment and care for SUD is structured by the interplay of individual, community-level, and treatment program organizational dynamics. As such, our study’s conceptual framework integrates key principles from the field of social ecology and the Donabedian healthcare quality framework [61, 62, 9698], guiding our research questions and analysis. Fig 1 below depicts the conceptual framework. Primarily, we recognize the importance of considering individual characteristics (e.g., age, comorbidities) alongside the social and built environments. Second, we acknowledge that environments have a multi-level impact on treatment access and quality of care. For our study, we explore how program structural characteristics (e.g., program size and type) and clinical processes (e.g., use of telehealth; counseling modalities) structure outcomes, conditional on individual and community characteristics (e.g., socioeconomic status, racial/ethnic composition). Third, we incorporate a longitudinal perspective in our analysis to assess explicitly the evolving impact of individual, treatment program, and community-level factors on treatment quality practices and outcomes over several years. Fourth, we evaluate the quality of OUD-related treatment provided by organizations through the Donabedian framework, focusing on three key processes: 1) structural or institutional factors associated with capacity to provide care; 2) clinical protocols––namely processes––that guide interactions between staff and patients; and 3) outcomes, that is, whether patients achieve the goals for which they entered treatment [9698].

thumbnail
Fig 1. Social ecological and Donabedian conceptual framework.

https://doi.org/10.1371/journal.pone.0297567.g001

Study design and aims of the study

Our study introduces a retrospective, longitudinal cohort design to assess treatment quality practices and outcomes among TA patients with OUD in NYS using administrative data from 2010 through 2025. We will combine Medicaid claims and encounter data with data from the Client Data System (CDS), a state registry of treatment episodes in licensed SUD treatment programs. CDS is an Office of Addiction Services and Supports (OASAS) treatment registry that all licensed providers of SUD treatment in the state of New York use to enter admission and discharge data. Data include demographics (e.g., age, race/ethnicity, and marital status), level of functioning (e.g., housing status, health status, and comorbid mental health), criminal justice status, recent history and frequency of substance use, and recent SUD treatment history. This registry data will supplement information from the Medicaid data with additional socio-demographic and clinical information as well as SUD treatment that was not funded by Medicaid. Therefore, despite fragmentation in funding sources, the combination of these administrative data sets will yield a more inclusive record of treatment episodes. Through this targeted, innovative approach, we intend to identify the diverse treatment outcomes within this specific demographic across different program organizations and communities. The study has been reviewed by the Institutional Review Board of NYU Grossman School of Medicine (#s22-00914) and meets the criteria for exemption under 45 CFR 46.104(d). Study findings will be disseminated via national and international conferences, reports, and peer-reviewed publications.

Aim 1. Quantify the associations between MOUD use and individual, community, and program characteristics.

Our first aim involves conducting an analysis of associations of MOUD use among TA adults and psychological and social determinants of health at the individual, community, and program organizational level. Using the CDS and Medicaid claims from NYS, we will assess the impact of demographic data (e.g., race/ethnicity, criminal justice involvement), housing status, comorbid mental health diagnoses, and community-level indicators (e.g., program availability, the social vulnerability index) on MOUD use. Additionally, we will examine the relationship between MOUD use and treatment program organizational characteristics, such as program size and type, telehealth volume, and integrated mental health treatment. We also will explore the influence of a range of factors on the use of different MOUD options (e.g., buprenorphine, methadone, or XR naltrexone) at individual, program, and community levels.

Aim 2. Assess program organizational characteristics associated with improved adherence and retention in OUD treatment, while accounting for individual and community factors.

Our second aim focuses on identifying organizational factors that may be associated with improved medication adherence and retention in OUD treatment among TA adults. We will evaluate the impact of program structural factors (e.g., program size and type), program staff characteristics (e.g., professional degrees), and clinical process measures (e.g., use of telehealth, counseling modalities) on medication adherence and treatment retention, adjusting for individual and community-level characteristics.

Aim 3. Examine the association between program organizational characteristics and adverse OUD-related events (AE) such as overdose, while accounting for individual and community factors.

Our third aim centers on investigating the nexus between program organizational characteristics and OUD-related adverse events among TA adults including SUD-related emergency department visits or hospitalizations, including for overdoses, and increases in levels of SUD care. We will examine the association between program structural factors (e.g., program size and type) and AE outcomes. Additionally, we will examine how program staff characteristics (e.g., professional degrees) impact AE. We also will explore the association between clinical care process measures (e.g., use of telehealth, counseling modalities) and AE outcomes.

Sample

The study cohort will be drawn from combined Medicaid and CDS data and will include approximately 65,000 individuals ages 18 to 25 whose first treatment episode for OUD in Medicaid occurs in 2012 or later—that is, not preceded by a prior OUD-related treatment episode in 2010 or later. Individuals who are co-insured with Medicare (some people under 65 with certain disabilities or conditions) will be excluded because not all their healthcare events are represented in the Medicaid claims data. We estimate that approximately 5,000 individuals will meet these criteria each year. Our link rate among all Medicaid enrollees with OUD ages 18–25 is 93%. The demographic and clinical profile is expected to be generally stable across years. Each year we will select TA adults receiving their first treatment for OUD. Once someone has joined a cohort, that person is retained in the analytical dataset in all future years. By using the first treatment episode in Medicaid as our index episode for a young cohort, we are identifying individuals early in their OUD treatment continuum of care. We estimate that about 26,000 TA adults will enter treatment after the COVID-19 public health emergency related telehealth and other measures take effect.

Analysis

The study uses rigorous methods to address questions about multilevel factors associated with MOUD use, retention, and adverse event mitigation. Table 1 below outlines measures aligned with the social ecology framework and data sources. Baseline patient, program, and community characteristics will be assessed at admission, while ongoing treatment and healthcare measures will be assessed monthly. We also will compare pre- and post-COVID-19 treatment patterns to examine care innovations on retention and outcomes, like telehealth and flexibility in methadone take-home doses. We present an outline of the analytical approach, specifying the strategies we intend to employ for each of our three aims.

thumbnail
Table 1. Summary of outcome and predictor variables and sources by level.

https://doi.org/10.1371/journal.pone.0297567.t001

Aim 1: Quantifying associations between MOUD use and social and ecological factors.

To quantify the associations between MOUD use (e.g., methadone, buprenorphine, XR naltrexone) and individual, community, and treatment program organizational characteristics, we will use generalized linear mixed effects models (GLMM). The primary outcome of interest is whether an individual received MOUD during the treatment episode. We will include random effects to account for repeated measurements within individuals and clustering by program and county, and time fixed effects to address secular trends, such as the pre- and post-COVID-19 periods. We will test whether models can be simplified by replacing time fixed effects with time-related splines or power terms. We also will explore interactions among variables of substantive interest (e.g., varying the effect of criminal justice involvement on OUD treatment by community influences and program organizational factors). We will adopt a generalized estimating equations approach with robust standard errors to ensure the robustness of our findings. To address potential bias associated with correlations between predictors and random effects, we will utilize the Mundalk approach of mean-centering variables within county. A penalization approach (lasso regression) will be used for feature selection to address overfitting and collinearity. The validity of the approach will be ensured using cross-validation and sample splitting. Given the large sample size (>65,000) across multiple years, we are powered to detect conservative odds ratios (≥1.1) with 80% power at a two-sided alpha of 0.05 (assuming 10% overall prevalence of MOUD use). Higher prevalence will lead to improved power.

Aim 1a: Associations with psychological and social determinants of health. First, we will explore the association between MOUD use and psychological and social determinants of health at both the individual (e.g., housing status, comorbid mental health diagnoses) and community levels (e.g., social vulnerability index, program availability). For each group of measures, we will build distinct GLMMs. These models will be adjusted for age, sex, race, as well as other individual baseline and time-varying covariates (as specified in the measures table).

Aim 1b: Associations with program organizational characteristics. Second, we will focus on examining the connection between MOUD use and treatment program organizational characteristics (e.g., program size and type, volume of telehealth, integrated mental health treatment). Like Aim 1a, we will use GLMMs to analyze treatment program measures. These models will be adjusted for age, sex, race, other individual and community baseline measures, and other time-varying covariates (as detailed in the measures table). For aims 1a and 1b, estimates of odds ratios and their corresponding 95% confidence intervals will be reported.

Aim 1c: Associations with MOUD options. Third, we will investigate the factors linked to the use of different MOUD options (e.g., buprenorphine, methadone, or XR naltrexone) at individual, program, and community levels. To explore the association between medication option, provider proximity, and racial/ethnic patient characteristics, we will employ mixed effects multinomial logistic regression, while adjusting for individual, program, and county level covariates.

Aim 2: Evaluating program organizational factors influencing OUD treatment retention.

This objective focuses on analyzing program organizational characteristics associated with improved medication adherence and retention in OUD treatment among TA adults, while controlling for individual and community characteristics related to retention in care. Employing time-to-event analysis, a set of statistical methodologies focusing on the time until an event occurs, we will focus on a) discontinuation of MOUD use following initiation during the treatment episode and b) treatment completion as our event outcome of interest. To accommodate the longitudinal structure of these data, we will employ extended Cox models. We will assess the validity of the proportional hazards (PH) assumption for time-invariant variables through log-log plots, observed versus expected plots, goodness-of-fit testing, and the use of time-dependent variables. Variables not adhering to the PH assumption will be assessed for interaction with time and, if necessary, incorporated into the final Cox model. We will assume non-informative censoring, meaning that censoring and the event risk are independent after conditioning on observable features.

These models will yield hazard ratios, critical in evaluating the hypotheses stated. To mitigate confounding, we will introduce individual, program, and community-level variables into the model, yielding adjusted hazard ratios alongside point estimates and 95% confidence intervals. The extensive confounding measures at individual, program, and community levels collectively address bias stemming from omitted or uncontrolled confounding variables. We will conduct robust sensitivity analyses and explore variation in association strength due to plausible instruments for program selection, such as patient travel distance to programs and concurrent MOUD use among other individuals in the same community. To prevent overfitting, we will apply techniques outlined in Aim 1. As a sensitivity analysis to consider the multilevel structure of the data, we will deploy extended mixed-effects Cox models. An extended Cox model can incorporate time-dependent factors [99]. A mixed-effects Cox model can incorporate multiple fixed and random effects [100]. Specifically, we will include a fixed effect for each individual, program, and community-level variable defined above and random effects for repeated measures of an individual over time, program, and community.

Aim 2a: Program structural factors and adherence and retention in OUD treatment. First, we will investigate the association between program structural factors (e.g., program size and type) and adherence and retention, guided by the hypothesis of adjusted hazard ratios being equal to 1.

Aim 2b: Program staff characteristics and adherence and retention. Second, we will examine the relationship between program staff characteristics (e.g., professional degrees) and adherence and retention, guided by the hypothesis of adjusted hazard ratios being equal to 1.

Aim 2c: Clinical care process measures and adherence and retention. Third, we will analyze the association between clinical care process measures (e.g., use of telehealth, counseling modalities) and adherence and retention, guided by the hypothesis of adjusted hazard ratios being equal to 1.

Aim 3: Examining program characteristics and adverse OUD-related events.

Our final objective is to examine the association between treatment program organizational characteristics and adverse OUD-related events (AE) such as an SUD-related emergency department visit, including for overdose, while accounting for individual and community characteristics. Like Aim 2, we will employ time-to-event methods, focusing on the occurrence of the first adverse event. The adjusted hazard ratio of program structural factors, staff characteristics, and clinical care delivery features will be evaluated against a null hypothesis of 1. We will conduct sensitivity analyses akin to those described in Aim 2, ensuring the robustness of our results and conclusions. Applying the Lachin-Foulkes method to a study spanning 14 years, with variable drop-out rates, we determined that our sample size (>65,000) provides substantial power to detect clinically significant associations. Even under variable rates of attrition (10%-70%), we maintain adequate power to detect hazard ratios of 1.15 (or 0.87) with 80% power and a 5% type I error rate. Given the estimated study sample (>65,000), we are powered adequately to detect clinically meaningful associations.

Aim 3a: Program structural factors and AE. First, we will investigate the relationship between program structural elements (e.g., program size and type) and the occurrence of adverse OUD-related events (AE).

Aim 3b: Program staff characteristics and AE. Second, we will explore the connection between program staff attributes (e.g., professional degrees) and the incidence of adverse OUD-related events.

Aim 3c: Clinical care process measures and AE. Third, we will assess how clinical care processes (e.g., use of telehealth, counseling modalities) are associated with the prevalence of adverse OUD-related events.

Discussion

Our study explores treatment quality outcomes for TA adults with OUD along three dimensions, encompassing the use of MOUD, treatment adherence and retention, and adverse event outcomes, such as overdose. We also will focus on the influence of organizational change and innovation on these outcomes, such as increased telehealth visits and flexibility in methadone take-home doses following onset of the COVID-19 federal public health emergency. By integrating large administrative datasets with insights from rigorous statistical analyses, our study will examine the socio-ecological factors influencing treatment quality and aid policy makers in establishing evidence-based standards for an understudied and vulnerable population.

With the number of TA adults seeking treatment for OUD on the rise, especially among those covered by Medicaid, this study has the potential to make an impact by improving the health outcomes of TA adults amidst the opioid crisis. One of our study’s strengths is that it is designed to study the quality of treatment for OUD that is specific to young adults. Adopting a socio-ecological perspective, we draw insights into how individual, program, and community-level characteristics impact how a specific population that is especially vulnerable to socio-ecological forces does over time. Given that OUD disproportionately affects individuals insured by Medicaid, the data linkage between the CDS and Medicaid claims is another key strength of the study.

We must acknowledge that our study has its limitations. The most critical limitation is that we will not be experimentally controlling for all factors related to program selection. Consequently, we will be tempered in making causal inferences about the associations we find [101, 102]. We address this limitation through the use of the rigorous statistical methods and sensitivity analyses described above. Studies of this type, which examine the impact of organizational quality in real-world settings, have a long tradition in informing both scientific practice and policy [102]. Another limitation of our study is that we do not compare the impact of multi-level factors on MOUD outcomes between TA and older adults, limiting our ability to discern if there are organizational factors that are more or less potently associated with MOUD outcomes for TA adults than for non-TA adults. Still, our study findings will yield important recommendations to engage and retain an underserved population in treatment at a pivotal life phase. Lastly, the administrative databases we use will not identify all aspects of care provision for OUD (e.g., staff decision-making and patient clinical experiences). Nevertheless, our study will be a valuable addition to the growing body of qualitative, ethnographic, and spatially oriented research that explores the impact of various mechanisms like social networks, institutional qualities, and structural vulnerability on substance-related risks and harms and treatment practices [103105].

Over the past decade, there has been a significant increase in the prevalence of OUD among TA adults. Unfortunately, the existing OUD treatment framework inadequately serves this demographic, with lower rates of evidence-based treatment and increased early treatment attrition. Moreover, the heightened risk of substance-related adversities magnifies the issue. We need research to understand better the impact of existing types of care as well as inform policy makers, treatment providers, and the public about what individual, program, and community characteristics are associated with better quality of care. With the array of care options and the diversity inherent among TA adults, our study’s analytical methods will provide crucial information to address treatment gaps and disparities, benefiting this highly vulnerable age group.

Status and timeline of the study

Access to both state treatment registry (CDS) and Medicaid claims has been acquired as of September 2023, but no data analysis has been done yet. Analysis is expected to start during the winter of 2023, after merging data from the two sources. Aim 1 analysis will begin during the winter of 2023, followed by Aims 2–3 concurrently. The study is set to be finished by the fall of 2025.

References

  1. 1. Smith D. Emerging Adults and Substance Use Disorder Treatment: Oxford; 2018.
  2. 2. Institute of Medicine, National Research Council. In: Bonnie RJ, Stroud C, Breiner H, editors. Investing in the Health and Well-Being of Young Adults. Washington (DC)2015.
  3. 3. Arnett JJ. Emerging adulthood. A theory of development from the late teens through the twenties. Am Psychol. 2000;55(5):469–80. pmid:10842426
  4. 4. Silverstein M, Hadland SE, Hallett E, Botticelli M. Principles of Care for Young Adults With Substance Use Disorders. Pediatrics. 2021;147(Suppl 2):S195–S203. pmid:33386322
  5. 5. Smith DC. Emerging adults and substance use disorder treatment: developmental considerations and innovative approaches. New York, NY: Oxford University Press; 2018. xii, 277 pages p.
  6. 6. National Research Council. Investing in the health and well-being of young adults. In: Bonnie RJ, Stroud C, Breiner H, editors. Investing in the Health and Well-Being of Young Adults. Washington (DC): The National Academies Press; 2015.
  7. 7. Substance Abuse and Mental Health Services Administration. Key substance use and mental health indicators in the United States: Results from the 2019 National Survey on Drug Use and Health. Rockville, MD; 2020. Contract No.: HHS Pub No PEP20-07-01-001, NSDUH Series H-55.
  8. 8. Chambers RA, Taylor JR, Potenza MN. Developmental neurocircuitry of motivation in adolescence: a critical period of addiction vulnerability. Am J Psychiatry. 2003;160(6):1041–52. pmid:12777258
  9. 9. Afuseh E, Pike CA, Oruche UM. Individualized approach to primary prevention of substance use disorder: age-related risks. Subst Abuse Treat Prev Policy. 2020;15(1):58. pmid:32795372
  10. 10. Sussman S, Arnett JJ. Emerging Adulthood: Developmental Period Facilitative of the Addictions. Eval Health Prof. 2014;37(2):147–55. pmid:24492245
  11. 11. Wilson S. Commentary: Substance use and the brain: it is not straightforward to differentiate cause from consequence—a commentary on Kim-Spoon et al. (2020). J Child Psychol Psychiatry. 2020. pmid:32803755
  12. 12. Shulman EP, Smith AR, Silva K, Icenogle G, Duell N, Chein J, et al. The dual systems model: Review, reappraisal, and reaffirmation. Dev Cogn Neurosci. 2016;17:103–17. pmid:26774291
  13. 13. Facing Addiction in America: The Surgeon General’s Report on Alcohol, Drugs, and Health. In: General OotS, editor. Washington (DC): U.S. Department of Health & Human Services; November 2016.
  14. 14. Murthy VH. Ending the Opioid Epidemic—A Call to Action. N Engl J Med. 2016;375(25):2413–5. pmid:27959718
  15. 15. Christie C, Baker C, Cooper R, Kennedy PJ, Madras B, Bondi P. The President’s Commission on Combating Drug Addiction and the Opioid Crisis Final Report. Washington, DC: Office of National Drug Control Policy; 2017.
  16. 16. McLellan AT, Lewis DC, O’Brien CP, Kleber HD. Drug dependence, a chronic medical illness: implications for treatment, insurance, and outcomes evaluation. Jama. 2000;284(13):1689–95. pmid:11015800
  17. 17. Williams AR, Nunes EV, Bisaga A, Levin FR, Olfson M. Development of a Cascade of Care for responding to the opioid epidemic. Am J Drug Alcohol Abuse. 2019;45(1):1–10. pmid:30675818
  18. 18. Samples H, Williams AR, Crystal S, Olfson M. Impact Of Long-Term Buprenorphine Treatment On Adverse Health Care Outcomes In Medicaid. Health Aff (Millwood). 2020;39(5):747–55. pmid:32364847
  19. 19. Williams AR, Samples H, Crystal S, Olfson M. Acute Care, Prescription Opioid Use, and Overdose Following Discontinuation of Long-Term Buprenorphine Treatment for Opioid Use Disorder. Am J Psychiatry. 2020;177(2):117–24. pmid:31786933
  20. 20. Krawczyk N, Williams AR, Saloner B, Cerda M. Who stays in medication treatment for opioid use disorder? A national study of outpatient specialty treatment settings. J Subst Abuse Treat. 2021;126:108329. pmid:34116820
  21. 21. Hser YI, Evans E, Grella C, Ling W, Anglin D. Long-term course of opioid addiction. Harv Rev Psychiatry. 2015;23(2):76–89. pmid:25747921
  22. 22. Tsai AC, Kiang MV, Barnett ML, Beletsky L, Keyes KM, McGinty EE, et al. Stigma as a fundamental hindrance to the United States opioid overdose crisis response. PLOS Medicine. 2019;16(11):e1002969. pmid:31770387
  23. 23. Jalal H, Buchanich JM, Roberts MS, Balmert LC, Zhang K, Burke DS. Changing dynamics of the drug overdose epidemic in the United States from 1979 through 2016. Science. 2018;361(6408). pmid:30237320
  24. 24. Jones CM, Logan J, Gladden RM, Bohm MK. Vital Signs: Demographic and Substance Use Trends Among Heroin Users—United States, 2002–2013. MMWR Morb Mortal Wkly Rep. 2015;64(26):719–25. pmid:26158353
  25. 25. Larance B, Gisev N, Cama E, Nelson EC, Darke S, Larney S, et al. Predictors of transitions across stages of heroin use and dependence prior to treatment-seeking among people in treatment for opioid dependence. Drug Alcohol Depend. 2018;191:145–51. pmid:30107320
  26. 26. Hadland SE. The Broken Care Continuum for Young Adults With Opioid Addiction. J Adolesc Health. 2020;67(6):735–6. pmid:33220792
  27. 27. Fishman M, Wenzel K, Scodes J, Pavlicova M, Lee JD, Rotrosen J, et al. Young Adults Have Worse Outcomes Than Older Adults: Secondary Analysis of a Medication Trial for Opioid Use Disorder. J Adolesc Health. 2020;67(6):778–85. pmid:32873500
  28. 28. Hoeppner BB, Hoeppner SS, Kelly JF. Do young people benefit from AA as much, and in the same ways, as adult aged 30+? A moderated multiple mediation analysis. Drug Alcohol Depend. 2014;143:181–8. pmid:25150401
  29. 29. Kampman K, Jarvis M. American Society of Addiction Medicine (ASAM) National Practice Guideline for the Use of Medications in the Treatment of Addiction Involving Opioid Use. J Addict Med. 2015;9(5):358–67. pmid:26406300
  30. 30. Committee On Substance USE, Prevention. Medication-Assisted Treatment of Adolescents With Opioid Use Disorders. Pediatrics. 2016;138(3). pmid:27550978
  31. 31. Pietras S, Azur M, Brown J. Review of medication assisted treatment guidelines and measures for opioid and alcohol use. Washington, DC: Assistant Secretary for Planning and Evaluation; 2015.
  32. 32. Substance Abuse and Mental Health Services Administration. Medications for Opioid Use Disorder. Treatment Improvement Protocol (TIP) 63. Rockville, MD Substance Abuse and Mental Health Services Administration; 2020. Contract No.: Publication No. PEP20-02-01-006.
  33. 33. Neighbors CJ, Choi S, Healy S, Yerneni R, Sun T, Shapoval L. Age related medication for addiction treatment (MAT) use for opioid use disorder among Medicaid-insured patients in New York. Subst Abuse Treat Prev Policy. 2019;14(1):28. pmid:31238952
  34. 34. Hadland SE, Bagley SM, Rodean J, Silverstein M, Levy S, Larochelle MR, et al. Receipt of Timely Addiction Treatment and Association of Early Medication Treatment With Retention in Care Among Youths With Opioid Use Disorder. JAMA Pediatr. 2018. pmid:30208470
  35. 35. Hadland SE, Wharam JF, Schuster MA, Zhang F, Samet JH, Larochelle MR. Trends in Receipt of Buprenorphine and Naltrexone for Opioid Use Disorder Among Adolescents and Young Adults, 2001–2014. JAMA Pediatr. 2017;171(8):747–55. pmid:28628701
  36. 36. Feder KA, Krawczyk N, Saloner B. Medication-Assisted Treatment for Adolescents in Specialty Treatment for Opioid Use Disorder. J Adolesc Health. 2017;60(6):747–50. pmid:28258807
  37. 37. Woody GE, Poole SA, Subramaniam G, Dugosh K, Bogenschutz M, Abbott P, et al. Extended vs short-term buprenorphine-naloxone for treatment of opioid-addicted youth: a randomized trial. JAMA. 2008;300(17):2003–11. pmid:18984887
  38. 38. Marsch LA, Moore SK, Borodovsky JT, Solhkhah R, Badger GJ, Semino S, et al. A randomized controlled trial of buprenorphine taper duration among opioid-dependent adolescents and young adults. Addiction. 2016;111(8):1406–15. pmid:26918564
  39. 39. Zhang Z, Friedmann PD, Gerstein DR. Does retention matter? Treatment duration and improvement in drug use. Addiction. 2003;98(5):673–84. pmid:12751985
  40. 40. Hubbard RL, Craddock SG, Anderson J. Overview of 5-year followup outcomes in the drug abuse treatment outcome studies (DATOS). J Subst Abuse Treat. 2003;25(3):125–34. pmid:14670518
  41. 41. Moos RH, Moos BS. Long-term influence of duration and intensity of treatment on previously untreated individuals with alcohol use disorders. Addiction. 2003;98(3):325–37. pmid:12603232
  42. 42. Grella CE, Hser YI, Joshi V, Anglin MD. Patient histories, retention, and outcome models for younger and older adults in DATOS. Drug Alcohol Depend. 1999;57(2):151–66. pmid:10617099
  43. 43. Satre DD, Mertens JR, Arean PA, Weisner C. Five-year alcohol and drug treatment outcomes of older adults versus middle-aged and younger adults in a managed care program. Addiction. 2004;99(10):1286–97. pmid:15369567
  44. 44. Timko C, Schultz NR, Cucciare MA, Vittorio L, Garrison-Diehn C. Retention in medication-assisted treatment for opiate dependence: A systematic review. J Addict Dis. 2016;35(1):22–35. pmid:26467975
  45. 45. Hser YI, Huang D, Chou CP, Anglin MD. Trajectories of heroin addiction: growth mixture modeling results based on a 33-year follow-up study. Eval Rev. 2007;31(6):548–63. pmid:17986707
  46. 46. Nosyk B, Anglin MD, Brecht ML, Lima VD, Hser YI. Characterizing durations of heroin abstinence in the California Civil Addict Program: results from a 33-year observational cohort study. Am J Epidemiol. 2013;177(7):675–82. pmid:23445901
  47. 47. Mattick RP, Breen C, Kimber J, Davoli M. Methadone maintenance therapy versus no opioid replacement therapy for opioid dependence. Cochrane Database Syst Rev. 2009(3):CD002209. pmid:19588333
  48. 48. Weiss RD, Potter JS, Fiellin DA, Byrne M, Connery HS, Dickinson W, et al. Adjunctive counseling during brief and extended buprenorphine-naloxone treatment for prescription opioid dependence: a 2-phase randomized controlled trial. Arch Gen Psychiatry. 2011;68(12):1238–46. pmid:22065255
  49. 49. Gruber VA, Delucchi KL, Kielstein A, Batki SL. A randomized trial of 6-month methadone maintenance with standard or minimal counseling versus 21-day methadone detoxification. Drug Alcohol Depend. 2008;94(1–3):199–206. pmid:18243585
  50. 50. Sees KL, Delucchi KL, Masson C, Rosen A, Clark HW, Robillard H, et al. Methadone maintenance vs 180-day psychosocially enriched detoxification for treatment of opioid dependence: a randomized controlled trial. JAMA. 2000;283(10):1303–10. pmid:10714729
  51. 51. Matson SC, Hobson G, Abdel-Rasoul M, Bonny AE. A retrospective study of retention of opioid-dependent adolescents and young adults in an outpatient buprenorphine/naloxone clinic. J Addict Med. 2014;8(3):176–82. pmid:24695018
  52. 52. Smyth BP, Elmusharaf K, Cullen W. Opioid substitution treatment and heroin dependent adolescents: reductions in heroin use and treatment retention over twelve months. BMC Pediatr. 2018;18(1):151. pmid:29728088
  53. 53. Askari MS, Martins SS, Mauro PM. Medication for opioid use disorder treatment and specialty outpatient substance use treatment outcomes: Differences in retention and completion among opioid-related discharges in 2016. J Subst Abuse Treat. 2020;114:108028. pmid:32527510
  54. 54. Mintz CM, Presnall NJ, Sahrmann JM, Borodovsky JT, Glaser PEA, Bierut LJ, et al. Age disparities in six-month treatment retention for opioid use disorder. Drug Alcohol Depend. 2020;213:108130. pmid:32593972
  55. 55. Brorson HH, Ajo Arnevik E, Rand-Hendriksen K, Duckert F. Drop-out from addiction treatment: a systematic review of risk factors. Clin Psychol Rev. 2013;33(8):1010–24. pmid:24029221
  56. 56. Schuman-Olivier Z, Weiss RD, Hoeppner BB, Borodovsky J, Albanese MJ. Emerging adult age status predicts poor buprenorphine treatment retention. J Subst Abuse Treat. 2014;47(3):202–12. pmid:24953168
  57. 57. Viera A, Bromberg DJ, Whittaker S, Refsland BM, Stanojlovic M, Nyhan K, et al. Adherence to and Retention in Medications for Opioid Use Disorder Among Adolescents and Young Adults. Epidemiol Rev. 2020;42(1):41–56. pmid:32239206
  58. 58. Bagley SM, Schoenberger SF, Dellabitta V, Lunze K, Barron K, Hadland SE, et al. Ambivalence and Stigma Beliefs About Medication Treatment Among Young Adults With Opioid Use Disorder: A Qualitative Exploration of Young Adults’ Perspectives. Journal of Adolescent Health. 2023;72(1):105–10. pmid:36216678
  59. 59. Davis JP, Smith DC, Briley DA. Substance use prevention and treatment outcomes for emerging adults in non-college settings: A meta-analysis. Psychol Addict Behav. 2017;31(3):242–54. pmid:28318279
  60. 60. Borodovsky JT, Levy S, Fishman M, Marsch LA. Buprenorphine Treatment for Adolescents and Young Adults With Opioid Use Disorders: A Narrative Review. J Addict Med. 2018;12(3):170–83. pmid:29432333
  61. 61. Stokols D. Social ecology and behavioral medicine: implications for training, practice, and policy. Behav Med. 2000;26(3):129–38. pmid:11209593
  62. 62. Stokols D. Establishing and maintaining healthy environments. Toward a social ecology of health promotion. Am Psychol. 1992;47(1):6–22. pmid:1539925
  63. 63. Link BG, Phelan J. Social conditions as fundamental causes of disease. Journal of health and social behavior. 1995:80–94. pmid:7560851
  64. 64. Fishman M, Wenzel K, Vo H, Wildberger J, Burgower R. A pilot randomized controlled trial of assertive treatment including family involvement and home delivery of medication for young adults with opioid use disorder. Addiction. 2021;116(3):548–57. pmid:32621368
  65. 65. Hadland SE, Yule AM, Levy SJ, Hallett E, Silverstein M, Bagley SM. Evidence-Based Treatment of Young Adults With Substance Use Disorders. Pediatrics. 2021;147(Suppl 2):S204–S14. pmid:33386323
  66. 66. Bagley SM, Ventura AS, Lasser KE, Muench F. Engaging the Family in the Care of Young Adults With Substance Use Disorders. Pediatrics. 2021;147(Suppl 2):S215–S9. pmid:33386324
  67. 67. Acevedo A, Harvey N, Kamanu M, Tendulkar S, Fleary S. Barriers, facilitators, and disparities in retention for adolescents in treatment for substance use disorders: a qualitative study with treatment providers. Subst Abuse Treat Prev Policy. 2020;15(1):42. pmid:32552836
  68. 68. Siringil Perker S, Chester LEH. The Justice System and Young Adults With Substance Use Disorders. Pediatrics. 2021;147(Suppl 2):S249–S58. pmid:33386327
  69. 69. Wagner V, Bertrand K, Flores-Aranda J, Acier D, Brunelle N, Landry M, et al. Initiation of Addiction Treatment and Access to Services: Young Adults’ Accounts of Their Help-Seeking Experiences. Qual Health Res. 2017;27(11):1614–27. pmid:27920355
  70. 70. Matusow H, Dickman SL, Rich JD, Fong C, Dumont DM, Hardin C, et al. Medication assisted treatment in US drug courts: Results from a nationwide survey of availability, barriers and attitudes. Journal of Substance Abuse Treatment. 2013;44(5):473–80. pmid:23217610
  71. 71. Hora PF. Trading one drug for another? What drug treatment court professionals need to learn about opioid replacement therapy. Journal of Maintenance in the Addictions. 2005;2(4):71–6.
  72. 72. Friedmann PD, Hoskinson R Jr, Gordon M, Schwartz R, Kinlock T, Knight K, et al. Medication-assisted treatment in criminal justice agencies affiliated with the criminal justice-drug abuse treatment studies (CJ-DATS): availability, barriers, and intentions. Substance Abuse. 2012;33(1):9–18. pmid:22263709
  73. 73. Friedmann PD, Wilson D, Knudsen HK, Ducharme LJ, Welsh WN, Frisman L, et al. Effect of an Organizational Linkage Intervention on Staff Perceptions of Medication-Assisted Treatment and Referral Intentions in Community Corrections. Journal of Substance Abuse Treatment. 2015;50:50–8. pmid:25456091
  74. 74. Gordon AJ, Lo-Ciganic WH, Cochran G, Gellad WF, Cathers T, Kelley D, et al. Patterns and Quality of Buprenorphine Opioid Agonist Treatment in a Large Medicaid Program. J Addict Med. 2015;9(6):470–7. pmid:26517324
  75. 75. Rosenblum A, Cleland CM, Fong C, Kayman DJ, Tempalski B, Parrino M. Distance traveled and cross-state commuting to opioid treatment programs in the United States. J Environ Public Health. 2011;2011:948789. pmid:21776440
  76. 76. Stein BD, Gordon AJ, Sorbero M, Dick AW, Schuster J, Farmer C. The impact of buprenorphine on treatment of opioid dependence in a Medicaid population: recent service utilization trends in the use of buprenorphine and methadone. Drug Alcohol Depend. 2012;123(1–3):72–8. pmid:22093488
  77. 77. Hogue A, Becker SJ, Fishman M, Henderson CE, Levy S. Youth OUD treatment during and after COVID: Increasing family involvement across the services continuum. J Subst Abuse Treat. 2021;120:108159. pmid:33298299
  78. 78. Bradley EH, Taylor LA. The American health care paradox: why spending more is getting us less. First edition. ed. New York: PublicAffairs; 2013. xix, 248 pages p.
  79. 79. Hansen HB, Siegel CE, Case BG, Bertollo DN, DiRocco D, Galanter M. Variation in use of buprenorphine and methadone treatment by racial, ethnic, and income characteristics of residential social areas in New York City. J Behav Health Serv Res. 2013;40(3):367–77. pmid:23702611
  80. 80. Grubb LK. Personal and Socioeconomic Determinants in Medication-assisted Treatment of Opioid Use Disorder in Adolescents and Young Adults. Clin Ther. 2019;41(9):1669–80. pmid:31462387
  81. 81. Cook BL, Alegria M. Racial-ethnic disparities in substance abuse treatment: the role of criminal history and socioeconomic status. Psychiatr Serv. 2011;62(11):1273–81. pmid:22211205
  82. 82. Alegria M, Carson NJ, Goncalves M, Keefe K. Disparities in treatment for substance use disorders and co-occurring disorders for ethnic/racial minority youth. J Am Acad Child Adolesc Psychiatry. 2011;50(1):22–31. pmid:21156267
  83. 83. Stahler GJ, Mennis J. Treatment outcome disparities for opioid users: Are there racial and ethnic differences in treatment completion across large US metropolitan areas? Drug Alcohol Depend. 2018;190:170–8. pmid:30041092
  84. 84. Sahker E, Pro G, Sakata M, Furukawa TA. Substance use improvement depends on Race/Ethnicity: Outpatient treatment disparities observed in a large US national sample. Drug Alcohol Depend. 2020;213:108087. pmid:32492601
  85. 85. Pro G, Sahker E, Baldwin J. Incarceration as a Reason for US Alcohol and Drug Treatment Non-completion: a Multilevel Analysis of Racial/Ethnic and Sex Disparities. J Behav Health Serv Res. 2020;47(4):464–75. pmid:32350800
  86. 86. Komaromy M, Mendez-Escobar E, Madden E. Addressing Racial Trauma in the Treatment of Substance Use Disorders. Pediatrics. 2021;147(Suppl 2):S268–S70. pmid:33386331
  87. 87. D’Aunno T. The role of organization and management in substance abuse treatment: Review and roadmap. J Subst Abuse Treat. 2006;31(3):221–33. pmid:16996385
  88. 88. Roman PM, Abraham AJ, Knudsen HK. Using medication-assisted treatment for substance use disorders: evidence of barriers and facilitators of implementation. Addict Behav. 2011;36(6):584–9. pmid:21377275
  89. 89. Knudsen HK, Abraham AJ, Oser CB. Barriers to the implementation of medication-assisted treatment for substance use disorders: the importance of funding policies and medical infrastructure. Eval Program Plann. 2011;34(4):375–81. pmid:21371752
  90. 90. Mancher M, Leshner AI, National Academies of Sciences E, Medicine. Barriers to broader use of medications to treat opioid use disorder. Medications for opioid use disorder save lives: National Academies Press (US); 2019.
  91. 91. Earnshaw V, Smith L, Copenhaver M. Drug Addiction Stigma in the Context of Methadone Maintenance Therapy: An Investigation into Understudied Sources of Stigma. International Journal of Mental Health and Addiction. 2013;11(1):110–22. pmid:23956702
  92. 92. Alinsky RH, Hadland SE, Matson PA, Cerda M, Saloner B. Adolescent-Serving Addiction Treatment Facilities in the United States and the Availability of Medications for Opioid Use Disorder. Journal of Adolescent Health. 2020;67(4):542–9. pmid:32336560
  93. 93. Hadland SE, Wood E, Levy S. How the paediatric workforce can address the opioid crisis. Lancet. 2016;388(10051):1260–1. pmid:27673455
  94. 94. Martin SA, Chiodo LM, Wilson A. Retention in care as a quality measure for opioid use disorder. Subst Abus. 2019;40(4):453–8. pmid:31361592
  95. 95. Clark RE, Baxter JD, Aweh G, O’Connell E, Fisher WH, Barton BA. Risk Factors for Relapse and Higher Costs Among Medicaid Members with Opioid Dependence or Abuse: Opioid Agonists, Comorbidities, and Treatment History. J Subst Abuse Treat. 2015;57:75–80. pmid:25997674
  96. 96. Berwick D, Fox DM. "Evaluating the Quality of Medical Care": Donabedian’s Classic Article 50 Years Later. Milbank Q. 2016;94(2):237–41. pmid:27265554
  97. 97. Donabedian A. The quality of care. How can it be assessed? JAMA. 1988;260(12):1743–8. pmid:3045356
  98. 98. Donabedian A. Quality assessment and assurance: unity of purpose, diversity of means. Inquiry. 1988;25(1):173–92. pmid:2966122
  99. 99. Kleinbaum DG, Klein M. Survival Analysis: A Self-Learning Text. 3 ed. New York: Springer; 2012. 700 p.
  100. 100. Ripatti S, Palmgren J. Estimation of multivariate frailty models using penalized partial likelihood. Biometrics. 2000;56(4):1016–22. pmid:11129456
  101. 101. Popper K. The Logic of Scientific Discovery. New York: Routledge; 1959.
  102. 102. Shadish WR, Cook TD, Campbell DT. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. New York: Houghton Mifflin; 2002. 623 p.
  103. 103. McNeil R, Fleming T, Collins AB, Czechaczek S, Mayer S, Boyd J. Navigating post-eviction drug use amidst a changing drug supply: a spatially-oriented qualitative study of overlapping housing and overdose crises in Vancouver, Canada. Drug and alcohol dependence. 2021;222:108666. pmid:33766440
  104. 104. McKim A. Addicted to rehab: Race, gender, and drugs in the era of mass incarceration: Rutgers University Press; 2017.
  105. 105. Bradford AC. Nuisance ordinances and overdose mortality. Available at SSRN 4232271. 2022.