This paper examines network prominence in a co-prescription network as an indicator of opioid doctor shopping (i.e., fraudulent solicitation of opioids from multiple prescribers). Using longitudinal data from a large commercially insured population, we construct a network where a tie between patients is weighted by the number of shared opioid prescribers. Given prior research suggesting that doctor shopping may be a social process, we hypothesize that active doctor shoppers will occupy central structural positions in this network. We show that network prominence, operationalized using PageRank, is associated with more opioid prescriptions, higher predicted risk for dangerous morphine dosage, opioid overdose, and opioid use disorder, controlling for number of prescribers and other variables. Moreover, as a patient’s prominence increases over time, so does their risk for these outcomes, compared to their own average level of risk. Results highlight the importance of co-prescription networks in characterizing high-risk social dynamics.
Citation: Perry BL, Yang KC, Kaminski P, Odabas M, Park J, Martel M, et al. (2019) Co-prescription network reveals social dynamics of opioid doctor shopping. PLoS ONE 14(10): e0223849. https://doi.org/10.1371/journal.pone.0223849
Editor: Kathryn E. McCollister, University of Miami, UNITED STATES
Received: February 27, 2019; Accepted: September 30, 2019; Published: October 25, 2019
Copyright: © 2019 Perry et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are available on Dryad at https://doi.org/10.5061/dryad.4xgxd2552.
Funding: This research was funded by a grant from the National Institute on Drug Abuse (R01 DA039928) to the first author, BLP. Information about NIDA can be found at https://www.drugabuse.gov/. Funding was also provided by an Indiana University Addictions Grand Challenge Grant, and a University of Kentucky Interdisciplinary Research Collaborations Seed Grant. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Prescription drug abuse is an unmitigated public health crisis that has been developing for decades , despite increasing regulatory efforts. Drug overdose was responsible for more than 70,000 deaths in the U.S. in 2017, making the current drug epidemic the deadliest in history . The Centers for Disease Control (CDC) reports that opioids are the leading cause of overdose mortality, and more than 40% of opioid overdoses are attributable to prescription opioids .
One of the primary means of obtaining prescription opioids is through “doctor shopping” , or soliciting prescriptions for controlled substances from multiple clinicians by over-reporting or manufacturing symptoms. Among those with prescription drug dependence, nearly 40% are estimated to engage in doctor shopping . Moreover, compared to people who abuse prescription drugs but do not shop doctors, doctor shoppers are more likely to experience drug-related hospital admission , non-fatal opioid overdose , and opioid overdose fatalities [8,9]. Thus, doctor shopping is a critical mechanism that contributes to opioid misuse trajectories .
In response to the increasing prevalence of prescription drug abuse and diversion, all fifty states and Washington D.C. have created prescription drug monitoring programs (PDMPs) to discourage doctor shopping and to reduce inappropriate prescribing and dispensing . While PDMP implementation has recently been associated with modest decreases in rates of prescription opioid prescribing, diversion, and poisoning in some geographic areas, evidence overall is mixed . Moreover, the U.S. continues to see increases in opioid dependence and related morbidity and mortality [12–15]. These findings suggest that although PDMPs may have reduced egregious drug-seeking and prescribing behavior, they have not addressed opioid misuse initiation and early patterns of abuse that fall short of detection criteria used to identify fraudulent behavior.
Doctor shopping has historically been difficult to characterize . A common method of measurement uses multiple provider episodes (MPE), defined as obtaining controlled substances from some minimum number of prescribers and/or pharmacies in a given period of time. Although commonly used MPE thresholds have low false positive rates [7, 16, 17], this approach is crude and may be overly conservative. For example, people who engage in low levels of doctor shopping or those who doctor shop heavily for a brief period are unlikely to be correctly classified. Therefore, it is critical to explore alternative methods for characterizing prescription drug seeking behaviors to facilitate early intervention and prevention.
Recent research suggests that social processes may be a critical element of doctor shopping [16, 18, 19]. First, doctor shopping is clustered around particular at-risk prescribers. Doctor shoppers systematically seek out physicians who are complicit, easily manipulated, or unlikely to monitor electronic data . For instance, a previous study estimated that the majority of doctor shopping is concentrated around 13% of clinicians who prescribed any opioids, and only about 2% of prescribers were used by heavy doctor shoppers . Second, qualitative research indicates that information about prescriber behavior is disseminated through social networks .
This line of research raises an important question: Do doctor shoppers occupy distinctive structural positions in a network of patients and prescribers? In particular, we hypothesize that doctor shoppers—or high-risk individuals more generally—occupy central positions in the co-prescription network, where patients are connected to other patients if they share the same prescribers. First, by definition, they receive prescriptions from multiple prescribers and thus are likely to be connected to many other patients through those prescribers. Second, their prescribers tend to be at-risk prescribers who are targeted by other doctor shoppers. In other words, the prescribers who are connected to a doctor shopper are probably more likely to be connected to many other doctor shoppers. If doctor shoppers in isolation tend to occupy more central positions in the network, then doctor shoppers are more likely to be connected to other central nodes (other doctor shoppers), further strengthening the prominence of their structural positions. Third, simply being at a central position in the network may reflect high-risk conditions, such as being embedded in a social network of doctor shoppers or living in a community at risk for opioid misuse.
We test the hypothesis that prominence in a patient co-prescription network is an indicator of opioid misuse and related adverse outcomes using a large claims database of over 500,000 patients. Consistent with our expectations, we find that network prominence is associated with number of opioid prescriptions and risk for high morphine dosage, overdose, and opioid use disorder.
We use deidentified health claims from a large commercially insured population of about 19 million patients for the period of June 2015 through December 2016. Data are observed quarterly at the patient level and linked across administrative and health data. Patients are demographically representative of the US population with respect to gender and age, and representative of the commercially-insured population on all other measurable characteristics. However, because data are observational and retrospective, statistical inferences and any related conclusions should be made with caution.
We focus our study on the area most affected by the opioid crisis , the Appalachian region of the US. While prescription opioid misuse is a nation-wide concern, the Appalachian region of the United States has historically been the epicenter of the crisis [20, 21]. High rates of opioid prescribing early in the epidemic, economic stressors, and densely-knit social networks that facilitate drug diversion and distribution contributed to prescription drug misuse and, later, heroin initiation and abuse in Appalachia and other rural areas [22–24].
There is considerable disagreement about which states constitute Appalachia, with geographic, cultural, and political definitions providing unique but overlapping boundaries. Following Williams , we use the core region comprised of six states that have been included in the most influential government and scientific definitions of Appalachia–Georgia, North Carolina, Tennessee, Kentucky, Virginia, and West Virginia. Given its prominent status in the opioid epidemic (including being the probable epicenter), we add a seventh state, Ohio, which is included in the larger regional boundaries defined by the Appalachian Regional Commission . To reduce the data to a manageable number of patients for SNA, we restrict our analysis sample to patients in this seven-state region who received one or more opioid prescriptions during the study period. Models using the larger ARC definition of Appalachia yield substantively identical results, but require more computing resources to converge. This process results in a sample of 526,914 patients who contribute 2,107,656 quarterly observations.
To conduct SNA, we construct a patient co-prescription network in which a tie between patients indicates that they were prescribed one or more opioids by the same prescriber (as identified with a unique provider identification number). For this process, we omit opioid agents used exclusively or primarily for medication assisted treatment (MAT; e.g., buprenorphine). This strategy reduces concerns that network centrality measures were an artifice of network clustering due to sparsely located MAT-licensed providers in medically underserved areas. Network ties are undirected and weighted by the number of unique providers from which opioid co-prescriptions (minus MATs) were obtained. For example, if Patient A and Patient B were prescribed opioids by a set of the same three unique providers, the weight of their tie is three. Ties are also pooled across three quarters (T-2, T-1, and T) to account for potential lags in information diffusion and to offset the unnatural cut points imposed by quarterly observation.
We conduct two sets of sensitivity analyses to assess the robustness of results to different network specifications. First, because the network is sparse and contains many isolates, we replicate all models after omitting patients who had no more than one unique opioid prescriber per quarter. This provides an assessment of the extent to which network prominence captures variation among moderate and high-risk patients rather than simply identifying those that are clearly not doctor shoppers. Second, we conduct sensitivity analyses using bipartite, or two-mode, network measures. This is accomplished using the generalized Co-HITS algorithm developed by Deng and colleagues . This algorithm produces a PageRank score for patients that is based on both their own structural position and the prominence of the prescribers to which they are directly and indirectly connected. Many different weighting strategies are possible in the context of Co-HITS, but here we constrain all weights to be 1. In future research, we will explore different weighting strategies in attempt to improve bipartite measures of prominence in prescription networks.
The PageRank algorithm is used to measure each patient’s prominence or influence in the co-prescription network. PageRank, originally developed to measure the importance of web pages , roughly measures the probability that an actor who randomly traverses the network through ties will arrive at a particular node. More specifically, PageRank is a stationary probability distribution over all nodes in a network that satisfy the following equation:
Where PR(i) is the PageRank of node i, N is the number of nodes, d is a damping factor (d = 0.85), M(i) is the set of the nodes that have an edge pointing to i, wij is the weight of the edge from j to i, and is the strength of node j (the sum of the weights from node j). In our case, the patient-patient network does not have directed edges, and thus each undirected edge is treated as two directional edges. Although PageRank is similar to Eigenvector centrality in that both measure prominence, PageRank does not exhibit the critical localization problem of Eigenvector centrality .
A patient with high PageRank is someone who received opioids from health professionals who also prescribed opioids to other prominent patients (i.e., those with high PageRank). Note that a patient could have low PageRank and still visit a large number of prescribers, as long as those prescribers did not simultaneously provide opioids to many other prominent patients; Conversely, a patient could have high PageRank and still visit a small number of prescribers since PageRank takes into account the network positions of other nodes. For the current analysis, we convert the raw score for patient PageRank to a percentile value to address pronounced positive skew and to increase the interpretability of PageRank. We conduct sensitivity analyses using other specifications of PageRank and other network centralities and find that they produce similar results. These are presented in Tables 3–6.
We model four dependent variables. First, number of opioid prescriptions is a count of the number of unique prescriptions for opioids obtained in a given quarter across all prescribers. Second, overdose potential is measured using maximum daily morphine milligram equivalents (MME). MME is a value assigned to opioid medications to standardize relative potency. It was developed to assess dosing safety by facilitating calculation of the total potency of consumed drugs . Daily MME is calculated by: 1) determining the total daily amount of each opioid prescribed; 2) multiplying the dose for each opioid by the CDC conversion factor; and 3) totaling MMEs for all prescriptions. We then use the maximum daily MME during a quarter to operationalize a patient’s highest risk for overdose. High MME could also be an indicator of diversion potential. In our data, 1.46% of patients in the top tenth percentile for PageRank had a maximum daily MME greater than 500 mg–over 500% of the CDC’s threshold for high overdose potential. Because doctor shopping for the purposes of diversion may not be associated with personal risk for opioid misuse outcomes (e.g., overdose, opioid use disorder), this is a potential source of unexplained variation. A binary variable is equal to 1 (else 0) if maximum daily MME is greater than 90 mg, consistent with CDC prescribing guidelines defining this as the threshold for high overdose risk . Third, drug overdose is indexed using ICD-10 diagnostic codes for accidental drug poisoning in a given quarter. We calculate a measure for accidental poisoning by opioids exclusively (including synthetic opioids, e.g., fentanyl), and a separate measure that indexes poisoning by opioids or “unspecified” drugs. Although findings are consistent, we present model results based on the more inclusive measure. This decision is based on research suggesting that use of nonspecific language to classify drug poisoning leads to overuse of the “unspecified” code and undercounting of opioid overdoses [31–33]. Fourth, we create a binary indicator of opioid use disorder based on the presence of ICD-10 diagnostic codes for opioid abuse or dependence in a given quarter.
Our models also include a number of controls. We add gender (1 = female; 0 = male), age in years, and type of insurance. The latter is coded into three binary categories representing the most restrictive plans (health maintenance organizations, or HMOs), the least restrictive plans (point of service plans, or POSs), and other plans falling between these on a continuum of restrictiveness. Insurance plan is included to control for any patterns of health services utilization (i.e., which specific prescribers were accessed) that are due to plan restrictions rather than social network processes such as information sharing. To adjust for high opioid volume associated with hospice care, which may be correlated with patient PageRank percentile, we add a control for any cancer diagnosis during the study period. Finally, because our intention is to capture the relational pattern of drug seeking through prescribers rather than the sheer volume of doctor shopping, we control for each patients’ number of unique prescribers in a given quarter. This ensures that any effects of patient PageRank percentile are attributable to the position of the node in a network of co-prescription ties over and above any effect of visiting a large number of prescribers.
Longitudinal analyses are conducted using multivariate mixed effects logistic and negative binomial regression models with random intercepts at the person level to adjust for correlation of observations within patients over time. Models regress opioid use outcomes on network prominence (i.e., PageRank percentile) and control variables. We employ variance decomposition to model the effects of PageRank percentile on outcomes. Specifically, we split the variance in PageRank percentile into between-person and within-person estimates, where BP is the person mean (i.e., the mean value across four quarters) and WP is the difference between the current quarter and the person mean. The BP effect conveys information about how a patient’s average network prominence is associated with their average number of opioid prescriptions, for example, comparing across patients. The WP effect reflects how being more or less prominent than usual is associated with obtaining a higher or lower number of prescriptions than usual, comparing a patient to him or herself across quarters. The latter estimate is analogous to a fixed effects model, and controls for all measured and unmeasured heterogeneity at the patient level that is time invariant .
We also include state fixed effects to control for all unobserved heterogeneity at the state level, reducing concerns about confounding effects of differences across states in PDMP monitoring, prescription drug policies, and health care systems. Sensitivity analyses using United States Post Office city groups (based on zip code) in lieu of state fixed effects produce identical results. All models control for gender, age, type of insurance, any cancer diagnosis, and number of unique opioid prescribers. Figures of predicted counts or probabilities are presented to convey the magnitude of the effects. In figures, the y-axis range is set to +/-1 standard deviation. All data and Stata code needed to replicate these analyses will be archived in Dryad.
Our dataset contains 526,914 patients who contributed 2,107,656 quarterly prescription entries in 2016. In the patient co-prescription network, a tie between patients indicates that they were prescribed one or more opioids (excluding medication-assisted treatment) by the same prescriber. On average, each patient is connected to 29 other patients through opioid co-prescription in the same 90-day period (see Table 1). However, the degree distribution is heavily skewed and there are a small number of hub patients with very large degree (range: 0–1,178). The mean number of opioid prescriptions per quarter is 1.26 and the mean number of opioid prescribers is 0.59. About 8% of patients have high overdose potential (i.e., a max daily MME greater than 90mg) in a given quarter, and 0.16% experience an opioid overdose.
Table 2 provides results from the regression of number of opioids prescribed per quarter on PageRank percentile. Patients with higher PageRank are predicted to have higher numbers of opioid prescriptions compared to those with lower PageRank, controlling for the number of prescribers and other factors (See Model 1). A 10-percentile increase in between-person (BP) PageRank is associated with a predicted 18% increase in the odds of obtaining an additional opioid prescription (p < .001), adjusting for controls. Similarly, when patients have higher PageRank than usual, they also obtain more prescriptions than is typical for them. A 10-percentile increase in within-person (WP) PageRank over time is associated with a 15% increase in the odds of having an additional opioid prescription (p < .001), even after controlling for the number of unique opioid prescribers in a quarter.
Results from the regression of high overdose potential (>90mg maximum daily MME) on PageRank percentile are provided in Model 2 of Table 2. Patients with higher average PageRank are at greater risk for being prescribed dangerous doses of opioids compared to those with lower PageRank. A 10-percentile increase in BP PageRank predicts a 88% higher odds of having a maximum daily MME>90mg (p < .001). Also, as a patient’s own PageRank increases, so does their predicted odds of high MME, net of controls. A 10-percentile increase in PageRank predicts a 27% increased odds of overdose over time (p < .001).
Model 3 of Table 2 presents results from the regression of opioid overdose on PageRank percentile. Higher average PageRank is associated with elevated risk of overdose compared to patients with lower PageRank. A 10-percentile increase in BP PageRank predicts a 20% higher odds of overdose (p < .001). Also, as a patient’s own PageRank increases, so does their predicted odds of overdose, adjusting for number of prescribers and other control variables. A 10-percentile increase in WP PageRank over time is estimated to increase overdose risk by 10% (p < .001).
Finally, as shown in Model 4 (See Table 2), PageRank is associated with being diagnosed with an opioid use disorder (OUD). A 10-percentile increase in average PageRank predicts a 200% higher odds of OUD, comparing across patients (p < .001). At the same time, as a patient’s own PageRank increases, so too does their risk for being diagnosed with OUD. A 10-percentile increase in WP PageRank over time is associated with an 11% increase in the predicted odds of OUD.
Predicted counts or probabilities of adverse opioid outcomes as a function of network prominence are presented in figures. As shown in Fig 1, patients with the lowest PageRank percentile are predicted to obtain an average of 0.769 (CI: 0.756–0.783) opioid prescriptions per quarter, compared to 2.098 (CI: 2.082–2.113) opioid prescriptions among those with the highest PageRank percentile. Likewise, in quarters where a patient experiences an extreme decrease in PageRank percentile over time, they are predicted to obtain 0.431 (CI: 0.416–0.447) opioid prescriptions. In comparison, following a large increase in PageRank percentile, predicted number of prescriptions increases to 2.104 (CI: 2.090–2.118).
Predicted probabilities of maximum daily MME>90mg are presented in Fig 2. Comparing across patients, those with the lowest PageRank percentile have a predicted probability of only 0.027 (CI: 0.027–0.028) of dangerously high MME, compared to 0.185 (CI: 0.183–0.187) among those in the most prominent network positions. There is a more pronounced effect of network prominence between patients compared to within patients–a pattern consistent with the fairly high correlation of observations within patients over time (ICC = 0.83). That is, patients taking high doses of opioids tend to continue taking them over time. Nonetheless, the predicted probability of high MME ranges from 0.044 (CI: 0.043–0.045) when a person experiences a large decrease in PageRank percentile to 0.121 (CI: 0.120–0.123) in quarters when they experience the greatest increase over time.
Fig 3 presents predicted probabilities of opioid overdose. A patient with the lowest PageRank percentile has a predicted probability of overdose of 0.00077 (CI: 0.00070–0.00084) relative to 0.00305 (CI: 0.00281–0.00328) for those with the highest average PageRank. Over time, a patient experiencing a large decrease in PageRank percentile compared to usual is expected to have a 0.00089 (CI: 0.00075–0.00102) probability of overdose, while predicted probability of overdose is 0.00262 (CI: 0.00229–0.00294) when increases in PageRank are large.
Finally, comparing across patients, those with the lowest PageRank percentile have a predicted probability of OUD of 0.0018 (CI: 0.0017–0.0019), compared to 0.0468 (CI: 0.0451–0.0485) among those in the most prominent network positions (See Fig 4). Like high dosage prescription regimens, OUD is highly correlated over time within patients (ICC = 0.82). Consequently, there is a more pronounced effect of network prominence between patients compared to within patients. The predicted probability of receiving a diagnosis of OUD ranges from 0.0080 (CI: 0.0076–0.0084) when a person experiences a large decrease in PageRank percentile to 0.0155 (CI: 0.0149–0.0162) in quarters when they experience the greatest increase over time.
Results from sensitivity analyses are presented in Tables 3–6. First, we replicate all models after omitting patients who had no more than one unique opioid prescriber per quarter. Findings are consistent with those using the full sample (See Table 3), suggesting that network prominence may be useful for distinguishing between gradations of moderate to high-risk patient behavior. Specifically, within-person and between-person PageRank percentile are significantly associated with number of opioid prescriptions, high-risk MME volume, overdose, and opioid use disorder. Findings are smaller in magnitude in the restricted samples, as would be expected with reduced variation to explain, but the direction and significance of effects are robust. Second, we replicate models using a variety of different methods for operationalizing network centrality. These include employing a bipartite network of patients and prescribing physicians in lieu of a projected one-mode network of patients (See Table 4); standardized raw PageRank rather than PageRank percentile (See Table 5); and logged degree centrality instead of PageRank (See Table 6). All of these findings broadly provide support for a network approach to measuring drug seeking. That is, network metrics are significantly and positively associated with adverse drug use outcomes across all models.
In this study, we examine whether structural position in a co-prescription network could provide insight into high-risk drug-seeking. We find that patients in positions of prominence in a co-prescription network disproportionately experience adverse opioid outcomes, even after controlling for the number of unique opioid prescribers visited. Moreover, as a patient’s own prominence increases over time, so does their risk for these outcomes, compared to their own average level of risk. These results are consistent with a pattern of information sharing among networked, drug-seeking patients about effective targets for doctor shopping , or localized prescription drug diversion coalitions . Alternatively, observable attributes (e.g., being located in a pain clinic, being isolated from other providers) may make particular prescribers vulnerable to doctor shopping, even in the absence of direct information sharing.
Our findings have important implications for evolving social responses to policy change. Specifically, relationships between network prominence and risk for opioid misuse and overdose were not attributable to the sheer number of prescribers, as this variable was held constant in regression models. Rather, in characterizing doctor shopping behavior, our findings indicate that which prescribers a patient targets (i.e., their relative network centrality) may be as critical as how many. Supply-side interventions to reduce prescription drug misuse (e.g., prescription limits and guidelines, mandatory prescription monitoring, prescriber incentives to reduce volume) have typically used the latter approach to measure and mitigate fraud and abuse [36, 37]. Thus, cooperation and information sharing may increasingly be essential strategies for procuring opioids in today’s policy environment. While existing research has focused on the turn toward black-market alternatives to prescription opioids (e.g., heroin, fentanyl) [22, 38–40], our findings highlight collaborative and calculated doctor shopping as another potential behavioral response to supply-side interventions. If true, social network analysis is likely to become an increasingly essential tool for characterizing prescription drug misuse, including diversion.
A limitation of our analysis is that social mechanisms underlying network structure are not directly observed and must be inferred. However, it is reassuring that findings are robust to different specifications of network centrality, and that we are able to rule out alternative explanations for network clustering, including cancer-related pain management, shortages of licensed medication-assisted therapy (MAT) prescribers, type of insurance, and state or county of residence. Also, because our data are derived from claims billed through commercial insurance carriers, we are unable to observe cash transactions and Medicaid claims. Since self-payment is a strategy for avoiding detection of doctor shopping behavior , our findings may underestimate the effects of social network prominence and should be replicated using PDMP data.
In sum, while existing research suggests that social mechanisms facilitate doctor shopping, we are aware of no prior large-scale analysis using social network methods to characterize this behavior. These results are significant because they underscore the potential of network approaches to improve measurement, and also to expose social dynamics underlying the opioid epidemic that are not discoverable with traditional threshold approaches (e.g., number of prescribers). Future research should explore these possibilities. For example, the predictive value of social network indicators of doctor shopping should be tested against traditional measures for identifying early and intermittent opioid misuse, or for distinguishing high-volume personal use from fraud and diversion. A network approach might also be used to identify social or geographic “hot spots” for intervention (e.g., increased harm reduction efforts) or for early prediction of unmet substance abuse treatment need.
This research was funded by the National Institute on Drug Abuse (R01 DA039928), an Indiana University Addictions Grand Challenge Grant, and a University of Kentucky Interdisciplinary Research Collaborations Seed Grant. We would like to thank the information technology team at the Indiana University Network Science Institute for their technical support.
- 1. Jalal H, Buchanich JM, Roberts MS, Balmert LC, Zhang K, Burke DS. Changing dynamics of the drug overdose epidemic in the United States from 1979 through 2016. Science. 2018 Sep 21;361(6408):eaau1184. pmid:30237320
- 2. Ahmad F, Rossen L, Spencer M, Warner M, Sutton P. Provisional drug overdose death counts. National Center for Health Statistics. 2018. Available from https://www.cdc.gov/nchs/nvss/vsrr/drug-overdose-data.htm.
- 3. Rudd RA. Increases in drug and opioid-involved overdose deaths—United States, 2010–2015. MMWR. Morbidity and Mortality Weekly Report. 2016;65.
- 4. Worley J, Hall JM. Doctor shopping: a concept analysis. Research and Theory for Nursing Practice. 2012 Jan 1;26(4):262–78. pmid:23556328
- 5. SAMHSA Administration. Methadone- Associated Mortality: Report of a National Assessment 2014 [9/14/2014]. Available from: http://dpt.samhsa.gov/reports/index.htm.
- 6. Jena AB, Goldman D, Weaver L, Karaca-Mandic P. Opioid prescribing by multiple providers in Medicare: retrospective observational study of insurance claims. BMJ. 2014 Feb 19;348:g1393. pmid:24553363
- 7. Hall AJ, Logan JE, Toblin RL, Kaplan JA, Kraner JC, Bixler D, Crosby AE, Paulozzi LJ. Patterns of abuse among unintentional pharmaceutical overdose fatalities. JAMA. 2008 Dec 10;300(22):2613–20. pmid:19066381
- 8. Martyres RF, Clode D, Burns JM. Seeking drugs or seeking help? Escalating “doctor shopping” by young heroin users before fatal overdose. Medical Journal of Australia. 2004 Mar;180(5):211–4. pmid:14984339
- 9. Peirce GL, Smith MJ, Abate MA, Halverson J. Doctor and pharmacy shopping for controlled substances. Medical Care. 2012 Jun 1:494–500.
- 10. McCarty D, Priest KC, Korthuis PT. Treatment and prevention of opioid use disorder: challenges and opportunities. Annual Review of Public Health. 2018 Apr 1;39:525–41. pmid:29272165
- 11. Finley EP, Garcia A, Rosen K, McGeary D, Pugh MJ, Potter JS. Evaluating the impact of prescription drug monitoring program implementation: a scoping review. BMC Health Services Research. 2017 Dec;17(1):420. pmid:28633638
- 12. Ayres I, Jalal A. The Impact of Prescription Drug Monitoring Programs on US Opioid Prescriptions. The Journal of Law, Medicine & Ethics. 2018 Jun;46(2):387–403.
- 13. Pauly NJ, Slavova S, Delcher C, Freeman PR, Talbert J. Features of prescription drug monitoring programs associated with reduced rates of prescription opioid-related poisonings. Drug and Alcohol Dependence. 2018 Mar 1;184:26–32. pmid:29402676
- 14. Reifler LM, Droz D, Bailey JE, Schnoll SH, Fant R, Dart RC, Bucher Bartelson B. Do prescription monitoring programs impact state trends in opioid abuse/misuse?. Pain Medicine. 2012 Mar 1;13(3):434–42. pmid:22299725
- 15. Simeone R. Doctor shopping behavior and the diversion of prescription opioids. Substance Abuse: Research and Treatment. 2017 Apr 7;11:1178221817696077.
- 16. Cepeda MS, Fife D, Yuan Y, Mastrogiovanni G. Distance traveled and frequency of interstate opioid dispensing in opioid shoppers and nonshoppers. The Journal of Pain. 2013 Oct 1;14(10):1158–61. pmid:23791042
- 17. Wilsey BL, Fishman SM, Gilson AM, Casamalhuapa C, Baxi H, Lin TC, Li CS. An analysis of the number of multiple prescribers for opioids utilizing data from the California Prescription Monitoring Program. Pharmacoepidemiology and Drug Safety. 2011 Dec;20(12):1262–8. pmid:21448897
- 18. Ong MS, Olson KL, Cami A, Liu C, Tian F, Selvam N, Mandl KD. Provider patient-sharing networks and multiple-provider prescribing of benzodiazepines. Journal of General Internal Medicine. 2016 Feb 1;31(2):164–71. pmid:26187583
- 19. Worley J, Thomas SP. Women who doctor shop for prescription drugs. Western journal of nursing research. 2014 Apr;36(4):456–74. pmid:24168912
- 20. Centers for Disease Control and Prevention. Annual Surveillance Report of Drug-Related Risks and Outcomes—United States, 2017. Surveillance Special Report 1. Centers for Disease Control and Prevention, U.S. Department of Health and Human Services. Published August 31, 2017.
- 21. Dasgupta N, Beletsky L, Ciccarone D. Opioid crisis: no easy fix to its social and economic determinants. American Journal of Public Health. 2018 Feb;108(2):182–6. pmid:29267060
- 22. Cicero TJ, Ellis MS, Surratt HL, Kurtz SP. The changing face of heroin use in the United States: a retrospective analysis of the past 50 years. JAMA Psychiatry. 2014 Jul 1;71(7):821–6. pmid:24871348
- 23. Harp JP, Havens JR. Risk and protective factors for heroin initiation and re-initiation among rural prescription opioid users. Drug and Alcohol Dependence. 2015;100(146):e135.
- 24. Keyes KM, Cerdá M, Brady JE, Havens JR, Galea S. Understanding the rural–urban differences in nonmedical prescription opioid use and abuse in the United States. American Journal of Public Health. 2014 Feb;104(2):e52–9. pmid:24328642
- 25. Williams JA. Appalachia: A history. Univ of North Carolina Press; 2002.
- 26. Appalachian Regional Commission. The Appalachian Region 2018 [01/12/18]. Available from: https://www.arc.gov/appalachian_region/TheAppalachianRegion.asp.
- 27. Deng H, Lyu MR, King I. A generalized co-hits algorithm and its application to bipartite graphs. InProceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining 2009 Jun 28 (pp. 239–248). ACM.
- 28. Brin S, Page L. The anatomy of a large-scale hypertextual web search engine. Computer Networks and ISDN Systems. 1998 Apr 1;30(1–7):107–17.
- 29. Martin T, Zhang X, Newman ME. Localization and centrality in networks. Physical Review E. 2014 Nov 12;90(5):052808.
- 30. Dowell D, Haegerich TM, Chou R. CDC guideline for prescribing opioids for chronic pain—United States, 2016. JAMA. 2016 Apr 19;315(15):1624–45. pmid:26977696
- 31. Lowder EM, Ray BR, Huynh P, Ballew A, Watson DP. Identifying unreported opioid deaths through toxicology data and vital records linkage: case study in Marion County, Indiana, 2011–2016. American Journal of Public Health. 2018 Dec;108(12):1682–7. pmid:30359109
- 32. Ruhm CJ. Corrected US opioid‐involved drug poisoning deaths and mortality rates, 1999–2015. Addiction. 2018 Jul;113(7):1339–44. pmid:29430760
- 33. Slavova S, O'Brien DB, Creppage K, Dao D, Fondario A, Haile E, Hume B, Largo TW, Nguyen C, Sabel JC, Wright D. Drug overdose deaths: let's get specific. Public Health Reports. 2015 Jul;130(4):339–42. pmid:26345488
- 34. Hoffman L. Longitudinal Analysis: Modeling Within-Person Fluctuation and Change. Routledge; 2015 Jan 30.
- 35. Inciardi JA, Surratt HL, Kurtz SP, Cicero TJ. Mechanisms of prescription drug diversion among drug-involved club-and street-based populations. Pain Medicine. 2007 Feb 14;8(2):171–83. pmid:17305688
- 36. Ali MM, Dowd WN, Classen T, Mutter R, Novak SP. Prescription drug monitoring programs, nonmedical use of prescription drugs, and heroin use: Evidence from the National Survey of Drug Use and Health. Addictive Behaviors. 2017 Jun 1;69:65–77. pmid:28152391
- 37. Beletsky L, Davis CS. Today’s fentanyl crisis: Prohibition’s Iron Law, revisited. International Journal of Drug Policy. 2017 Aug 1;46:156–9. pmid:28735773
- 38. Alpert A, Powell D, Pacula RL. Supply-side drug policy in the presence of substitutes: Evidence from the introduction of abuse-deterrent opioids. American Economic Journal: Economic Policy. 2018 Nov;10(4):1–35.
- 39. Compton WM, Jones CM, Baldwin GT. Relationship between nonmedical prescription-opioid use and heroin use. New England Journal of Medicine. 2016 Jan 14;374(2):154–63. pmid:26760086
- 40. Martins SS, Sarvet A, Santaella-Tenorio J, Saha T, Grant BF, Hasin DS. Changes in US lifetime heroin use and heroin use disorder: prevalence from the 2001–2002 to 2012–2013 National Epidemiologic Survey on Alcohol and Related Conditions. JAMA Psychiatry. 2017 May 1;74(5):445–55. pmid:28355458
- 41. Cepeda MS, Fife D, Berwaerts J, Friedman A, Yuan Y, Mastrogiovanni G. Doctor shopping for medications used in the treatment of attention deficit hyperactivity disorder: shoppers often pay in cash and cross state lines. The American Journal of Drug and Alcohol Abuse. 2015 May 4;41(3):226–9. pmid:25860878