Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Motivations, perceived risk, and tampering of XTAMPZA ER and abuse-deterrent opioid drugs

  • Hannah L. Burkett ,

    Contributed equally to this work with: Hannah L. Burkett, Richard C. Dart, Joshua C. Black

    Roles Formal analysis, Investigation, Visualization, Writing – original draft

    hannah.burkett@rmpds.org

    Affiliation Rocky Mountain Poison & Drug Safety, Denver, Colorado, United States of America

  • Richard C. Dart ,

    Contributed equally to this work with: Hannah L. Burkett, Richard C. Dart, Joshua C. Black

    Roles Funding acquisition, Supervision

    Affiliation Rocky Mountain Poison & Drug Safety, Denver, Colorado, United States of America

  • Joshua C. Black

    Contributed equally to this work with: Hannah L. Burkett, Richard C. Dart, Joshua C. Black

    Roles Conceptualization, Methodology, Project administration, Supervision, Validation, Writing – review & editing

    Affiliation Rocky Mountain Poison & Drug Safety, Denver, Colorado, United States of America

Abstract

Abuse deterrent formulation (ADF) products are designed to prevent people from tampering with medication, especially with the intention to misuse or abuse the product. While clinical results support the efficacy of ADF products in controlled settings, little is known about how people use and abuse them in the real world. The objective of this research was to describe tampering behavior and perceived risk among U.S. adults who report non-medical use (NMU) of XTAMPZA® ER, a novel ADF extended-release opioid, and comparable products. A cross-sectional survey was conducted in 2021 and 2022 among adults who reported NMU of oxycodone or hydrocodone products in the past year. To compare use patterns and tampering behavior to XTAMPZA® ER, three similar opioid products were also assessed. Participants who reported NMU of an eligible drug were asked why they used it, how they tempered with it, and what other drug-related behaviors they engaged in. A total of 628 participants were recruited. A total of 56 (8.92%) reported NMU of XTAMPZA® ER in the past year, 256 (40.8%) reported NMU of other ADF ER oxycodone/hydrocodone, 459 (73.1%) reported NMU of non-ADF ER oxycodone/hydrocodone, and 225 (35.8%) reported NMU of IR oxycodone. Non-ADF ER oxycodone/hydrocodone was the most used. Those who reported NMU of XTAMPZA® ER had more severe drug use profiles, including higher scores on the 10-item Drug Abuse Screening Test (DAST-10) and higher prevalence of concomitant and illicit drug use. Overall, 3.7% tampered with XTAMPZA® ER, 12.9% tampered with other ADF ER oxycodone/hydrocodone, 16.0% tampered with non-ADF ER oxycodone/hydrocodone, and 10.7% tampered with IR oxycodone. U.S. adults who reported tampering with XTAMPZA® ER or a comparable product frequently did so for therapeutic reasons, most commonly “to swallow the pill more easily” and “to improve the pain relief from the pill.” They also viewed tampering with products they used as less risky than tampering with products they did not use. Tampering with XTAMPZA® ER was uncommon compared to other drugs but more common as a proportion among those who used XTAMPZA® ER. This is, potentially because those using XTAMPZA® ER had other markers of severe, problematic drug use.

Introduction

It is estimated that 9.3 million people in the U.S. misused prescription pain relievers in 2020, [1] and opioid prescriptions per capita remains high [2]. Although immediate-release (IR) opioids continue to be diverted and abused at higher rates than extended-release (ER) formulations, among respondents in national surveys who report misusing opioids, over 40% report misusing crush-resistant ER formulations [3]. Tampering via physical and chemical manipulation or use through unintended routes can bypass the time release mechanism, resulting in the entire opioid load releasing and absorbing rapidly [4]. The risk of negative outcomes associated with abuse increase when the drug is not used as intended [5]. In 2017, the relative risk of death or major medical outcome compared to abuse by oral route was found to be 2.24 times for inhalation, 2.6 times for injection and 2.41 times for other/multiple routes of abuse [5]. Public health efforts to address tampering and abuse of ER opioid products have evolved in response to these risks.

Reformulating high risk drugs into abuse deterrent formulations (ADF) [6] is one of many interventions [79] deployed to curb overdose and related harms. ADFs are intended to make tampering harder and less rewarding, ensuring the time release load enters the system as intended. While most individuals with chronic pain do not abuse drugs [7], ADF products are designed to protect against tampering for therapeutic reasons, either intentional (e.g., To enhance pain relief) and unintentional (e.g., Breaking up large tablets to make them easier to swallow) [8,9]. Previous research of an abuse-deterrent product has shown that when products are reformulated, rates of abuse, diversion, death, and doctor shopping decreased and remained low. [10].There are several ADF products currently on the market including XTAMPZA® ER, OxyContin®, Hysingla® ER, and multiple generic oxycodone products. But as ADF technology improves, so does the response to it.

Because tampering methods continue to evolve, increasingly complex deterrence mechanisms are needed, such as those employed in XTAMPZA® ER. XTAMPZA® ER is an ER ADF oxycodone product that uses DETERx® technology designed to reduce manipulation, first marketed in 2016. XTAMPZA® ER contains pharmaceutically active microspheres delivered in a capsule for oral administration. These microspheres have been shown to maintain their integrity after attempted manipulation using common household tools and chewing [11]. XTAMPZA® ER was granted abuse-deterrent labeling with respect to oral, nasal, and intravenous routes of administration based on pre-clinical and clinical evidence showing reduced likelihood of tampering compared to similar drugs [12]. Rates of abuse, misuse, diversion, and tampering of XTAMPZA® ER are low compared to IR oxycodone, other ADF ER opioids, and non-ADF ER opioids [10].

Although clinical evidence shows XTAMPZA® ER puts up barriers to tampering [8,9,13], relatively little is known about how effectively XTAMPZA® ER DETERx technology prevents tampering in a community setting, or how people perceive the risk of NMU of XTAMPZA® ER and comparable drugs. Interventions intended to prevent tampering and reduce the risks associated with drug use in the general population should be assessed for efficacy under real-world conditions. The U.S. Food and Drug Administration (FDA) requires real-world evidence conducted in a post-market setting to measure true efficacy of interventions. Final guidelines for ADF product labeling released by the FDA in 2015 [14] include specific requirements to surveil real-world use of the drug product to assess the effectiveness of ADF technology in the community.

Exploring the real-world efficacy of ADF technology and how the technology may be overcome through a targeted population of non-medical users fulfills the FDA requirement for real-world, post-marketing surveillance. It will also help inform risk reduction strategies and prescribing guidelines, as well as provide insight into this high-risk population. However, identifying cases of NMU in the community setting is challenging and often requires targeted sampling techniques. These challenges are compounded by low drug volume [15] and low exposure prevalence [16] to drugs designed to deter abuse among pain patients.

The objective of this research was to describe tampering behavior, including motivations, methods, success, and perceived risk among U.S. adults who report NMU of a novel ADF opioid and comparable products. Those who use prescription opioids non-medically represent a high-risk group that is hard to access outside of a clinical setting. Additionally, we characterized the population of adults reporting NMU in terms of demographics, health measures, and indicators of problematic drug behavior. We used a targeted case-finding method from a general population sample, which enabled investigation into low prevalence behaviors involving an infrequently dispensed drug by individuals who may not interact with the healthcare system. Individuals who non-medically use XTAMPZA ER and a control group of comparable products were recruited from a larger, nationally representative survey, the Survey of Non-Medical Use of Prescription Drugs (NMURx). We compared motivations for NMU, tampering behaviors, and risk perception of XTAMPZA ER with other ER ADF opioids, non-ADF ER opioids, and IR oxycodone. We also compared the difficulty and effectiveness of different tampering methods commonly used in the real-world setting.

Materials and methods

NMURx is a cross-sectional surveillance survey administered biannually to approximately 30,000 adults, which has been shown to be valid [17] and reliable [15]. The routine NMURx survey collects anonymous information about prescription drug use and associated behaviors. Respondents reporting past year NMU, defined as use “in a way not directed by a healthcare professional” of XTAMPZA ER or a comparable product were recruited into a follow-up survey sent within 2 weeks of their completion of the routine survey. Comparable products were classified as 1) other ADF ER oxycodone/hydrocodone products, 2) non-ADF ER oxycodone/hydrocodone products, or 3) IR oxycodone products. In addition to questions around drug use behavior, the routine NMURx survey covers participant demographics and socioeconomic characteristics and includes several validated screening instruments, including the DAST-10.

The DAST-10 is a validated screening instrument for problematic drug use. A score of 3 or larger on the continuous scale is a suitable indicator for risk of substance use disorder [18]. Inclusion of the DAST-10 and past year use of illicit substances allows for the comparison of relevant risk factors which may affect an individual’s chances of tampering. Participants were recruited from the 3rd quarter 2021 and the 1st quarter 2022 routine surveys. The NMURx Program study protocol is approved by the Colorado Multiple Institutional Review Board, with the most recent certificate of exemption granted 17 January 2019.

The follow-up survey asked specific questions about past year NMU and tampering for XTAMPZA ER and its comparable products. Comparable products were selected based on indication and form. A full list of products included in each comparison group can be found in S1 Table. Respondents were first required to confirm they used one of the products non-medically in the past year and were then asked which product they preferred. Respondents were asked about specific potential tampering methods for each endorsed product and were then asked a series of follow-up questions for each endorsed method. Of the eight methods asked about, chewing, crushing, heating or melting, dissolving orally, and dissolving in a liquid were classified as tampering with the pill.

Follow up questions covered motivations, difficulty level (as a Likert scale), and whether the tampering was perceived as effective. Because ADF products are only intended for oral use, manipulating the product for use by another route was considered motivation. Difficulty level of tampering was averaged across all individuals who used each drug. Finally, respondents rated their perceived risk of harm by NMU of each product and their perceived risk of harm by engaging in seven use behaviors. on a series of 4-point Likert scales from no risk to great risk. Perceived risk was averaged both across all individuals and across only individuals who reported use of each drug to examine whether risk differs by history of use. All analyses were conducted in SAS 9.4 (Cary, NC). This work was funded by Collegium® Pharmaceuticals, Inc. The funder did not participate in data collection, analysis, or interpretation of the findings.

Results

Descriptive analysis

A total of 9,158 of respondents to the routine NMURx survey reported use of XTAMPZA ER, other ADF ER oxycodone/hydrocodone, non-ADF oxycodone/hydrocodone or IR oxycodone within the past 12 months and were invited to initiate the follow-up survey. Of those invited, 2,186 initiated the follow-up survey and 738 were eligible to complete the follow-up survey based on endorsing past year NMU of one or more qualifying products. Of these, 628 (85.1%) respondents completed the survey (Fig 1). Demographics for the final sample are shown in Table 1. The sample was predominantly female (52.7%), White (85.5%), non-Hispanic (89.3%), and had a DAST-10 level of low or none (82.6%). Of the targeted sample who reported NMU of at least 1 product, 56 (8.9%) endorsed NMU of XTAMPZA ER in the past year, 256 (40.0%) endorsed NMU of another ADF ER oxycodone/hydrocodone, 459 (73.1%) endorsed NMU of a non-ADF ER oxycodone/hydrocodone and 225 (35.0%) endorsed NMU of an IR oxycodone pain reliever in the past year.

thumbnail
Table 1. Demographics among adults who non-medically use by drug group in the past year.

https://doi.org/10.1371/journal.pone.0332574.t001

thumbnail
Fig 1. Flow Chart of Survey Respondents.

The number and percent of respondents who initiated and completed the follow up survey out of those that were invited.

https://doi.org/10.1371/journal.pone.0332574.g001

Compared to XTAMPZA ER, other ADF ER oxycodone/hydrocodone products were dispensed at 42.2%, non-ADF ER oxycodone/hydrocodone were dispensed at 1,976.8% and IR oxycodone pain relievers were dispensed at 1.4% the average number of units per year-quarter. Those who endorsed NMU of XTAMPZA ER were younger (mean age = 44.2) than those who non-medically used other drugs (mean age = 53.9). Overall, 16 respondents (2.6%) reported XTAMPZA ER as their preferred drug, while 281 (44.8%) preferred another non-ADF ER oxycodone/hydrocodone.

Tampering methods

A total of 168 (26.8%) of respondents reported tampering with one of the drugs in the past year. Of those reporting NMU of each product, 23 (41.1%, N = 56) reported tampering with XTAMPZA ER, 81 (31.6%, N = 256) tampered with another ADF ER oxycodone/hydrocodone, 103 (22.4%, N = 40.8) tampered with a non-ADF ER oxycodone/hydrocodone, and 67 (29.8%, N = 225) tampered with IR oxycodone. Among those who reported NMU, the percentages of tampering by different methods were generally similar across drug groups (Table 2). Among those who tampered with XTAMPZA ER, 14 (60.9%) dissolved it orally, 14 (60.9%) dissolved it into a liquid, 10 (43.5%) chewed it, and 9 (39.1%) crushed it. For other ADF ER oxycodone/hydrocodone and IR oxycodone, crushing was the most common method; for non-ADF oxycodone/hydrocodone, dissolving the pill orally was most common. The least common method for all products was heating or melting, although this method was more common with ADF ER oxycodone/hydrocodone or XTAMPZA ER than non-ADF oxycodone/hydrocodone or IR oxycodone.

thumbnail
Table 2. Tampering and behavioral risk factors by drug group.

https://doi.org/10.1371/journal.pone.0332574.t002

Reasons for tampering with products were relatively consistent across the drug groups, with the most common reasons being to increase the high feeling from the pill, to improve pain relief from the pill, to swallow the pill more easily, and to feel the effect of the pill more quickly. For those who reported tampering with XTAMPZA ER, 87.0% did so to feel the effects of the pill more quickly, 73.9% did so to improve pain relief from the pill, and 73.9% did so to swallow the pill more easily. Among respondents who reported tampering with any product, most reported that the method they used was successful for feeling the effects of the pill more quickly, improving pain relief from the pill, and swallowing the pill more easily. Most tampering methods were ranked on average, as moderately difficult. Those who reported tampering with XTAMPZA ER reported that dissolving it in their mouth was easier than other methods, which is not the case for other ER oxycodone/hydrocodone. Compared to other products, XTAMPZA ER was reported as harder to chew and dissolve into a liquid but easier to heat or melt (Fig 2).

thumbnail
Fig 2. Reported difficulty of tampering by method.

Mean reported difficulty of tampering with each drug group by each individual method among respondents who reported tampering with each drug by each individual method.

https://doi.org/10.1371/journal.pone.0332574.g002

Perceived risk

Among the full sample, the perceived NMU risk of XTAMPZA ER and other ADF ER oxycodone/hydrocodone was lower than the perceived NMU risk of non-ADF ER oxycodone/hydrocodone and IR oxycodone (Fig 3). When referring to drugs that respondents themselves had non-medically used, the perceived NMU risk of XTAMPZA ER was higher, and only the perceived NMU risk of ADF ER oxycodone/hydrocodone was lower. The perceived risk of tampering with XTAMPZA ER and other ADF ER oxycodone/hydrocodone is higher among those who reported tampering with that drug in the past year compared to those who did not report tampering with that drug. For non-ADF ER oxycodone/hydrocodone and IR oxycodone, the perceived risk of tampering is similar between those who did and did not report tampering with that drug.

thumbnail
Fig 3. Perceived Risk of Tampering by drug group.

Mean reported perceived risk of tampering with each drug group among the full sample and among only those who reported NMU of each drug.

https://doi.org/10.1371/journal.pone.0332574.g003

Discussion

Even among a targeted sample of adults who reported use of one or more qualifying products in the past year, only 33.8% reported past year NMU and only 7.7% reported tampering. The low prevalence of these behaviors makes them difficult to quantify and describe without using a targeted sampling approach. Evidence generated in a real-world setting has become increasingly recognized as an essential part of post-market drug surveillance [19]. FDA recently produced a draft guidance on the use of real-world evidence in regulatory decision-making, where conclusions from such studies could be used to inform healthcare and regulatory decisions [19]. Obtaining real world evidence from a community setting is more challenging when it requires evaluation of low prevalence behaviors. Those who report NMU of drugs and tampering are the type of patient ADF technology is intended for, and targeted sampling is required to recruit these individuals from a community setting.

NMU of XTAMPZA ER was uncommon relative to similarly indicated oxycodone- and hydrocodone-containing drugs. Compared to the full sample, those who reported NMU of XTAMPZA ER also reported more severe drug use profiles (e.g., higher DAST-10 score, concomitant drug use, illicit drug use) than those using comparator drugs. This could be due to differential prescribing practices between XTAMPZA ER and other ADF products. A previous study found that 80% of physicians prescribing an ADF were influenced in their decision to prevent patients from switching to heroin [20], suggesting that existing abuse behaviors may be the driving factor in ADF prescriptions.

The preferred drug for past year use (including medical and non-medical) among adults reporting NMU was non-ADF ER pain relievers with less than 3.0% preferring XTAMPZA ER. Participants’ preferred drug tended to be the same drug they used non-medically. A similar pattern was seen in perceived risk of tampering among ADF products. Respondents rated the risk higher among ADF drugs they used non-medically compared to those they had not. This was not the case for non-ADF products where the perceived risk remained stable between those who had and had not engaged in NMU behavior with each product.

Among non-medical users who reported tampering, the proportion that tampered with XTAMPZA ER was lower than for all comparator drug groups. Among the small group who reported NMU of each drug group, a greater proportion reported tampering with XTAMPZA ER compared to other drugs. Among those who reported tampering with XTAMPZA ER, the majority manipulated the pill in ways that would likely not disrupt the ADF properties [8,9,13], decreasing the risk of harmful outcomes normally associated with drug tampering.

The most common reason reported for tampering with any qualifying product was to swallow the pill more easily. This may be motivated by therapeutic reasons and patients may not know that tampering to achieve these goals can disrupt the time release mechanism and put them at higher risk of harmful outcomes [5]. In these well intended situations, crushing or breaking pills may occur in therapeutic settings [21] or may be done for therapeutic reasons. Products that can be manipulated to be easier to swallow without disrupting the time release mechanism, such as XTAMPZA ER, could protect patients from unknowingly engaging in high-risk behaviors (S1 Table).

The study has several strengths, one being inclusion of an appropriate control group from the same population, which can be challenging when drug indication and prescribing practices affect an individual’s exposure to specific products. Recruiting the sample from a general population also allowed a more comprehensive group of individuals to be analyzed, and for response bias among the final targeted sample to be measured. The outcomes of interest in this study were low prevalence, high risk behaviors which may not occur within clinical study samples. The survey was anonymously conducted, which could further reduce bias [22].

The study had two main limitations. The first was that information about prior medical history was not collected, and therefore some context could not be discerned. It cannot be discerned if the more severe drug use profiles seen among adults who reported NMU of XTAMPZA ER are due to differential prescribing for adults with a history of drug NMU. The second is that individuals who experienced severe harm from engaging in high-risk drug behavior may not be recruited by a self-report survey. Further, selection bias into the follow-up survey is unaccounted for, preventing strict statistical comparisons, although the 85% of those who began the follow-up survey and were found eligible did complete the survey.

By recruiting from a from a general population source survey shown to be broadly representative of national trends in drug use [17] and employing both careless response exclusions [23] and confirmatory answering [24], we were able to test for differences in medical outcomes or behavioral patterns in a case-control study design with confounding control, to provide relevant real-world data on use and misuse of ADF products required for appropriate evaluation of the technology. Our results suggest that a substantial percent of adults who tamper with abuse-deterrent drugs may be doing it for therapeutic reasons such as to swallow the pill more easily. Although this is still misuse, patients may not be aware that this carries the same risks associated with abusing abuse-deterrent formulations of oxycodone and hydrocodone. The ability to capture this high-risk group of adults engaging in low prevalence behaviors begins to provide insight into the real-world motivations for drug tampering.

Acknowledgments

Authors have no individual declarations of interest. This work was performed in collaboration with the Researched Abuse, Diversion and Addiction-Related Surveillance (RADARS®) System. The RADARS System is supported by subscriptions from pharmaceutical manufacturers, government, and non-government agencies for surveillance, research and reporting services. RADARS System is the property of Denver Health and Hospital Authority (DHHA), a political subdivision of the State of Colorado. Denver Health retains exclusive ownership of all data, databases and systems. This work was funded by Collegium Pharmaceuticals, Inc. The funder did not participate in data collection, analysis, or interpretation of the findings.

References

  1. 1. National Survey on Drug Use and Health 2020. Rockville, MD: Center for Behavioral Health and Statistics Quality. 2022.
  2. 2. Guy GP Jr, Zhang K, Schieber LZ, Young R, Dowell D. County-Level Opioid Prescribing in the United States, 2015 and 2017. JAMA Intern Med. 2019;179(4):574–6. pmid:30742206
  3. 3. Webster L. Update on abuse-resistant and abuse-deterrent approaches to opioid formulations. Pain Med. 2009;10 Suppl 2:S124-33. pmid:19691683
  4. 4. Rauck RL. Mitigation of IV abuse through the use of abuse-deterrent opioid formulations: an overview of current technologies. Pain Pract. 2019;19(4):443–54. pmid:30597739
  5. 5. Green JL, Bucher Bartelson B, Le Lait MC, Roland CL, Masters ET, Mardekian J, et al. Medical outcomes associated with prescription opioid abuse via oral and non-oral routes of administration. Drug Alcohol Depend. 2017;175:140–5. pmid:28414990
  6. 6. Stanos SP, Bruckenthal P, Barkin RL. Strategies to reduce the tampering and subsequent abuse of long-acting opioids: potential risks and benefits of formulations with physical or pharmacologic deterrents to tampering. Mayo Clin Proc. 2012;87(7):683–94. pmid:22766088
  7. 7. Vowles KE, McEntee ML, Julnes PS, Frohe T, Ney JP, van der Goes DN. Rates of opioid misuse, abuse, and addiction in chronic pain: a systematic review and data synthesis. Pain. 2015;156(4):569–76. pmid:25785523
  8. 8. Mayock SP, Saim S, Fleming AB. Author correction to: In vitro drug release after crushing: evaluation of Xtampza. Clin Drug Investig. 2017;37(12):1203.
  9. 9. Mayock SP, Saim S, Fleming AB. In vitro drug release after crushing: evaluation of xtampza. Clin Drug Investig. 2017;37(12):1117–24.
  10. 10. Severtson SG, Ellis MS, Kurtz SP, Rosenblum A, Cicero TJ, Parrino MW, et al. Sustained reduction of diversion and abuse after introduction of an abuse deterrent formulation of extended release oxycodone. Drug Alcohol Depend. 2016;168:219–29. pmid:27716575
  11. 11. Kopecky EA, Fleming AB, Noonan PK, Varanasi RK, Grima M, Saim S, et al. Impact of physical manipulation on in vitro and in vivo release profiles of oxycodone DETERx®: an extended-release, abuse-deterrent formulation. J Opioid Manag. 2014;10(4):233–46. pmid:25162603
  12. 12. Kopecky EA, Fleming AB, Noonan PK, Varanasi RK, Grima M, Saim S, et al. Impact of physical manipulation on in vitro and in vivo release profiles of oxycodone DETERx®: an extended-release, abuse-deterrent formulation. J Opioid Manag. 2014;10(4):233–46. pmid:25162603
  13. 13. Butler SF, Black RA, Fleming AB. Relative abuse of crush-resistant prescription opioid tablets via alternative oral modes of administration. Pain Med. 2018;19(8):1613–27.
  14. 14. Assessment of abuse potential of drugs: guidance for industry, D. o. H. a. H. Services. Rockville, MD: Center for Drug Evaluation and Research (CDER). 2017.
  15. 15. Black JC, Forber A, Severtson SG, Rockhill K, May KP, Amioka E, et al. Drug product dispensing and estimates of use in a general population survey as a signal detection problem. Pharmacoepidemiol Drug Saf. 2021;30(8):1132–9. pmid:33931917
  16. 16. Brenner H, Gefeller O. Variation of sensitivity, specificity, likelihood ratios and predictive values with disease prevalence. Stat Med. 1997;16(9):981–91. pmid:9160493
  17. 17. Black JC, Rockhill K, Forber A, Amioka E, May KP, Haynes CM, et al. An Online Survey for Pharmacoepidemiological Investigation (Survey of Non-Medical Use of Prescription Drugs Program): Validation Study. J Med Internet Res. 2019;21(10):e15830. pmid:31654568
  18. 18. Yudko E, Lozhkina O, Fouts A. A comprehensive review of the psychometric properties of the Drug Abuse Screening Test. J Subst Abuse Treat. 2007;32(2):189–98.
  19. 19. Sultana J, et al. What can real-world evidence contribute to regulatory science in pre- and post- marketing setting?. Pharmadvances. 2020;2(2):51–8.
  20. 20. Dasgupta N, Brown JR, Nocera M, Lazard A, Slavova S, Freeman PR. Abuse-Deterrent Opioids: A Survey of Physician Beliefs, Behaviors, and Psychology. Pain Ther. 2022;11(1):133–51. pmid:34870790
  21. 21. Solberg H, Devik SA, Bell HT, Zeiss DH, Olsen RM. Drug modification by nurses in Norwegian nursing homes: A cross-sectional study. Geriatr Nurs. 2021;42(2):351–7. pmid:33561616
  22. 22. Ong AD, Weiss DJ. The Impact of Anonymity on Responses to Sensitive Questions1. J Applied Social Pyschol. 2000;30(8):1691–708.
  23. 23. Meade AW, Craig SB. Identifying careless responses in survey data. Psychol Methods. 2012;17(3):437–55. pmid:22506584
  24. 24. Dillman D, Smyth J, Christian L. Internet, Phone, Mail, and Mixed-Mode Surveys: The Tailored Design Method. 4 ed. Hoboken, New Jersey: John Wiley & Sons. 2014.