Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Drivers of the opioid crisis: An appraisal of financial conflicts of interest in clinical practice guideline panels at the peak of opioid prescribing

  • Sheryl Spithoff ,

    Roles Conceptualization, Formal analysis, Writing – original draft

    sheryl.spithoff@wchospital.ca

    Affiliations Department of Family and Community Medicine, Women’s College Hospital, Toronto, Canada, Department of Family and Community Medicine, University of Toronto, Toronto, Canada

  • Pamela Leece,

    Roles Conceptualization, Formal analysis, Writing – review & editing

    Affiliations Department of Family and Community Medicine, University of Toronto, Toronto, Canada, Dalla Lana School of Public Health, University of Toronto, Toronto, Canada, Public Health Ontario, Toronto, Canada

  • Frank Sullivan,

    Roles Conceptualization, Formal analysis, Writing – review & editing

    Affiliations Department of Family and Community Medicine, University of Toronto, Toronto, Canada, Medical School University of St Andrews, St Andrews, Scotland, United Kingdom

  • Nav Persaud,

    Roles Conceptualization, Formal analysis, Writing – review & editing

    Affiliations Department of Family and Community Medicine, University of Toronto, Toronto, Canada, Department of Family and Community Medicine, St. Michael’s Hospital, Toronto, Canada

  • Peter Belesiotis,

    Roles Formal analysis, Writing – review & editing

    Affiliation Faculty of Health Sciences, McMaster University, Hamilton, Canada

  • Liane Steiner

    Roles Formal analysis, Writing – review & editing

    Affiliation St. Michael’s Hospital Centre for Urban Health Solutions, Toronto, Canada

Abstract

Background

Starting in the late 1990s, the pharmaceutical industry sought to increase prescribing of opioids for chronic non-cancer pain. Influencing the content of clinical practice guidelines may have been one strategy industry employed. In this study we assessed potential risk of bias from financial conflicts of interest with the pharmaceutical industry in guidelines for opioid prescribing for chronic non-cancer pain published between 2007 and 2013, the peak of opioid prescribing.

Methods

We used the Guideline Panel Review (GPR) to appraise the guidelines included in the 2014 systematic review and critical appraisal by Nuckols et al. These were English language opioid prescribing guidelines for adults with chronic non-cancer pain published between July 2007 and July 2013, the peak of opioid prescribing. The GPR assigns red flags to items known to introduce potential bias from financial conflicts of interest. We operationalized the GPR by creating specific definitions for each red flag. Two reviewers independently evaluated each guideline. Disagreements were resolved with discussion. We also compared our score to the critical appraisal scores for overall quality from the study by Nuckols et al.

Results

We appraised 13 guidelines, which received 43 red flags in total. Guidelines had 3.3 red flags on average (out of a possible seven) with range from one to six. Four guidelines had missing information, so red flags may be higher than reported. The guidelines with the highest and second highest scores for overall quality in the 2014 critical appraisal by Nuckols et al. had five and three red flags, respectively.

Conclusion

Our findings reveal that the guidelines for opioid prescribing chronic non-cancer pain from 2007 to 2013 were at risk of bias because of pervasive conflicts of interest with the pharmaceutical industry and a paucity of mechanisms to address bias. Even highly-rated guidelines examined in a 2014 systematic review and critical appraisal had many red flags.

Introduction

Understanding the root causes of the opioid crisis may help prevent similar iatrogenic epidemics in the future. The pharmaceutical industry’s influence on physician prescribing, particularly in Canada and the US, appears to be a major cause of the crisis [1,2]. In the late 1990s, Purdue Pharma started aggressively marketing its opioid, Oxycontin (oxycodone), for chronic non-cancer pain (CNCP) through academic detailing and education sessions for physicians [3]. Other pharmaceutical companies followed suit [4]. These activities have been linked to the rise in opioid prescriptions and the subsequent harms [37].

Clinical practice guidelines are another mechanism that the pharmaceutical industry may have used to influence physicians’ opioid prescribing practices. Clinical practice guidelines provide evidence-based clinical recommendations to improve patient care and outcomes [810]. They have a moderate impact on the behaviour of health care providers [1113]. A recent study found that the 2016 Centre for Disease Control (CDC) guideline for opioid prescribing led to declines in opioid prescribing [14]. Given the potential impact of guidelines, the Institute of Medicine in its 2011 report “Clinical Practice Guidelines We Can Trust,” recommends that organizations that produce guidelines take steps to mitigate bias. These steps include selecting guideline chairs and committee members without financial conflicts of interest, creating a multi-disciplinary committee and ensuring a rigorous external review [8]. These recommendations aligned with earlier guidance [15]. Research has demonstrated, however, that many guidelines do not adhere to these recommendations, particularly independence from the pharmaceutical industry [1619].

To date, guidelines for opioid prescribing for CNCP have escaped scrutiny. For example, in 2014, well into the opioid crisis and at the peak of opioid prescribing [2024], Nuckols et al. published a systematic review and critical appraisal of guidelines for opioid prescribing for adults with CNCP. Other than reporting the range of scores for editorial independence, it did not address potential bias from financial conflicts of interest with the pharmaceutical industry [25].

Our study objective was to assess the potential risk of bias from financial conflicts of interest with the pharmaceutical industry in the guidelines for opioid prescribing for chronic non-cancer pain that were included in the 2014 systematic review and critical appraisal by Nuckols et al. [25].

Methods

Overview

We conducted an appraisal of the 13 clinical practice guidelines included in the 2014 systematic review and critical appraisal by Nuckols et al. [25]. (Table 1). For each guideline we compared our findings to their critical appraisal score for overall guideline quality. This approach allowed us to build upon Nuckols et al.‘s work.

thumbnail
Table 1. Location, sponsor and name of the 13 guidelines for opioid prescribing for chronic non-cancer pain (CNCP) included in Nuckols et al. 2014 systematic review and critical appraisal [25].

https://doi.org/10.1371/journal.pone.0227045.t001

Data sources

We assessed the 13 guidelines for opioid prescribing for CNCP that were included in the Nuckols et al. 2014 systematic review and critical appraisal [25]. Nuckols et al. included English language guidelines published between 2007 and 2013 that addressed the use of opioids to treat CNCP in adults. The guidelines had to be clinical practice guidelines that included “recommendations intended to optimize patient care that are informed by a systematic review of evidence and an assessment of the benefits and harms of alternative care options” and were published after 2006 [47]. To assess the quality of the Nuckols review, two authors (SMS and PL) independently rated the guidelines using the JBI Critical Appraisal Checklist for Systematic Reviews and Research Syntheses [48]. Differences were resolved with discussion. The Nuckols review satisfied all checklist criteria except for item 7: “Were there methods to minimize errors in data extraction? For item 7 the authors do not mention any methods to minimize errors in data extraction (e.g. data extraction in duplication or extraction double-checked). There were no concerns about the inclusion criteria, search strategy, criteria for appraising studies, appraisal method and methods to combine the data.

For each guideline, we evaluated the same version that was reviewed and appraisal by Nuckols et al. In two cases we had to request the version of the guideline used by Nuckols et al. from the sponsoring organization because it was no longer available online [41,42]. If the guideline did not contain information on the chair and committee members’ conflicts of interest we contacted the sponsoring organization or authors for this information. We also used supplementary information on guideline methods when available from the sponsoring organization [49,50]. Since individuals and organizations often neglect to report conflicts of interest [5153], we checked independent sources. To determine if the sponsoring organization was a professional society that receives pharmaceutical industry funding or was a proprietary company, two reviewers independently searched the organization’s website (including any webpages on sponsorship and annual reports) to determine if it received funds from the pharmaceutical industry. To determine if the committee chair had conflicts of interest in the two years prior to publication, two reviewers independently conducted a Pubmed search and a Google search of the chair’s name to look for this information. For the Pubmed search we searched the author’s name for any publications for the same year the guideline was published and checked if these listed any conflicts of interest. For the Google search, we searched the author’s name with the term “conflict of interest.” We reviewed the first 30 entries (three pages) for information on conflicts at time of guideline publication and up to two years prior. We opted for conflicts of interest up to two year prior because that was a common standard for conflict of interest reporting in 2007 to 2013 [15].

For their critical appraisal Nuckols et al. assessed guideline quality using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) instrument, [54] and the systematic review supporting each guideline [25] using the A Measurement Tool to Assess Systematic Reviews (AMSTAR) tool [55]. The AGREE II instrument assesses the quality and reporting of practice guidelines [54], and it can also be used to inform guideline development and reporting [56].

Instrument

To guide our assessment of the risk of bias in guidelines, we used the Guideline Panel Review (GPR) [57]. The GPR was created by an international expert working group (the Guideline Panel Review working group) in 2013 using a modified Delphi process [57]. The tool assigns red flags to practice elements “known to introduce potential bias” [57]. The goal of the group was to inform patients and those that develop, publish and use guidelines. The GPR reflects the standards created by the Institute of Medicine for developing trustworthy guidelines [8]. The GPR focuses on financial conflicts of interest, in particular those involving industry, because industry-funded networks dramatically amplify findings that support its products and obscure those that do not [57,58].

Operationalizing the GPR

The GPR has not been validated or operationalized and at present is described by the creators as a “framework for future developments” [57]. The developers also designed the tool to be used by the organization producing the guidelines and submitted to the journal along with the guidelines. Journals would use the information to decide whether or not to publish the guidelines. They would also publish the GPR along with the guideline. We found, however, that it was able to also provide us with a framework as we appraised the guidelines. Lenzer and colleagues also used this approach to evaluate guidelines [57]. We operationalized the GPR for our purposes by creating specific definitions for each red flag (Table 2) through several rounds of testing and discussion. Differences were resolved through discussion. Our operationalized statements vary in several places from how the GPR was employed by Lenzer and colleagues [57]. For financial conflicts of interest, we report only on financial conflicts of interest with industry. Other financial conflicts of interest can have an impact—like professional conflicts—however, this was not the focus of our study. The most challenging red flag to operationalize was panel or committee stacking because it was very difficult to determine each committee member’s views prior to the guideline development. This may be easily accomplished if guideline sponsors asked participants to self-report their views. However, it was not feasible for our assessment. Therefore, in discussion, we decided we would use expertise in chronic pain or addictions as a proxy for a balanced committee. This would ensure there were committee members who saw the benefits of opioid prescribing for CNCP and members who saw the harms. We set a minimum of 10% of committee members from each of these two categories. And finally, the GPR also uses a “caution” rating for items that may be an “important part of guideline development, but for which there is not proof that bias is introduced by the presence of that element.” We opted not to report cautions because of the lack of evidence to support these items.

thumbnail
Table 2. Description of items on the Guideline Panel Review (GPR) tool and GPR elements known to introduce bias [57], and our operationalized and modified statement.

https://doi.org/10.1371/journal.pone.0227045.t002

Data extraction

We created a data abstraction form using the GPR. All six reviewers independently pilot-tested the form on two guidelines. We reviewed the results and modified the form based on team feedback. Two reviewers then independently assessed each guideline and completed the data abstraction form. Differences in opinion were resolved through discussions, and when needed, a third reviewer (SMS) assisted in making the final decision.

Outputs

Our outputs included: name of the guideline and sponsoring organization; location; date published; GPR red flags; sources for completion of GPR (official guideline/supporting documents/information on website/correspondence with the sponsoring organization and/or authors producing the guideline). We compared the AGREE II scores for overall quality from Nuckols et al.’s systematic review and critical appraisal [25] to our findings. The overall quality score is a global score reported by reviewers after rating all the domains of quality. It is based on the other scores but is not calculated from those scores [25,54]. We did not compare our findings to the AMSTAR scores from the study because AMSTAR assesses systematic reviews underpinning the guidelines, not the guideline itself.

Data synthesis

We displayed our results in tabular format to summarize the number of red flags and uncertain items (items which could not be confidently appraised with available information) for each item. For each guideline we reported on the total number of red flags and the AGREE II scores for overall quality from Nuckols et al.’s review [25].

Results

Overview

We appraised the 13 guidelines in the systematic review and critical appraisal by Nuckols et al. (Table 1). The guidelines, one Canadian and the rest American, were published between 2009 and 2012. We assigned 43 red flags in total to the 13 guidelines (Table 3).

thumbnail
Table 3. Guideline Panel Review (GPR) [57] red flags (indicating potential bias) in the opioid prescribing for chronic non-cancer pain (CNCP) guidelines included in Nuckols et al. 2014 systematic review and critical appraisal [25].

https://doi.org/10.1371/journal.pone.0227045.t003

Sponsor

We assigned a red flag to four of the guidelines because the sponsoring organization was a professional society that accepted funds from the pharmaceutical industry [27,31,32,45], and a red flag to the fifth one because the guideline was funded through an unrestricted pharmaceutical grant [40]. Among the four professional societies that accepted pharmaceutical industry funding, this information was not declared in the guidelines, but was found in supplementary sources.

Chair(s)

We assigned a red flag to five guidelines because at least one of the committee chairs received funding from the pharmaceutical industry in the two years prior to its publication [27,30,35,40], all but one [35] from opioid manufacturers. We also assigned a red flag to a guideline because the co-chair was on the board of directors of patient advocacy group that received over 90% of its funding from the pharmaceutical industry [45]. In three of the five guidelines that received a red flag, conflicts of interest information was either not declared, or not stated in the guideline or available from the sponsoring organization, but were found in other source documents [27,40,45]. We assigned an uncertain rating to one guideline because its sponsor did not report the names of committee chairs, and we were unable to contact the organization [39].

Committee members

We assigned a red flag to three guidelines because at least two of the committee members had received funding from the pharmaceutical industry in the two years prior to its publication [27,29,35]. We assigned an uncertain rating to four guidelines because they did not contain conflict of interest declarations, and we were either unable to contact the sponsor or authors [39,40]; or the sponsoring organization declined to provide the information [32]; or only provided limited information [45].

Panel stacking

We assigned a red flag to six guidelines because they had evidence of “panel stacking:” the exclusion of members likely to have an opposing view [26,29,32,41,42,46]. These six guidelines had less than 10% of their members with expertise in addictions. For one guideline we were not able to determine if there was panel stacking because information on the committee members was not included in the guideline and we were not able to contact the author or guideline sponsor [40].

Methodologist

We assigned a red flag to seven guidelines because no methodologist was mentioned, or they were not a chair or part of an oversight committee for methodology [27,33,3942,46].

External review

We assigned a red flag to four guidelines because they did not undergo a formal external review [32,39,40,42]. For two guidelines, information on the external review was located in supplementary materials [26,45].

Composition

Finally, only one guideline committee was both multi-disciplinary and included patient representatives, and therefore was not assigned a red flag [41].

Individual guidelines

The number of red flags for an individual guideline ranged from one to six (out of a possible seven) (see Table 4 for more details). Mean and median red number of flags for guidelines were 3.3 and 3.0, respectively. Since we were unable to obtain conflict of interest information from the authors or sponsoring organization of four guidelines, the number of red flags are likely higher than reported. The guidelines with the four highest AGREE II scores for overall quality [30][36][26][45] had five, three, two and three red flags, respectively. The guidelines with the lowest four AGREEII scores for overall quality [32][39][40][46], had four, three, five and three red flags, respectively.

thumbnail
Table 4. Guideline Panel Review (GPR) [57] red flags (indicating potential bias) in the opioid prescribing for chronic non-cancer pain (CNCP) guidelines included in Nuckols et al. 2014 systematic review and critical appraisal [25].

https://doi.org/10.1371/journal.pone.0227045.t004

Discussion

Our appraisal demonstrates that the pharmaceutical industry had a pervasive presence in clinical practice guidelines for opioid prescribing for CNCP from 2007 to 2013, the peak of opioid prescribing [2024]. Additionally, organizations that produced the guidelines failed to regularly employ mechanisms, such as appointing a methodologist in a lead role or conducting an external review—to mitigate potential bias from industry involvement. Even guidelines that had high AGREE II scores for overall quality (indicating rigour in development and reporting of the guideline) (20), had many red flags in our appraisal because of potential bias. Many guidelines also had missing or incomplete information on the sponsoring organization’s funding sources, and on panel members’ conflicts of interest. And finally, in a number of cases, guidelines provided incomplete or inaccurate information about financial conflicts of interest. As a result, the appraisal likely provides a conservative estimate of the potential for bias.

To our knowledge, this is the first study to demonstrate the pervasive presence of the pharmaceutical industry in guidelines for opioid prescribing for CNCP. This aligns with past research showing the pharmaceutical industry’s widespread involvement in guidelines on other topics [16,17,19,59,60]. A 2011 systematic review of studies that examined the effect of conflicts of interest on guidelines development and recommendations, found that most guidelines had committee members with conflicts of interest [59]. These conflicts of interest with the pharmaceutical industry can affect the attitudes and behaviour of individuals and organizations. Individuals with more conflicts of interest with pharmaceutical companies are more likely to espouse industry-friendly positions and prescribe more drugs [6163]. Organizations with more financial conflicts of interest are more likely to make recommendations that would benefit industry [57,64,65]. Therefore, bias in guidelines for opioid prescribing for CNCP may have led to industry-friendly recommendations contributed to high rates of opioid prescribing. These findings are particularly concerning because risk of bias from industry presence in opioid prescribing guidelines appears to be ongoing; the 2017 Canadian Guideline for Opioids for Chronic Non-Cancer Pain had several members with conflicts of interest, including one who had been a speaker for Purdue Pharma [66,67].

Our finding that guidelines that scored high for overall quality on the 2014 critical appraisal by Nuckols et al. [25] had many red flags aligns with findings in a study by Eady et al. [68]. In an appraisal of guidelines on treating acne, the authors reported that using the AGREE II tool during guideline development did not have “as great an effect on guideline quality as expected. There is considerable room for improvement in acne treatment guidelines in order to satisfy the Institute of Medicine’s trustworthiness criteria and avoid bias.” The AGREE II tool assesses conflicts of interests and strategies to mitigate bias differently than the GPR and the Institute of Medicine. The GPR assigns a red flag if the sponsoring organization or individuals on the guideline committees have a financial conflict of interest. The AGREE II, however, rates a guideline with conflicts of interest equally as one without, as long as they are reported and their potential impact on the guideline described [54]. The medical literature indicates, however, that transparency is not sufficient to reduce bias and divestment from financial conflict is a better strategy [8,6972]. Additionally, Nuckols et al. did not use supplementary sources for conflicts of interests and therefore did not identify the four sponsoring organizations and three chairs who did not accurately report financial conflicts of interest with the pharmaceutical industry. This may have affected the AGREE II score for overall quality. Finally, the AGREE II tool gives a guideline with a methodologist in a minor role a high score, whereas the GPR requires that the methodologist have a major role. The literature supports having a methodologist in a major role, because when content experts take the lead, evidence reviews are less accurate [7375]. These findings indicate that the AGREE II may not accurately assess risk of bias from financial conflicts of interest with industry, particularly if appraisers do not seek out supplementary sources to assess for hidden conflicts of interest.

Our finding that many guidelines either did not report or accurately report funding sources for the sponsoring organization and conflicts of interest for individuals is consistent with other studies and media reports [53,7680]. A recent ProPublica and New York Times investigation found that a top cancer researcher consistently failed to disclose millions in payments [81]. Although some of the guidelines in our study were published prior to the 2011 recommendations from the Institute of Medicine, accurate disclosure was the accepted standard during the time period of these guidelines were published [82]. Reasons that individuals and organizations do not declare conflicts of interest has been poorly studied, but may include: not understanding what to declare [83,84]; believing that a conflict is irrelevant [85]; and concerns about reducing trust in the guideline user [85]. Independent verification of conflicts of interest would help address reporting inaccuracies. This is easily done in the US with the Open Payments database (available since 2014) that records all industry payments to physicians [80]. A similar database, however, does not exist in Canada [86].

Limitations

Our study allowed us to build on the past work of Nuckols et al. However, it also means we did not create and conduct our own search strategy. In particular, the English language requirement may have excluded some guidelines that would have otherwise met the inclusion criteria. It is also possible that Nuckols et al. missed English language guidelines (despite an appropriate search strategy). Additionally, although we used the same version of the guidelines as in the systematic review by Nuckols et al., we did not access the documents on the same dates. In two cases we had to order the version of the guideline used by Nuckols et al. from the sponsoring organization because it was no longer available online [41,42]. Therefore, it is possible that the sources were slightly different and this may have affected our findings. The GPR also has some limitations. It is based on recommendations from the Institute of Medicine and other evidence [8,57], but has not been used frequently to date and is not a standardized or validated tool. However, it does provide a structured approach to descriptively appraise clinical practice guidelines. Another limitation was our difficulty in assessing for panel stacking. The GPR was designed for use by the guidelines organizer who would complete and submit the GPR along with the guidelines for publication. In this situation, the committee could easily and accurately assess the important views of the committee members prior to the creation of the guidelines. Conducting the assessment as external reviewers is much more difficult. However, we believe our approach (ensuring an adequate number of chronic pain and addictions specialists) would ensure that there were people on both sides of the opioid prescribing debate. Another limitation is our Google search for conflicts of interest not reported in the guidelines. It is possible that we missed conflicts of interest by not conducting a more exhaustive search. Therefore, our study is likely a conservative estimate of the potential for bias. And a final limitation is that we only examined conflicts of interest with the pharmaceutical industry. We did not assess other financial conflicts of interest (e.g. an individual’s income from performing surgical procedures) [87][57], which can lead to bias in guidelines, but these were not the focus of our study.

Conclusion and next steps

Our findings reveal that the clinical practice guidelines for opioid prescribing for CNCP from 2007 to 2013 were at risk of bias because of pervasive conflicts of interest with the pharmaceutical industry, and with a paucity of mechanisms to mitigate bias. Even highly rated guidelines in a 2014 systematic review and critical appraisal had many red flags indicating a high risk of bias. More research is needed to understand the impact of the pharmaceutical industry’s presence via conflicts of interest in opioid prescribing guidelines. This is particularly important given recent evidence of ongoing industry involvement in guidelines for opioid prescribing for CNCP.

Guideline sponsors, researchers and guideline users should consider using the GPR in guideline development and appraisal to assess risk of bias. Guideline developers should search independent sources where available, such as the Open Payments database, to verify the conflicts of interest reported by committee chairs and members.

Supporting information

S1 Table. Master Data Extraction Sheet.

Table with information on sponsor/author, guidelines name, references, elements known to introduce bias, number of red flags and uncertain rating and notes for each guideline.

https://doi.org/10.1371/journal.pone.0227045.s001

(DOCX)

Acknowledgments

We would like to thank Susan Hum, Research Associate (Women’s College Hospital Department of Family and Community Medicine) for reviewing and editing this paper.

References

  1. 1. Hadland SE, Rivera-Aguirre A, Marshall BDL, Cerdá M. Association of Pharmaceutical Industry Marketing of Opioid Products With Mortality From Opioid-Related Overdoses. JAMA Netw Open. 2019;2: e186007–e186007. pmid:30657529
  2. 2. Fischer B, Keates A, Bühringer G, Reimer J, Rehm J. Non-medical use of prescription opioids and prescription opioid-related harms: why so markedly higher in North America compared to the rest of the world? Addict Abingdon Engl. 2014;109: 177–181. pmid:23692335
  3. 3. Van Zee A. The Promotion and Marketing of OxyContin: Commercial Triumph, Public Health Tragedy. Am J Public Health. 2009;99: 221–227. pmid:18799767
  4. 4. Dhalla IA, Persaud N, Juurlink DN. Facing up to the prescription opioid crisis. BMJ. 2011;343: d5142. pmid:21862533
  5. 5. Okie S. A Flood of Opioids, a Rising Tide of Deaths. N Engl J Med. 2010;363: 1981–1985. pmid:21083382
  6. 6. Dhalla IA, Mamdani MM, Sivilotti MLA, Kopp A, Qureshi O, Juurlink DN. Prescribing of opioid analgesics and related mortality before and after the introduction of long-acting oxycodone. CMAJ Can Med Assoc J. 2009;181: 891–896. pmid:19969578
  7. 7. Kolodny A. The opioid epidemic in 6 charts. In: The Conversation [Internet]. [cited 26 Mar 2019]. Available: http://theconversation.com/the-opioid-epidemic-in-6-charts-81601
  8. 8. Institute of Medicine (US) Committee on Standards for Developing Trustworthy Clinical Practice Guidelines. Clinical Practice Guidelines We Can Trust. Graham R, Mancher M, Miller Wolman D, Greenfield S, Steinberg E, editors. Washington (DC): National Academies Press (US); 2011. Available: http://www.ncbi.nlm.nih.gov/books/NBK209539/
  9. 9. Qaseem A. Guidelines International Network: Toward International Standards for Clinical Practice Guidelines. Ann Intern Med. 2012;156: 525. pmid:22473437
  10. 10. Kredo T, Bernhardsson S, Machingaidze S, Young T, Louw Q, Ochodo E, et al. Guide to clinical practice guidelines: the current state of play. Int J Qual Health Care. 2016;28: 122–128. pmid:26796486
  11. 11. Lugtenberg M, Burgers JS, Westert GP. Effects of evidence-based clinical practice guidelines on quality of care: a systematic review. Qual Saf Health Care. 2009;18: 385–392. pmid:19812102
  12. 12. Grimshaw JM, Russell IT. Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. The Lancet. 1993;342: 1317–1322.
  13. 13. Spooner L, Fernandes K, Martins D, Juurlink D, Mamdani M, Paterson JM, et al. High-Dose Opioid Prescribing and Opioid-Related Hospitalization: A Population-Based Study. PLOS ONE. 2016;11: e0167479. pmid:27973601
  14. 14. Bohnert ASB, Guy GP, Losby JL. Opioid Prescribing in the United States Before and After the Centers for Disease Control and Prevention’s 2016 Opioid Guideline. Ann Intern Med. 2018;169: 367. pmid:30167651
  15. 15. Institute of Medicine. Conflict of Interest in Medical Research, Education, and Practice. 2009 [cited 18 Sep 2019]. Available: http://www.nationalacademies.org/hmd/Reports/2009/Conflict-of-Interest-in-Medical-Research-Education-and-Practice.aspx
  16. 16. Choudhry NK, Stelfox HT, Detsky AS. Relationships Between Authors of Clinical Practice Guidelines and the Pharmaceutical Industry. JAMA. 2002;287: 612–617. pmid:11829700
  17. 17. Shnier A, Lexchin J, Romero M, Brown K. Reporting of financial conflicts of interest in clinical practice guidelines: a case study analysis of guidelines from the Canadian Medical Association Infobase. BMC Health Serv Res. 2016;16: 383. pmid:27528247
  18. 18. Lashner BA, Cominelli F. Conflicts of Interest in Clinical Practice Guidelines. Inflamm Bowel Dis. 2019;25: 646–646. pmid:30295815
  19. 19. Campsall P, Colizza K, Straus S, Stelfox HT. Financial Relationships between Organizations That Produce Clinical Practice Guidelines and the Biomedical Industry: A Cross-Sectional Study. PLoS Med. 2016;13: e1002029. pmid:27244653
  20. 20. Canadian Institute for Health Information. Pan-Canadian Trends in the Prescribing of Opioids, 2012 to 2016. 2017. Available: https://secure.cihi.ca/free_products/pan-canadian-trends-opioid-prescribing-2017-en-web.pdf
  21. 21. Gomes T, Mamdani MM, Paterson JM, Dhalla IA, Juurlink DN. Trends in high-dose opioid prescribing in Canada. Can Fam Physician. 2014;60: 826–832. pmid:25217680
  22. 22. Kuo Y-F, Raji MA, Chen N-W, Hasan H, Goodwin JS. Trends in Opioid Prescriptions Among Part D Medicare Recipients From 2007 to 2012. Am J Med. 2016;129: 221.e21–30. pmid:26522794
  23. 23. Foy R, Leaman B, McCrorie C, Petty D, House A, Bennett M, et al. Prescribed opioids in primary care: cross-sectional and longitudinal analyses of influence of patient and practice characteristics. BMJ Open. 2016;6: e010276. pmid:27178970
  24. 24. Guy GP. Vital Signs: Changes in Opioid Prescribing in the United States, 2006–2015. MMWR Morb Mortal Wkly Rep. 2017;66. pmid:28683056
  25. 25. Nuckols TK, Anderson L, Popescu I, Diamant AL, Doyle B, Di Capua P, et al. Opioid prescribing: a systematic review and critical appraisal of guidelines for chronic pain. Ann Intern Med. 2014;160: 38–47. pmid:24217469
  26. 26. American Coll of Occupational and Environmental Medicine. ACOEM Guidelines for Chronic Use of Opioids. American Coll of Occupational and Environmental Medicine; 2011. Available: https://www.nhms.org/sites/default/files/Pdfs/ACOEM%202011-Chronic%20Pain%20Opioid%20.pdf
  27. 27. American Geriatrics Society Panel on Pharmacological Management of Persistent Pain in Older Persons. Pharmacological management of persistent pain in older persons. J Am Geriatr Soc. 2009;57: 1331–1346. pmid:19573219
  28. 28. AGS Panel on Persistent Pain in Older Persons. The management of persistent pain in older persons. J Am Geriatr Soc. 2002;50: S205–224. pmid:12067390
  29. 29. Chou R. 2009 Clinical Guidelines from the American Pain Society and the American Academy of Pain Medicine on the use of chronic opioid therapy in chronic noncancer pain: what are the key messages for clinical practice? Pol Arch Med Wewn. 2009;119: 469–477. pmid:19776687
  30. 30. American Pain Society, American Academy of Pain Medicine. Guideline for the Use of Chronic Opioid Therapy in Chronic Noncancer Pain: Evidence Review. American Pain Society, American Academy of Pain Medicine; 2009. Available: http://americanpainsociety.org/uploads/education/guidelines/chronic-opioid-therapy-cncp.pdf
  31. 31. Chou R, Fanciullo GJ, Fine PG, Adler JA, Ballantyne JC, Davies P, et al. Clinical Guidelines for the Use of Chronic Opioid Therapy in Chronic Noncancer Pain. J Pain. 2009;10: 113–130.e22. pmid:19187889
  32. 32. American Society of Anesthesiologists Task Force on Chronic Pain Management, American Society of Regional Anesthesia and Pain Medicine. Practice guidelines for chronic pain management: an updated report by the American Society of Anesthesiologists Task Force on Chronic Pain Management and the American Society of Regional Anesthesia and Pain Medicine. Anesthesiology. 2010;112: 810–833. pmid:20124882
  33. 33. Manchikanti L, Abdi S, Atluri S, Balog CC, Benyamin RM, Boswell MV, et al. American Society of Interventional Pain Physicians (ASIPP) guidelines for responsible opioid prescribing in chronic non-cancer pain: Part I—evidence assessment. Pain Physician. 2012;15: S1–65. pmid:22786448
  34. 34. Manchikanti L, Abdi S, Atluri S, Balog CC, Benyamin RM, Boswell MV, et al. American Society of Interventional Pain Physicians (ASIPP) guidelines for responsible opioid prescribing in chronic non-cancer pain: Part 2—guidance. Pain Physician. 2012;15: S67–116. pmid:22786449
  35. 35. Furlan AD, Reardon R, Weppler C, National Opioid Use Guideline Group. Opioids for chronic noncancer pain: a new Canadian practice guideline. CMAJ Can Med Assoc J J Assoc Medicale Can. 2010;182: 923–930. pmid:20439443
  36. 36. National Opioid Use Guideline Group. Canadian Guideline for Safe and Effective Use of Opioids for Chronic Non-Cancer Pain. National Pain Centre; 2010. Available: http://nationalpaincentre.mcmaster.ca/opioid_2010/
  37. 37. Kahan M, Mailis-Gagnon A, Wilson L, Srivastava A, National Opioid Use Guideline Group. Canadian guideline for safe and effective use of opioids for chronic noncancer pain: clinical summary for family physicians. Part 1: general population. Can Fam Physician Med Fam Can. 2011;57: 1257–1266, e407-418.
  38. 38. Kahan M, Wilson L, Mailis-Gagnon A, Srivastava A, National Opioid Use Guideline Group. Canadian guideline for safe and effective use of opioids for chronic noncancer pain: clinical summary for family physicians. Part 2: special populations. Can Fam Physician Med Fam Can. 2011;57: 1269–1276, e419-428.
  39. 39. Colorado Division of Workers’ Compensation. Chronic Pain Disorder Medical Treatment Guidelines. Colorado Division of Workers’ Compensation; 2011.
  40. 40. Fine PG, Portenoy RK, Ad Hoc Expert Panel on Evidence Review and Guidelines for Opioid Rotation. Establishing “best practices” for opioid rotation: conclusions of an expert panel. J Pain Symptom Manage. 2009;38: 418–425. pmid:19735902
  41. 41. Institute for Clinical Systems Improvement. Assessment and Management of Chronic Pain. Bloomington, MN: Institute for Clinical Systems Improvement; 2011. Institute for Clinical Systems Improvement; 2011.
  42. 42. University of Michigan. Managing Chronic Non-Terminal Pain in Adults Including Prescribing Controlled Substances. University of Michigan; 2009.
  43. 43. Utah Department of Health. Utah Clinical Guidelines on Prescribing Opioids for Treatment of Pain. Utah Department of Health; 2009.
  44. 44. Rolfs RT, Johnson E, Williams NJ, Sundwall DN, Utah Department of Health. Utah clinical guidelines on prescribing opioids for treatment of pain. J Pain Palliat Care Pharmacother. 2010;24: 219–235. pmid:20718642
  45. 45. Department of Veterans Affairs, Department of Defense. Clinical Practice Guideline for Management of Opioid Therapy for Chronic Pain. Department of Defense; 2010. Available: http://www.healthquality.va.gov/guidelines/Pain/cot/COT_312_Full-er.pdf
  46. 46. Work Loss Data Institute. Pain (chronic). Work Loss Data Institute; 2011. https://doi.org/10.1007/s00586-011-1931-2
  47. 47. Shekelle P, Woolf S, Grimshaw JM, Schünemann HJ, Eccles MP. Developing clinical practice guidelines: reviewing, reporting, and publishing guidelines; updating guidelines; and the emerging issues of enhancing guideline implementability and accounting for comorbid conditions in guideline development. Implement Sci. 2012;7: 62. pmid:22762242
  48. 48. Joanna Briggs Institute. The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews Checklist for Systematic Reviews and Research Syntheses. 2017.
  49. 49. American College of Occupational and Environmental Medicine. Methodology for ACOEMʼs Occupational Medicine Practice Guidelines, 2011 revision. 2011. Available: https://www.acoem.org/gmc.aspx
  50. 50. Department of Veteran Affairs and Department of Defense. Guidelines for guidelines. 2013.
  51. 51. Bindslev JB, Schroll J, Gøtzsche PC, Lundh A. Underreporting of conflicts of interest in clinical practice guidelines: cross sectional study. BMC Med Ethics. 2013;14: 19. pmid:23642105
  52. 52. Thompson JC, Volpe KA, Bridgewater LK, Qeadan F, Dunivan GC, Komesu YM, et al. Sunshine Act: shedding light on inaccurate disclosures at a gynecologic annual meeting. Am J Obstet Gynecol. 2016;215: 661.e1–661.e7. pmid:27319366
  53. 53. Checketts JX, Sims MT, Vassar M. Evaluating Industry Payments Among Dermatology Clinical Practice Guidelines Authors. JAMA Dermatol. 2017;153: 1229–1235. pmid:29049553
  54. 54. Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. AGREE II: advancing guideline development, reporting and evaluation in health care. CMAJ Can Med Assoc J. 2010;182: E839–E842. pmid:20603348
  55. 55. Shea BJ, Hamel C, Wells GA, Bouter LM, Kristjansson E, Grimshaw J, et al. AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. J Clin Epidemiol. 2009;62: 1013–1020. pmid:19230606
  56. 56. Brouwers MC, Florez ID, McNair SA, Vella ET, Yao X. Clinical Practice Guidelines: Tools to Support High Quality Patient Care. Semin Nucl Med. 2019;49: 145–152. pmid:30819394
  57. 57. Lenzer J, Hoffman JR, Furberg CD, Ioannidis JPA. Ensuring the integrity of clinical practice guidelines: a tool for protecting patients. BMJ. 2013;347: f5535. pmid:24046286
  58. 58. Bero LA, Grundy Q. Why Having a (Nonfinancial) Interest Is Not a Conflict of Interest. PLOS Biol. 2016;14: e2001221. pmid:28002462
  59. 59. Norris SL, Holmer HK, Ogden LA, Burda BU. Conflict of Interest in Clinical Practice Guideline Development: A Systematic Review. PLoS ONE. 2011;6. pmid:22039406
  60. 60. Allan GM, Kraut R, Crawshay A, Korownyk C, Vandermeer B, Kolber MR. Contributors to primary care guidelines What are their professions and how many of them have conflicts of interest? Can Fam Physician. 2015;61: 52–58. pmid:25609522
  61. 61. Wang AT, McCoy CP, Murad MH, Montori VM. Association between industry affiliation and position on cardiovascular risk with rosiglitazone: cross sectional systematic review. BMJ. 2010;340: c1344–c1344. pmid:20299696
  62. 62. Fickweiler F, Fickweiler W, Urbach E. Interactions between physicians and the pharmaceutical industry generally and sales representatives specifically and their association with physicians’ attitudes and prescribing habits: a systematic review. BMJ Open. 2017;7: e016408. pmid:28963287
  63. 63. Lexchin J. Interactions between physicians and the pharmaceutical industry: what does the literature say? CMAJ Can Med Assoc J J Assoc Medicale Can. 1993;149: 1401–1407.
  64. 64. Schott G, Dünnweber C, Mühlbauer B, Niebling W, Pachl H, Ludwig W-D. Does the Pharmaceutical Industry Influence Guidelines? Dtsch Ärztebl Int. 2013;110: 575–583. pmid:24078837
  65. 65. Lin DH, Lucas E, Murimi IB, Kolodny A, Alexander GC. Financial Conflicts of Interest and the Centers for Disease Control and Prevention’s 2016 Guideline for Prescribing Opioids for Chronic Pain. JAMA Intern Med. 2017;177: 427–428. pmid:28114444
  66. 66. Government of Canada CI of HR. CIHR Assessment of the Canadian Guideline for Opioids for Chronic Non-Cancer Pain—CIHR. 29 Aug 2017 [cited 31 May 2019]. Available: http://www.cihr-irsc.gc.ca/e/50544.html
  67. 67. Howlett K. Doctor’s pharma links raise fears of bias on opioid panel. 14 May 2017. Available: https://www.theglobeandmail.com/news/national/doctors-pharma-links-raise-fears-of-bias-on-opioid-panel/article34984781/. Accessed 31 May 2019.
  68. 68. Eady EA, Layton AM, Sprakel J, Arents BWM, Fedorowicz Z, Zuuren EJ van. AGREE II assessments of recent acne treatment guidelines: how well do they reveal trustworthiness as defined by the U.S. Institute of Medicine criteria? Br J Dermatol. 2017;177: 1716–1725. pmid:28667760
  69. 69. Wilson M. Is transparency really a panacea? J R Soc Med. 2014;107: 216–217. pmid:24912788
  70. 70. Wilson M. The Sunshine Act: Commercial conflicts of interest and the limits of transparency. Open Med. 2014;8: e10–e13. pmid:25009680
  71. 71. Loewenstein G SS. The unintended consequences of conflict of interest disclosure. JAMA. 2012;307: 669–670. pmid:22337676
  72. 72. Melo-Martín I de, Intemann K. How do disclosure policies fail? Let us count the ways. FASEB J. 2009;23: 1638–1642. pmid:19176877
  73. 73. Panagiotou OA, Ioannidis JPA. Primary study authors of significant studies are more likely to believe that a strong association exists in a heterogeneous meta-analysis compared with methodologists. J Clin Epidemiol. 2012;65: 740–747. pmid:22537426
  74. 74. Oxman AD, Guyatt GH. The science of reviewing research. Ann N Y Acad Sci. 1993;703: 125–133; discussion 133–134. pmid:8192290
  75. 75. Antman EM, Lau J, Kupelnick B, Mosteller F, Chalmers TC. A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts. Treatments for myocardial infarction. JAMA. 1992;268: 240–248. pmid:1535110
  76. 76. Bauchner H, Fontanarosa PB, Flanagin A. Conflicts of Interests, Authors, and Journals: New Challenges for a Persistent Problem. JAMA. 2018;320: 2315–2318. pmid:30422174
  77. 77. Boddapati V, Fu MC, Nwachukwu BU, Ranawat AS, Zhen WY, Dines JS. Accuracy Between AJSM Author-Reported Disclosures and the Centers for Medicare and Medicaid Services Open Payments Database. Am J Sports Med. 2018;46: 969–976. pmid:29382212
  78. 78. Horn J, Checketts JX, Jawhar O, Vassar M. Evaluation of Industry Relationships Among Authors of Otolaryngology Clinical Practice Guidelines. JAMA Otolaryngol—Head Neck Surg. 2018;144: 194–201. pmid:29270633
  79. 79. Lopez J, Samaha G, Purvis TE, Siegel G, Jabbari J, Ahmed R, et al. The Accuracy of Conflict-of-Interest Disclosures Reported by Plastic Surgeons and Industry. Plast Reconstr Surg. 2018;141: 1592–1599. pmid:29794718
  80. 80. Ziai K, Pigazzi A, Smith BR, Nouri-Nikbakht R, Nepomuceno H, Carmichael JC, et al. Association of Compensation From the Surgical and Medical Device Industry to Physicians and Self-declared Conflict of Interest. JAMA Surg. 2018;153: 997–1002. pmid:30140910
  81. 81. Ornstein C, Thomas K. Top Cancer Researcher Fails to Disclose Corporate Financial Ties in Major Research Journals. The New York Times. 12 Jan 2019. Available: https://www.nytimes.com/2018/09/08/health/jose-baselga-cancer-memorial-sloan-kettering.html. Accessed 13 May 2019.
  82. 82. Boyd EA, Bero LA. Improving the use of research evidence in guideline development: 4. Managing conflicts of interests. Health Res Policy Syst. 2006;4: 16. pmid:17140441
  83. 83. Rohwer A, Young T, Wager E, Garner P. Authorship, plagiarism and conflict of interest: views and practices from low/middle-income country health researchers. BMJ Open. 2017;7. pmid:29170291
  84. 84. Baethge C. The effect of a conflict of interest disclosure form using closed questions on the number of positive conflicts of interest declared–a controlled study. PeerJ. 2013;1. pmid:24024081
  85. 85. Weinfurt KP, Friedman JY, Dinan MA, Allsbrook JS, Hall MA, Dhillon JK, et al. Disclosing Conflicts of Interest in Clinical Research: Views of Institutional Review Boards, Conflict of Interest Committees, and Investigators. J Law Med Ethics J Am Soc Law Med Ethics. 2006;34: 581–481.
  86. 86. Owens B. Ontario delays implementation of pharma transparency rules. CMAJ. 2019;191: E241–E242. pmid:30803958
  87. 87. Norris SL, Burda BU, Holmer HK, Ogden LA, Fu R, Bero L, et al. Author’s specialty and conflicts of interest contribute to conflicting guidelines for screening mammography. J Clin Epidemiol. 2012;65: 725–733. pmid:22498428