Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Intellectual conflicts of interest among cardiology and pulmonology clinical practice guidelines

  • J. Henry Brems ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing

    jbrems2@jh.edu

    Affiliations Division of Pulmonary and Critical Care Medicine, Johns Hopkins University School of Medicine, Baltimore, MD, United States of America, Berman Institute of Bioethics, Johns Hopkins University, Baltimore, MD, United States of America

  • Taylor Wagner,

    Roles Data curation, Formal analysis, Writing – review & editing

    Affiliation Berman Institute of Bioethics, Johns Hopkins University, Baltimore, MD, United States of America

  • Julia Diamant,

    Roles Data curation, Formal analysis, Writing – review & editing

    Affiliation Berman Institute of Bioethics, Johns Hopkins University, Baltimore, MD, United States of America

  • Andrea E. Davis,

    Roles Data curation, Formal analysis, Writing – review & editing

    Affiliation Department of Medicine, Vanderbilt University Medical Center, Nashville, TN, United States of America

  • Ellen Wright Clayton

    Roles Conceptualization, Investigation, Methodology, Supervision, Writing – review & editing

    Affiliations Center for Biomedical Ethics and Society, Vanderbilt University Medical Center, Nashville, TN, United States of America, Law School, Vanderbilt University, Nashville, TN, United States of America

Abstract

Background

Intellectual conflicts of interest (COI), like financial COI, may threaten the validity and trustworthiness of clinical practice guidelines (CPGs). However, comparatively little is known about intellectual COI in CPGs. This study sought to estimate the prevalence of intellectual COI and corresponding management strategies among cardiology and pulmonology CPGs.

Methods

We conducted a retrospective document review of CPGs published by cardiology or pulmonology professional societies from the United States, Canada, or Europe from 2018 to 2019 available via the Emergency Care Research Institute, Guidelines International Network, or Medscape databases. We assessed the percentage of authors with an intellectual COI, defined as i) authorship on a study reviewed by the CPG, ii) authorship of a prior editorial related to a CPG recommendation, or iii) authorship of a prior related CPG. Management strategies assessed included use of GRADE methodology, inclusion of a methodologist, and recusals due to intellectual COI. Outcomes were assessed overall and compared between cardiology and pulmonology CPGs.

Results

Among the 39 CPGs identified (14 cardiology, 25 pulmonology), there were a total of 737 authors, of whom 473 (64%) had at least one intellectual COI. Among all CPGs, a median of 67% (Interquartile Range 50%-76%) of authors had at least one intellectual COI, and COI was more prevalent among cardiology compared with pulmonology CPGs (84% vs 57%, p<0.001). There was variable use of management strategies among the CPGs, including use of GRADE methodology (64% of CPGs), inclusion of a methodologist (49%), and recusals due to intellectual COI (0%).

Conclusion

Intellectual conflicts of interest appear to be highly prevalent and under-reported among cardiology and pulmonology CPGs, which may threaten their validity. Greater attention to and improved management of intellectual COI by CPG-producing organizations is needed.

Introduction

Clinical practice guidelines (CPGs) provide critically important recommendations on the delivery of care throughout the medical field [1]. In its 2011 report, the Institute of Medicine (IOM), now known as the National Academy of Medicine, defined CPGs as producing recommendations on the basis of systematic reviews of the evidence [2]. Thus, compared with other forms of guidance statements which may rely more on expert opinion, CPGs place the highest emphasis on evidence-based recommendations.

Despite this emphasis on an evidence base, CPGs necessarily require some subjective interpretation by panel members and so are susceptible to conflicts of interest (COI). COI within CPGs have received significant attention in nearly every medical sub-specialty over the past two decades, but assessments have focused almost exclusively on financial COI [312]. However, non-financial COI, such as intellectual COI, also threaten the validity of guidelines [2].

While all individuals have pre-existing opinions, intellectual COI are defined as “academic activities that create the potential for an attachment to a specific point of view that could unduly affect an individual’s judgment about a specific recommendation” [2, 13]. In the context of CPGs, a guideline panelist may have authored primary studies that are being reviewed by the guideline. That panelist is likely to believe the results of their own study and have an interest in promoting their own findings. Thus, they may be biased in their recommendation.

Intellectual COI may cause harm either by biasing recommendations or by producing guidelines that appear less trustworthy and thereby impair the uptake of well-founded recommendations. As an example of the latter, the American Academy of Family Medicine refused to endorse the 2017 American College of Cardiology (ACC)/American Heart Association (AHA) guideline on hypertension largely due to intellectual COI [14]. Conversely, other organizations have taken public steps to combat intellectual COI in CPG development. In particular, because content experts, while necessary, may be more likely to have intellectual COI, some organizations such as the American College of Chest Physicians (ACCP) have chosen to mitigate this issue by including more methodologists in the development process [1517].

Despite growing concerns, the prevalence and management of intellectual COI among CPGs remains unclear [18]. A single study of two Japanese CPGs found that 27–47% of cited studies were authored by CPG panelists [18, 19]. However, it did not evaluate other suggested metrics of intellectual COI such as editorials or prior guidelines authorship, [13, 20] and it is unclear how representative those results are of intellectual COI in CPGs more broadly.

Thus, we sought to investigate the prevalence of intellectual COI and management strategies among CPGs. As a secondary objective, we also sought to investigate the variability in these measures among different organizations. Due to criticism received by the ACC/AHA as well as publicized measures taken by the ACCP, [14, 16] we investigated intellectual COI among recent cardiology and pulmonology CPGs.

Materials and methods

Sample selection

We included all CPGs published by cardiology or pulmonology professional societies in the United States, Canada, or Europe between January 1, 2018 and December 31, 2019. Given the clinical overlap between pulmonary and critical care medicine, we included critical care societies among the pulmonology group.

Because no comprehensive CPG database exists since the National Guidelines Clearinghouse became unavailable due to a loss of funding, [21] we searched three databases—Emergency Care Research Institute, Guidelines International Network, and Medscape—as described in a previous study [22]. For every potential guideline that met our initial inclusion criteria, we searched the corresponding professional societies’ websites for any other guidelines. We excluded documents titled as ‘focused updates,’ ‘position statements,’ or ‘consensus documents,’ which were explicitly differentiated from CPGs by their organization. To further ensure all potential guidelines met the IOM definition of a CPG, they were included only if they contained: (i) a systematic review, (ii) an assessment of benefits and harms, and (iii) explicit recommendations [2]. Further, due to the lack of an existing comprehensive database, a two-year time frame was selected for this study for comparability to prior systematic evaluations of CPGs [18, 22].

As many CPGs are developed jointly by multiple professional societies, we classified each CPG as cardiology or pulmonology according to the society that was clearly distinguished as primary in the title, or if no clear designation existed, the society in whose associated journal the CPG was published. Other societies were considered as partner organizations, and data were only collected up to the first three organizations listed.

Intellectual COI measures

We assessed intellectual COI among all CPG authors and only considered those explicitly listed as authors by the CPG. We did not evaluate others listed only as reviewers or panelists because these were non-standardized and their contribution to CPG development was not always clear.

For all CPG authors, we assessed whether they had any of the following intellectual COI:

  1. authorship on a study reviewed by the CPG
  2. publication of a prior editorial
  3. membership on a prior CPG panel

These criteria for intellectual COI have been used before, are quantifiable, and represent a potential strong prior attachment to a clinical viewpoint [13, 18, 19].

To determine authorship on a reviewed study, we cross-referenced each CPG author’s PubMed bibliography with the CPG’s references. To ensure any identified publications represented authorship of a study considered by CPG in formulating a distinct recommendation, we excluded CPG references that were cited only in the introduction or conclusion of the CPG. In addition, we required the identified publication be a clinical trial, cohort study, case-control study, case series, meta-analysis, and systematic review as these are the data sources generally considered by CPGs in formulating recommendations. Lastly, we ensured any identified studies had the same author as the CPG, defined by the same name plus institutional affiliation.

To determine publication of a prior editorial or membership on a prior CPG panel, two reviewers (JHB and TW or JD) conducted a search of each CPG author via PubMed. For editorials, each reviewer independently searched the author’s bibliography on PubMed using the ‘Editorial’ search criterion. An initial title and abstract review were used to exclude any documents that were irrelevant to the CPG or were not in fact editorials. Potentially relevant editorials were then reviewed to determine if they expressed a clear opinion for or against an explicit recommendation of the CPG. A similar process was used to identify prior panel membership, using the “Guideline” and “Practice Guideline” search criteria from PubMed. Prior editorials and CPGs did not have to be referenced by the current CPG to be included. Authors were identified by name and institutional affiliation as above. Any discrepancies were resolved via discussion among reviewers.

Strategies for management of intellectual COI

We reviewed each CPG for multiple techniques to manage intellectual COI including use of the Grading and Recommendations, Assessment, Development, and Evaluation (GRADE) methodology, including methodologist(s) on the CPG panel, COI disclosures, and recusals due to COI. The GRADE methodology offers a systematic method for translating evidence into recommendations and has been used to manage intellectual COI [16, 23, 24]. Any COI disclosures and recusals were assessed directly from the guideline. We focused solely on non-financial disclosures and corresponding recusals.

We also assessed whether each organization had a policy in place for management of COI within CPGs and whether that policy specifically considered intellectual COI. This was conducted via a two-reviewer (JHB, AED) online search, as described previously [22].

Composition of guideline panels

Lastly, we obtained information on the composition of CPG panels. Using each CPG author’s name and affiliation, we conducted an internet search with www.Google.com to determine if they were: i) ‘clinical expert’–defined as a sub-specialist physician in the same field as the CPG (i.e. a cardiologist on a cardiology CPG, ii) ‘other physician’–defined as a physician not in the same field as the CPG, iii) a ‘methodologist’, iv) non-physician health care professional (HCP) (including RN and PhD), or v) non-HCP. With the exception of ‘methodologist,’ determination of each author’s role was based on their title, degree, and departmental affiliation from their institutional webpage. Methodologists, who have specific expertise in guideline methodology that is not necessarily reflected by any degree, were considered those who were identified explicitly as such in the CPG itself.

We additionally searched every guideline to determine which, if any, authors were denoted as chairs, co-chairs, or vice-chairs. All were collectively categorized as ‘chairs.’

Analysis

Our primary outcome was the percentage of authors with any intellectual COI, defined as the percentage of authors among a CPG who were identified as having at least one of the three intellectual COI sub-types.

Descriptive statistics were generated for all sub-types of intellectual COI, strategies to manage intellectual COI, and the composition of CPG panels. Measures of intellectual COI were summarized by chairs and by all authors (inclusive of chairs/co-chairs). Additionally, frequency of intellectual COI was summarized by author role. Summary statistics were generated among all CPGs as well as separately among cardiology and pulmonology CPGs.

To analyze the variation in intellectual COI by specialty, we compared the percentage of authors with any intellectual COI among cardiology and pulmonology guidelines using Mann Whitney U test. We repeated this analysis for all sub-types of intellectual COI and additionally compared management strategies by organization type using Chi-squared test.

Kappa statistic for inter-rater reliability was calculated for the two-reviewer search used to identify editorials and CPGs. For the two-reviewer search of prior editorial or CPG panel membership, our reviewers demonstrated 85.3% agreement. Cohen’s kappa statistic was 0.65 (95% Confidence Interval 0.60–0.70).

All data analyses were conducted using Microsoft Excel and Stata v17.0.

Results

Guideline and organization characteristics

We identified a total of 39 CPGs produced by 16 cardiology or pulmonology professional societies published between January 1, 2018 and December 31, 2019 (S1 Fig). Of the CPGs, 14 (31%) were produced by cardiology organizations and 25 (69%) by pulmonology organizations. A single CPG was produced by a cardiology organization with a pulmonology organization as a partner. Of note, 35 (90%) of the CPGs were primarily produced by 6 organizations. The numbers of CPGs produced by each organization are shown in Table 1, and all CPGs are listed in S1 Table.

Prevalence of intellectual conflict of interest

Overall, there were a total of 737 authors, of whom 473 (64.2%) of authors had at least one intellectual COI. All 39 (100%) CPGs had at least one author with an intellectual COI, and only 9 (23%) CPGs had fewer than 50% of authors with an intellectual COI. The most frequent type of intellectual COI was authorship on a reviewed study with a median of 44% (IQR 33–71%) of authors having such a COI. Full results by intellectual COI sub-type are shown in Table 2.

thumbnail
Table 2. Frequencies of authors’ intellectual COI by subtype, overall and by specialty.

https://doi.org/10.1371/journal.pone.0288349.t002

A total of 36 CPGs noted which author was the chair or co-chair, and 34 of 36 (94%) had at least one chair or co-chair with an intellectual COI. Among all CPGs, a median of 100% (IQR 100–100%) of chairs and co-chairs had an intellectual COI. Authorship on a reviewed study was also most common among chairs and co-chairs, with a median of 100% (IQR 50–100%) of chairs. The total number of authors and chairs with an intellectual COI identified by CPG is shown in S1 Table.

Intellectual COI was more frequent among cardiology compared with pulmonology CPGs (Fig 1). A median of 84% (IQR 68–88%) of authors on cardiology CPGs had an intellectual COI compared with a 56% (41–69%) of authors on pulmonology CPGs (p< 0.001). Similarly, all sub-types of intellectual COI were more common among cardiology CPGs, including authorship on reviewed studies (74 vs 43%, p = 0.004), first or last authorship of reviewed studies (39 vs 25%, p = 0.02), publication of a prior editorial (35 vs 17%, p = 0.001), and membership on prior CPG (52 vs 24%, p<0.001) (Table 2).

thumbnail
Fig 1. Frequencies of intellectual COI by specialty.

Boxplot representing the percentage of authors identified with each sub-type of intellectual conflict of interest (iCOI) among (A) pulmonology and (B) cardiology CPGs.

https://doi.org/10.1371/journal.pone.0288349.g001

Management of intellectual conflict of interest

The frequency of each strategy to manage intellectual COI is shown in Table 3. While most strategies were seen in 40% or more of CPGs, only 4 (10%) CPGs had any author recusals, and no recusals were due to intellectual COI.

thumbnail
Table 3. Strategies for management of intellectual COI, overall and by specialty.

https://doi.org/10.1371/journal.pone.0288349.t003

The use of strategies varied by specialty, as use of GRADE methodology (0 vs 100%, p<0.001) and inclusion of methodologists (0 vs 76%, p <0.001) were less common among cardiology compared with pulmonology CPGS. Moreover, 79% of cardiology CPGs had at least one author disclose a non-financial COI compared with 24% of pulmonology CPGs (p = 0.003).

Composition of guideline panels

Among all CPGs, there was a median of 19 (IQR 14–22) panelists on the CPG. Clinical experts generally made up a majority of CPG panels with a median (IQR) of 71% (53–88%), and it was the only role present in every CPG. A total of 32 (82%) CPGs included other physicians, and 19 (49%) included a methodologist. Non-physician HCPs were included on 23 (59%) CPG panels, and non-HCPs were included in 13 (33%). The frequencies of professions on CPG panels are shown in Fig 2.

thumbnail
Fig 2. Composition of guideline panels.

Boxplot of the percentage of authors with each role among all CPGs.

https://doi.org/10.1371/journal.pone.0288349.g002

Overall, intellectual COI was most common among clinical experts, with 71% of such authors having at least one intellectual COI. Intellectual COI was least prevalent among methodologists and non-HCPs, with 14% of each having at least one COI. Frequencies of intellectual COI by author role are shown in Table 4.

thumbnail
Table 4. Percentages of authors with intellectual COI, by author role.

https://doi.org/10.1371/journal.pone.0288349.t004

Discussion

In this retrospective study of cardiology and pulmonology CPGs, we found a high prevalence of intellectual COI with variable use of strategies to manage it. Our findings raise several important points.

First, the prevalence of intellectual COI is high and is comparable to financial COI. We found that 64% of all authors had an intellectual COI, which is similar to studies of financial COI, which occur among 40–80% of CPG authors [311, 18]. Even without accounting for financial COI, the frequency of intellectual COI alone means that more than three-quarters of CPGs investigated in this study fell short of the IOM standards for trustworthy CPGs, which state that a minority of CPG authors should have any COI [2].

While the potential for intellectual COI to bias CPG recommendations is unknown, our findings are nonetheless cause for substantial concern. Notably, the most common intellectual COI was authorship on a reviewed study, which has been previously recognized as an “important intellectual COI” [13]. Researchers have an interest in promoting their own findings, and intuitively, authors of original research should be expected to more strongly believe their results compared to a neutral observer. Within medical research more broadly, there are clear suggestions that intellectual biases impact clinicians’ interpretation of evidence, as demonstrated by beliefs that persist despite contradicted findings, [25] the impact of favorable recommendations from like-minded peer reviewers, [2628] and researchers’ allegiance to their findings [29]. Although there is a lack of evidence, it has been suggested before that CPG panels including a member with intellectual COI could have bias in 15% of their recommendations [30]. While that estimate could be incorrect, even 5% of recommendations’ being inappropriately biased could result in significant harm to patients given the high number of CPGs combined with the prevalence of intellectual COI.

Important differences between intellectual COI and financial COI should be considered in interpreting our results. First, financial COI likely only biases individuals in favor of the intervention for which they have a conflict. However, intellectual COI may bias an individual either for or against an intervention depending on their specific conflict (e.g. whether their prior study found evidence supporting or refuting an intervention). Second, in practice, financial COI disclosures are often only requested from the past few years, although the exact time frame varies by organization [31]. We did not impose a time limit for intellectual COI in this study because it is unclear if or when intellectual COI truly become irrelevant. Particularly because CPGs may consider evidence from more than a decade prior, intellectual COI have potential to endure. Despite these differences between financial and intellectual COI, both represent a threat to the validity of CPGs, are recognized by the IOM, and merit explicit consideration from CPG developers [2].

Regardless of the extent to which intellectual COI bias recommendations, they make CPGs less trustworthy. Intellectual COI are recognized as undermining trust by the IOM, [2] and the major family medicine professional society in the U.S. cited intellectual COI as grounds not to endorse an update in the ACC/AHA hypertension guidelines that would have doubled the number of patients under 45 diagnosed with hypertension [14, 32]. Assuming the ACC/AHA recommendations were optimally evidence-based, the presence of intellectual COI (even if it did not result in bias) still may have harmed patients by impairing uptake of the guidelines among family medicine practitioners. Trustworthiness of guidelines is of paramount importance.

Our results also address previous concerns surrounding inclusion of intellectual COI in CPG management. Some have previously argued that “non-financial COI” is too broad and is used to represent intellectual beliefs rather than to define actual conflicts of interests [3335]. While these concerns remain valid for the term “non-financial COI,” our results demonstrate that the narrower “intellectual COI” can be well-specified with only a few criteria and is highly prevalent.

Importantly, intellectual COI, as defined in our study, plausibly present a true COI rather than just intellectual beliefs because CPG panelists may have an interest in promoting their prior published works via CPG recommendation given the potential career and reputational benefits. The criteria used in our study cannot identify all potential intellectual COI or pre-existing viewpoints. However, they present a simple, concrete method that CPG-developers could use to better evaluate and manage intellectual COI. Attempts to identify and manage intellectual COI do not (and should not) need to identify all individuals with any pre-existing belief or opinion; identifying the highest-risk and verifiable conflicts would be a major step forward.

Further, CPG-producing organizations can and should take steps to better manage intellectual COI. The variability in management strategies between cardiology and pulmonology CPGs can be viewed as evidence that each of the strategies is practical yet needs to be more widely implemented. Crucially, recusals for intellectual COI ought to be strongly considered for a panelist reviewing their own work, but they were absent in our study. While improving disclosures of intellectual COI is also needed, disclosure alone is not sufficient and can worsen bias if not paired with appropriate management [36].

Our finding that clinical experts were the most likely participant to have an intellectual COI suggests that CPG developers must balance clinical expertise to mitigate intellectual COI. Since clinical expertise is necessary to interpret data and to make a clinical assessment of risks and benefits, it should not be eliminated for the sake of eliminating all COI. Rather, CPG developers should increase the diversity of panel members, limiting the number of panelists who have an intellectual (or any other relevant) COI to a minority of the panel. All panel members should be excluded from sections in of the CPG in which they would be reviewing their own studies.

In addition, because CPGs rely on a systematic review of the evidence, they ought to give more weight to methodologic expertise by increasing inclusion of methodologists. Intellectual COI was far less common among methodologists in our study, and prior work suggests their inclusion impacts strength of recommendations [16]. Finally, while some important questions certainly require an even greater degree of clinical expertise due to a lack of evidence, those are best answered by other forms of guidance documents, which may explicitly rely on expert opinion rather than in a CPG.

It should be noted that, although we considered CPGs published by Canadian professional societies eligible for inclusion our study, we did not identify any that met full inclusion criteria. Given the lack of an existing single, universal CPG database, this could reflect a limit of our sampling strategy, which did not include a database such as the Canadian Medical Association’s Infobase that may be more enriched for Canadian CPGs [37]. There may be important differences between Canadian, American, and European professional societies with respect to intellectual COI. Further studies are needed to confidently draw any conclusions about intellectual COI in Canadian CPGs.

Additionally, while we evaluated CPGs published in 2018 and 2019, some recent publications indicate that CPG developers may be paying increased attention to intellectual COI [38, 39]. The ACC—a major developer of cardiology CPGs—initiated a review of its CPG policies and procedures in 2020 [40]. While intellectual COI was not mentioned explicitly in that report, [40] it is possible that the COI policy or composition of CPG panels could be shifting for the ACC and for CPG developers more broadly. Thus, future studies to evaluate shifts in prevalence and management of intellectual COI over time will be critical.

Our study has multiple other limitations. First, we only assessed cardiology and pulmonology CPGs, which may not be representative of broader CPGs. Second, we did not investigate financial COI, so we cannot directly assess the prevalence or importance of financial COI relative to intellectual COI. However, even for financial COI, the thresholds used to define ‘significant’ or ‘allowable’ COI are arbitrary [41]. Given how common intellectual COI was in our study, CPG developers ought to consider and implement thresholds for it as well, even if further study is needed to refine those thresholds. Third, given the partly subjective nature of assessing prior editorials and CPGs, our estimates are likely imperfect. However, our inter-rater reliability demonstrated moderate agreement, and the majority of intellectual COI found in our study was based on authorship of reviewed studies, which is a more objective measure.

In conclusion, intellectual conflicts of interest appear to be highly prevalent and under-reported among cardiology and pulmonology CPGs, which may threaten their validity. Further research is needed to understand the impact of intellectual COI on guideline recommendations, but regardless, greater attention to this issue, increasing recusal, and expanding the diversity of these panels, particularly in the area of methodology, can be implemented now.

Supporting information

S1 Table. Guidelines, professional societies, and intellectual conflicts of interests.

https://doi.org/10.1371/journal.pone.0288349.s001

(PDF)

S1 Fig. Identification and assessment of clinical practice guidelines (CPGs).

https://doi.org/10.1371/journal.pone.0288349.s002

(TIF)

References

  1. 1. Woolf SH, Grol R, Hutchinson A, Eccles M, Grimshaw J. Potential benefits, limitations, and harms of clinical guidelines. BMJ. 1999 Feb 20;318(7182):527–30.
  2. 2. Institute of Medicine (US), Graham R, Mancher M, Wolman DM, Greenfield S, Steinberg E. Clinical Practice Guidelines We Can Trust. National Academies Press (US); 2011.
  3. 3. Jefferson AA, Pearson SD. Conflict of Interest in Seminal Hepatitis C Virus and Cholesterol Management Guidelines. JAMA Intern Med. 2017 Mar 1;177(3):352. pmid:28114439
  4. 4. Mitchell AP, Basch EM, Dusetzina SB. Financial Relationships With Industry Among National Comprehensive Cancer Network Guideline Authors. JAMA Oncol. 2016 Dec 1;2(12):1628. pmid:27561170
  5. 5. Combs TR, Scott J, Jorski A, Heavener T, Vassar M. Evaluation of Industry Relationships Among Authors of Clinical Practice Guidelines in Gastroenterology. JAMA Intern Med. 2018 Dec;178(12):1711–2. pmid:30383088
  6. 6. Irwig MS, Kyinn M, Shefa MC. Financial Conflicts of Interest Among Authors of Endocrine Society Clinical Practice Guidelines. J Clin Endocrinol Metab. 2018 01;103(12):4333–8. pmid:30346542
  7. 7. Checketts JX, Sims MT, Vassar M. Evaluating Industry Payments Among Dermatology Clinical Practice Guidelines Authors. JAMA Dermatol. 2017 Dec;153(12):1229–35. pmid:29049553
  8. 8. Horn J, Checketts JX, Jawhar O, Vassar M. Evaluation of Industry Relationships Among Authors of Otolaryngology Clinical Practice Guidelines. JAMA Otolaryngol Neck Surg. 2018 Mar 1;144(3):194. pmid:29270633
  9. 9. Carlisle A, Bowers A, Wayant C, Meyer C, Vassar M. Financial Conflicts of Interest Among Authors of Urology Clinical Practice Guidelines. Eur Urol. 2018;74(3):348–54. pmid:29747945
  10. 10. Khan R, Scaffidi MA, Rumman A, Grindal AW, Plener IS, Grover SC. Prevalence of Financial Conflicts of Interest Among Authors of Clinical Guidelines Related to High-Revenue Medications. JAMA Intern Med. 2018 Dec;178(12):1712–5. pmid:30383094
  11. 11. Norris SL, Holmer HK, Ogden LA, Burda BU, Fu R. Conflicts of Interest among Authors of Clinical Practice Guidelines for Glycemic Control in Type 2 Diabetes Mellitus. PLoS ONE. 2013 Oct 14;8(10).
  12. 12. Cosgrove L, Krimsky S, Wheeler EE, Peters SM, Brodt M, Shaughnessy AF. Conflict of Interest Policies and Industry Relationships of Guideline Development Group Members: A Cross-Sectional Study of Clinical Practice Guidelines for Depression. Account Res. 2017;24(2):99–115. pmid:27901595
  13. 13. Guyatt G, Akl EA, Hirsh J, Kearon C, Crowther M, Gutterman D, et al. The Vexing Problem of Guidelines and Conflict of Interest: A Potential Solution. Ann Intern Med. 2010 Jun 1;152(11):738–41. pmid:20479011
  14. 14. Miyazaki K. Overdiagnosis or not? 2017 ACC/AHA high blood pressure clinical practice guideline: Consequences of intellectual conflict of interest. J Gen Fam Med. 2018 May 31;19(4):123–6. pmid:29998041
  15. 15. Schünemann HJ, Osborne M, Moss J, Manthous C, Wagner G, Sicilian L, et al. An official American Thoracic Society Policy statement: managing conflict of interest in professional societies. Am J Respir Crit Care Med. 2009 Sep 15;180(6):564–80. pmid:19734351
  16. 16. Agoritsas T, Neumann I, Mendoza C, Guyatt GH. Guideline conflict of interest management and methodology heavily impacts on the strength of recommendations: comparison between two iterations of the American College of Chest Physicians Antithrombotic Guidelines. J Clin Epidemiol. 2017 Jan 1;81:141–3. pmid:27472965
  17. 17. Disclosure of Interests and Management of Conflicts Policy | Who We Are | ACP [Internet]. [cited 2022 Aug 17]. Available from: https://www.acponline.org/about-acp/who-we-are/disclosure-of-interests-and-management-of-conflicts-policy
  18. 18. Norris SL, Holmer HK, Ogden LA, Burda BU. Conflict of Interest in Clinical Practice Guideline Development: A Systematic Review. PLoS ONE. 2011 Oct 19;6(10). pmid:22039406
  19. 19. Murayama A, Kida F, Ozaki A, Saito H, Sawano T, Tanimoto T. Financial and Intellectual Conflicts of Interest Among Japanese Clinical Practice Guidelines Authors for Allergic Rhinitis. Otolaryngol—Head Neck Surg Off J Am Acad Otolaryngol-Head Neck Surg. 2022 May;166(5):869–76. pmid:34399654
  20. 20. Reporting of financial and non-financial conflicts of interest by authors of systematic reviews: a methodological survey | BMJ Open [Internet]. [cited 2020 Oct 17]. Available from: https://bmjopen.bmj.com/content/6/8/e011997 pmid:27515760
  21. 21. Shekelle PG. Clinical Practice Guidelines: What’s Next? JAMA. 2018 Aug 28;320(8):757–8. pmid:30098168
  22. 22. Brems JH, Davis AE, Clayton EW. Analysis of conflict of interest policies among organizations producing clinical practice guidelines. PLoS ONE. 2021 Apr 30;16(4):e0249267. pmid:33930893
  23. 23. Andrews JC, Schünemann HJ, Oxman AD, Pottie K, Meerpohl JJ, Coello PA, et al. GRADE guidelines: 15. Going from evidence to recommendation-determinants of a recommendation’s direction and strength. J Clin Epidemiol. 2013 Jul;66(7):726–35. pmid:23570745
  24. 24. Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008 Apr 26;336(7650):924–6. pmid:18436948
  25. 25. Tatsioni A, Bonitsis NG, Ioannidis JPA. Persistence of contradicted claims in the literature. JAMA. 2007 Dec 5;298(21):2517–26. pmid:18056905
  26. 26. Wager E, Parkin EC, Tamber PS. Are reviewers suggested by authors as good as those chosen by editors? Results of a rater-blinded, retrospective study. BMC Med. 2006 May 30;4(1):13. pmid:16734897
  27. 27. Grimm D. Suggesting or Excluding Reviewers Can Help Get Your Paper Published. Science. 2005 Sep 23;309(5743):1974–1974.
  28. 28. Schroter S, Tite L, Hutchings A, Black N. Differences in Review Quality and Recommendations for Publication Between Peer Reviewers Suggested by Authors or by Editors. JAMA. 2006 Jan 18;295(3):314–7. pmid:16418467
  29. 29. Luborsky L, Diguer L, Seligman DA, Rosenthal R, Krause ED, Johnson S, et al. The Researcher’s Own Therapy Allegiances: A “Wild Card” in Comparisons of Treatment Efficacy. Clin Psychol Sci Pract. 1999;6(1):95–106.
  30. 30. Akl EA, El-Hachem P, Abou-Haidar H, Neumann I, Schünemann HJ, Guyatt GH. Considering intellectual, in addition to financial, conflicts of interest proved important in a clinical practice guideline: a descriptive study. J Clin Epidemiol. 2014 Nov;67(11):1222–8. pmid:24970099
  31. 31. Institute of Medicine (US) Committee on Conflict of Interest in Medical Research, Education, and Practice. Conflict of Interest in Medical Research, Education, and Practice. Lo B, Field MJ, editors. Washington, DC: National Academies Press (US); 2009.
  32. 32. New ACC/AHA High Blood Pressure Guidelines Lower Definition of Hypertension [Internet]. American College of Cardiology. [cited 2022 Aug 22]. Available from: https://www.acc.org/latest-in-cardiology/articles/2017/11/08/11/47/http%3a%2f%2fwww.acc.org%2flatest-in-cardiology%2farticles%2f2017%2f11%2f08%2f11%2f47%2fmon-5pm-bp-guideline-aha-2017
  33. 33. Grundy Q, Mayes C, Holloway K, Mazzarello S, Thombs BD, Bero L. Conflict of interest as ethical shorthand: understanding the range and nature of “non-financial conflict of interest” in biomedicine. J Clin Epidemiol. 2020 Apr;120:1–7. pmid:31866470
  34. 34. Bero L. Addressing Bias and Conflict of Interest Among Biomedical Researchers. JAMA. 2017 May 2;317(17):1723–4. pmid:28464166
  35. 35. Poole D. When does a point of view become an intellectual conflict of interest? Crit Care Med. 2008 May;36(5):1688; author reply 1688–1689. pmid:18448947
  36. 36. Cain DM, Loewenstein G, Moore DA. The Dirt on Coming Clean: Perverse Effects of Disclosing Conflicts of Interest. J Leg Stud. 2005 Jan 1;34(1):1–25.
  37. 37. Fitzpatrick RB. CMA Infobase: clinical practice guidelines. Med Ref Serv Q. 2008;27(4):419–29. pmid:19042721
  38. 38. Alhazzani W, Lewis K, Jaeschke R, Rochwerg B, Møller MH, Evans L, et al. Conflicts of interest disclosure forms and management in critical care clinical practice guidelines. Intensive Care Med. 2018 Oct;44(10):1691–8. pmid:30264380
  39. 39. Nejstgaard CH, Bero L, Hróbjartsson A, Jørgensen AW, Jørgensen KJ, Le M, et al. Conflicts of interest in clinical guidelines, advisory committee reports, opinion pieces, and narrative reviews: associations with recommendations. Cochrane Database Syst Rev. 2020 Dec 8;12(12):MR000040. pmid:33289919
  40. 40. Poppas A, Elkind MSV, O ‘Gara Patrick T., Beckman JA. Optimizing Clinical Practice Guidelines. J Am Coll Cardiol. 2020 Nov 3;76(18):2170–2.
  41. 41. Wiersma M, Kerridge I, Lipworth W. Dangers of neglecting non-financial conflicts of interest in health and medicine. J Med Ethics. 2018 May 1;44(5):319–22. pmid:29175967