12 Aug 2013: Norris SL, Holmer HK, Ogden LA, Selph SS, Fu R (2013) Correction: Conflict of Interest Disclosures for Clinical Practice Guidelines in the National Guideline Clearinghouse. PLOS ONE 8(8): 10.1371/annotation/1b125769-1f74-4225-94b8-bd2c80adae1f. doi: 10.1371/annotation/1b125769-1f74-4225-94b8-bd2c80adae1f View correction
Conflict of interest (COI) is an important potential source of bias in the development of clinical practice guidelines (CPGs) and high rates of COI among guideline authors have been reported in the past. Our objective was to report current rates of disclosure and specific author COI across a broad range of CPGs and to examine whether CPG characteristics were associated with the presence of disclosures and of conflicts.
Methods and Findings
We selected a random sample of 250 CPGs listed in the National Guideline Clearinghouse on November 22, 2010, representing approximately a 10% sample of guidelines listed in the NGC on that date. We abstracted information on author COI from each CPG and examined predictors of the disclosures and COI using a logistic generalized estimating equation regression model. 87% of organizations developing guidelines had a CPG-specific policy, however, 40% of CPGs did not indicate that they had collected disclosures from guideline authors. In addition, 42% of organizations that did collect author disclosures did not have those disclosures available in the public domain. Of CPGs where we had disclosures for all authors, 60% had one or more authors with a conflict. On average, 28% of the authors of CPGs with available disclosures had a COI. Guidelines that were published in journals with an impact factor greater than 5.0 were more likely to have one or more authors with a COI than guidelines not published in journals.
Rates of disclosure of author COI and the public availability of that information are unacceptably low, however rates of COI among guideline authors may have decreased in recent years. Continued efforts are needed to establish and enforce optimal COI policies in clinical practice guideline development in order to minimize the risk of bias associated with those conflicts.
Citation: Norris SL, Holmer HK, Ogden LA, Selph SS, Fu R (2012) Conflict of Interest Disclosures for Clinical Practice Guidelines in the National Guideline Clearinghouse. PLoS ONE 7(11): e47343. doi:10.1371/journal.pone.0047343
Editor: Joseph S. Ross, Yale University School of Medicine, United States of America
Received: June 6, 2012; Accepted: September 14, 2012; Published: November 7, 2012
Copyright: © 2012 Norris et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This project was supported by grant number 1R01HS018500 from the Agency for Healthcare Research and Quality. The content is solely the responsibility of the authors and does not necessarily represent the official views of the Agency for Healthcare Research and Quality. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: This project was supported by grant number 1R01HS018500 from the Agency for Healthcare Research and Quality. The content is solely the responsibility of the authors and does not necessarily represent the official views of the Agency for Healthcare Research and Quality. SLN has received funding from the US Agency for Healthcare Research and Quality to study conflict of interest in clinical practice guideline development. HKH, LAO and RF received salary support from the Agency for Healthcare Research and Quality under grant number 1R01HS018500, to study conflict of interest in clinical practice guideline development. The authors have no other conflicts of interest to declare. This does not alter the authors’ adherence to all the PLOS ONE policies on sharing data and materials.
Conflict of interest (COI) is an important potential source of bias in the development of clinical practice guidelines (CPGs). A COI is a set of conditions in which professional judgment concerning a primary interest (such as the health and wellbeing of a patient or the validity of research), may be unduly influenced by a secondary interest . Physician-industry relationships  and industry funding of research ,  are frequent and increasing in prevalence. There are data suggesting an association between author or funder COI and study outcomes , , , , , between industry relationships and physician behavior  or expressed opinions , , and between COI and conclusions in systematic reviews .
CPGs are “statements that include recommendations intended to optimize patient care that are informed by a systematic review of evidence and an assessment of the benefits and harms of alternative care options” . CPGs can influence the care delivered by a large number of healthcare providers and thus potentially the outcomes of patients . The quality of CPGs is therefore critically.
important: high-quality, or trustworthy guidelines promote the use of effective clinical services, decrease undesirable practice variation, reduce the use of services that are of minimal or questionable value, increase the use of effective but underused services, and target services to populations most likely to benefit .
Data on the prevalence of industry relationships of CPG sponsors and authors are either limited to specific clinical areas , ,  or dated , , . A study published in Nature in 2005  reported that 49% of 215 CPGs in the National Guideline Clearinghouse provided no disclosures of COI, and that 43% of CPGs with disclosures had one or more authors who were paid by industry for speaking engagements. Of the 685 authors of these CPGs, 35% disclosed an interest in a company relevant to the topic of the guideline. More recently, Neuman and colleagues  reported that 48% of panel members producing CPGs on the management of diabetes or hyperlipidemia disclosed a COI while 27% of members were not given the opportunity to disclose conflicts. 36% of guidelines (n = 14) did not provide an opportunity for panelists to publicly declare financial COI .
The Institutes of Medicine (IOM) report on Conflict of Interest in Medical Research, Education, and Practice  noted that additional information is needed on the prevalence of COI in CPGs, and on the potential effects of such conflicts. The objective of this study was to address this knowledge gap by reporting on current practices of COI disclosure and on author COI across a broad range of CPGs. In addition, we examined whether characteristics of guideline topics, sponsors, developers, and publications were associated with the presence of disclosures and of reported conflicts.
We selected a random sample of 250 CPGs listed in the National Guideline Clearinghouse (NGC) (http://www.guideline.gov) on November 22, 2010, representing approximately a 10% sample of guidelines listed in the NGC on that date. The NGC is funded by the Agency for Healthcare Research and Quality (AHRQ), and was established in January, 1999 “to provide physicians and other health professionals, health care providers, health plans, integrated delivery systems, purchasers, and others an accessible mechanism for obtaining objective, detailed information on clinical practice guidelines and to further their dissemination, implementation, and use” . The inclusion criteria for guidelines within the NGC are: 1) The clinical practice guideline contains systematically developed statements that include recommendations, strategies, or information that assists physicians and/or other health care practitioners and patients to make decisions about appropriate health care for specific clinical circumstances. 2) The clinical practice guideline was produced under the auspices of medical specialty associations; relevant professional societies, public or private organizations, government agencies at the Federal, State, or local level; or health care organizations or plans. 3) Corroborating documentation can be produced and verified that a systematic literature search and review of existing scientific evidence published in peer reviewed journals was performed during the guideline development. 4) The full text guideline is available upon request in the English language. 5) The guideline was developed, reviewed, or revised within the last 5 years.
Random numbers for the selection of our cohort of CPGs were obtained from Random.org (http://www.random.org). Because CPGs are continuously added and archived in the NGC, CPGs identified in the original cohort were not always available at the time of data abstraction. In that situation, we selected the CPG corresponding to the next random number in our sequence.
One author abstracted information from each CPG and from the corresponding summary in NGC, into a pre-specified template in Microsoft Excel®, and those data were checked by a second author. We examined the NGC summaries because in some circumstances they provided more detailed information on CPG author COI, (upon submission of a guideline to the NGC, guideline developers are asked to disclose COI if none was provided in the submitted CPG). We also looked for disclosure information in CPG supplemental documents if any were referenced.
Data were abstracted on: 1) where the CPG was published; 2) the presence of a COI policy for the developer of the CPG and the journal where the CPG was published (if applicable); 3) the number of authors or panel members responsible for the recommendations in the CPG; 4) specific disclosures for each author of each CPG. We stratified disclosures as financial and nonfinancial, and further categorized the financial conflicts into one or more categories (advising, consulting, research, patents/royalties, stock/equity, gifts, other) based in part on the frameworks proposed by Papinakalou  and Cosgrove . Nonfinancial COI included any interests that are not usually assessed in terms of their monetary value, including intellectual, academic, and professional interests.
If conflicts were listed for some but not all of the CPG authors, and there was no mention of all authors having disclosed, we assumed that all authors had provided COI statements, and that those authors without disclosures had no conflicts. If the CPG indicated that authors and/or panel members with COI were excluded from participating in the CPG development process, we assumed that none of the authors had COI.
This study was exploratory and descriptive, thus our approach to data analysis and synthesis was largely qualitative. We examined four outcome variables: 1) the presence of any disclosure in the CPG (including disclosures of no COI); 2) whether the presence of COI could be assessed for the CPG (Yes versus No, the latter including CPGs with no disclosures and CPGs with disclosures that were not publically available); 3) whether one or more CPG authors had any disclosed COI; and 4) the percentage of CPG authors with any disclosed COI. For outcomes 1) and 2), the analysis used the entire CPG sample (n = 250). Outcomes 3) and 4) involved the subset of CPGs where the specific conflicts were disclosed and available to us.
The association of pre-specified predictor variables with the four outcomes above was examined. The predictor variables included year of publication or guideline update; funder; type of organizations that developed the CPG and type of organizations that funded the CPG (both classified as government, academic, professional organization, and combined); number of organizations that developed the CPG (1, 2, or 3); number of organizations that funded the CPG (1 or more than 1); whether the funder was the same as the developer of the CPG; types of interventions contained in the CPG (any recommendation regarding drug therapy versus no drug-related recommendations); whether the CPG was published in a journal, and if it was, whether the journal had a CPG-specific COI policy; the 2010 impact factor of the journal) ; and the country where the CPG originated. Given the exploratory nature of this study, only significant variables were included in the final model.
Characteristics of the CPGs and the organizations producing them were summarized using descriptive statistics. To assess the association between outcomes 1) through 3) and the pre-specified independent variables, we used a logistic generalized estimating equation (GEE) regression model. For outcome 4), the percentage of CPG authors with a COI, we used a linear GEE model. Since some organizations within our cohort developed multiple CPGs, the GEE approach was used to account for correlations among multiple CPGs.
Characteristics of Organizations Producing CPGs
The 250 CPGs in our cohort were developed by 97 different organizations worldwide, with over half (59.6%) originating in the US (Table 1). On the date or our search, NGC listed between 1 and 17 guidelines (median 2) from 97 different organizations. 188 of the CPGs were developed by a single organization, while 44 were co-developed by two organizations and eight by three. 142 of the CPGs in our cohort were the original release of the guideline: the remainder were updates. The majority of CPGs (62%) were published in a journal; the others were available only online or in hard-copy format. Professional organizations were the most frequent developer of the guidelines in our cohort (69%). Authors were individually listed in 233 CPGs (mean number of authors 15, range 1–92); the remaining 17 CPGs were authored by guideline development groups.
Disclosure Statements and Conflicts of Interest among CPGs and CPG Authors
In our cohort, 217 (86.8%) of the guidelines were developed by organizations with COI policies specific to the development of CPGs. The majority of the CPGs (60.0%, n = 150) reported disclosure statements either in the CPG itself or in the NGC summary (Figure 1). For 63 of these 150 guidelines, however, these statements were not publically available. Thus, in total, only 87 (34.8%) of the 250 CPGs provided publicly available COI information on all authors.
Abbreviations: COI, conflict of interest; CPGs, clinical practice guidelines.
Of the 87 CPG’s with public disclosures, 35 (40.2%) had no authors with a COI. Of those CPGs with one or more authors with a COI (n = 52), the mean proportion of authors with COI was 46.8% (standard deviation 5.4%) (range 4.2% to 100%) (Table 2).
The most common types of conflicts among the 52 guidelines with one or more authors with a conflict, were payments for advising/consulting (94% of these guidelines) and research (76.9%) (Table 2). These 52 CPGs had a total of 731 authors, of whom 325 (44.5%) disclosed 445 unique conflicts, including advising/consulting (49.4% of conflicts) and research (37.1%). Only three CPGs mentioned non-financial/intellectual COI, and six of the 445 total disclosures (1.3%) were for intellectual COI.
Predictors of Disclosures and Conflicts of Interest among CPGs and CPG Authors
Several variables were found to significantly predict whether a CPG provided any disclosures for authors (Table 3), including whether the guideline was published in a journal and impact factor of the journal (P = 0.0014). CPGs published in a journal with an impact factor less than 5 were less likely to provide disclosures, compared with CPG not published in a journal (odds ratio [OR] 0.311; 95% confidence interval [CI] 0.127, 0.759; P = 0.011). Whether the organization had a policy for COI (P = 0.015), the number of organizations that developed the CPG (P = 0.031), and the country of the organization developing the CPG (P = 0.021) all predicted whether the guideline provided disclosures. CPGs developed by two organizations were less likely to provide disclosures than those developed by three organizations (OR 0.111; 95% CI 0.022, 0.568; P = 0.0085).
CPGs developed by a Canadian (P = 0.038) or European organization (P = 0.014) were more likely to provide disclosures than those developed by a US organization.
In the final model examining whether the presence of COI could be assessed in a CPG, two variables were significant: whether the CPG was published in a journal and the journal impact factor (P = 0.0004), and the number of organizations that funded the CPG (P = 0.0051) (Table 3). Compared to CPGs not published in a journal, CPGs published in a journal with an impact factor greater than 10 were more likely to provide disclosures that were accessible to the reader (OR 7.662; 95% CI 2.495, 23.534; P = 0.0004). CPGs funded by more than one organizations were more likely to provide disclosures than those funded only by one organization (OR 4.141; 95% CI 1.538, 11.152). Only three CPGs were funded by three organizations, hence for this analysis these were combined with CPGs funded by two organizations.
For the analysis of the subset of CPGs where we could determine the presence or absence of author COI (n = 87), only whether the guideline was published in a journal and the impact factor were significantly associated with the presence of any COI in the final model (P = 0.0001). The number of developers, number of funders, and the type of funder and developer were not significant in the final model (P>0.05). Compared to authors of CPGs not published in a journal, one or more authors of CPGs published in a journal with an impact factor greater than five were more likely to have a COI (OR 48.794; 95% CI 8.678, 274.366; P<0.0001), while authors of CPGs published in a journal with an impact factor less than 5 showed no significant difference (OR 2.911; 95% CI 0.570, 14.862; P = 0.20). Due to the small sample size, CPGs published in a journal with an impact factor between 5 and 10 and greater than 10 were combined into one group in this analysis.
Similarly, whether the CPG was published in a journal and impact factor of the journal were also significant in the final model for the percentage of authors with COI (n = 87, P = 0.0004). The percentage of authors who reported COIs for CPGs published in a journal with an impact factor greater than 5 was 33.3% higher than the percentage of authors of CPGs not published in a journal (95% CI 17.2%, 49.4%; P<0.0001). There was no significant difference in percentage of authors with COIs between CPGs published in a journal with an impact factor less than five and CPGs not published in a journal (mean difference 11.3%; 95% CI 14.4%, 37.0%; P = 0.384).
It appears that some progress has been made by CPGs developers to improve transparency through disclosures by CPG authors over the last two decades. Choudhry and colleagues  reported that only 2 of 44 CPGs published between 1991 and 1999 included author disclosures. Similarly, Papanikolaou and coauthors  reported that only seven of 40 guidelines published in six major clinical journals in 1999 provided disclosures. Tregear  reported that the proportion of summaries in NGC with financial relationships reported increased from about 20% in 1999 to 50% in 2006, although these summaries contain information supplied by guideline developers in response to a specific request for COI information, and thus may be more complete than information contained only within the guideline document. More recently, Neuman and colleagues  reported that 64% of 14 CPGs on diabetes or hyperlipidemia provided public author disclosures and 17 recent CPGs by the American college of Cardiology and the American Heart Association all provided disclosures . The current study also suggests that disclosure rates, although still suboptimal, have improved.
This apparent improvement in disclosure rates may be attributed in part to increased awareness of the potential importance of COI in primary medical research and in derivative products such as systematic reviews and clinical practice guidelines , , . There have been major efforts in the last 5 years to devise and update policies on COI disclosure and management by journals, academic institutions, government agencies, and professional organizations , , . In 2011 the IOM released a report with standards for guideline development based on an expert consensus process and evidence when available . One of the eight standards focuses on the management of COI and a second standard relates to the composition of the guideline development group. The IOM recommends disclosure of all potential and confirmed members of guideline panels, divestment of financial interests that could be affected by the guideline, exclusion (when possible) of individuals with COI, and a multidisciplinary and balanced guideline panel. Guideline organizations are beginning to incorporate these standards into their processes and policies  and thus disclosure rates and guideline author COI may continue to improve.
Disclosures of COI by CPG panel members should be readily available to all users of a guideline in order to assess the risk of bias and the credibility of the guideline. It is therefore concerning that 42% of guidelines with disclosures did not make those disclosures available in the public domain. It is also not sufficient in our view to have disclosures only in the NGC summary and not in the CPG itself, as many users will not access the summary.
We report a lower proportion of conflicted CPG authors than have prior studies –, , –. In two recent studies examining small cohorts of CPGs , , the percentage of authors with COI was 56%  and 65%  (among authors with publically available disclosures). Older studies report even higher rates of COI among guideline panel authors , , , .
It is difficult to compare rates of COI for panel members across guidelines, however. Studies examining rates of COI in CPGs generally involve small, select cohorts with variations in publication sites (peer reviewed journal or web-based), policies on public availability of disclosures, disclosure forms and instructions (particularly relevance of the disclosure to the content of the CPG), and management of disclosed conflicts .
Although rates of disclosure of COI may be improving, a significant proportion of CPGs are developed by panels with one or more authors with a COI. There are likely a number of factors contributing to these continued high rates. Industry accounts for more than half of biomedical research funding and is continuing to increase in proportion to other funding sources , so clinical experts who conduct research and who participate in guideline development may be receiving significant funding from industry. Guideline authors who are asked to complete disclosure forms may be providing more complete and accurate disclosures in view of an increased awareness of COI, anticipation of scrutiny by journal editors and readers, and the use of the International Committee of medical Journal Editors (ICMJE) standardized disclosure form . Guidelines on specialized medical treatments may recruit from a small number of individuals with the relevant expertise, such that involving unconflicted individuals may not be possible.
Several factors were noted to be associated with whether or not CPGs had author disclosures. Journals with impact factors less than five had disclosures less commonly than CPGs that were not published in journals, suggesting that these journals either did not have COI polices or did not adhere to existing policies. Guidelines produced by Canadian organizations were more likely to have disclosures than US organizations, suggesting room for improvement among US-based organizations. Disclosures do appear to be occurring more frequently in later years of our 5-year examination, suggesting that positive changes are occurring.
CPGs published in journals with an impact factor greater than five were associated with an increased proportion of authors with COI. The reasons for this are unclear, but in addition to actually having more conflicts, authors might be more consistent in reporting COI in these journals due to the use of ICMJE forms, author experience, journal editor attention and pressure, and policy-specific influences such as a requirement to update COI disclosures periodically.
This study focuses on disclosures of COI by CPGs authors, however, the central issue for guideline quality is the risk of bias and the diminished credibility related to the secondary interests held by guideline developers. The relationship between disclosures and biased recommendations in CPGs is complex and poorly understood. The effect of COI on conclusions in CPGs is unknown  as also is the effect of disclosing COI on the authors and the users of CPGs. We did not examine the management of disclosures for each of the CPGs in our cohort. It is possible that some of the effects of the disclosed conflicts were mitigated with procedures and approaches carried out by each organization during CPG development.
There are limitations to our approach. Although we examined COI statements from both the CPG itself and the statements provided to the NGC, disclosures in publications may not always be accurate , , , and the information in NGC may have limitations reflecting the quality of source documents used to determine COI . Additionally, we did not request author disclosures from organizations that did not provide these disclosures in the public domain as these were usually listed as available to members of that organization only. We examined all authors or panel members for each guideline, irrespective of their role on each panel; it is possible that the chair or co-chair of each guideline group might have played a dominant role in deliberations, and thus their COI might be more important than for other panel members. We did not examine the sources of funding for development of each CPG, so it is possible that funders may also have had a role in formulating recommendations in CPGs.
Our findings may be generalizable to other guidelines within the NGC, given our random, 10% sample. Applicability of our findings to CPGs not contained within NGC may be limited, however. For example, guidelines not published in English or those without an underlying systematic review may have different rates of disclosure and COI than those in our cohort.
Although financial interests are usually the most obvious, intellectual interests are increasingly recognized and may be powerful motivators for researchers, systematic reviewers, and guideline authors , . Intellectual COI has been defined as “academic activities that create the potential for an attachment to a specific point of view that could unduly affect an individual’s judgment about a specific recommendation” . Intellectual interests include benefits the advancement of medical science, career advancement, fulfillment of a desire to do good, opportunity to publish, notoriety, future success in obtaining grant funding for research, and increased sense of self-worth . Very few CPGs in our cohort disclosed nonfinancial COI and future efforts in COI transparency need to address this.
It is clear that much improvement is still needed in the rates of disclosure of author COI, in the public availability of that information, and in the unacceptably high rates of COI among guideline authors. CPGs can be an important tool for improving patient care, and as such, continued efforts are needed to optimize their quality by increased transparency and by minimizing potential sources of bias.
The authors thank the staff of the National Guideline Clearinghouse contractor, ECRI Institute, for their assistance. The material in this manuscript was presented as a poster at the Cochrane Colloquium in Madrid, Spain, in October, 2011. The abstract can be found at http://www.cochrane.org/sites/default/files/uploads/Abstracts_Book_DEF.pdf
Conceived and designed the experiments: SLN HKH RF. Performed the experiments: SLN HKH LAO SS RF. Analyzed the data: SLN HKH LAO SS RF. Wrote the paper: SLN HKH LAO SS RF.
- 1. Thompson DF (1993) Understanding financial conflicts of interest. N Engl J Med 329: 573–576.
- 2. Campbell EG, Gruen RL, Mountford J, Miller LG, Cleary PD, et al. (2007) A national survey of physician-industry relationships. N Engl J Med 356: 1742–1750.
- 3. Pharmaceutical Industry Profile 2011 (2011) Washington, DC: Pharmaceutical Research and Manufacturers of America.
- 4. House of Commons Health Committee (2005) The Influence of the Pharmaceutical Industry, Fourth Report of Session 2004–05. London: House of Commons Health Committee.
- 5. Bekelman JE, Li Y, Gross CP (2003) Scope and impact of financial conflicts of interest in biomedical research: a systematic review. JAMA 289: 454–465.
- 6. Lexchin J, Bero LA, Djulbegovic B, Clark O (2003) Pharmaceutical industry sponsorship and research outcome and quality: systematic review. BMJ 326: 1167–1170.
- 7. Stelfox HT, Chua G, O’Rourke K, Detsky AS (1998) Conflict of interest in the debate over calcium-channel antagonists. N Engl J Med 338: 101–106.
- 8. Als-Nielsen B, Chen W, Gluud C, Kjaergard LL (2003) Association of funding and conclusions in randomized drug trials: a reflection of treatment effect or adverse events? JAMA 290: 921–928.
- 9. Rochon PA, Gurwitz JH, Simms RW, Fortin PR, Felson DT, et al. (1994) A study of manufacturer-supported trials of nonsteroidal anti-inflammatory drugs in the treatment of arthritis. Arch Intern Med 154: 157–163.
- 10. Chren MM, Landefeld CS (1994) Physicians’ behavior and their interactions with drug companies. A controlled study of physicians who requested additions to a hospital drug formulary. JAMA 271: 684–689.
- 11. Wang AT, McCoy CP, Murad MH, Montori VM, Wang AT, et al. (2010) Association between industry affiliation and position on cardiovascular risk with rosiglitazone: cross sectional systematic review. BMJ 340: c1344.
- 12. Fugh-Berman A, McDonald CP, Bell AM, Bethards EC, Scialli AR, et al. (2011) Promotional tone in reviews of menopausal hormone therapy after the Women’s Health Initiative: an analysis of published articles. PLoS Med 8: e1000425.
- 13. Barnes DE, Bero LA (1998) Why review articles on the health effects of passive smoking reach different conclusions. JAMA 279: 1566–1570.
- 14. Institute of Medicine (2011) Clinical Practice Guidelines We Can Trust; Graham R, Mancher M, Wolman DM, Greenfield S, Steinberg E, editors. Washington, D.C.: The National Academies Press. 197 p.
- 15. Woolf SH, Grol R, Hutchinson A, Eccles M, Grimshaw J (1999) Clinical guidelines: potential benefits, limitations, and harms of clinical guidelines. BMJ 318: 527–530.
- 16. Institute of Medicine (2008) Knowing what works in health care: A roadmap for the nation. Washington, DC: The National Academies Press.
- 17. Holloway RG, Mooney CJ, Getchius TS, Edlund WS, Miyasaki JO, et al. (2008) Invited Article: Conflicts of interest for authors of American Academy of Neurology clinical practice guidelines. Neurology 71: 57–63.
- 18. Neuman J, Korenstein D, Ross JS, Keyhani S (2011) Prevalence of financial conflicts of interest among panel members producing clinical practice guidelines in Canada and United States: cross sectional study. BMJ 343: d5621.
- 19. Mendelson TB, Meltzer M, Campbell EG, Caplan AL, Kirkpatrick JN (2011) Conflicts of interest in cardiovascular clinical practice guidelines. Arch Intern Med 171: 577–584.
- 20. Choudhry NK, Stelfox HT, Detsky AS (2002) Relationships between authors of clinical practice guidelines and the pharmaceutical industry. JAMA 287: 612–617.
- 21. Taylor R, Giles J (2005) Cash interests taint drug advice. Nature 437: 1070–1071.
- 22. Papanikolaou GN, Baltogianni MS, Contopoulos-Ioannidis DG, Haidich AB, Giannakakis IA, et al. (2001) Reporting of conflicts of interest in guidelines of preventive and therapeutic interventions. BMC Medical Research Methodology 1: 3.
- 23. Institute of Medicine (2009) Conflict of Interest in Medical Research, Education, and Practice; Lo B, Field MJ, editors. Washington, D.C.: The National Academies Press. 414 p.
- 24. National Guideline Clearinghouse website. Available: http://www.guideline.gov/about/index.aspx. Accessed 2012 May 7.
- 25. Cosgrove L, Bursztajn HJ, Krimsky S, Anaya M, Walker J (2009) Conflicts of interest and disclosure in the American Psychiatric Association’s Clinical Practice Guidelines. Psychother Psychosom 78: 228–232.
- 26. Journal Citation Reports website. Available: www.webofknowledge.com/JCR. Accessed 2011 Sep 23.
- 27. Tregear M (2007) Guideline Heterogeneity: Workshop Part 2, ECRI Institute, August 27. Presentation at the Fourth Annual Guidelines International Network Meeting, Toronto, August 22–25.
- 28. Institute of Medicine (2011) Finding What Works in Health Care: Standards for Systematic Reviews; Eden J, Levit L, Berg A, Morton S, editors. Washington, D.C.: The National Academies Press. 245 p.
- 29. International Committee of Medical Journal Editors (2012) Uniform requirements for manuscripts submitted to biomedical journals. Available: http://www.icmje.org/ethical_4conflicts.html. Accessed 2012 Jul 8.
- 30. Council of Medical Specialty Societies (2011) Code for Interactions with Companies. Available: http://www.cmss.org/codeforinteractions.aspx. Accessed 2012 Jul 7.
- 31. Brawley O, Byers T, Chen A, Pignone M, Ransohoff D, et al. (2011) New American Cancer Society Process for Creating Trustworthy Cancer Screening Guidelines. JAMA: The Journal of the American Medical Association 306: 2495–2499.
- 32. Coyne DW (2007) Influence of industry on renal guideline development. Clin J Am Soc Nephrol 2: 3–7.
- 33. Hietanen P (2009) Does the expert panel at the St Gallen meeting provide an unbiased opinion about the management of women with early breast cancer? Ann Oncol 20: 1749–1751; author reply 1751–1742.
- 34. Buchan HA, Currie KC, Lourey EJ, Duggan GR (2010) Australian clinical practice guidelines–a national study. Med J Aust 192: 490–494.
- 35. Norris SL, Holmer HK, Burda BU, Ogden LA, Fu R (2012) Conflict of interest policies for organizations producing a large number of clinical practice guidelines. PLoS ONE 7: e37413.
- 36. Dorsey ER, de Roulet J, Thompson JP, Reminick JI, Thai A, et al. (2010) Funding of US biomedical research, 2003–2008. JAMA 303: 137–143.
- 37. Norris S, Holmer H, Ogden L, Burda B (2011) Conflict of interest in clinical practice guideline development: a systematic review. PLoS ONE 6: e25153.
- 38. Chimonas S, Frosch Z, Rothman DJ (2011) From Disclosure to Transparency: The Use of Company Payment Data. Arch Intern Med 171: 81–86.
- 39. Okike K, Kocher MS, Wei EX, Mehlman CT, Bhandari M, et al. (2009) Accuracy of conflict-of-interest disclosures reported by physicians. N Engl J Med 361: 1466–1474.
- 40. Weinfurt KP, Seils DM, Tzeng JP, Lin L, Schulman KA, et al. (2008) Consistency of Financial Interest Disclosures in the Biomedical Literature: The Case of Coronary Stents. PLOS One 3: e2128.
- 41. Schunemann HJ, Osborne M, Moss J, Manthous C, Wagner G, et al. (2009) An official American Thoracic Society Policy statement: managing conflict of interest in professional societies. Am J Respir Crit Care Med 180: 564–580.
- 42. Levinsky NG (2002) Nonfinancial conflicts of interest in research. N Engl J Med 347: 759–761.
- 43. Guyatt G, Akl EA, Hirsh J, Kearon C, Crowther M, et al. (2010) The vexing problem of guidelines and conflict of interest: a potential solution. Ann Intern Med 152: 738–741.
- 44. Alpert JS, Shine KI, Adams RJ, Antman EM, Kavey RE, et al. (2004) Task force 1: The ACCF and AHA codes of conduct in human subjects research. J Am Coll Cardiol 44: 1724–1728.