The private versus public contribution to developing new health knowledge and interventions is deeply contentious. Proponents of commercial innovation highlight its role in late-stage clinical trials, regulatory approval, and widespread distribution. Proponents of public innovation point out the role of public institutions in forming the foundational knowledge undergirding downstream innovation. The rapidly evolving COVID-19 situation has brought with it uniquely proactive public involvement to characterize, treat, and prevent this novel health treat. How has this affected the share of research by industry and public institutions, particularly compared to the experience of previous pandemics, Ebola, H1N1 and Zika?
Using Embase, we categorized all publications for COVID-19, Ebola, H1N1 and Zika as having any author identified as affiliated with industry or not. We placed all disease areas on a common timeline of the number of days since the WHO had declared a Public Health Emergency of International Concern with a six-month lookback window. We plotted the number and proportion of publications over time using a smoothing function and plotted a rolling 30-day cumulative sum to illustrate the variability in publication outputs over time.
Industry-affiliated articles represented 2% (1,773 articles) of publications over the 14 months observed for COVID-19, 7% (278 articles) over 7.1 years observed for Ebola, 5% (350 articles) over 12.4 years observed for H1N1, and 3% (160 articles) over the 5.7 years observed for Zika. The proportion of industry-affiliated publications built steadily over the time observed, eventually plateauing around 7.5% for Ebola, 5.5% for H1H1, and 3.5% for Zika. In contrast, COVID-19’s proportion oscillated from 1.4% to above 2.7% and then declined again to 1.7%. At this point in the pandemic (i.e., 14 months since the PHEIC), the proportion of industry-affiliated articles had been higher for the other three disease areas; for example, the proportion for H1N1 was twice as high.
While the industry-affiliated contribution to the biomedical literature for COVID is extraordinary in its absolute number, its proportional share is unprecedentedly low currently. Nevertheless, the world has witnessed one of the most remarkable mobilizations of the biomedical innovation ecosystem in history.
Citation: Beall RF, Moradpour J, Hollis A (2021) The private versus public contribution to the biomedical literature during the COVID-19, Ebola, H1N1, and Zika public health emergencies. PLoS ONE 16(10): e0258013. https://doi.org/10.1371/journal.pone.0258013
Editor: Quinn Grundy, University of Toronto, CANADA
Received: May 28, 2021; Accepted: September 15, 2021; Published: October 22, 2021
Copyright: © 2021 Beall et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data that support the findings of this study are available from EMBASE but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the upon reasonable request and with permission of EMBASE. The institutional contact is: email@example.com. The authors did not have any special access privileges that others would not have.
Funding: RB and AH both received funding from Canadian Institutes of Health Research, grant #s NGR-167542 and 439801. https://cihr-irsc.gc.ca The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
There has been extensive discussion about the contribution of the pharmaceutical industry to resolving the coronavirus pandemic, with some critics arguing that industry has profited from the support of government [1–4]. This has galvanized an ongoing and age-old debate regarding how much drug development actually costs private industry versus the public, especially considering how much is attributable to public investment in early science [5–15]. Apologists for the industry have pointed to its key role in bringing together capital and expertise to bring vaccines through clinical trials, secure regulatory approvals, and operationalize the mass manufacturing [16–18].
Within this context, numerous studies have used scientific publications to approximate the contribution of public versus private investments into the research enterprise, often finding that public contributions form the backbone of the innovation system with private industry playing a less substantial, but critical role in bringing health innovations to the marketplace [19–22]. Studies within this line of research have also included co-authorship analysis between public institutions and private firms . Several investigations have used scientific bibliographic data to track the mobilization of the biomedical research enterprise during COVID-19 [23–28] with a minority of these comparing this pandemic to previous ones in order to understand the magnitude of the response [29, 30], but none have focused specifically on industry-affiliated versus non-industry-affiliated published research studies.
In this study, we use bibliographic data to examine the role of industry in the global research enterprise during public health emergencies. Our objective was to quantify the role of industry in the wide-ranging mobilization of the biomedical science community, to understand the extent to which this evolves over time, and to assess how industry’s contribution during COVID-19 compares to previous pandemics, including Ebola, H1N1 and Zika.
We used Embase to search for publications that mentioned either COVID-19, H1N1, Zika, or Ebola (or any variant of these terms) in the abstract, extracted bibliographic data, tabulated the results, and then compared the results across the four disease areas. We consider only articles with one of the following publication types: Article, Chapter, Review, Letter, Note, and Editorial. We chose these four epidemics because each had been designated a Public Health Emergency of International Concern (PHEIC) by the World Health Organization. This led us to select COVID-19 (designated a PHEIC on 30 January 2020 ), Ebola (8 August 2014  with a second PHEIC declared in 2019), H1N1 influenza (26 April 2009 ), and Zika (1 February 2016 ). We excluded the 2014 polio PHEIC since there were existing polio vaccines available. The disease areas of the articles were located by searching the titles and abstracts for key terms associated with or variations of names for those diseases (S1 Appendix). We used a six-month lookback window for publications prior to the PHEIC. A lookback period was used as our main objective was to closely examine across disease areas the mobilization of the scientific community following a period of high urgency, rather than the entire historical evolution prior to the PHEIC (e.g., publications for Ebola from 1976 to present day).
After extracting the publication data, the articles were categorized by reviewing the authors’ affiliations. Industry-affiliated articles were coded as those with one or more authors who listed a firm as their affiliation, such as a pharmaceutical or biotech company, rather than (or in addition to) another entity, such as a university, a governmental office, or a civil society organization. Therefore, the distinction of “industry-affiliated” includes articles that were either co-authored by one or more authors with a private affiliation or were entirely authored by authors with private affiliations. This approach was taken to establish a clear delineation rule for coding decisions that can be applied consistently across the diseases. There were a limited number of publication records in which no affiliation data were available. No affiliation data were available for a small fraction of publications. While these were not retained for our main analysis, we report on the distribution of these records across the four pandemics as well as their potential impact on our results.
Our analysis reports descriptive statistics on the number of industry-affiliated articles as well as their proportional representation of all publications examined. We plotted the number and proportion of all publications over time using a smoothing function with confidence intervals. Additionally, we plotted a 30-day publication rate (i.e., the number of articles published within 30 days of the date in question) using a cumulative sum function as well as a smooth with confidence intervals in order to more closely examine the variability in publication outputs over time. All plots were generated using the ggplot2 package in R.
Our searches within the four disease areas collectively located 126,532 relevant publications. Affiliation data was available for 120,667 (95%) and was therefore retained in our final dataset for analysis. Of these, publications for COVID-19 represented 87% (110,585) of the literature (time observed: 14 months), followed by H1N1 with 5% (6,773) (time observed: 12.4 years), Zika with 4% (5,075) (time observed: 5.7 years), and Ebola with 3% (4,099) (time observed: 7.1 years) (Table 1). The remaining 5% (5,856) of the publication records had no author affiliation data available. Of these 5,856 without affiliation data, the publications relevant to Ebola had the largest proportion of such records (9%, 379/4,099), followed by COVID-19 (5%, 5,119/110,585), Zika (4% 181/5,075), and H1N1 (3%, 186/6,773).
Industry-affiliated publications across the four pandemics
Of the 120,667 publications with affiliation data available, 2% (2,561 articles) had industry affiliations (Table 2). However, this proportion varied across the four pandemics with the highest level for Ebola at 7% (278 articles), followed by H1N1 with 5% (350 articles), Zika with 3% (160 articles), and COVID-19 with 2% (1,773 articles). At this point in the pandemic (428 days after the pandemic), the cumulative sum of publications for COVID-19 was 1,773 for industry-affiliated versus for 103,693 non-industry-affiliated publications–a number far exceeding previously observed cumulative sums after the same amount of time following the PHEIC for both industry-affiliated publications (46 times larger as compared to Ebola) versus non-industry-affiliated publications (92 times higher as compared to Zika) (Ebola: 39 versus 937; H1N1: 7 versus 271; Zika: 24 versus 1,123) (Fig 1).
Notes: The cumulative number of publications observed among Ebola, H1N1, and Zika was extremely similar for industry- and non-industry-affiliated publications alike. COVID-19 is a true outlier in reaching such a high number of publications so quickly. The absolute number is unprecedented both for industry- and non-industry-affiliated publications alike.
Proportion of industry-affiliated publications over time
The proportion of industry-affiliated publications varied over the total time observed for each pandemic (Fig 2). The proportion of industry-affiliated publications built steadily over the time and eventually plateauing over the time observed for each of the three non-COVID pandemics with 7.5% for Ebola (after 7.1 years), 5.3% for H1H1 (after 12.4 years), and 3.3% for Zika (after 5.7 years). In contrast, COVID-19’s proportion oscillated from 1.4% at 4 weeks after the PHEIC, to 2.6% at 180 days after the PHEIC, and then declined back down to 1.7% at the end of the time observed (428 days). At this point in the pandemic (i.e., 428 months since the PHEIC), the proportion of industry-affiliated articles was higher for the three other diseases (Ebola: 4.0%; H1N1: 2.8%; Zika: 2.2%).
Notes: The proportion of industry-affiliated publications varies by disease area and has generally appeared to build or stabilized over time, with large exception to COVID-19 more recently which rose above 2.5% before dropped to 1% during the time observed. COVID-19 was also unique in that the proportion of industry-affiliated articles was extremely low by the end of the observation period; for example, the proportion for H1N1 is double that of COVID-19 at 14 months out from the PHEIC.
The proportional decline for COVID-19 occurred because industry-affiliated publications reached a peak 30-day rate of 296 publications on 26 August 2020 before declining to 77 publications on 14 January 2021. While this pace began to accelerate again in April 2021 with a last observed rate of 177 publications, non-industry-affiliated publications had been steadily climbing to a rate of 16,726 observed on that same day (Fig 3, Panel A). Based on the record of previous pandemics, there has been a peak in the publication rate per pandemic, but this may occur at different times for industry- and non-industry-affiliates (Fig 3, Panel B). It remains possible that there may be an even larger surge in industry-affiliated publications which could regain greater proportional representation in the literature in the longer term that is more commensurate with prior experience.
Notes: The 30-day publication rate (i.e., a rolling sum of the total publications within 30 days of the date in question) for COVID-19 is unprecedented when compared against the publication record of Ebola, H1N1, and Zika, generally oscillated between 3–5 and 25–100 articles for industry- and non-industry-affiliates. Industry-affiliated publications appear to have peaked at nearly 300 publications per month, while non-industry-affiliated appear to continue building. This explains why the proportion of industry-affiliated publications dropped from above 2.5% of the literature back down to less than 1%. However, based on the experience of the other three disease areas, industry-affiliated publications may again accelerate in the coming months to outmatch its previous peak. Note that COVID-19 has been placed in its own panel given its uniquely high publication rate and to allow for direct comparability of the experience among the other 3 disease areas, which are on the same scale.
Our study has observed that industry-affiliated articles represent a small minority of the scientific publications across four recent pandemics. Industry-affiliated publications appeared more slowly but built generally over time to represent an increasing level of participation in the scientific literature, albeit still remaining below 8 percent. While it is already abundantly clear that the absolute number of industry-affiliated publications for COVID-19 is extraordinarily high, the share of industry-affiliated articles is not; in fact, it is unprecedentedly low (less than 2%) at 14 months out from the PHEIC. This result is most surprising given unprecedented amount of public funding provided to industry during COVID-19 and given the levels of proportionate engagement in the biomedical scientific literature during previous pandemics.
Similar to previous studies [23–30], we found that the mobilization of the biomedical community against COVID-19 as reflected in the record of the scientific literature is extraordinary, dwarfing what has been previously observed for other diseases. For example, by 24 May 2020 (not even 4 months after the PHEIC), one study  found that the number of COVID-related publications had already outnumbered the cumulative sum of publications accrued over the two years following the SARS, H5N1, MERS, Ebola, and Zika outbreaks combined.
Our findings regarding the proportion of industry-affiliated articles resonates with previous investigations, particularly in the sense that publicly funded research provides a platform from which industry can use applied research and commercialize. For example, one study  found NIH funding could be linked directly or indirectly to all 210 new drugs without exception that the FDA had approved between 2010–2016. Other studies have identified a link to public sector funding for 50–75% of new drugs [10, 12–13] and that as many as half of all industry patents cite prior art from public institutions [12, 14, 15].
This is not to understate the critical and substantive role of industry which has been estimated to provide two-thirds of the total investment in life sciences in the United States , but rather to underscore the importance of the upstream public contribution to understanding and treating disease that undergirds commercial innovation. As has been argued elsewhere , a possible learning from the COVID experience is that private industry responds to society’s health needs more readily when there is strong and unanimous public support; and when governments assume a proactive, substantial, and explicit role in driving the biomedical research agenda—leaving behind the market driven approach that had become status quo prior to COVID—the results are extraordinary, and more can (and should) be demanded from industry. For example, given our findings that the proportional output of publications by industry on COVID is low, there may be a need to heighten publication requirements for private industry operating with public support.
Our study is subject to certain limitations. First, while our study is as current as possible, only 14 months of data is available for COVID. There may well (and hopefully will be) a second and larger wave of industry-affiliated publications that will bring its level to be more commensurate with the experience of previous pandemics. Second, in contrast to industry, the primary responsibility of academics who largely work for public or non-profit institutions is to publish; therefore, it is unsurprising that industry publications represent a small fraction of such publications. For this reason, our study has focused upon to the proportionate experience of prior pandemics for establishing a reasonable benchmark from which to compare. Third, our investigation broadly focused upon the entire biomedical enterprise using a single, yet important repository of scientific publications. It is possible that by isolating subsets of publications—such as by intervention type (e.g., vaccines, diagnostics)—the proportion of industry-affiliated articles would be higher. However, this would be at the exclusion of the context of the broader ecosystem of knowledge and innovation which made these interventions possible in the first place. Finally, our analysis applies the most inclusive approach to industry participation: if even one author lists an industry affiliation, then the article is categorized as industry-affiliated. This may overstate the share of industry participation.
The absolute number of industry-affiliated scientific articles on COVID in the biomedical literature is unprecedented when compared to the previous experience of Ebola, H1N1, and Zika. However, the proportional share of industry-affiliated articles (versus non-industry-affiliated articles) on COVID is not. In fact, as of writing, its current level is extraordinarily low at below 2 percent, perhaps because the world has seen the most stunning mobilization of the biomedical innovation ecosystem in history. A possible learning that may emerge from the COVID pandemic in the long term is an appreciation for what can be achieved with a strong role for governments in driving innovation agendas and the advantages of this strategy over a market-driven model in which private industries are left to strategically respond to lower-risk business opportunities.
The authors are members of the Global1 Health Network (http://global1hn.ca), supported by grants from Canadian Institutes of Health Research, refs. NGR-167542 and 439801.
- 1. Heled Y, Rutschman AS, Vertinsky L. The problem with relying on profit-driven models to produce pandemic drugs. J Law Biosci. 2020;7(1):lsaa060–lsaa. pmid:32913653
- 2. Santos Rutschman A. The COVID-19 vaccine race: Intellectual property, collaboration (s), nationalism and misinformation. Washington University Journal of Law and Policy. 2020;64.
- 3. Inbar S. Big Pharma Is Fooling Us: New York Times; 2020 [Available from: https://www.nytimes.com/2020/12/17/opinion/covid-vaccine-big-pharma.html.
- 4. Robinson JC. Funding of Pharmaceutical Innovation During and After the COVID-19 Pandemic. JAMA. 2021;325(9):825–6. pmid:33443546
- 5. Sarpatwari A, Avorn J, Kesselheim AS. Accounting for US public funding in drug development: how can we better balance access, affordability, and innovation? BMJ. 2020;371:m3841. pmid:33032982
- 6. Wouters OJ, McKee M, Luyten J. Estimated Research and Development Investment Needed to Bring a New Medicine to Market, 2009–2018. JAMA. 2020;323(9):844–53. pmid:32125404
- 7. The Avorn J. $2.6 Billion Pill—Methodologic and Policy Considerations. New England Journal of Medicine. 2015;372(20):1877–9.
- 8. Sekar K. National Institutes of Health (NIH) Funding: FY1995–FY2021 2020 [Available from: https://fas.org/sgp/crs/misc/R43341.pdf.
- 9. Azoulay P, Graff Zivin JS, Li D, Sampat BN. Public R&D Investments and Private-sector Patenting: Evidence from NIH Funding Rules. The Review of Economic Studies. 2018;86(1):117–52. pmid:31662587
- 10. Zycher B, DiMasi JA, Milne CP. Private sector contributions to pharmaceutical science: thirty-five summary case histories. Am J Ther. 2010;17(1):101–20. pmid:20027102
- 11. Chakravarthy R, Cotter K, DiMasi J, Milne CP, Wendel N. Public- and Private-Sector Contributions to the Research and Development of the Most Transformational Drugs in the Past 25 Years: From Theory to Therapy. Ther Innov Regul Sci. 2016;50(6):759–68. pmid:30231735
- 12. Galkina Cleary E, Beierlein JM, Khanuja NS, McNamee LM, Ledley FD. Contribution of NIH funding to new drug approvals 2010–2016. Proceedings of the National Academy of Sciences. 2018;115(10):2329–34. pmid:29440428
- 13. Cockburn IM, Henderson RM. Publicly Funded Science and the Productivity of the Pharmaceutical Industry. Innovation Policy and the Economy. 2000;1:1–34.
- 14. Sampat BN, Lichtenberg FR. What are the respective roles of the public and private sectors in pharmaceutical innovation? Health Affairs. 2011;30(2):332–9. pmid:21289355
- 15. Kneller R. The importance of new companies for drug discovery: origins of a decade of new drugs. Nature reviews Drug discovery. 2010;9(11):867–82. pmid:21031002
- 16. PhRMA. Advocacy: Research and Development 2021 [Available from: https://www.phrma.org/advocacy/research-development.
- 17. PhRMA. The COVID-19 Vaccine Breakthroughs and the Work Ahead 2021 [Available from: https://www.phrma.org/en/Coronavirus.
- 18. IFPMA. COVID-19: Global biopharmaceutical industry commitment to address Coronavirus public health crisis 2021 [Available from: https://www.ifpma.org/covid19/.
- 19. Li D, Azoulay P, Sampat BN. The applied value of public investments in biomedical research. Science. 2017;356(6333):78–81. pmid:28360137
- 20. Ahmadpoor M, Jones BF. The dual frontier: Patented inventions and prior scientific advance. Science. 2017;357(6351):583–7. pmid:28798128
- 21. Fleming L, Greene H, Li G, Marx M, Yao D. Government-funded research increasingly fuels innovation. Science. 2019;364(6446):1139–41. pmid:31221848
- 22. Testoni FE, García Carrillo M, Gagnon M-A, Rikap C, Blaustein M. Whose shoulders is health research standing on? Determining the key actors and contents of the prevailing biomedical research agenda. PLOS ONE. 2021;16(4):e0249661. pmid:33826657
- 23. Chahrour M, Assi S, Bejjani M, Nasrallah AA, Salhab H, Fares M, et al. A Bibliometric Analysis of COVID-19 Research Activity: A Call for Increased Output. Cureus. 2020;12(3):e7357–e. pmid:32328369
- 24. Yu Y, Li Y, Zhang Z, Gu Z, Zhong H, Zha Q, et al. A bibliometric analysis using VOSviewer of publications on COVID-19. Annals of translational medicine. 2020;8(13):816–. pmid:32793661
- 25. Zyoud SeH Al-Jabi SW. Mapping the situation of research on coronavirus disease-19 (COVID-19): a preliminary bibliometric analysis during the early stage of the outbreak. BMC Infectious Diseases. 2020;20(1):561. pmid:32738881
- 26. Shamsi A, Mansourzadeh MJ, Ghazbani A, Khalagi K, Fahimfar N, Ostovar A. Contribution of Iran in COVID-19 studies: a bibliometrics analysis. Journal of Diabetes & Metabolic Disorders. 2020:1–10. pmid:32837958
- 27. Aristovnik A, Ravšelj D, Umek L. A bibliometric analysis of COVID-19 across science and social science research landscape. Sustainability. 2020;12(21):9132.
- 28. Fry CV, Cai X, Zhang Y, Wagner CS. Consolidation in a crisis: Patterns of international collaboration in early COVID-19 research. PloS one. 2020;15(7):e0236307. pmid:32692757
- 29. Haghani M, Bliemer MCJ. Covid-19 pandemic and the unprecedented mobilisation of scholarly efforts prompted by a health crisis: Scientometric comparisons across SARS, MERS and 2019-nCoV literature. Scientometrics. 2020;125(3):2695–726. pmid:32981988
- 30. Chaleplioglou A, Kyriaki-Manessi D. Comparison of Citations Trends between the COVID-19 Pandemic and SARS-CoV, MERS-CoV, Ebola, Zika, Avian and Swine Influenza Epidemics. arXiv preprint arXiv:200605366. 2020.
- 31. World Health Organization. Statement on the second meeting of the International Health Regulations (2005) Emergency Committee regarding the outbreak of novel coronavirus (2019-nCoV) 2020 [Available from: https://www.who.int/news-room/detail/30-01-2020-statement-on-the-second-meeting-of-the-international-health-regulations-(2005)-emergency-committee-regarding-the-outbreak-of-novel-coronavirus-(2019-ncov).
- 32. World Health Organization. Ebola outbreak in West Africa declared a public health emergency of international concern. 2014.
- 33. World Health Organization. Implementation of the International Health Regulations (2005)—Report of the Review Committee on the Functioning of the International Health Regulations (2005) in relation to Pandemic (H1N1) 2009 2011 [Available from: https://apps.who.int/gb/ebwha/pdf_files/WHA64/A64_10-en.pdf.
- 34. World Health Organization. WHO Director-General summarizes the outcome of the Emergency Committee regarding clusters of microcephaly and Guillain-Barré syndrome 2016 [Available from: https://www.who.int/en/news-room/detail/01-02-2016-who-director-general-summarizes-the-outcome-of-the-emergency-committee-regarding-clusters-of-microcephaly-and-guillain-barr%c3%a9-syndrome.
- 35. Research America. U.S. Investments in Medical and Health Research and Development 2019 [Available from: https://www.researchamerica.org/sites/default/files/Publications/InvestmentReport2019_Fnl.pdf.