Tuberculosis (TB) research is a key component of the End TB Strategy. To track research output, we conducted a bibliometric analysis of TB research from the past decade.
The Web of Science database was searched for publications from January 2007 to December 2016 with “tuberculosis” in the title. References were analysed using the R bibliometrix package. A year-stratified 5% random subset was drawn to extract funding sources and identify research areas.
The annual growth rate of publications was 7.3%, and was highest (13.1%) among Brazil, Russia, India, China and South Africa (BRICS). The USA was the most productive country, with 18.4% of references, followed by India (9.7%), China (7.3%), England (6.5%), and South Africa (3.9%). In the subset analysis, the most common research area was ‘fundamental research’ (33.8%). Frequently acknowledged funders were US and EU-based, with China and India emerging as top funders. Collaborations appeared more frequently between high-income countries and low/medium income countries (LMICs), with fewer collaborations among LMICs.
Citation: Nafade V, Nash M, Huddart S, Pande T, Gebreselassie N, Lienhardt C, et al. (2018) A bibliometric analysis of tuberculosis research, 2007–2016. PLoS ONE 13(6): e0199706. https://doi.org/10.1371/journal.pone.0199706
Editor: Leonidas G. Koniaris, Indiana University, UNITED STATES
Received: March 9, 2018; Accepted: June 12, 2018; Published: June 25, 2018
Copyright: © 2018 Nafade et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: An EndNote library with all the citations that were included in this bibliometric analysis is available from this website: http://www.paitbgroup.org/.
Funding: This study was commissioned and funded by the World Health Organization (WHO) and WHO staff were involved in conceptualization and supervision of the project. This analysis was originally prepared as part of a policy paper released at the WHO global ministerial conference on ending tuberculosis in the sustainable development era, held in Moscow, Russia, in November 2017.
Competing interests: MP serves as a consultant to the Bill & Melinda Gates Foundation (BMGF), which had no involvement in this study or manuscript. MP serves on the Editorial Boards of PLOS Medicine & PLOS ONE. He is also a joint editor of the PLoS Tuberculosis Channel. This does not alter our adherence to PLOS ONE policies on sharing data and materials. None of the other authors have any competing interests to disclose.
Tuberculosis (TB) is the leading infectious disease killer, and the ninth cause of death worldwide . TB mortality has been falling by about 3% per year and incidence by 2%, but the majority of countries are not on track to meet the UN 2030 Sustainable Development Goal of ending the TB epidemic by 2030 . Modelling studies indicate that drastically reducing TB incidence will require new diagnostic tests, drugs, and vaccines . Accordingly, intensified research and innovation is one of the three pillars of the World Health Organization’s End TB Strategy , and the WHO has developed the Global Action Framework for TB Research to foster high-quality TB research for the period 2016 to 2025 at global and national levels .
While TB incidence and mortality are regularly estimated, it is more difficult to track the evolution of knowledge generation in the field. Bibliometric analysis is a tool that has been used widely to assess research productivity and growth in the health sciences; bibliometric analyses have been published in a wide variety of research fields, such as cancer , respiratory medicine , and public health [8,9]. By conducting a statistical analysis of citations, it is possible to examine trends in research output, countries of publication, and international collaborations. A bibliometric analysis of global TB research was last published in 2008, covering research from 1997 to 2006 . Since then, bibliometric analyses of drug-resistant TB , tubercular pleurisy , and spinal TB  have been published. Analyses of highly cited TB papers have also been published [14,15]. However, no bibliometric analysis of all TB research from 2007 onwards has been published.
Our study builds on the previous analysis of research from 1997 to 2006, and describes trends in TB research from the past decade, 2007 to 2016, through an assessment of the medical literature.
Our study aims to build on previous analyses and describe trends in TB research from the past decade, 2007 to 2016, through an assessment of the medical literature. Additionally, a random subset of articles was analysed to determine the most common areas of research and the most common sources of funding in TB research. Here we have focused on the bibliometric measures that illustrate the trajectory of TB research including which countries are producing TB research papers, the areas of research within the TB field and the major funders of this research.
We searched Web of Science on 19 July 2017 and searched for all references with ‘tuberculosis’ in the title. References published and indexed from 1 January 2007 to 31 December 2016 inclusive were included. The following information was obtained for each reference: reference type, title, journal, date of publication, author names and affiliations, and abstract.
A bibliometric analysis was performed on the full search results using the bibliometrix package in R . This package uses the meta-data in the Web of Science citations to calculate and rank country production, journal sources, and country collaborations. Country production was defined using the first author’s country. As a sensitivity analysis, a fractional authorship attribution for the paper’s country was applied where an equal fraction of the paper was counted toward each authors' country of affiliation. This authorship assignment scheme made no meaningful difference to the results and is not shown here. Using World Bank country classification for the 2018 fiscal year, countries were divided into low, middle and high-income strata (upper- and lower-middle income countries were classified as middle income). The author affiliation strings in the Web of Science citations were searched for the presence of countries named in each classification strata. The 5-year impact factor for the top journals was obtained from Web of Science.
Subset analysis of abstracts/full-text
Given the large numbers of references over a 10-year period, we decided to select a random subset of references to review abstracts and full-text articles. A year-stratified 5% random sample was drawn using a random number generator. This subset was screened for papers that were related to human Mycobacterium tuberculosis and were original research articles (i.e., not meeting abstracts, book chapters, narrative reviews, news items, editorial material and case reports/series). Systematic reviews/meta-analyses were included as original research. Data were extracted from these original research articles to determine year of publication, journal, study design, country of first author, and field-site country. The papers were then classified into one of the six research areas identified in the International Roadmap for TB Research , or into “other” if none of the six were appropriate. The six research areas are: fundamental research (or basic science), epidemiology, diagnostics, treatment, vaccines, and operational and public health. All screening and classification was performed independently by two authors (VN and MN), and any subsequent disagreements were resolved by consensus.
To identify sources of funding, the full text article was retrieved for the original research references and the names of all listed funding sources were extracted. Most frequently listed funders were identified overall and by research area. In the event that authors did not acknowledge funding sources in the article, or stated that no funding was received, the paper was excluded from the funding analysis.
The initial search returned 34,512 references (Fig 1). Overall, both publications and inter-country collaboration have increased, with BRICS countries experiencing the greatest increase. The average year-on-year increase in publications was 7.3%. This growth rate is higher than that found in a previous bibiliometric analysis  of the decade 1997 to 2006, but methodological variations might confound this observation. Publications were primarily from specialty journals focused on tuberculosis, respiratory disease, or infectious disease/microbiology (Table 1); of the top ten, only PLoS One (ranked second) was a general journal. The International Journal of Tuberculosis and Lung Disease was the journal with the most published citations.
Country of publication and growth rate
In total, 145 unique countries were represented across the full decade, with the top ten publishing countries listed in Table 2. The United States, despite having a very low incidence of TB, produced the most publications of any one country, with 18.4% of all references. Among the top five publishing countries, three were high-burden BRICS member countries: India, China, and South Africa. Of all publications in the last decade, 25.5% had first authors from BRICS countries, the yearly proportion having increased from 19.3% in 2007 to 30.7% in 2016 (Fig 2). The average year-on-year increase in publications was 13.1% for BRICS countries, nearly double that of the increase among all countries. Out of all the BRICS countries, India, the country with the highest TB burden, had the largest proportion of publications (9.7% of total references).
The collaboration analysis (Fig 3) demonstrates that collaborations have increased overall during the decade. Collaborations appear to be more frequent between high-income countries and LMICs; India, China, and South Africa collaborate often with the United States, but there are relatively few collaborations between the BRICS countries themselves.
Each diagram includes the top five publishing countries for that year. Each line between countries represents an article with an author from each country. Dense regions of each plot indicate numerous collaborations between the two countries, demonstrating that collaborations have increased throughout the decade.
The 5% subset analysis yielded 1,725 references (Fig 1). After excluding non-original research and articles without an abstract, 878 abstracts were screened by two independent reviewers. Table 3 lists the number of articles belonging to each research area by year. ‘Fundamental research’ and ‘epidemiology’ comprised the majority of articles, with 33.8% and 29.6% of articles respectively. No significant yearly trends were identified in any research area.
Epidemiology: epidemiological research related to the distribution and natural history of TB
Fundamental research: basic science and laboratory research
Diagnostics: research & development of new technologies for diagnosing all forms of TB.
Treatment: research & development of new drugs and new drug regimens for treating all forms of TB.
Vaccines: research & development of new vaccines and adjuvants for preventing TB.
Operational & PH research: operational and public health research to evaluate and improve TB control programmes and design effective interventions.
Other: research that could not be categorised into one of the six research areas.
Among the subset, 30.9% of papers did not acknowledge any funding sources in the full-text article. The average number of reported funders for all papers was 1.22, and the average number of funders for papers with at least one funder listed was 1.77. The five most frequent funders by research area are listed in Table 4. Overall, major funders are US- and EU- based: National Institutes of Health (NIH), United States Agency for International Development (USAID), and the European Commission. Chinese agencies also appear on the list, particularly the National Natural Science Foundation of China, which was second overall. The Bill & Melinda Gates Foundation was third overall and among the top five for the areas of fundamental research, diagnostics, and operational and public health. Industry funders were not frequently represented overall.
Our bibliometric analysis of TB research during the last decade shows a steady increase in TB publications. It is unsurprising that the USA had the most publications in our analysis, as it invests more in TB R&D than any other country . Our findings are consistent with the previous bibliometric analysis by Ramos et al., which found that though the USA published more than any other country, its relative annual proportion of articles declined from 24.1% in 1997 to 18.4% in 2006 . The trend of increased research output from BRICS countries is encouraging, as these five countries cumulatively account for 38% of the world’s notified TB cases .
BRICS countries–particularly India, South Africa, and China–have rapidly developing economies, and their domestic research capacity and impact on global health research appears to have increased accordingly . In fact, 46% of global funding for TB R&D in 2017 is in BRICS countries, although their spending on TB R&D still does not meet set targets . The identified proportion of governmental funding agencies from India and China in our funding analysis is consistent with this, and also with our finding that India and China are among the most productive countries in terms of publication number. Progress towards eliminating TB will require BRICS countries to sustain this observed increase in TB research, and ensure that research is also translated into effective policy.
The 5% sample size limits the generalisability of our results, particularly in the funding analysis where data were sparser, further decreasing the sample size and limiting interpretability of the funding results. Further, our analysis only determines the proportion of articles listing a particular funding agency as a source, and not the size of the financial contribution. The cost of one study is not equal across different types of studies. However, our results are in line with what is known about global funding for TB R&D; among TB research funding institutions, the NIH, USAID, and Bill & Melinda Gates Foundation have been top funders across the past decade .
Despite the increase in research output, our results suggest that collaborations among BRICS countries occur much less frequently than collaborations between a BRICS member and a high-income, low-burden nation such as the U.S. or U.K. As TB R&D in BRICS is primarily funded by domestic sources, these countries potentially have the capacity to collaborate without funding from high-income countries . While north-south collaborations allow for the sharing of valuable expertise as well as resources, the trend of increased collaboration overall will ideally be followed by one of increased collaboration among LMICs.
It is heartening to note that the Moscow Declaration to End TB called for WHO in collaboration with global partners, research organizations, donors, the scientific community and countries to consider developing a Global Strategy for TB Research taking into consideration ongoing and new efforts, such as the TB Research Network stated in the BRICS Leaders Xiamen Declaration . A TB Research Network by BRICS would go a long way in enhancing collaborations among these countries and harmonize research funding.
A major limitation of our study is that neither the bibliometric nor the subset analysis effectively capture the quality of publications. Our results indicated that most TB research is published in low to modest impact factor journals, but journal impact factor does not necessarily reflect the quality of an article . Previous attempts to capture article quality have also focused on citations; for example, an analysis of TB research in India from 1998 to 2009 analysed citations per paper for BRICS countries and found that articles from Brazil and South Africa received more citations on average than articles from India . As such, there was no effective measure of article quality in our analysis.
Another limitation is that the affiliation address of the first author does not necessarily reflect the country where the research was conducted, nor the originator of the research project. Especially in the case of collaborative papers, the principal investigator and source of funding may be in a different country than the first author. However, a sensitivity analysis using fractional authorship attribution did not significantly change our results. Further, Web of Science may capture fewer non-English publications than other databases such as PubMed . As a result, articles from English-speaking countries–which are primarily high-income and low-burden–may be overrepresented. Researchers in smaller countries with a lower research capacity may be more likely to publish in non-English journals that are only indexed in regional databases. Additionally, developing countries are often underrepresented in major medical journals .
The most cited articles were not examined in this analysis. We did not include this as detailed analyses of the 100 most cited studies  and 100 most cited systematic reviews  in TB research have been published in the last five years.
Publications related to TB have increased over the past decade, particularly among BRICS countries, though the U.S. and European countries remain a major source of publications and funding. International research collaborations have increased as well, though North-South collaborations remain more common than South-South collaborations. Our findings are consistent with previous bibliometric analyses in the field of TB research that have described overall growth in publications [10,11] and collaborations .
Our findings informed the recently published policy paper entitled “Global investments in Tuberculosis research and development: past, present and future,” published by WHO at the Global Ministerial Conference on Ending TB in the Sustainable Development Era, held in Moscow, Russia, on November 16–17, 2017 . It is expected that this report will advance the global TB research agenda, and contribute to the goals of the End TB Strategy.
This study was funded by the World Health Organization (WHO) and WHO staff were involved in conceptualization and supervision of the project. This analysis was originally prepared as part of a policy paper released at the WHO global ministerial conference on ending tuberculosis in the sustainable development era, held in Moscow, Russia in November 2017.
- 1. World Health Organization. Global Tuberculosis Report 2017 [Internet]. World Health Organization 2017 [cited 2017 Nov 14]. Available from: http://apps.who.int/iris/bitstream/10665/259366/1/9789241565516-eng.pdf?ua=1
- 2. Abajobir AA, Abate KH, Abbafati C, Abbas KM, Abd-Allah F, Abdulkader RS, et al. Measuring progress and projecting attainment on the basis of past trends of the health-related Sustainable Development Goals in 188 countries: an analysis from the Global Burden of Disease Study 2016. The Lancet. 2017;390(10100):1423–59.
- 3. Dye C, Glaziou P, Floyd K, Raviglione M. Prospects for Tuberculosis Elimination. Annual Review of Public Health. 2013;34(1):271–86.
- 4. World Health Organization. Global strategy and targets for tuberculosis prevention, care and control after 2015 [Internet]. World Health Organization 2015 [cited 2017 Nov 14]. Available from: http://www.who.int/tb/strategy/End_TB_Strategy.pdf?ua=1
- 5. World Health Organization. A global action framework for TB research in support of the third pillar of WHO’s end TB strategy [Internet]. World Health Organization 2015 [cited 2017 Nov 14]. Available from: http://www.who.int/tb/publications/global-framework-research/en/
- 6. Glynn RW, Chin JZ, Kerin MJ, Sweeney KJ. Representation of cancer in the medical literature—a bibliometric analysis. PloS ONE. 2010;5(11):e13902. pmid:21085482
- 7. Michalopoulos A, Falagas ME. A bibliometric analysis of global research production in respiratory medicine. Chest. 2005;128(6):3993–8. pmid:16354871
- 8. Soteriades ES, Falagas ME. A bibliometric analysis in the fields of preventive medicine, occupational and environmental medicine, epidemiology, and public health. BMC Public Health. 2006;6.
- 9. Badenhorst A, Mansoori P, Chan KY. Assessing global, regional, national and sub-national capacity for public health research: a bibliometric analysis of the Web of Science (TM) in 1996–2010. Journal of Global Health. 2016;6(1).
- 10. Ramos JM, Padilla S, Masia M, Gutierrez F. A bibliometric analysis of tuberculosis research indexed in PubMed, 1997–2006. International Journal of Tuberculosis and Lung Disease. 2008;12(12):1461–8. pmid:19017458
- 11. Sweileh WM, AbuTaha AS, Sawalha AF, Al-Khalil S, Al-Jabi SW, Zyoud SH. Bibliometric analysis of worldwide publications on multi-, extensively, and totally drug—resistant tuberculosis (2006–2015). Multidisciplinary Respiratory Medicine. 2016;11:45. pmid:28096979
- 12. Ye H, Li QF, Kasanga M, Lin DJ. Bibliometric analysis of tuberculosis pleurisy based on web of science. Biomedical Research-India. 2017;28(7):3322–7.
- 13. Wang YR, Wang QJ, Zhu RB, Yang CW, Chen ZQ, Bai YS, et al. Trends of spinal tuberculosis research (1994–2015): A bibliometric study. Medicine. 2016;95(38).
- 14. Chen LM, Liu YQ, Shen JN, Peng YL, Xiong TY, Tong X, et al. The 100 top-cited tuberculosis research studies. The International Journal of Tuberculosis and Lung Disease. 2015;19(6):717–22. pmid:25946366
- 15. Zhang Y, Huang J, Du L. The top-cited systematic reviews/meta-analyses in tuberculosis research: A PRISMA-compliant systematic literature review and bibliometric analysis. Medicine. 2017;96(6):e4822. pmid:28178120
- 16. Aria M, Cuccurullo C. bibliometrix: An R-tool for comprehensive science mapping analysis. Journal of Informetrics. 2017;11(4):959–75.
- 17. World Health Organization and Stop TB Partnership. An international roadmap for tuberculosis research. Geneva: World Health Organization; 2011. Available from: http://www.stoptb.org/global/research/pandp.asp/.
- 18. Frick M. 2016 Report on Tuberculosis Research Funding Trends, 2005–2015: No Time To Lose. Treatment Action Group 2017 [cited 2017 Nov 14]. Available from: http://www.treatmentactiongroup.org/sites/default/files/TB_FUNDING_2016_WEB.pdf
- 19. Bai J, Li W, Huang YM, Guo Y. Bibliometric study of research and development for neglected diseases in the BRICS. Infectious Diseases of Poverty. 2016;5.
- 20. World Health Organization. Moscow Declaration to End TB. World Health Organization 2017 [cited 2017 Nov 27]. Available from: http://www.who.int/tb/features_archive/Moscow_Declaration_to_End_TB_final_draft_ENGLISH.pdf?ua=1
- 21. Garfield E. The history and meaning of the journal impact factor. Jama. 2006;295(1):90–3. pmid:16391221
- 22. Gupta BM, Bala A. Mapping of Tuberculosis Research in India: A Scientometric Analysis of Publications Output during 1998–2009. COLLNET Journal of Scientometrics and Information Management. 2011;5(1):33–51.
- 23. Sumathipala A, Siribaddana S, Patel V. Under-representation of developing countries in the research literature: ethical issues arising from a survey of five leading medical journals. BMC Medical Ethics. 2004;5:E5. pmid:15461820
- 24. World Health Organization. Global Investments in Tuberculosis Research and Development: Past, Present, and Future [Internet]. World Health Organization 2017 [cited 2017 Nov 27]. Available from: http://www.who.int/tb/publications/2017/Global_Investments_in_Tuberculosis_Research_Investment/en/