Primary biliary cirrhosis (PBC) is a chronic liver disease characterized by intrahepatic bile-duct destruction, cholestasis, and fibrosis. It can lead to cirrhosis and eventually liver failure. PBC also shows some regional differences with respect to incidence and prevalence that are becoming more pronounced each year. Recently, researchers have paid more attention to PBC. To evaluate the development of PBC research during the past 11 years, we determined the quantity and quality of articles on this subject. We also compared the contributions of scientists from the US, UK, Japan, Italy, Germany, and China.
The English-language papers covering PBC published in journals from 2000 through 2010 were retrieved from the PubMed database. We recorded the number of papers published each year, analyzed the publication type, and calculated the accumulated, average impact factors (IFs) and citations from every country. The quantity and quality of articles on PBC were compared by country. We also contrasted the level of PBC research in China and other countries.
The total number of articles did not significantly increase during the past 11 years. The number of articles from the US exceeded those from any other country; the publications from the US also had the highest IFs and the most citations. Four other countries showed complex trends with respect to the quantity and quality of articles about PBC.
The researchers from the US have contributed the most to the development of PBC research. They currently represent the highest level of research. Some high-level studies, such as RCTs, meta-analyses, and in-depth basic studies should be launched. The gap between China and the advanced level is still enormous. Chinese investigators still have a long way to go.
Citation: Qin B, Liang Y, Yang Z, Zhong R (2012) Scientific Publications on Primary Biliary Cirrhosis from 2000 through 2010: An 11-Year Survey of the Literature. PLoS ONE 7(4): e35366. https://doi.org/10.1371/journal.pone.0035366
Editor: Robert S. Phillips, University of York, United Kingdom
Received: September 25, 2011; Accepted: March 15, 2012; Published: April 11, 2012
Copyright: © 2012 Qin et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This study was supported by two grants from the China National Natural Science Foundation Council (81001333 and 81072479). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Primary biliary cirrhosis (PBC) is an immune-mediated chronic liver disease characterized by intrahepatic bile-duct destruction, cholestasis, and fibrosis. It can lead to cirrhosis and eventually liver failure . The disease primarily affects women over 40 years of age (female preponderance (9–10∶1), although younger patients have been diagnosed, including children . According to reported data, a latitudinal geo-epidemiological pattern has been proposed to describe development of PBC . The disease is most common in northern Europe and North America, especially in Scandinavia, Great Britain, and the Northern Midwest region of the US. It is rarest in Australia. It has been suggested that the incidence of PBC is increasing over time. For example, in Sheffield, UK, the rates rose from 5.8 to 20.5 cases per million between 1980 to 1999 , . Antimitochondrial antibodies in the serum are a hallmark of PBC. Ursodeoxycholic acid (UDCA) is currently the only FDA-approved medical treatment for PBC. Liver transplantation is performed in patients with advanced or late-stage PBC. However, the limited number of donors has narrowed the application of liver transplantation, it has also posed large economic burdens on patients and government.
With the growing incidence of PBC and other emerging issues, the scientific communities of different countries have gradually attached more importance to this condition. Researchers attempt to understand the pathogenesis of PBC and to develop new diagnostic methods and remedies. However, the trends in the annual numbers of scientific publications and in the quality of research performed in different countries are not immediately clear. We analyzed English-language papers on PBC published in international journals over the past 11 years (2000.1.1–2010.12.31) and investigated the quantity and quality of articles from different regions.
In this retrospective study, we evaluated all articles related to PBC indexed in PubMed over the past 11 years. Our search Mesh term was “liver cirrhosis, biliary,” and searched within a specific date range (2000.1.1 and 2010.12.31) and publication language (English only). The information within all selected articles was drawn out independently by two investigators (BD Qin and Y Liang), who surveyed the titles, authors, abstracts, publication types, and other details. Discrepancies were resolved by review of the full text. The research output from different countries was determined using the first author's institutional affiliations. Impact factors (IFs) from 2000 to 2010 were determined using Thomson Reuters in ISI's Journal Citation Reports (JCR) . In addition, the number of citations of every article was calculated using the Web of Science of ISI Database.
First, the total annual number of articles and externally funded publications related to PBC were calculated. Second, the publication types of the articles were analyzed. These included basic research, clinical research, case reports, reviews, commentaries, and other types of articles. Third, the accumulated and average IFs, and citations of every article were calculated to permit comparison of the quality of the publications, which were mainly from the top five countries, ranked by the total number of articles produced during the past 11 years (See Flowchart S1).
Statistical analyses were performed using SPSS 18.0 software (IBM, New York, US), and statistical results are given in Tables and Figures. Results mostly show the trends and scientific contributions of different countries. The differences of contributions (including quantity and quality) to PBC by different regions were detected using the Kruskal-Wallis test, and the means were compared using one-factor ANOVA. The trends with respect to number of articles were analyzed via curvilinear regression. P values of less than 0.05 were considered significant. These were determined using two-tailed tests.
Total number of articles
From 2000 to 2010, a total of 1819 articles were published in the 389 journals indexed in PubMed. They were mainly from 52 countries. The number of articles published was largest in 2010 (205/1819) and least in 2009 (133/1819). However, the trend in annual number of articles published around the world fluctuated slightly and the number increased insignificantly from 2000 to 2010 (R2 = 0.023, P = 0.656). The number of externally funded articles exhibited the same trend as the total number of articles (R2 = 0.234, P = 0.131) (Fig. 1). The top five countries by number of articles were the US (22.9%, 417/1819), Japan (18.5%, 335/1819), UK (11.4%, 208/1819), Italy (8.0%, 145/1819), and Germany (5.4%, 99/1819). China (3.5%, 63/1819), including mainland China (35), Hong Kong (4), and Taiwan (24), ranked the seventh among the 52 countries. The growth in the annual number of published articles from these countries changed insignificantly, with the exception of China (R2 = 0.732, P = 0.001) (Fig. 2).
The number of published clinical studies was the largest, followed by basic studies, case reports, commentaries, and reviews (Fig. 3). Of all the 427 clinical studies, case-control studies occupied overwhelming share (66.98%), to which the authors from Japan, the US, and the UK made the main contributions. Japanese researchers published the most case reports, while US researchers conducted the most clinical trials (Fig. 4). However, there were only 38 RCTs in all 1819 articles. These were published by researchers from 11 countries. Although the number of RCTs was minor, there were still significant differences among the six countries (P<0.05), and the quantity of RCTs from the USA was found to be greater than those of other countries even though there were only 13 articles.
In accordance to the JCR, the 325 journals that published articles about PBC were indexed in SCI and had impact factors from 2000 to 2010, but 64 journals containing 91 articles had no impact factors. After excluding these 91 articles, we determined the impact factors of each one in its year of publication. Then we calculated the accumulated and average IFs of these countries. The annual total IFs from the US was significantly higher than those of other countries (P<0.05), and the four other countries showed complex trends and differed significantly despite the insignificant difference between the UK and Japan (P = 0.622)(Fig. 5). In addition, the average IFs were similar to above-mentioned results shown in Table 1, and the average IFs differed significantly among the six countries (P<0.05).
In the ISI database, we found the number of citations for every article and analyzed the total number of citations and the average citation rate from the top 5 countries and China. The results are shown in Figure 6. The US had 417 articles and 8334 citations. The UK had 208 articles and 3763citations, Japan had 335 articles and 3156 citations. Italy had 146 articles and 1558 citations. Germany had 99 articles and 1194 citations. China had 63 articles and 395 citations. These differences among these six countries were found to be significant (P<0.05). Papers from the US and UK had the greatest average number of citations (19.99 and 18.09), followed by Germany, Italy, and Japan (12.06, 10.67, and 9.45) (Fig. 7). Chinese papers had the fewer citations on average than papers from the above 5 countries.
Favorite and most high-impact medical journals
The most popular journals are listed in Table 2. Hepatology was the No. 1 journal with respect to number of articles about PBC, followed by J Hepatol, Am J Gastroenterol and Liver Int. Hepatology also appeared among the top four journals of the five countries. A total of 416 articles from 2000 to 2010 were published in the top five ranking sub-specialty medical journals, which included Hepatology, Gastroenterology, Gut, J Hepatol, and Am J Gastroenterol. Only 19 articles on PBC were published in the four leading general-medicine journals: NEJM, Lancet, JAMA, and BMJ. There were only 3 articles published in the top three basic medical journals (Nature: 2 articles, Science: 1 article, Cell: 0 articles).
This is, to our knowledge, the first study to analyze the distribution of English-language papers on PBC from 2000 to 2010, and it is also the first report to evaluate the quantity and quality of the top five countries as ranked by number of articles.
The present study shows that the total number of articles about PBC has not varied drastically. Although that number reached the peak in 2010, the rate of increase is not considerable. The trend in the annual number of articles has not shown any evident increase, probably because the studies on PBC have reached a bottleneck or found some kind of limiting factor. In addition, a total of 575 articles (31.6%) on PBC were found to have been externally funded, and the quality of funded studies was much higher with respect to both average IFs and number of citations (P<0.05). This suggests that societies and governments should pour more funds into PBC research.
Clinical studies made up a considerable proportion of the articles evaluated, but highly convincing RCTs were rare. Only 17 meta-analyses were published during the past 11 years, and they mainly evaluated the effects of therapy rather than risk factors, diagnostic criteria, or prevention. Although basic studies made up the second largest subgroup, only 3 of these articles were published in the top three journals. Therefore, the scientific levels of these basic studies are probably not high and need to be improved. Case reports mainly discussed specific symptoms and complications. Japanese researchers contributed the most case reports (28.2%). Researchers should consider summarizing and classifying these findings.
These five developed countries, the US, UK, Japan, Italy, and Germany, have been in the forefront of global scientific research for many years, and authors from these countries have contributed the most to PBC with respect to both quantity and quality of published articles. The US clearly leads other countries in research productivity (accounting for 22.9% of the total), with an annual number of articles exceeding any of the other countries in the past 11 years, except in 2000, 2001, and 2006. Japan followed the US, but the annual number of papers from Japan has shown a downward trend, reaching its lowest point in 2009. None of the three other countries surpassed the US or Japan in number of articles except in 2004. The ranking with respect to number of articles was the UK, Italy, and Germany in the third, fourth, and fifth places. In addition to the number of articles, US researchers have also written the papers of the highest quality (P<0.05), with the highest annual total and average IFs. There were no significant differences in annual total IFs between Japan and the UK, but the average IFs of articles from Japan were significantly lower than those from the UK (P<0.05). Italians have published more top-quality articles than Germans with respect to both annual total and average IFs. In addition to these five countries, Canada and France also showed advanced-level PBC research. Researchers from these two countries contributed 4 articles in NEJM (France: 3 articles, Canada: 1 article) during the past 11 years.
Citations are another indicator of publication quality, showing the degree to which the paper has been accepted by other authors in the same field. Articles from the US exceeded those of all other countries with respect to average number of citations (P<0.05) during the past 11 years, and the cumulative number of citations is also fairly high. The UK surpassed Japan with respect to total number of citations in 2003, which was similar to the relationship between Germany and Italy. In 2010, the ranking with respect to total number of citations was US, UK, Japan, Italy, and Germany.
In the present study, Hepatology (163 articles) was found to be the most popular journal (8.9%) for authors writing about PBC. It printed 71 articles from the US, most of which were written by the researchers from the University of California at Davis School of Medicine (Gershwin ME). This laboratory represents the most advanced level of PBC research, where the researchers make a profound contribution to development of the PBC knowledge base. A total of 416 articles were published in the five highest-impact hepatology and gastroenterology journals, three of which are the top three popular journals with respect to total number of PBC articles. However, Gut and Gastroenterology published fewer articles (41 articles in Gut, 46 articles in Gastroenterology). For the four leading medical journals, only 19 articles were (NEJM: 11 articles, Lancet: 6 articles, JAMA: 1article, BMJ: 1article). It can be seen from the above results that the number of PBC articles published in top journals is still relatively low.
Although China is ranked No. 7 with respect to total number of articles on PBC during the past 11 years, the number has shown a significant upward trend (R2 = 0.732, P = 0.001). The total number of citations of publications from China are still below the internationally advanced level, such as that observed in the five countries discussed in present study. However, the annual total IFs of articles has also increased each year, reaching a peak in 2007. The average IFs from China (3.651) surpassed Japan (2.971) and Germany (3.532), but it not to a statistically significant extent (P = 0.514 and P = 0.908). From the analysis of publication types, none of the RCT articles were written by researchers from China. With the increases in the number of PBC patients, Chinese researchers should launch more multicenter prospective studies and RCTs aimed at risk factors, diagnosis, complications, treatments, and prevention. In conclusion, the contribution of China to PBC research is less than that of the top five countries. Therefore, there is a lot of room for Chinese researchers to improve.
Actually, there may be some limitations in the literature. First, the six countries selected may not represent the status of all articles and may also not be representative of the international level of PBC research. However, these countries have produced 70% of the total number of English-language articles published during the past 11 years, which suggests that research in these countries is advanced. Second, we only retrieved English-language documents and passed over articles published in other languages. Although English is the international language of communication in academic fields and high-quality articles and journals are mainly published in English, there are still 290 (13.7%) articles related to PBC indexed in the PubMed database published in non-English languages during the past 11 years. These include 37 French papers, 48 German papers, 46 Japanese papers, 58 Chinese papers, 30 Spanish papers, 8 Italian papers and more. This may have affected the efficacy and accuracy of the current assessment of the development of PBC research around the world because some researchers may release articles on PBC in their own languages rather than in English. Third, it may not be appropriate or accurate to assess the quality of these articles using IFs . There are many inherent limitations to IFs as quantitative measurement tools. Only when citations are uniformly spread between articles can we use IFs to objectively evaluate the quality of individual articles. However, the non-parametric distribution of citations to articles lies at the heart of the problem with impact factors. Some journals include many useful articles, accounting for most of the total number of citations of journals . Moreover, document type can affect IF. Review papers attract more citations than original research papers . Original research papers, however, are the main engines that generate new knowledge, and so are the best representatives of research levels. In the present study, increases in the IFs of articles related to PBC may paradoxically reduce the overall influence of said research on the scientific community because fewer original research papers will be published. For the reasons given above, other metrics that assess the quality and quantity of citations have been proposed, such as the Eigenfactor Score and Article Influence Score, which must be taken into account when attempting to determine impact factor . However, Bollen et al. found that scientific impact is a multi-dimensional characteristic that cannot be adequately captured by one metric . Any single indicator may not accurately indicate the quality and impact of articles or academic journals. Despite its many at present unavoidable limitations, the journal impact factor is still the most commonly used indicator of the quality or at least the popularity of a given scientific journal.
In conclusion, the present study provides some useful information regarding scientific studies of primary biliary cirrhosis. US researchers have contributed the most to the development of PBC studies, and the country currently produces the highest level of PBC research. More RCTs, meta-analyses, and high-level basic studies should be carried out. Although the quantity and quality of articles written by Chinese scientists have increased every year, the gap between China and the advanced level in PBC research is still enormous.
Conceived and designed the experiments: BDQ YL ZXY RQZ. Performed the experiments: BDQ YL ZXY RQZ. Analyzed the data: BDQ YL ZXY RQZ. Contributed reagents/materials/analysis tools: BDQ YL ZXY RQZ. Wrote the paper: BDQ YL ZXY RQZ.
- 1. Kaplan MM, Gershwin ME (2005) Primary biliary cirrhosis. New England Journal of Medicine 353: 1261–1273.
- 2. Hohenester S, Oude-Elferink RP, Beuers U (2009) Primary biliary cirrhosis. Seminars Immunopathology 31: 283–307.
- 3. Selmi C, Invernizzi P, Zuin M, Podda M, Gershwin ME (2005) Genetics and geoepidemiology of primary biliary cirrhosis: following the footprints to disease etiology. Semin Liver Dis 25: 265–280.
- 4. Triger DR (1980) Primary biliary cirrhosis: an epidemiological study. British Medical Journal 281: 772–775.
- 5. Ray-Chadhuri D, Rigney E, MacComack K (2001) Epidemiology of PBC in Sheffield updated: demographics and relation to water supply. Gut 48: 42.
- 6. ISI Journal Citation Reports, Institute for Scientific Information. 29: Available: http://isiknowledge.com. Accessed 2010 Aug.
- 7. Saha S, Saint S, Christakis DA (2003) Impact factor: a valid measure of journal quality? Journal of the Medical Library Association 91: 42–46.
- 8. Weale AR, Bailey M, Lear PA (2004) The level of non-citation of articles within a journal as a measure of quality: a comparison to the impact factor. BMC Med Res Methodol 4: 14.
- 9. Seglen PO (1997) Why the impact factor of journals should not be used for evaluating research. BMJ 314: 498–502.
- 10. Rizkallah J, Sin D (2010) Integrative approach to quality assessment of medical journals using impact factor, eigenfactor, and article influence scores, PLos One 5: e10204.
- 11. Bollen J, Van de Sompel H, Hagberg A, Chute R (2009) A principal component analysis of 39 scientific impact measures.PLos One 4: e6022.