Conceived and designed the experiments: DEK MEF. Performed the experiments: MEF. Analyzed the data: DEK MEF VK TAS IDG. Wrote the first draft of the manuscript: DEK. Data acquisition: VK TAS IDG. Critically revised the manuscript: MEF VK TAS IDG. Approved the final version of the manuscript for publication: DEK VK TAS IDG MEF.
The authors have declared that no competing interests exist.
The impact factors of biomedical journals tend to rise over time. We sought to assess the trend in the impact factor, during the past decade, of journals published on behalf of United States (US) and European scientific societies, in four select biomedical subject categories (
We identified all journals included in the above-mentioned subject categories of Thomson Reuters Journal Citation Reports® for the years 1999, 2002, 2005, and 2008. We selected those that were published on behalf of US or European scientific societies, as documented in journal websites.
We included 167 journals (35 in the subject category of
Journals published on behalf of European scientific societies, in select biomedical fields, may tend to close the “gap” in impact factor compared with those of US societies.
The impact factors of biomedical journals tend to rise through years. The leading positions in productivity in biomedical research are held by developed countries, including those from North America and Western Europe.
The journals from European biomedical scientific societies tended, over the past decade, to increase their impact factor more than the respective US journals.
The most commonly used indicator of the quality or at least the popularity of scientific journals is the journal impact factor, which is not however exempt of some limitations
In this context, we sought to evaluate the trends in the impact factor of journals published on behalf of United States (US) and European biomedical scientific societies during the past 10 years.
We did a retrospective analysis of journal impact factors provided by Thomson Reuters Journal Citation Reports® for the last 10-year period (1999–2008). We focused on 2 biomedical scientific fields, Biology and Medicine and selected two subject categories (as classified in the above-mentioned database) from each field. Specifically, we selected
We retrieved all journals by name and International Standard Serial Number (ISSN) that were indexed in the above 4 subject categories of Journal Citation Reports,® for the years 1999, 2002, 2005, and 2008. To identify the journals that were published on behalf of scientific societies or professional organizations we searched in the official website of each of the retrieved journals for relevant information. We selected for inclusion the journals representing US or European scientific societies; the European countries of interest were specifically the first 15 ones to participate in the European Union (EU-15). Journals representing international scientific societies were excluded.
We extracted the impact factors of each of the included journals for the years 1999, 2002, 2005, and 2008. We grouped these data into separate variables for the US and European journals, respectively. We calculated the median value for the journal impact factor in each category and plotted graphically the temporal trends for the studied period. Journals that had an impact factor for any one of the above-mentioned years were included in this analysis.
We additionally calculated for each of the included journals the percentage change in the impact factor between 2002 and 1999, 2005 and 2002, 2008 and 2005, and finally between 2008 and 1999. Only journals that had an impact factor for both years in regard could be included in this analysis. We grouped these data into separate variables for the US and European journals and the years in regard. We assessed for statistical differences between the above variables. Our primary comparison was the difference in the percentage change in the impact factor between the US and European journals from 1999 to 2009. We used the independent samples t-test statistic for this comparison; a p-value less than 0.05 was considered as statistically significant.
The 4 subject categories of our interest
Subject category | Region | ||
|
|
|
|
Biology | 16 | 19 |
|
Cell Biology | 40 | 39 |
|
Critical Care Medicine | 19 | 8 |
|
Infectious Diseases | 8 | 18 |
|
|
|
|
|
Abbreviations: EU: European Union; US: United States.
In
The fitted line represents the temporal trend in the median impact factors.
In
Period/Region | Number of journals | Percentage change in the IF (mean ± SD) | P-value for IF change (US vs EU) |
|
|||
US | 65 | 7.2±42.9% | 0.09 |
EU | 61 | 22.9±60.1% | |
|
|||
US | 71 | 12.0±31.8% | 0.06 |
EU | 68 | 24.4±44.7% | |
|
|||
US | 70 | 32.1±79.5% | 0.36 |
EU | 69 | 22.2±44.7% | |
|
|||
US | 59 | 39.7±70.0% |
|
EU | 56 | 73.7±110.0% |
Abbreviations: IF: impact factor; EU: European Union; SD: standard deviation; US: United States.
The main finding of our study is that the impact factor of journals published by European scientific societies rose more than that of journals published by US ones, in cumulatively 4 select subject categories, in the fields of Medicine or Biology, over the past decade. However, considerable variability was observed in this regard between journals in specific subject categories; the difference in the rise of the impact factor between European and US journals was particularly seen in the medical subject categories (
The difference in favor of the European journals regarding the degree of change in the impact factor appeared less pronounced when the median impact factor of each subject category was analyzed than when the percentage change in the impact factor of the journals included in each category was analyzed. In the first analysis, all journals that had an impact factor for at least one of the studied years were included, in contrast with the second, in which only journals that had an impact factor for both the initial and the final year compared were included. The latter analysis plausibly refers to journals with substantial tradition and influence; those with a low and declining impact factor could instead have been left out of the Journal Citation Reports® database.
A potential explanation for the relatively high increase in the impact factor of European Journals could lie in the role of the funding for research. Over the past decade, the European Union has given greater value than before on research funding, by allocating more financial resources, organizing better the process of the allocation of resources, and favoring scientific collaboration within the European Union
There are various factors, however, that can influence the impact factor of scientific journals
Our study findings may be of interest to the individual researchers for deciding to what journal they should submit their work for publication. There is an important time lag between article submission, publication, and assignment of the journal impact factors for the specific year
Our study has several potential limitations. First, it is limited to journals of 4 subject categories, two in Biology and two in Medicine. Although the biological subject categories evaluated can be considered as potentially representative of the whole field, it might not be so for the medical ones. Moreover, there was difference in our study findings between the subject categories evaluated. Other studies have also shown that the scientific contribution of researchers from different countries can differ by the discipline examined
We also limited our analysis to journals published on behalf of scientific societies. This has inevitably decreased the sample size we analyzed. Yet, we elected to include only the above-mentioned type of journals, as the identity of other types of journals with regard to geographical origin can be more difficult to establish with accuracy. Some bibliographic databases include such information, which is easy to retrieve, but it mostly reflects the country that the publisher of the journal is legally based in, rather than the origin of the scientific board of the journal. The journals published on behalf of scientific societies can, to our view, reflect more accurately the research productivity in each region.
Finally, our findings should be interpreted in the context of the well-discussed limitations of the journal impact factor as an indicator of the quality of scientific journals. Several scientists consider that this indicator could primarily reflect journal popularity rather than quality.
In conclusion, our study indicates that the journals that were published on behalf of European scientific societies in 4 select biomedical subject categories tended, over the past decade, to increase their impact factor more than the respective US journals. This finding varied considerably between the 4 subject categories examined. Our analysis cannot however reflect the entire scientific fields of Biology and Medicine. Our findings could be interpreted as potentially indicative of an effort of the European Union to close the ‘gap’ in research productivity with the US.