Skip to main content
Advertisement
  • Loading metrics

Why ONE Is More Than 5

PLoS ONE is five years old this month. Though still young in age, the journal has grown up remarkably rapidly, to the extent that it is now the largest peer-reviewed journal in the world. In the past five years, it has both garnered huge respect and support from authors, readers, and editors, and drawn the criticism and ire of many commercial publishers and establishment figures still fighting to maintain the science publishing status quo. Their fight now appears to be in vain, however: this past year a series of journals emerged that are very similar in scope to PLoS ONE (Table 1), suggesting that the landscape of scholarly publishing has irreversibly shifted. PLoS ONE clearly fills an unmet need in the world of scientific publishing, or publishers and scholarly societies wouldn't want to copy it.

thumbnail
Table 1. A sample of recently launched journals similar in scope to PLoS ONE.

https://doi.org/10.1371/journal.pbio.1001235.t001

The success of PLoS ONE has surprised even us. The journal is now publishing about 70 papers a day (i.e., currently around 4,000 papers every quarter), and this figure continues to grow (Figure 1). If the trend continues, it will publish 14,500 articles in 2011: approximately 1 in 60 of all the papers indexed by PubMed in that calendar year will have been published in PLoS ONE. It has even attracted a new term—“megajournal”—to characterize it and the other journals of its ilk [1].

thumbnail
Figure 1. Publication growth of PLoS ONE.

This is provided as the number of publications each quarter year since the last quarter of 2006, when PLoS ONE was launched.

https://doi.org/10.1371/journal.pbio.1001235.g001

We believe its success relies on two features: trust and innovation. By demonstrating that open access (OA) is compatible with high quality and rigorous science, PLoS Biology, then PLoS Medicine and the PLoS “Community Journals” (PLoS Genetics, PLoS Computational Biology, PLoS Pathogens, and PLoS Neglected Tropical Diseases) built a “PLoS brand,” making PLoS a trusted source of excellent science that authors and readers respect. As a result, PLoS could introduce a single key innovation beyond that of OA—one that represented a fundamental change to the traditional editorial model (and which has garnered awards from the Association of Learned and Professional Publishers [2] and the Scholarly Publishing and Academic Resources Coalition [3]). All articles in PLoS ONE are peer reviewed, but editors and reviewers are explicitly asked not to assess the “broad interest” or importance of a paper, a criterion that provides the rationale for other journals to reject articles. Instead, any article can be published if it is technically sound, ethically and appropriately reported, and its conclusions are supported by the data. Thus, PLoS ONE publications include negative results, methods papers, and studies that replicate (but do not duplicate) others, as well as articles that potentially represent a major advance for the field. And because PLoS ONE covers all of science (albeit with a current focus on the life and medical sciences), and because the publication fee ensures that each article covers its own editorial and production costs, there is no limit to PLoS ONE's potential size beyond that of science itself [4].

Growing Up: Responsibilities and Challenges

With size, however, come responsibilities and challenges [4]. A fundamental responsibility is to ensure that peer review is appropriately rigorous, regardless of subject area. Training and managing a growing editorial board of more than 2,500 academic editors from very diverse fields and cultures to oversee this process represents one of the ongoing challenges for PLoS ONE. This challenge is especially acute if these editors have been trained, by their prior activities in more traditional journals, to feel that part of their role is to increase a journal's impact factor by rejecting papers that they feel are not sufficiently novel or exciting (something that PLoS ONE explicitly does not attempt to do). Another responsibility is to ensure that basic standards of reporting are high. For example, each article must have appropriate ethical approval for the work carried out (be it on humans or animals), and authors and editors are asked to declare any financial or other competing interests (which are then made transparent both to the reviewers and to readers on any published article). Indeed, by publishing so many papers, PLoS ONE has an opportunity to help set reporting standards in science rather than follow existing ones. (Some countries and institutions, for example, have no independent ethical committee overseeing animal studies; although assessed on a case-by-case basis, such papers are generally rejected.) Every article submitted to PLoS ONE, therefore, goes through a series of rigorous checks to ensure that appropriate standards have been met, before an academic editor or reviewer even sets eyes on the paper.

The Post-Publication Dawn?

The greatest challenge now, not just for PLoS ONE but for all OA publications, is not what happens to the article before it is published but what happens once it reaches the public domain. It seems almost bizarre to think that publishers traditionally felt their job finished once the paper was published and archived. With changing technology and social media, publication is now just the beginning of an article's “life.” This is where new opportunities to serve and advance science lie and why it is so important to ensure papers—and the data associated with them—are OA, i.e., not just free to read but free to reuse [5].

PLoS ONE and the other megajournals are giant OA content generators. But although PLoS ONE publishes more than 1,300 papers a month, it doesn't yet organize this massive content beyond allowing navigation by (author selected) subject categories. And although searching for articles is made easier by using PLoS's faceted search [6] or resources such as PubMed [7], we know that the audience comprises not just research scientists, but policy makers, health officials, educators, journalists, and the curious reader, all of whom will have different needs in terms of how they navigate and discover content. Moreover, no reader is interested in the content of only one journal, no matter how big; they want to reuse information regardless of its source. The question now is whether the content can not only be structured to cater to different communities, but also satisfy the needs of each individual and even enable them to generate new questions or discover novel avenues of research.

A very straightforward way to organize content is to package relevant articles into subject-specific collections. PLoS has a range of collections covering papers from all their journals (e.g., in PLoS ONE [8]), some of which are the outcome of specific conferences or projects (such as the Census of Marine Life [9]). Another solution is to provide “hubs” of activity around certain topics. One such initiative, still in the early stages of development, is the PLoS Biodiversity Hub [10], funded by the Sloan Foundation, which allows individuals from the community (curators) to select and filter articles, regardless of the venue, and which can be enhanced by comments from curators and via semantic linking.

It is likely, however, that the solution will not be to provide only pre-packaged platforms of content for readers to come and browse but to give individuals the tools to create their own personalized “hub” and to use, reuse, and track research in any direction they wish. There is a growing list of innovative research aids, such as Mendeley [11], which already enables you to organize your reference library and PDFs and to find others with similar interests; publishers would then just need to incorporate these as part of an article-level service. To help with this, PLoS and Mendeley recently launched a “binary battle” to build software applications (apps) that make science more open and useful for the reader using the application programming interface (API) provided by PLoS and/or Mendeley [12]. The possibilities, therefore, are limited only by imagination, and the next few years are likely to provide an exciting period of experimentation with different navigation tools.

Alternative Thinking

In such a post-publication world, where greater emphasis is put on the article and its content rather than on the journal in which it happened to be published, how can you identify which papers and resources are more important for your work than others? Relying on the journal's Impact Factor to tell you about the merits of an individual paper is inappropriate [13],[14]. PLoS ONE, for example, has some papers that have received more than 200 citations, while 20% of articles one year or older have received more than nine citations and 76% one or more, a pattern of variation that will be familiar to all journals. By studying the citations to the individual articles, rather than a journal-level metric, a reader can understand in a much more nuanced way the research impact of that article. But impact also takes many different forms, some unmeasurable [14]. An article published in 2008 by PLoS Medicine, for example, provided a “Dirty War Index” [15], which has been adapted for use in NATO military environments, such as Southern Afghanistan, to reduce the possibility of injuring Afghan civilians. The approach has led to NATO changing procedures [16]. How can citations or downloads ever reflect this impact?

PLoS therefore provides a range of metrics [17] with each article in all the PLoS journals (which can be accessed via the “Metrics” tab on the online version). These include traditional parameters, such as the number of times an article is downloaded and how often it is cited (as recorded by different databases such as the Web of Science [18] and Scopus [19]) but also whether it has been bookmarked (e.g., by CiteULike [20]). The data about downloads and citations are also available under our OA license for anyone to download and analyze.

We have purposely provided an array of metrics because there is no one metric that can yet capture the different value readers place on articles. Moreover, this field is moving fast. An obvious addition might include how often and how soon an article is mentioned on Twitter or Facebook. But others are coming up with more innovative ideas. Several of the top “10+1” apps, shortlisted in the PLoS/Mendeley binary battle [12], for example, are about measuring the impact of articles or researchers.

The Open-Access Ecosystem

The transition to sophisticated navigation and data extraction tools and alternative metrics will enhance all open-access articles to the benefit of science and scientists. Of more immediate concern, however, is that open-access publications still represent only about 8% of scientific publications [21]. This is going to change, not least because the new swath of recently launched OA megajournals will dramatically increase the market share. Such competition is good for OA and good for PLoS ONE, as it will promote innovation in the services that OA publishers provide to authors and readers, and help ensure that users get the best value from these services.

PLoS ONE turning 5 is an important milestone, but what is much more significant is the effects of PLoS ONE (and other successful OA journals) on the entire OA ecosystem and the future of publishing [22],[23]. And PLoS ONE wouldn't have achieved this without the pioneering authors who first published in PLoS Biology and the other PLoS journals, and the authors and editors who volunteered for the PLoS ONE experiment. Happy Birthday to all those who made and continue to make PLoS ONE happen.

References

  1. 1. Patterson M (2011) Open-access megajournals – find out more in Estonia. The official PLoS Blog. Available: http://blogs.plos.org/plos/2011/06/open-access-megajournals-%E2%80%93-find-out-more-in-estonia/. Accessed 22 November 2011.
  2. 2. ALPSP (Association of Learned and Professional Society Publishers) (2009) ALPSP Awards Winners Announced. Available: http://www.alpsp.org/ngen_public/article.asp?aid=97909. Accessed 22 November 2011.
  3. 3. SPARC (2011) SPARC Innovator: PLoS ONE. Available: http://www.arl.org/sparc/innovator/. Accessed 22 November 2011.
  4. 4. Binfield P (2011) OA Mega Journals: The view from PLoS ONE. Available: http://www.youtube.com/watch?v=N4N7ogyz4o4&feature=youtube_gdata_player. Accessed 20 November 2011.
  5. 5. Carroll M. W (2011) Why Full Open Access Matters. PLoS Biol 9(11): e1001210.
  6. 6. PLoS ONE Advanced Search. Available: http://www.plosone.org/search/advancedSearch. Accessed 20 November 2011.
  7. 7. PubMed, NCBI. Available: http://www.ncbi.nlm.nih.gov/pubmed/. Accessed 20 November 2011.
  8. 8. PLoS Collections: Article collections published by the Public Library of Science. Available: http://www.ploscollections.org/static/poneCollections.action. Accessed 20 November 2011.
  9. 9. Census of Marine Life: A Decade of Discovery. Available: http://www.coml.org/. Accessed 19 November 2011.
  10. 10. PLoS Biodiversity Hub. Available: http://hubs.plos.org/web/biodiversity/jsessionid=FE19B1880629F999D97140A5AF9F3160. Accessed 20 November 2011.
  11. 11. Mendeley: Free reference manager and PDF organizer. Available: http://www.mendeley.com/. Accessed 20 November 2011.
  12. 12. Mendeley Developers PortalThe Mendeley API Binary Battle. Available: http://dev.mendeley.com/api-binary-battle/. Accessed 20 November 2011.
  13. 13. Patterson M (2009) PLoS Journals – measuring impact where it matters. The Official PLoS Blog. Available: http://blogs.plos.org/plos/2009/07/plos-journals-measuring-impact-where-it-matters/. Accessed 19 November 2011.
  14. 14. Neylon C, Wu S (2009) Article-Level Metrics and the Evolution of Scientific Impact. PLoS Biol 7: e1000242.
  15. 15. Hicks M. H-R, Spagat M (2008) The Dirty War Index: A Public Health and Human Rights Tool for Examining and Monitoring Armed Conflict Outcomes. PLoS Med 5: e243.
  16. 16. Hicks M (2010) First application of the Dirty War Index: CBDARs in Southern Afghanistan. [Comment on Hicks MH-R, Spagat M (2008) The Dirty War Index: A Public Health and Human Rights Tool for Examining and Monitoring Armed Conflict Outcomes. PLoS Med 5(12): e243.
  17. 17. Article Level Metrics. Available: http://article-level-metrics.plos.org/. Accessed 22 November 2011.
  18. 18. Thomson Reuters. Web of Science. Available: http://thomsonreuters.com/products_services/science/science_products/a-z/web_of_science/. Accessed 20 November 2011.
  19. 19. Scopus. Welcome to Scopus. Available: http://www.scopus.com/home.url. Accessed 22 November 2011.
  20. 20. CiteULike. Everyone's library. Available: http://www.citeulike.org/. Accessed 20 November 2011.
  21. 21. Laakso M, Welling P, Bukvova H, Nyman L, Björk B-C, et al. (2011) The development of open access journal publishing from 1993 to 2009. PLoS ONE 6: e20961.
  22. 22. Lewis D. W (2011) The Inevitability of Open Access. College & Research Libraries [abstract]. Available: http://crl.acrl.org/content/early/2011/09/21/crl-299.abstract. Accessed 22 November 2011.
  23. 23. Peter Binfield at the Stanford Summit @ Medicine 2.0 (2011) Available: http://www.youtube.com/watch?v=D0Iguwaj6pQ&feature=youtube_gdata_player. Accessed 20 November 2011.