Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Women’s representation as authors of retracted papers in the biomedical sciences

  • Ana-Catarina Pinho-Gomes ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Visualization, Writing – original draft, Writing – review & editing

    a.pinho-gomes@imperial.ac.uk

    Affiliations The George Institute for Global Health, Imperial College London, London, United Kingdom, Institute of Health Informatics, University College London, London, United Kingdom

  • Carinna Hockham,

    Roles Conceptualization, Project administration, Writing – review & editing

    Affiliation The George Institute for Global Health, Imperial College London, London, United Kingdom

  • Mark Woodward

    Roles Methodology, Supervision, Writing – review & editing

    Affiliations The George Institute for Global Health, Imperial College London, London, United Kingdom, The George Institute for Global Health, University of New South Wales, Sydney, New South Wales, Australia

Abstract

Women are under-represented among authors of scientific papers. Although the number of retractions has been rising over the past few decades, gender differences among authors of retracted papers remain poorly understood. Therefore, this study investigated gender differences in authorship of retracted papers in biomedical sciences available on RetractionWatch. Among 35,635 biomedical articles retracted between 1970 and 2022, including 20,849 first authors and 20,413 last authors, women accounted for 27.4% [26.8 to 28.0] of first authors and 23.5% [22.9 to 24.1] of last authors. The lowest representation of women was found for fraud (18.9% [17.1 to 20.9] for first authors and 13.5% [11.9 to 15.1] for last authors) and misconduct (19.5% [17.3 to 21.9] for first authors and 17.8% [15.7 to 20.3] for last authors). Women’s representation was the highest for issues related to editors and publishers (35.1% [32.2 to 38.0] for first authors and 24.8% [22.9 to 26.8] for last authors) and errors (29.5% [28.0 to 31.0] for first authors and 22.1% [20.7 to 23.4] for last authors). Most retractions (60.9%) had men as first and last authors. Gender equality could improve research integrity in biomedical sciences.

Introduction

Peer reviewed papers are retracted when they are considered an invalid source of scientific knowledge and, hence, should be completely removed from the scientific record. According to the Committee on Publication Ethics (COPE) [1], papers should be retracted in the following circumstances: (i) clear evidence for misconduct or honest error; (ii) duplicate publication without proper reference; (iii) plagiarism; and (iv) unethical research. Despite the proposal of the COPE, there is no consensual definition of retraction and the terms retraction, correction, withdrawal, removal, expression of concern, erratum, and corrigendum are often used interchangeably. Although the reasons for retraction are not always clear, they are often provided by retraction notices. According to a previous study, the most common reason for retraction is research misconduct (i.e., fabrication, falsification, or plagiarism), which accounts for about 60% of retractions [2]. Most retractions (about 60%) are initiated by author(s) followed by editors (about 20%), publishers (about 15%), journals (about 5%), and institutions (less than 1%) [3].

Although retractions are rare, their absolute number and relative proportion of published papers have been increasing over the past two decades [4, 5]. In the biomedical literature, the number and proportion of retractions by year increased between 1980 and 2014 (particularly after 2004) and declined after 2015 [4]. Current estimations for the proportion of retractions are about 4 in 10,000. However, the proportion of retractions varies by publisher, with high impact journals having the highest retraction rates [3]. The cause for this recent rise in retractions is not clear but it seems to be the effect of growing scientific integrity, rather than growing scientific misconduct [6]. Evidence suggests that researchers and journal editors have become more aware of and more proactive about scientific misconduct, without a true increase in cases of fraud.

The underrepresentation of women among authors of scientific papers, particularly in biomedical sciences, has been well documented [7]. Furthermore, the gender gap is larger for last authors than for first authors, thus reflecting the cumulative disadvantage experienced by women in academia and research [8]. Less attention has been dedicated to gender inequalities in retractions of scientific papers. Considering the rise in retractions over the past decades, it is germane to investigate whether gender differences are replicated among authors of retracted papers, overall and for specific reasons [3]. Although gender differences in retractions have been previously identified [9], this study was restricted to papers published in 2016 and included a small sample, which limited its ability to draw meaningful conclusions, particularly regarding reasons for retraction. Therefore, the aim of this study was to reliably estimate the representation of women among authors of retracted papers in biomedical sciences, overall and by reason of retraction, using a large database.

Methods

We used a database of retracted papers curated by RetractionWatch [10]. This is the largest, most comprehensive database of retracted papers across multiple scientific fields. It was launched in 2010 and is continuously updated by pulling retractions from existing databases, such as PubMed, or publishers’ sites. We were provided with a bespoke dataset comprising 35,635 papers in biomedical sciences published between January 1971 and September 2022. No papers were excluded. We extracted data for the first and last author of each paper. We did not include other authors as their contribution and responsibility for the content of papers in biomedical sciences is variable and sometimes minimal. The first author should be the person who contributed most to the work, including writing of the manuscript, whilst the last author is commonly the senior author. We inferred their gender based on their first names using Gender-API software [11]. We accepted gender predictions when the accuracy was estimated to be at least 80% and performed sensitivity analysis for an accuracy of 60% or over. This meant that 14,786 and 15,222 papers were excluded from the main analysis of first and last author, respectively (7,154 and 7,299 papers were excluded from the sensitivity analysis for first and last author, respectively).

We also extracted data for the reasons for retractions, of which there were multiple for each paper. Reasons for retractions were grouped into the following categories (i) misconduct (including misconduct or concerns about authorship), (ii) fraud, (iii) plagiarism, (iv) errors (including errors in any section of the paper), (v) duplication of content (including duplication of data, results, or images), (vi) concerns about data (including results being unreproducible or unreliable, or manipulation of images), (vii) issues related to the journal editor or publisher (including rogue editor, publisher/editor errors, and fake peer review), and (viii) issues related to ethics and law (including non-compliance with ethical standards, lack of approval by ethics, institutional research boards or regulators, lack of patient consent, copyright breaches, and legal threats). Due to small numbers, all remaining reasons were categorised as “other”.

We estimated the percentage of retractions that could be attributed to women and men first authors and last authors, overall and for each reason for retraction. We carried out an additional analysis using the gender dyads for first and last authors. We used binomial distributions to estimate percentages retracted by women authors, with 95% confidence intervals, and test whether these percentages were significantly different from 50% (i.e., no gender difference). As a sensitivity analysis, we tested whether women’s representation as authors of retractions was comparable to their representation as authors of papers overall. Based on previous literature showing the underrepresentation of women in authorship of biomedical papers, we tested whether those percentages were significantly different from 40% for first authors and 30% for last authors [12, 13].

Results

Among the 35,635 retracted articles, a total of 20,849 first authors and 20,413 last authors were included in the main analyses after excluding authors whose gender could not be predicted based on first names with at least 80% accuracy. For the sensitivity analyses using a threshold of 60%, a total of 28,481 first authors and 28,336 last authors were included.

Overall, women accounted for 27.4% [26.8 to 28.0] of first authors and 23.5% [22.9 to 24.1] of last authors (S1 Table). The sensitivity analysis using a 60% threshold for the accuracy of gender prediction gave similar estimates: women comprised 26.9% [26.3 to 27.4] of first authors and 23.6% [23.2 to 24.1] of last authors. In retractions, there was a steady increase in the percentage of women as first authors from 5.1% in the 1970’s to 29.8% in the last decade, whilst the percentage of women as last authors initially decreased and then increased (Fig 1 and S2 Table).

thumbnail
Fig 1. Women’s representation among authors of retracted papers over time.

https://doi.org/10.1371/journal.pone.0284403.g001

Sensitivity analyses comparing women’s representation as authors of retractions with their representation as authors of papers overall were comparable to the main analyses. The percentage of women as authors of retractions was significantly lower than their representation as authors of biomedical papers for both first and last author (p<0.0001).

There were differences in women’s representation between reasons for retraction (Fig 2). For instance, women accounted for 18.9% [17.1 to 20.9] of first authors and 13.5% [11.9 to 15.1] of last authors for fraud but 29.1% [27.5 to 30.8] of first authors and 29.4% [27.8 to 31.1] of last authors for plagiarism. By far the most retractions (60.9%) were authored by men as first and last authors (Table 1).

thumbnail
Fig 2. Women’s representation among authors of retracted papers, stratified by reason for retraction.

https://doi.org/10.1371/journal.pone.0284403.g002

thumbnail
Table 1. Distribution of authorship of retracted papers by gender dyads, stratified by reason.

https://doi.org/10.1371/journal.pone.0284403.t001

The vertical dashed lines mark the range within the overall representation of women as authors of biomedical science papers has been reported (about 30–40% for first authors and 25–30% for last authors).

Discussion

Among retracted papers in biomedical sciences, women represented about 27% of first authors and 24% of last authors. These figures reflect an overall increase in women’s representation as first and last authors from 1970 to 2022. There were stark differences in reasons for retraction. Whilst women accounted for about 19% of first authors and 14% of last authors for fraud, they comprised about 29% of both first and last authors for plagiarism. Over 60% of retractions had men as first and last authors.

Women’s underrepresentation among first and last authors of retracted papers was slightly lower than women’s representation among first and last authors of biomedical papers in general. Although there is substantial variation between biomedical fields, women have consistently represented about 30–40% of first authors and 25–30% of last authors [7, 12, 13]. These trends over time are also broadly comparable to general trends in authorship in biomedical sciences [14]. For instance, in medical journals, there was a 4.2% increase in the proportion of women authors between 2008 and 2018, with a larger increase for women as last authors than as first authors (7.8% versus 3.6%, respectively) [12]. We found a greater increase in women as first than last authors, with the percentage of women as first authors remaining larger than last authors over time. This is in keeping with the greater representation of women as first than last authors of biomedical papers overall [12]. The increase in women’s representation among authors of retractions is also in line with the rise in the number and proportion of retractions, which seems to be related to greater awareness and commitment to research integrity than an actual increase in fraudulent research [6].

On the other hand, the gender differences in reasons for retraction deserve careful consideration. Women’s underrepresentation was greater for misconduct and fraud and lower for plagiarism, duplication of content, and errors. Women’s representation was also higher for issues related to editors and publishers, which are out of author’s remit. This is in keeping with previous studies suggesting that men are more likely than women to be involved in fraud and misconduct in research [9, 15]. For instance, in a sample of 113 retractions from diverse scientific fields, fraud and plagiarism accounted for 28.6% of women-authored retractions and 59.2% men-authored retractions [9]. The underlying reasons for these gender differences are difficult to pinpoint. They may be related to attitudes toward research integrity, which are themselves influenced by career goals and ambitions as well as social norms [16, 17]. Gender stereotypes and bias at societal level may result in differences in moral standards and values, which then influence attitudes and behaviours related to research integrity. On the other hand, men may experience greater pressure to maintain a certain level of outputs at senior positions than women [18]. However, no studies have specifically addressed this issue, thus precluding drawing definite conclusions.

Although only a small fraction of biomedical research papers is estimated to be retracted [2], the marked gender differences in underlying reasons for retractions may have important implications. Addressing longstanding gender bias and other barriers that hinder women’s progression in academia and research could enhance the integrity and moral standards of the scientific community overall and, hence, reduce misconduct and fraud [19]. Achieving gender equality across the academic ladder, particularly in positions of power and influence, would allow women to serve as role modellers and exert a positive influence on research teams and institutions to adhere to the highest standards of research integrity. This could have far-reaching benefits from increasing public’s trust in science [20], to improving the value of research for populations and reducing the long-term harms caused by fraudulent research [21].

Our study is the first to have investigated retractions in relation to gender using a large dataset of biomedical papers published over four decades. However, the large number of papers meant that gender determination had to be based on authors’ first names and performed by a software tool. Although this software has been found to be the most reliable at estimating gender, it is not completely accurate, especially for names using non-Latin alphabets [11]. This approach also fails to account for non-binary gender identification as it classifies authors as women or men. Although RetractionWatch is the largest database of retracted papers, it does not capture all retractions as not all publishers clearly label or publicise papers they have retracted or disclose the underlying reasons. In addition, the database was only started in 2010. There is still no consensus about order of authors in biomedical papers, which may have influenced our findings of women’s representation for different authorship positions [22]. It is uncertain how generalisable our findings are to other fields beyond biomedical sciences, as practices may vary regarding authorship and retraction criteria between scientific fields.

Conclusion

Women’s representation among authors of retracted papers seems slightly lower than women’s representation as authors of biomedical papers overall. Women’s underrepresentation is particularly marked for retractions due to fraud and misconduct. Gender equality among authors of biomedical papers could enhance research integrity within the scientific community in general and, hence, reduce the negative impact that retractions have on population health and trust in science.

Supporting information

S1 Table. Women’s representation among authors of retracted papers.

https://doi.org/10.1371/journal.pone.0284403.s001

(DOCX)

S2 Table. Women’s representation among authors of retracted papers over time (from 1970).

https://doi.org/10.1371/journal.pone.0284403.s002

(DOCX)

References

  1. 1. COPE Council. COPE retraction guidelines. Committee on Publication ethics, 2019.
  2. 2. Fang FC, Steen RG, Casadevall A. Misconduct accounts for the majority of retracted scientific publications. Proceedings of the National Academy of Sciences. 2012;109(42):17028–33. pmid:23027971
  3. 3. Brainard J. What a massive database of retracted papers reveals about science publishing’s ‘death penalty’. Science. 2018.
  4. 4. Gaudino M, Robinson NB, Audisio K, Rahouma M, Benedetto U, Kurlansky P, et al. Trends and Characteristics of Retracted Articles in the Biomedical Literature, 1971 to 2020. JAMA Intern Med. 2021;181(8):1118–21. pmid:33970185; PubMed Central PMCID: PMC8111562.
  5. 5. Wager E, Williams P. Why and how do journals retract articles? An analysis of Medline retractions 1988–2008. J Med Ethics. 2011;37(9):567–70. Epub 20110412. pmid:21486985.
  6. 6. Fanelli D. Why growing retractions are (mostly) a good sign. PLoS Med. 2013;10(12):e1001563. Epub 20131203. pmid:24311988; PubMed Central PMCID: PMC3848921.
  7. 7. Filardo G, da Graca B, Sass DM, Pollock BD, Smith EB, Martinez MA-M. Trends and comparison of female first authorship in high impact medical journals: observational study (1994–2014). BMJ. 2016;352:i847. pmid:26935100
  8. 8. Huang J, Gates AJ, Sinatra R, Barabási AL. Historical comparison of gender inequality in scientific careers across countries and disciplines. Proc Natl Acad Sci U S A. 2020;117(9):4609–16. Epub 20200218. pmid:32071248; PubMed Central PMCID: PMC7060730.
  9. 9. Decullier E, Maisonneuve H. Retraction according to gender: A descriptive study. Account Res. 2021:1–6. Epub 20211013. pmid:34615410.
  10. 10. The Retraction Watch Database New York: The Center for Scientific Integrity; 2018 [cited 2022 12 December]. Available from: http://retractiondatabase.org/.
  11. 11. Sebo P. Performance of gender detection tools: a comparative study of name-to-gender inference services. J Med Libr Assoc. 2021;109(3):414–21. pmid:34629970; PubMed Central PMCID: PMC8485937.
  12. 12. Hart KL, Perlis RH. Trends in Proportion of Women as Authors of Medical Journal Articles, 2008–2018. JAMA Internal Medicine. 2019;179(9):1285–7. pmid:31135815
  13. 13. Squazzoni F, Bravo G, Farjam M, Marusic A, Mehmani B, Willis M, et al. Peer review and gender bias: A study on 145 scholarly journals. Science Advances. 2021;7(2):eabd0299. pmid:33523967
  14. 14. Jagsi R, Guancial EA, Worobey CC, Henault LE, Chang Y, Starr R, et al. The “Gender Gap” in Authorship of Academic Medical Literature—A 35-Year Perspective. New England Journal of Medicine. 2006;355(3):281–7. pmid:16855268.
  15. 15. Fang FC, Bennett JW, Casadevall A. Males are overrepresented among life science researchers committing scientific misconduct. mBio. 2013;4(1):e00640–12. Epub 20130122. pmid:23341553; PubMed Central PMCID: PMC3551552.
  16. 16. Satalkar P, Shaw D. How do researchers acquire and develop notions of research integrity? A qualitative study among biomedical researchers in Switzerland. BMC Medical Ethics. 2019;20(1):72. pmid:31619226
  17. 17. Kaatz A, Vogelman PN, Carnes M. Are Men More Likely than Women To Commit Scientific Misconduct? Maybe, Maybe Not. mBio. 2013;4(2):e00156–13. pmid:23532977
  18. 18. Rawat S, Meena S. Publish or perish: Where are we heading? J Res Med Sci. 2014;19(2):87–9. pmid:24778659; PubMed Central PMCID: PMC3999612.
  19. 19. Elsevier. The Researcher Journey Through a Gender Lens 2020 10 April 2021. Available from: https://www.elsevier.com/__data/assets/pdf_file/0011/1083971/Elsevier-gender-report-2020.pdf.
  20. 20. Davey M. Retracted studies may have damaged public trust in science, top researchers fear. The Guardian [Internet]. 2020 3 November 2022. Available from: https://www.theguardian.com/science/2020/jun/06/retracted-studies-may-have-damaged-public-trust-in-science-top-researchers-fear.
  21. 21. Omer SB. The discredited doctor hailed by the anti-vaccine movement. Nature. 2020;586(7831):668–70.
  22. 22. Burrows S, Moore M. Trends in Authorship Order in Biomedical Research Publications. Journal of Electronic Resources in Medical Libraries. 2011;8(2):155–68.