Figures
Abstract
While women are generally underrepresented in STEM fields, there are noticeable differences between fields. For instance, the gender ratio in biology is more balanced than in computer science. We were interested in how this difference is reflected in the interdisciplinary field of computational/quantitative biology. To this end, we examined the proportion of female authors in publications from the PubMed and arXiv databases. There are fewer female authors on research papers in computational biology, as compared to biology in general. This is true across authorship position, year, and journal impact factor. A comparison with arXiv shows that quantitative biology papers have a higher ratio of female authors than computer science papers, placing computational biology in between its two parent fields in terms of gender representation. Both in biology and in computational biology, a female last author increases the probability of other authors on the paper being female, pointing to a potential role of female PIs in influencing the gender balance.
Author summary
There are fewer women than men working in Science, Technology, Engineering and Mathematics (STEM). However, some fields within STEM are more gender-balanced than others. For instance, biology has a relatively high proportion of women, whereas there are few women in computer science. But what about computational biology? As an interdisciplinary STEM field, would its gender balance be close to one of its “parent” fields, or in between the two? To investigate this question, we examined authorship data from databases of scholarly publications in biology, computational biology, and computer science. We found that computational biology lies in between computer science and biology, as far as female representation goes. This is independent of other factors, e.g. year of publication. This suggests that computational biology might provide an environment that is more conducive to female participation that other areas of computer science. Across all three fields, we also found that if the last author on a publication—usually the person leading the study—is a women, then there will also be more women in other authorship positions. This suggests that having women in leadership positions might be beneficial for overall gender balance, though our data do not allow us to uncover the underlying mechanism.
Citation: Bonham KS, Stefan MI (2017) Women are underrepresented in computational biology: An analysis of the scholarly literature in biology, computer science and computational biology. PLoS Comput Biol 13(10): e1005134. https://doi.org/10.1371/journal.pcbi.1005134
Editor: Carl T. Bergstrom, University of Washington, UNITED STATES
Received: December 7, 2016; Accepted: July 7, 2017; Published: October 12, 2017
Copyright: © 2017 Bonham, Stefan. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Publication and author information for the manuscripts analyzed are archived on zenodo.org http://doi.org/10.5281/zenodo.58990 http://doi.org/10.5281/zenodo.60088 Code to analyze the data are available on github and archived at zenodo.org. http://doi.org/10.5281/zenodo.60090 Gender inferences for first names were supplied by Gender-API.com. An example dataset of 1000 names and associated data is included as supplementary data. For more information, contact Markus Perl at contact@gender-api.com.
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
There is ample literature on the underrepresentation of women in STEM fields and the biases contributing to it. Those biases, though often subtle, are pervasive in several ways: they are often held and perpetuated by both men and women, and they are apparent across all aspects of academic and scientific practice. Undergraduate students show bias in favor of men both when rating their peers [1] and their professors [2]. Professors, in turn, are more likely to respond to e-mail from prospective students who are male [3]. They also show gender bias when hiring staff and deciding on a starting salary [4].
When looking at research output in the form of publication and impact, the story is complex: Women tend to publish less than men [5], are underrepresented in the more prestigious first and last author positions, and publish fewer single-author papers [6]. In mathematics, women tend to publish in lower-impact journals [7], while in engineering, women publish in journals with higher impact factors [14]. In general, however, articles authored by women are cited less frequently than articles authored by men [5, 14], which might in part be due to men citing their own work more often than women do [8]. Inferring bias in these studies is difficult, since the cause of the disparity between male and female authorship cannot be readily determined. At the same time, when stories of scientific discoveries are told, gender biases are readily identified: Work by female scientists is more likely to be attributed to a male colleague [9], and biographies of successful female scientists perpetuate gender stereotypes [10]. Finally, the way in which evidence for gender bias is received is in itself biased: Male scientists are less likely to accept studies that point to the existence of gender bias than are their female colleagues [11].
Although gender imbalance seems to be universal across all aspects of the scientific enterprise, there are also more nuanced effects. In particular, not all disciplines are equally affected. For instance, in the biosciences over half of PhD recipients are now women, while in computer science, it is less than 20% [12]. This raises an intriguing question, namely how do the effects of gender persist in interdisciplinary fields where the parent fields are discordant for female representation?
To this end, we are interested in the gender balance in computational biology and how it compares to other areas of biology, since computational biology is a relatively young field at the disciplinary intersection between biology and computer science. We examined authorship on papers from Pubmed published between 1997 and 2014 and compared computational biology to biology in general. We found that in computational biology, there is a smaller proportion of female authors overall, and a lower proportion of female authors in first and last authorship positions than in all biological fields combined. This is true across all years, though the gender gap has been narrowing, both in computational biology and in biology overall. A comparison to computer science papers shows that computational biology stands between biology and computer science in terms of gender equality.
Results and discussion
In order to determine if there is a difference in the gender of authors in computational biology compared to biology as a whole, we used data from Pubmed, a database of biology and biomedical publications administered by the US National Library of Medicine. Pubmed uses Medical Subject Heading (MeSH) terms to classify individual papers by subject. The MeSH term “Computational Biology” is a subset of “Biology” and was introduced in 1997, so we restricted our analysis to primary articles published after this date (see S1A and S1B Fig, Materials and methods).
To determine the gender of authors, we used the web service Gender-API.com, which curates a database of first names and associated genders from government records as well as social media profiles. Gender-API searches provide information on the likely gender as well as confidence in the estimate based on the number of times a name appears in the database. We used bootstrap analysis to estimate the probability (Pfemale) that an author in a particular dataset is female as well as a 95% confidence interval (see Materials and methods).
We validated this method by comparing it to a set of 2155 known author:gender pairs from the biomedical literature provided by Filardo et. al. [13] Filardo and colleagues manually determined the genders of the first authors for over 3000 papers by searching for authors’ photographs on institutional web pages or social media profiles like LinkedIn. We compared the results obtained from our method of computational inference of gender for a subset of this data (see Materials and methods), to the known gender composition of this author set. Infering author gender using Gender-API data suggested that Pfemale = 0.373 ± 0.023 (S1C Fig, black bar). Because the actual gender of each of these authors is known, we could also calculate the actual Pfemale. Using the same bootstrap method on actual gender (known female authors were assigned Pfemale = 1, known male authors were assigned Pfemale = 0), we determined that the real Pfemale = 0.360 ± 0.018 (S1C Fig, white bar).
Unfortunately, 43% of names used to query to Gender-API did not have associated gender information. These names, representing 26.6% of authors, were therefore excluded from our analysis. In order to ensure that this was not systematically skewing our results, we also determined the Pfemale in Filardo et al.’s known gender dataset excluding those authors with names that were not associated with a Gender-API record, giving Pfemale = 0.381 ± .027 (S1C Fig, white bar). Together, these results suggest that our method of automatically assigning gender using Gender-API gives comparable results to human-validated gender assignment, and that excluding names without clear gender information does not lead us to underestimate the proportion of women in our dataset.
We began our investigation of the gender make-up in biology and computational biology publications by analyzing the gender representation in primary publications from 1997 to 2014. Consistent with previous publications, women were substantially less likely to be in senior author positions than first author positions in publications labeled with the Biology (Bio) MeSH term (Last author, Pfemale = 0.245 ± 0.002, First author, Pfemale = 0.376 ± 0.003 (Fig 1A, Table 1). We observed the same trend in papers labeled with the computational biology (comp) MeSH term, though the Pfemale at every author position was 4-6 percentage points lower. An analysis of publications by year suggests that the gender gaps in both biology and computational biology are narrowing, but by less than 1 percentage point per year (for bio, change in Pfemale = 0.0035 ± 0.0005/year, for comp, change in Pfemale = 0.0049 ± 0.0008/year). However, the discrepancy between biology and computational biology has been consistent over time (Fig 1B).
A: Mean probability that an author in a given position is female for primary articles indexed in Pubmed with the MeSH term Biology (black) or Computational Biology (grey). The bio dataset is inclusive of papers in the comp dataset. Error bars represent 95% confidence intervals. B: Mean probability that an author is female for publications in a given year. Error bars represent 95% confidence intervals. C: Mean probability that the first (F), second (S), penultimate (P) or other (O) author is female for publications where the last author is male (Pfemale < 0.2) or female (Pfemale > 0.8). Papers where the gender of the last author was uncertain or could not be determined were excluded. Error bars represent 95% confidence intervals.
One possible explanation for the difference in male and female authorship position might be a difference in role models or mentors. If true, we would expect studies with a female principal investigator to be more likely to attract female collaborators. Conventionally in biology, the last author on a publication is the principal investigator on the project. Therefore, we looked at two subsets of our data: publications with a female last author (Pfemale > 0.8) and those with a male last author (Pfemale < 0.2). We found that women were substantially more likely to be authors at every other position if the paper had a female last author than if the last author was male (Fig 1C, Table 2). It is possible that female trainees are be more likely to pursue computational biology if they have a mentor that is also female. Since women are less likely to be senior authors, this might reduce the proportion of women overall. However, we cannot determine if the effect we observe is instead due to a tendancy for women that pursue computational biology to select female mentors.
Though MeSH terms enable sorting a large number of papers regardless of where they are published, the assignment of these terms is a manual process and may not be comprehensive for all publications. As another way to qualitatively examine gender differences in publishing, we examined different journals, since some journals specialize in computational papers, while others are more general. We looked at the 123 journals that had at least 1000 authors in our bio dataset, and determined Pfemale for each journal separately (Fig 2A). Of these journals, 21 (14%) have titles indicative of computational biology or bioinformatics, and these journals have substantially lower representation of female authors. The 3 journals with the lowest female representation and 6 out of the bottom 10 are all journals focused on studies using computational methods. Only 4 computational biology/bioinformatics journals are above the median of female representation.
A: Mean probability that an author is female for every journal that had at least 1000 authors in our dataset. Grey bars represent journals that have the words “Bioinformatics”, “Computational”, “Computer”, “System(s)”, or “omic(s)” in their title. Vertical line represents the median for female author representation. See also S1 Table. B: Mean probability that an author is female for articles in the “Bio” dataset (black dot) or in the “Comp” dataset (open dot) for each journal that had at least 1000 authors plotted against the journals' 2014 impact factor. Journals that had computational biology articles are included in both datasets. An ordinary least squares regression was performed for each dataset. Bio: m = −0.00264, PZ > |z| = 0.0022. Comp: m = −0.00079, PZ > |z| = 0.568.
One possible explanation might be that women are less likely to publish in high-impact journals, so we considered the possibility that the differences in the gender of authors that we observe could be the result of differences in impact factor between papers published in biology versus computational biology publications. We compared the Pfemale of authors in each journal with that journal’s 2014 impact factor (Fig 2B). There is a marginal but significant negative correlation (−0.00264, PZ > |z| = 0.0022) between impact factor and gender for the biology dataset. This is in contrast to previous studies from engineering that have found that women tend to publish in higher-impact journals [14]. It is, however, consistent with a previous studies from mathematics [7]. By contrast, there is no significant correlation (PZ > |z| = 0.568) between impact factor and Pfemale in computational biology publications. Further, for journals that have articles labeled with the computational biology MeSH term, the Pfemale for those articles is the same or lower than that for all biology publications in the same journal.
We also examined whether computational biology or biology articles tend to have higher impact factors. Bootstrap analysis of authors in each dataset suggest that computational biology publications tend to be published in journals with a higher impact factor () than publications in biology as a whole (
). However, given the magnitude of the correlation between IF and Pfemale, this difference is unlikely to explain the differences in Pfemale observed between our computational biology and biology datasets. Taken together, these data suggest that the authors of computational biology papers are less likely to be women than the authors of biology papers generally.
We turned next to an investigation of biological fields relative to computer science. Since Pubmed does not index computer science publications, we cannot compare the computational biology dataset to computer science research papers directly. Instead, we investigated the gender balance of authors of manuscripts submitted to arXiv, a preprint repository for academic papers used frequently by quantitative fields like mathematics and physics. These preprint records cannot be compared to peer-reviewed publications indexed on pubmed, but a “quantitative biology” (qb) section was added to arXiv in 2003. Quantitative biology is not necessarily equivalent to computational biology, and analysis of arXiv-qb papers that have been published and indexed on pubmed suggests that only a fraction of them are labeled with the “computational biology” MeSH term. However, this does allow us to make an apples-to-apples comparision between a field of biology and computer science. There are relatively few papers preprints prior to 2007, so we compared preprints in “quantitative biology” to those in “computer science” from 2007-2016.
Women were more likely to be authors in quantitative biology manuscripts than in computer science manuscripts in first, second, and middle author positions (Fig 3A, Table 3). We found no significant difference in the frequency of female authors in the last or penultimate author positions in these two datasets, though the conventions for determining author order are not necessarily the same in computer science as in biology. Nevertheless, women had higher representation in quantitative biology than in computer science for all years except 2009 (Fig 3B). Interestingly, there is a slight but significant (0.0052/year, PZ > |z| < 0.005) increase in the proportion of female authors over time in quantitative biology, while there’s no significant increase in female representation in computer science preprints.
A: Mean probability that an author in a given position is female for all preprints in the arXiv quantitative biology (black) or computer science (grey) categories between 2007 and 2014. Error bars represent 95% confidence intervals. B: Mean probability of authors being female in arXiv preprints in a given year. Error bars represent 95% confidence intervals. Slopes were determined using ordinary least squares regression. The slope for qbio is slightly positive (p < 0.05), but the slope for cs is not.
Taken together, our results suggest that computational biology lies between biology in general and computer science when it comes to gender representation in publications. This is perhaps not surprising given the interdisciplinary nature of computational biology. Compared to biology in general, computational biology papers have fewer female authors, and this is consistent across all authorship positions. Importantly, this difference is not due to a difference in impact factor between computational biology and general biology papers.
Articles with a female last author tend to have more female authors in other positions and this is true for both biology in general and computational biology. Since the last author position is most often occupied by the principal investigator of the study, this suggests that having a woman as principal investigator has a positive influence on the participation of women. This resonates with findings by Macaluso et al., who studied the nature of authorship contribution by gender in PLoS publications [15]. They found that if the corresponding author of a paper was female, then there was also a greater proportion of women across almost all authorship roles (data analysis, experimental design, performing experiments, and writing the paper). In contrast, if the corresponding author was male, then men were dominating all authorship roles except for performing experiments, which remained female-dominated. The reasons for this are difficult to ascertain. It could be the case that female PIs tend to work in more female-dominated sub-fields and therefore naturally have more female co-authors. It is also possible that female PIs are more likely to recognise contributions by female staff members, or that they are more likely to attract female co-workers and collaborators. Our publication data cannot differentiate between those two (and other) explanations, but points to the important role that women in senior positions may play as role models for trainees.
Since biology attracts more women than computer science, we suspect that many women initially decide to study biology and later become interested in computational biology. If this is the case, understanding what factors influence the field of study will provide useful insight when designing interventions to help narrow the gender gap in computer science and computational biology.
Materials and methods
Datasets
Biology publications 1997-2014 (bio).
This dataset [16] contains all English language publications under the MeSH term “Biology” published between 1997 and 2014, excluding many non-primary sources. This set contains 204,767 records. Downloaded 12 February, 2016. Search term: (“Biology”[Mesh]) NOT (Review[ptyp] OR Comment[ptyp] OR Editorial[ptyp] OR Letter[ptyp] OR Case Reports[ptyp] OR News[ptyp] OR “Biography” [Publication Type]) AND (“1997/01/01”[PDAT]: “2014/12/31”[PDAT]) AND english[language]
Computational biology publications 1997-2014 (comp).
Same as above [16], except using MeSH term “Computational Biology”. Only uses papers where this is a major term. Date range was selected because this MeSH term was introduced in 1997. This dataset is a subset of the “bio” dataset (all of the papers in this dataset are contained within “bio”) and contains 43,198 records. Downloaded 12 February, 2016. Search term: (“Computational Biology”[Majr]) NOT (Review[ptyp] OR Comment[ptyp] OR Editorial[ptyp] OR Letter[ptyp] OR Case Reports[ptyp] OR News[ptyp] OR “Biography” [Publication Type]) AND (“1997/01/01”[PDAT]: “2014/12/31”[PDAT]) AND english[language]
Medical papers.
Subset of author and gender data from Filardo et.al [13]. This dataset did not contain author first names or unique publication identifiers. We searched pubmed for the title, author and publication date, and were able to identify 2155/3153 publications to analyze. Publications with no matching search results or with multiple matching search results were excluded.
arXiv quantitative biology (q-bio).
This dataset [17] contains all preprints with the label “q-bio” from 2003 (when the section was introduced) to 2014. This set contains 41,637 records and was downloaded on 10 June, 2016.
arXiv CS (cs).
This dataset [17] contains all preprints with the label “cs” from 2003 to 2014, and contains 188,617 records. Downloaded on 10 June, 2016. There are 1412 preprints that are found in both the qbio and cs dataset (3.4% of bio and 0.75% of cs).
Gender inference
Genders were determined using Gender-API (http://gender-api.com), which compares first names to a database compiled from government sources as well as from crawling social media profiles and returns a gender probability and a measure of confidence based on the number of times the name appears in the database. The API was queried with the 74,760 unique first names in the dataset (24 May, 2016).
Mean gender probabilities were determined using bootstrap analysis. Briefly, for each dataset, authors were randomly sampled with replacement to generate a new dataset of the same size. The mean Pfemale for each sample was determined excluding names for which no gender information was available (26.6% of authors). The reported Pfemale represents the mean of means for 1000 samples. Error bars in figures represent 95% confidence intervals. Code and further explanation can be found on github [18].
Author positions were assigned based on the number of total authors. In papers with 5 or more authors, all authors besides first, second, last and penultimate were designated “other”. Papers with 3 authors were assigned only first, second and last, papers with two authors were assigned only first and last, and single-author papers were assigned only first.
Supporting information
S1 Fig.
A: Number of primary publications per year indexed under the “Biology” MeSH term. B: Number of primary publications per year indexed with “Computational Biology” as a major MeSH term. C: Comparison of computational gender inference (black) with known genders (white) for the dataset from Filardo et. al. [13]. Grey represents the known proportion of female authors when excluding names for which the gender could not be computationally inferred. Error bars represent 95% confidence intervals.
https://doi.org/10.1371/journal.pcbi.1005134.s001
(TIF)
S2 Fig.
A: Mean probability that an author in a given position is female for primary articles indexed in Pubmed with the MeSH term Biology (black), Computational Biology (gray) or for those articles with Biology but not Computational biology (white). Error bars represent 95% confidence intervals. B: Mean probability that an author is female for articles in the “Bio” dataset (black) in the “Comp” dataset (white), or for articles in the Bio but not Comp (gray) for each journal that had at least 1000 authors plotted against the journals’ 2014 impact factor. Excluding computational publications from the biology dataset does not substantially alter the correlation between impact factor and Pfemale.
https://doi.org/10.1371/journal.pcbi.1005134.s002
(TIF)
S1 Table. Pfemale for each journal with at least 1000 authors in the bio dataset.
Journals identified as primarily computational are shaded grey.
https://doi.org/10.1371/journal.pcbi.1005134.s003
(TSV)
S1 Data. A subset of 1000 name:gender pairs, downloaded from GenderAPI.com.
Permission to share these data was granted by Markus Perl. For additional information, e-mail contact@gender-api.com.
https://doi.org/10.1371/journal.pcbi.1005134.s004
(JSON)
Acknowledgments
The authors would like to thank Markus Perl for the free use of Gender-API—contact@gender-api.com; Casper Strømgren for the free use of genderize.io—info@genderize.io; Giovanni Filardo for sharing data [13]; Johanna Gutlerner, Marshall Thomas, Diane Lam, and other members of the Curriculum Fellows Program (CFP) at Harvard Medical School (HMS) for helpful feedback and discussions; and The HMS CFP and Educational Laboratory for resources and mentorship.
Author Contributions
- Conceptualization: KSB MIS.
- Data curation: KSB MIS.
- Formal analysis: KSB.
- Investigation: KSB.
- Methodology: KSB MIS.
- Project administration: KSB MIS.
- Resources: KSB.
- Software: KSB.
- Validation: KSB MIS.
- Visualization: KSB MIS.
- Writing – original draft: KSB MIS.
- Writing – review & editing: KSB MIS.
References
- 1. Grunspan DZ, Eddy SL, Brownell SE, Wiggins BL, Crowe AJ, Goodreau SM. Males Under-Estimate Academic Performance of Their Female Peers in Undergraduate Biology Classrooms. PLoS ONE. 2016 11:e0148405. pmid:26863320
- 2. MacNell L, Driscoll A, Hunt AN. What’s in a Name: Exposing Gender Bias in Student Ratings of Teaching. Innovative Higher Education. 2014 40: 291–303.
- 3. Milkman KL, Akinola M, Chugh D. What happens before? A field experiment exploring how pay and representation differentially shape bias on the pathway into organizations. J Appl Psychol. 2015 100:1678–1712. pmid:25867167
- 4. Moss-Racusin CA, Dovidio JF, Brescoll VL, Graham MJ, Handelsman J. Science faculty’s subtle gender biases favor male students. Proc Natl Acad Sci U S A. 2012 109:16474–16479. pmid:22988126
- 5. Larivière V, Ni C, Gingras Y, Cronin B, Sugimoto CR. Bibliometrics: global gender disparities in science. Nature. 2013 504: 211–213. pmid:24350369
- 6. West JD, Jacquet J, King MM, Correll SJ, Bergstrom CT. The role of gender in scholarly authorship. PLoS One. 2013 8:e66212. pmid:23894278
- 7. Mihaljević-Brandt H, Santamaría L, Tullney M. The Effect of Gender in the Publication Patterns in Mathematics. PLoS ONE. 2016 11(10):e0165367. pmid:27780266
- 8.
King MM, Bergstrom CT, Correll SJ, Jacquet J, West JD. Men set their own cites high: Gender and self-citation across fields and over time. 2016. Available: http://arxiv.org/abs/1607.00376v1.
- 9. Rossiter MW. The Matthew Matilda Effect in Science. Soc Stud Sci. 1993 23:325–341.
- 10. Fara P. Women in science: Weird sisters? Nature. 2013 495: 43–44.
- 11. Handley IM, Brown ER, Moss-Racusin CA, Smith JL. Quality of evidence revealing subtle gender biases in science is in the eye of the beholder. Proc Natl Acad Sci U S A. 2015 112:13201–13206. pmid:26460001
- 12.
National Science Foundation, National Center for Science and Engineering Statistics. Women, Minorities, and Persons with Disabilities in Science and Engineering: 2015. [Internet]. 2015 Available: http://www.nsf.gov/statistics/wmpd/.
- 13. Filardo G, da Graca B, Sass DM, Pollock BD, Smith EB, Martinez MA-M. Trends and comparison of female first authorship in high impact medical journals: observational study (1994-2014). BMJ. 2016 352:i847. pmid:26935100
- 14. Ghiasi G, Larivière V, Sugimoto CR. On the Compliance of Women Engineers with a Gendered Scientific System. PLoS ONE. 2015 10(12):e0145931. pmid:26716831
- 15. Macaluso B, Larivière V, Sugimoto T, Sugimoto CR. Is Science Built on the Shoulders of Women? A Study of Gender Differences in Contributorship. Academic Medicine. 2016 91(8):1136–11420. pmid:27276004
- 16. Bonham KS, Stefan MI. Biology and Computational Biology Papers in Pubmed, 1997-2014. [Internet]. Zenodo; 2016.
- 17. Bonham KS, Stefan MI. Preprints from arXiv.org in cs and q-bio. [Internet]. Zenodo; 2016.
- 18. Bonham KS, Stefan MI. gender-comp-bio: Pre-publication release. [Internet]. Zenodo; 2016.