https://orcid.org/0000-0003-2529-962X
Figures
Abstract
In this study, it was investigated whether early tweets counts could differentially benefit female and male (first, last) authors in terms of the later citation counts received. The data for this study comprised 47,961 articles in the research area of Life Sciences & Biomedicine from 2014–2016, retrieved from Web of Science’s Medline. For each article, the number of received citations per year was downloaded from WOS, while the number of received tweets per year was obtained from PlumX. Using the hurdle regression model, I compared the number of received citations by female and male (first, last) authored papers and then I investigated whether early tweet counts could predict the later citation counts received by female and male (first, last) authored papers. In the regression models, I controlled for several important factors that were investigated in previous research in relation to citation counts, gender or Altmetrics. These included journal impact (SNIP), number of authors, open access, research funding, topic of an article, international collaboration, lay summary, F1000 Score and mega journal. The findings showed that the percentage of papers with male authors in first or last authorship positions was higher than that for female authors. However, female first and last-authored papers had a small but significant citation advantage of 4.7% and 5.5% compared to male-authored papers. The findings also showed that irrespective of whether the factors were included in regression models or not, early tweet counts had a weak positive and significant association with the later citations counts (3.3%) and the probability of a paper being cited (21.1%). Regarding gender, the findings showed that when all variables were controlled, female (first, last) authored papers had a small citation advantage of 3.7% and 4.2% in comparison to the male authored papers for the same number of tweets.
Citation: Dehdarirad T (2020) Could early tweet counts predict later citation counts? A gender study in Life Sciences and Biomedicine (2014–2016). PLoS ONE 15(11): e0241723. https://doi.org/10.1371/journal.pone.0241723
Editor: Alireza Abbasi, UNSW, AUSTRALIA
Received: July 16, 2020; Accepted: October 17, 2020; Published: November 2, 2020
Copyright: © 2020 Tahereh Dehdarirad. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data regarding the variables, how they were obtained, and R packages used for analysis are within the paper. The results of multi-collinearity tests and data for Fig 2 (at aggregated level) are also available in the supporting information. The Doi list of the documents used in this study are available at https://doi.org/10.7910/DVN/GHMV8Q in compliance with NLM Copyright. However, restrictions apply to the availability of the bibliometric and altmetrics (tweet counts) data. These data were downloaded under the provision of the institutional standard contract held by the Chalmers University of Technology to Clarivate’s Web of Science (https://clarivate.com/webofsciencegroup/solutions/web-of-science/), SciVal (https://www.scival.com/) and PlumX (https://plu.mx/sign_in). The author did not have any special access privileges to these databases. Interested researchers may access Clarivate’s Web of Science, PlumX and SciVal in the same way the author did.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
According to statistics provided by the US National Science Foundation [1], women received over half of the bachelor’s, master’s and doctorate degrees awarded in biological sciences in 2016. Furthermore, the proportion of women amongst researchers in health and life sciences between 2011–2015 was shown to be overall higher than men researchers, as per the Gender in the Global Research Landscape Report [2]. Despite the gender parity in degree recipients and the number of researchers, women remain underrepresented among tenure-track biomedical faculty at research institutions [3] and are underrepresented in the faculties of medicine and life sciences, as well in senior positions [4]. In 2016 in the EU, women represented totally 27% of grade A academic staff in health and medical sciences [5]. In the United States, in 2014, women composed 38% of the full-time academic medicine workforce, while men made up 62%.Additionallly, only 21% of full professors and just 15% of department chairs were female, compared with 79% and 85% for men in the same positions [6].
Beyond the gender imbalance in the number of women in senior positions and amongst tenure-track faculty members, some studies have also reported a citation advantage for male-last authored papers in biomedical and life sciences fields [7–9]. However, some others did not find notable differences between male and female-last authored papers or between female and male authors in terms of the number received citations [10, 11]. Typically, in biomedicine, the author listed first has less experience and does most of the research work, while the author listed last has more experience and provides a supervisory role [12, 13].
Given these gender differences in the number of women in senior positions and the number of citations, some studies have also sought to examine whether the web might provide a democratizing space for female academics [14, 15]. Many social media sites have provided new opportunities for both female and male scholars to disseminate and promote their research results within and beyond scientific community [15, 16]. Twitter is one of these social media platforms which is fundamentally reshaping the way biomedical scientists and academic physicians can discover, discuss and share research across disciplinary boundaries, as well as to the public. Twitter allows conversations about new papers to happen immediately and publicly [15, 17]. It also provides a possibility for authors to push their research out via twitter, rather than hope that it is pulled in by readers. Thus, this possibility provides the potential for scholars to draw wide attention to their research [15]. Twitter might also reduce the influence of hierarchies based on seniority. This is because on Twitter, people who do not have tenure, or have a limited number of publications or are early in their career can demonstrate their expertise [17]. Shifting to the push method on social media might also potentially reduce gendered gatekeeping in the dissemination of research [15]. For example, some studies on social media and gender have found that females had a higher visibility in terms of Web citations [18], average Mendeley readers [19, 20], profile views on Academia.Edu in certain disciplines [21], or event counts from Twitter [14, 20], blogs, and news [14]. Others found similar visibility for both female and male scholars in blogs, news, Facebook, or LinkedIn. [20].
Regarding the relation between tweet counts and the number received citation, studies generally tend to suggest a weak positive correlation [15, 22]. Some studies also suggested that tweet counts could predict the later number of received citation [23] or correlate with later downloads and citations for arXiv preprints [24].
This study follows in the same vein. However, it extends this line of research about the prediction of later citation count by early tweets, by comparing female and male (first, last) authored papers while controlling for several important factors that according to previous research have an association with citation counts. Most of these factors have also been examined in relation to gender or altmetrics studies. In relation to citation and gender, these included factors such as journal impact [7, 25], citations and self-citation of first and last authors [25], topic of an article (measured as MeSH) [8, 26], number of MeSH topics [13], gender of first and last authors [9], and the total number of authors’ publications [13, 27]. In relation to citations, these included open access (OA) [28], Mega journal [29, 30] and number of topics of an article [31] amongst others. Regarding altmetrics and citations, factors such as abstract readability [32], international collaboration (measured as number of countries) [32, 33], title length [34], OA [35, 36], Mega journal, journal impact (measured as SNIP) and lay summary [36] have been studied.
Additionally, by studying both first and last authorship positions, I was able to control for the effect of seniority in terms of citations and tweet counts.
Thus, this study aims to investigate whether early tweets counts could differentially benefit female and male scholars in the field of Life Sciences and Biomedicine, in terms of later citations counts received per paper. The study has the two following objectives:
- To compare the number of received citations by female and male last/first authored papers, when controlling for a number of important factors.
- To investigate whether (and to what extent) early tweet counts can predict the later number of received citations by female and male last/first authored papers, when controlling for several important factors.
Materials and methods
Data collection and processing
The data for this study comprised 47,961 articles in the research area of Life Sciences & Biomedicine from 2014–2016, retrieved from Web of Science’s Medline in June 2020. The reason for choosing this time period was to give the documents the required two-year period after publication year to receive tweets, which could be used to predict later citation counts. Furthermore, it would ensure that the documents would have had enough time (a time citation window of at least three years) to be cited following the two-year period after publication year. For each article, the number of received citations per year was downloaded from WOS, while the number of received tweets per year was downloaded from PlumX, using a combination of Doi and Pubmed ID. As the number of tweets per year is not currently available in PlumX, I obtained the date of tweets for each article and then aggregated the number of citations and tweets per year using the methodology applied in Thelwall and Nevill’s study [37] (See Table 1).
After aggregation, of the 47,961 articles, 2,496 had zero citations and 24,190 had zero tweets. Fig 1 shows the distribution of early tweet counts versus later citation counts.
OA status of the articles was obtained from Unpaywall.org in June 2020. To determine the gender of first and last authors, Gender API (https://gender-api.com/) was used. Using this service, it is possible to search for first names, including those with two parts. The results provide the gender (male, female, or unknown), the number of names used to determine the gender and accuracy [38]. In cases of gender-neutral, unknown, initials or where the accuracy was lower than 80%, the names were checked manually using internet searches. The gender of authors in 12 authorship positions were remained unidentified. In the regression models (explained in data collection processing section) they were regarded as missing values. These 12 authorships accounted for seven first and five last authorship positions. The reason for choosing these two authorship positions was that in the field of biomedicine, the last position in the authors list is reserved for senior authors, whereas the first author position is for the person who fulfils the International Committee of Medical Journal Editors (ICMJE) authorship criteria to the highest level and performs the majority of the experimental and clinical work [12, 39].
The total numbers of publications, citations and self-citations for each author (first, last) as scientific (professional) age of an author [13, 25] were downloaded from SciVal API using authors’ IDs in June 2020. To do this, the author IDs for first and last authors were downloaded via Scopus author API using a combination of Doi and Pubmed ID of articles. Then, in the next step, the SciVal Author Lookup API (https://dev.elsevier.com/documentation/SciValAuthorAPI.wadl) was used to download the three former-mentioned indicators.
Regarding mega journals, I used the journal list provided by Spezi et al.’s study [40] to determine whether a journal was mega journal or not. A mega journal is a peer-reviewed academic open access journal that publishes manuscripts that presents scientifically trustworthy empirical results without asking about the potential scientific contribution prior to publication. It covers a broad coverage of different subject areas and uses article processing charges to cover the costs of publishing [29, 40].
For each article, the paper length was considered as the absolute number of pages of a publication, while the title length was calculated by counting the number of characters in the title of an article.
As this study has been conducted in the area of Life Sciences and Biomedicine, MeSH categories were an appropriate subject classification to consider. Medline assigns articles to 14 broad MeSH categories. In this article, only the seven most relevant medical topics were considered for evaluation. These topic categories were Anatomy, Organisms, Diseases, ‘Chemicals and Drugs’, ‘Analytical, Diagnostic and Therapeutic Techniques and Equipment’, ‘Psychiatry and Psychology’ and ‘Health Care’. For each of these seven MeSH categories, a dummy variable was created and entered as a covariate in the regression models. The articles that did not belong to any of these seven MeSH categories were tagged with a 0.
Lay summaries can help journals in life sciences and biomedicine to reach out to patients and others who might benefit from the research [41]. Thus, they may assist the diffusion of research on social media platforms such as Twitter. Using a journal list provided by Shailes [41], the articles were divided in two groups, those with and those without a lay summary.
Regarding the abstract readability, the Flesch Reading Ease Score was used, as it is the most commonly used measure of text readability and it has been used in other bibliometric studies [30]. The R quanteda package was used to calculate this score for each abstract. The highest possible score is 121.22 and there is no lower limit. Very complicated sentences can have negative scores. The higher the score, the easier the text is to understand.
F1000 score as an altmetric indicator was included in the models as a control variable. The rationale for this is that the articles scored in F1000 are recommended as highly important works in the fields of life sciences, health and physical sciences [42].
Table 2 shows all the variables studied in this paper categorized as dependent, independent variables and covariates. It also provides a short description of these variables and how they are measured.
Data analysis and procedures
Excel and the mctest, pscl, quanteda R packages were used to process and analyse the data.
Considering that the dependent variable of this study, the number of citations (See Table 2), was count data, count regression models were used. Furthermore, as this variable was over-dispersed and zero-inflated, a count model was required to deal with these two issues. Therefore, a negative binomial-logit hurdle model was the best fit for the data. Hurdle models measure the likelihood of an observation being positive or zero, and then determine the parameters of the count distribution for positive observations. Thus, a hurdle model comprises two parts: the count model, which is either a negative binomial or Poisson model, and the logit model. The count model predicts the changes in the positive non-zero observations, whilst the logit part models the zero observations [43, 44].
In this paper, three hurdle regression analysis were performed, namely model 1, model 2 and model 3. In model 1, the total number of received citations was considered as a dependant variable, whereas the gender of first and last authors was considered as independent variables. The rest of the variables were considered as covariates, except time since publication, which was considered as an offset variable in the regression model.
In models 2 and 3, the later citation counts were considered as dependant variables, whereas the early tweet counts were considered as an independent variable. In Model 3, the rest of variables were considered as covariates. In model 2, there were no covariates. In both models, time after two first years of publication was entered as an offset variable. Table 3 shows descriptive statistics at paper level for the covariates used in regression models 1 and 3. As can be seen from this table, the covariates are divided into two groups of numerical and categorical variables.
Multicollinearity was tested using Variance Inflation Factor (VIF). The VIF estimates how much the variance of a regression coefficient is inflated due to multicollinearity in the model. As a rule of thumb, a VIF value that exceeds 5 or 10 indicates a problematic amount of collinearity [45]. All variables had VIF values less than 3; hence no collinearity is expected (See S1 and S2 Appendices).
Results
Fig 2 shows the percentage of first and last authorship positions by gender. As can be seen from the figure, in both authorship positions, the percentage of male-authored papers is higher than that of female authors. However, the percentage of female-first authored positions is slightly higher than the percentage of female-last authored positions.
Comparison of the number of received citations between female and male last/first authored papers (Model 1)
As can be seen from the count model in Table 4, female first-authored papers and female-last authored papers have a small significant citation advantage over male-authored papers in these two positions. This means that by a unit of increase in gender (moving from male to female in either of these positions), the average number of received citations will be increased by 4.7% for female first-authored papers and by 5.5% for female last-authored papers.
As for controlled factors in both logit and count models and regardless of gender, OA, SNIP, number of authors, paper length and the total number of citations and self-citations of first and last authors has a positive associations with average number of received citations, as well as higher probability of a paper to be cited. Amongst MeSH topics, there was small positive association with the estimated number of received citations for articles categorized as ‘Chemicals and Drugs’.
Early tweet counts and later citation counts
Regression model with tweet and citation counts only (Model 2).
As can be seen from Table 5, the early number of tweets received by an article has a small positive association with the average number of later citations and a higher probability of a paper being cited. In other words, by increase of a unit in the number of tweet counts, the average number of later citation counts will approximately increase by 1.7% and the probability of being cited will be higher by 22.5%.
Regression model with tweet and citation counts controlling for all covariates (Model 3).
In the next step, we checked to see if there still would be an association between the early number of tweets and the later number of received citations when controlling for a several important factors that have an association with the number of received citations. Interestingly, the results from the comparison of two regression models (2 and 3) shows that by increase of a unit in early tweet counts in both models, the estimated average citation counts will increase to 1.7% in Model 2 (see Table 5) and 3.3% in the current model (see Table 6). As the coefficient in Model 3 is still significant and positive, this suggests that the early number of tweets could predict the later number of received citations, having controlled for specific factors.
As can been seen from count and logit models in Table 6, by increase of a unit in the number of early tweets, the estimated number of received citations will increase by 3.3% and the probability of being cited will be higher by 21.1%.
Regarding gender, as can be seen from the count model, it can be concluded that while keeping all other variables in the model constant, at the same number tweets, the estimated number of citations by female first or last-authored papers on average is slightly higher than that for male authors. In other words, by switching from male to female in both authorship positions, the average number of citations by female first or last-authored papers (at the same number of tweets for both genders) will increase by 3.7% and 4.2%, respectively.
As for the rest of covariates, as can be seen from both logit and count models, OA, SNIP, number of authors, International collaboration, Funding, paper length and being categorized under the ‘Chemicals and Drugs’ MeSH topic, were significantly associated with the higher number of received citations as well as the higher probability of being cited.
Conclusion and discussion
The goal of this paper was to examine whether and to what extent early tweet counts received by articles in the field of Life Sciences and Biomedicine (2014–2016) could differently benefit female and male scholars in terms of the later citation counts received. To do this, the number of received citations by female and male last/first authored papers were compared, when controlling for several important factors (model 1). Then, it was investigated whether, and to what extent, early tweet counts could predict later citation counts received by female and male last/first authored papers, when controlling for several important factors (model 3). The findings in relation to these two objectives are briefly discussed below.
Regarding the first objective, the findings showed that the percentage of papers with male authors in first or last authorship positions was higher than that for female authors. Furthermore, the percentage of female-first authored papers was slightly higher than the percentage of female-last authored ones. These findings might indicate male dominance in the field. The later finding might especially reflect the lack of senior females in this field, as last authors tend to be senior. This conclusion is supported by Plank-Bazinet’s, et al. [4] study which found a significant scarcity of women in academic biomedical leadership and senior positions. Having controlled for several factors, it was found that female first and last-authored papers had a small but significant citation advantage of 4.7% and 5.5% compared to male-authored papers. This finding is interesting given the lower number of female authors in these two authorship positions. The finding regarding the female first author citation advantage is in line with Thelwall’s [9] study, which found a small citation advantage for female first authored papers in parasitology. As first authorship positions tend to be taken by younger researchers, it could be suggested that young female researchers are slightly outperforming young male researchers in terms of citation counts. The findings regarding the last authorship position, contradicts the ones from Thelwall [9], which found a small female last author disadvantage in immunology, parasitology and virology. It is however in line with a study by Sotudeh, Dehdarirad, Freer [20] in the field of neurosurgery, which found a higher average of citations for female first and last authors.
Regarding the second objective, the findings showed that irrespective of whether the factors were included in regression models or not, early tweet counts had a weak positive and significant association with the later citations counts (3.3%) and the probability of a paper being cited (21.1%). This finding is in line with the ones of Eysenbach [23], Haustein, et al. [22], Peoples et al. [46] and Klar, et al. [15].
Regarding gender, the findings showed that while keeping all other variables constant in the model, at the same number of tweets, the average citation counts by female first or last-authored papers was slightly higher than that for male authors. Compared to male first or last authored papers, female authored papers had a small citation advantage of 3.7% and 4.2% when both genders receive the same number of tweets per paper. This might suggest that in Life sciences and Biomedicine, early tweets counts could slightly benefit female authored papers in terms of the later citation counts received. This finding is to some extent in line with Klar et al. [15], who found a positive association between the percentage of women authors per paper and the number of citations received, after controlling for the number of tweets.
With regard to the other variables controlled for in model 3 (early tweet-later citation counts), the results showed that while keeping all other variables in the model constant, with the same number of tweets, two conclusions can be drawn. i) OA articles, articles with international collaboration or research funding had a higher average of citations and a higher probability to be cited. ii) As F1000 score and journal impact (SNIP) increased, the average number of citations increased. Amongst these covariates, journal impact and OA had the highest association with the number of citations and the probability of being cited, respectively. The finding about journal impact is consistent with Andersen’s et al. [25] study, which found journal prestige as a covariate that accounted for most of the small average citation differences between genders. The finding about OA might show the importance of making an article open, as this makes it more visible, and thus easier for Twitter users to access the full text of articles. This in turn might translate into more citations.
With regard to MeSH topics, the results showed that while keeping all other variables in the model constant and with the same number of tweets, the articles with ‘Chemicals and Drugs’ MeSH topic had a higher probability of being cited (24.3%) and a higher average of citations (7.8%) in comparison to the rest of articles with other 13 MeSH topics. According to a study by Bhattacharya, Srinivasan and Polgreen [47], tweeting about MeSH topics such as ‘Chemicals and Drugs’ leads to more engagement (in terms of number of re-tweets) on Twitter. More engagement on Twitter does not guaranty more citations. However, it might provide increased visibility for papers with this topic, which may also make them be seen more by the scientific community.
The findings also showed that while some factors had a positive association with the average number of citations received (model 1, citation comparison), they had a very weak or almost no association with the later citation counts received (model 3, early tweet-later citation counts). As an example, the total number of citations by first and last authors had a positive association with the probability of a paper being cited (34.8%; 15.5%) and the average number of citations received in model 1 (36.2%; 17.7%). However, the association between the same variables and the average later citation counts in model 3 was almost none and the coefficients were very close to zero. Collectively, this could suggest that at the same number of tweets, scientific impact of authors, measured as total number of citations, has almost no association with the probability of a paper being cited and later average citations counts received.
This study has some limitations. The extent to which early tweet counts associates with later citation counts may vary by adding or removing factors from the model. However, the current model attempted to control for several important factors. By doing so, I was able to increase the probability of obtaining a more precise and reliable association between the early tweet counts and average number of citations received. It also should be considered that the analysis in this paper was limited to articles in the area of Life sciences and Biomedicine which were published in the time period of 2014–2016. Thus, the results obtained in this article are not comprehensive. Thus, caution should be advised with generalization of the results beyond the case studied.
Supporting information
S1 Appendix. Multicollinearity diagnostics results for Model 1.
https://doi.org/10.1371/journal.pone.0241723.s001
(DOCX)
S2 Appendix. Multicollinearity diagnostics results for Model 3.
https://doi.org/10.1371/journal.pone.0241723.s002
(DOCX)
S1 Fig. The percentage and number of articles by female and male authors in first and last authorship positions.
https://doi.org/10.1371/journal.pone.0241723.s003
(XLSX)
Acknowledgments
I would like to thank Mr. Jonathan Freer and Ms. Momena Khatun from the Department of Communication and Learning in Science (CLS) at Chalmers University of Technology for their assistance regarding the gender detection of authors. I also would like to thank Dr. Hajar Sotudeh from Shiraz University (Iran) for her valuable comments which helped to improve the paper. Finally, I would like to thank Mr. Alexander Mladenovic from Gothenburg University (Sweden) for his assistance regarding data collection.
References
- 1.
National Science Foundation. Women, Minorities, and Persons with Disabilities in Science and Engineering. National Center for Science and Engineering Statistics, 2019. Available from: https://ncses.nsf.gov/pubs/nsf19304/digest/field-of-degree-women
- 2.
Elsevier. Gender in the Global Research Landscape Report. 2017. Available from: https://www.elsevier.com/research-intelligence/resource-library/gender-report
- 3. Remich R, Jones R, Wood CV, Campbell PB, McGee R. How Women in Biomedical PhD Programs Manage Gender Consciousness as They Persist Toward Academic Research Careers. Acad Med. 2016;91(8):1119–27. pmid:27254008.
- 4. Plank-Bazinet JL, Heggeness ML, Lund PK, Clayton JA. Women's Careers in Biomedical Sciences: Implications for the Economy, Scientific Discovery, and Women's Health. J Womens Health (Larchmt). 2017;26(5):525–9. Epub 2016/08/10. pmid:27509297.
- 5.
European Commission E. SHE FIGURES 2018. Directorate-General for Research and Innovation, 2019. Available from: https://www.etag.ee/wp-content/uploads/2019/03/She-Figures-2018-1.pdf.
- 6. Lautenberger DM, Valerie MAT, Dandar M, Claudia MA, Raezer L, Sloane RA. The Pipeline and Pathways to Leadership: The State of Women in Academic Medicine. 2014.
- 7. Schisterman EF, Swanson CW, Lu Y-L, Mumford SL. The Changing Face of Epidemiology: Gender Disparities in Citations? Epidemiology. 2017;28(2):159–68. pmid:27930394.
- 8. Bendels MHK, Müller R, Brueggmann D, Groneberg DA. Gender disparities in high-quality research revealed by Nature Index journals. PLoS One. 2018;13(1): e0189136–e. pmid:29293499.
- 9. Thelwall MA. Authorship and citation gender trends in immunology and microbiology. FEMS Microbiology Letters. 2020;367(2). pmid:32025706
- 10. Symonds MRE, Gemmell NJ, Braisher TL, Gorringe KL, Elgar MA. Gender Differences in Publication Output: Towards an Unbiased Metric of Research Performance. PLoS One. 2006;1(1): e127. pmid:17205131
- 11. Huang M, Naser-Tavakolian K, Clifton M, Franceschi AM, Kim D, Zhang JZ, et al. Gender Differences in Article Citations by Authors from American Institutions in Major Radiology Journals. Cureus. 2019;11(8): e5313–e. pmid:31592368.
- 12.
International Committee of Medical Journal Editors (ICMJE). Uniform Requirements for Manuscripts Submitted to Biomedical Journals: Defining the Role of Authors and Contributors 2010. Available from: http://www.icmje.org/recommendations/browse/roles-and-responsibilities/defining-the-role-of-authors-and-contributors.html.
- 13. Mishra S, Fegley BD, Diesner J, Torvik VI. Self-citation is the hallmark of productive authors, of any gender. PLoS One. 2018;13(9): e0195773. pmid:30256792
- 14.
Paul-Hus A, Sugimoto C, Haustein S, Larivière V. Is there a gender gap in social media metrics? In: A.A. Salah, Tonta Y, Salah AAA, Sugimoto C, Al U, editors. 15th International Conference on Scientometrics & Informetrics; Istanbul, Turkey: Bogaziçi University Printhouse; 2015.
- 15. Klar S, Krupnikov Y, Ryan JB, Searles K, Shmargad Y. Using social media to promote academic research: Identifying the benefits of twitter for sharing academic work. PLoS One. 2020;15(4): e0229446. pmid:32251463
- 16. AbiGhannam N. Madam Science Communicator: A Typology of Women’s Experiences in Online Science Communication. Science Communication. 2016;38(4):468–94.
- 17. Wetsman N. How Twitter is changing medical research. Nat Med. 2020;26(1):11–3. Epub 2019/12/11. pmid:31819233.
- 18. Kretschmer H, Aguillo IF. New indicators for gender studies in Web networks. Information Processing & Management. 2005;41(6):1481–94. https://doi.org/10.1016/j.ipm.2005.03.009.
- 19. Bar-Ilan J, Van Der Weijden I. Altmetric Gender Bias?—An Exploratory Study. International Journal of Computer Science: Theory and Application. 2015;4(1):16–22.
- 20. Sotudeh H, Dehdarirad T, Freer J. Gender differences in scientific productivity and visibility in core neurosurgery journals: Citations and social media metrics. Research Evaluation. 2018;27(3):262–9.
- 21. Thelwall M, Kousha K. Academia.edu: Social network or Academic Network? Journal of the Association for Information Science and Technology. 2014;65(4):721–31.
- 22. Haustein S, Peters I, Sugimoto CR, Thelwall M, Larivière V. Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature. Journal of the Association for Information Science and Technology. 2014;65(4):656–69.
- 23. Eysenbach G. Can Tweets Predict Citations? Metrics of Social Impact Based on Twitter and Correlation with Traditional Metrics of Scientific Impact. J Med Internet Res. 2011;13(4): e123. Epub 16.12.2011. pmid:22173204.
- 24. Shuai X, Pepe A, Bollen J. How the Scientific Community Reacts to Newly Submitted Preprints: Article Downloads, Twitter Mentions, and Citations. PLoS One. 2012;7(11):e47523. pmid:23133597
- 25. Andersen JP, Schneider JW, Jagsi R, Nielsen MW. Gender variations in citation distributions in medicine are very small and due to self-citation and journal prestige. eLife. 2019;8:e45374. pmid:31305239
- 26.
Gallivan MJ, editor Analyzing citation impact of IS research by women and men: Do women have higher levels of research impact? SIGMIS-CPR'12—Proceedings of the 2012 Computers and People Research Conference; 2012.
- 27. Mirnezami SR, Beaudry C, Larivière V. What determines researchers’ scientific impact? A case study of Quebec researchers. Science and Public Policy. 2015;43(2):262–74.
- 28. Piwowar H, Priem J, Larivière V, Alperin JP, Matthias L, Norlander B, et al. The state of OA: a large-scale analysis of the prevalence and impact of Open Access articles. PeerJ. 2018;6: e4375–e. pmid:29456894.
- 29. Björk B-C, Catani P. Peer review in megajournals compared with traditional scholarly journals: Does it make a difference? Learned Publishing. 2016;29(1):9–12.
- 30. Heneberg P. The troubles of high-profile open access megajournals. Scientometrics. 2019;120(2):733–46.
- 31. Abramo G, D’Angelo CA, Di Costa F. Specialization versus diversification in research activities: the extent, intensity and relatedness of field diversification by individual scientists. Scientometrics. 2017;112(3):1403–18.
- 32. Didegah F, Bowman TD, Holmberg K. On the differences between citations and altmetrics: An investigation of factors driving altmetrics versus citations for finnish articles. Journal of the Association for Information Science and Technology. 2018;69(6):832–43.
- 33. Zahedi Z, Haustein S. On the relationships between bibliographic characteristics of scientific documents and citation and Mendeley readership counts: A large-scale analysis of Web of Science publications. Journal of Informetrics. 2018;12(1):191–202. https://doi.org/10.1016/j.joi.2017.12.005.
- 34. Haustein S, Costas R, Larivière V. Characterizing Social Media Metrics of Scholarly Papers: The Effect of Document Properties and Collaboration Patterns. PLoS One. 2015;10(3): e0120495. pmid:25780916
- 35. Holmberg K, Hedman J, Bowman TD, Didegah F, Laakso M. Do articles in open access journals have more frequent altmetric activity than articles in subscription-based journals? An investigation of the research output of Finnish universities. Scientometrics. 2020;122(1):645–59.
- 36. Dehdarirad T, Didegah F. To What Extent Does the Open Access Status of Articles Predict Their Social Media Visibility? A Case Study of Life Sciences and Biomedicine. Journal of Altmetrics 2020;3(1). http://doi.org/10.29024/joa.29.
- 37. Thelwall M, Nevill T. Could scientists use Altmetric.com scores to predict longer term citation counts? Journal of Informetrics. 2018;12(1):237–48. https://doi.org/10.1016/j.joi.2018.01.008.
- 38. Santamaría L, Mihaljević H. Comparison and benchmark of name-to-gender inference services. PeerJ Computer Science. 2018;4: e156.
- 39. Sharma H, Verma S. Authorship in biomedical research: A sweet fruit of inspiration or a bitter fruit of trade. Trop Parasitol. 2018;8(2):62–9. Epub 2018/12/27. pmid:30693209.
- 40. Spezi V, Wakeling S, Pinfield S, Creaser C, Fry J, Willett P. Open-access mega-journals: The future of scholarly communication or academic dumping ground? A review. Journal of Documentation. 2017;73(2):263–83.
- 41. Shailes S. Plain-language Summaries of Research: Something for everyone. eLife. 2017; 6:e25411. pmid:28294940
- 42.
Faculty Opinions (2020). About faculty opinions. Avilable from https://facultyopinions.com/prime/faq.
- 43. Zeileis A, Kleiber C, Jackman S. Regression Models for Count Data in R. 2008. 2008;27(8):25. Epub 2008-07-29.
- 44.
Cameron AC, Trivedi PK. Regression Analysis of Count Data. Second Edition ed. Cambridge: Cambridge University Press; 2013.
- 45.
James G, Witten D, Hastie T, Tibshirani R. Linear Regression. An Introduction to Statistical Learning: with Applications in R. New York, NY: Springer New York; 2013. p. 59–126.
- 46. Peoples BK, Midway SR, Sackett D, Lynch A, Cooney PB. Twitter Predicts Citation Rates of Ecological Research. PLoS One. 2016;11(11): e0166570. pmid:27835703
- 47. Bhattacharya S, Srinivasan P, Polgreen P. Engagement with Health Agencies on Twitter. PLoS One. 2014;9(11): e112235. pmid:25379727