26 Mar 2013: Nye JVC, Androuschak G, Desierto D, Jones G, Yudkevich M (2013) Correction: 2D:4D Asymmetry and Gender Differences in Academic Performance. PLoS ONE 8(3): 10.1371/annotation/8e05e33b-58cf-4983-b021-3a65d27ef2a1. doi: 10.1371/annotation/8e05e33b-58cf-4983-b021-3a65d27ef2a1 View correction
Exposure to prenatal androgens affects both future behavior and life choices. However, there is still relatively limited evidence on its effects on academic performance. Moreover, the predicted effect of exposure to prenatal testosterone (T)–which is inversely correlated with the relative length of the second to fourth finger lengths (2D:4D)–would seem to have ambiguous effects on academic achievement since traits like aggressiveness or risk-taking are not uniformly positive for success in school. We provide the first evidence of a non-linear, quadratic, relationship between 2D:4D and academic achievement using samples from Moscow and Manila. We also find that there is a gender differentiated link between various measures of academic achievement and measured digit ratios. These effects are different depending on the field of study, choice of achievement measure, and use of the right hand or left digit ratios. The results seem to be asymmetric between Moscow and Manila where the right (left) hand generates inverted-U (U-shaped) curves in Moscow while the pattern for hands reverses in Manila. Drawing from unusually large and detailed samples of university students in two countries not studied in the digit literature, our work is the first to have a large cross country comparison that includes two groups with very different ethnic compositions.
Citation: Nye JVC, Androuschak G, Desierto D, Jones G, Yudkevich M (2012) 2D:4D Asymmetry and Gender Differences in Academic Performance. PLoS ONE 7(10): e46319. doi:10.1371/journal.pone.0046319
Editor: Bin He, Baylor College of Medicine, United States of America
Received: February 28, 2012; Accepted: August 30, 2012; Published: October 8, 2012
Copyright: © Nye et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: These authors have no support or funding to report.
Competing interests: The authors have declared that no competing interests exist.
Performance in schooling is known to be dependent on cognitive ability, family background, and social status, but it is also heavily influenced by biological and psychological traits independent of or even orthogonal to standard notions of cognitive ability. These include aggressiveness or self-confidence, conscientiousness, and/or willingness to take risks. (For cognitive ability, see . For noncognitive skills, see  and ).
Some of these characteristics may derive partly from prenatal exposure to androgenic steroids. The most common marker for measuring prenatal androgens is the second-to-fourth finger digit length ratio (henceforth 2D:4D) with relatively longer fourth fingers (lower 2D:4D) indicating higher fetal androgens . Previous work has shown links between digit ratios and success in competitive sports, preference for risk, and success in high frequency financial trading (e.g. – for sports; – for risk; and  on financial trading).
However, the most recent large surveys do not support robust, within-sex correlations between 2D:4D and the masculinity/femininity personality dimensions  and only small effects for 2D:4D and aggression . What seems to persist are the links to sporting ability and to risk taking and financial trading mentioned above.
Ties to academic achievement are even less well-explored. There is some limited work on the relationship between 2D:4D and academic performance but the findings are mixed and often based on limited samples. Romano found that adult males’ 2D:4D ratios positively predicted examination grades while females’ marks were uncorrelated with these ratios . Others have studied British school children’s digit ratios and their correlations with their numeracy and literacy . Digit ratios were not found to be significant for the group as a whole but there were sex based differences whereby lower digit ratios predicted numeracy for boys and higher digit ratios predicted higher literary SAT scores for girls – though in both cases the effects were small. Similarly, Bull et al.  found no correlations between the digit ratios and numerical or visual-spatial tasksof children.
Brosnan et al.  considered a small group of computer science students to see if prenatal testosterone exposure was related to performance and computeranxiety, however they found few correlations and no sex-related differences in grades. However, lower computer anxiety was associated with lower 2D:4D ratios.
The strongest claims on 2D:4D effects that might be relevant for understanding academic achievement are to be found in Branas-Garza and Rustichini’s  work which follows up on the demonstrated link between prenatal T exposure (low 2D:4D) and success in financial trading. They find links between low measured 2D:4D and higher performance on tests of abstract reasoning, as well as risk taking. This work might suggest that we should observe low 2D:4D predicting higher academic achievement to the extent that the abstract reasoning relationship is dominant. However, as Branas-Garza and Rustichini  note, the interaction between the gender specific effects of 2D:4D and its links to abstract reasoning and risk taking are fairly complex especially considering the much stronger links between abstract reasoning and risk-taking for males. There seems to be no link between digit ratio and risk taking for females.
This work, seen in light of the earlier diverse findings showing at best weak links between 2D:4D and academic performance suggests that there might be strongly sex differentiated effects; further, the unreliable findings across studies could be driven by nonlinearity in the relationship between testosterone and later outcomes. Some characteristics associated with high testosterone could plausibly have non-linear effects on performance – some risk-taking or aggressiveness, for instance, might be beneficial, but too much might lead to destructive behavior (e.g.  shows low digit ratios correlated with increased tendency to alcohol dependency). Also, the importance of abstract reasoning in determining achievement might vary by field of study and program.
Sapienza et al.  were among the first to highlight potential nonlinearities as confounding the effects of prenatal testosterone exposure that might result in insignificant linear estimations but did not directly test for non-linear effects themselves.
Materials and Methods
The various findings from the literature suggest that the effect of 2D:4D on academic outcomes may be more complex than a linear relationship. There may be many other relevant factors that affect academic outcomes that happen to be correlated with 2D:4D, and any effect of 2D:4D on academic outcomes obtained from a simple linear specification may be an incomplete approximation.
To verify whether the effect could actually be non-linear, and would vary across academic fields and between genders, we specify the following model:
(1)where the academic outcome W of individual i of gender in field f with digit ratio DR of hand is a quadratic function of DR. Note that equation (1) not only controls for gender and academic field, but also allows for the possibility that results may differ depending on which hand is used. This is because the physiology of how and to what extent prenatal testosterone is manifested in digit ratios is still unclear, which makes it difficult to ascertain whether it is the left or the right hand that best reflects prenatal testosterone. For example,  and  get significant results with both hands’ digit ratios, but  gets consistency for both hands only for males and only left hand results for females. Articles , ,  and  only get significance for males’ right hands, while , , and  use averages of both hands.
To empirically test equation (1), we use two different cross-sectional datasets – one is a sample of over 700 students from the Higher School of Economics (HSE) in Moscow, and the other is a sample of about 120 students from the University of the Philippines School of Economics (UPSE) in Manila. For both Moscow and Manila, all the students in the samples were recruited for the study in a manner consistent with local protocols for human subject research. Though no signed consent forms were obtained, permission for the study was formally obtained at the HSE and the UPSE in accordance with local practice. In addition, the overall survey and research design was reviewed by the George Mason University Office of Research Subjects Protection and it was determined that no review by the Human Subjects Review Board was necessary for participation by the two authors representing GMU who were not directly involved in collecting the survey information presented to them in anonymous form.
In Moscow, measurements of the second and fourth fingers of both the left and right hands of all the subjects were taken by two research assistants using a laser caliper (with the exception of those subjects who had stated in the questionnaire that they had broken their second and/or fourth finger – these were then omitted). In Manila, we had the subjects photocopy their left and right hands, and from these, two research assistants obtained the lengths of the second and fourth fingers using tape measures. Whether by laser caliper or tape measure, finger length is measured as the distance between the middle of the line at the base of the finger up to the point on the fingertip that is perpendicular to that base. Note that in both Moscow and Manila, subjects were allocated among the research assistants, but each assistant measured both the left and right-hand fingers of the subjects assigned to her. Thus, while there may be some variability in the measurements across subjects, we do not expect any biased difference between the measurements of the left hand and the right hand and/or between the measurements of the second and fourth fingers of each hand.
From these measurements, each subject’s digit ratio was computed by dividing the length of the subject’s second finger to the length of her fourth finger, for her left and right hands. For both Moscow and Manila samples, we thus have two proxies for , denoted as Left hand 2D:4D and Right hand 2D:4D.
We use several proxies for individual academic outcomes . For the Moscow sample, we have information on test scores on the college entrance exam–the Unified State Exam (USE)–particularly the Math Score and the Russian (language) Score. (It should be noted that there was an old version of the USE which was in a different form and used a different grading scale. This old USE was taken by the oldest students in the original sample and only as an option, unlike the new version of the USE which is compulsory. To get a consistent set of students for the final sample, we only included the younger students, i.e. those who took the new version of the USE. However, as a robustness check, we also ran regressions using the original sample in which students who took the old USE were included, after re-scaling their scores to approximate the new USE. The results are generally similar to the ones reported in this paper and can be provided upon demand).
We also have data on whether the subject was admitted to HSE based on high scores in pre-college competitions called Olympiads; whether the subject was a recipient of high school honors; and whether the subject was admitted to HSE with a full academic scholarship (virtually all HSE scholarships are based on academic criteria only using non-subjective formulae). For these we constructed the corresponding binary variables Olympiad, High School Honors and Full Scholarship.
For the Manila sample, the subjects provided their grades for all economics courses taken to date and their grades for all mathematics courses taken to date. We converted these to the US grading scale (using the official guidelines of the University of the Philippines) and computed the Economics Weighted Average and the Mathematics Weighted Average according to the University’s convention of using the number of units of the course as its weight.
We also have data on the subjects’ gender from both Moscow and Manila. In addition, because HSE is further divided into different faculties, we create binary variables indicating the particular Faculty to which each Moscow subject belongs: Faculty(Economics), Faculty(Law), Faculty(Management) and Faculty(Political Science).
Summary Statistics and Bivariate Correlations
Tables 1 and 2 list all the variables used in this study and provides some descriptive statistics. Note that for the full sample, and separately among females and among males, the mean Math Score is lower than mean Russian Score, and the mean Mathematics Weighted Average is lower than the Economics Weighted Average. In the Manila sample, females on average have significantly lower Economics and Mathematics Weighted Averages than males, while in Moscow, females on average have significantly higher Russian Scores than males, and that they are also more likely to have High School Honors and Full Scholarship. Furthermore, the choice of Faculty may also be gender-differentiated, with females in Moscow significantly more likely to be in Political Science but less likely to be in Economics.
For both Manila and Moscow, the mean values of the Right hand 2D:4D and Left hand 2D:4D are significantly different for males and females, with females having significantly higher Right hand 2D:4D and Left hand 2D:4D than males. This suggests that, on average, females have significantly less prenatal testosterone exposure than males. In addition, the mean values of Right 2D:4D for females are similar across Manila and Moscow, but the mean Left 2D:4D is lower for females in Manila than in Moscow. Judging only by the left hand, this suggests that female Manila students may have more prenatal testosterone on average than female Moscow students. Male Manila students also may have higher prenatal testosterone than male Moscow students, as the former’s mean Right and Left 2D:4D are lower than the latter’s.
Tables 3, 4, 5, and 6 present bivariate correlations among all the variables for the full sample, and separately for the female and male subsamples. Note that the different academic outcome variables are significantly and positively correlated, with the exception of the Olympiad variable in Moscow which is negatively correlated with Math scores and Russian scores, but positively correlated with High School Honors and Full Scholarship. The correlations, however, are less than half, even between the Mathematics and Economics Weighted Averages in Manila, or between Math and Russian Scores in Moscow. (That the former correlation is larger than the latter may be expected, since economics courses are mathematics-based.)
Note also that while Left hand 2D:4D and Right hand 2D:4D are positively correlated in both samples, the correlation is not very high – only 0.55 for Manila and 0.56 for Moscow when aggregating females and males. The correlations appear larger for females than males, with 0.56 for females in Manila and 0.47 for males, and 0.57 for females in Moscow and 0.52 for males. This indicates that prenatal testosterone may be expressed differently between the hands, and between females and males, and suggests that regression results may differ significantly by gender and depending on which hand is used. In fact, Full Scholarship is significantly positively correlated with both Left and Right 2D:4D for males in Moscow, while the Mathematics Weighted Average is correlated with Right 2D:4D for females in Manila.
Gender also appears to have a direct correlation with academic outcomes and digit ratios. In Manila, being female is negatively correlated with the Economics and Mathematics Weighted Average, and positively correlated with Left and Right 2D:4D. Being female is also positively correlated with digit ratios in Moscow, but unlike Manila, it is positively correlated with academic outcome variables, specifically, Russian Score, High School Honors and Full Scholarship.
Lastly, note that the Faculty variables in Moscow are significantly correlated with the academic outcome variables for the full sample, and when subdividing by gender. In particular, Faculty (Economics) is positively related to all outcomes except Full Scholarship, while Faculty (Law), Faculty (Management), and Faculty (Political Science) are negatively related to most of the outcome variables.
Non-linear (Quadratic) Association between 2D:4D and Academic Outcomes
The foregoing suggests that gender, choice of Faculty and hand measured can modify the association between digit ratio and academic outcomes. Figures 1a, 1b, 2a, 2b, 3a, 3b, 4a, and 4b further suggest that such associations may be nonlinear, specifically quadratic, for both Manila and Moscow.
The Manila graphs depict an inverted-U relationship between Mathematics Weighted Average and Left 2D:4D for females (but not so for males), as well as an inverted-U relationship between Economics Weighted Average and Left 2D:4D for males (but not for females). Note, however, that when the Right 2D:4D is used, the non-linear relationships are now U-shaped for both males and females.
On the other hand, the Moscow graphs generally show inverted-U relationships between various academic outcomes and Right 2D:4D, even within different Faculties (especially for females), while the relationships between outcomes and Left 2D:4D are mostly U-shaped (especially for males).
We now provide more rigorous regression-based tests of our hypothesis that digit ratios affect academic outcomes in a quadratic manner and that the effects are differentiated between genders, Faculty types, and left and right hands.
The next tables report the results from OLS regressions of equation (1) for the continuous dependent variables in Moscow and Manila, i.e. Math Scores, Russian, Scores, Economics Weighted Average and Mathematics Weighted Average. For the binary dependent variables High School Honors, Olympiad and Full Scholarship, equation (1) is interpreted as a Linear Probability Model (LPM). As an alternative to the LPM, logit regressions are also reported. Whenever the OLS/LPM results show that there is a significant quadratic relationship between 2D:4D and the academic outcome, we also compute the optimal value of 2D:4D that maximizes or minimizes this academic outcome. That is, maxima are computed for significant inverted-U relationships, while minima are computed for significant U-shaped relationships. Note that an inverted-U (U-shaped) relationship is implied by a positive (negative) estimated coefficient b1 and a negative (positive) estimated coefficient b2. (The maxima/minima are not computed for the logit regressions since unlike in the OLS/LPM, the marginal effect of the digit ratio is not readily computed from the estimated coefficients in the logit regressions. Although the marginal effects from logit regressions are not reported here, they are very similar to the LPM, and can be provided by the authors upon request. However, to get an approximate comparison between LPM and Logit results, one can divide the estimated logit coefficients by 4). Lastly, we also indicate whether the variables are significant in backward stepwise regressions, specifically those whose p-values in backward stepwise regressions are equal to or less than the chosen tolerance level p = 0.10 and thus ought not to be removed from the model.
Tables 7, 8, 9, and 10 present the various regression results for Moscow when Left 2D:4D is used. The results for subsamples Female and Male are reported in separate columns. However, the results for the various Faculty subsamples are concisely reported in single specifications involving interaction terms of the various Faculty binary variables with 2D:4D, and with the square of 2D:4D. Thus, columns with no interaction terms are the results from regressions by gender only, while those with interaction terms are results from regressions by gender and faculty type. To interpret the latter columns, note that the chosen base group is Faculty(Economics), such that the coefficients from the uninteracted 2D:4D and square of 2D:4D pertain to the estimated coefficients b1 and b2 for subsample Faculty (Economics) (that is, when all Faculty dummies are zero). For subsample Faculty (Law), that is, when Faculty(Law) is one (and other Faculty dummies are zero), its coefficient b1 is thus equal to the sum of the coefficients of 2D:4D and of 2D:4D × Faculty(Law), while the coefficient b2 is the sum of the coefficients of square of 2D:4D and of square of 2D:4D × Faculty(Law).
Note that the results from logit regressions are similar to the LPM – dividing the logit estimates by 4 gives values that are close to the LPM estimates. The backward stepwise regressions generally confirm the results, as variables are significant whenever they are significant in the OLS/LPM/logit regressions. However, the backward stepwise regressions seem to yield more significant results - see, for instance, female and male Math Scores, male HS Honors, female Olympiads, and female Full Scholarship. This indicates that the variables are jointly significant, even if they are individually insignificant in the OLS/LPM/Logit regressions. In fact, note that the R-squared and F-stat are high, and the p-value(F) is low. That the variables are jointly significant is consistent with the results implied by the backward stepwise regressions which indicate that most of the variables ought to be included in the model.
It can be seen that the significant relationships are U-shaped and mostly hold for male students. Without controlling for Faculty type, there are significant U-shaped relationships between Left 2D:4D and Math Score, Olympiad and Full Scholarship for the male subsample. When we further break down the sample by Faculty type, we find significant U-shaped relationships between Left 2D:4D and the following: High School Honors for female law students; Olympiad for male economics students; Russian Score for female law and female political science students; and Full Scholarship for male economics students. Note, however, that for Russian Scores for female law and female political science students, the computed Lmin values lie outside the range of Left 2D:4D values in the Moscow sample. For law, Lmin is below the lowest 2D:4D, which indicates that the sample is on the upward-sloping part of the U-curve; while for political science, the sample is on the downward-sloping part of the U-curve (since their Lmin is above the highest 2D:4D in the sample).
Tables 11, 12, 13, and 14 present the regression results for Moscow when the Right 2D:4D is used. It can be seen that the significant quadratic relationships are inverted-U and mostly hold for females, with the exception of the High School Honors for male political science students, Olympiad for male law students and Full Scholarship for male law students. (In the latter cases, however, their respective Rmax are below the lowest 2D:4D in the sample, implying that the sample is actually on the upward-sloping part of the U-curves). That is, the U-shaped cases only hold for male samples. Without controlling for faculty type, Right 2D:4D is seen to have a significant inverted-U relationship between High School Honors for females, Olympiad for males, Math Scores of females, Russian Scores of females, and Full Scholarship for females. When considering faculty subsamples, Right 2D:4D is shown to have significant inverted-U relationships between: High School Honors for female economics and female law students: Olympiad for male law students; Math Score of female economics students; Russian Score of female economics and female political science students.
Table 15 reports regression results for Manila using Left 2D:4D. We find that the only significant result is for females–their Mathematics Weighted Average and Left 2D:4D have an inverted-U relationship. Table 16 reports results using Right 2D:4D, where it can be seen that Right 2D:4D is significantly related to both Economics and Mathematics Weighted Average in a U-shaped fashion, both for males and females. (Backward stepwise regressions yield significant results only for the Right 2D:4D, and mostly for females).
All these results indicate the following patterns across Manila and Moscow. In Moscow, using the right (left) hand generates inverted-U (U-shaped) curves while in Manila, using the left (right) hand generates the inverted-U (U-shape).That is, without accounting for gender, the results for Manila are opposite of those for Moscow depending on which hand is used. However, when we consider gender subsamples, both Manila and Moscow seem to produce a consistent trend in that the U-shaped curve seems to be more associated with male students. In Manila, while Right 2D:4D also generates U-shaped curves for females, note that the only significant results for males are U-shaped. In Moscow, it seems that irrespective of which hand is used, the significant results for males are almost always U-shaped.
We have shown in both Moscow and Manila that the degree to which prenatal testosterone is linked to academic achievement exhibits some nonlinearity, and the precise relationship is dependent on gender, faculty, or subject choice, and on which hand is used to proxy for prenatal testosterone.
To the extent we do not yet understand the precise mechanism through which prenatal androgens manifest themselves in the right versus the left hand, this suggests that much more needs to be done to learn how we can use these measures to study the effects of prenatal testosterone on achievement. Our research combined with the findings of  make clear that the potential nonlinearity in prenatal testosterone’s effects coupled to the differential benefits of abstract reasoning in different contexts would lead to highly particular links of 2D4D to achievement depending on field or choice of achievement measure. We might speculate for example that the strong results in sports or in financial trading are in areas where there is no tradeoff to greater abstract reasoning combined with greater risk taking. In other situations, nonlinearity is more likely to emerge and it might be harder to discern these interactions without further identifying restrictions.
We would like to thank Karen Lazaro, Ekaterina Orel, DilyaraValeeva, Ekaterina Kochergina, and Filipinas Bundoc for excellent research assistance. We are grateful to Aldo Rustichini and to two anonymous referees for comments and suggestions.
Conceived and designed the experiments: JN DD GJ MY. Performed the experiments: GA MY. Analyzed the data: JN GA DD GJ. Wrote the paper: JN DD GJ.
- 1. Plomin R, Petrill SA (1997) Genetics and intelligence: What's new? Intelligence 24(1): 53–77. doi: 10.1016/s0160-2896(97)90013-1
- 2. Heckman JJ, Stixrud J Urzua S (2006) The effects of cognitive and noncognitive abilities on labor market outcomes and social behavior. J Labor Econ 24(3): 411–482. doi: 10.1086/504455
- 3. De Raad B, Schouwenberg HC (1996) Personality in learning andeducation: a review. Eur J Pers 10(5): 303–336. doi: 10.1002/(sici)1099-0984(199612)10:5<303::aid-per262>3.0.co;2-2
- 4. Manning JT (2002) Digit Ratio. New Brunswick, NJ: Rutgers University Press.
- 5. Honekopp J, Manning JT, Muller K (2006) Digit ratio (2D:4D) and physical fitness in males and females: Evidence for effects of prenatal androgens on sexually selected traits. Horm Behav 49(4): 545–549. doi: 10.1016/j.yhbeh.2005.11.006
- 6. Manning JT, Morris L, Caswell N (2007) Endurance running and digit ratio (2D:4D): Implications for fetal testosterone effects on running speed and vascular health. Am J Hum Biol 19(3): 416–421. doi: 10.1002/ajhb.20603
- 7. Apicella L, Dreber A, Campbell B, Gray PB, Hoffman M, et al. (2008) Testosterone and financial risk preferences. Evol Hum Behav 29: 384–390. doi: 10.1016/j.evolhumbehav.2008.07.001
- 8. Sapienza P, Zingales L, Maestripieri D (2009) Gender differences in financial risk aversion and career choices are affected by testosterone. PNAS 106(36): 15268–15273. doi: 10.1073/pnas.0907352106
- 9. Stenstrom E, Saad G, Nepomuceno MV, Mendenhall Z (2011) Testosterone and domain-specific risk: Digit ratios (2D:4D and rel2) as predictors of recreational, financial and social risk-taking behaviors. Pers Individ Diff 51(4): 412–416. doi: 10.1016/j.paid.2010.07.003
- 10. Coates JM, Gurnell M, Rustichini A (2009) Second-to-fourth digit ratio predicts success among high-frequency financial traders. PNAS 106(2): 623–628. doi: 10.1073/pnas.0810907106
- 11. Voracek M, Pietschnig J, Nader IW, Stieger S (2011) Digit ratio (2D:4D) and sex-role orientation: Further evidence and meta-analysis. PersIndivid Diff 51(4): 417–422. doi: 10.1016/j.paid.2010.06.009
- 12. Honekopp J, Watson S (2011) Meta-analysis of the relationship between digit-ratio 2D:4D and aggression. PersIndivid Diff 51(4): 381–386. doi: 10.1016/j.paid.2010.05.003
- 13. Romano M, Leoni B, Saino N (2006) Examination marks of male university students positively correlate with finger length ratios (2D:4D). Biol Psychol 71: 175–182. doi: 10.1016/j.biopsycho.2005.03.006
- 14. Brosnan MJ (2008) Digit ratio as an indicator of numeracy relative to literacy in 7-year-old British schoolchildren. Br JPsychol 99: 75–85. doi: 10.1348/000712607x197406
- 15. Bull R, Davidson WA, Nordmann E (2010) Prenatal testosterone, visual-spatial memory, and numerical skills in young children. Learn Individ Differ 20(3): 246–250. doi: 10.1016/j.lindif.2009.12.002
- 16. Brosnan M, Gallop V, Iftikhar N, Keogh E (2011) Digit ratio (2D:4D), academic performance in computer science and computer-related anxiety. Pers Individ Dif 51(4): 371–375. doi: 10.1016/j.paid.2010.07.009
- 17. Brañas-Garza P, Rustichini A (2011) Organizing Effects of Testosterone and Economic Behavior: Not Just Risk Taking. PLoS ONE 6(12): e29842. doi: 10.1371/journal.pone.0029842
- 18. Kornhuber J, Erhard G, Lenz B, Kraus T, Sperling W, et al. (2011) Low digit ratio 2D:4D in alcohol dependent patients. PLoS ONE 6(4): e19332. doi: 10.1371/journal.pone.0019332