Figures
Citation: Fredrickson BL (2016) Selective Data Analysis in Brown et al.'s Continued Critical Reanalysis. PLoS ONE 11(8): e0160565. https://doi.org/10.1371/journal.pone.0160565
Editor: Neil R. Smalheiser, University of Illinois-Chicago, UNITED STATES
Received: May 26, 2016; Accepted: July 21, 2016; Published: August 4, 2016
Copyright: © 2016 Barbara L. Fredrickson. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This research was funded by a grant from the National Institutes of Health (http://www.nih.gov): R01NR012899 (BLF), which is supported by the National Institutes of Health Common Fund, which is managed by the National Institutes of Health Office of the Director/Office of Strategic Coordination. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The author has the following conflicts. The present Formal Comment challenges a reanalysis presented by Brown et al. [1], which was critical of an empirical report by the current author and her colleagues that appeared in PLOS ONE in 2015 [2]. That 2015 empirical report offered new data that challenged critical statements made previously by Brown et al. [5] regarding a 2013 empirical report by the current author and her colleagues that appeared in the Proceedings of the National Academies of Science, USA [4].
In their latest critique [1], Brown et al. verify the primary statistical results of our 2015 PLoS ONE report [2]. The results Brown et al. report for their mixed effect linear model analyses of our Confirmation study and pooled Discovery and Confirmation studies in their Table 3 [1] are nearly identical to the results we reported in our Tables 2 and 3 [2].
Nevertheless, Brown et al. continue to dispute the conclusions that follow from these results. They do so by selectively re-analyzing our Discovery study dataset (N = 76), which represents only 25% of the data presented in our 2015 report. Using this approach, Brown et al. argue that the relationship between eudaimonic well-being and gene expression is sensitive to (1) the inclusion vs. exclusion of a single data case (SOBC1-1293), and (2) the effects of a coding error in the originally posted covariate data for another data case (SOBC1-1299). However, analysis of the full set of data presented in our Discovery and Confirmation studies (N = 198) reveals that the association of eudaimonic well-being with gene expression is not materially affected by either of these factors (see Table 1 herein).
The mixed effect linear model analyses reported in Table 1 account for correlation among the multiple indicator genes examined [3] and continue to indicate a significant inverse relationship between eudaimonic well-being and gene expression, regardless of SOBC1-1293 exclusion or the SOBC1-1299 coding error. (Because SOBC1-1293 and SOBC1-1299 come from the Discovery study sample, they have no effect on analyses of the Confirmation study dataset alone [N = 122] or the Generalization study dataset [N = 107].) The Discovery study sample alone is too small to provide a well-powered mixed effect linear model analysis. Thus, it is unsurprising that Brown et al.’s Table 4 [1] shows non-significant regression coefficients for eudaimonic well-being and point estimates that vary substantially from those of the better-powered analyses of the Confirmation study and the pooled Discovery and Confirmation studies (reported in our Tables 2 and 3, respectively [2], and Brown et al.’s Table 3 [1]). This discrepancy in statistical power between Brown et al.’s selective reanalyses (reported in their Table 4) and a more complete analysis (replicated in their Table 3) is evident in the larger Standard Errors (SE) in their Table 4 versus Table 3 [1].
In their previous critique of our 2013 report [4] on gene expression correlates of well-being, Brown et al. [5] argued for the replication of findings in additional samples using mixed effect linear model analyses. Such data are now available from two new samples with 229 new participants, and results continue to indicate a significant inverse relationship between eudaimonic well-being and gene expression. Brown et al.’s claims of statistical instability rely on selective omission of these new data, which comprise 75% of the data presented in our 2015 PLoS ONE report.
Acknowledgments
The author wishes to thank Steve W. Cole for valuable contributions to this Comment.
Author Contributions
- Conceptualization: BLF.
- Formal analysis: BLF.
- Writing - original draft: BLF.
- Writing - review & editing: BLF.
References
- 1. Brown NJL, MacDonald DA, Samanta MP, Friedman HL, & Coyne JC (2016) More questions than answers: Continued Critical Reanalysis of Fredrickson et al.’s studies of genomics and well-being. PLoS ONE pmid:27270924
- 2. Fredrickson BL, Grewen KM, Algoe SB, Firestine AM, Arevalo JMG, Ma J, Cole SW (2015) Psychological well-being and the human conserved transcriptional response to adversity. PLoS ONE 10(3): e0121839. pmid:25811656
- 3.
McCulloch CE, Searle SR, Neuhaus JM (2008) Generalized, linear, and mixed models. Hoboken NJ: John Wiley & Sons.
- 4. Fredrickson BL, Grewen KM, Coffey KA, Algoe SB, Firestine AM, Arevalo JM, Ma J, Cole SW (2013) A functional genomic perspective on human well-being. Proc Natl Acad Sci U S A 110: 13684–13689. pmid:23898182
- 5. Brown NJ, MacDonald DA, Samanta MP, Friedman HL, Coyne JC (2014) A critical reanalysis of the relationship between genomics and well-being. Proc Natl Acad Sci U S A