Table 1.
Sample.
Table 2.
Number of articles from which p-values were retrieved, number of p-values retrieved per journal, and mean number of p-values retrieved per article and per journal.
Figure 1.
Flow chart for composition of sample.
Figure 2.
The probability per journal that an article contains at least one p-value comprising an error or gross error (with 95% confidence interval).
Note. JAP = Journal of Applied Psychology (n = 42); JCCP = Journal of Consulting and Clinical Psychology (n = 67); JCN = Journal of Cognitive Neuroscience (n = 107); JCPP = Journal of Child Psychology and Psychiatry (n = 39); JPSP = Journal of Personality and Social Psychology (n = 133); PP = Psychophysiology (n = 42); TOTAL = all articles together (N = 430).
Figure 3.
The probability per journal that a given p-value comprises an error or a gross error (with 95% confidence interval).
Note. JAP = Journal of Applied Psychology (n = 340); JCCP = Journal of Consulting and Clinical Psychology (n = 833); JCN = Journal of Cognitive Neuroscience (n = 1,721); JCPP = Journal of Child Psychology and Psychiatry (n = 444); JPSP = Journal of Personality and Social Psychology (n = 4,018); PP = Psychophysiology (n = 749); TOTAL = all p-values together (N = 8,105).
Figure 4.
The percentage of articles in which co-piloting occurred for various processes (with 95% confidence intervals).
Note. statistical analyses = conducting the statistical analyses (N = 335); write up sample details = writing the sample details in the manuscript (N = 330); write up results = writing up the results in the manuscript (N = 334); check results in manuscript = checking of the results in the manuscript by someone other than the person who wrote up the results in the manuscript (N = 326); data sharing at submission = having access to the data at the moment the manuscript was submitted (N = 333); data sharing now = having access to the data at the moment the survey was being filled in (N = 332).
Figure 5.
The probability that a p-value in the first (or only) study reported comprises an error: co-piloted studies versus non-co-piloted studies.
Note. statistical analyses = conducting the statistical analyses (N = 2,247); write up sample details = writing the sample details in the manuscript (N = 2,215); write up results = writing up the results in the manuscript (N = 2,231); check results in manuscript = checking of the results in the manuscript by someone other than the person who wrote up the results in the manuscript (N = 2,185); data sharing at submission = having access to the data at the moment the manuscript was submitted (N = 2,228); data sharing now = having access to the data at the moment the survey was being filled in (N = 2,226).
Figure 6.
The probability that a p-value in the first (or only) study reported comprises a gross error: co-piloted studies versus non-co-piloted studies.
Note. statistical analyses = conducting the statistical analyses (N = 2,247); write up sample details = writing the sample details in the manuscript (N = 2,215); write up results = writing up the results in the manuscript (N = 2,231); check results in manuscript = checking of the results in the manuscript by someone other than the person who wrote up the results in the manuscript (N = 2,185); data sharing at submission = having access to the data at the moment the manuscript was submitted (N = 2,228); data sharing now = having access to the data at the moment the survey was being filled in (N = 2,226).