Peer Review History
| Original SubmissionJuly 26, 2019 |
|---|
|
PONE-D-19-20912 Trait Self-Control Does Not Predict Attentional Control: Evidence from a Novel Attention Capture Paradigm PLOS ONE Dear Mr. Dieciuc, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Thank you for submitting your very nice paper to PLOS One. The paper is almost ready for publication, but before I accept it I would like you to perform the following additional analyses of the data: 1) As suggested by referee 1, please compare behavior in the early rounds of a session with behavior in the later ones. 2) As suggested by referee 2, please run additional analyses that include the available demographic information. If you find that this has little impact and/or that the controls are statistically insignifcant then you could mention that in a footnote; otherwise it would seem natural to include it in the text. 3) As also suggested by referee 2, please do some analysis of the te the influence of self-control on attentional capture- regression is one way to do that but you may prefer others. Both referees also make interesting suggestions for further experiments. I encourage you to consider following up on these suggestions in future work. sincerely Drew Fudenberg ============================== We would appreciate receiving your revised manuscript by Oct 21 2019 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols Please include the following items when submitting your revised manuscript:
Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out. We look forward to receiving your revised manuscript. Kind regards, Drew Fudenberg Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at http://www.journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and http://www.journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf Additional Editor Comments (if provided): [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Partly ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: No ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: This study investigates whether trait self-control correlates with individual susceptibility to attention capture. Self-control is measured using self-reported perception of self-control with various questions on a scale, while susceptibility to attention capture is measured using a novel experimental paradigm which relies on mouse tracking. The article makes 2 main contributions. The first contribution is methodological: the authors propose a novel experimental task to measure low-level attention capture and show that their resulting (pre-registered) quantitative indexes are much more reliable than those previously used in the literature (as measured by the degree of internal correlation within-subject). The second key contribution is a null result: trait self-control is not correlated with susceptibility to attention capture. This contribution is significant because: - Both self-control and resistance to attention capture are thought to employ similar mechanisms, relying on inhibitory control, albeit at a high cognitive level for self-control and at a low cognitive level for attention capture; - Self-control and resistance to attention capture have been shown to correlate in an experimental paradigm which involves utility-relevant distractions (e.g. food items). Yet it was unclear if this correlation would survive if the attention capture environment was made lower-level with purely perceptual stimuli. This study provides a negative answer to this question, suggesting the correlation does rely on the nature of the distraction and is not due to low-level cognitive mechanisms involved in attention control (note: this is an important consideration and I find the article would benefit if this was mentioned in the introduction, not only in the conclusion) ; - Both self-control and susceptibility to attention capture have been shown to correlate with working memory. Minor comments: - An eye-tracking based version of the experiment would seem like a more natural paradigm, because it would not rely on the assumption that “the partial and tentative conclusions of perceptuo-cognitive systems continuously feed into and affect the motor system” (which the authors correctly mention). The article would benefit from a discussion justifying the choice of mouse-tracking, unless it was a purely practical choice. - In the “Predictions” section, the verb “affect” is repeatedly used (“self-control may affect only selectivity” etc.), suggesting a causal link. However nothing in the literature cited nor in the data collected supports a causal relationship. Hence it would be more appropriate to use a verb such as “correlates with”. - The self-control scale used suffers from being purely based on a self-report. The study would benefit from comments about how well the specific scale used here predicts revealed preferences measures such as actual intertemporal choices. - The authors mention that it would be interesting to investigate whether learning arises and self-control does help resist attention capture but only after some training. I agree that this is an interesting follow-up question. But while the authors have no data on training, they do have a lot of trials per participant. They thus could provide a partial answer by comparing behavior in the later trials to behavior in the earlier trials in the experiment. It would be beneficial to run such tests and add some words on these. Reviewer #2: Summary: This work measures attention capture—the tendency to briefly respond to extraneous stimuli before returning to a primary task—via a mouse-tracking experiment, with the goal of assessing the correlation between that behavior and a questionnaire measuring self-control. Specifically, the work seeks to examine the effect of self-control on selectivity (whether the strength of attention capture increases as the distractor becomes more similar to the goal) and disengagement (how easy it is for the subject to return to the goal after being distracted). In the experiment, subjects are tasked with clicking a colored X which appears in one of four boxes, and are distracted by the flashing outline of a randomly-selected box before doing so. By changing the color of the distracting stimulus to match or differ from that of the goal, the work replicates findings in the literature wherein similar stimuli are more effective in capturing attention. To provide a description of the magnitude of attention capture, the work computes both the distance (in pixels) added to a straight-line trajectory by the distracting stimulus and the time taken by the subjects to begin moving their mouse towards the goal. Selectivity is measured by comparing each subject’s behavior when the distractor’s color matched the goal to their behavior when it did not; disengagement is measured by restricting analysis to the case where the distractor’s color matched the goal, but the distractor was on the opposite side of the screen. The work splits the data set in two and examines between-subsample correlations in both the attention-capture and self-control measures, finding a high degree of reliability. However, the work finds near-zero correlations between self-control and their attention capture measures, and the mouse trajectories of the participants show no clear differences regardless of self-control scores. This result is taken as grounds to claim that attention capture and self-control operate through different cognitive mechanisms. Comments: Following the seven PLOS ONE Criteria for Publication, (1) Primary results of original research: criterion met; no further comments. (2) Results not published elsewhere: criterion met, this work has only been submitted to PLOS ONE; no further comments. (3) Experiments, statistics, analyses are high-standard and described in detail: descriptions are clear and reproducible, but some additional analysis is needed to confirm the reliability and consistency of the measures of attention capture and address other potential variables of interest a. It would be good to see the correlation between the two measures of attention capture, both within-sample (i.e., compare each participant to themselves) and “out-of-sample” (i.e., compare on aggregate or using subsampling). These results would provide stronger evidence of whether these measures are really capturing the same behavior. b. Along the lines of (2), there are no demographic/socioeconomic/other controls included in the correlation analysis. The work notes that attention-capture and self-control may vary due to individual-level traits (e.g. video-game-playing); is the goal of the study to capture the correlation after taking into account these personal idiosyncrasies or to extract some more “baseline” measure, or one that can be adjusted for interactions with various personal factors? If it is the latter, then including controls would help to provide a clearer picture of how self-control and attention capture interact without the influence of particular personal traits. (4) Conclusions supported by the data: some scope for clearer causal analysis and further experiments to more directly involve the processes of self-control a. In addition to examining the correlation between attention capture and self-control, it seems valuable to make some effort at examining the influence of one on the other, e.g., regressing attention-capture measures on self-control scores. While there is potential for reverse causality (sensitivity to attention capture influences the ability to develop self-control), given that self-control is the macro-level process it seems more likely to be the overall driver of behavior. Especially if both attention-capture measures are used, care must be taken in interpreting the coefficients, but this approach could still provide another angle on the relationship between the two variables. b. The measure of disengagement includes only goal-similar distractors; it is unclear why this is the optimal measure of disengagement. It may be that self-control does not influence goal-similar attention capture but does improve disengagement from goal-dissimilar attention capture—in the dessert vs. healthy eating example, self-control may improve the ability to reject a goal-dissimilar slice of cake, but not a goal-similar fruit tart. Investigating the effect of self-control on goal-dissimilar distractors, or the overall measures of attention capture not split by goal-similarity, would provide a richer picture of this effect. c. In addition to using questionnaire measures of self-control, and in order to more directly invoke self-control behavior, additional tasks that take advantage of the mouse-tracking framework could be implemented. The work notes that self-control can vary according to “situational demands,” so using tasks that more directly invoke self-control (e.g., clicking on the “healthy” food from among various “unhealthy” options) would provide a valuable point of comparison to the more abstract task used here. (5) Presented in intelligible fashion: criterion met; no further comments. (6) Meets ethics standards: criterion met; IRB documentation provided, no further comments. (7) Data availability: criterion met; analysis is preregistered and data is available, no further comments. Conclusions This work lays out an experimental method that, while it could use refinement, provides a great level of detail about the temporal and spatial behaviors associated with attention capture without requiring particularly resource-intensive hardware and software. There is room to take further advantage of this method to obtain a more complete picture of attention capture, which may include a greater variety of tasks, the introduction of more true-to-life goals and distractions, and clearer measures of disengagement in different contexts. In addition to these extensions of the existing experiment—extensions that could provide more direct experimental evidence of the role of self-control—the analysis of existing data could be strengthened by considering alternative statistical approaches and a richer set of potential independent and dependent variables. These modifications would help take advantage of what appears to be a powerful approach to answering important psychological questions. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
Trait Self-Control Does Not Predict Attentional Control: Evidence from a Novel Attention Capture Paradigm PONE-D-19-20912R1 Dear Dr. Dieciuc, Thank you for your responsive revision, I am now happy to accept the paper for publication. Bolierplate follows below ----. Within one week, you will receive an e-mail containing information on the amendments required prior to publication. When all required modifications have been addressed, you will receive a formal acceptance letter and your manuscript will proceed to our production department and be scheduled for publication. Shortly after the formal acceptance letter is sent, an invoice for payment will follow. To ensure an efficient production and billing process, please log into Editorial Manager at https://www.editorialmanager.com/pone/, click the "Update My Information" link at the top of the page, and update your user information. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, you must inform our press team as soon as possible and no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. With kind regards, Drew Fudenberg Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: |
| Formally Accepted |
|
PONE-D-19-20912R1 Trait Self-Control Does Not Predict Attentional Control: Evidence from a Novel Attention Capture Paradigm Dear Dr. Dieciuc: I am pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. For any other questions or concerns, please email plosone@plos.org. Thank you for submitting your work to PLOS ONE. With kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Drew Fudenberg Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .