Peer Review History
| Original SubmissionJune 17, 2025 |
|---|
|
I have now received the reports from two reviewers with considerable knowledge and expertise in your topic domain (their detailed feedback appears below or as separate files). On the positive side, both the reviewers find your manuscript easy to follow and believe that you have interesting results based on a rigorous and preregistered empirical investigation. On the more critical side, however, they also raise a series of substantial concerns, which largely focus on lacking recruitment details, potential differential attrition across conditions, insufficient level of detail in the preregistered analyses, and clarity issues with respect to what was and was not preregistered. Moreover, they also note construct validity/confusion concerns, a failure to clearly discuss certain seemingly counterintuitive findings (e.g., more cheating in the concrete victim condition), and a lack of elaboration pertaining to whether, why, and how you believe that the study setting (online vs. real life) might have influenced your results, potentially due to lacking engagement among online participants (Baumeister et al., 2023). Further, the reviewers mention some uncited work which might bolster your theorizing and storyline. Based on the constructive comments from the reviewers and my own reading of your paper, I am willing to move this manuscript into a second round of reviews. Given the magnitude of some of the issues identified by the reviewers, this will be a major revision, although a revision with a relatively clear path toward publication as long as you meticulously address all the substantive concerns flagged in the separate reviewer reports. Please make sure to reply to all comments made by the reviewers, incorporate needed changes in the manuscript, and then send an updated version of it along with your revision notes at your earliest convenience. Try to do this within the next two months. If you need additional time, feel free to let me know (at tobias.otterbring@uia.no) and I am happy to extend your revision window. Reference Baumeister, R. F., Tice, D. M., & Bushman, B. J. (2023). A review of multisite replication projects in social psychology: is it viable to sustain any confidence in social psychology’s knowledge base? Perspectives on Psychological Science, 18(4), 912-935. Please include the following items when submitting your revised manuscript: • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'. • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'. If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Tobias Otterbring Handling Editor, PLOS One Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf 2. Thank you for stating in your Funding Statement: [This work was supported by the National Natural Science Foundation of China (32271111, U1736125 to L. Sai); the Science and Technology Innovation 2030-“Brain Science and Brain-like Research” Major Project (Grant/Award Number: 2022ZD0210800).]. Please provide an amended statement that declares *all* the funding or sources of support (whether external or internal to your organization) received during this study, as detailed online in our guide for authors at http://journals.plos.org/plosone/s/submit-now. Please also include the statement “There was no additional external funding received for this study.” in your updated Funding Statement. 3. Thank you for stating the following in the Acknowledgments Section of your manuscript: [This work was supported by the National Natural Science Foundation of China (32271111, U1736125 to L. Sai); the Science and Technology Innovation 2030-“Brain Science and Brain-like Research” Major Project (Grant/Award Number: 2022ZD0210800).] We note that you have provided funding information that is currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows: [This work was supported by the National Natural Science Foundation of China (32271111, U1736125 to L. Sai); the Science and Technology Innovation 2030-“Brain Science and Brain-like Research” Major Project (Grant/Award Number: 2022ZD0210800).] Please include your amended statements within your cover letter; we will change the online submission form on your behalf. Please include your amended Funding Statement within your cover letter. We will change the online submission form on your behalf. 4. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? Reviewer #1: Yes Reviewer #2: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? -->?> Reviewer #1: Yes Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available??> The PLOS Data policy Reviewer #1: Yes Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English??> Reviewer #1: Yes Reviewer #2: Yes ********** Reviewer #1: Hello I have read your manuscript "Intuitive or Deliberative Dishonesty: The effect of abstract versus concrete victim" submitted to Plos One. Below is my review. First, I applaud the fact that you conducted a preregistered well-powered study that aims to replicate earlier findings. This is surely a merit. Second, for the most part I think the paper is well written and easy to follow. You cite plenty of relevant research. Perhaps you want to look on Josh Greenes work on dual process morality where it is proposed that intuition leads to deontological decision making (following rules such as not harming) whereas deliberation leads to utilitarian decision making (maximizing good consequences). See Greene, J. D. (2008). The secret joke of Kant's soul. In W. Sinnott-Armstrong (Ed.), Moral psychology, Vol 3: The neuroscience of morality: Emotion, brain disorders, and development. (pp. 35-80). Cambridge: MIT Press. for an overview. I wonder whether you measure dishonestly or selfishness. In your study, lying is always selfish as it increases the participants’ payoff so dishonestly and selfishness are difficult to disentangle. Still, it is important to remember that both lies and truth telling can have both positive and negative (or no) consequences for both the person deciding whether to lie, and for the person being lied to. There are white lies, prosocial lies and altruistic lies. This should be highlighted and you should discuss the related literature investigating about whether prosociality is intuitive or deliberate. For instance Rand, D. G., Greene, J. D., & Nowak, M. A. (2012). Spontaneous giving and calculated greed [10.1038/nature11467]. Nature, 489(7416), 427-430. Tinghög, G., Andersson, D., Bonn, C., Böttiger, H., Josephson, C., Lundgren, G., Västfjäll, D., Kirchler, M., & Johannesson, M. (2013). Intuition and cooperation reconsidered. Nature, 498(7452), E1-E2. I am not perfectly updated on the literature, but I feel that the fact that you did the die roll and reporting online rather than in real life can influence the believability of being able to lie without being detected. In the original die rolling studies, participants rolled a die in private and then reported the results on a separate paper (correct me if I am misremembering). This approach made it believable that one could cheat without being detected. In your online study, I feel that I would assume that you recorded the result of the die roll and could easily “prove that I lied” if you wanted to. You might not agree, but I feel you should discuss whether this rather big methodological difference could explain diverging results. Relatedly, could it even be that what you measure is not dishonestly (lying in the belief that no one notices) but rather how much participants care about being caught lying? I like your method, but did you consider manipulating the die roll results rather than just observing them. In an online paradigm, this could easily be done I suppose and it would give you more control. Not saying that it must be done, but that it could be reflected upon. I believe the most surprising result is that people cheated more in the concrete victim conditions. This seems to be an effect in the opposite direction of what could be expected and against the identifiable victim effect. I strongly suggest that you discuss and try to make sense of this result. Not only a null effect but an effect in the opposite direction. Could it be that participants in the concrete victim conditions perceived it more like a game where the normative response was to “try to win” whereas participants in the abstract condition did not. Not sure, but in your version it seems like you want to hide this significant effect. I do not really understand panel C on Figure 2. The x-axis display the two manipulated variables, but what does “score” on the Y-axis stand for? The weak interaction effect of moral identity and time pressure condition is interesting but hard to make sense of. It makes sense that low moral ID and no time pressure leads to much cheating, but it does not makes much sense that time pressure leads to much cheating among those with high moral id. Or does it? I feel that you report results in a good way, but you could do more to at least offer possible reasons for the obtained results. The study below seems relevant. I feel that cheating in the abstract victim condition is to act with low integrity (break a rule, and to act unfairly) wheres cheating in the concrete victim condition is to act with low benevolence. Moore, A. K., Munguia Gomez, D. M., & Levine, E. E. (2019). Everyday dilemmas: New directions on the judgment and resolution of benevolence–integrity dilemmas. Social and Personality Psychology Compass, 13(7), e12472. Reviewer #2: This paper reports a preregistered experiment investigating whether time pressure (intuition) increases dishonesty (cheating behavior) when dishonesty harms an abstract (but not concrete) other. Results do not support this prediction, as there is no significant interaction effect between time pressure (vs. no time pressure) and harm type (abstract vs. concrete victim). However, there was a main effect of harm type such that participants cheated more when the victim was concrete than abstract, opposite of expectations. The experiment also explores individual traits. The study addresses an interesting and relevant question and I think the paper is well-organized and clear and the conclusions appear warranted by the data. I hope my comments below can help improve the paper further. 1. Some more detail about how/where participants were recruited would be desirable (e.g. was it using a recruitment platform, social media, etc.). 2. I am a bit puzzled by the results from the manipulation check for the harm type manipulation (concrete vs. abstract victim). The question asks: “How much does your task performance affect another subject’s earnings?” It seems to me that participants in the “abstract” condition should answer 1 (“not at all”) if they correctly understood the instructions, yet the mean rating is 2.31. Furthermore, one of the pre-game rule-check questions asks how much the opponent could obtain if the participant reports 5 points; given that participants in the abstract condition are not playing with an opponent, it is unclear what they should answer here. I wonder if there might be some selection effect because of this that affects the two conditions differently, as participants are screened out if they answer incorrectly. Also, how many participants in each condition failed the rule-check questions? 3. I would suggest reporting the full regression results from the main hypothesis test (section 3.1.2), considering that it is the main (and preregistered) hypothesis test. 4. In some places it could be made clearer what was and what was not preregistered among the analyses. In particular, it could be mentioned in the analysis section that the use of Bayes factors was not preregistered. 5. Figure 2c (manipulation checks) could be modified slightly to improve interpretability on its own (without having to read the text). E.g. add the manipulation check questions into the figure as subheadings or similar. Minor: 1. Look over the grammar in this sentence: ”Other experimental works have similarly revealed … will increase self-serving dishonesty.” (p 3-4) 2. “cognitively impaired” (p 4) has a different connotation than what I think the authors intend – change to “cognitively depleted” or “temporarily cognitively impaired”? 3. Preregistrated (p 5) -> preregistered 4. Mofied -> modified (p 5) 5. Pista et al./Pistea et al. -> Pitesa et al. (p 5) 6. ”Exploratory” -> ”As exploratory analyses” or similar (p 6) 7. present study -> the present study (p 6) 8. preregistratrion study -> preregistered study (p 23) 9. P. 11: “t-tests assessed the manipulations' effects on time pressure and harm types” – I believe this refers to the manipulation checks? I suggest a slight rephrasing for clarity, e.g. “t-tests assessed the manipulations’ effects on participants’ subjective experience of time pressure and whether participants understood that their results in the game would (or would not) affect another participant’s earnings” (or whatever the authors find more appropriate). ********** what does this mean? ). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy Reviewer #1: Yes: Arvid Erlandsson Reviewer #2: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/ . PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org . Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
Intuitive or Deliberative Dishonesty: The effect of abstract versus concrete victim PONE-D-25-29808R1 Dear Dr. Sai, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. For questions related to billing, please contact billing support . If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Tobias Otterbring Academic Editor PLOS ONE Additional Editor Comments (optional): Dear authors, Thank you for delivering a responsive revision. Based on your material revisions in the manuscript and your detailed replies to the reviewers, both of whom are positive toward the current version of the manuscript, I am happy to recommend acceptance of your paper in its current form. That said, I strongly recommend you to consider the remaining minor suggestions from the reviewers in the proof process. Congratulations! Kind regards, Tobias Otterbring Associate Editor, PLOS One Reviewers' comments: Reviewer's Responses to Questions Comments to the Author Reviewer #1: All comments have been addressed Reviewer #2: (No Response) ********** 2. Is the manuscript technically sound, and do the data support the conclusions??> Reviewer #1: Yes Reviewer #2: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? -->?> Reviewer #1: Yes Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available??> The PLOS Data policy Reviewer #1: Yes Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English??> Reviewer #1: Yes Reviewer #2: Yes ********** Reviewer #1: Hello This is reviewer 1 from the earlier round. I have read your revised manuscript "Intuitive or Deliberative Dishonesty: The effect of abstract versus concrete victim" submitted to Plos One. Below is my review. Thank you for the good revision. I feel you addressed most of my concerns in a satisfactory way. I have some final suggestions, but after they are fixed, I am willing to recommend publication. Page 6. I feel you repeat yourself regarding analyses about individual differences. Page 8-9: I feel that the die-rolling task can be explained more in detail at this point (it become clearer when you go through the results). When reading about it here, it is not clear (unless one has read Shalvi et al) that the die-roll was semi-random (you controlled so that it never landed on 6 but it was random whether it landed on 1-5). Please make it clear how you operate cheating and honesty, and I would also mention cheating magnitude at this point. Page 15 Fig 2. Here your refer to the conditions as harm vs no harm. I think it is better to refer to it as concrete vs abstract harm Page 24. Last rows: “inflict [harm to] the identified victims” The discussion is much improved, but I think you can separate “lack of expected results” (which can be because a lot of different factors) from “presence of unexpected results” even more explicit. Again, I am surprised that cheating was higher in the concrete harm conditions. The discussion you have is good, but I would also argue that your “concrete harm” condition could be even more concrete (e.g. you learn more individualizing aspects about the player you are paired with and perhaps even that you anticipate how you will be able to observe the reaction when that player receives his/her pay). Reviewer #2: Thank you for responding to my comments. I think the authors have answered the points raised. Regarding my comment about potential selection effects - thank you for clarifying that participants are not screened out based on their answers to the pre-game rule-check questions. I would suggest adjusting the wording in the paper slightly to clarify this, specifically on p. 9 where it is stated that “only those who passed the rule-check questions could continue to the formal experiment” (to something along the lines of "participants could not proceed until they answered correctly") ********** what does this mean? ). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy Reviewer #1: Yes: Arvid Erlandsson Reviewer #2: No ********** |
| Formally Accepted |
|
PONE-D-25-29808R1 PLOS One Dear Dr. Sai, I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS One. Congratulations! Your manuscript is now being handed over to our production team. At this stage, our production department will prepare your paper for publication. This includes ensuring the following: * All references, tables, and figures are properly cited * All relevant supporting information is included in the manuscript submission, * There are no issues that prevent the paper from being properly typeset You will receive further instructions from the production team, including instructions on how to review your proof when it is ready. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few days to review your paper and let you know the next and final steps. Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. You will receive an invoice from PLOS for your publication fee after your manuscript has reached the completed accept phase. If you receive an email requesting payment before acceptance or for any other service, this may be a phishing scheme. Learn how to identify phishing emails and protect your accounts at https://explore.plos.org/phishing. If we can help with anything else, please email us at customercare@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Professor Tobias Otterbring Academic Editor PLOS One |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .