Peer Review History
| Original SubmissionMay 5, 2021 |
|---|
|
PONE-D-21-14926 No utilitarians in a pandemic? Shifts in moral reasoning during the COVID-19 global health crisis PLOS ONE Dear Dr. Antoniou, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please find below the reviewers' comments, as well as those of mine. Please submit your revised manuscript by Aug 09 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Valerio Capraro Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and Additional Editor Comments (if provided): I have now collected two reviews from two experts in the field, whom I thank for their detailed and thoughtful reviews. Both reviewers think that the paper has potential, but they suggest major changes before it can be published. The main change regards the acknowledgement of the fact that you do not really have a control group, so you cannot make any causal statement. One of the reviewer even suggests to collect additional data. I don't feel strong about this, but I agree with the reviewer that the paper would greatly improve with more data. However, I won't make my decision conditional on this. Needless to say that also the other comments should be addressed. I also have a couple more comments, one regarding the section on dual process theories of moral reasoning. I have a review article on the topic, which you might find useful, as it covers virtually all the literature on the topic (Capraro, 2019). Also, the perspective article on what social and behavioural science can do to support pandemic response, published by Van Bavel et al in Nature Human Behaviour might be a useful general reference. Of course, it is not a requirement to cite these works, but I'm mentioning them because they look very related. I am looking forward for the revision. Van Bavel, J. J., et al. (2020). Using social and behavioural science to support COVID-19 pandemic response. Nature Human Behaviour, 4, 460-471. Capraro, V. (2019). The dual-process approach to human sociality: A review. Available at SSRN 3409146. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Partly ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: Review PONE-D-21-14926 The authors present a pre-registered study comparing a 2014 sample with a 2020 sample on moral utilitarianism. The authors rely on the terror management theory to predict that old people more at risk during the pandemic (2020 sample) should be less utilitarian more confident in their choices and should experience greater emotion than old people (associated in age) in 2014. The authors test these predictions on three categories of moral dilemmas (personal rights, agent-centered permissions, and special obligations). The main difference observed (which was also preregistered) was a difference to personal rights moral dilemmas (which commonly require to harm/kill someone for the greater good), a result consistent with the predictions from the dual-process specification of terror management theory. No differences between the two waves are observed for confidence and emotion elicitation. The paper is well-written, concise, and the research question is clearly defined. Overall, I’m quite positive toward seeing this paper published, given some amendments, some of which are important however. Yet, I feel like it is a timely publication, which has the merit to crosspollinate the use of fictitious sacrificial dilemmas which largely lack ecological validity, yet with a real-world impacting context (COVID-19 pandemic). I have a few suggestions which I think should be addressed to increase the appeal of the paper. An important weakness of the research is the absence of a true control group (old people with no fear of the COVID-19). The participants were drawn from the part of the Hillblom Aging Network, and I’m left puzzled why the authors did not try to collect additional data selecting participants from the network who did not exhibit anxiety signs regarding COVID-19. As a result, this decreases the appeal of the results. I leave the editor with the decision to collect additional data or not, but at least this should be included as a critical limitation (what if old people without fear/anxiety toward COVID-19 showed the same decrease in moral utilitarianism to sacrificial moral dilemmas?). Another weakness of the paper is the discussion section. Regarding the context, much more could be said about moral utilitarianism during the COVID-19 pandemic. The results presented in this paper are interesting: old people are less utilitarian in the context of COVID-10 pandemic. Yet this is something quite opposed to what happens worldwide: health care provided have come in several states to endorse utilitarianism because of a lack of resources (for instance, by favoring the young at the expense of the older). Although I’m aware that this is not the very same topic, some discussion might be interesting and might help improve the discussion section. Finally, what is the take-home message of your research? Why is it an important one? (I personally think that it is an important research). The discussion section should answer more thoroughly such questionings. References: Vearrier, L., & Henderson, C. M. (2021, June). Utilitarian principlism as a framework for crisis healthcare ethics. In Hec Forum (Vol. 33, No. 1, pp. 45-60). Springer Netherlands. Minor: Unless this is a requirement from the journal, please replace “Material and method” by Method. Material is a subsection of Method. Please format all the Tables according to the APA7 guidelines I wish the authors good luck with their research. Reviewer #2: This paper, “No utilitarians in a pandemic? Shifts in moral reasoning during the COVID-19 global health crisis” by Antoniou et al. presents the results of a pre-registered study analyzing moral judgements made by older adults in response to hypothetical dilemmas collected in two waves: one in 2014 and the other one during 2020. Dilemmas had three moral categories: Personal Rights (PRs), Agent-centered Permissions (APs), and Special Obligations (SOs). Results show that participants’ responses did not change substantially when considering all three categories, but there was a significant difference in the direction hypothesized by the authors when restricting the analysis to just the PR category. Ratings of the emotion elicited by the decision did not significantly change. There are several things to like about this paper, including the comparison of moral decisions in a time window pre- versus post- pandemic onset. The topic is timely and relevant and the statistical analyses are sound. The authors should also be commended for clearly outlining their hypotheses and pre-registering their analyses before collecting the second wave of data. However, there are several weak points in the manuscript which the authors need to address before I could recommend publication. These issues, some of which are major points, are entirely about the way in which the authors framed the paper and the interpretation of the observed results. Major issues: 1- Causal interpretation: Several parts of the paper suggest that the authors are interpreting these findings in a causal way. Abstract: “We investigated the influence of…” (line 30) or Discussion: “we examined the effect of a global health crisis on…” (line 327). This study is 100% observational and the authors need to be clear and upfront about this. Moreover, they should avoid using terms such as “influence” or “effect” of the pandemic on moral choices given that the pandemic is not an experimental treatment. In one paragraph in the Discussion (lines 369-381), the authors acknowledge that many things happened between 2014 and 2020 and that the effect cannot be attributed to only the pandemic. (For example, could this study have been re-written as “No utilitarians during the Trump administration”?). Even if the results would have shown a clear and strong change in moral responses (which is not the case), this study cannot speak about the causal effect of the pandemic on moral choices (after all, it would be impossible to have such experimental treatment and the observational data presented here is clearly insufficient to suggest a causal role played by the pandemic). Similarly, this implies that this study cannot be thought of as a “real-world replication of the experimental manipulation in Tremoliere and colleagues” (line 339) since there is no experimental manipulation here. 2- Pre-registration: the main result inspiring the title and the take-home message of the paper is based on one of the three categories of moral dilemmas (PRs). The authors claim to have planned and pre-registered “subsidiary analyses focusing exclusively on the subset of dilemmas involving personal rights” (line 159). However, the registry in the Open Science Framework (https://osf.io/g2wtp) does not support that claim. There is no mention to such subsidiary analysis which suggests that the focus on dilemmas involving PRs was indeed exploratory. Therefore, the significant result found using PR dilemmas should be labeled in that way. There is nothing inherently wrong with the data not supporting the main hypothesis and to try publishing the results of a subsequent exploratory analysis, but the authors should be explicit about it. Given that this is a pre-registered study, every analysis that was not described in the registry should be labeled as exploratory. 3- Issues with the title: The title is misleading and problematic in at least three ways. First, the question “No utilitarians in a pandemic?” cannot be answered unless making a massive overstatement of the findings in the paper. The main result is that there is no overall change in utilitarian decision-making during the pandemic (i.e., results do not support the hypothesis H1 pre-registered by the authors), as 2 out of 3 categories of moral dilemmas show no significant difference. Second, a shift in utilitarian decision-making does not imply that there is a shift in moral “reasoning”. As the authors correctly pointed out in lines 102-106, people might make utilitarian decisions for a variety of reasons that may or may not include engaging in utilitarian reasoning. In fact, DP theories (lines 107-126) suggest that making non-utilitarian decisions is consistent with a process different than reasoning, namely, emotional harm avoidance. So, one should not assume that the mechanism underlying the reduction in utilitarian choices is a “shift in moral reasoning” unless the data is accompanied by observations that support such mechanistic interpretation. Instead of presenting more data to test this mechanism, the authors could simply use mechanism-neutral language and refer to utilitarian “judgements” or “decisions”. Third, it is also inaccurate to portrait participants making utilitarian decisions as “utilitarians”. While there are some stable individual differences in utilitarian thinking, recent studies in the literature suggest that terms such as “deontological” or “utilitarian” describe decisions made by people rather than people itself. This is because lay people (unlike philosophers) may make utilitarian choices without necessarily engaging in utilitarian thinking (Conway et al., 2018). Instead, it is more accurate to refer to participants as “people making utilitarian choices” or “utilitarian decision-makers” or “people making utilitarian judgements”, etc. Other points: 4- External validity of the findings: This work studies moral responses made by individuals who are older than most participants in psychological research. This leaves open the question of whether and how these results are present in other populations. While the authors do not necessarily need to address this with more data, they should flag the possibility that age differences could play an important role in moral judgements. For example, a recent pre-print (Navajas et al., 2020, https://osf.io/ktv6z) found that moral decisions about dilemmas of the COVID-19 crisis correlate with utilitarian decision-making in hypothetical scenarios. Importantly, these utilitarian decisions became more prevalent in participants proceeding from countries where the crisis was more severe. Therefore, one could argue that such observations support the idea that a more dangerous context correlates with making more utilitarian decisions. This apparent discrepancy between empirical observations across studies could stem from the use of different methodologies but also from the measurement of utilitarian choices in populations which are very different in terms of age. 5- Limitations: When describing the limitations of the present work in the Discussion, the authors should also add the fact that there were different economic incentives to participate in the study in the 2014 versus 2020 wave of data collection. 6- Introduction (lines 52-60): please expand on the arguments made by competing theoretical predictions. What does it mean when Savulescu and colleagues claim “There are no egalitarian in a pandemic”? ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
PONE-D-21-14926R1No utilitarians in a pandemic? Shifts in moral reasoning during the COVID-19 global health crisisPLOS ONE Dear Dr. Antoniou, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript by Oct 21 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Valerio Capraro Academic Editor PLOS ONE Additional Editor Comments: One of the reviewers feel that their comments were not satisfactorily addressed and (re)suggest major revision. Therefore, I would like to invite you to revise your manuscript again. In your response letter, please respond to all reviewer's comments. I am looking forward for the revision. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #2: (No Response) ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #2: Partly ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #2: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #2: The authors have addressed most of my previous concerns. First, I would like to apologize for missing the part of the pre-registration where they stated the subsidiary analysis reported in this work. I do believe now that, although it was not the main point of the pre-registration, the result based on PR dilemmas was planned. I have, however, two more comments about this revised version of the manuscript: 1- When you discuss the potential role of incentives in partially explaining the different results between cohorts you state: “though at first glance the absence of a personal financial incentive in the second wave might have been expected to select for a more rather than less utilitarian cohort.” Do we know how people vary in their responses to PR dilemmas based on whether or not they receive economic incentives due to their participation? While I understand the point the authors wanted to make, I do not see anything in the data or in the literature supporting this statement. Instead, I believe authors should simply acknowledge they do not know the magnitude or direction of the effect of financial incentives on their data. 2- The authors claim that “whether moral judgements are susceptible to this [age-related] effect remains unclear”. In my previous report, I pointed the authors to a recent study (Navajas et al., 2020, https://osf.io/ktv6z) that examines how demographic factors (including age) correlate with utilitarian judgements during the pandemic. [The part of my original report where I suggested authors to look at this paper was removed and did not appear in the response letter]. Discussing the relationship with those results would help better situating the findings reported in this work in the context of a fast-changing literature. ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 2 |
|
Reduced Utilitarian Willingness to Violate Personal Rights during the COVID-19 Pandemic PONE-D-21-14926R2 Dear Dr. Antoniou, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Valerio Capraro Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #2: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #2: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #2: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #2: The authors have addressed all my remaining comments. Thank you. ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #2: No |
| Formally Accepted |
|
PONE-D-21-14926R2 Reduced Utilitarian Willingness to Violate Personal Rights during the COVID-19 Pandemic Dear Dr. Antoniou: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Valerio Capraro Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .