Peer Review History
| Original SubmissionMarch 8, 2021 |
|---|
|
PONE-D-21-07601 Using moral foundations in government communication to reduce vaccine hesitancy PLOS ONE Dear Dr. Heine, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Both reviewers provided important comments (see below). Please read the comments and incorporate those in the revision. Please submit your revised manuscript by Jul 21 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Kazutoshi Sasahara Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements.
https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Partly Reviewer #2: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: No ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: No ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: GENERAL COMMENTS: *Introduction section* What is “intentions”? The authors mention the term “intentions” on page 2 as the concept that has been focused on previous studies, but it is not clearly stated what is it and why it is not suitable for this kind of research. I assume that the concept of “intensions” represents one’s self-stated vaccine hesitancy from the sentences in the same paragraph, but I am not sure. Explanation of the MFT. The explanation of the MFT can be included in the manuscript itself (not in Appendix) because the flow of the manuscript should not be interrupted. I am not sure why the authors explain it in the separated section. Relationship between concepts One of my major concerns is that how morality and vaccine hesitancy are related is not clearly discussed in the Introduction section, which is connected to the aim of this study. The authors describe the MFT and the past research on the MFT and vaccine uptake, but, in the first place, how morality itself and vaccine uptake/hesitancy are related and why the authors should conduct research on vaccine hesitancy with the framework of morality are not argued. The authors may need to explain morality before the MFT to clarify the importance of their study. Purpose of the study The last paragraph on page 3 seems to describe the purpose of the present study, but what will be revealed by this study and the importance of this study in the academic field are not elaborated enough. Particularly this paragraph confused me because all the sentences are written in present tense, and also because what will be investigated and the results are presented in the same paragraph. Further, the authors need hypothesis; or, isn’t it a hypothesis-testing type study? How the purpose is related to the paradigm Related to the purpose of the study, the authors need to justify the appropriateness of the analyses to accomplish what they want to know. Why do the authors look at the language use? I would like to know more about the rationale. *Methods section* I like to see some example words from the MFD. Also, the Dutch version of the MFD needs to be described so that a reader understands it (e.g., How was the original version translated? Is the translation method a prevalent way to be used in past research involving non-English speaking people?). *Results section* The authors should present their results more carefully from regression analyses, such as “A significantly predicted B.” The expression used by the authors (e.g., “leads to”) do not efficiently convey what was observed. Also, it is not clear why the authors cited Amin et al. in the Main Result 1 section because Amin et al. found the reverse causal relationship compared to the current study. Please let me know if I am reading wrong. Regarding Main Result 4, I am not sure why the authors mention the Harm/Care foundation specifically. I like to see the rationale in the introduction section. Results and interpretations I see the results from the analyses and their interpretations are sometimes mixed up both in style- and concept-wise. For example, the descriptions in lines 93-96 should be in the results section. For another example, although you state that immunization coverage is inversely related to vaccine hesitancy (lines 187-188), it does not automatically mean that “the use of moral foundations in government communication affects vaccine hesitancy (lines 322-323).” What was found in the regression analyses was that the use of moral-related language significantly predicted the vaccine rate. I sometimes have hard time following the authors’ logic—what was FOUND as results and what was SUGGESTED from the results? Further, when the regression is performed, the authors may want to clearly state the independent variables and dependent variables. Minor issue1: I am not sure if your style is fine in your field, but Methods and Results should be basically written in past tense. Minor issue 2: I am not sure how the authors use the term “effect size” (e.g., line 348). I was wondering if they calculated Cohens’ d etc. *Discussion section* The authors state “future research may investigate the question of why these moral foundations in particular reduce vaccine hesitancy,” but isn’t it the purpose of the current study? It is related to the purpose of this study—the authors need to justify why this particular study was designed this way. It is not just that the variables were randomly chosen or the authors unexpectedly found the associations between them. Further, the authors discuss the possible practical applications of the results from this study, but I like to see how this study can contribute theoretically. Minor issue: It is easier to understand if the discussion section starts with the summary of the study and results. *Other* Tone of the manuscript The tone of the manuscript (especially results and discussion) seems a bit assertive. I’d caution against the causal language used in some sentences throughout the manuscript, such as “…as this moral foundation increases vaccine hesitancy…(line 473-). Again, it was just that the use of morality-related language predicted/was associated with vaccine rate (positively or negatively). What the “use of moral foundations” means The other of my major concerns is the language used in the manuscript. The meaning of the expression, “use of moral foundations,” sounds vague. It is the frequency of the morality-related word. I like to see how the language use and vaccine ratio are conceptually connected. SPECIFIC COMMENTS: Page 11: I like to see how N = 22 was calculated; I like to see the number of the broachers for each year. Tables: The decimals should be aligned. Page 20, Line 429: Please elaborate how it is counterproductive. Page 20, Line 451: What is the “underlying study”? Page 21, Line 469: Please provide some examples of the MFD in different languages. Appendix (Page 233, Line 528): The description of the pluralist approach is confusing. Does pluralism demur the evolutionary explanation? Reviewer #2: The paper studies the relationship between the moral dimensions and the parental hesitancy towards vaccination. It is a relevant topic given the current pandemic situation. Few comments are as follows: Major comments 1. Please describe the process used to translate the English MFD dictionary to Dutch. Moral foundations may vary with culture and usage of the English-translated dictionary may not be able to capture the socio-cultural aspects of a particular region and may potentially bias the results. How do you ensure that English dictionary can be generalised well to the Dutch language? Please refer to [1] to learn more about the translation methodology. 2. The authors have used a moral foundation dictionary (MFD) and word count based methodology to capture the moral rhetoric used in the brochures. MFD created by a small group of experts with limited amounts of stem words and lemmas may not be valid for diverse contexts and populations [2]. The authors are advised to look at the applicability of the extended MFD [2] for their work. Also, many machine learning and word embedding based methods have been shown to better capture the moral rhetoric than word count based method. Authors should consider using such methods ( for example [3,4]) . 3. As mentioned by the authors the NIP started in 1957, please mention the reasons to select the data from 2011-2019 only. 4. In equation (1), moral dimensions i.e. HC, PD etc have been shown as varying with regions. Are there different brochures corresponding to the different regions? Kindly clarify. It seems there are only 22 brochures in total from 2011 to 2019. The immunisation coverage data is available at the high spatial granularity, while the same is not true for moral dimensions data. How do you ensure that the OLS model is not overfitting the data? 5. How do you account for the different lengths of brochures in Table 5? What was the motivation to use absolute word count? 6. Fairness dimension was not detected in the brochures and it is also the most difficult dimension to trace in language [5]. Authors may include this. Minor comments 7. Kindly include some example statements from the vaccination brochures corresponding to different moral dimensions. 8 . The overall writing can be improved significantly. Few examples (a)Page 4, line 73, 76, Subsection has been mentioned without referring to one. (b) Page 16, line 330, “We test this theorem in our study”. Usage of the word “theorem” is incorrect. (c) Please avoid vague terms such as “some” for results where statistical data can be provided e.g. Table 6 ”some evidence” 9. Table 10 has been referred to in the text after Table 2. Please put them in a sequential order. 10. n Figure 2, for better readability, please include 2012, 2014, etc on x-axis. Also, a descriptive caption can be provided which may help in better understanding of the figure. [1] Matsuo, Akiko, et al. "Development and validation of the japanese moral foundations dictionary." PloS one 14.3 (2019): e0213343. [2] Hopp, Frederic R., et al. "The extended Moral Foundations Dictionary (eMFD): Development and applications of a crowd-sourced approach to extracting moral intuitions from text." Behavior Research Methods 53.1 (2021): 232-246. [3] Sagi, Eyal, and Morteza Dehghani. "Measuring moral rhetoric in text." Social science computer review 32.2 (2014): 132-144 [4] Araque, Oscar, Lorenzo Gatti, and Kyriaki Kalimeri. "MoralStrength: Exploiting a moral lexicon and embedding similarity for moral foundations prediction." Knowledge-based systems 191 (2020): 105184 [5] Kennedy, Brendan, et al. "Moral concerns are differentially observable in language." Cognition 212 (2021): 104696 ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
PONE-D-21-07601R1Using moral foundations in government communication to reduce vaccine hesitancyPLOS ONE Dear Dr. Heine, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript by Oct 30 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Kazutoshi Sasahara Academic Editor PLOS ONE Journal Requirements: Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice. Additional Editor Comments (if provided): Both reviewers agreed that the MS was improved. However, they also think that the MS needs several minor revisions. Please read their comments and address them properly. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: All comments have been addressed Reviewer #2: (No Response) ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: I am happy with the revision and only have some minor suggestions/comments as follows: -In the subsection “The Dutch National Immunisation Programme (p. 5)”, the authors state “Our results confirm this trend, providing… (L. 103)”. Is it from the current study? If so, is it appropriate to show a part of the results here in the method section? -Now that the authors clarify how they made the Dutch version of the MFD, I suggest the authors mention the translation issue as a limitation. -In the Discussion and Conclusion section, the authors argue a possible difference between Authority and Liberty foundations. I would like to see some articles discussing the relationships between those (or other) foundations (if any). It can help readers to deeply speculate the results from the current study and moral foundations as a whole for future research. -Thank you for showing how manuscripts are structured in your field (Response 7). It helps me. Reviewer #2: Table 2 lists 26 brochures. Please highlight the brochures which were not considered for analysis in the table itself to avoid the confusion. The paper needs serious proof-reading. There are several grammatical mistakes and other errors. e.g. the reference to subsections are missing at many places : pg 17- line 338, pg 10- line 222, page 10-line 224. As mentioned in pg 17, line 335, fairness/cheating has been discarded from analysis. FC should also be removed from Equation 1. Since MF dimensions do not vary spatially. I do not see the point of analysing it at national, regional and municipal levels. It is rather surprising that the coeffs for MF dimensions vary significantly at the different spatial resolutions since the MF dimensions and other control variables such as degree of difficulty (which are again derived from linguistic analysis of brochures) and time remain constant across the regions. Is it only modelling the variations in population sizes? Loyalty/betrayal effect became significant at regional and municipal level but not at the national level, however, the values of MF dimensions remain the same. OLS with time-demeaning fixed effects would suggest that the moral dimensions remain constant over time. Is this a valid assumption? Authors should not make strong claims regarding the effect of MF dimensions on vaccine hesitancy on the basis of only 22 sample points and there could be many other factors affecting the hesitancy which have not been considered for the analysis. Also, consider that the moral foundations are not completely independent of each other which is also evident from the MF dictionary words. For line and page numbers, please refer to manuscript with track changes ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 2 |
|
Using moral foundations in government communication to reduce vaccine hesitancy PONE-D-21-07601R2 Dear Dr. Heine, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Kazutoshi Sasahara Academic Editor PLOS ONE Additional Editor Comments (optional): Now both reviewers think that all the comments are properly address. Thank you for your careful revision. Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: All comments have been addressed Reviewer #2: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: (No Response) Reviewer #2: (No Response) ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No |
| Formally Accepted |
|
PONE-D-21-07601R2 Using moral foundations in government communication to reduce vaccine hesitancy Dear Dr. Heine: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Kazutoshi Sasahara Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .