Peer Review History
| Original SubmissionDecember 21, 2020 |
|---|
|
PONE-D-20-40039 Politics overwhelms science in the SARS-CoV-2 pandemic: evidence from the whole coverage of the Italian quality newspapers PLOS ONE Dear Dr. Crabu, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. All the reviewers appreciated your work, however they identified a series of issues that need to be addressed before publication. I would invite the authors to consider all the reviewers' suggestions and comments, especially w.r.t. the contextualisation of the work in the literature, clarifications on the methodology used in the paper, and the definitions of science and scientific source. Please submit your revised manuscript by Apr 16 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols We look forward to receiving your revised manuscript. Kind regards, Fabiana Zollo, Ph.D. Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. In your revised cover letter, please address the following prompts: a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent. b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. We will update your Data Availability statement on your behalf to reflect the information you provide. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Partly Reviewer #2: Yes Reviewer #3: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: No Reviewer #3: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: The manuscript offers a quantitave analysis of the media coverage (main Italian newspapers) of politics and science during the first months of COVID-19 outbreak in Italy. The main topics discussed about the two news categories are also investigated as well the distribution of the media attention on different types of actors: role, individual, organization. As result of the analysis, the authors conclude that the health emergency has been addressed primarily in terms of political regulation and concerns only marginally as a scientific matter. Moreover, the analysis reveals that the personalization in media coverage, only understood as individualization (see [1]), is a phenomenon typical of politics. I find the paper and the arguments discussed of interest. Nevertheless, I believe that the observation period should be extended for increasing the robustness of the results. Indeed, despite the timespan of about 6 months and despite the scientific nature of the thematic domain, I guess that such period does not represent a suitable ground for investigating the scientific salience of news items about COVID-19 and then for supporting the claim inferred by answering RQ1. Basically, the highlighted findings only confirm that the times of science are very different from those of journalism and not consistent with the early solutions required during health emergencies such as the one in progress [2]. This could be also inferred by reading the breaking events identified for dividing the timewindow into disjoint periods (S2 Tab). To date, there are no approved therapies which are known to be really efficient in fighting the coronavirus desease. Excluding few news emphasing the potential effectiveness of known drugs or experimental therapies, their early rejection by the competent authorities has soon reduced the media attention. Moreover, the scientific community has mainly focused its efforts on the development of vaccines, but the media attention on this topic only began when the first vaccines has been approved and their purchase and administration has began. Last, the authors should stress that not only politics has long been mediated, but also the process of mediatization of politics is now completely accomplished. On the contrary, many important scientists, especially virologists, have achieved notoriety only during the COVID-19 pandemic. This could partially (or totally) justify the claim answering to RQ2 (Fig. 6). Furthermore, this sudden popularity combined with the initial lack of information and data, has led many scientists go on personal interpretations of the virus and its harmfulness, with the resultant spread of news counteract each other (lines 389-398). I suggest to query the media monitoring platform already used, in order to extend the analysis to at least the last six months (oct 2020 - feb 2021), roughly coinciding with the second wave of pandemic and the real vaccines debate. If the authors decide to follow my suggestions, I stress the importance to pay great attention on the classification of contents about vaccinations as political or scientific. The recursive use of LDA is a common procedure in topic modeling tasks, so nothing to say about the methodology. Two typos at line 31 and 45, intruding 'and' and space, respectively. [1] P. Van Aelst, T. Sheafer, J. Stanyer, The personalization of mediated political communication: A review of concepts, operationalizations and key findings , Journalism 13 (2), pp 203-220, 2012 [2] COVID-19, the public debate on social media. Available at https://agcom-ses.github.io/COVID/social_media.html?lang=en Reviewer #2: Referee Report The paper enters into the scientific debate regarding the mediatic effect of the COVID-19. Specifically, the author(s) investigates the interaction between science and political arguments in the media. The work considers the Italian's mainstream newspapers, assuming that pandemics are strictly interconnected with the broader media, cultural, and political landscapes. The source of data employed represents the mainstream media's covering considering the most common political and cultural positions within Italian society. From a methodological perspective, the paper presents the results from a combination of traditional machine learning tools applied to the selected corpora. Despite the rigorous application of the selected methodological items, the following minor points must be considered before publication: • From a general point of view, I recommend looking at o [2] for better positioning the present manuscript in the scientific debate. As it is, the present work addresses crucial aspects, but it has no mention of the relevant literature around the global "infodemic" clearly connected with the topic. o [1,3] contain detailed steps of corpora pre-processing. The author(s) can briefly describe what is happened to their texts before feeding the ML algorithms (this point is further stressed later). • A few words and references for supporting the media's division in: progressive, moderate, conservative, neoliberal and Catholic is undoubtedly beneficial. As it is, one can question the subjective interpretation. • In the Introduction, the author(s) writes, "This is particularly urgent in a context of relative lack of curative and preventive treatments to face COVID-19 disease, where policies and protocols against the spreading of the virus are primarily rooted in lifestyle and behavioural changes, that is social norms and convention, whose plausibility and legitimacy are widely debated by mainstream media." At the moment of this revision, this is not 100% true anymore (see vaccination campaigns). I suggest an edit of statements like these to stay 100% true for the current period and hopefully at the moment of the publication. • Regarding the RQ1 "Or more specifically, which domain, between the scientific and the political one, is prevalent in media discourses over SARS-CoV-2 pandemic? "I reckon that the intention of the author(s) is to determine the interaction between the scientific and the political debate. To determine the prevalence of one to the other requires the definition of a – or more -measure of such a phenomenon. This aspect would benefit from further clarifications. • Regarding the data and its processing: o The creation of the corpus used for the analysis should be in the body of the paper and not in the appendix as well as a clearer description of the procedure to prepare the texts (e.g. what did you do with stop words? Have you used a Bag of words approach? TF-IDF?). o When the author(s) says: "The three corpora were analyzed using machine learning techniques to obtain a classification according to their content (scientific or non-scientific) and to identify the topics covered by the articles." Which are the 3 corpora? This should be further clarified in the body of the paper, maybe when the data is introduced (the 3 corpora are mentioned in section "MATERIAL AND METHODS" but properly introduced in "DATASET"). In the current version, one can understand that just after having looked at the appendix. o Furthermore, in the manuscript's body, the claim of using ML techniques as it stands is too vague. Similarly, in section "Data Analysis", the ML methods mention does not help in clarifying the description of the ML techniques used. Details about it are reported in the appendix only. The modelling decisions are too relevant for being left in there. o The LDA is introduced later in 144 e 145. This is too late in the text; a more careful reading and a subsequent reorganization is necessary. • Regarding the topics met during the final run of the topic classifier, it would be appreciated a distribution of the recurrent topics meet in the corpora chosen. This can help the reader in mapping. • In the "Data Analysis" section, it is not clear how the training and the test data set have been identified if the considered articles' label were not known apriori. They might have been manually labelled or something else; It will be beneficial to state it more clearly. • Regarding the conclusions: the author(s) wrote, "Indeed, the media discourse about the pandemic is deeply characterized by politics' "patronization" of science and medicine." This should be more explicitly connected with the results obtained. The results look promising, but a futher contexutalizaiton will surely help highlight them, maybe with a few examples that could seat in the appendix if the author(s) does not want to have them in the paper. Similar comments apply to the following statement in the manuscript "Lastly, media narratives exalt the personification of politics, reducing science and medicine to institutional roles." Bibliography [1] Cinelli, M., Ficcadenti, V., & Riccioni, J. (2019). The interconnectedness of the economic content in the speeches of the US Presidents. Annals of Operations Research, 1-23. [2] Cinelli, M., Quattrociocchi, W., Galeazzi, A., Valensise, C. M., Brugnoli, E., Schmidt, A. L., ... & Scala, A. (2020). The covid-19 social media infodemic. Scientific Reports, 10(1), 1-10. [3] Ficcadenti, V., Cerqueti, R., & Ausloos, M. (2019). A joint text mining-rank size investigation of the rhetoric structures of the US Presidents' speeches. Expert Systems with Applications, 123, 127-142. Reviewer #3: The topic modelling and the use of LDA allows the analysis of a large dataset of articles and offers a very interesting general overview of mainstream media coverage of the first months of the pandemics in Italy. It also identifies the dominant tone of voice of the coverage, that privileged the political discourse over the scientific one. Nonetheless this study has a major flaw: the disentaglement between science and politics, in such an uncertain frame, is hard to perform using only salience as a marker. Scientific evidence is influenced by politics and ideology, as demonstrated by the case of hydroxychloroquine (see https://www.thelancet.com/journals/lancet/article/PIIS0140-6736(20)32221-2/fulltext and https://www.nature.com/articles/s41562-020-0894-x for the debate on this topic). The authors should clarify how they defined "science" and how they disentangled science from politics in the data analysis (the selection of a set of keywords is not enough, as it doesn't allow to evaluate the appropriateness of the scientific information. The same set of keywords could easily identify an article supporting pseduscientific views). Another important point that the paper does not clarify is the source of the scientific evidence when presented by the media. Italian journalists tend to rely more on experts' advices than on researches or peer-reviewed papers. Is the personal opinion of the experts classified as scientific content (and should we consider it scientific or political)? On the role of experts and the epistemic authorithy in the pandemic see https://www.frontiersin.org/articles/10.3389/fpubh.2020.00356/full ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No Reviewer #3: Yes: Daniela Ovadia (University of Pavia; Center for Ethics in Science and Journalism - Milan) [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
Politics overwhelms science in the Covid-19 pandemic: evidence from the whole coverage of the Italian quality newspapers. PONE-D-20-40039R1 Dear Dr. Crabu, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Fabiana Zollo, Ph.D. Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: All comments have been addressed Reviewer #2: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Partly Reviewer #2: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: (No Response) Reviewer #2: The comments have been addressed and I am convinced about the improvements made in the present version of the manuscript. ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No |
| Formally Accepted |
|
PONE-D-20-40039R1 Politics overwhelms science in the Covid-19 pandemic: evidence from the whole coverage of the Italian quality newspapers. Dear Dr. Crabu: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Fabiana Zollo Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .