Peer Review History
| Original SubmissionJune 23, 2022 |
|---|
|
PONE-D-22-17799Attention boost through media coverage? Agenda setting effects from news media coverage on topic selection of scientific journalsPLOS ONE Dear Dr. Leidecker-Sandmann, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. ==============================The reviewers found this to be an interesting study, exploring a novel research question. However, they each raised some methodological critiques, which I ask you to address to ensure the validity and rigour of your conclusions. Particularly, there are concerns that the conclusions, methods, and research question are not congruent, undermining the potentially interesting and important findings. Please address each of the reviewer's comments, but specifically the questions related to the Altmetric and MSM measurements to ensure the validity of your measures of attention; and please consider the use of comparative statistical methods to support your results and revise your conclusions accordingly. I look forward to receiving your revised manuscript. ============================== Please submit your revised manuscript by Sep 18 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Quinn Grundy, PhD, RN Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. Thank you for stating in your Funding Statement: "This work was supported by the German Research Foundation (DFG), Bonn within the framework program “Medializing brain diseases: interactions between research and mass media” (Reference No. 411038189) https://gepris.dfg.de/gepris/projekt/411038189?language=en and by the Volkswagen Foundation in the framework program “Entwicklung von Methoden und Tools für eine datengestützte Wissenschaftskommunikation” [“Development of methods and tools for data-based science communication”, Hannover (Reference No. 94838) https://www.volkswagenstiftung.de/. The author who received the award was M. L. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript." Please provide an amended statement that declares *all* the funding or sources of support (whether external or internal to your organization) received during this study, as detailed online in our guide for authors at http://journals.plos.org/plosone/s/submit-now. Please also include the statement “There was no additional external funding received for this study.” in your updated Funding Statement. Please include your amended Funding Statement within your cover letter. We will change the online submission form on your behalf. 3. Please amend your manuscript to include your abstract after the title page. 4. We note that you have referenced (Dumas et al. [9]) which has currently not yet been accepted for publication. Please remove this from your References and amend this to state in the body of your manuscript: (“Dumas et al. [Unpublished]”) as detailed online in our guide for authors http://journals.plos.org/plosone/s/submission-guidelines#loc-reference-style [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: No Reviewer #2: Partly ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: No Reviewer #2: No ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: This study compares the scientific productivity related to specific research topics before and after the release of a considerable number of news coverage about those topics. Regarding the research questions and the methods used, I have the following questions: 1. The ambition of the authors is to examine the feedback effect of news coverage on scientific productivity. However, there must be a variety of factors that play a role in affecting the productivity of scientific papers around a specific topic. In the case of altmetrics, for example, in addition to news media, other channels such as blogs, Twitter and Facebook can also increase the visibility of scientific papers as well as their related topics. More importantly, these data sources show a similar pace of data accumulation as news media – most of the data from these sources are accumulated in the early stage after the publication of papers. In other words, although the authors used news coverage counts to divide “similar articles” into two periods (i.e., before/after), similar results may have been observed with other altmetric data sources as the objects of study (e.g., blogs and Twitter). Therefore, comparative analyses with other altmetric data sources as the research objects are needed, to rule out the influence of other altmetric factors and to validate the conclusion that news coverage plays a key role in influencing the thematic trends of scientific journals. 2. Although the authors mentioned that their findings were unable to “draw the causal conclusion”, the hypothesis – “a scientific topic that attracted media attention will attract more attention in scientific journals” – sounds more like an assumption of a causality between news media attention and subsequent scientific productivity, particularly when the authors concluded that “journalism can be considered as an agenda setter for the choice of topics in academic journals”. If the authors aimed to verify this hypothesis, specific methods of causal inference should have been employed, rather than merely the observations based on box plots. 3. “Since the agenda setting approach is considered to be relatively well scientifically proven and since correlations between popular media coverage and citation rates of scientific studies have already been evidenced” This argument seems to be one-sided because there have also been many studies based on larger dataset reporting weak correlations between news media counts and citations at the scientific paper level, for example, � DOI: 10.1002/asi.23309 � DOI: 10.1371/journal.pone.0120495 4. The “similar articles” function of PubMed was adopted to measure the scientific productivity around specific topics. However, only nearly half of the similar papers identified by PubMed were correct as the authors manually checked. Is this precision degree sufficient to support the idea that this function can be used to represent the scientific productivity related to certain research topics? Especially given that the authors also mentioned “here are always cases where no similar articles could be found”. I am wondering how much of an impact these flaws would have. 5. As for Fig 2 and Fig 3, a significance test of the difference between the two groups is needed to support the arguments of “small difference” and “significant difference”. 6. For Fig 3 specifically, I am wondering why not just continue to use the six journals as the so-called opinion-leader journals and instead selected a new dataset that included only Nature and Science. 7. Please pay attention to the typos, like “Altmetric” in P9, L205. Reviewer #2: Although the research questions proposed by the authors are interesting and worth comprehensive study, there are some problems with this manuscript as follows: i) It takes some time for the MSM-score to accumulate to a high number. The MSM-score of the paper will not necessarily reach more than 100 points at the time of publication that year, especially for the paper published in December. In order to truly select a high MSM-score article (i.e. an article that received noticeable media attention), the time effect of cross year must be eliminated, and then “compare the quotient of the number of thematically similar articles published by scientific journals from a two-year period before respectively after the publication of an article that received noticeable media attention.” It is suggested to redesign the data collection and processing method. ii) The analysis method is too simple. Please use the standard statistical method for comparative analysis. Since there is no control group, the conclusions are doubtful. Although there seems to be a little comparison in Fig 3, it is far from enough. iii) As for the threshold of MSM-score, why choose more than or equal to 100? Can you choose 50 or other standards? This manuscript refers to the Kohler et al.’s paper (2020) which is a preprint without peer review, and one of the authors is lehmkuhl, who is also the author of the manuscript. Therefore, the reason for choosing 100 must be explained in more detail. It is suggested to choose different thresholds, such as 100, 50, 25, etc., and do a variety of studies from different perspectives. In short, due to some problems in data and analysis methods, the current conclusion of manuscript is questionable. References Kohler S, Promies N, Lehmkuhl M. Patterns in the journalistic selection of neuroscientific research results. SocArXiv. 2020. doi: 10.31235/osf.io/s9dy7. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
PONE-D-22-17799R1Correlations between the topic selection of news media and scientific journalsPLOS ONE Dear Dr. Leidecker-Sandmann, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. ==============================Thank you for your thoughtful and comprehensive attention to the reviewers' comments. Before I can proceed to a final decision, I kindly ask you to address the following minor comments:- the reviewer raises the issue of bias related to time of publication; please address and/or respond to this concern- the abstract well emphasizes the key findings and limitations of the study; you might consider adding further detail related to the sample (including the n), population and methods of study, key statistics to support the key findings (if they can stand alone), and a conclusion that sums up the key relevance- I would recommend having a copy editor work through the manuscript for conciseness and clarity in sentence structure including: "plausibilizing" and "plausibilize" replaced with "making plausible", breaking up the introduction into smaller paragraphs to aid readability; check missing punctuation (periods) in places following tracked changes removal- The Introduction makes a strong argument for the study, but could be reworked to deliver the key points more succinctly and to remove repetition. A few sentences were unclear to me; could you rephrase these? For example, I didn't understand the point "It is for instance obvious that mass media is important for a change in values regarding animal trials."============================== Please submit your revised manuscript by Dec 24 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Quinn Grundy, PhD, RN Academic Editor PLOS ONE Journal Requirements: Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #2: (No Response) ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #2: Partly ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #2: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #2: The authors said that they “retrieved the MSM ≥100 paper all at a consistent point of time, namely in May 2019. Since the publication date of our selected papers had to be between August 2014 and July 2018 (pick-up criterion), the collection date is far enough behind the publication date of the articles, so that an MSM-score should already have developed.” It is suggested that the authors analyze the 1608 articles according to their publication date. If the yearly/monthly distribution is not even, there should be time bias in these data. At this time, the author should try to eliminate this impact. ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #2: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 2 |
|
Correlations between the selection of topics by news media and scientific journals PONE-D-22-17799R2 Dear Dr. Leidecker-Sandmann, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Quinn Grundy, PhD, RN Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: |
| Formally Accepted |
|
PONE-D-22-17799R2 Correlations between the selection of topics by news media and scientific journals Dear Dr. Leidecker-Sandmann: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Quinn Grundy Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .