Peer Review History
| Original SubmissionMay 21, 2021 |
|---|
|
PONE-D-21-16799 PROTOCOL: Benefits and harms of remdesivir for COVID-19 in adults: a systematic review with meta-analysis PLOS ONE Dear Dr. Paludan-Müller, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript by Oct 15 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Spyridon N. Papageorgiou, DDS, Dr Med Dent Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. Thank you for stating the following in the Acknowledgments/ Funding Section of your manuscript: This study is funded internally by Cochrane Denmark and the Centre for Evidence-Based Medicine Odense (CEBMO). MJP is supported by an Australian Research Council Discovery Early Career Researcher Award (DE200101618). We note that you have provided additional information within the Acknowledgements Section that is not currently declared in your Funding Statement. Please note that funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows: N/A Please include your amended statements within your cover letter; we will change the online submission form on your behalf. 3. Thank you for stating the following financial disclosure: N/A At this time, please address the following queries: a) Please clarify the sources of funding (financial or material support) for your study. List the grants or organizations that supported your study, including funding received from your institution. b) State what role the funders took in the study. If the funders had no role in your study, please state: “The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.” c) If any authors received a salary from any of your funders, please state which authors and which funders. d) If you did not receive any funding for this study, please state: “The authors received no specific funding for this work.” Please include your amended statements within your cover letter; we will change the online submission form on your behalf. 4. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information. 5. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Does the manuscript provide a valid rationale for the proposed study, with clearly identified and justified research questions? The research question outlined is expected to address a valid academic problem or topic and contribute to the base of knowledge in the field. Reviewer #1: Yes Reviewer #2: Yes ********** 2. Is the protocol technically sound and planned in a manner that will lead to a meaningful outcome and allow testing the stated hypotheses? The manuscript should describe the methods in sufficient detail to prevent undisclosed flexibility in the experimental procedure or analysis pipeline, including sufficient outcome-neutral conditions (e.g. necessary controls, absence of floor or ceiling effects) to test the proposed hypotheses and a statistical power analysis where applicable. As there may be aspects of the methodology and analysis which can only be refined once the work is undertaken, authors should outline potential assumptions and explicitly describe what aspects of the proposed analyses, if any, are exploratory. Reviewer #1: Yes Reviewer #2: Partly ********** 3. Is the methodology feasible and described in sufficient detail to allow the work to be replicable? Descriptions of methods and materials in the protocol should be reported in sufficient detail for another researcher to reproduce all experiments and analyses. The protocol should describe the appropriate controls, sample size calculations, and replication needed to ensure that the data are robust and reproducible. Reviewer #1: Yes Reviewer #2: Yes ********** 4. Have the authors described where all data underlying the findings will be made available when the study is complete? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception, at the time of publication. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above and, if applicable, provide comments about issues authors must address before this protocol can be accepted for publication. You may also include additional comments for the author, including concerns about research or publication ethics. You may also provide optional suggestions and comments to authors that they might find helpful in planning their study. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: I have reviewed this as a clinical pharmacologist and physician. It appears to be very clear, comprehensive, and of value. I still have a few comments and questions. Line 116. I am not aware of cluster-randomized trials of remdesivir, but if large enough they may be informative—see https://training.cochrane.org/handbook/current/chapter-23] Line 120: ‘of both sexes’ → ‘of either sex’ Line 121: The pragmatic question is whether remdesivir reduces harm in patients with ‘Covid-19,’ but the scientific question is whether it reduce harm in patients with proven Covid-19. It may be that a subsidiary analysis would be helpful to answer the latter question. Line 123: Harms may be related to an interaction between the drug and the disease, so it may distort estimates of harm to include trials in diseases other than Covid-19. The most serious harms will cause death (which is included in the measure ‘all-cause mortality’). Lines 132 and 354: A problem that has bedevilled trials in Covid-19 has been the heterogeneity of ‘usual care,’ which has in some circumstances included azithromycin, or dexamethasone, or hydroxychloroquine, or any combination of these. How will you deal with this? Line 136: What if an intervention (notably ventilation, dexametasone) is delivered to some but not all patients in both treatment and control groups? Line 146: Length of hospital stay & time to death do depend on disease severity. Will this be taken into account in your analysis, or in grading the quality of the research that you include? Line 166: UK Medicines and Healthcare products Regulatory Agency will also have looked at data from Gilead. Line 201: I did not understand the sentence ‘We will rerun all searches if the initial search date is greater than 3 months prior to manuscript publication.’ Lines 203 and 295: Is it known how likely authors are to respond to such requests? How will you deal with authors who do not respond? Line 230: There is no mention of the statistical methods used to analyse trial results. Line 305: An ITT analysis is entirely appropriate for efficacy, but may not be appropriate for adverse events. Line 325: The stratified secondary analyses will be interesting and could be clinically relevant. Line 334: This section will require careful review by a statistician familiar with the field. Reference 37 warns that ‘Even with the HKSJ method, extra caution is needed when there are = <5 studies of very unequal sizes,’ which may well be the case with this study. Line 374: The accuracy of diagnosis will depend on the prevalence of Covid-19. Most of the trials will have been conducted at times of and in areas of high prevalence. Reviewer #2: The manuscript 'PROTOCOL: Benefits and harms of remdesivir for COVID-19 in adults: a systemic review with meta-analysis' authored by Paludan-Müller et al. provides a protocol for a systemic review and meta-analysis of remdesivir. The authors ask a relevant question as conflicting evidence and different interpretations have lead to heterogenous national recommendations and published meta-analyses to date do not fully succeeded in implementing raw and unpublished data. The authors undeline their aim to include such data in the analysis. However, there are lots of meta-analyses published on remdesivir asking the same question, all of which encountered the same issues for data syntheses: heterogenous trial designs and definitions, problems to get raw data in order to seperate aggregated data and harmonize outcomes, limited possibilities for subgroup group analyses. Prior meta-analyses tried to include raw data as well but failed to retrieve for example data from the SOLIDARITY trial which dramatically limits possibilities for valid subgroup analyses. However, robust subgroup analyses with focus on hospitalized patients at an early stage of disease would be of main interest and an overall mortality benefit over all patient groups is not expectable based on individual trial results and existing meta-analyses. From a clinical point of view, the relevant question is not if remdesivir provides a mortality benefit over all hospitalized patients as the answer is most probably known already. The more important question is if there are subgroups that do benefit from remdesivir treatment which can be supported by evidence. Both theoretical assumptions on antiviral activity and subgroup analyses of individual trials ACTT-1 and SOLIDARITY suggest potential efficacy in patients with low flow supplemental oxygen. Seperate subgroup analyses suggest a more pronounced effect of remdesivir when used at an early COVID-19 stage (shorter duration after symptom onset). If this systematic analysis wants to provide novel insights, a comprehensive subgroup analysis inlcuding raw data from clinical trials (e.g. in SOLIDARITY low flow and high flow supplemental oxygen groups are aggregated) is warranted. In addition, data synthesis is limited by different definitions of clinical outcomes (e.g. time to clinical recovery, time to hospital discharge). Here, an intelligent and clinically valid methodology is required in order to incorporate available data in a systematic approach. Aggregation of related outcomes / composite endpoints might be one option if raw data cannot be provided. In summary, I would recommend to include a subgroup analysis in the protocol and to document constructive considerations how to realize a robust subgroup analysis taking the heterogeneity of clinical trial designs and the resulting complexity for data syntheses into account. As COVID-19 is caused by an acute viral respiratory infection - clinical efficacy of antivirals at later stages of the disease is not expectable based on our current pathophysiologic knowledge. The authors might also profit from exchange with other Cochrane centers that might be working on this topic to provide a unique approach. The protocol could include information on how to deal with different treatment durations (5 and 10 days of remdesivir) in the trials and how to deal with combinational treatments including remdesivir (e.g. ACTT-2 remdesivir with baricitinib). Finally, the second time point chosen for analyses of defined outcomes (day 60 after randomisation) might be too optimistic as most trials do not provide follow up data for 60 days to my knowledge. Alternative time points might be considered in the protocol if the 60d point is not covered by sufficient data. ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: Yes: Jakob J. Malin [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
PROTOCOL: Benefits and harms of remdesivir for COVID-19 in adults: a systematic review with meta-analysis PONE-D-21-16799R1 Dear Dr. Paludan-Müller, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Spyridon N. Papageorgiou, DDS, Dr Med Dent Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: |
| Formally Accepted |
|
PONE-D-21-16799R1 PROTOCOL: Benefits and harms of remdesivir for COVID-19 in adults: a systematic review with meta-analysis Dear Dr. Paludan-Müller: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Spyridon N. Papageorgiou Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .