Peer Review History
| Original SubmissionApril 26, 2024 |
|---|
|
PONE-D-24-16700The Probability of Reducing Hospitalization Rates for Bronchiolitis: A Bayesian AnalysisPLOS ONE Dear Dr. Heath, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. The manuscript has been evaluated by two reviewers, and their comments are available below. The reviewers have raised a number of concerns that need attention. They request improvements to the reporting of methodological and statistical aspects of the study, and improvements to the writing and discussion. Could you please revise the manuscript to carefully address the concerns raised? Please submit your revised manuscript by Mar 27 2025 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Helen Howard Staff Editor PLOS ONE Journal requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. Please note that PLOS ONE has specific guidelines on code sharing for submissions in which author-generated code underpins the findings in the manuscript. In these cases, we expect all author-generated code to be made available without restrictions upon publication of the work. Please review our guidelines at https://journals.plos.org/plosone/s/materials-and-software-sharing#loc-sharing-code and ensure that your code is shared in a way that follows best practice and facilitates reproducibility and reuse. 3. We note that you have indicated that there are restrictions to data sharing for this study. For studies involving human research participant data or other sensitive data, we encourage authors to share de-identified or anonymized data. However, when data cannot be publicly shared for ethical reasons, we allow authors to make their data sets available upon request. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Before we proceed with your manuscript, please address the following prompts: a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., a Research Ethics Committee or Institutional Review Board, etc.). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent. b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of recommended repositories, please see https://journals.plos.org/plosone/s/recommended-repositories. You also have the option of uploading the data as Supporting Information files, but we would recommend depositing data directly to a data repository if possible. Please update your Data Availability statement in the submission form accordingly. 4. Your ethics statement should only appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please move it to the Methods section and delete it from any other section. Please ensure that your ethics statement is included in your manuscript, as the ethics statement entered into the online submission form will not be published alongside your manuscript. 5. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Partly ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: I Don't Know Reviewer #2: No ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: No ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: Thank you for asking me to review your paper on bronchiolitis. I agree that it will take a further study with strong evidence to convince clinicians to start using epidex for treatment of patients with bronchiolitis. All the evidence to date and guidelines recommends minimal handling and not to use any medications. I feel the paper explains clearly about the Can BEST study and explains the results of the original paper and the reasoning for re-analysis using the Bayesian method. I have to say that I don’t fully understand the statistics and have recommended the paper be reviewed by a statistician. The paper is heavy in statistical methods and discussion so I agree that it will not convince many frontline clinicians to adjust their practise and start using epidex in the management of bronchiolitis. I think it is a valuable debate to have about the methods used for analysis of RCTs but would generally err on supporting simple methods that reflect a pragmatic approach. It will be interesting to see the results of the BIPED study and then see if the combined data shows that epi and dex truly reduces the hospitalisation of children with bronchiolitis. Major changes: I think there needs to be an acknowledgement that the data for this re-analysis is from 2004-2008 when bronchiolitis was different to what we now see. Post covid the bronchiolitis season has dramatically changed and we are only just starting to see a return to normality. It maybe that emerging bronchiolitis studies demonstrate changes in the natural course of the disease. I think the limitations of this re-analysis needs to further develop the potential risks of using dex and epi in children with bronchiolitis. The importance of safe prescribing can not be ignored and we know that the current management of infants with bronchiolitis with minimal intervention is safe and causing little harm. I would be keen to see if there is any difference when you assess the different risk groups such as those with underlying conditions or born extreme preterm. It is also important to note that with the introduction of RSV vaccinations the rates of bronchiolitis admissions to hospital should be significantly reduced. This may therefore negate the need for changing in our clinical management of bronchiolitis as it is hoped the burden from bronchiolitis will be significantly reduced. Minor changes: I would suggest changing the title to include epinephrine and steroids. Maybe ‘The probability of reducing hospitalisation rates for bronchiolitis with epidex using a Bayesian analysis method.’ In the design of prior distributions section the third criteria for suitable studies close to CanBEST is participants were infants less than two years of age but Can BEST was based on less than 12 months of age. I feel this would lead to significant differences in the cohorts of children being included as the many of the children 1-2 years of age will have a different aetiology to their respiratory illness other than bronchiolitis. This will therefore impact on the results of those studies and so I would assume impact the data driven priors. As stated I am not a statistician and so unsure how you would take into account the difference in ages in the different studies and into the Bayesian analysis model. In the discussion section it is stated ‘Our Bayesian analysis of the results from the pivotal CanBEST trial has demonstrated that there is a greater than 98% probability that EpiDex reduces hospitalizations for bronchiolitis compared to placebo unless clinicians are highly skeptical.’ which is a repeat of what has been described in the results. I would like to see more detail about what does the greater than 98% probability mean? In the limitations section the references 38 and 39 are based on evidence from young children or children under 2 years of age. Again I do not feel this is representative of the bronchiolitis group of children who should be defined as less than 12 months of age to avoid confusion with different respiratory illness aetiologies such as episodic wheeze which may be more likely to benefit from steroids or epi. I would also say another limitation of the re-analysis is the unfamiliarity of clinicians with Bayesian analysis and therefore it is unlikely to lead to changes in clinical practise. Reviewer #2: The aim of this study is to reanalyze data from a previous study that applied frequentist statistics using Bayesian analysis. The study requires a more detailed description of its methodology and results. Another problem is that the present findings lead to uncertain conclusions, depending on the strength of the prior belief. For certain readers, such as policymakers, this uncertainty may not be reassuring. I think there is value in the fact that the focus of the study is on the probability of the treatment effect, however, this should be communicated in an effective manner. First, there is a mismatch between the presented results in Table 2 and Figure 2. The color of strongly skeptical shows a posterior distribution with highest density for a value around 0,75. The color of skeptical distribution shows the highest density for a value around 0,86. The moderately enthusiastic distribution peaks at something around 0,6. The strongly enthusiastic distribution peaks at around 0,75. Finally, the minimally informative peaks at around 0,66. This is inconsistent with Table 2. Furthermore, inconsistencies also happen for the results using data-driven priors in Figure 2. The 100% weight appears to have the smallest median value. The 50% weight has the largest median value. The 10% weight has an intermediate median value. Second, the use of data-driven prior distributions is an interesting approach for the reason pointed out in the manuscript that the analysis considers the data of the present study with prior knowledge of the previous studies. There are two problems. One is the methodology is still not clear on how the weights are applied. The other problem is that the upper bound of the posterior interval remains unchanged regardless of how informative the priors are. For instance, it is difficult to accept no change in the upper bound for the 10% weight distribution. Third, for a reader that is not used with Bayesian analysis, results that vary depending on the views might be hard to accept. In the absence of previous data, I would suggest the minimally informative prior. IN this case, according to Table 2, the probability of RR below threshold is high. Since there is previous knowledge, the data-driven priors are an interesting approach. However, it is not clear how this was applied to be able to fully judge the results. Although I see some value in using different degrees of views (skeptical, enthusiastic etc.), I would say that a manuscript with minimally informative, and data-driven only priors would better communicate results. This means all other results not incorporated in the manuscript. Additional comments below. Abstract The term Bayesian distribution should be replaced with posterior distribution for accuracy. Correction: The probability that the treatment effect is less than 1, 0.9, 0.8 and 0.6 For a reader of the abstract, the meaning of skeptical views is not clear. It may be helpful to introduce this concept in the background section. The same applies to strongly skeptical individuals. After re-reading the manuscript, I understand what is meant, but the abstract should be accessible to a general audience. Introduction Statement about 9.3% absolute risk reduction (line 16): is this from ref 8? Methods I do not think the description of frequentist methods in line 64 is fair and should be revised. "Frequentist analyses reach statistical conclusions by controlling error rates over many analyses conducted in the same manner (29). When multiple research questions are evaluated within the same study, the chance of making at least one incorrect conclusion is increased and necessitates adjustments to control the error rate of the overall study." The phrase "treatment effect after seeing the data" (line 76) seems very conversational and should be revised. About the statement:"Secondly, readers can determine which prior best represents their own background assessment of the efficacy of EpiDex, based on their experience and expertise, and interpret the CanBEST study results accordingly." This is a strong claim, implying that the results are subjective, which I do not agree with. It should be reworded to avoid this implication. Regarding Table 1: Inform which distributions are being used. It is not well understood how the weighting is applied to data-driven priors. Is it applied to the standard deviation to make the prior less informative? Further clarification on this point would be helpful. Formulas can be useful as well. Results For some unknown reason, when I download Figure 1 (JPEG), only Figure 2 is downloaded. I wanted to view Figure 1 in higher resolution. Figures 1 and 2: The tables use the term moderately skeptical. I recommend maintaining this term in the figures for consistency. When a probability is found to be 0, it is best to report it as less than a negligible number, such as 0.001. The previous comments about Figure 2 on the mismatch of the distributions. How is the equivalent prior sample size calculated? This was not explained in the methodology. Figure D1: The distribution of RR seems bounded on top by 1. What explains this behavior? Discussion Last sentence: should be revised. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: Yes: Martin Edwards Reviewer #2: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
The Probability of Reducing Hospitalization Rates for Bronchiolitis with Epinephrine and Dexamethasone: A Bayesian Analysis PONE-D-24-16700R1 Dear Dr. Heath, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Dhammika Leshan Wannigama, MD PhD Academic Editor PLOS ONE Additional Editor Comments (optional): All the questions raised have been adequately addressed, and the study provides critical new insights that could shift how we treat bronchiolitis with steroids. Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #2: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #2: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #2: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #2: All comments have been addressed by the authors. ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #2: No ********** |
| Formally Accepted |
|
PONE-D-24-16700R1 PLOS ONE Dear Dr. Heath, I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team. At this stage, our production department will prepare your paper for publication. This includes ensuring the following: * All references, tables, and figures are properly cited * All relevant supporting information is included in the manuscript submission, * There are no issues that prevent the paper from being properly typeset You will receive further instructions from the production team, including instructions on how to review your proof when it is ready. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few days to review your paper and let you know the next and final steps. Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. If we can help with anything else, please email us at customercare@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Dhammika Leshan Wannigama Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .