Peer Review History
| Original SubmissionJune 3, 2021 |
|---|
|
Dear Dr. Maya Gopalakrishnan, Thank you very much for submitting your manuscript "A simple mortality risk prediction score for viper envenoming in India (VENOMS): A model development and validation study" for consideration at PLOS Neglected Tropical Diseases. As with all papers reviewed by the journal, your manuscript was reviewed by members of the editorial board and by several independent reviewers. In light of the reviews and the editor's comments (below this email), we would like to invite the resubmission of a significantly-revised version that takes into account the reviewers' comments. We cannot make any decision about publication until we have seen the revised manuscript and your response to the reviewers' comments. Your revised manuscript is also likely to be sent to reviewers for further evaluation. When you are ready to resubmit, please upload the following: [1] A letter containing a detailed list of your responses to the review comments and a description of the changes you have made in the manuscript. Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out. [2] Two versions of the revised manuscript: one with either highlights or tracked changes denoting where the text has been changed; the other a clean version (uploaded as the manuscript file). Important additional instructions are given below your reviewer comments. Please prepare and submit your revised manuscript within 60 days. If you anticipate any delay, please let us know the expected resubmission date by replying to this email. Please note that revised manuscripts received after the 60-day due date may require evaluation and peer review similar to newly submitted manuscripts. Thank you again for your submission. We hope that our editorial process has been constructive so far, and we welcome your feedback at any time. Please don't hesitate to contact us if you have any questions or comments. Sincerely, Nicholas R Casewell Associate Editor PLOS Neglected Tropical Diseases Janaka de Silva Deputy Editor PLOS Neglected Tropical Diseases *********************** Editor's comments: 1. A syndromic approach to identifying the offending snake may well have resulted in errors. 2. Clinical manifestations vary greatly across India, and this sample of bite victims is from a single site. 3. The scoring system has only been validated in a single centre and that this was the same centre as the derivation cohort. The score requires independent external validation in other settings. The authors should acknowledge these major limitations in the methodology, and the discussion and conclusions should take these limitations into account (be less dogmatic). Reviewer's Responses to Questions Key Review Criteria Required for Acceptance? As you describe the new analyses required for acceptance, please consider the following: Methods -Are the objectives of the study clearly articulated with a clear testable hypothesis stated? -Is the study design appropriate to address the stated objectives? -Is the population clearly described and appropriate for the hypothesis being tested? -Is the sample size sufficient to ensure adequate power to address the hypothesis being tested? -Were correct statistical analysis used to support conclusions? -Are there concerns about ethical or regulatory requirements being met? Reviewer #1: Abstract line 26 and and intro line 124 - is there conclusive evidence to support that mortality is higher amongst viperid envenomings? I would have thought neurotoxic elapdis would have a higher case fatality rate? Author summary line 55-57 - it is too early to suggest the score can be used to inform clinical practice. It has only been validated in a single centre, and that was the same centre as the derivation cohort. Suggest reword to, 'may become' or 'shows promise'. Methods line 155 - specify if patients were enrolled consecutively for the derivation cohort? Methods Table 1 - Although this is based on previously published data, suggest moving this table to the results section. Methods table 2 - suggest removing this table. All of these covariates with corresponding ORs and 95% CIs should be listed in Table 3 of the results. Choice of covariates - it seems unusual not to include biting species as a covariate as this seems like an important predictor of outcome. Was this not used due to missing data - in which case specify this in the paper? If there is too much missing data, in those cases where the species was known it would be helpful to present the mortality rate by species. This will show if, for example, those with known Russell's envenoming have a higher mortality than those with known Echis envenoming. Reviewer #2: -Are the objectives of the study clearly articulated with a clear testable hypothesis stated? Yes -Is the study design appropriate to address the stated objectives? Yes - however methodological concern as outlined below. -Is the population clearly described and appropriate for the hypothesis being tested? Some concern - See below -Is the sample size sufficient to ensure adequate power to address the hypothesis being tested? - Yes -Were correct statistical analysis used to support conclusions? - Yes -Are there concerns about ethical or regulatory requirements being met? - No concerns -------------------- Results -Does the analysis presented match the analysis plan? -Are the results clearly and completely presented? -Are the figures (Tables, Images) of sufficient quality for clarity? Reviewer #1: Results Table 3 - Include all covariates that were entered into the logistic regression model. Include unadjusted (univariate) and adjusted (multivariate) ORs, 95% CIs and p values. Results Table 3 - there is an error in the 'Hb 10' covariate. P value is <0.0001 yet 95% CI 0.84-6.10. If this covariate is a non-significant predictor I would suggest removing it from the scoring system. Results Table 4 - I would disagree with including 'gender' and 'bite to ASV' as predictors in the model. The confidence intervals cross 1 and therefore it is not clear if they are associated with a higher or lower risk of death. One would expect the model to be slightly more accurate without them? Results line 306 - was multiple imputation necessary when 97.8% of data was available. Was missing data 'missing at random?' Unless data was not missing at random and this influenced the model, I would suggest not doing multiple imputation. I'm not a statistician so happy to be corrected if there is something I am missing. Results line 331 - request that the sensitivity, specificity, PPV and NPV is calculated for every score cut-off in the validation cohort and that this be included in an additional table. See Abouyannis et al 2011 Table 3 for an example (doi:10.1097/QAD.0b013e328349a414). PPV and NPV are particularly meaningful when applied to clinical decision making. Reviewer #2: -Does the analysis presented match the analysis plan? Yes -Are the results clearly and completely presented? Yes -Are the figures (Tables, Images) of sufficient quality for clarity? In the most part. Figure 1 could be improved. -------------------- Conclusions -Are the conclusions supported by the data presented? -Are the limitations of analysis clearly described? -Do the authors discuss how these data can be helpful to advance our understanding of the topic under study? -Is public health relevance addressed? Reviewer #1: More emphasis should be placed on the fact that this scoring system has only been validated in a single centre and that this was the same centre as the derivation cohort. Highlight that the tool requires independent external validation in other settings with a high burden of Russell's viper envenoming. Reviewer #2: -Are the conclusions supported by the data presented? Some modification required -Are the limitations of analysis clearly described? - Yes, these could be grouped together better, see comments below. -Do the authors discuss how these data can be helpful to advance our understanding of the topic under study? Yes, but can be improved. -Is public health relevance addressed? Yes -------------------- Editorial and Data Presentation Modifications? Use this section for editorial suggestions as well as relatively minor modifications of existing data that would enhance clarity. If the only modifications needed are minor and/or editorial, you may wish to recommend “Minor Revision” or “Accept”. Reviewer #1: Appendix S3 is difficult to interpret as it shows the raw output from the logistic regression. Reviewer #2: Running title – This is misleading – needs to specify Indian Vipers. Line 26 - Reported mortality is higher in viper envenoming compared to snakes – please correct. Author summary Line 57-58 It can also aid better decision making with respect to antivenom administration and other supportive care. The findings of this study do not support this statement, VENOMS tool was not validated as to whether patients should be administered antivenom/repeated antivenom Image quality of Figure 1 is poor. -------------------- Summary and General Comments Use this section to provide overall comments, discuss strengths/weaknesses of the study, novelty, significance, general execution and scholarship. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. If requesting major revision, please articulate the new experiments that are needed. Reviewer #1: Overall I think the topic area and the findings of this paper are highly important and certainly worthy of acceptance once the above changes have been made. Particularly in India, where mortality rates from envenoming are high, there is a great need for validated scoring systems that clincians can use to help inform their decisions. The major limitation is that this is single centre, and validated in the same centre, so generalisibility is not confirmed. Reviewer #2: The authors should be congratulated for devising a severity scoring system using a systematic approach to development and validation for Viper envenoming in India. Some suggestions and concerns are outlined below. Methodological concerns Syndromic approach to identifying snake may have resulted in errors in inclusion/exclusion Sampling was from one site only – we know that clinical manifestations vary greatly across India and Indian subcontinent. Validation cohort selected limited patients with >200ml antivenom prior to presentation. This is likely to bias the patient selection to less severely envenomed patients (demonstrated in Table 1 with reduced complication rates between groups 1 and 2 and a reduced mortality rate for the validation group). Smaller concerns Authors need to define CLS and the time at which data points were collected – Was this at admission or at 24 hours? (Bearing in mind the median time to development of signs is 48 hours). Results Did the authors assess heart rate as a potential variable? I note this was not included in the list of 25 potential variables listed in the supplementary material. After selection of the variables for inclusion in the VENOMS score – I would like to see a comparison of mortality risk curves for data collected at different time points. E.g on admission, admission +12 hours, Admission +24 hours, Admission + 36 hours, Admission + 48 hours. If the time points mortality risk scores are not statistically significant for each time point, then it supports the statement that the score can be calculated at any point between presentation and 48 hours after. Discussion I believe the paragraph from Lines 438-449 should be communicated early in the discussion. Please expand on how use of the VENOMS severity score may improve snakebite management? Are there examples in the literature? How have clinical severity scoring for other conditions improved care (such as CURB65)? As mentioned in comments, I believe the subjects outlined between Lines 396-412 are limitations of this study methodology and that practical prospective assessment of this assessment tool is needed from multiple study sites (external validation) to corroborate the study findings. Data sharing All individual patient data sets should be made readily available to meet PLoS NTD data sharing statement. This is not presently provided. -------------------- PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: Yes: Michael Abouyannis Reviewer #2: No Figure Files: While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Data Requirements: Please note that, as a condition of publication, PLOS' data policy requires that you make available all data used to draw the conclusions outlined in your manuscript. Data must be deposited in an appropriate repository, included within the body of the manuscript, or uploaded as supporting information. This includes all numerical values that were used to generate graphs, histograms etc.. For an example see here: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001908#s5. Reproducibility: To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols |
| Revision 1 |
|
Dear Dr Gopalakrishnan, Thank you very much for submitting your manuscript "A simple mortality risk prediction score for viper envenoming in India (VENOMS): A model development and validation study" for consideration at PLOS Neglected Tropical Diseases. As with all papers reviewed by the journal, your manuscript was reviewed by members of the editorial board and by several independent reviewers. The reviewers appreciated the attention to an important topic. Based on the reviews, we are likely to accept this manuscript for publication, providing that you modify the manuscript according to the review recommendations. The reviewers both acknowledged the considerable effort undertaken in the revision submitted, and the resulting impact that this has had on the manuscript. Please attend to the minor revisions suggested by reviewer one (and the reference corrections indicated by reviewer two). We thank the authors for engaging productively in the review process. Please prepare and submit your revised manuscript within 30 days. If you anticipate any delay, please let us know the expected resubmission date by replying to this email. When you are ready to resubmit, please upload the following: [1] A letter containing a detailed list of your responses to all review comments, and a description of the changes you have made in the manuscript. Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out [2] Two versions of the revised manuscript: one with either highlights or tracked changes denoting where the text has been changed; the other a clean version (uploaded as the manuscript file). Important additional instructions are given below your reviewer comments. Thank you again for your submission to our journal. We hope that our editorial process has been constructive so far, and we welcome your feedback at any time. Please don't hesitate to contact us if you have any questions or comments. Sincerely, Nicholas R Casewell Associate Editor PLOS Neglected Tropical Diseases Janaka de Silva Deputy Editor PLOS Neglected Tropical Diseases *********************** The reviewers both acknowledged the considerable effort undertaken in the revision submitted, and the resulting impact that this has had on the manuscript. Following the completion of the minor revisions suggested by reviewer one (and the reference corrections indicated by reviewer two) this manuscript will be accepted for publication. I thank the authors for engaging to productively in the review process. Reviewer's Responses to Questions Key Review Criteria Required for Acceptance? As you describe the new analyses required for acceptance, please consider the following: Methods -Are the objectives of the study clearly articulated with a clear testable hypothesis stated? -Is the study design appropriate to address the stated objectives? -Is the population clearly described and appropriate for the hypothesis being tested? -Is the sample size sufficient to ensure adequate power to address the hypothesis being tested? -Were correct statistical analysis used to support conclusions? -Are there concerns about ethical or regulatory requirements being met? Reviewer #1: Yes Reviewer #2: (No Response) -------------------- Results -Does the analysis presented match the analysis plan? -Are the results clearly and completely presented? -Are the figures (Tables, Images) of sufficient quality for clarity? Reviewer #1: Table 5 - I suggest making it clear that each row refers to a score cut-off. Perhaps rename 1st column as “Venom score cut-off” and add ‘≥’ in front of the 0-12. It is also a bit confusing that for sens/spec/ppv/npv the accuracy using the cut-off is used, whereas for number of patient and number of deaths the number with that specific score is used. Perhaps change column 2 and 3 to the number of patients with that cut-off (i.e., the first row (score cut-off ≥0) would be 140 patients and 20 deaths. Second row 110 patients and 20 deaths). It may be possible to do this a different way - it just needs to be more clear and consistent for the reader. Table 5 - I think there may be errors in the values in this table. For score cut-off of ≥2 the sensitivity is 97.5%. But no deaths are missed at this cut-off so sensitivity should be 100%? With a score cut-off of ≥3 the sensitivity is 95% (seems correct as 1 of 20 deaths missed). Score cut-off of ≥4, 90% sensitivity but this should be 95% as still only one death missed? I haven’t checked spec/PPV and NPV but I would suggest double checking all of the values in Table 5. Reviewer #2: (No Response) -------------------- Conclusions -Are the conclusions supported by the data presented? -Are the limitations of analysis clearly described? -Do the authors discuss how these data can be helpful to advance our understanding of the topic under study? -Is public health relevance addressed? Reviewer #1: (No Response) Reviewer #2: (No Response) -------------------- Editorial and Data Presentation Modifications? Use this section for editorial suggestions as well as relatively minor modifications of existing data that would enhance clarity. If the only modifications needed are minor and/or editorial, you may wish to recommend “Minor Revision” or “Accept”. Reviewer #1: Typo with full stop mid sentence line 406 Reviewer #2: (No Response) -------------------- Summary and General Comments Use this section to provide overall comments, discuss strengths/weaknesses of the study, novelty, significance, general execution and scholarship. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. If requesting major revision, please articulate the new experiments that are needed. Reviewer #1: An excellent study that has adopted a data driven apporach to developing a risk score for predicting mortality outcome of people with viper envenoming in India. With minor changes, as highlighted above, I would suggest this study be accepted. Reviewer #2: The authors should be congratulated on the considerable improvement to the manuscript, particularly in reference to its potential applicability to clinical use. I look forward to seeing it validated in a multi-centre prospective study! Please double check all citations correspond to the relevant reference (for example citation 38 does not correspond to reference 38 - (a letter in reference to another article)) and ensure that the list of references are referenced in accordance with journal specifications. -------------------- PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: Yes: Michael Abouyannis Reviewer #2: No Figure Files: While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Data Requirements: Please note that, as a condition of publication, PLOS' data policy requires that you make available all data used to draw the conclusions outlined in your manuscript. Data must be deposited in an appropriate repository, included within the body of the manuscript, or uploaded as supporting information. This includes all numerical values that were used to generate graphs, histograms etc.. For an example see here: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001908#s5. Reproducibility: To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols References Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article's retracted status in the References list and also include a citation and full reference for the retraction notice. |
| Revision 2 |
|
Dear Dr Gopalakrishnan, We are pleased to inform you that your manuscript 'A simple mortality risk prediction score for viper envenoming in India (VENOMS): A model development and validation study' has been provisionally accepted for publication in PLOS Neglected Tropical Diseases. Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests. Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated. IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript. Should you, your institution's press office or the journal office choose to press release your paper, you will automatically be opted out of early publication. We ask that you notify us now if you or your institution is planning to press release the article. All press must be co-ordinated with PLOS. Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Neglected Tropical Diseases. Best regards, Nicholas R Casewell Associate Editor PLOS Neglected Tropical Diseases Janaka de Silva Deputy Editor PLOS Neglected Tropical Diseases *********************************************************** Following the final minor changes made in response to the reviewers, the revised manuscript has now been accepted for publication. |
| Formally Accepted |
|
Dear Dr Gopalakrishnan, We are delighted to inform you that your manuscript, "A simple mortality risk prediction score for viper envenoming in India (VENOMS): A model development and validation study," has been formally accepted for publication in PLOS Neglected Tropical Diseases. We have now passed your article onto the PLOS Production Department who will complete the rest of the publication process. All authors will receive a confirmation email upon publication. The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any scientific or type-setting errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript. Note: Proofs for Front Matter articles (Editorial, Viewpoint, Symposium, Review, etc...) are generated on a different schedule and may not be made available as quickly. Soon after your final files are uploaded, the early version of your manuscript will be published online unless you opted out of this process. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers. Thank you again for supporting open-access publishing; we are looking forward to publishing your work in PLOS Neglected Tropical Diseases. Best regards, Shaden Kamhawi co-Editor-in-Chief PLOS Neglected Tropical Diseases Paul Brindley co-Editor-in-Chief PLOS Neglected Tropical Diseases |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .