Peer Review History

Original SubmissionOctober 11, 2023
Decision Letter - Christopher M. Barker, Editor, Andrea Marzi, Editor

Dear Mr Mills,

Thank you very much for submitting your manuscript "Climate-based modelling and forecasting of dengue fever in three endemic departments of Peru" for consideration at PLOS Neglected Tropical Diseases. As with all papers reviewed by the journal, your manuscript was reviewed by members of the editorial board and by independent reviewers. The reviewers appreciated the attention to an important topic. Based on the reviews, we are likely to accept this manuscript for publication, providing that you modify the manuscript according to the review recommendations.

Please prepare and submit your revised manuscript within 30 days. If you anticipate any delay, please let us know the expected resubmission date by replying to this email.

When you are ready to resubmit, please upload the following:

[1] A letter containing a detailed list of your responses to all review comments, and a description of the changes you have made in the manuscript.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out

[2] Two versions of the revised manuscript: one with either highlights or tracked changes denoting where the text has been changed; the other a clean version (uploaded as the manuscript file).

Important additional instructions are given below your reviewer comments.

Thank you again for your submission to our journal. We hope that our editorial process has been constructive so far, and we welcome your feedback at any time. Please don't hesitate to contact us if you have any questions or comments.

Sincerely,

Christopher M. Barker

Academic Editor

PLOS Neglected Tropical Diseases

Andrea Marzi

Section Editor

PLOS Neglected Tropical Diseases

***********************

Reviewer's Responses to Questions

Key Review Criteria Required for Acceptance?

As you describe the new analyses required for acceptance, please consider the following:

Methods

-Are the objectives of the study clearly articulated with a clear testable hypothesis stated?

-Is the study design appropriate to address the stated objectives?

-Is the population clearly described and appropriate for the hypothesis being tested?

-Is the sample size sufficient to ensure adequate power to address the hypothesis being tested?

-Were correct statistical analysis used to support conclusions?

-Are there concerns about ethical or regulatory requirements being met?

Reviewer #1: All YES

Reviewer #2: The study's objectives are clearly articulated, focusing on developing a climate-based Bayesian spatiotemporal model to understand and predict dengue incidence in specific regions of Peru. The hypothesis is implicit, proposing that incorporating climatic variables and specific indicators will improve dengue incidence predictions. The study design is appropriate, employing a bespoke Bayesian spatiotemporal model that integrates region-specific climatic knowledge and dengue incidence data. The design includes model fitting, retrospective modelling, and real-time forecasting, all of which align with the study's objectives.

The population is clearly described, focusing on three Peruvian departments: Piura, Tumbes, and Lambayeque. This regional focus is appropriate given the hypothesis that climate impacts dengue incidence differently in various areas. The sample size of 140 months of dengue notifications across three departments appears sufficient for the study's complex modelling framework. The use of cross-validation methods further strengthens the robustness of the analysis.

The study employs advanced statistical methods, including a Bayesian hierarchical model, negative binomial likelihood, and Integrated Nested Laplace Approximation (INLA). These methods are appropriate for handling spatiotemporal data and overdispersion, supporting the study's conclusions effectively. The summary does not explicitly address ethical or regulatory concerns. However, as it involves epidemiological data and statistical modelling rather than direct human or animal subjects, the primary ethical considerations would involve data privacy and accurate reporting, which are not indicated as problematic here.

Overall, the study is well-designed with a robust statistical framework, addressing the objectives through comprehensive modelling and validation techniques. The population is well-chosen, and the sample size is adequate for the study's aims. The statistical analyses are correctly applied, ensuring the conclusions are well-supported. While not explicitly discussed, there are no apparent ethical concerns given the nature of the study. The study appears thorough, well-structured, and methodologically sound, capable of providing valuable insights into the relationship between climate variables and dengue incidence in the specified regions of Peru.

--------------------

Results

-Does the analysis presented match the analysis plan?

-Are the results clearly and completely presented?

-Are the figures (Tables, Images) of sufficient quality for clarity?

Reviewer #1: Generally YES. As mentioned in my review it would be nice to see the dengue data

Reviewer #2: The analysis presented closely matches the analysis plan, as it follows a clear and systematic approach to examining the relationship between climatic factors and dengue incidence. The results are clearly and comprehensively presented, detailing the relationships identified between climate variables and dengue incidence rates (DIRs) at various lag times. The use of exploratory cross-correlation plots (Figure 2) effectively captures the structure and intensity of these relationships, demonstrating strong similarities across different departments and indicating potential for useful climate-based forecasts at least one month ahead.

The Bayesian spatiotemporal model framework, including distributed lag non-linear models (DLNMs), precisely describes the relationships between DIRs and climatic variables while accounting for seasonality, momentum effects, and both temporal and spatial random effects. The results, including three-dimensional exposure-lag-response relative risk (RR) plots (Figure 3), show clear patterns: higher maximum temperatures and extreme precipitation conditions are associated with elevated dengue risk. Additionally, the study finds that both moderate-to-extreme rainfall and severe drought, as measured by the SPI-6 index, influence dengue incidence, and that El Niño events significantly impact RR.

The figures and tables presented are of high quality and provide sufficient clarity. Figures like the cumulative risk plots and exposure-lag-response plots effectively illustrate the findings. Supplementary materials further enhance understanding by providing detailed visualizations of model performance and error distributions.

The model’s performance was validated through various metrics, such as Deviance Information Criterion (DIC), cross-validated (CV) log score, Mean Absolute Error (MAE), and cross-validated posterior predictive checking. The LOOCV posterior predictive check revealed that 94.7% of DIR observations fell within the 95% credible intervals, demonstrating the model's robustness. Visual assessments of out-of-sample predictive performance (Figure 4) and model-based errors (Supplementary Material Figure SI 13) indicate a moderate-to-strong ability to track dengue trends, despite occasional under-estimation of extreme outbreaks.

The model’s capability to detect outbreaks was further assessed through probabilistic estimates, showing high accuracy in classifying out-of-sample outbreaks with thresholds of 50 and 150 per 100,000 DIR. The false positive rates were low, indicating reliable outbreak detection.

In the forecasting analysis, the model accurately predicted subsequent month’s DIRs from 2018 to 2021, with 93.9% of DIR observations within the 95% credible intervals. The model successfully anticipated future dengue outbreaks, achieving 100% correct forecasts for both outbreak thresholds with relatively low false positive rates. Figure 6 and Supplementary Material Figure SI 15 effectively visualize the correspondence between observed and forecasted DIR values, showcasing the model's forecasting reliability. Overall, the analysis is thorough and the presentation of results is clear, supported by high-quality figures and rigorous validation methods.

--------------------

Conclusions

-Are the conclusions supported by the data presented?

-Are the limitations of analysis clearly described?

-Do the authors discuss how these data can be helpful to advance our understanding of the topic under study?

-Is public health relevance addressed?

Reviewer #1: All YES

Reviewer #2: The conclusions are strongly supported by the data, as the climate-based Bayesian hierarchical model accurately captured spatiotemporal trends in dengue incidence. Extensive model validation confirmed the reliability of the findings.

The analysis acknowledges limitations, such as the quality of climate and surveillance data, variability in dengue incidence reporting, and the absence of socioeconomic confounders. These are addressed by including unstructured spatial effects and yearly random effects.

The study advances understanding by identifying specific climatic influences on dengue risk and their lagged effects, corroborated by existing research.

Public health relevance is highlighted through the model’s ability to forecast dengue outbreaks one month ahead with high accuracy. This can inform early warning systems, aiding timely vector control measures and reducing dengue-related healthcare pressures. The study's findings are thus valuable for public health decision-making.

--------------------

Editorial and Data Presentation Modifications?

Use this section for editorial suggestions as well as relatively minor modifications of existing data that would enhance clarity. If the only modifications needed are minor and/or editorial, you may wish to recommend “Minor Revision” or “Accept”.

Reviewer #1: Minor revision. There are a number of aspects that should be relatively easy to add/change and which would improve the paper. These are in my attached word doc.

Reviewer #2: The paper is written very well.

--------------------

Summary and General Comments

Use this section to provide overall comments, discuss strengths/weaknesses of the study, novelty, significance, general execution and scholarship. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. If requesting major revision, please articulate the new experiments that are needed.

Reviewer #1: This is a very good analysis with astonishingly good results for predicting dengue epidemics with only 12% false positive rates. What is lacking is more information on the three study sites and the acquired dengue data, as well as a number of smaller points throughout that need some clarification.

Reviewer #2: I thank the authors for sharing this insightful document, which presents a robust analysis of dengue incidence using a climate-based Bayesian hierarchical model. The study accurately captures spatiotemporal trends and has strong forecasting abilities, predicting dengue outbreaks one month in advance with high reliability. It enhances our understanding of the relationship between climatic variables and dengue risk and has clear public health relevance, aiding in timely deployment of vector control resources.

--------------------

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Figure Files:

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org.

Data Requirements:

Please note that, as a condition of publication, PLOS' data policy requires that you make available all data used to draw the conclusions outlined in your manuscript. Data must be deposited in an appropriate repository, included within the body of the manuscript, or uploaded as supporting information. This includes all numerical values that were used to generate graphs, histograms etc.. For an example see here: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001908#s5.

Reproducibility:

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

References

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article's retracted status in the References list and also include a citation and full reference for the retraction notice.

Attachments
Attachment
Submitted filename: Review Mills and Donnelly.docx
Revision 1

Attachments
Attachment
Submitted filename: dengue_peru_reviewers_response.pdf
Decision Letter - Christopher M. Barker, Editor, Andrea Marzi, Editor

Dear Mr Mills,

We are pleased to inform you that your manuscript 'Climate-based modelling and forecasting of dengue fever in three endemic departments of Peru' has been provisionally accepted for publication in PLOS Neglected Tropical Diseases.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests.

A reviewer (and we as editors) have not been able to locate the data that are stated to be publicly available "from the National Centre for Epidemiology, Disease Prevention and Control (Peru CDC) in Peru’s Ministry of Health at " ext-link-type="uri" xlink:type="simple">https://www.dge.gob.pe/." The link provided is to a general website that leaves a lot of work to the reader to locate the data. To avoid any further delays, we are accepting the manuscript instead of requesting minor revision, but we ask that you please include a clearer definition of the data source, including exactly how and where one might locate the public data used in your analyses.

Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated.

IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards (except the requested clarification regarding the public data source above). Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript.

Should you, your institution's press office or the journal office choose to press release your paper, you will automatically be opted out of early publication. We ask that you notify us now if you or your institution is planning to press release the article. All press must be co-ordinated with PLOS.

Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Neglected Tropical Diseases.

Best regards,

Christopher M. Barker

Academic Editor

PLOS Neglected Tropical Diseases

Andrea Marzi

Section Editor

PLOS Neglected Tropical Diseases

***********************************************************

Please consider moderating claims about the high degree of novelty or pioneering nature of this paper, as some seem exaggerated. Incremental progress has value, and we agree that this study is a useful advance. Modeling and prediction of dengue at various spatio-temporal scales with a wide range of model forms, including zero-inflated and machine learning models, have been published previously. It is somewhat misleading to claim that "this is the first instance in which dengue prediction accuracy has been compared across various spatiotemporal resolutions." Even in the unlikely event that this is true, many other studies on dengue prediction have collectively evaluated predictive performance across a very wide range of spatio-temporal resolutions.

We appreciate your response to the reviewers' concerns, and the reviewers have provided feedback on the revised manuscript.

Reviewer's Responses to Questions

Key Review Criteria Required for Acceptance?

As you describe the new analyses required for acceptance, please consider the following:

Methods

-Are the objectives of the study clearly articulated with a clear testable hypothesis stated?

-Is the study design appropriate to address the stated objectives?

-Is the population clearly described and appropriate for the hypothesis being tested?

-Is the sample size sufficient to ensure adequate power to address the hypothesis being tested?

-Were correct statistical analysis used to support conclusions?

-Are there concerns about ethical or regulatory requirements being met?

Reviewer #1: I thank the authors for taking on board my comments. It reads very well now.

**********

Results

-Does the analysis presented match the analysis plan?

-Are the results clearly and completely presented?

-Are the figures (Tables, Images) of sufficient quality for clarity?

Reviewer #1: I thank the authors for taking on board my comments. It reads very well now. The results are excellent.

**********

Conclusions

-Are the conclusions supported by the data presented?

-Are the limitations of analysis clearly described?

-Do the authors discuss how these data can be helpful to advance our understanding of the topic under study?

-Is public health relevance addressed?

Reviewer #1: I thank the authors for taking on board my comments. It reads very well now.

**********

Editorial and Data Presentation Modifications?

Use this section for editorial suggestions as well as relatively minor modifications of existing data that would enhance clarity. If the only modifications needed are minor and/or editorial, you may wish to recommend “Minor Revision” or “Accept”.

Reviewer #1: (No Response)

**********

Summary and General Comments

Use this section to provide overall comments, discuss strengths/weaknesses of the study, novelty, significance, general execution and scholarship. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. If requesting major revision, please articulate the new experiments that are needed.

Reviewer #1: I thank the authors for taking on board my comments. It reads very well now.

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Formally Accepted
Acceptance Letter - Christopher M. Barker, Editor, Andrea Marzi, Editor

Dear Mr Mills,

We are delighted to inform you that your manuscript, "Climate-based modelling and forecasting of dengue in three endemic departments of Peru," has been formally accepted for publication in PLOS Neglected Tropical Diseases.

We have now passed your article onto the PLOS Production Department who will complete the rest of the publication process. All authors will receive a confirmation email upon publication.

The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any scientific or type-setting errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript. Note: Proofs for Front Matter articles (Editorial, Viewpoint, Symposium, Review, etc...) are generated on a different schedule and may not be made available as quickly.

Soon after your final files are uploaded, the early version of your manuscript will be published online unless you opted out of this process. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers.

Thank you again for supporting open-access publishing; we are looking forward to publishing your work in PLOS Neglected Tropical Diseases.

Best regards,

Shaden Kamhawi

co-Editor-in-Chief

PLOS Neglected Tropical Diseases

Paul Brindley

co-Editor-in-Chief

PLOS Neglected Tropical Diseases

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .