Peer Review History
| Original SubmissionMarch 14, 2025 |
|---|
|
Dear Dr. Ngwira, Please submit your revised manuscript by Jun 27 2025 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org . When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols . Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols . We look forward to receiving your revised manuscript. Kind regards, Rebecca Lee Smith, D.V.M., M.S., Ph.D. Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. Thank you for uploading your study's underlying data set. Unfortunately, the repository you have noted in your Data Availability statement does not qualify as an acceptable data repository according to PLOS's standards. At this time, please upload the minimal data set necessary to replicate your study's findings to a stable, public repository (such as figshare or Dryad) and provide us with the relevant URLs, DOIs, or accession numbers that may be used to access these data. For a list of recommended repositories and additional information on PLOS standards for data deposition, please see https://journals.plos.org/plosone/s/recommended-repositories . 3. Thank you for stating the following in the Acknowledgments Section of your manuscript: [This study was supported by the Regional Scholarship and Innovation Fund (RSIF) of the Partnership for Skills in Applied Sciences, Engineering and Technology (PASET) (Project Grant No. P165581) grant to SACIDS Africa Centre of Excellence for Infectious Diseases of Humans and Animals in Southern and East Africa (SACIDS-ACE) at the Sokoine University of Agriculture (SUA). Alfred Ngwira was a recipient of an RSIF-PASET doctoral scholarship at SUA.] We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows: “The authors received no specific funding for this work.” Please include your amended statements within your cover letter; we will change the online submission form on your behalf. 4. We note that Figures 1,3,4 and 5 in your submission contain [map/satellite] images which may be copyrighted. All PLOS content is published under the Creative Commons Attribution License (CC BY 4.0), which means that the manuscript, images, and Supporting Information files will be freely available online, and any third party is permitted to access, download, copy, distribute, and use these materials in any way, even commercially, with proper attribution. For these reasons, we cannot publish previously copyrighted maps or satellite images created using proprietary data, such as Google software (Google Maps, Street View, and Earth). For more information, see our copyright guidelines: http://journals.plos.org/plosone/s/licenses-and-copyright. We require you to either (1) present written permission from the copyright holder to publish these figures specifically under the CC BY 4.0 license, or (2) remove the figures from your submission: 1. You may seek permission from the original copyright holder of Figures 1,3,4 and 5 to publish the content specifically under the CC BY 4.0 license. We recommend that you contact the original copyright holder with the Content Permission Form (http://journals.plos.org/plosone/s/file?id=7c09/content-permission-form.pdf) and the following text: “I request permission for the open-access journal PLOS ONE to publish XXX under the Creative Commons Attribution License (CCAL) CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). Please be aware that this license allows unrestricted use and distribution, even commercially, by third parties. Please reply and provide explicit written permission to publish XXX under a CC BY license and complete the attached form.” Please upload the completed Content Permission Form or other proof of granted permissions as an ""Other"" file with your submission. In the figure caption of the copyrighted figure, please include the following text: “Reprinted from [ref] under a CC BY license, with permission from [name of publisher], original copyright [original copyright year].” 2. If you are unable to obtain permission from the original copyright holder to publish these figures under the CC BY 4.0 license or if the copyright holder’s requirements are incompatible with the CC BY 4.0 license, please either i) remove the figure or ii) supply a replacement figure that complies with the CC BY 4.0 license. Please check copyright information on all replacement figures and update the figure caption with source information. If applicable, please specify in the figure caption text when a figure is similar but not identical to the original image and is therefore for illustrative purposes only. The following resources for replacing copyrighted map figures may be helpful: USGS National Map Viewer (public domain): http://viewer.nationalmap.gov/viewer/ The Gateway to Astronaut Photography of Earth (public domain): http://eol.jsc.nasa.gov/sseop/clickmap/ Maps at the CIA (public domain): https://www.cia.gov/library/publications/the-world-factbook/index.html and https://www.cia.gov/library/publications/cia-maps-publications/index.html NASA Earth Observatory (public domain): http://earthobservatory.nasa.gov/ Landsat: http://landsat.visibleearth.nasa.gov/ USGS EROS (Earth Resources Observatory and Science (EROS) Center) (public domain): http://eros.usgs.gov/# Natural Earth (public domain): http://www.naturalearthdata.com/ [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? Reviewer #1: Partly Reviewer #2: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? -->?> Reviewer #1: Yes Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available??> The PLOS Data policy Reviewer #1: Yes Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English??> Reviewer #1: Yes Reviewer #2: Yes ********** Reviewer #1: Review of the Manuscript: “JSTMapp: A web-based joint spatiotemporal modeling and mapping application for epidemiologists” The manuscript focuses on JSTMapp, a user-friendly web-based dashboard for joint spatiotemporal modelling and mapping of two diseases using Bayesian hierarchical modelling applying INLA and R Shiny. The application deals with cattle bovine tuberculosis (BTB) and human extrapulmonary tuberculosis (EPTB) across Africa from 2005 to 2018. The study presents a highly a welcome tool for epidemiologists who may not have advanced programming skills. By integrating Bayesian spatiotemporal modelling into a graphical interface, JSTMapp facilitates a complex modelling process. Strengths • JSTMapp presents a user-friendly application for complex joint spatiotemporal modelling which is highly relevant and valuable, especially for public health researchers with limited statistical or programming expertise. • The approach implements multivariate, disease specific and multivariate shared components, allowing for the exploration of spatial, temporal, and spatiotemporal correlations. • The approach incorporates prediction capabilities for a wide range of prediction intervals. • The approach includes an interactive exploratory data analysis component, a mapping of standardized incidence ratios module, and a spatiotemporal risk interpolation component enhancing user experience. • The application is well documented with an easily to use installation guide via GitHub. Limitations and Areas for Improvement Despite its strengths, the manuscript and the application have several important limitations that should be addressed: 1. Lack of Model Flexibility The current version of JSTMapp assumes that all spatially structured, temporally structured, and unstructured components are significant contributors to explaining the spatiotemporal variability of the diseases. • Critique: In real-world applications, not all random components may be significant. • Suggestion: The approach should allow model selection options (particularly , selecting spatial effects only, temporal effects only, or spatiotemporal effects only) based on model comparison criteria like the DIC, WAIC, or CPO. See inter alia Jaya and Folmer 2020, J. of Geographical Systems, pp 105-142; 2021, Geographical Analysis, pp 767-817. 2. Fixed Prior Specifications The application does not allow users to adjust prior distributions for the random effects or the hyperparameters (see Jaya and Folmer 2020, J. of Geographical Systems, pp 105-142). • Critique: The choice of priors can heavily influence Bayesian model prediction results, especially in the case of sparse data. • Suggestion: Providing options for users to modify priors (particularly, for spatial precision, temporal precision, and weight parameters) would significantly increase the flexibility and broader applicability of JSTMapp. 3. Limited Covariate Inclusion The model is restricted to area and time effects as covariates. No allowance for additional covariates (such as socio-economic factors, climate variables, etc.) is provided. • Suggestion: Allowing JSTMapp for the inclusion of external covariates would make it more powerful for real-world disease mapping and risk modelling. • Note: For an overview of the prediction accuracy of multivariate spatiotemporal models with a confounded covariate versus univariate models without covariates, see Jaya and Folmer, 2025, J. of Geographical Systems, 113-146. 4. Lack of Hotspot Detection The application does not support posterior probability mapping or hotspot analysis (particularly, mapping of areas where the posterior probability of risk exceeding a threshold is above 0.8 or 0.9). See Jaya, Folmer, and Lundberg, 2024, Annals of Regional Science , pp 107-140, for details) • Suggestion: Adding this feature would be very useful for public health interventions. 5. Future Prediction Needs Accuracy Evaluation Although the application enables future risk prediction, it does not evaluate the prediction performance (see Jaya and Folmer 2020, J. of Geographical Systems, pp 105-142) • Critique: Without validating using a training and testing dataset split, the forecasted risks lack an objective measure of accuracy. • Suggestion: The authors should consider integrating a model validation procedure where part of the data is used for training and another part for testing. Predictive performance metrics such as the MAE, RMSE, or correlation coefficients between observed and predicted values should be provided as statistics to assess forecast accuracy. (See inter alia Jaya and Folmer 2020, J. of Geographical Systems, pp 105-142; Jaya and Folmer, 2025, J. of Geographical Systems, 113-146) 6. Deployment Issues The application performs better when run locally rather than online via a Shiny server due to memory limitations. • Suggestion: While the paper recommends using GitHub local installation, applying Dockerization or lightweight server deployment are likely to improve online usability. 7. Graphics and Interface Improvements • Critique: Some of the graphical outputs could be improved in terms of better readability (e.g., appropriate scaling legends, improving color schemes for color-blind users). • Suggestion: Future updates should offer user-friendely color palettes and exportable high-resolution images. • Note: For high-resolution prediction and mapping the author may consult Jaya and Folmer 2022, J. of Geographical Systems, 525-581. Minor Points • Typographical and grammatical editing are needed to improve the clarity and professionalism of the manuscript. Some minor errors in English expression should be corrected. • It would be beneficial if the authors could provide a video tutorial or sample case studies in the GitHub repository for beginners. Reviewer #2: The authors describe a bioinformatic application called JSTMapp that they have developed in R, and can be used to fit statistical models to epidemiological surveillance datasets consisting of spatiotemporally referenced case-counts for multiple diseases. JSTMapp can be run using open-source tools such as R, GitHub, or an online interface. They provide an example dataset of national, annual level case-counts of two diseases – BTB, and EPTB – sourced from publicly available repositories and georeferenced to areal units of numerous African countries. When loaded into the JSTMapp interface, the application applies a suite of modeling and data visualization processes to the data allowing the user to explore trends and parameters derived from the model, including spatially interpolated predictions based on shapefiles of the areal units. The example dataset also includes the environmental variables of temperature and precipitation (however it is unclear to me if these are included in the model, as I do not see parameter estimates for them under the “Model estimation” tab). As described, the tool has notable applications for epidemiologists and students of biostatistics, although some upfront work is required of the user to set up the time series data in the right format and link it to the polygons in the shapefile. I am someone who works with spatiotemporally referenced health data frequently, but who has only intermediate R and basic GitHub proficiency. I have not myself ever fitted the kinds of models employed by JSTMapp (INLA, MCAR etc.) though I am aware of them, have colleagues who work with them frequently, and understand them to be appropriate and state of the art methods for this kind of data. I therefore approach this review from the perspective of the “ordinary epidemiologist with limited analytical skills” that the authors describe. Introduction: Not being previously familiar with the term “joint spatiotemporal modeling”, it is unclear to me whether in these kinds of model, each disease outcome serves as a predictor for the others. Is the burden of each disease jointly modeled conditional on the presence of the others. Could the authors please clarify? Is it only applicable to infectious diseases? This is not specified. Methods: This section starts with a lengthy explication of the modelling using equations and formal notation. I am not qualified to review these equations, however I do believe that in most journal articles, equations are numbered so that they can be easily referenced within the text. I think the “components of the application” should be moved up to the beginning of the methods section, and the model descriptions should be lower down or even moved to a supplemental appendix. Results: I’m not sure that a results section is even required for this type of paper, since you are not offering an interpretation of scientific findings, but rather describing a tool and an illustrative example of its application. I will defer to the editor on this point, but perhaps “illustrative example” would be a better name for this section. The sources of the illustrative data could perhaps be described in a separate section with its own subheading, and I don’t think that full URLs should be given within the text. Rather, online sources should be cited using in-text citations e.g. (WHO 2025) referencing sources in the bibliography which would include their URLs. Perhaps the sources could be better presented in a small table. I was able to download the data and JSTMapp R package and run the application using RStudio. I was not able to do this within GitHub as I am less familiar with that platform. The database that’s downloadable from GitHub contains what appear to be several meteorological variables (temp, tmax, tmin, prec). These are static across years within each country in the database and are not described or cited in the article. It is unclear if they are being used as predictors in the model, and in any case, they probably should not be, since national aggregate statistics are not a suitable level of resolution for weather parameters. Figure 1: I selected the variables in the same way that the authors described, but the visualizations did not appear in exactly the same way. Instead of the maps in the upper left-hand corner of figure 1, I got an error message saying “the following option does not exist: check.and.fix.. Furthermore, the label for figure 1 does not sufficiently describe the map panel. Are these predictions from the INLA component of the model? The legend title is not legible in either the article figure, or in the application interface. I realize that the data is meant to be illustrative, but the authors should perhaps acknowledge that in a real epidemiological analysis, it would not be appropriate to do a spatial interpolation for an entire continent that was based on national level aggregates, since that does not offer sufficient spatial resolution. Similarly, annual totals are probably not a sufficient temporal resolution to derive conclusion about infectious disease transmission. The optimal use case for this package, I think, would be at least monthly or weekly resolution epidemiological data aggregated to province, or district level. Figure 2: Since the other tabs offer visually appealing visualizations of the model results, could the “Model estimation” tab do the same, rather than displaying raw R model output? Perhaps the parameter estimates could be visualized in dot-and-whisker plots. Figure 3: The maps in this figure did not appear when I ran the application in RStudio. I got the same error message about the option not existing. Figure 4: The prediction maps appeared when I ran the application, but the estimation maps did not (same error message). The application does not seem to offer any customizability in the visual outputs and as such is not particularly interactive. More important than generating a series of panels for each year, would be for the user to be able to zoom in and out of the map and click on particular locations to see the prediction values displayed in a pop-out. Furthermore, the user should be able to assign names to the diseases so that they appear in the graph legends rather than “Disease 1” and “Disease 2”. Figure 5: Again, the maps did not appear when I ran the application. I realize that, since the data is intended to be illustrative, commenting on the actual results of the model is beside the point, however, I do find the post-2018 predictions for EPTB implausible. What possible reason could there be for the relative risk to plummet below the null value of 1 like that? It does not seem to be an extrapolation from the observed trends pre-2018. The authors do not comment on this strange finding. Figure 6: When I select the “Correlation” tab, no results appear and instead an error message says “Package 'sn' is required to proceed but is not installed. Please install.” sn is not listed among the required packages. Also, the database is named differently in the downloadable file (jointafrica.csv) compared to in the screenshot figures (jointcattlehuman.csv). Discussion: The authors are right to highlight the lack of flexibility of the tool. The ideal use case for JSTMapp is so specific that it is hard to imagine it arising frequently enough to warrant a dedicated package, and yet the example dataset that it is tailored to (the BTB, EPTB example) is not even a suitable use case for this kind of model, since the data is aggregated to national and annual totals. General comments: The dashboard allows the user to select two diseases and their populations at risk from the database using the dropdown menu. Is it possible to jointly model more than two diseases? The authors refer to “the application” throughout the manuscript. I think they should own the name JSTMapp more and say e.g. “JSTMapp” can be run in R software…” (line 164). The name is not even mentioned in the abstract and doesn’t occur in the main text until line 178. It’s a decent name and I think the authors should not be hesitant to use it. It would be nice if JSTMapp had a simple logo that could appear on the dashboard and thumbnails for the package. The authors could consider developing one on Canva or a similar platform. ********** what does this mean? ). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy Reviewer #1: Yes: HENK FOLMER Reviewer #2: Yes: Josh M Colston ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/ . PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org . Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
JSTMapp: a web-based joint spatiotemporal modelling and mapping application for epidemiologists PONE-D-25-13633R1 Dear Dr. Ngwira, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. For questions related to billing, please contact billing support . If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Rebecca Lee Smith, D.V.M., M.S., Ph.D. Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewer #1: Reviewer #2: Reviewers' comments: Reviewer's Responses to Questions Comments to the Author Reviewer #1: (No Response) Reviewer #2: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions??> Reviewer #1: Yes Reviewer #2: (No Response) ********** 3. Has the statistical analysis been performed appropriately and rigorously? -->?> Reviewer #1: Yes Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available??> The PLOS Data policy Reviewer #1: Yes Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English??> Reviewer #1: Yes Reviewer #2: Yes ********** Reviewer #1: THE AUTHORS HAVE IMPLEMENTED MY COMMENTS AND RECOMMONDATIONS SATISFACTORLY . Reviewer #2: Thank you for addressing my initial comments from the first round. The limitations are better characterized and the application is more visually appealing now. After a bit of playing around and a few failed attempts (I think due to having the input files stored in different folders) I was able to recreate in RStudio the output shown in the manuscript figures. I will note that the figures are a little slow to load, and that the bottom time series panel under the "Spatial and Temporal Risk" tab did not load, instead giving me the message "plot omitted-your model has no temporal component". Also, the output on the "Correlation" is more limited than in the corresponding figure - perhaps I was meant to select some covariates in the "Model estimation" tab? - and in legends on some of the maps are so large that they obscure the content. In any case, I think the paper can be accepted, and these minor issues can be addressed while the paper is in press. Congratulations on a well-written paper and an appealing application that has some (admittedly narrow) applications of public health relevance. ********** what does this mean? ). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy Reviewer #1: No Reviewer #2: Yes: Josh M Colston ********** |
| Formally Accepted |
|
PONE-D-25-13633R1 PLOS ONE Dear Dr. Ngwira, I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team. At this stage, our production department will prepare your paper for publication. This includes ensuring the following: * All references, tables, and figures are properly cited * All relevant supporting information is included in the manuscript submission, * There are no issues that prevent the paper from being properly typeset You will receive further instructions from the production team, including instructions on how to review your proof when it is ready. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few days to review your paper and let you know the next and final steps. Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. You will receive an invoice from PLOS for your publication fee after your manuscript has reached the completed accept phase. If you receive an email requesting payment before acceptance or for any other service, this may be a phishing scheme. Learn how to identify phishing emails and protect your accounts at https://explore.plos.org/phishing. If we can help with anything else, please email us at customercare@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Rebecca Lee Smith Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .