Peer Review History
| Original SubmissionFebruary 7, 2025 |
|---|
|
Dear Dr. Khan, Please submit your revised manuscript by May 27 2025 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org . When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols . Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols . We look forward to receiving your revised manuscript. Kind regards, Syed Khurram Azmat, PhD, MPH, MD Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. In the online submission form, you indicated that [Insert text from online submission form here]. All PLOS journals now require all data underlying the findings described in their manuscript to be freely available to other researchers, either 1. In a public repository, 2. Within the manuscript itself, or 3. Uploaded as supplementary information. This policy applies to all data except where public deposition would breach compliance with the protocol approved by your research ethics board. If your data cannot be made publicly available for ethical or legal reasons (e.g., public availability would compromise patient privacy), please explain your reasons on resubmission and your exemption request will be escalated for approval. 3. In the online submission form, you indicated that your data is available only on request from a third party. Please note that your Data Availability Statement is currently missing [contact details for the third party, such as an email address or a link to where data requests can be made]. Please update your statement with the missing information. 4. Please amend your manuscript to include your abstract after the title page. 5. We note that Figures 1-5 in your submission contain [map/satellite] images which may be copyrighted. All PLOS content is published under the Creative Commons Attribution License (CC BY 4.0), which means that the manuscript, images, and Supporting Information files will be freely available online, and any third party is permitted to access, download, copy, distribute, and use these materials in any way, even commercially, with proper attribution. For these reasons, we cannot publish previously copyrighted maps or satellite images created using proprietary data, such as Google software (Google Maps, Street View, and Earth). For more information, see our copyright guidelines: http://journals.plos.org/plosone/s/licenses-and-copyright. We require you to either (1) present written permission from the copyright holder to publish these figures specifically under the CC BY 4.0 license, or (2) remove the figures from your submission: a. You may seek permission from the original copyright holder of Figures 1-5 to publish the content specifically under the CC BY 4.0 license. We recommend that you contact the original copyright holder with the Content Permission Form (http://journals.plos.org/plosone/s/file?id=7c09/content-permission-form.pdf) and the following text: “I request permission for the open-access journal PLOS ONE to publish XXX under the Creative Commons Attribution License (CCAL) CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). Please be aware that this license allows unrestricted use and distribution, even commercially, by third parties. Please reply and provide explicit written permission to publish XXX under a CC BY license and complete the attached form.” Please upload the completed Content Permission Form or other proof of granted permissions as an "Other" file with your submission. In the figure caption of the copyrighted figure, please include the following text: “Reprinted from [ref] under a CC BY license, with permission from [name of publisher], original copyright [original copyright year].” b. If you are unable to obtain permission from the original copyright holder to publish these figures under the CC BY 4.0 license or if the copyright holder’s requirements are incompatible with the CC BY 4.0 license, please either i) remove the figure or ii) supply a replacement figure that complies with the CC BY 4.0 license. Please check copyright information on all replacement figures and update the figure caption with source information. If applicable, please specify in the figure caption text when a figure is similar but not identical to the original image and is therefore for illustrative purposes only. The following resources for replacing copyrighted map figures may be helpful: USGS National Map Viewer (public domain): http://viewer.nationalmap.gov/viewer/ The Gateway to Astronaut Photography of Earth (public domain): http://eol.jsc.nasa.gov/sseop/clickmap/ Maps at the CIA (public domain): https://www.cia.gov/library/publications/the-world-factbook/index.html and https://www.cia.gov/library/publications/cia-maps-publications/index.html NASA Earth Observatory (public domain): http://earthobservatory.nasa.gov/ Landsat: http://landsat.visibleearth.nasa.gov/ USGS EROS (Earth Resources Observatory and Science (EROS) Center) (public domain): http://eros.usgs.gov/# Natural Earth (public domain): http://www.naturalearthdata.com/ [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? Reviewer #1: Yes Reviewer #2: Partly Reviewer #3: Partly ********** 2. Has the statistical analysis been performed appropriately and rigorously? -->?> Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available??> The PLOS Data policy Reviewer #1: No Reviewer #2: Yes Reviewer #3: No ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English??> Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: No ********** Reviewer #1: Dear Authors, Congratulations on preparing a well-structured and logically coherent manuscript. The document is well written; however, some revisions are necessary to enhance its clarity and completeness. The reviewer's suggestions and comments are noted in the attached document for your consideration. It appears that the final manuscript was not thoroughly reviewed before submission, and certain sections would benefit from further elaboration and/or clarification. Additionally, the references do not adhere to a standard format and should be revised accordingly. I am recommending minor revisions, after which the manuscript can be resubmitted for publication. Wishing the authors the best of luck in the revision process. Best regards, Reviewer #2: Major comment The manuscript introduces an interesting approach towards analysing contraceptive availability and consumption data along with vaccine availability and administration in Pakistan. This approach per se is not novel, however, provides some level of insight into these issues in the context of Pakistan. The manuscript does not fully justify how and why the performed analysis may be superior to techniques already deployed and in use. Abstract � The authors mention the effect of inputs on “rate of utilization of services”. The paper does not mention any rate(s) either for contraceptive use or for immunization. � The objective appears to be “We explore the use of spatial heat maps to analyze the distribution of contraceptives and vaccines in Pakistan and to depict these analyses as visualizations.” However, the data from cLMIS is merely the stock of contraceptive(s), not distribution. How do the authors plan to address this aspect? � The results section states “we also show the effect of inputs (supplies, outreach) on rate of utilization of services (contraceptive uptake and vaccine coverage). Finally we depict how these visualizations can help track changes in programming over time.” This is merely a claim and not the finding or result of the study. For example, what is the “rate of utilization of services” the authors have measured? What are the findings that help track change over time? � The authors conclude that they the study “identifies critical gaps in health service supply and demand”, but it is not clear what is the gap? Specific comments � There is a question of generalizability of this study. The authors have referred to its application to all LMICs in the conclusion. However, does Pakistan reflect all LMICs, more so since vaccination data analysis covers the province of Sindh and that too for BCG and Penta-3 via outreach facilities only? � Please revisit the introduction section for more clarity. There are various language errors, note lines 35, 39, 48, 53, 59, 61, 69 and others. � Lines 74-78 appear to be more of a discussion point rather than introduction. � Objective is not clear in the introduction section. � More information on facilities which report data both for cLMIS and vLMIS will be helpful. Are these facilities all in the public sector or in the private sector as well. For contraceptive data, are the facilities operated by the health departments or the population departments in respective provinces. Is contraceptive availability captured in from the private sector as well. Does only outreach Penta-3 coverage provide sufficient information for this kind on analysis? � For contraceptives the authors have stated that the consumption data does not mean that contraceptives have been utilized (line 97). In this situation how can it be suggested that rates of utilization of services have been measured (see abstract). � It is unclear from the analysis if private sector information is part of this data set. Implications will be different if it is than if it is not. Please ensure that it is made clear. � Discussion section needs to be revisited. It will benefit from a discussion around the findings, that is how does the spatial analysis report the status of the contraceptive and vaccine availability as well as consumption. What are the regional disparities? A discussion of trends. � Please also discuss potential limitations in some detail. � The authors state that, “policymakers should address distribution inefficiencies in districts with high wastage and low vaccination rates, improve storage facilities in areas with high wastage, and enhance community outreach and educational campaigns in regions with low vaccination rates to boost uptake.” How is this recommendation flow from the spatial analysis conducted in this study? Isn’t this already known, BCG has one of the highest wastage rates among vaccines. � What policy level decisions can be taken by policy makers using this approach of data analysis? � The discussion section talks about some dashboard and policy makers clicking to get statistics of a district. Was that the purpose of this study? It is not relevant and confuses the reader. � Discussion needs to be crisp and avoid repetition which is considerable at present. � The manuscript does not convince the reader how the use of visualizations may improve routine data analysis and interpretation in this context. Reviewer #3: It is an immensely useful topic to investigate for country with massive population growth and sub-optimal policy development process. Major areas of improvement for this mansucript are language and grammatical errors, logical flow and failure to acknowledge the practical and methodological limitations. 'Consumption' is a key variable and intricate details are lacking, how it is calcuated. ********** what does this mean? ). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy Reviewer #1: Yes: SYED FARHAN ALI TIRMIZI Reviewer #2: No Reviewer #3: Yes: Fahad Javaid Siddiqui ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/ . PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org . Please note that Supporting Information files do not need this step.
|
| Revision 1 |
|
Dear Dr. Khan, ================== The reviewers and editorial team acknowledge that you have addressed the majority of the concerns raised during the previous round of review. Your responses have significantly improved the manuscript, and we commend your efforts to enhance the clarity and rigor of the work. However, there are still a few remaining areas that require attention before the manuscript can be accepted for publication (refer to the second peer review report/s). We therefore invite you to submit a minor revision of your manuscript. Please ensure that you provide a detailed, point-by-point response to the remaining concerns, highlighting any changes made in the revised manuscript. ================== Please submit your revised manuscript by Sep 18 2025 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org . When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols . Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols . We look forward to receiving your revised manuscript. Kind regards, Syed Khurram Azmat, PhD, MPH, MD Academic Editor PLOS ONE Journal Requirements: 1. If the reviewer comments include a recommendation to cite specific previously published works, please review and evaluate these publications to determine whether they are relevant and should be cited. There is no requirement to cite these works unless the editor has indicated otherwise. 2. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author Reviewer #2: (No Response) Reviewer #4: (No Response) ********** 2. Is the manuscript technically sound, and do the data support the conclusions??> Reviewer #2: Partly Reviewer #4: (No Response) ********** 3. Has the statistical analysis been performed appropriately and rigorously? -->?> Reviewer #2: Yes Reviewer #4: (No Response) ********** 4. Have the authors made all data underlying the findings in their manuscript fully available??> The PLOS Data policy Reviewer #2: Yes Reviewer #4: (No Response) ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English??> Reviewer #2: Yes Reviewer #4: (No Response) ********** Reviewer #2: Two concerns still remain. 1. Reporting on 'consumption'. While the authors have tried to address this by adding a definition for consumption, by their own admission "consumption alone does not indicate whether the available stocks are being appropriately utilized" (178-179). This contradicts with their assertion that "the proportion of stocks consumed serves as an indicator of demand for available commodities. For example, if consumption falls below 25% or 50% of the available stock, it suggests under utilization and potential misalignment between supply and demand" (208-210). The fundamental point is that cLMIS data does not provide consumption information for contraceptives such as condoms and oral pills. This is only 'issuance' or 'dispensation' data. Once a client is given these contraceptives, only clients can provide the information on whether the method has been utilized or otherwise. This is a serious limitation in this analysis and has not been discussed in the relevant section. 2. Reporting 'trends'. The data represented from a single year i.e. 2022. The only trends provided are for Penta-3 vaccine and that too only for 12 months in a single year. The paper is presenting this as a trend analysis for contraceptives as well, which is not correct. These two aspects must be rectified. Reviewer #4: Reviewer Report for PONE-D-25-06311 / PONE-D-25-06311R1 1. Previous Round Response The authors have provided a “Response to Reviewers” file indicating that they revised the manuscript throughout. Based on my review below, I do not recommend bypassing detailed comments; the manuscript still requires some improvements before acceptance. 2. Technical Soundness & Data Support Recommendation: Minor revision The study applies heat‐map visualizations coherently and the data presented support the stated conclusions about geographic disparities and temporal trends in contraceptive and vaccine logistics. However, the manuscript lacks a more rigorous description of any statistical testing or validation of the quantile cut‐offs and does not discuss uncertainty or sensitivity of the maps. 3. Statistical Analysis Recommendation: Needs improvement While the mapping methods are clearly described, no statistical tests (e.g., spatial autocorrelation measures, significance of differences between regions, or confidence intervals for consumption proportions) are reported. The choice of quartile cut‐offs should be justified or tested for robustness. 4. Data Availability Recommendation: No The Data Availability Statement indicates that data “will be available upon request” from Chemonics, which does not satisfy PLOS ONE’s requirement for fully open data. The authors must deposit cleaned, de‐identified datasets and any shapefiles to a public repository (e.g., Dryad, Zenodo) and include accession DOIs. 5. English & Presentation Recommendation: Acceptable with minor editing Overall the English is clear and the flow logical. A few grammatical or typographical errors remain (e.g., “adjected” → “adjusted” in Figure 2 caption; inconsistent hyphenation of “bi-variate” vs. “bivariate”). The Introduction and Discussion could be tightened to avoid some repetition. 6. Review Comments to the Author Abstract & Keywords Change made: Abstract wording refined for clarity; “depict these analyses as visualizations” changed to “analyze the stock availability and consumption/vaccination patterns” and keywords expanded to include “public policy” and “immunization.” Suggestion: Remove redundancies (“Finally, we depict…” duplicates methods wording). Limit keywords to six. Methods – Data Sources & Shapefiles Change made: Added description of geoBoundaries shapefiles and CC BY 4.0 license. Suggestion: Move shapefile license information to a Data Availability subsection. Clarify any QA/QC steps taken on LMIS data (e.g., how missing or delayed reports were handled). Statistical Rigor Needs improvement: No statistical measures accompany the maps. Consider adding: Spatial autocorrelation (e.g., Moran’s I) to quantify clustering. Sensitivity analysis around quartile cut-offs. Confidence intervals or bootstrapping for consumption proportions. Data Availability Needs improvement: PLOS policy requires public deposition. Please upload aggregated, de-identified district-level data and shapefiles to a public repository (e.g., Zenodo) and include DOI in the Data Availability Statement. Ethics Statement Current: “N/A” Suggestion: Although this is secondary data, state explicitly “Data are aggregate and anonymized; ethics approval was not required” or cite the institutional review board that waived review. English & Formatting Minor corrections: Figure 2 caption: “adjected” → “adjusted.” Consistency in hyphenation: use “bivariate” and “trivariate” throughout. Remove duplicate paragraphs in Discussion beginning “Improving data systems…” and “Exploratory data techniques…” Limitations Needs improvement: Although briefly mentioned, the Limitations section should discuss potential biases due to delayed reporting, data entry errors, and the exclusion of private sector LMIS gaps. Also note that MWRA estimates are based on the 2017 census only. Figures & Legends Change made: Figures reorganized and legends refined. Suggestion: Ensure all maps have consistent color scales and that size/area legends (e.g., circle sizes in tri-variate maps) are clearly labeled with numeric values. Discussion and Conclusions Needs improvement: The Discussion reiterates results without deeper interpretation of policy implications. Please expand on how local health managers could operationalize these heat maps (e.g., integrating into existing dashboards, training needs). ********** what does this mean? ). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy Reviewer #2: No Reviewer #4: Yes: Muhammad Bilal Siddiqui ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/ . PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org |
| Revision 2 |
|
Unlocking Insights from Complex Data: Leveraging Heat Maps for Decision-Making in LMIC PONE-D-25-06311R2 Dear Dr. Khan, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. For questions related to billing, please contact billing support . If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Syed Khurram Azmat, PhD, MPH, MD Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: |
| Formally Accepted |
|
PONE-D-25-06311R2 PLOS ONE Dear Dr. Khan, I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team. At this stage, our production department will prepare your paper for publication. This includes ensuring the following: * All references, tables, and figures are properly cited * All relevant supporting information is included in the manuscript submission, * There are no issues that prevent the paper from being properly typeset You will receive further instructions from the production team, including instructions on how to review your proof when it is ready. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few days to review your paper and let you know the next and final steps. Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. You will receive an invoice from PLOS for your publication fee after your manuscript has reached the completed accept phase. If you receive an email requesting payment before acceptance or for any other service, this may be a phishing scheme. Learn how to identify phishing emails and protect your accounts at https://explore.plos.org/phishing. If we can help with anything else, please email us at customercare@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Syed Khurram Azmat Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .