Peer Review History
| Original SubmissionAugust 13, 2025 |
|---|
|
Dear Dr. Persaud, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.
Please submit your revised manuscript by Oct 19 2025 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org . When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols . Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols . We look forward to receiving your revised manuscript. Kind regards, Muhammad Shahzad Aslam, Ph.D.,M.Phil., Pharm-D Academic Editor PLOS ONE Journal Requirements: If the reviewer comments include a recommendation to cite specific previously published works, please review and evaluate these publications to determine whether they are relevant and should be cited. There is no requirement to cite these works unless the editor has indicated otherwise. Additional Editor Comments: Ethics: Need for clarification on waiver vs. approval (R1 #7–8). This is a compliance matter that must be resolved before publication. Data availability: Both reviewers highlight that current practice (“on request”) does not meet PLOS ONE requirements. Must deposit data in an open repository such as OSF. Sample size/generalizability: Both reviewers point out only four countries were included, which limits external validity. This cannot be fixed immediately, but must be framed transparently as a limitation. Reliability: Some domains (e.g., Enforcement) show poor ICC. Both reviewers flag this. Authors must address it in discussion/limitations and ideally adjust the instrument. Overstatement of conclusions: R1 is correct that claims are too strong given small sample + weak domains. Appendices: R1 raises concerns that they are confusing, incomplete, or poorly explained. These can be corrected with careful revision. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? Reviewer #1: Partly Reviewer #2: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? -->?> Reviewer #1: No Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available??> The PLOS Data policy Reviewer #1: No Reviewer #2: No ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English??> Reviewer #1: Yes Reviewer #2: Yes ********** Reviewer #1: I have reviewed the manuscript, but major comments need to be addressed accordingly, the manuscript addresses an important gap by proposing and validating an instrument to assess the design effectiveness of NEML selection processes. However, some methodological, conceptual, and reporting issues require attention before publication: 1. Title of study should be revised for better clarity, it should be catchy and concise 2. Background is long, make it short max 2 lines 3. Purpose/aim/objective of the study should be mentioned separately after the background. 4. The abstract reports ICC values but does not specify the pilot sample size (n=4 countries, 5 raters). Including this would improve transparency. 5. Key words should be mentioned alphabetically 6. Abbreviations should be written in full form first e.g. AFR, EML, NEML, NPPs etc, check this throughout the manuscript. 7. Ethics approval waiver letter is required, mention the details of waiver in revised manuscript and also provide the waiver letter to reviewers and editorial office for their perusal and consideration. 8. While the study used publicly available documents, the authors should clarify whether consultation with WHO experts and recruited raters required institutional ethics approval or exemption (particularly since human raters were involved). Currently, this section is minimal. 9. The authors claim this is the first validated instrument to assess NEML selection process design. While the novelty is clear, the manuscript could benefit from a deeper comparison with existing frameworks/tools for priority setting and policy evaluation e.g., WHO checklist approaches, health policy analysis frameworks. This would better situate the contribution. 10. Why Only four countries (Afghanistan, Papua New Guinea, South Africa, Barbados) were assessed? The rationale for their selection is only briefly explained (income-level stratification). A stronger justification is needed for why these specific countries were chosen and how representative they are. Small sample size also raises concerns about generalizability. 11. While total instrument reliability is excellent (ICC > 0.9), sub-domain reliability (e.g., Relevance, Revisions & Appeals, Enforcement) is weak due to wide CIs and limited items. The authors should discuss how this affects interpretability of subscale scores and whether additional items are needed to improve measurement stability. 12. It was observed that the proxy measures “alignment with WHO model EML additions/removals are reasonable but limited. They primarily capture timeliness rather than overall process quality. The authors should acknowledge this limitation more explicitly and suggest potential stronger gold-standard validity benchmarks. 13. The data availability statement indicates datasets are available upon request. This does not fully align with PLOS ONE’s data policy, which generally requires deposition in an open repository unless there are compelling reasons. Authors should ensure raw scoring data, item-level assessments, and country-level evaluations are made available. 14. The conclusion overstates the robustness of the instrument. Given some domains had low reliability and the pilot sample was limited, claims about wide applicability should be more cautious. The authors should emphasize that further validation in diverse contexts is necessary. Revise the conclusion accordingly. 15. Separately add the limitations and future recommendations section below the conclusion part, clearly mentioning the drawbacks of the current study, and what next can be done, discus this in a logical way. 16. The manuscript is generally clear, but some sections (Methods, particularly instrument development and response scale generation) are overly technical and could be streamlined for readability. A flowchart summarizing instrument development steps would help. 17. Table 3 (response scales) is long and dense; it may be better placed in supplementary materials. Figures 1–3 could use clearer captions that describe the key interpretation points (e.g., what higher/lower scores mean in context). 18. The manuscript uses “AFR” and “Accountability for Reasonableness” interchangeably. Standardize terminology to avoid confusion. 19. Several references are dated (e.g., 2001, 2002 WHO guidelines). More recent WHO documents (2023 model list and guidance) should be cited where applicable. 20. Appendix A, Pilot Study Sample Countries: Only four countries are included, which limits representativeness, the table does not explain why these specific countries (e.g., Afghanistan vs. other low-income countries) were chosen. Explicitly state the selection rationale beyond income-stratification (e.g., data availability, policy diversity). My recommendation is that discuss these points as a footnote or provide a brief explanation in discussion part. 21. Appendix B, Conversion Calculation: No worked example is provided, making it difficult for readers to follow how conversion works in practice. What was the logic behind choosing 42 as the total raw max score and converting to 80 is not sufficiently explained. I recommend to Include a step-by-step example for one item and country, showing raw score. 22. Appendix C, Explanations are superficial 23. Appendix D, Clarify the meaning of rater codes, add a legend, and consider averaging scores in a separate summary table. 24. Appendix E, Adds little beyond what is already in Results.Unclear whether these are averages across raters or consensus scores. State clearly if the totals are mean scores. If redundant with main text, move to supplementary-only. 25. Appendix F, Only percentages are provided; no statistical measures (correlation coefficients, regression outputs) are included. Proxy measures mainly capture timeliness of updates, not full process quality. Include statistical tests (e.g., Pearson/Spearman r, regression slopes). Acknowledge limitations of proxies more strongly. 26. Appendix G, Some domains show poor reliability (e.g., Enforcement ICC = 0.44, CI includes negative values). This is downplayed in the main text. The appendix does not explain why enforcement reliability is so weak (likely due to single-item measure). Add an explicit note on interpretability issues for domains with poor reliability. Consider revising the instrument to include more items under weak domains. 27. The appendices add value by making the methodology transparent, but they currently fall short of journal-quality supplementary material. They require: Better formatting (clearer tables, legends, consistent decimals), Stronger statistical reporting (validity beyond descriptive percentages). More detailed justification for methodological decisions (item reduction, country selection). Removal of duplicated or redundant sections. Without these revisions, the appendices risk confusing rather than supporting readers. 28. Major Revision Required: The manuscript is promising and fills an important methodological gap, but revisions are required to strengthen justification of the study design, address limitations of reliability/validity, clarify ethics and data availability, and moderate conclusions. Reviewer #2: This study presents the first systematic development and validation of an instrument to evaluate the design effectiveness of National Essential Medicines List (NEML) selection processes, addressing a significant gap in the literature regarding quantitative assessment tools. The application of the Accountability for Reasonableness (AFR) framework to the evaluation of NEML selection processes is particularly innovative from a theoretical perspective. The study is well-designed, methodologically rigorous, and yields convincing results with strong theoretical and practical implications. It is recommended for acceptance after minor revisions, including expanding the sample size, optimizing the data availability statement, and elaborating on methodological details. Specific Comments: 1.The instrument development process is rigorous, but the sample size is limited. The tool was developed based on WHO guidelines and expert consultation, demonstrating a systematic approach. However, the pilot study included only four countries, which may limit the generalizability of the findings. It is recommended to expand the number of countries in future studies to enhance the representativeness and robustness of the results. 2.Reliability is generally good, but certain sub-dimensions show low reliability. The ICC values for the total score indicate excellent reliability (>0.9). However, the ICC for the "Enforcement" condition is relatively low (0.44) with a wide confidence interval, suggesting poor inter-rater consistency for this dimension. Further refinement of the scoring criteria or additional items for this dimension are recommended. 3.The validity assessment approach is reasonable, but proxy measures require further justification. The use of "alignment with additions/removals on the WHO Model List" as a proxy measure is appropriate. However, the theoretical linkage between these indicators and "selection process effectiveness" should be more explicitly articulated to strengthen the validity argument. 4.The literature review and methods section could be more detailed. The description of the literature search strategy (databases, keywords, screening process) is somewhat brief. A more thorough methodological description is recommended to enhance reproducibility. Additionally, please clarify the rationale for retaining 16 items and indicate whether factor analysis or item response theory (IRT) was applied. 5.The current data availability statement does not comply with PLOS ONE’s requirements. The statement “Data are available from the corresponding author upon reasonable request” does not meet the journal’s requirement for full public data availability. It is recommended to deposit the data in a public repository (e.g., Figshare, Zenodo) and provide a DOI or access link. 6.Results are clearly presented, but figures could be improved. The figures (e.g., Figure 1–3) effectively communicate the main results but lack sufficient annotations and explanatory text. Please consider adding clearer labels, error bar interpretations, and indicators of statistical significance where applicable. 7.The policy implications are strong and practical. The developed instrument has clear value for cross-country comparisons, policy evaluation, and process improvement. It is suggested to further emphasize in the Discussion how the tool could be implemented by national or international organizations (e.g., WHO) and outline plans for future dissemination. ********** what does this mean? ). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy Reviewer #1: No Reviewer #2: Yes: Jing Zhang, Ph.D. ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/ . PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org . Please note that Supporting Information files do not need this step.
|
| Revision 1 |
|
Assessing the National Essential Medicines List Selection Processes: Instrument Development and Testing PONE-D-25-39957R1 Dear Dr. Persaud, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. For questions related to billing, please contact billing support . If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Muhammad Shahzad Aslam, Ph.D.,M.Phil., Pharm-D Academic Editor PLOS One Additional Editor Comments (optional): Reviewers' comments: Reviewer's Responses to Questions Comments to the Author Reviewer #2: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions??> Reviewer #2: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? -->?> Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available??> The PLOS Data policy Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English??> Reviewer #2: Yes ********** Reviewer #2: The authors are to be commended for their thorough and thoughtful responses to the reviewers' comments. They have undertaken extensive revisions to the manuscript, which has significantly improved its clarity, rigor, and overall quality. All major concerns raised in the previous round of review have been adequately addressed. Key improvements include: A clearer title and abstract structure. A more detailed justification for the pilot study country selection. A revised data availability statement that now aligns with journal policy by directing readers to publicly available WHO repository data and supplementary files. A standardized use of terminology and updated references. A significantly strengthened discussion that better contextualizes the study within the existing literature. A new, stand-alone "Limitations" section that candidly addresses the pilot sample size, the reliability of certain sub-dimensions (notably the single-item 'Enforcement' domain), and the inherent limitations of the proxy measures used for validity. A more measured and cautious conclusion that accurately reflects the instrument's current stage of development as a promising but preliminary tool. The revisions to the methods, results, and appendices have enhanced the transparency and reproducibility of the instrument development process. The authors have successfully moderated claims of robustness while highlighting the tool's potential utility for cross-country comparison and policy evaluation. In summary, the manuscript now presents a well-developed and validated instrument that fills a clear methodological gap in the field. The authors have satisfactorily responded to all points raised, and the study meets the standards for publication in my view. ********** what does this mean? ). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy Reviewer #2: No ********** |
| Formally Accepted |
|
PONE-D-25-39957R1 PLOS One Dear Dr. Persaud, I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS One. Congratulations! Your manuscript is now being handed over to our production team. At this stage, our production department will prepare your paper for publication. This includes ensuring the following: * All references, tables, and figures are properly cited * All relevant supporting information is included in the manuscript submission, * There are no issues that prevent the paper from being properly typeset You will receive further instructions from the production team, including instructions on how to review your proof when it is ready. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few days to review your paper and let you know the next and final steps. Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. You will receive an invoice from PLOS for your publication fee after your manuscript has reached the completed accept phase. If you receive an email requesting payment before acceptance or for any other service, this may be a phishing scheme. Learn how to identify phishing emails and protect your accounts at https://explore.plos.org/phishing. If we can help with anything else, please email us at customercare@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Muhammad Shahzad Aslam Academic Editor PLOS One |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .