Peer Review History

Original SubmissionJuly 13, 2021
Decision Letter - Beryne Odeny, Editor

Dear Dr Peacocke,

Thank you for submitting your manuscript entitled "National adaptation and implementation of the WHO Model List of Essential Medicines: A qualitative evidence synthesis" for consideration by PLOS Medicine.

Your manuscript has now been evaluated by the PLOS Medicine editorial staff and I am writing to let you know that we would like to send your submission out for external peer review.

However, before we can send your manuscript to reviewers, we need you to complete your submission by providing the metadata that is required for full assessment. To this end, please login to Editorial Manager where you will find the paper in the 'Submissions Needing Revisions' folder on your homepage. Please click 'Revise Submission' from the Action Links and complete all additional questions in the submission questionnaire.

Please re-submit your manuscript within two working days, i.e. by Jul 29 2021 11:59PM.

Login to Editorial Manager here: https://www.editorialmanager.com/pmedicine

Once your full submission is complete, your paper will undergo a series of checks in preparation for peer review. Once your manuscript has passed all checks it will be sent out for review.

Feel free to email us at plosmedicine@plos.org if you have any queries relating to your submission.

Kind regards,

Beryne Odeny

Associate Editor

PLOS Medicine

Revision 1
Decision Letter - Beryne Odeny, Editor

Dear Dr. Peacocke,

Thank you very much for submitting your manuscript "National adaptation and implementation of the WHO Model List of Essential Medicines: A qualitative evidence synthesis" (PMEDICINE-D-21-03040R1) for consideration at PLOS Medicine.

Your paper was evaluated by a senior editor and discussed among all the editors here. It was also discussed with an academic editor with relevant expertise, and sent to independent reviewers, including a statistical reviewer. The reviews are appended at the bottom of this email and any accompanying reviewer attachments can be seen via the link below:

[LINK]

In light of these reviews, I am afraid that we will not be able to accept the manuscript for publication in the journal in its current form, but we would like to consider a revised version that addresses the reviewers' and editors' comments. Obviously we cannot make any decision about publication until we have seen the revised manuscript and your response, and we plan to seek re-review by one or more of the reviewers.

In revising the manuscript for further consideration, your revisions should address the specific points made by each reviewer and the editors. Please also check the guidelines for revised papers at http://journals.plos.org/plosmedicine/s/revising-your-manuscript for any that apply to your paper. In your rebuttal letter you should indicate your response to the reviewers' and editors' comments, the changes you have made in the manuscript, and include either an excerpt of the revised text or the location (eg: page and line number) where each change can be found. Please submit a clean version of the paper as the main article file; a version with changes marked should be uploaded as a marked up manuscript.

In addition, we request that you upload any figures associated with your paper as individual TIF or EPS files with 300dpi resolution at resubmission; please read our figure guidelines for more information on our requirements: http://journals.plos.org/plosmedicine/s/figures. While revising your submission, please upload your figure files to the PACE digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at PLOSMedicine@plos.org.

We expect to receive your revised manuscript by Oct 13 2021 11:59PM. Please email us (plosmedicine@plos.org) if you have any questions or concerns.

***Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.***

We ask every co-author listed on the manuscript to fill in a contributing author statement, making sure to declare all competing interests. If any of the co-authors have not filled in the statement, we will remind them to do so when the paper is revised. If all statements are not completed in a timely fashion this could hold up the re-review process. If new competing interests are declared later in the revision process, this may also hold up the submission. Should there be a problem getting one of your co-authors to fill in a statement we will be in contact. YOU MUST NOT ADD OR REMOVE AUTHORS UNLESS YOU HAVE ALERTED THE EDITOR HANDLING THE MANUSCRIPT TO THE CHANGE AND THEY SPECIFICALLY HAVE AGREED TO IT. You can see our competing interests policy here: http://journals.plos.org/plosmedicine/s/competing-interests.

Please use the following link to submit the revised manuscript:

https://www.editorialmanager.com/pmedicine/

Your article can be found in the "Submissions Needing Revision" folder.

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

Please ensure that the paper adheres to the PLOS Data Availability Policy (see http://journals.plos.org/plosmedicine/s/data-availability), which requires that all data underlying the study's findings be provided in a repository or as Supporting Information. For data residing with a third party, authors are required to provide instructions with contact information for obtaining the data. PLOS journals do not allow statements supported by "data not shown" or "unpublished results." For such statements, authors must provide supporting data or cite public sources that include it.

We look forward to receiving your revised manuscript.

Sincerely,

Beryne Odeny

Associate Editor

PLOS Medicine

plosmedicine.org

-----------------------------------------------------------

Requests from the editors:

Before we proceed, please respond to the following:

1) Abstract:

a) Please report your abstract according to PRISMA for abstracts, following the PLOS Medicine abstract structure (Background, Methods and Findings, Conclusions) http://www.plosmedicine.org/article/info:doi/10.1371/journal.pmed.1001419 .

b) Please combine the Methods and Results sections into one section, “Methods and findings”.

c) Please ensure that all numbers presented in the abstract are present and identical to numbers presented in the main manuscript text.

d) In the last sentence of the Abstract Methods and Findings section, please describe the main limitation(s) of the study's methodology.

2) At this stage, we ask that you include a short, non-technical Author Summary of your research to make findings accessible to a wide audience that includes both scientists and non-scientists. The Author Summary should immediately follow the Abstract in your revised manuscript. This text is subject to editorial change and should be distinct from the scientific abstract. Please see our author guidelines for more information: https://journals.plos.org/plosmedicine/s/revising-your-manuscript#loc-author-summary

3) Please submit a completed PRISMA checklist. We understand that not all items on the checklist will be directly relevant, and these can be marked as ‘not applicable’.

a) The PRISMA guidelines provided at the EQUATOR site http://www.equator-network.org/reporting-guidelines/prisma/

b) When completing the checklist, please use section and paragraph numbers, rather than page numbers.

c) Please add the following statement, or similar, to the Methods: "This study is reported as per the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guideline (S1 Checklist)."

4) In line with PLOS Medicine’s guidelines, please update your search to the present time and provide the beginning and end dates of your search.

5) Please avoid assertions of primacy (e.g.," This is the first systematic review of…"). Please temper claims of primacy of results by stating, "to our knowledge" or something similar.

6) References:

a) Please reformat the citation style into PLOS Medicine's format. Please ensure there is no space between numbers in reference call outs within the main text, and the period is placed after the call out. For example, “…NLMs [7,8].”

b) Please ensure that journal name abbreviations consistently match those found in the National Center for Biotechnology Information (NCBI) databases. https://journals.plos.org/plosmedicine/s/submission-guidelines#loc-references.

c) Please update reference #48 or remove if it has not yet been published

d) Please provide weblinks and access dates for reference # 2, 3, 4 and 43. In references #4 ad 43 please update the author’s name to WHO.

7) Please remove the ‘Funding’, from the end of the main text. In the event of publication, this information will be published as metadata based on your responses to the submission form.

Comments from the reviewers:

Reviewer #1: The paper claims to be the first systematic review of qualitative country-level evidence to identify key factors influencing the adaptation and implementation of WHO EML at national level. It brings comprehensive review of what is known (published) and unknown on barriers to implementation of WHO EML concept.

The claims are properly placed in the context of previous literature, and the authors have treated the literature fairly.

The data and the analyses fully support the claims. It would be very useful if authors provided the list (as a supplementary document) of excluded papers with the rationale for the exclusion.

Pg 5. It would be nice if authors checked income status with the World Bank and clearly state it in e.g. Table 2. More elaborate discussion of findings in light of income status of the country in question would be welcome? If data are not available on how many participants were in particular studies, maybe to state that fact, as an asterix in the table?

Pg 4., paragraph #3, "…, Two reviewers…" the letter T should not be capital.

Protocol of this systematic review has been registered at PROSPERO, and there are no major deviations from it. Methods are appropriately selected to answer the research objective.

This paper identifies gaps in EML concept implementation and provides valuable information necessary for better implementation of EML concepts.

The authors have selected GRADECERQual approach which is more suitable for analysis of this kind of qualitative data than the methods Equator Network recommends: SPQR and COREQ, since the latter two are more suitable for classic qualitative research - interviews.

The details of the methodology are sufficiently described and allow experiment to be reproduced.

The manuscript is well organized and written clearly enough to be accessible to non-specialists.

Reviewer #2: This systematic review was performed according to standard methodology and was well written. The author derive some relevant points from the literature. I had a few points to consider:

1. Why did the authors not include quantitative articles in the review? The qualitative lessons would be a lot more impactful if readers understood if there was any empirical basis on which the lessons were based. On a more minor note, the authors provide only in the table a quick summary of the underlying basis on which the recommendations were made in the qualitative articles themselves; it would be useful for some of that information to be integrated into the text as well.

2. The authors appear to consider all of the articles as contributing equally to the recommendations, but the articles were published across 2 decades and across many different countries from HIC to LMIC. Is an article from 20 years ago conducted in possibly a much different local health environment relevant to recommendations today? More background on the context in which the recommendations were made would be helpful -- i.e. how can policymakers in France consider lessons from a study from China if their implementation systems are very different? Even on a more specific note, the authors assigned the articles to different levels of confidence (high->low) based on the features of the report, but then appeared not to use those assignments in deriving their recommendations, since they appear to equally rely on low confidence conclusions from citations #29 and #32 just as strongly as high-confidence citations. Some recognition that a recommendation is based on low-confidence insights would be helpful. The same comment refers to the different qualitative bases on which the conclusions in the articles are reached -- some are based on actual qualitative research, some just on document review -- which is more reliable?

3. Greater detail in the discussion should be provided on how to implement some of these ideas, perhaps identifying specific organizations or prioritizing recommendations with different levels of urgency.

4. Minor stylistic note: There are too many acronyms, which makes for complicated reading.

Reviewer #3: This study addresses an important topic, namely, the adaptation and implementation of the WHO list of essential medicines. This is an interesting topic and may be applicable to countries interested in adapting the WHO list. There are several areas the limit the usefulness of this study.

# Value of WHO list of medicines

- The study has a laudatory perspective on the WHO EML, which offers a "trusted and objective reference list..." (Introduction). However, the WHO EML has several limitations and does not always list medicines that "best satisfy the priority health care needs of a country's population". In fact, the WHO EML omits many medicines for chronic medical conditions (e.g., diabetes, heart disease), which are routinely used in high-income countries. Therefore, the WHO EML might not be a reference document for many countries because it is not always grounded in the best evidence.

- In many countries (HICs, and LMICs; e.g., India), health policy and medicines fall under regional (e.g., state, provincial, etc.) jurisdiction. There may be a national EML and additional regional lists. In such instances, the regional list takes precedence over the national list.

- Given the above points, I am not convinced that many countries are trying to adapt the WHO EML, which raises questions on the utility/value/contribution of this study. I am not confident that this is a major problem or barrier for many countries.

# Data Source and Search Strategy

- The database search was led by an information specialist, which is a strong point.

- However, for this type of study, the grey literature is important because many policy documents might not be published in peer-reviewed journals.

- In conducting a literature search, I identified articles that were not included but seemed pertinent (e.g., Jarvis et al., CMAJ 2019; essential medicines in Canada). I was not part of this study and have no vested interest, but I was curious if this article would be relevant.

- The Limitations mention that the search was done in July 2020, and "following the last update, two studies were added for data extraction". This means, following July 2020? How were these identified? Given that the search was done in July 2020, the authors will have to consider if they should update the search because "We did not complete the search again later in 2021 as we thought it was unlikely that the addition of further studies would influence our main findings" might not convince most reviewers or editors. While new themes may not be identified, similar experiences from other countries may strengthen their conclusions. Having been involved in several systematic reviews, I recognize the effort needed to update literature searches. The authors should consider updating it. For literature sweeps, some journals accept if a single investigator screens articles and extracts data. The authors could consider this as a half-way solution.

# Scope of Review

- Table 2 outlines the types of studies included. It was not clear how the authors decided to combine studies on 'document reviews' and 'qualitative interviews'. If including document reviews, then it becomes more important to include the grey literature, as described above.

- It would be helpful if the study clarified if this list pertained to the adult only or adult and pediatric list of medicines (I apologize if I missed it).

# Audience

- The study should specify the intended audience and target the Discussion accordingly. It is not clear if this is directed toward government leaders, policy makers, academics, etc. Consequently, the Results and Discussion appear to lack focus.

# Additional points

- Many strongly worded statements are without reference(s). Please review and provide references. For example "HICs may have more robust reimbursement processes..."

- Please review for typos

- The Abstract should be revised. Were the 10 themes identified in all 18 studies (the current version suggests that). It would be helpful to summarize if one/few themes were found in all studies or a majority of the studies.

Overall, this is an interesting question, but the value/utility remains uncertain.

Any attachments provided with reviews can be seen via the following link:

[LINK]

Revision 2

Attachments
Attachment
Submitted filename: Response letter QES essential medicines list 20211213.docx
Decision Letter - Beryne Odeny, Editor

Dear Dr. Peacocke,

Thank you very much for re-submitting your manuscript "National adaptation and implementation of the WHO Model List of Essential Medicines: A qualitative evidence synthesis" (PMEDICINE-D-21-03040R2) for review by PLOS Medicine.

I have discussed the paper with my colleagues and the academic editor and it was also seen again by two reviewers. I am pleased to say that provided the remaining editorial and production issues are dealt with we are planning to accept the paper for publication in the journal.

The remaining issues that need to be addressed are listed at the end of this email. Any accompanying reviewer attachments can be seen via the link below. Please take these into account before resubmitting your manuscript:

[LINK]

***Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.***

In revising the manuscript for further consideration here, please ensure you address the specific points made by each reviewer and the editors. In your rebuttal letter you should indicate your response to the reviewers' and editors' comments and the changes you have made in the manuscript. Please submit a clean version of the paper as the main article file. A version with changes marked must also be uploaded as a marked up manuscript file.

Please also check the guidelines for revised papers at http://journals.plos.org/plosmedicine/s/revising-your-manuscript for any that apply to your paper. If you haven't already, we ask that you provide a short, non-technical Author Summary of your research to make findings accessible to a wide audience that includes both scientists and non-scientists. The Author Summary should immediately follow the Abstract in your revised manuscript. This text is subject to editorial change and should be distinct from the scientific abstract.

We expect to receive your revised manuscript within 1 week. Please email us (plosmedicine@plos.org) if you have any questions or concerns.

We ask every co-author listed on the manuscript to fill in a contributing author statement. If any of the co-authors have not filled in the statement, we will remind them to do so when the paper is revised. If all statements are not completed in a timely fashion this could hold up the re-review process. Should there be a problem getting one of your co-authors to fill in a statement we will be in contact. YOU MUST NOT ADD OR REMOVE AUTHORS UNLESS YOU HAVE ALERTED THE EDITOR HANDLING THE MANUSCRIPT TO THE CHANGE AND THEY SPECIFICALLY HAVE AGREED TO IT.

Please ensure that the paper adheres to the PLOS Data Availability Policy (see http://journals.plos.org/plosmedicine/s/data-availability), which requires that all data underlying the study's findings be provided in a repository or as Supporting Information. For data residing with a third party, authors are required to provide instructions with contact information for obtaining the data. PLOS journals do not allow statements supported by "data not shown" or "unpublished results." For such statements, authors must provide supporting data or cite public sources that include it.

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript.

Please note, when your manuscript is accepted, an uncorrected proof of your manuscript will be published online ahead of the final version, unless you've already opted out via the online submission form. If, for any reason, you do not want an earlier version of your manuscript published online or are unsure if you have already indicated as such, please let the journal staff know immediately at plosmedicine@plos.org.

If you have any questions in the meantime, please contact me or the journal staff on plosmedicine@plos.org.  

We look forward to receiving the revised manuscript by Feb 10 2022 11:59PM.   

Sincerely,

Beryne Odeny, 

PLOS Medicine

plosmedicine.org

------------------------------------------------------------

Requests from Editors:

1) Abstract: please change the sub-heading “Objective” to “Background.” Under background, please provide the context of why the study is important. The final sentence should clearly state the study question.

2) Please reformat your Author summary and use bullet points instead of paragraphs. Use no more than 4 bullet points per sub-heading.

Comments from Reviewers:

Reviewer #2: No further comments

Reviewer #3: The authors have provided adequate responses to all questions/comments. I have no further comments.

Any attachments provided with reviews can be seen via the following link:

[LINK]

Revision 3
Decision Letter - Beryne Odeny, Editor

Dear Dr Peacocke, 

On behalf of my colleagues and the Academic Editor, Dr. Aaron S Kesselheim, I am pleased to inform you that we have agreed to publish your manuscript "National adaptation and implementation of the WHO Model List of Essential Medicines: A qualitative evidence synthesis" (PMEDICINE-D-21-03040R3) in PLOS Medicine.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. Please be aware that it may take several days for you to receive this email; during this time no action is required by you. Once you have received these formatting requests, please note that your manuscript will not be scheduled for publication until you have made the required changes.

In the meantime, please log into Editorial Manager at http://www.editorialmanager.com/pmedicine/, click the "Update My Information" link at the top of the page, and update your user information to ensure an efficient production process. 

PRESS

We frequently collaborate with press offices. If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximise its impact. If the press office is planning to promote your findings, we would be grateful if they could coordinate with medicinepress@plos.org. If you have not yet opted out of the early version process, we ask that you notify us immediately of any press plans so that we may do so on your behalf.

We also ask that you take this opportunity to read our Embargo Policy regarding the discussion, promotion and media coverage of work that is yet to be published by PLOS. As your manuscript is not yet published, it is bound by the conditions of our Embargo Policy. Please be aware that this policy is in place both to ensure that any press coverage of your article is fully substantiated and to provide a direct link between such coverage and the published work. For full details of our Embargo Policy, please visit http://www.plos.org/about/media-inquiries/embargo-policy/.

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

Thank you again for submitting to PLOS Medicine. We look forward to publishing your paper. 

Sincerely, 

Beryne Odeny 

PLOS Medicine

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .