Peer Review History

Original SubmissionMarch 3, 2020
Decision Letter - Clare Stone, Editor

Dear Dr Hogan,

Thank you for submitting your manuscript entitled "Prioritising RTS,S/AS01 malaria vaccine allocation to maximise public health impact: a modelling study" for consideration by PLOS Medicine. Please accept my apologies for the delay in getting back to you about it.

Your manuscript has now been evaluated by the PLOS Medicine editorial staff [as well as by an academic editor with relevant expertise] and I am writing to let you know that we would like to send your submission out for external peer review.

However, before we can send your manuscript to reviewers, we need you to complete your submission by providing the metadata that is required for full assessment. To this end, please login to Editorial Manager where you will find the paper in the 'Submissions Needing Revisions' folder on your homepage. Please click 'Revise Submission' from the Action Links and complete all additional questions in the submission questionnaire.

Please re-submit your manuscript within two working days, i.e. by .

Login to Editorial Manager here: https://www.editorialmanager.com/pmedicine

Once your full submission is complete, your paper will undergo a series of checks in preparation for peer review. Once your manuscript has passed all checks it will be sent out for review.

Feel free to email us at plosmedicine@plos.org if you have any queries relating to your submission.

Kind regards,

Clare Stone, PhD,

PLOS Medicine

Revision 1
Decision Letter - Emma Veitch, Editor

Dear Dr. Hogan,

Thank you very much for submitting your manuscript "Prioritising RTS,S/AS01 malaria vaccine allocation to maximise public health impact: a modelling study" (PMEDICINE-D-20-00728R1) for consideration at PLOS Medicine.

Your paper was evaluated by a senior editor and discussed among all the editors here. It was also discussed with an academic editor with relevant expertise, and sent to independent reviewers, including a statistical reviewer. The reviews are appended at the bottom of this email and any accompanying reviewer attachments can be seen via the link below:

[LINK]

In light of these reviews, I am afraid that we will not be able to accept the manuscript for publication in the journal in its current form, but we would like to consider a revised version that addresses the reviewers' and editors' comments. Obviously we cannot make any decision about publication until we have seen the revised manuscript and your response, and we plan to seek re-review by one or more of the reviewers.

In revising the manuscript for further consideration, your revisions should address the specific points made by each reviewer and the editors. Please also check the guidelines for revised papers at http://journals.plos.org/plosmedicine/s/revising-your-manuscript for any that apply to your paper. In your rebuttal letter you should indicate your response to the reviewers' and editors' comments, the changes you have made in the manuscript, and include either an excerpt of the revised text or the location (eg: page and line number) where each change can be found. Please submit a clean version of the paper as the main article file; a version with changes marked should be uploaded as a marked up manuscript.

In addition, we request that you upload any figures associated with your paper as individual TIF or EPS files with 300dpi resolution at resubmission; please read our figure guidelines for more information on our requirements: http://journals.plos.org/plosmedicine/s/figures. While revising your submission, please upload your figure files to the PACE digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at PLOSMedicine@plos.org.

We expect to receive your revised manuscript by May 27 2020 11:59PM. Please email us (plosmedicine@plos.org) if you have any questions or concerns.

***Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.***

We ask every co-author listed on the manuscript to fill in a contributing author statement, making sure to declare all competing interests. If any of the co-authors have not filled in the statement, we will remind them to do so when the paper is revised. If all statements are not completed in a timely fashion this could hold up the re-review process. If new competing interests are declared later in the revision process, this may also hold up the submission. Should there be a problem getting one of your co-authors to fill in a statement we will be in contact. YOU MUST NOT ADD OR REMOVE AUTHORS UNLESS YOU HAVE ALERTED THE EDITOR HANDLING THE MANUSCRIPT TO THE CHANGE AND THEY SPECIFICALLY HAVE AGREED TO IT. You can see our competing interests policy here: http://journals.plos.org/plosmedicine/s/competing-interests.

Please use the following link to submit the revised manuscript:

https://www.editorialmanager.com/pmedicine/

Your article can be found in the "Submissions Needing Revision" folder.

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see http://journals.plos.org/plosmedicine/s/submission-guidelines#loc-methods.

Please ensure that the paper adheres to the PLOS Data Availability Policy (see http://journals.plos.org/plosmedicine/s/data-availability), which requires that all data underlying the study's findings be provided in a repository or as Supporting Information. For data residing with a third party, authors are required to provide instructions with contact information for obtaining the data. PLOS journals do not allow statements supported by "data not shown" or "unpublished results." For such statements, authors must provide supporting data or cite public sources that include it.

We look forward to receiving your revised manuscript.

Sincerely,

Emma Veitch, PhD

PLOS Medicine

On behalf of Clare Stone, PhD, Acting Chief Editor,

PLOS Medicine

plosmedicine.org

-----------------------------------------------------------

Requests from the editors:

*The abstract should be structured using the PLOS Medicine headings (Background, Methods and Findings, Conclusions -- Methods and Findings a single combined sub-section).

*In the Background section of the abstract, it would be good to also say something about the proven efficacy of the vaccine in trials, since the abstract just starts with the information about pilot implementation without saying anything about this being done against a background of the phase III trial data.

*In the last sentence of the Abstract Methods and Findings section, please describe the main limitation(s) of the study's methodology.

*At this stage, we ask that you include a short, non-technical Author Summary of your research to make findings accessible to a wide audience that includes both scientists and non-scientists. The Author Summary should immediately follow the Abstract in your revised manuscript. This text is subject to editorial change and should be distinct from the scientific abstract. Please see our author guidelines for more information: https://journals.plos.org/plosmedicine/s/revising-your-manuscript#loc-author-summary

*If possible, please reformat the in-text reference callouts so these are numbered citations in square brackets (eg [1, 2]) etc rather than superscript numerals. This should be quick and easy if referencing software was used. Many thanks.

-----------------------------------------------------------

Comments from the reviewers:

Reviewer #1: The RTS,S/AS01 vaccine pilot is now well underway in three African endemic countries, and preparations need urgently to be made in view of possible large-scale implementation - in case the results of the pilot introduction are satisfactory. The present modelling study makes a good attempt at exploring some important parameters for future implementation, such as efficacy under different level of co-interventions, and at different levels of vaccine coverage. This study looks at two key public health parameters (clinical cases and deaths from malaria) and explores the very interesting issues of whether vaccine priority allocation should be considered at country or at sub-national level. The modelling seems to be solid and is done by one of the most experienced groups in the field.

Major comments

I have three major comments, which should be addressed before the manuscript can be considered for publication.

1. In the introduction on p5, the authors claim that the age groups for vaccination in the large-scale randomized controlled clinical trial done in 11 African sites and published in 2015 were "approximately 4, 5, 6 and 25 months". This puzzles me because the schedule in the RCT was 1,2,3, and 18 months. Since it was an RCT it was strictly enforced. The vaccination schedule at 5, 6 and 25 months is the one chosen for the pilot implementation in 3 countries in order to make it more EPI-compatible. In addition, because the vaccine is now implemented in a real-world situation, there will inevitably be some variability in the age at vaccination.

Given how age-sensitive malaria incidence and mortality are, this difference must be considered. Since the vaccine parameters (especially age-efficacy) were derived from the RCT, the authors should mention this difference and have a clear explanation as to why it could matter or not. If it is likely to matter (which I believe), then an analytical approach should be designed to take that aspect into consideration.

2. Modelling parameters for vaccine coverage were set to two levels: (1) current EPI levels for DPT3, and (2) 100% coverage. Informal evidence from the three pilot countries suggest that current uptake of RTS,S is much lower than for current EPI vaccines. There are a number of possible reasons for that. Without getting into a causal discussion, it seems that in addition to have a 100% coverage parameter it would be desirable to also have a scenario in which coverage is lower than the average EPI level for DPT3. 100% coverage is completely unrealistic, but that parameter value has the benefit of showing how good the vaccine could theoretically be. But to get a better sense of how valuable RTS,S would be if coverage was not as high as expected (which is now a very likely outcome of the current pilot implementation), modelling a lower uptake would be practically of great relevance.

3. Discussion. No comment is made on the fact that distributing the vaccine over a maximum number of countries according to a sub-national impact optimization process is actually going to be very challenging. It is unlikely that countries will agree to such processes very easily. So while it is very good to show how this process of allocating at sub-national level can optimize limited resources, a caveat on the feasibility of this approach should be more clearly introduced in the discussion. The authors mention other GAVI-supported vaccines that are distributed according to risk areas. Giving such examples and showing possible analogies with the malaria vaccine situation would be very helpful and a good way of discussing this.

Minor comments

References start with No 10, and lower number appear later. Presumably, this should be fixed?

-----------------------------------------------------------

Reviewer #2: See attachment

Michael Dewey

-----------------------------------------------------------

Reviewer #3: This paper addresses the important question of how to prioritise distribution of the RTS,S/AS01 malaria vaccine when there is limited supply. They use a well-established mathematical model to answer the question.

Specific comments:

1. Abstract: "we estimate 4.3 million malaria cases and 22,000 deaths in children U5 years could be averted per year at a dose constraint of 30 million. This decreases to 3.0 million cases / 86,000 deaths at a dose constraint of 20 million" Is this a mistake? Why does the number of deaths averted decrease with fewer vaccine doses?

2. Perhaps something went awry with the numbering of the references because the first one is number 10.

3. The authors consider two scenarios: "remain at 2016 intervention coverage, or achieve WHO Global Technical Strategy targets". Given the coronavirus pandemic, it seems very possible that coverage of malaria control interventions will decrease in the coming years. I wonder if the authors should consider a scenario where coverage of malaria control interventions decreases, leading to an increase in prevalence in 2-10 yearolds.

4. Methods paragraph 2: While I think it is reasonable to relegate the details of the mathematical model to the supplementary material, the authors should include the mathematical details of how vaccine efficacy is modelled in the main text.

5. The authors say "Efficacy was assumed to occur following the third dose". It is reasonable to assume that absolutely no protection is conferred by the first 2 doses?

6. Methods paragraph 6: I think "5-17-month-old children at 6, 7.5, 9 and 27 months of age" doesn't quite make sense. 27 months is not in the range of 5-17 months. What is the significance of 5-17-month here? Should it be 6-27 month old children?

8 Methods paragraph 8. I think the way countries or regions were chosen was quite simple. Could the authors try to explain it again, because I found the paragraph somewhat opaque. Using jargon such as "steepest-descent algorithm" does not, I think, aid clarity.

9 Results line 3: Should it be 157,000 rather than 157,00? If so, perhaps the authors could check the other numbers in the paragraph.

10 The number of 157,000 deaths averted (if that is correct) does not agree with the 27000 given in table 2. I think the numbers of deaths in the text correspond to the numbers of severe cases in the table.

11 Table 2: The description of the table does not say over what timescale the deaths/cases are averted. Does it assume 4 doses?

12 At the end of the first paragraph of the results, table s1 is referenced. I think the authors mean table s2.

13 After multiple readings I still do not understand figure 5. Could the author please clarify? I don't understand it enough even to suggest an improvement, but one thing that is not clear to me is what is the difference between A, B and C (and likewise between D, E and F).

14 Equation 21 in supplementary material. Is "max" in the wrong place?

-----------------------------------------------------------

Any attachments provided with reviews can be seen via the following link:

[LINK]

Attachments
Attachment
Submitted filename: hogan.pdf
Revision 2

Attachments
Attachment
Submitted filename: PMEDICINE-D-20-00728R1_reviewer_comments_responses.docx
Decision Letter - Thomas J McBride, Editor

Dear Dr. Hogan,

Thank you very much for re-submitting your manuscript "Prioritising RTS,S/AS01 malaria vaccine allocation to maximise public health impact: a modelling study" (PMEDICINE-D-20-00728R2) for review by PLOS Medicine.

I have discussed the paper with my colleagues and the academic editor and it was also seen again by two of the original reviewers. I am pleased to say that provided the remaining editorial and production issues are dealt with we are planning to accept the paper for publication in the journal.

The remaining issues that need to be addressed are listed at the end of this email. Any accompanying reviewer attachments can be seen via the link below. Please take these into account before resubmitting your manuscript:

[LINK]

Our publications team (plosmedicine@plos.org) will be in touch shortly about the production requirements for your paper, and the link and deadline for resubmission. DO NOT RESUBMIT BEFORE YOU'VE RECEIVED THE PRODUCTION REQUIREMENTS.

***Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.***

In revising the manuscript for further consideration here, please ensure you address the specific points made by each reviewer and the editors. In your rebuttal letter you should indicate your response to the reviewers' and editors' comments and the changes you have made in the manuscript. Please submit a clean version of the paper as the main article file. A version with changes marked must also be uploaded as a marked up manuscript file.

Please also check the guidelines for revised papers at http://journals.plos.org/plosmedicine/s/revising-your-manuscript for any that apply to your paper. If you haven't already, we ask that you provide a short, non-technical Author Summary of your research to make findings accessible to a wide audience that includes both scientists and non-scientists. The Author Summary should immediately follow the Abstract in your revised manuscript. This text is subject to editorial change and should be distinct from the scientific abstract.

We expect to receive your revised manuscript within 1 week. Please email us (plosmedicine@plos.org) if you have any questions or concerns.

We ask every co-author listed on the manuscript to fill in a contributing author statement. If any of the co-authors have not filled in the statement, we will remind them to do so when the paper is revised. If all statements are not completed in a timely fashion this could hold up the re-review process. Should there be a problem getting one of your co-authors to fill in a statement we will be in contact. YOU MUST NOT ADD OR REMOVE AUTHORS UNLESS YOU HAVE ALERTED THE EDITOR HANDLING THE MANUSCRIPT TO THE CHANGE AND THEY SPECIFICALLY HAVE AGREED TO IT.

Please ensure that the paper adheres to the PLOS Data Availability Policy (see http://journals.plos.org/plosmedicine/s/data-availability), which requires that all data underlying the study's findings be provided in a repository or as Supporting Information. For data residing with a third party, authors are required to provide instructions with contact information for obtaining the data. PLOS journals do not allow statements supported by "data not shown" or "unpublished results." For such statements, authors must provide supporting data or cite public sources that include it.

If you have any questions in the meantime, please contact me or the journal staff on plosmedicine@plos.org.

We look forward to receiving the revised manuscript by Aug 25 2020 11:59PM.

Sincerely,

Thomas McBride, PhD

Senior Editor

PLOS Medicine

plosmedicine.org

------------------------------------------------------------

AE comments:

The investigators used a previously developed individual-based mathematical model of P. falciparum malaria transmission, and a second model of RTS,S vaccine efficacy (White et al.), plus parameterization of the model also from White et al.

My understanding is that the new mathematical modelling work and related code is the ranking algorithm where a range of vaccine coverage scenarios are explored, the rationale being that supply of the vaccine will be limited initially before manufacturing is scaled up.

A major driver for the current pilot studies in 3 countries was to look at the feasibility of implementing a 4th booster dose outside of EPI schedules which is predicted to be challenging. The investigators show the added protective efficacy conferred by this extra dose may not lead to a substantial impact on clinical malaria, if uptake is not high. The importance of this finding is not really stressed in the abstract or discussion- a 3 dose regimen has huge operational and cost advantages so I think it could be highlighted more.

Limitations of the analysis are that assumptions are not informed by any new efficacy or coverage data from the ongoing pilot studies and there is no cost effectiveness analysis

Minor specific comments

1. The scenario where the WHO Global Technical Strategy targets are achieved references a modelling study by Griffin et al which considers SMC coverage but not IPTi, an intervention recommended by WHO which is also delivered with EPI (although uptake has been low to date). This could be mentioned as a limitation- although during the next 2 years of the COVID pandemic IPTi is unlikely to take off.

2. P11 in tracked changes version says: “The algorithm was applied as follows: the number of events (clinical cases or deaths) averted per vaccine dose.” Just checking it is per dose and not per course or per 3/4 initial doses since the model assumes no protection until 3 doses have been delivered.

3. P12 “We also compared scenarios where all four doses were scheduled”. What does scheduled mean here? Received? Or means demand and dose not necessarily administered?

4. Typo “Diphtheria”

Requests from the editors:

1- Please edit the Title to PLOS Medicine format: “Estimated impact of RTS,S/AS01 malaria vaccine allocation strategies in sub-Saharan Africa: a modelling study”

2- Please include the setting (in sub-Saharan Africa) in the early part of the Abstract Methods and Findings.

3- Abstract Methods and Findings, second sentence: “... in order to maximize events *averted*”?

4- Please include the 95% CrI ranges when quantifying outcomes in the Abstract.

5- You note that this vaccine has "moderate efficacy" (abstract), and is "efficacious in children" (author summary). In the introduction efficacy is quoted as 36.3%, which is pretty low (this is why the vaccine was not deployed 5 or more years ago). Please be more straightforward about the limited efficacy in the abstract/author summary, and perhaps mention the poorer efficacy in children (quoted as 24% in the methods section) in the Introduction.

6- Additionally, vaccine effectiveness in real life could be less, no? - this could be quoted as a limitation.

7- In the Abstract, you note "...sub-national prioritization (as currently planned)", could you describe the current prioritization plan for vaccine targeting in a bit more detail (the Introduction would be an appropriate place, and perhaps warranting an additional mention in the Discussion).

8- Please edit the Abstract Conclusions to limit the interpretation to the current study. “Our models estimate…” or “These results suggest…” could be helpful.

9- Perhaps you could comment somewhere (Introduction and/or Discussion) on any constraints on supplying and paying for RTS,S, given other vaccine programmes, existing and hoped-for.

10- The headings on Table 2 could be edited to make it clear the 95% CrI are in the parentheses but also relay tha numbers are X 1000. Similarly for the supplementary tables.

11- Could you include the credible intervals in the graphs in Fig 1 and 4?

12- In the first paragraph of the Discussion, please include a brief summary of what was done in this study before presenting your main findings.

13- For reference 4 and any other preprints referenced, please include “Preprint” and the date cited.

“Li X, Mukandavire C, Cucunubá ZM, Abbas K, Clapham HE, Jit M, et al. Estimating the health impact of vaccination against 10 pathogens in 98 low and middle income countries from 2000 to 2030. Preprint. medRxiv. 2019. doi:10.1101/19004358v1 [cited Year, Month, Day]”

If the paper has since been published, please update the citation and check that the reference is still accurate.

14- Country codes are crowded on S1-3 Figs, consider removing.

Comments from Reviewers:

Reviewer #1: I am satisfied with the changes made by the authors in this second version of their manuscript.

Reviewer #3: Thank you to the authors for addressing my comments.

Any attachments provided with reviews can be seen via the following link:

[LINK]

Revision 3
Decision Letter - Thomas J McBride, Editor

Dear Dr Hogan,

On behalf of my colleagues and the academic editor, Dr. Elizabeth A Ashley, I am delighted to inform you that your manuscript entitled "Estimated impact of RTS,S/AS01 malaria vaccine allocation strategies in sub-Saharan Africa: a modelling study" (PMEDICINE-D-20-00728R3) has been accepted for publication in PLOS Medicine.

PRODUCTION PROCESS

Before publication you will see the copyedited word document (in around 1-2 weeks from now) and a PDF galley proof shortly after that. The copyeditor will be in touch shortly before sending you the copyedited Word document. We will make some revisions at the copyediting stage to conform to our general style, and for clarification. When you receive this version you should check and revise it very carefully, including figures, tables, references, and supporting information, because corrections at the next stage (proofs) will be strictly limited to (1) errors in author names or affiliations, (2) errors of scientific fact that would cause misunderstandings to readers, and (3) printer's (introduced) errors.

If you are likely to be away when either this document or the proof is sent, please ensure we have contact information of a second person, as we will need you to respond quickly at each point.

PRESS

A selection of our articles each week are press released by the journal. You will be contacted nearer the time if we are press releasing your article in order to approve the content and check the contact information for journalists is correct. If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximize its impact.

PROFILE INFORMATION

Now that your manuscript has been accepted, please log into EM and update your profile. Go to https://www.editorialmanager.com/pmedicine, log in, and click on the "Update My Information" link at the top of the page. Please update your user information to ensure an efficient production and billing process.

Thank you again for submitting the manuscript to PLOS Medicine. We look forward to publishing it.

Best wishes,

Thomas McBride, PhD

Senior Editor

PLOS Medicine

plosmedicine.org

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .