Peer Review History

Original SubmissionAugust 13, 2024
Decision Letter - Edward Adekola Oladele, Editor

PONE-D-24-32009A Prospective Model of the Potential Clinical and Economic Impact of

Cervical Cancer Screening Supported by a Mobile Phone AppPLOS ONE

Dear Dr. Garrison,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Nov 15 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org . When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols . Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols .

We look forward to receiving your revised manuscript.

Kind regards,

Edward Adekola Oladele, MD, MPH, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please include a complete copy of PLOS’ questionnaire on inclusivity in global research in your revised manuscript. Our policy for research in this area aims to improve transparency in the reporting of research performed outside of researchers’ own country or community. The policy applies to researchers who have travelled to a different country to conduct research, research with Indigenous populations or their lands, and research on cultural artefacts. The questionnaire can also be requested at the journal’s discretion for any other submissions, even if these conditions are not met.  Please find more information on the policy and a link to download a blank copy of the questionnaire here: https://journals.plos.org/plosone/s/best-practices-in-research-reporting . Please upload a completed version of your questionnaire as Supporting Information when you resubmit your manuscript.

3. In the ethics statement in the Methods, you have specified that verbal consent was obtained. Please provide additional details regarding how this consent was documented and witnessed, and state whether this was approved by the IRB

4. Please note that PLOS ONE has specific guidelines on code sharing for submissions in which author-generated code underpins the findings in the manuscript. In these cases, we expect all author-generated code to be made available without restrictions upon publication of the work. Please review our guidelines at https://journals.plos.org/plosone/s/materials-and-software-sharing#loc-sharing-code and ensure that your code is shared in a way that follows best practice and facilitates reproducibility and reuse.

5. Thank you for stating the following financial disclosure: Roche Diagnostics funded the economic analysis through a contract with Veritech Corporation, providing support for LPG, BWB, and FY.   

Please state what role the funders took in the study.  If the funders had no role, please state: ""The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript."" 

If this statement is not correct you must amend it as needed. 

Please include this amended Role of Funder statement in your cover letter; we will change the online submission form on your behalf.

5. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The paper does a good job explaining the limitations of this type of modeling tool while also highlighting the important role played by preliminary models like this one. You also highlighted some additional data that would be useful for future studies.

Reviewer #2: The authors have picked an interesting topic - the use of mobile technology in the followup of women being screened for Cervical Cancer, an important health problem. The study has been generally well conducted but I would like to address the following.

1. A clear definition of the time horizon over which costs and consequences were accrued is lacking, which is different from the study period.

2. A clear definition of the consequences being considered is not outlined. It is summarized as clinical, workflow and guideline pathways which is inadequate.

3. Also the phrase " standardized to 2022 cost" is not appropriate. This is because are cost are adjusted to a particular year to account for inflation and there are different approaches which can be used and the choice of approach should be specified.

4. Discounting is not mentioned and the rationale for not doing so should be provided.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean? ). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy .

Reviewer #1: Yes:  Meghan Steel

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/ . PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org . Please note that Supporting Information files do not need this step.

Revision 1

Response to Reviewers

Reviewer's Responses to Questions and Our Responses to Reviewers.

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

Authors' response:

Thanks! We address the four specific questions raised by Reviewer #2 below.

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: Yes

Authors' response:

Thanks!

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Authors' response:

Thanks! The data are provided in the manuscript.

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Authors' response:

Thanks! We appreciate this. We have corrected some minor errors that are visible in the marked-up version.

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The paper does a good job explaining the limitations of this type of modeling tool while also highlighting the important role played by preliminary models like this one. You also highlighted some additional data that would be useful for future studies.

Authors' response:

Thanks! We appreciate your understanding that this is a prospective clinico-economic evaluation using modeling.

Reviewer #2: The authors have picked an interesting topic - the use of mobile technology in the follow up of women being screened for Cervical Cancer, an important health problem.

The study has been generally well conducted but I would like to address the following.

Authors' response:

Thanks! We appreciate these questions:

1. A clear definition of the time horizon over which costs and consequences were accrued is lacking, which is different from the study period.

Authors' response:

Thanks! The analytic time horizon is the period (less than one year) for a typical patient to complete the three visits. It is shorter than the study period. From a practical perspective, our modeling approach assessed “events” occurring or not occurring (such as follow-up visits), rather than specific number of days or weeks/months. Timing of second or third visits, for example, varied. This is a realistic scenario, particularly in a low-to-middle-income country setting. We have added this language on page 5, line 98 to make it clear: "(usually completed in less that 6 months)"

2. A clear definition of the consequences being considered is not outlined. It is summarized as clinical, workflow and guideline pathways which is inadequate.

Authors' response:

Thanks for this comment. We have revised the text on page 6 line 104-5 to address this, adding: " "Key consequences include intermediate endpoints (such as test results) and final endpoints (viz., pre-cancerous and cancer cases detected and treated)." And on page 7, line 128-9, adding: " such as cost-per-case detected and cost-per-cancer-case avoided)'.

3. Also the phrase " standardized to 2022 cost" is not appropriate. This is because are cost are adjusted to a particular year to account for inflation and there are different approaches which can be used and the choice of approach should be specified.

Authors' response:

Thanks for this comment. We agree that the word "standardized' is unclear. We have changed it to "estimated costs in 2022," which more accurately reflects our approach.

Medical cost finding for economic evaluation from a (limited) societal perspective is difficult in both developed and developing counties if the aim is to use opportunity costs for clinical and economic policy making. Prices in medical "markets" are affected by government price setting and insurance--both public or private.

For this prospective modelling exercise, we needed to have plausible estimates or assumptions for the model parameters. By necessity, we used cost information from multiple sources to generate plausible base-case assumptions and ranges. Thus, our cost estimates were "triangulated" from multiple input sources, including: prospective data collection at sites, literature-based estimates, and expert opinion at the primary clinical site of the principal investigator in Kenya.

The prospective cost-related data was collected in 2022 in multiple Kenyan sites, including with hospital and clinic administrators (as IRB approved). Thus, we report our costs as 2022 U.S. dollars, converted from Kenyan shillings. We also used a time-and-motion estimation approach in 2022 to collect supporting data related to resources used during visits, time, and costs.

We did not apply a specific formulaic inflation adjustment to the literature-based costs estimates for visits, tests, or therapies, which were published in various years. We applied "face-validity testing" with experts (clinical and economic) to our 2022 base-case cost estimates and to our ranges of costs. We assessed how our estimates compared with recent published ranges for variables similar to our model inputs for amounts and ranges of cost.

A challenge is that literature-based costs varied in the inputs included in various studies, depending on the research question being asked and addressed, and other regional or national differences. Also, unlike the availability in the United States for having annual medical care price change percentages, there is not a similar precise "medical care inflation-adjustor." In Kenya, general inflation data is available through the Kenya National Bureau of Statistics (KNBS), and healthcare-related components might be included in the broader Consumer Price Index (CPI). However, these components typically lack the granularity or specificity of a dedicated "medical care inflation" index, making it more challenging to precisely adjust healthcare costs annually.

4. Discounting is not mentioned and the rationale for not doing so should be provided.

Authors' response:

Thanks for spotting this omission. We have added this sentence on page 9, lines 180-1, to make address this: "Since the time horizon for the primary analysis is short-term (i.e., less than one year to complete the 3 visits), there is no strong need to perform discounting of costs or outcomes."

Inquiry under Journal Requirements

3. In the ethics statement in the Methods, you have specified that verbal consent was obtained. Please provide additional details regarding how this consent was documented and witnessed, and state whether this was approved by the IRB.

Authors' Response:

We have added on page 9, lines 174-7: "For the verbal consent process, the study was explained to the participants who were selected based on their expertise in the study topic, and once they agreed to participate, the consent was documented and the interview conducted. All informed consenting processes were approved by the IRB."

Attachments
Attachment
Submitted filename: Response to Reviewers.docx
Decision Letter - Edward Adekola Oladele, Editor

A Prospective Model of the Potential Clinical and Economic Impact of

Cervical Cancer Screening Supported by a Mobile Phone App

PONE-D-24-32009R1

Dear Dr. Garrison,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager®  and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Edward Adekola Oladele, MD, MPH, PhD

Academic Editor

PLOS ONE

Formally Accepted
Acceptance Letter - Edward Adekola Oladele, Editor

PONE-D-24-32009R1

PLOS ONE

Dear Dr. Garrison Jr.,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Edward Adekola Oladele

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .