Peer Review History

Original SubmissionMay 28, 2021
Decision Letter - Carmine Pizzi, Editor

PONE-D-21-15771

Propensity score methods for comparative-effectiveness analysis: a case study of direct oral anticoagulants in the atrial fibrillation population

PLOS ONE

Dear Dr. Ciminata,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Oct 03 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Carmine Pizzi

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf.

2. Thank you for stating the following in the Competing Interests section:

“GC and CG have received research grants from Bristol-Myers Squibb UK and Pfizer UK outside the submitted work. OW has received consulting fee from Bayer UK outside the submitted work. MD, NK and PL declare no conflict of interest.”

Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests).  If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf.

3. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

4. Please note that in order to use the direct billing option the corresponding author must be affiliated with the chosen institute. Please either amend your manuscript to change the affiliation or corresponding author, or email us at plosone@plos.org with a request to remove this option.

Comments to the Author

Reviewer #1: The present paper is brilliant and of high qualitative level

Some issues.

In the abstract it should be added how the models performed best, that is which outcomes were evaluated to assess performance of the model.

Methods: why patients in "dabigatran only" were assessed? and not rivaroxaban etc?

Methods: I woudl remore propensity score to mimic rct, which is correct but not formally true

methods dealing with missing value shoud be added

Reviewer #2: The paper is well written and deals with the use of the best methodological approach to estimate the effectiveness of anticoagulation treatment by using a dataset extracted from the Scottish Morbidity Records (SMR). The aim of the authors was to explore the use of Propensity Score (PS) mathcing, Inverse Probability Weighting (IPW) and covariate adjustment with PS. As a clinician, I have appreciated the efforts of the authors to give a clear view on the best statistical analysis to an important topic with crucial influence on Health Technology Assessment (HTA). The Authors have clarified the main differences among the statistical approaches, for example indicating the IPW the best performing method to assess covariate balance when applied to subjects of relatively large sample-size (such as combined DOACs versus warfarin). Instead, covariate adjustment with PS appears to the most appropriate method when applied to subjects of relatively small sample-size (such as dabigatran versus warfarin).

Just one comment on the concept of the introduction of dabigatran in clinical practice. The use of dabigatran as opposed to warfarin is more linked to the more convenient management of the drug than to other reasons. This is what has happened in the recents years in the clinical practice, but the same also is seen for apixaban and rivaroxaban.

Revision 1

We would like to thank both reviewers for their time and valuable comments. We have addressed these as follows.

Reviewer#1: In the abstract it should be added how the models performed best, that is which outcomes were evaluated to assess performance of the model.

Response: In the Abstract the following is already stated: “Model performance was assessed by standardised difference. Clinical outcomes and mortality were compared for all DOACs (including apixaban, dabigatran and rivaroxaban) versus warfarin”. The outcomes used in our model are now specified in the methods section of the abstract (line 41). However, the clinical outcomes where not used to assess model performance, but for indicating how the size of the treatment effect (reported in the form of Hazard Ratios) may change according to the PS method employed. For instance, with the IPTW-IPCW approach, the treatment effect tends to be larger, but still in line, compared to the treatment effect estimated with other PS methods. This is now stated in the results section of the Abstract (line 48 and 49).

Reviewer#1: why patients in "dabigatran only" were assessed? and not rivaroxaban etc?

Response: An explanation on why patients on “dabigatran only” were assessed is already provided in the manuscript; that is the smallest subgroup of DOACs users in Scotland compared to apixaban and rivaroxaban. However, this has now been made clearer (line 169).

Reviewer#1: Methods: I would remove propensity score to mimic RCT, which is correct but not formally true.

Response: The sentence referring to propensity score mimicking RCT has now been deleted (line 174).

Reviewer#1: methods dealing with missing value should be added.

Response: No methods for dealing with missing value were used. Given that missing data was <5%, no imputation method was used, a complete available case analysis was provided instead. This is now stated in the manuscript (line 194-196).

Reviewer #2: Just one comment on the concept of the introduction of dabigatran in clinical practice. The use of dabigatran as opposed to warfarin is more linked to the more convenient management of the drug than to other reasons. This is what has happened in the recent years in the clinical practice, but the same also is seen for apixaban and rivaroxaban.

Response: More on the “more convenient management” of DOACs versus warfarin has now been added to the methods section (line 110-13). That is, rapid onset of action, and the possibility of using fixed doses without requirement for routine anticoagulant monitoring.

Kind Regards,

Dr Giorgio Ciminata

Attachments
Attachment
Submitted filename: Response_to_Reviewers.docx
Decision Letter - Carmine Pizzi, Editor

Propensity score methods for comparative-effectiveness analysis: a case study of direct oral anticoagulants in the atrial fibrillation population

PONE-D-21-15771R1

Dear Dr. Ciminata,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Carmine Pizzi

Academic Editor

PLOS ONE

Formally Accepted
Acceptance Letter - Carmine Pizzi, Editor

PONE-D-21-15771R1

Propensity score methods for comparative-effectiveness analysis: a case study of direct oral anticoagulants in the atrial fibrillation population

Dear Dr. Ciminata:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Prof Carmine Pizzi

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .