Peer Review History

Original SubmissionSeptember 17, 2021
Decision Letter - Salvatore De Rosa, Editor

PONE-D-21-22546

Cilostazol Effectiveness in Reducing Drug-Coated Stent Restenosis in the Superficial Femoral Artery: The ZERO Study

PLOS ONE

Dear Dr. Miura,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Apr 17 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Salvatore De Rosa

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf.

2. Please report the date(s) in which you received ethics approval for your study.

3. We note that your clinical trial registration does not include sufficient information. Please update your record to include all relevant sections, such as study design and intervention.

4. Thank you for stating the following financial disclosure:

“NO”

At this time, please address the following queries:

a) Please clarify the sources of funding (financial or material support) for your study. List the grants or organizations that supported your study, including funding received from your institution.

b) State what role the funders took in the study. If the funders had no role in your study, please state: “The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.”

c) If any authors received a salary from any of your funders, please state which authors and which funders.

d) If you did not receive any funding for this study, please state: “The authors received no specific funding for this work.”

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

5. Thank you for stating the following in your Competing Interests section: 

“NO authors have competing interests”

Please complete your Competing Interests on the online submission form to state any Competing Interests. If you have no competing interests, please state ""The authors have declared that no competing interests exist."", as detailed online in our guide for authors at http://journals.plos.org/plosone/s/submit-now

 This information should be included in your cover letter; we will change the online submission form on your behalf.

6. Please upload a copy of Figures 4 and 5, to which you refer in manuscript. If the figure is no longer to be included as part of the submission please remove all reference to it within the text.

7. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

8. We noticed you have some minor occurrence of overlapping text with the following previous publication, which needs to be addressed:

- https://www.ahajournals.org/doi/10.1161/CIRCINTERVENTIONS.118.006564

In your revision ensure you cite all your sources (including your own works), and quote or rephrase any duplicated text outside the methods section. Further consideration is dependent on these concerns being addressed.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

Reviewer #2: I Don't Know

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: General comments:

The authors present analyses where data from an open-label study were pooled with data from a historical randomized trial.

Overall, I think these analyses have merit, though more information is needed to understand why pooling these two trials is reasonable. I believe more needs to be done with the analytic methods as well. Pooling of studies can create bias since data were collected at different times and, potentially, different places. These biases need to be addressed, or at least fully discussed to inform readers, and for me that has not been done here.

Specific comments:

1. (p.4) I believe that you mean that the data…*will be* made available.

2. (p.5) A really key part of these analyses is how comparable the DES+cilostazol patients are to the DEBATE SFA study participants. One part that it completely glossed over are the locations that people are coming from. Were the eight centers from DES+cilostazol ones that were included in DEBATE SFA? If not, are they from similar geographic areas? These sorts of questions should be answered somewhere in the manuscript.

3. (p.7) Please include further information on the sample size. For instance, how was this powered, i.e., using a particular test? What values were assumed, e.g., what effect size?

4. (p.7; Table 3) I think these analyses should be run with proportional hazards regression models (aka Cox models). There is a categorical exposure here so, best that I understand, you are running a bunch of pairwise log-rank tests. That is probably resulting in a higher type I error rate than expected.

5. In addition, the Cox model will allow you to control for other potential confounders which I think needs to be done here. Some of the baseline characteristics in table 1 suggest that including them in a model might have some impact. I am not sure whether any covariates should go into a final model, but this should at least be tried, especially given that these are pooled data.

6. Finally, in the Cox model, I think clustering by center should be accounted for in the model, probably with some sort of marginal model, e.g., via the sandwich estimator. This could also be done with a frailty.

7. You might also consider performing some sensitivity analyses in regards to the pooling, especially in terms of the centers. It's hard for me to know what to recommend here information is lacking. Maybe you could limit the data from DEBATE SFA to those that were in DES+cilostazol. Or maybe some sort of intelligent matching of centers or participants.

8. (Table 1) Significance testing for baseline imbalance in randomized trials been has regarded as unnecessary and potentially misleading (see Altman DG. Comparability of randomised groups. The Statistician 1985; 125-136; Senn, S. Testing for baseline balance in clinical trials. Statistics in Medicine 1994; 1715-1726). I recommend removing the significance testing entirely from table 1.

9. There's no page 15 and then numbering starts on page 16. (It would be nice to have the line numbers throughout the document in future submissions.)

10. (Table 3) I think this table would be easier if the arm names could be used instead of "Group 1" etc.

11. (Figure 2) These survival curves should have confidence bands on them to depict the variability in these estimates. Though, four curves with bands will make this pretty busy. You may need to break these out into panels.

12. (Figure 3) Same comment as figure 2, though with just two curves, panels shouldn't be needed.

Reviewer #2: I read with interest the manuscript #PONE-D-21-22546 by Dr Miura and colleagues entitled “Cilostazol Effectiveness in Reducing Drug-Coated Stent Restenosis in the Superficial Femoral Artery: The ZERO Study”.

This is a prospective, open-label, multicenter study evaluating the efficacy of cilostazol in improving the patency of DESs and determine whether BNS or DESs with or without cilostazol are more effective in improving the 12-month patency after EVT for FP lesions.

The manuscript is well written and the topic is of interest.

However, the manuscript presents several issues:

- In the “outcome assessments” sub-section, concerning the peak systolic velocity (PSV) ratio cut-off used for ISR determination, authors state “we changed definition of PSV from >2.0 to > 2.5 because that of almost all trial was > 2.5”. First, authors should at least cite the studies they are referring to. Second and most important, in the DEBATE in SFA trial, it seems that the primary end point was evaluated using a peak systolic velocity ratio <2.0, as stated in the “Outcomes Assessment” section of that study1. Since the PSV was used to determine restenosis, the primary outcome of this study, this represents a major issue of the manuscript. Please Clarify.

- When comparing cohorts with historical control data, statistical methods including a propensity score matching would improve the quality of the analysis.

- In the “Results” section, authors state that “no significant differences were found in the 12-month patency rate among the DES with cilostazol, DES, BNS with cilostazol, and BNS groups (94.2% vs. 82.8% vs. 93.1% vs. 77.6%, respectively, p = 0.007) (Figure 2)”; however, in the Figure 2 description is reported that “the 12-month patency rate differed significantly among the four groups (DES with cilostazol: 94.2% vs. BNS with cilostazol 93.1% vs. DES without cilostazol 82.8%, BNS without cilostazol 77.6%, p = 0.0007) with different p value. Please clarify.

References:

1. Miura T, Miyashita Y, Soga Y, Hozawa K, Doijiri T, Ikeda U, et al. Drug-eluting versus bare-metal stent implantation with or without cilostazol in the treatment of the superficial femoral artery. Circ Cardiovasc Interv. 2018;11(8): e006564. doi: 10.1161/CIRCINTERVENTIONS.118.006564.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 1

We wish to express our appreciation to the Reviewer for their comments, which have helped us significantly improve the paper.

Reviewer #1: General comments:

The authors present analyses where data from an open-label study were pooled with data from a historical randomized trial.

Overall, I think these analyses have merit, though more information is needed to understand why pooling these two trials is reasonable. I believe more needs to be done with the analytic methods as well. Pooling of studies can create bias since data were collected at different times and, potentially, different places. These biases need to be addressed, or at least fully discussed to inform readers, and for me that has not been done here.

Specific comments:

1. (p.4) I believe that you mean that the data…*will be* made available.

Response: We appreciate the Reviewer`s comment on this point. We deleted the sentence.

2. (p.5) A really key part of these analyses is how comparable the DES+cilostazol patients are to the DEBATE SFA study participants. One part that it completely glossed over are the locations that people are coming from. Were the eight centers from DES+cilostazol ones that were included in DEBATE SFA? If not, are they from similar geographic areas? These sorts of questions should be answered somewhere in the manuscript.

Response: We thank the Reviewer`s comment on this point. The eight centers participated DEBATE in SFA study As Reviewer's comment, we described that in Materials and Methods on P 5.

3. (p.7) Please include further information on the sample size. For instance, how was this powered, i.e., using a particular test? What values were assumed, e.g., what effect size?

Response: We appreciate the Reviewer`s comment on this point. As Reviewer's comment, we described further information on the sample size in Statistical analysis on P 7.

4. (p.7; Table 3) I think these analyses should be run with proportional hazards regression models (aka Cox models). There is a categorical exposure here so, best that I understand, you are running a bunch of pairwise log-rank tests. That is probably resulting in a higher type I error rate than expected.

Response: We appreciate the Reviewer`s comment on this point. As Reviewer's comment, we reanalysed secondary endpoints by Cox proportional hazards regression models.

5. In addition, the Cox model will allow you to control for other potential confounders which I think needs to be done here. Some of the baseline characteristics in table 1 suggest that including them in a model might have some impact. I am not sure whether any covariates should go into a final model, but this should at least be tried, especially given that these are pooled data.

6. Finally, in the Cox model, I think clustering by center should be accounted for in the model, probably with some sort of marginal model, e.g., via the sandwich estimator. This could also be done with a frailty.

Response: We appreciate the Reviewer`s comment on this point. As Reviewer's comment, we used Cox model to adjust other factors, especially which factors have significant difference between groups. However, because number of endpoints are not so much, we could adjust only a few predictors. We described them in Limitation on P23. Unfortunately we didn`t have the data of frailty.

7. You might also consider performing some sensitivity analyses in regards to the pooling, especially in terms of the centers. It's hard for me to know what to recommend here information is lacking. Maybe you could limit the data from DEBATE SFA to those that were in DES+cilostazol. Or maybe some sort of intelligent matching of centers or participants.

Response: We thank the Reviewer`s comment on this point. All participating centers of current study participated DEBATE in SFA study As Reviewer's comment, we described that in Materials and Methods on P 5.

8. (Table 1) Significance testing for baseline imbalance in randomized trials been has regarded as unnecessary and potentially misleading (see Altman DG. Comparability of randomised groups. The Statistician 1985; 125-136; Senn, S. Testing for baseline balance in clinical trials. Statistics in Medicine 1994; 1715-1726). I recommend removing the significance testing entirely from table 1.

Response: We appreciate the Reviewer`s comment on this point. As Reviewer's comment, we removed significance testing.

9. There's no page 15 and then numbering starts on page 16. (It would be nice to have the line numbers throughout the document in future submissions.)

Response: We appreciate the Reviewer`s comment on this point. As Reviewer's comment, we removed that page.

10. (Table 3) I think this table would be easier if the arm names could be used instead of "Group 1" etc.

Response: We appreciate the Reviewer`s comment on this point. As Reviewer's comment, we changed the arm names form <Group1,,,> to <DES+C,,,>.

11. (Figure 2) These survival curves should have confidence bands on them to depict the variability in these estimates. Though, four curves with bands will make this pretty busy. You may need to break these out into panels.

Response: We really appreciate the Reviewer`s comment on this point. As Reviewer's comment, four curves with bands will make busy, and still busy to describe 95%CI outside of graph. Thus, we added standard error outside of survival curves.

12. (Figure 3) Same comment as figure 2, though with just two curves, panels shouldn't be needed.

Response: We really appreciate the Reviewer`s comment on this point. As Reviewer's comment, Figure 3 was just two curves. But they were close each other. Thus, we added standard error outside of survival curves.

Reviewer #2: I read with interest the manuscript #PONE-D-21-22546 by Dr Miura and colleagues entitled “Cilostazol Effectiveness in Reducing Drug-Coated Stent Restenosis in the Superficial Femoral Artery: The ZERO Study”.

This is a prospective, open-label, multicenter study evaluating the efficacy of cilostazol in improving the patency of DESs and determine whether BNS or DESs with or without cilostazol are more effective in improving the 12-month patency after EVT for FP lesions.

The manuscript is well written and the topic is of interest.

However, the manuscript presents several issues:

- In the “outcome assessments” sub-section, concerning the peak systolic velocity (PSV) ratio cut-off used for ISR determination, authors state “we changed definition of PSV from >2.0 to > 2.5 because that of almost all trial was > 2.5”. First, authors should at least cite the studies they are referring to.

Response: We thank the Reviewer`s comment on this point. As Reviewer's comment, we added the paper in which there were definition of PSV ≥ 2.5 into reference (we noticed our mistake and corrected from > to ≥ ).

Second and most important, in the DEBATE in SFA trial, it seems that the primary end point was evaluated using a peak systolic velocity ratio <2.0, as stated in the “Outcomes Assessment” section of that study1. Since the PSV was used to determine restenosis, the primary outcome of this study, this represents a major issue of the manuscript. Please Clarify.

Response: We appreciate the Reviewer`s comment on this point. As Reviewer's comment, definition of ISR in the DEBATE in SFA was PSV > 2.0. Thus, in this study, we re-analysed ISR rate with PSV ≥2.5 in DEBATE in SFA data with this study`s data.

- When comparing cohorts with historical control data, statistical methods including a propensity score matching would improve the quality of the analysis.

Response: We appreciate the Reviewer`s comment on this point. We completely agree with Reviewer's comment. Actually, we tried to analyse propensity score matching, but we coludn`t, because number of original enroll patients were small. We described in Limitation on P 23.

- In the “Results” section, authors state that “no significant differences were found in the 12-month patency rate among the DES with cilostazol, DES, BNS with cilostazol, and BNS groups (94.2% vs. 82.8% vs. 93.1% vs. 77.6%, respectively, p = 0.007) (Figure 2)”; however, in the Figure 2 description is reported that “the 12-month patency rate differed significantly among the four groups (DES with cilostazol: 94.2% vs. BNS with cilostazol 93.1% vs. DES without cilostazol 82.8%, BNS without cilostazol 77.6%, p = 0.0007) with different p value. Please clarify.

Response: We really appreciate the Reviewer`s comment on this point. As Reviewer's comment, we corrected from No significant… to Significant…. in Results on P 8.

Attachments
Attachment
Submitted filename: response to reviewer.docx
Decision Letter - Salvatore De Rosa, Editor

Cilostazol Effectiveness in Reducing Drug-Coated Stent Restenosis in the Superficial Femoral Artery: The ZERO Study

PONE-D-21-22546R1

Dear Dr. Miura,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Salvatore De Rosa

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: (No Response)

Reviewer #2: Partly

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #2: The authors edited their manuscript addressing the majority of the reviwers' comments, improving the overall quality.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

Formally Accepted
Acceptance Letter - Salvatore De Rosa, Editor

PONE-D-21-22546R1

Cilostazol Effectiveness in Reducing Drug-Coated Stent Restenosis in the Superficial Femoral Artery: The ZERO Study

Dear Dr. Miura:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Salvatore De Rosa

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .