Peer Review History

Original SubmissionApril 9, 2021
Decision Letter - James Mockridge, Editor

PONE-D-21-11618

A group resilience training program for people with multiple sclerosis: study protocol of a multi-centre cluster-randomized controlled trial (Multi-READY for MS)

PLOS ONE

Dear Dr. Giovannetti,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Dec 05 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

James Mockridge, PhD

Division Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

3. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match. 

When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

4. We note that you have stated that you will provide repository information for your data at acceptance. Should your manuscript be accepted for publication, we will hold it until you provide the relevant accession numbers or DOIs necessary to access your data. If you wish to make changes to your Data Availability statement, please describe these changes in your cover letter and we will update your Data Availability statement to reflect the information you provide.

5. Your ethics statement should only appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please delete it from any other section. 

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

 

Comments to the Author

1. Does the manuscript provide a valid rationale for the proposed study, with clearly identified and justified research questions?

The research question outlined is expected to address a valid academic problem or topic and contribute to the base of knowledge in the field.

Reviewer #1: Yes

Reviewer #2: Yes

********** 

2. Is the protocol technically sound and planned in a manner that will lead to a meaningful outcome and allow testing the stated hypotheses?

The manuscript should describe the methods in sufficient detail to prevent undisclosed flexibility in the experimental procedure or analysis pipeline, including sufficient outcome-neutral conditions (e.g. necessary controls, absence of floor or ceiling effects) to test the proposed hypotheses and a statistical power analysis where applicable. As there may be aspects of the methodology and analysis which can only be refined once the work is undertaken, authors should outline potential assumptions and explicitly describe what aspects of the proposed analyses, if any, are exploratory.

Reviewer #1: Yes

Reviewer #2: Yes

********** 

3. Is the methodology feasible and described in sufficient detail to allow the work to be replicable?

Descriptions of methods and materials in the protocol should be reported in sufficient detail for another researcher to reproduce all experiments and analyses. The protocol should describe the appropriate controls, sample size calculations, and replication needed to ensure that the data are robust and reproducible.

Reviewer #1: Yes

Reviewer #2: Yes

********** 

4. Have the authors described where all data underlying the findings will be made available when the study is complete?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception, at the time of publication. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

********** 

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

********** 

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above and, if applicable, provide comments about issues authors must address before this protocol can be accepted for publication. You may also include additional comments for the author, including concerns about research or publication ethics.

You may also provide optional suggestions and comments to authors that they might find helpful in planning their study.

(Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is an excellently designed protocol and the authors have done their due diligence planning for COVID-19 and how to minimize disruptions in their study. My only suggestion is that the authors consider adding a brief justification as to why a cut-off score of 83 was selected for the CD-RISC 25 in the inclusion/exclusion criteria (line 163).

Reviewer #2: I will focus on methods and reporting. This is a well-written and clear protocol. There are some technical issues I would like to highlight.

Major

1) It wasn't clear to me how the minimisation sampling would work. as far as I know it's either or, can't be both minimisation and randomisation, unless it's some sort of cluster randomisation with the clusters defined by the two variables of interest (centre and dichotomised CDRISK score). Anyway, some clarification is needed here. Also I'd advise you to ensure a process that allows for relatively even balance of cases and controls within each centre, otherwise analyses may become complicated. This may well be the case here, but it was not clear to me as explained.

Minor

1) Ensure analysts are blinded to which group is which (update: I see you have added that to the limitations section, move it to the analysis section or earlier, it is not a limitation)

2) When is it appropriate to use multiple imputation in this context?

3) Will the analyses be controlled for any covariates or is perfect balance across all relevant covariates expected?

4) Need to make it clearer in the outcomes section and the analysis section that the time point of interest is 3-months post-intervention. the immediate post-intervention will be useful in a multiple imputation approach, but would add very little in a complete case analysis.

PS: I reviewed for this funder this summer, but not this work. well done getting a protocol out already.

********** 

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 1

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

RESPONSE 1: We have checked the PLOS ONE's style requirements and modified the files accordingly.

2. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

RESPONSE 2: Thanks. We have reported the correct reference in the Reference section: “Qiu J, Shen B, Zhao M, Wang Z, Xie B, Xu Y. A nationwide survey of psychological distress among Chinese people in the COVID-19 epidemic: implications and policy recommendations. Gen Psychiatr. 2020;33(2): e100213.”

We have added the papers published that were previously indicated as “under review” in the reference section.

3. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match.

When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

RESPONSE 3: We checked and corrected the information provided in ‘Funding Information’ and ‘Financial Disclosure’ sections in order for them to match.

4. We note that you have stated that you will provide repository information for your data at acceptance. Should your manuscript be accepted for publication, we will hold it until you provide the relevant accession numbers or DOIs necessary to access your data. If you wish to make changes to your Data Availability statement, please describe these changes in your cover letter and we will update your Data Availability statement to reflect the information you provide.

RESPONSE 4: Dear editor, this is a protocol paper and no data have been generated yet. Data will be generated and stored during the RCT. The dataset generated and analysed during the current study will be available in the Zenodo repository.

5. Your ethics statement should only appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please delete it from any other section.

RESPONSE 5: as per your request we moved the information on the Ethical clearance to the Methods section, as reported below: “The protocol received ethical clearance from the ethics committee of the Fondazione IRCCS Istituto Neurologico Carlo Besta (15th April 2020, internal ref: 71; amendment approved 18th November 2020, internal ref: 78) and it has been evaluated by each participating centre’s ethics committee. After obtaining Ethics Committee approvals from all the participating centres, the study will be run at the MS/rehabilitation units of eight university hospitals, research hospitals, general hospitals or community health services across Italy.”

We also modified the abstract accordingly.

Review Comments to the Author

Reviewer #1: This is an excellently designed protocol and the authors have done their due diligence planning for COVID-19 and how to minimize disruptions in their study. My only suggestion is that the authors consider adding a brief justification as to why a cut-off score of 83 was selected for the CD-RISC 25 in the inclusion/exclusion criteria (line 163).

RESPONSE R1.1 = Thank you for the opportunity to clarify this aspect. We discussed the CD-RISC 25 cut off with Prof. Davidson (one of the questionnaire developer) during the design of the pilot study (Giovannetti, A. M., Quintas, R., Tramacere, I., Giordano, A., Confalonieri, P., Messmer Uccelli, M., Solari, A., & Pakenham, K. I. (2020). A resilience group training program for people with multiple sclerosis: Results of a pilot single-blind randomized controlled trial and nested qualitative study. PloS one, 15(4), e0231380). Despite no CD-RISC 25 formal cut-off has been published, he (based on his experience on the use of the scale) suggested us to set this cut-off in order to be sure to include people that had the potential to improve in resilience (avoiding ceiling effect).

To clarify this aspect the following statement was added in the text: “Participant inclusion criteria are: MS diagnosis [56]; age ≥18 years; written informed consent; CD-RISC 25 score < 83, which indicates that the person could still improve his/her level of resilience;”

Reviewer #2: I will focus on methods and reporting. This is a well-written and clear protocol. There are some technical issues I would like to highlight.

Major

1) It wasn't clear to me how the minimisation sampling would work. as far as I know it's either or, can't be both minimisation and randomisation, unless it's some sort of cluster randomisation with the clusters defined by the two variables of interest (centre and dichotomised CDRISK score). Anyway, some clarification is needed here. Also I'd advise you to ensure a process that allows for relatively even balance of cases and controls within each centre, otherwise analyses may become complicated. This may well be the case here, but it was not clear to me as explained.

RESPONSE R2.1= Thank you for the opportunity to clarify this important issue. Minimization will be used. We used also the term “randomization”, letting this Reviewer be a little bit confused, since, in general, this technique randomly assigns the first participants, then accounts for the covariates of participants previously enrolled and assigns each new participant to the group that provides better balance. Pure minimization is indeed completely deterministic, that is, we can predict which group the next subject will be enrolled in, provided the factor levels of the new subject are known. This may invalidate the principle of trial blindness and introduce some bias into the trial. To overcome this shortcoming some elements of randomness are incorporated into the minimization algorithm, to make the prediction unlikely. Following this Reviewer suggestion, we revised this section clarifying that patients will be assigned to the treatment arm using the method of minimization.

“Each centre will collect information on the number of people approached, screened, and eligible prior to random assignment, including reasons for non-enrolment. Participants will then be assigned to the READY or relaxation in a 1:1 ratio using the method of minimization (two factors: Centre and CDRISC score < 50 and ≥ 50) [57]. Treatment assignment will be provided by an independent randomization unit, using a computer-based algorithm [58].”

Minor

1) Ensure analysts are blinded to which group is which (update: I see you have added that to the limitations section, move it to the analysis section or earlier, it is not a limitation)

RESPONSE R2.2 = We added a statement in the analysis section: “Analyses will be carried out in accordance with the pre-specified statistical analysis plan and performed by study personnel blind to the participants’ assignment to the two intervention conditions and to those providing the interventions.”

2) When is it appropriate to use multiple imputation in this context?

RESPONSE R2.3= We modified the text as follows, in order to specify this aspect: “All group comparisons will be carried out according to the intention-to-treat principle. That is, participants will be analysed in the arm (READY or relaxation) to which they were assigned. We will use multiple imputations for missing data where appropriate (i.e. drop-out, missing item/questionnaire) [85]. In addition, we will carry out a per-protocol analysis and assess the sensitivity of the results to excluding patients who missed three or more READY sessions.”

3) Will the analyses be controlled for any covariates or is perfect balance across all relevant

RESPONSE R2.3= A detailed statistical analysis plan will be developed by the end of the clinical study and the Steering Committee will consider if include or not few covariates (e.g. disease severity-EDSS). Interestingly, the results of previous a study (Giovannetti et al. 2021) on the effectiveness of the READY program in a sample of PwMS showed that no demographic or illness variables predicted the improvements observed at post-intervention or 3-month follow-up, thus suggesting that these variables may play a trivial role in predicting the intervention effect.

Giovannetti, A. M., Solari, A., & Pakenham, K. I. (2021). Effectiveness of a group resilience intervention for people with multiple sclerosis delivered via frontline services. Disability and rehabilitation, 1–11. Advance online publication. https://doi.org/10.1080/09638288.2021.1960441).

We revised the Statistics Section to provide more information about this issue: “Analyses will be carried out in accordance with the pre-specified statistical analysis plan and performed by study personnel blind to the participants’ assignment and to those providing the interventions.

Baseline variables’ standardized mean differences (for clustered data) between arms will be computed to measure potential unbalance.

Longitudinal changes will be analyzed using repeated measures hierarchical (patients nested in clusters) generalized linear mixed models, accounting for the cluster effect (using random intercepts for clusters) and adjusted for those baseline covariates resulting unbalanced between arms. As reported above, the between-arm difference from baseline (T0) to three-month follow-up (T2) changes in resilience scores is the primary endpoint. To mitigate the risk of inflating Type I error given the small number of clusters, we will use the Kenward-Roger degrees of freedom correction, which does not rely on the assumption of fixed cluster sizes [81].”

4) Need to make it clearer in the outcomes section and the analysis section that the time point of interest is 3-months post-intervention. the immediate post-intervention will be useful in a multiple imputation approach, but would add very little in a complete case analysis.

RESPONSE R2.5= In the Methods section you can find the following statement: “The primary end-point is the between-arm difference from baseline (T0) to three-month follow-up (T2) changes in resilience scores.”

We clarified that the 3-month follow up is our primary endpoint by specifying that even in the following section of the manuscript:

- The Box 1. Panel recommendations: “A six-month post-intervention follow-up should be scheduled in addition to the 3-month follow-up (primary endpoint).

- The Analysis section: “Longitudinal changes will be analyzed using repeated measures hierarchical (patients nested in clusters) generalized linear mixed models, accounting for the cluster effect (using random intercepts for clusters). As reported above, the between-arm difference from baseline (T0) to three-month follow-up (T2) changes in resilience scores is the primary endpoint. To mitigate the risk of inflating Type I error given the small number of clusters, we will use the Kenward-Roger degrees of freedom correction, which does not rely on the assumption of fixed cluster sizes [84].”

Attachments
Attachment
Submitted filename: Response to Reviewers.docx
Decision Letter - Carla Pegoraro, Editor

A group resilience training program for people with multiple sclerosis: study protocol of a multi-centre cluster-randomized controlled trial (Multi-READY for MS)

PONE-D-21-11618R1

Dear Dr. Giovannetti,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Carla Pegoraro

Division Editor

PLOS ONE

Additional Editor Comments (optional):

Please note that Reviewer 1 has observed a minor typo. Please amend this during production of your paper.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Does the manuscript provide a valid rationale for the proposed study, with clearly identified and justified research questions?

The research question outlined is expected to address a valid academic problem or topic and contribute to the base of knowledge in the field.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Is the protocol technically sound and planned in a manner that will lead to a meaningful outcome and allow testing the stated hypotheses?

The manuscript should describe the methods in sufficient detail to prevent undisclosed flexibility in the experimental procedure or analysis pipeline, including sufficient outcome-neutral conditions (e.g. necessary controls, absence of floor or ceiling effects) to test the proposed hypotheses and a statistical power analysis where applicable. As there may be aspects of the methodology and analysis which can only be refined once the work is undertaken, authors should outline potential assumptions and explicitly describe what aspects of the proposed analyses, if any, are exploratory.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Is the methodology feasible and described in sufficient detail to allow the work to be replicable?

Descriptions of methods and materials in the protocol should be reported in sufficient detail for another researcher to reproduce all experiments and analyses. The protocol should describe the appropriate controls, sample size calculations, and replication needed to ensure that the data are robust and reproducible.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors described where all data underlying the findings will be made available when the study is complete?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception, at the time of publication. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above and, if applicable, provide comments about issues authors must address before this protocol can be accepted for publication. You may also include additional comments for the author, including concerns about research or publication ethics.

You may also provide optional suggestions and comments to authors that they might find helpful in planning their study.

(Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors have adequately addressed my previous concern. One small note: on page 3, line 54 of the manuscript, it should read "this study" instead of "his study"

Reviewer #2: I am happy with the authors' responses. The paper was reading very well to begin with and only a few clarifications were needed.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Formally Accepted
Acceptance Letter - Carla Pegoraro, Editor

PONE-D-21-11618R1

A group resilience training program for people with multiple sclerosis: study protocol of a multi-centre cluster-randomized controlled trial (Multi-READY for MS)

Dear Dr. Giovannetti:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr Carla Pegoraro

Staff Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .