Peer Review History

Original SubmissionSeptember 7, 2022
Decision Letter - Stephan Doering, Editor

PONE-D-22-24983Psychological interventions for generalized anxiety disorder: Effects and predictors in a naturalistic outpatient settingPLOS ONE

Dear Dr. Buhlmann,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Mar 11 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Stephan Doering, M.D.

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. 

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

3. We note that you have stated that you will provide repository information for your data at acceptance. Should your manuscript be accepted for publication, we will hold it until you provide the relevant accession numbers or DOIs necessary to access your data. If you wish to make changes to your Data Availability statement, please describe these changes in your cover letter and we will update your Data Availability statement to reflect the information you provide.

4. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information. 

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is a well-written paper that could surely contribute to the existing literature, however I have some suggestions to be addressed. First, some comment on the authors' methods is necessary as to why they chose to evaluate participants using the DSM IV as opposed to the DSM V (timeline etc.). Second, some self-report measures were employed in this study and other research shows us that these can sometimes be unreliable for various reasons. Should this be noted as a partial limitation of the study? Overall, this is a high quality manuscript fit for publication if these concerns are adequately addressed.

Reviewer #2: Abstract

- The authors may consider rewording “significant changes” and instead provide detail about the direction i.e., decreased.

- Could the authors please provide a brief explanation of how reliable change and recovery were calculated? Was this the RCI or a percentage change?

Introduction

- The introduction may benefit from combining the first two paragraphs together. Furthermore, could the authors please explain how recovery was conceptualized by the studies mentioned?

- The authors argue that previous studies of psychotherapy for GAD in routine care are limited by their strict treatment protocols. Did the current study have unstandardized treatment protocols? One could argue that psychology training clinics have rather strict protocols as the trainee psychologists are under close supervision and are often following treatment manuals.

- One strength of this paper is their investigation of IU and metacognitions as predictors of change in a naturalistic setting. However, the authors do note that previous studies have already examined predictors of change in GAD in naturalistic settings. The introduction could benefit from highlighting how the current study differs from these previous studies (refs 44-47).

Method

- The treatment duration of M = 51.4 sessions is long, particularly for exposure therapy or cognitive restructuring. Could the authors please provide the average session duration for each of the treatment approaches (perhaps the primary treatment type)?

- A sample of 59 participants is small for predictor analyses. Could the authors provide a power analysis or reference which justifies the use of n = 59 participants for these analyses?

- How did the authors conduct multiple imputation? What predictors were used to generate the replacement values?

- The authors may reconsider the use of repeated-measures MANOVA for treatment outcome and instead use mixed linear models or generalized estimating equations, as is standard in current psychotherapy research. For reference, see doi: 10.1001/archpsyc.61.3.310.

Discussion

- The authors state that this study provides insights into the effectiveness of CBT. They may reconsider replacing “CBT” with the umbrella term “psychotherapy” considering the diversity of treatment protocols included in the study.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 1

Editor‘s comments:

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

Our response: We have revised our manuscript accordingly.

2. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

Our response: We have added a paragraph in the cover letter to clarify why we cannot publicly share the data for the study, even though we acknowledge and support the benefits of open data sharing.

3. We note that you have stated that you will provide repository information for your data at acceptance. Should your manuscript be accepted for publication, we will hold it until you provide the relevant accession numbers or DOIs necessary to access your data. If you wish to make changes to your Data Availability statement, please describe these changes in your cover letter and we will update your Data Availability statement to reflect the information you provide.

Our response: It seems that we made this statement by mistake. As stated above, it will not be possible for us to share the data in a public repository. Our apologies for any confusion caused.

4. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

Our response: We have included captions for our Supporting Information File at the end of the manuscript.

Reviewers' comments:

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is a well-written paper that could surely contribute to the existing literature, however I have some suggestions to be addressed. First, some comment on the authors' methods is necessary as to why they chose to evaluate participants using the DSM IV as opposed to the DSM V (timeline etc.). Second, some self-report measures were employed in this study and other research shows us that these can sometimes be unreliable for various reasons. Should this be noted as a partial limitation of the study? Overall, this is a high quality manuscript fit for publication if these concerns are adequately addressed.

Our response:

1. We thank the reviewer for their positive feedback. Given that the German version of the structured clinical interview for DSM (SCID) based on the DSM-5 was only published in 2019, we used the DSM-IV-based SCID for the entire study. In response to this comment we now clarify in the manuscript that we used the DSM-IV-based SCID for the entire study (page 6).

2. We agree that self-report questionnaires can be prone to bias. We have added a section on this limitation in the discussion section (page 18).

Reviewer #2: Abstract

- The authors may consider rewording “significant changes” and instead provide detail about the direction i.e., decreased.

Our response: We have adjusted this part of the abstract to clarify the direction of the effects.

- Could the authors please provide a brief explanation of how reliable change and recovery were calculated? Was this the RCI or a percentage change?

Our response: Thank you for this inquiry. For the calculation of the number of participants with reliable change and recovery, we relied on data from Fisher (Fisher PL. The efficacy of psychological treatments for generalised anxiety disorder. In: Davey GCL, Wells A, editors. Worry and its psychological disorders. Theory, assessment, and treatment. West Sussex: Wiley & Sons; 2006. pp. 359–77). In his reanalysis of five RCTs with n = 223 participants, a RCI greater than ± 1.96 corresponds to a 7-point change on the PSWQ. In our study, we classified the participants with a change in PSWQ ≥ 7 as those with reliable change. Accordingly, we used the calculated cut off score of recovery from the same review and counted how many of our participants reached a PSWQ score of 46 or below at post-assessment. We have rephrased the method section to make it clearer that we did not calculate a reliable change index based on our data (page 12).

Introduction

- The introduction may benefit from combining the first two paragraphs together. Furthermore, could the authors please explain how recovery was conceptualized by the studies mentioned?

Our response: We have combined the paragraphs and rephrased the sentence to point out that recovery was based on the score in self-report questionnaires.

- The authors argue that previous studies of psychotherapy for GAD in routine care are limited by their strict treatment protocols. Did the current study have unstandardized treatment protocols? One could argue that psychology training clinics have rather strict protocols as the trainee psychologists are under close supervision and are often following treatment manuals.

Our response: Thank you for this comment. We have added a sentence to the manuscript (page 8) to clarify, that they were free in consultation with their supervisors, to combine methods from different treatment approaches. The final treatment reports yielded that they made use of this possibility. Therefore, we see our setting as rather unrestricted; especially in comparison with RCTs with often strict treatment protocols structuring each session.

- One strength of this paper is their investigation of IU and metacognitions as predictors of change in a naturalistic setting. However, the authors do note that previous studies have already examined predictors of change in GAD in naturalistic settings. The introduction could benefit from highlighting how the current study differs from these previous studies (refs 44-47).

Our response: We have reworded the end of the paragraph on previous studies (refs 44-47) concerning predictors of change in GAD to highlight the gaps in the literature that our study contributes to fill.

Method

- The treatment duration of M = 51.4 sessions is long, particularly for exposure therapy or cognitive restructuring. Could the authors please provide the average session duration for each of the treatment approaches (perhaps the primary treatment type)?

Our response: We agree that an average of just over fifty therapy sessions is long and we would have liked to provide information on the differences between the different treatment approaches. Unfortunately, we only have three treatments in which only one of the approaches was used. From the final treatment reports, it was not possible to determine which was the primary treatment type. As is often the case in naturalistic therapies, the therapists used an eclectic approach and mixed different interventions. Therefore, unfortunately, we cannot report the duration of the treatment for each approach.

- A sample of 59 participants is small for predictor analyses. Could the authors provide a power analysis or reference which justifies the use of n = 59 participants for these analyses?

Our response: We appreciate the prompt to the rather small sample size of n = 59 for predictor analysis in our study. Due to the inconclusive findings in the literature concerning predictors of treatment outcomes in GAD, we decided to run an exploratory regression analysis and did not compute an a priori power analysis. However, as suggested we have added a post-hoc power analysis to our manuscript (page 15) based on the final model of the regression analysis and also added confidence intervals for the R2 to reflect the uncertainty of our results. Based on our data, we calculated a power of .78 to detect the effect of the lower confidence interval for total R2. This is just below the .8 value that is normally considered acceptable power. We also added a sentence in our discussion section to highlight the importance of larger sample sizes in future studies to enhance statistical power and solidify the findings presented.

- How did the authors conduct multiple imputation? What predictors were used to generate the replacement values?

Our response: Thank you for this valuable comment. We added some more specific information on the imputation model and the auxiliary variables which were used to impute the missing values. In general, we followed the instructions by Enders et al. which are already mentioned in the manuscript. We added the following sentences (page 11): We included all variables within the data set correlating ≥ ±.40 with one of the variables with missing values or with the missing variables (which indicate whether a data point is missing) as auxiliary variables into the imputation model. Further, we included variables which showed a significant univariate t-test and thus indicating statistically significant differences between participants with vs. without missing values.

- The authors may reconsider the use of repeated-measures MANOVA for treatment outcome and instead use mixed linear models or generalized estimating equations, as is standard in current psychotherapy research. For reference, see doi: 10.1001/archpsyc.61.3.310.

Our response: We recognize that mixed linear models or generalized estimating equations are commonly used in current psychotherapy research. However, we carefully considered the assumptions and limitations of different analysis methods in consultation with statistical support and determined that repeated-measures MANOVA was an appropriate choice for our study given the research questions, structure of the data, sample size, and ability to compare with previous studies. In addition, our analyses are clear and simple, making them accessible to a wide audience, including non-statisticians. This is crucial, because one goal is to provide practical recommendations for routine psychotherapy.

Discussion

- The authors state that this study provides insights into the effectiveness of CBT. They may reconsider replacing “CBT” with the umbrella term “psychotherapy” considering the diversity of treatment protocols included in the study.

Our response: We appreciate the reviewer's concern regarding the use of the term "CBT". We understand CBT as a comprehensive approach in psychotherapy, including for example the third-wave method of MCT. We have thoroughly reviewed the manuscript and taken steps to clarify our definition of CBT. Since we have not included other approaches, such as psychodynamic or systemic therapy, we prefer to avoid using the broader term "psychotherapy" to avoid any misunderstandings.

We also made a minor adjustment consisting of the inclusion of the category "divorced" in Table 1 on page 6 of the manuscript.

Finally, we would like to thank you for your efforts and attentive comments on our manuscript. We feel that our manuscript has improved greatly with your input. We hope that we have adequately addressed your concerns and that you may consider the manuscript for publication.

Attachments
Attachment
Submitted filename: Response to Reviewers.docx
Decision Letter - Stephan Doering, Editor

Psychological interventions for generalized anxiety disorder: Effects and predictors in a naturalistic outpatient setting

PONE-D-22-24983R1

Dear Dr. Buhlmann,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Stephan Doering, M.D.

Academic Editor

PLOS ONE

Formally Accepted
Acceptance Letter - Stephan Doering, Editor

PONE-D-22-24983R1

Psychological interventions for generalized anxiety disorder: Effects and predictors in a naturalistic outpatient setting

Dear Dr. Buhlmann:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Professor Stephan Doering

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .