Peer Review History

Original SubmissionJuly 29, 2021
Decision Letter - Vincenzo De Luca, Editor

PONE-D-21-24557Experiences and perceptions of people with a severe mental illness and health care professionals with a one-year group-based lifestyle program (SMILE)PLOS ONE

Dear Dr. Walburg,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Mar 10 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Vincenzo De Luca

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for stating the following financial disclosure: "This study was funded by the Netherlands Organization for Health Research and

Development (ZonMW), the grant was awarded to Marcel Adriaanse. Grant number 80–84300–98-72012. " ext-link-type="uri" xlink:type="simple">https://www.zonmw.nl/nl/"

Please state what role the funders took in the study.  If the funders had no role, please state: "The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript." 

If this statement is not correct you must amend it as needed. 

Please include this amended Role of Funder statement in your cover letter; we will change the online submission form on your behalf.

3. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. 

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: I Don't Know

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: 1. Is the manuscript technically sound, and do the data support the conclusions?

This manuscript describes a qualitative research study designed to evaluate the experiences and perceptions of individuals who participated in a long-term (one year) ambulatory care (outpatient), group-based lifestyle program. All participants had a severe mental illness (SMI) (and, according to line 108, were overweight). The perceptions of health care providers (HCP) who led the group sessions were also evaluated. As acknowledged by the authors, the inclusion of the HCPs is a strength of the research as their experiences serve to complement the findings from the clients.

This research used semi-structured interviews to evaluate the perceptions of participants. Separate interview guides (described in the supplementary materials) were used for the two groups of participants. Four themes (and eight sub-themes) were identified and described. Together, these themes captured the perceived value and benefits of the program, the impact of the program on participants’ wellbeing, and factors that contributed to the effectiveness of the program. The perceptions of the HCPs complemented and extended the findings obtained from the clients. As described in the Discussion, the findings set the stage for evidence-based recommendations regarding the development and implementation of lifestyle-focused programs.

The focus of the research is important. It is well-established that wellbeing is adversely impacted by SMI. As the authors acknowledged, people with a SMI have poorer physical health and are at greater risk for premature mortality. They are generally less physically active and have a poorer diet. Other research has demonstrated that individuals with a SMI are often more isolated, experience greater loneliness, and have a lower quality of life and perceived wellbeing. While treatment of the SMI specifically is important, interventions that target lifestyle issues more generally can make a substantive difference to the wellbeing of these individuals. The described intervention is distinct from other programs that have been described in the research literature. First, it is a year-long program (weekly sessions for the first six months, followed by monthly sessions). It is offered as an outpatient group program. However, attention is paid to the needs and styles of individual clients. As described by the authors, the group nature of the intervention seemed to be a strong contributor to the effectiveness of the program.

The research is also timely. We continue to be in the midst of the COVID-19 pandemic, which has stretched health care systems to their limits. In addition, the mental health of people (with and without premorbid mental health concerns) has been adversely and substantively effected. Thus, intervention programs that focus upon lifestyle issues and that promote social connections may be especially important in the current context. In this regard, it was interesting that the researchers noted that response to recruitment attempts was more positive than expected. In particular, even individuals who did not meet the inclusion criteria wanted to participate. This was in contrast to the expectations of various stakeholders who anticipated that the group-nature of the program would limit participant’ interest. Furthermore, as indicated above, the group-nature of the intervention was found to be one of the critical strengths of the intervention.

Overall, I thought the research was well done and meaningful. I found the Introduction and Methods to be the weaker sections in that key aspects of the research were not always described clearly. The recommended revisions are relatively minor (that is, they should be easily achieved); however, they will substantively improve the quality of the manuscript.

Concerns:

1. Focus of the intervention: It would be helpful to acknowledge the primary focus of the lifestyle intervention (i.e., weight loss, physical activity) in the Abstract (Objective; lines 23-25) and Introduction. This was not clear until S1 Appendix was examined. Although there were hints of the focus (e.g., line 37, “Irrespective of weight loss …; description of the inclusion criteria (i.e., line 108), for the most part, the description of the program within the body of the manuscript was quite vague. This is problematic in that the descriptor “lifestyle intervention” is vague. Such programs can be narrow or broad. In the case of more narrow foci, programs can vary tremendously. It is recommended that the final paragraph of the introduction (lines 78-86) be revised to include a brief description of the program’s main focus.

2. The described research is part of a process evaluation of the intervention that was conducted in parallel with a pragmatic cluster-randomized control trial of the SMILE lifestyle intervention. While the main study was cited, it is not clear if the process evaluation of the intervention has been published. Moreover, it was not clear why the authors decided to present the qualitative data in a separate manuscript. While this decision may well be appropriate, it would be helpful if additional information was included about the primary process evaluation in the Study Design section of the Methods (lines 88 – 95). For example, was this evaluation quantitative in nature? If it has been published, a reference for that article should be provided (see lines 81 and 91-92). In revising this section, please ensure that the various components of the study as a whole are clearly described. Also, it may be pertinent, in the Discussion, for the authors to address the inter-relationships between the results of the two parts of the process evaluation. Are the two sets of results complementary? Are there any discrepancies?

3. SMILE Intervention (lines 96-108): Please provide more information about the structure of the program. How long was each session? What was the size of the groups (i.e., clients and HCPs; this information was finally provided in the Discussion section (lines 380-381))? Describe the SMI inclusion criterion. Were individuals with co-morbid mental health disorders eligible to participate? While a list of topics covered in the program is available in S1 Appendix, it would be helpful to describe briefly the kinds of topics addressed in the body of the manuscript.

4. Use of RE-AIM framework: It was stated that the interview guides were based on the RE-AIM framework (Glasgow et al., 2019). While this framework is very pertinent, it was not clear how it was used, even after reviewing the two interview guides (S2 Appendix). First, it may be helpful to describe more fully the nature of this framework and how it was used. That is, describe the fit between the framework and the interview guides. Presumably, RE-AIM was also considered when deciding who the participants would be in the current study. Some of the dimensions (e.g., implementation and maintenance; perhaps, adoption) are also pertinent to the implications of the research. Accordingly, it may be helpful to consider this framework in the Discussion section.

5. Participants (Results): Please include a brief description of the kinds of SMI experienced by the participants. Please note that the tables are incorrectly referred to on lines 154-155. That is, Table IA concerns the HCPs while Table 1B is client-focused.

It was also noted in the Methods that during the second half of the intervention, individual phone support was available as an adjunct to the monthly group sessions (line 99-100). It is recommended that information about the frequency of these contacts be described in this section or in Table IB. Was this type of support addressed by clients in the interviews? This is especially important given that HCPS recommended offering increased individual face-to-face support for some clients (see lines 318-321; see also lines 431-432). Again, was this recommendation fairly general or are there sub-groups of clients that would benefit from this support?

6. Results (Themes 1 and 2): The description of these themes seem to focus upon the experiences and perceptions of the majority of clients. The experiences of the minority, however, can be very pertinent – especially in considering the effectiveness of a program and steps to enhance the program. Accordingly, it may be helpful to describe some of the dissenting views. For example, it was stated that some participants wanted to gain more knowledge about lifestyle related issues (lines 174-175). What were the primary interests of the other clients? Did the interests seem to vary as a function of participant characteristics (e.g., gender, age, etc.)? The answers have help to refine and extend some of the recommendations made in the Discussion.

7. Discussion (appropriateness of a group-based intervention): On line 369, the authors state that “a group setting will not be ideal for all people with SMI …” Any thoughts as to who will benefit most from a group-based intervention?

8. Discussion (cognitive impairments): On line 382, it was acknowledged that many of the clients had cognitive impairments and that these impairments may be a barrier for successful change. What kinds of cognitive impairments? The nature of these impairments may lead to specific recommendations/procedures for addressing this potential barrier.

Comments related to the other specific Review Questions:

*2. Has the statistical analysis been performed appropriately and rigorously?

The described study uses qualitative methods and, as such, the issue of statistical analysis per se is not relevant. Having said that, it is important to consider the thematic analysis methods used. Overall, the methods used to analyze the transcripts and identify emerging themes were appropriate. In addition, member checking was conducted (lines 133-134) to help demonstrate credibility of the data and identified themes. Importantly, they had a strong response rate.

It was indicated that two members of the study team reviewed and coded each transcript (line 138). However, no information was provided about the consistency (or congruence) of the two sets of codes and how differences were resolved. It is recommended that a brief description of this process be included.

The statement on Line 141 regarding the validity of the themes was unclear. It is unusual to talk about the validity of qualitative data or themes, more generally.

*3. Have the authors made all data underlying the findings in their manuscript fully available?

No, some restrictions were identified. Specifically, the authors indicated that in response to “reasonable request[s],” the data will be made available from the corresponding author and with permission of the Vrije Universiteit Amerstdam.

Limited access to qualitative data is not unusual.

*4. Is the manuscript presented in an intelligible fashion and written in standard English?

Overall, the manuscript was clearly written in standard English. There were sections that were awkward such that it was hard to understand some of the points being made (e.g., lines 70-71, 137, 164, 171-172, 408-409). Careful proof-reading and editing will be sufficient to address this comment.

Reviewer #2: While I have expertise in severe mental illness and knowledge of qualitative methods, I do not use such methods in my work. Rather, I appreciate the approach in terms of its yield of underlying processes that are invisible in RCTs and quantitative approaches. This study did not disappoint as I found it very useful and informative. Note that I cannot judge the statistics other than recognizing that those described are used in qualitative studies. The lack of fully publically available data does not surprise me given confidentiality matters for clinical samples. The authors make it available under appropriate conditions, in my view.

In terms of suggestions to the authors, here is my list:

1) Abstract should be clear about the objectives so persons unfamiliar with SMILE will know what the study is about.

2) Extensive use of acronyms that are unexplained is problematic for clarity, e.g., what is FACT?

3) Explain more of the technical jargon, e.g., what is "process evaluation" exactly? Look for jargon and clarify meaning so the work is consumable by persons not steeped in qualitative methods.

4) The authors state that selection bias possibly occurred. Of course it occured, be clear that it did.

5) When describing themes, terms like most participants and some participants are frequent. I would suggest giving percentage to make things more concrete.

6) Address as a potential limitation that some participants attended a very small percentage of the 30 available sessions. What might be the impact or such.

7) Likewise, as a limitation concern, what are the potential implications that only 48% of the client interviewees "responded to the member check, and agreed with the summary". Why were they unresponsive at such a higher rate and does it degrade the contribution?

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Carolyn Szostak

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 1

We thank the reviewers for their positive comments and for the feedback on our manuscript. Please note that all lines mentioned in the responses are based on the 'Revised Manuscript with Track Changes' document when ''all markup'' under display tracking is enabled.

Review Comments to the Author

Reviewer #1:

Overall, I thought the research was well done and meaningful. I found the Introduction and Methods to be the weaker sections in that key aspects of the research were not always described clearly. The recommended revisions are relatively minor (that is, they should be easily achieved); however, they will substantively improve the quality of the manuscript.

RESPONSE: We thank the reviewer for these positive comments and for the feedback on our manuscript.

Concerns:

1. Focus of the intervention: It would be helpful to acknowledge the primary focus of the lifestyle intervention (i.e., weight loss, physical activity) in the Abstract (Objective; lines 23-26) and Introduction. This was not clear until S1 Appendix was examined. Although there were hints of the focus (e.g., line 38, “Irrespective of weight loss …; description of the inclusion criteria (i.e., line 122-23), for the most part, the description of the program within the body of the manuscript was quite vague. This is problematic in that the descriptor “lifestyle intervention” is vague. Such programs can be narrow or broad. In the case of more narrow foci, programs can vary tremendously. It is recommended that the final paragraph of the introduction (lines 80-93) be revised to include a brief description of the program’s main focus.

RESPONSE: Thank you for your comment. We agree that the current description is vague at certain places in the manuscript.

CHANGE: We added more information regarding the focus of the lifestyle intervention: in the abstract (lines 25-26), the introduction (lines 80-82) and the methods section (lines 110-113).

2. The described research is part of a process evaluation of the intervention that was conducted in parallel with a pragmatic cluster-randomized control trial of the SMILE lifestyle intervention. While the main study was cited, it is not clear if the process evaluation of the intervention has been published. Moreover, it was not clear why the authors decided to present the qualitative data in a separate manuscript. While this decision may well be appropriate, it would be helpful if additional information was included about the primary process evaluation in the Study Design section of the Methods (lines 96-105). For example, was this evaluation quantitative in nature? If it has been published, a reference for that article should be provided (see lines 84 and 86). In revising this section, please ensure that the various components of the study as a whole are clearly described. Also, it may be pertinent, in the Discussion, for the authors to address the inter-relationships between the results of the two parts of the process evaluation. Are the two sets of results complementary? Are there any discrepancies?

RESPONSE: The process evaluation was also qualitative in nature, however with a specific focus on the implementation process of the intervention, including a description of barriers and facilitators for effective implementation. As the present study and the process evaluation each have a different but complementary focus, and because it was impossible to summarize the wealth of information in one manuscript, we have prepared two different manuscripts.

CHANGE: The process evaluation of the study has recently been published, therefore we have added the reference of this publication when the process evaluation is mentioned in the manuscript. In addition, we explained the aim of the process evaluation (see also comment 3 from reviewer 2) in the introduction section (lines 84-86), in order to understand how the present study on the experiences of patients and health-care providers is related to the process evaluation. Finally, in the discussion (lines 459-462) we described the complementary relation of the process evaluation and the current article.

3. SMILE Intervention (lines 107-123): Please provide more information about the structure of the program. How long was each session? What was the size of the groups (i.e., clients and HCPs; this information was finally provided in the Discussion section (lines 422-423))? Describe the SMI inclusion criterion. Were individuals with co-morbid mental health disorders eligible to participate? While a list of topics covered in the program is available in S1 Appendix, it would be helpful to describe briefly the kinds of topics addressed in the body of the manuscript.

RESPONSE: For the inclusion of participants there was no distinction made between (co-morbid) mental health disorders in clients. All clients from participating FACT-teams were eligible to participate.

CHANGE: We added additional information regarding the SMILE intervention (lines 108 - 122), such as the timing of the sessions, group sizes, intervention topics and how many HCP’s were involved per session.

4. Use of RE-AIM framework: It was stated that the interview guides were based on the RE-AIM framework (Glasgow et al., 2019). While this framework is very pertinent, it was not clear how it was used, even after reviewing the two interview guides (S2 Appendix). First, it may be helpful to describe more fully the nature of this framework and how it was used. That is, describe the fit between the framework and the interview guides. Presumably, RE-AIM was also considered when deciding who the participants would be in the current study. Some of the dimensions (e.g., implementation and maintenance; perhaps, adoption) are also pertinent to the implications of the research. Accordingly, it may be helpful to consider this framework in the Discussion section.

RESPONSE: For the process evaluation and the current study on experiences of patients and professionals, the qualitative results were derived from the same data source (semi-structured interviews). Both articles are complementary to each other. We based the topics and interview guide on the RE-AIM framework which was explicitly used for the process evaluation to describe the process of implementation, including barriers and facilitators. In the analysis and writing of the current manuscript, the RE-AIM framework was no longer explicitly used, given its focus on experiences of clients and professionals with the lifestyle intervention. Therefore, we have not provided an extensive explanation of the RE-AIM framework and have not used it for data analysis and reporting for the current manuscript.

CHANGE: We have made some adjustments in the section Procedures to clarify the use of the RE-AIM framework in the two studies: the process evaluation and the current study on the experiences of clients and professionals.

The following sentences were added:

- The topics were based on the RE-AIM framework as this study was performed alongside the process evaluation which focused on the process of implementation of the intervention (Lines 143-145).

- These RE-AIM dimensions were incorporated throughout the interviews but were not explicitly used for the analysis of the data in the present study, given our focus on the experiences of clients and professionals (Lines 150-152).

5. Participants (Results): Please include a brief description of the kinds of SMI experienced by the participants. Please note that the tables are incorrectly referred to on lines 183-184. That is, Table IA concerns the HCPs while Table 1B is client-focused.

RESPONSE: We thank the reviewer for this comment. The global description of the psychiatric diagnoses can be found in Table 1B. We purposely did not further specify these diagnoses in order to ensure privacy of the clients, as HCPs know which of their clients was interviewed for the study.

CHANGE: We corrected the references for Tables 1A and 1B.

It was also noted in the Methods that during the second half of the intervention, individual phone support was available as an adjunct to the monthly group sessions (line 109-110). It is recommended that information about the frequency of these contacts be described in this section or in Table IB. Was this type of support addressed by clients in the interviews? This is especially important given that HCPS recommended offering increased individual face-to-face support for some clients (see lines 348-249; see also lines 418-419). Again, was this recommendation fairly general or are there sub-groups of clients that would benefit from this support?

RESPONSE: This is an interesting question. We agree that better insight into the telephone contacts could provide valuable information. Unfortunately, we were not able to collect reliable data on the use of those contacts, despite our efforts in this regard. In the interviews, the telephone contacts were not explicitly put forward as being valuable or not. Therefore, we cannot provide more information about this.

6. Results (Themes 1 and 2): The description of these themes seem to focus upon the experiences and perceptions of the majority of clients. The experiences of the minority, however, can be very pertinent – especially in considering the effectiveness of a program and steps to enhance the program. Accordingly, it may be helpful to describe some of the dissenting views. For example, it was stated that some participants wanted to gain more knowledge about lifestyle related issues (lines 206-207). What were the primary interests of the other clients? Did the interests seem to vary as a function of participant characteristics (e.g., gender, age, etc.)? The answers have help to refine and extend some of the recommendations made in the Discussion.

RESPONSE: We agree that when addressing ‘the majority’ on some views it seems we leave out views of the minority. We agree that this seems to make the information in the results section incomplete, as views from minorities of the participants are also of interest. When looking into our data again and when considering how we elaborated themes 1 and 2, we may conclude that no specific views of a minority of patients emerged from the data. The way we phrased some of the perspectives of respondents with respect to themes 1 and 2 were complete, given the available data. The fact that with respect to some (sub)themes a majority of respondents articulated their perspectives explicitly, this often means that other respondents did not verbalize their perspective in an explicit way. This is inherent to the qualitative method followed, using a semi-structured interview protocol and an iterative process of data-collection and data-analysis (see also our response to Reviewer 2).

That said, we were able to make some adjustments. We modified some sentences to clarify the above-mentioned aspects. Further, we added additional reasons participants mentioned to join the sessions, in addition to the most common reasons we already mentioned under theme 1. In the end, no clear dissenting views emerged from our data to report in the results section. Also, the analysis showed no clear relationship between participant characteristics and articulated perspectives for both theme 1 and 2.

CHANGE: We changed some phrasing of themes 1 and 2 in line with the above-mentioned clarification. In addition, we added some extra views for theme 1 regarding primary interests for joining the sessions (lines 208-210).

7. Discussion (appropriateness of a group-based intervention): On line 408, the authors state that “a group setting will not be ideal for all people with SMI …” Any thoughts as to who will benefit most from a group-based intervention?

RESPONSE: People who could benefit most from a group-based intervention are those who are looking for (new) social contacts, enjoy social activities or want to learn from peers.

CHANGE: We added the following sentence to the discussion section: In our opinion, people who could benefit most from a group-based intervention are those who are looking for (new) social contacts, enjoy social activities or are interested in learning from peers. (Lines 420-422).

8. Discussion (cognitive impairments): On line 395, it was acknowledged that many of the clients had cognitive impairments and that these impairments may be a barrier for successful change. What kinds of cognitive impairments? The nature of these impairments may lead to specific recommendations/procedures for addressing this potential barrier.

RESPONSE: We agree that it is important to specify the clients’ cognitive impairments in order to better apply procedures or recommendations to address this potential barrier. The data revealed that impairments in concentration were particularly mentioned.

CHANGE: We added this information in line 284(results) and line 395 (discussion).

Comments related to the other specific Review Questions:

*2. Has the statistical analysis been performed appropriately and rigorously?

The described study uses qualitative methods and, as such, the issue of statistical analysis per se is not relevant. Having said that, it is important to consider the thematic analysis methods used. Overall, the methods used to analyze the transcripts and identify emerging themes were appropriate. In addition, member checking was conducted (lines 158-160) to help demonstrate credibility of the data and identified themes. Importantly, they had a strong response rate.

It was indicated that two members of the study team reviewed and coded each transcript (line 163). However, no information was provided about the consistency (or congruence) of the two sets of codes and how differences were resolved. It is recommended that a brief description of this process be included.

CHANGE: We added additional information regarding this process in line 169-172.

The statement on Line 166 regarding the validity of the themes was unclear. It is unusual to talk about the validity of qualitative data or themes, more generally.

RESPONSE: We agree this is unusual. Instead of valid/validity we now used the words ‘credible/credibility’ as these terms are more common in qualitative research.

CHANGE: We adapted this sentence to: (4) reviewing whether themes credibly represent the data (lines 166-167).

*4. Is the manuscript presented in an intelligible fashion and written in standard English?

Overall, the manuscript was clearly written in standard English. There were sections that were awkward such that it was hard to understand some of the points being made. Careful proof-reading and editing will be sufficient to address this comment.

CHANGE: We have asked an English native speaker with experience with academic writing to edit the manuscript to make the article more clearly written in English. Several changes have been made throughout the manuscript.

Reviewer #2:

While I have expertise in severe mental illness and knowledge of qualitative methods, I do not use such methods in my work. Rather, I appreciate the approach in terms of its yield of underlying processes that are invisible in RCTs and quantitative approaches. This study did not disappoint as I found it very useful and informative. Note that I cannot judge the statistics other than recognizing that those described are used in qualitative studies. The lack of fully publically available data does not surprise me given confidentiality matters for clinical samples. The authors make it available under appropriate conditions, in my view.

RESPONSE: We thank the reviewer for these positive comments and for the feedback on our manuscript.

In terms of suggestions to the authors, here is my list:

1) Abstract should be clear about the objectives so persons unfamiliar with SMILE will know what the study is about.

RESPONSE: We agree this was unclear, therefore we adapted the aim description in the abstract.

CHANGE: We changed the objectives to make it more clear for people unfamiliar with SMILE (Lines 23-26).

2) Extensive use of acronyms that are unexplained is problematic for clarity, e.g., what is FACT?

CHANGE: We added the explanations for the acronyms FACT and SMILE to the manuscript.

FACT: Flexible Assertive Community Treatment

SMILE: Severe Mental Illness Lifestyle Evaluation

3) Explain more of the technical jargon, e.g., what is "process evaluation" exactly? Look for jargon and clarify meaning so the work is consumable by persons not steeped in qualitative methods.

RESPONSE: Thank you for your comment, we agree it is important to explain more technical jargon in the manuscript to make the work more accessible for people who are not steeped in qualitative methods.

CHANGE: We added explanations of the following technical jargon to the manuscript:

(1): Process evaluation (Lines 84-86, 101-102 and 458-463)

(2): Purposive sampling (Lines 129-137)

(3): Data saturation: (Lines 156-157)

4) The authors state that selection bias possibly occurred. Of course it occured, be clear that it did.

RESPONSE: We agree and changed this sentence in the discussion section.

CHANGE: We changed the sentence to: Therefore, it is plausible that selection bias has occurred. (line 471).

5) When describing themes, terms like most participants and some participants are frequent. I would suggest giving percentage to make things more concrete.

RESPONSE: Giving percentages or numbers is uncommon in qualitative research. As an iterative process is used, topics were adapted throughout the interview period, and new topics were added in subsequent interviews, based on information collected in previous interviews. It is possible that some (new) topics were not discussed in previous interviews as these topics were not addressed in those interviews but were in later interviews. In this qualitative research the exact quantity is not of primary concern, but we do give an indication to give an impression of bigger or smaller importance.

CHANGE: We believe it is opportune to provide exact quantitative figures in terms of percentages as this is uncommon for qualitative studies.

6) Address as a potential limitation that some participants attended a very small percentage of the 30 available sessions. What might be the impact or such.

RESPONSE: We purposely invited clients with a low attendance rate in the intervention to participate in the interviews to learn about their perspectives as well (this was done as part of the purposive sampling strategy, of which we have now added an explanation on lines 129-137). Learning the perspectives of participants with a low attendance is of interest as only interviewing people with a high attendance (who we assumed would be more satisfied with the intervention) will give one-sided views. Therefore, we do not believe this is a limitation of the study.

CHANGE: We believe it is not necessary to address this as a potential limitation as these participants were purposively added to the sample, as part of our purposive sampling strategy.

7) Likewise, as a limitation concern, what are the potential implications that only 48% of the client interviewees "responded to the member check and agreed with the summary". Why were they unresponsive at such a higher rate and does it degrade the contribution?

RESPONSE: Beforehand, for this population of clients with severe mental illness we did not expect a high response for the member checks. We were satisfied with the response rate of 48%. All member checks we received from clients mentioned that no changes were needed to the provided summary. However we do agree this might be a potential limitation.

CHANGE: We have added this as a limitation in the limitations section in the discussion (lines 474-476).

Attachments
Attachment
Submitted filename: 20220526 Response to Reviewers.docx
Decision Letter - Vincenzo De Luca, Editor

Experiences and perceptions of people with a severe mental illness and health care professionals of a one-year group-based lifestyle programme (SMILE)

PONE-D-21-24557R1

Dear Dr. Walburg,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Vincenzo De Luca

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: All major concerns have been addressed. I enjoyed reading the revised manuscript. It was very informative. However, there are a few minor revisions concerning writing that should be addressed.

1. On a number of occasions a word is preceded by a single quotation mark (i.e., '). There should be a closing quotation mark. See lines: 224, 392, 416, and 437.

2. Lines 81-82: the second clause of the sentence that starts, "The intervention was ..." is awkward and hard to follow. Please re-phrase.

3. Lines 119 and 121: HCPs and clients should be the possessive (i.e., HCPs' and clients'), respectively. Similarly, on line 362, "clients" should be the possessive and read, clients'.

4. Line 284: The sentence, "This change that was ..." is incomplete. Alternatively, omit "that" from the sentence.

5. The first sentence of the Strengths section is confusing (line 432). Given what follows, it seems that the first sentence should be descriptive of the current study.

6. Line 434: There should be a comma after "together".

With regards to the requirement to make all data full available (see Point 4), the authors provide an appropriate explanation for restricting access. Moreover, they have indicated that they will make it available under appropriate conditions.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Carolyn Szostak, Ph.D.

**********

Formally Accepted
Acceptance Letter - Vincenzo De Luca, Editor

PONE-D-21-24557R1

Experiences and perceptions of people with a severe mental illness and health care professionals of a one-year group-based lifestyle programme (SMILE)

Dear Dr. Walburg:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Vincenzo De Luca

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .