Peer Review History

Original SubmissionMay 24, 2023
Decision Letter - Humayun Kabir, Editor

PONE-D-23-15949The role of problem-solving skills in the prevention of suicidal behaviors: A systematic review and meta-analysisPLOS ONE

Dear Dr. Poorolajal,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Sep 09 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Humayun Kabir

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for stating the following financial disclosure: "X"

At this time, please address the following queries:

a) Please clarify the sources of funding (financial or material support) for your study. List the grants or organizations that supported your study, including funding received from your institution. 

b) State what role the funders took in the study. If the funders had no role in your study, please state: “The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.”

c) If any authors received a salary from any of your funders, please state which authors and which funders.

d) If you did not receive any funding for this study, please state: “The authors received no specific funding for this work.”

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

3. Thank you for stating the following in your Competing Interests section: "X" 

Please complete your Competing Interests on the online submission form to state any Competing Interests. If you have no competing interests, please state ""The authors have declared that no competing interests exist."", as detailed online in our guide for authors at http://journals.plos.org/plosone/s/submit-now 

This information should be included in your cover letter; we will change the online submission form on your behalf.

4. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information. 

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This paper makes a welcome contribution to understanding about problem solving skills and suicidal behaviour. At present, however, it is somewhat lacking in detail, and I strongly encourage the author/s to consider the suggestions below.

First and foremost, in a full length research article I would expect to see more depth and sophistication in the introduction. There is an opportunity to discuss ways in which different types of problem solving ability are thought to relate to different suicidal behaviors (and why), to elaborate on the different concepts raised and/or to give examples of some past studies (and how conflicts in previous results point to the need for meta-analysis), and to touch on some of the reasons for why the current study used a fairly broad focus (i.e., the paper can be framed as an initial step towards finding points of consensus and difference between existing studies, while also acknowledging that the variation in existing work in terms of definitions, measurement etc makes it challenging to directly compare those studies).

I would also like to see more information about the selection criteria and study selection procedures. For example, what was considered a study on problem solving, vs what was not considered problem solving?

I am also concerned that at a few points, causality seems to be inferred. While it is certainly fair to say that the evidence is very suggestive of a protective effect of problem solving skills, it is not clear at this stage how and why that may be operating (for example, potential mediators or moderators, confounds, etc). This is especially relevant in light of the diverse nature of the different studies included in the meta-analysis.

Finally, I would very much like to see some discussion about the differences between the studies that were included and how and why that may relate to the results.

Reviewer #2: 1. Since WHO reports in 2019 (ref 2) has been listed and cited, it is redundant to list and cite 2014 report (ref 1). Relevant data has been updated in the 2019 report.

2. My major concern is that the conclusion is not sufficiently supported by findings. Findings of RCT studies argued that the problem sovling skills could NOT reduce suicide risk (small effective size), although results of observational studies substantially supported such association. Might such association be attributed to, at least partly, other factors which did not assessed in this study.

3. In the table 1, 17 studies focused on suicidal ideation, 9 on suicide attempt, why in the Figure 2, only 6 and 7 studies have been included? What about the other 13 studies?

4.Only one study focused on suicide death, it is meaningless to review or meta-analyze one study.

5.Authors did not describe any data or information on how to assess so-called problem solving skill, and measure tool or methods were not included in assessing the source of heterogeneity, why? Good psychometric performance and consistent measures are important to assess research findings. Different tools or cut-off points might result in different findings.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

<quillbot-extension-portal></quillbot-extension-portal>

Revision 1

Reviewers' comments

Reviewer #1

This paper makes a welcome contribution to understanding about problem solving skills and suicidal behaviour. At present, however, it is somewhat lacking in detail, and I strongly encourage the author/s to consider the suggestions below.

First and foremost, in a full length research article I would expect to see more depth and sophistication in the introduction. There is an opportunity to discuss ways in which different types of problem solving ability are thought to relate to different suicidal behaviors (and why), to elaborate on the different concepts raised and/or to give examples of some past studies (and how conflicts in previous results point to the need for meta-analysis), and to touch on some of the reasons for why the current study used a fairly broad focus (i.e., the paper can be framed as an initial step towards finding points of consensus and difference between existing studies, while also acknowledging that the variation in existing work in terms of definitions, measurement etc makes it challenging to directly compare those studies).

Answer: Thank you for your feedback. We agree that a full-length research article should have a more comprehensive and sophisticated introduction, and we appreciate the opportunity to revise ours. We carefully revised the introduction section to provide a thorough review of the literature, outline the rationale for the study, and provide context for the research question. We also discussed the existing evidence and gaps in the literature related to the relationship between problem-solving ability and suicidal behaviors. We hope that our revised introduction provides a clearer and more comprehensive understanding of the importance and relevance of our study.

I would also like to see more information about the selection criteria and study selection procedures. For example, what was considered a study on problem solving, vs what was not considered problem solving?

Answer: In the methods section, we provided a detailed explanation of the selection criteria used and presented a definition of problem-solving skills along with the measurement tools that were utilized.

I am also concerned that at a few points, causality seems to be inferred. While it is certainly fair to say that the evidence is very suggestive of a protective effect of problem solving skills, it is not clear at this stage how and why that may be operating (for example, potential mediators or moderators, confounds, etc). This is especially relevant in light of the diverse nature of the different studies included in the meta-analysis.

Answer: We revised the conclusion sections in both the abstract and main text, and modified the final inference based on our findings. Also, in the discussion section, we highlighted the limitations and potential biases of the study.

Finally, I would very much like to see some discussion about the differences between the studies that were included and how and why that may relate to the results.

Answer: In the third paragraph of the discussion section, we provided a detailed explanation of the differences between the studies included in the meta-analysis and how these differences may have impacted the overall results.

Reviewer #2

1. Since WHO reports in 2019 (ref 2) has been listed and cited, it is redundant to list and cite 2014 report (ref 1). Relevant data has been updated in the 2019 report.

Answer: We have replaced the old reference with a new one and revised the introduction accordingly.

2. My major concern is that the conclusion is not sufficiently supported by findings. Findings of RCT studies argued that the problem sovling skills could NOT reduce suicide risk (small effective size), although results of observational studies substantially supported such association. Might such association be attributed to, at least partly, other factors which did not assessed in this study.

Answer: We revised the conclusion sections in both the abstract and main text.

3. In the table 1, 17 studies focused on suicidal ideation, 9 on suicide attempt, why in the Figure 2, only 6 and 7 studies have been included? What about the other 13 studies?

Answer: Thank you for your attention.

Out of the 27 studies included, 17 focused on suicidal ideation, 9 on suicide attempt, and 1 on suicide death.

Within the 17 studies related to suicidal ideation, 5 reported OR (upper part of Figure 2), 10 reported mean difference (shown in Figure 3), and 2 were RCTs (shown in Figures 2 & 4). Therefore, the total number of studies related to suicidal ideation was 17 (5+10+2).

Within the 9 studies related to suicide attempt, 6 reported OR (shown in Figure 2) and 3 were RCTs (shown in Figures 2 & 4). Therefore, the total number of studies related to suicide attempt was 9 (6+3).

4. Only one study focused on suicide death, it is meaningless to review or meta-analyze one study.

Answer: We appreciate the reviewer's concern about the inclusion of only one study that focused on suicide death. While we agree that it is not possible to conduct a meaningful meta-analysis with only one study, we decided to include this study in our systematic review to provide a comprehensive assessment of the existing literature on the relationship between social support and suicidal behaviors. The study in question is the only case-control study that provides valuable information on the association between social support and suicide death. We acknowledge that further research is needed to confirm these findings, and we have emphasized in the conclusion section the need for additional studies to explore the complex relationship between social support and suicidal behaviors.

5. Authors did not describe any data or information on how to assess so-called problem solving skill, and measure tool or methods were not included in assessing the source of heterogeneity, why? Good psychometric performance and consistent measures are important to assess research findings. Different tools or cut-off points might result in different findings.

Answer: In the method section, we provided an explanation of problem-solving skills and presented a comprehensive list of tools used to measure them in Table 1. As part of our meta-regression analysis, we also included measurement tools to investigate potential sources of heterogeneity.

Decision Letter - Humayun Kabir, Editor

PONE-D-23-15949R1The role of problem-solving skills in the prevention of suicidal behaviors: A systematic review and meta-analysisPLOS ONE

Dear Dr. Poorolajal,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Sep 29 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Humayun Kabir

Academic Editor

PLOS ONE

Additional Editor Comments:

Please revise the interpretation of the pooled estimate as the statistical significance should be not emphasized in the meta-analysis.

limitation section and a recommendation section are missing.

is it only search strategy, "The following

keywords were searched: (problem solving OR problem-solving) AND (suicide OR suicidal OR

suicidality)"? If yes, then the search is very narrow and may be no longer systematic research. Describe the details of the search like if you used the MES heading and keywords both. The search strategies should be provided in a supplementary file.

EMBASE and other databases were not covered which may be the potential limitation of the review.

how was the RCT incorporated in this study along with other designs?

"randomized clinical trials (RCT) addressing

the association between problem-solving skills and suicide behaviors" RCT does not incorporate association.

use subheadings while reporting the results.

"problem-solving skills" how this intervention was measured throughout the study?

inclusion and exclusion are missing.

"Control: In cases where studies categorized problem-solving skills, we examined the possibility of

suicidal behaviors in individuals with high problem-solving skills compared to those with low problem solving skills as a control group." what does it mean? specify who is the comparator. if the intervention is problem-solving skills then the comparator should be something else, maybe not having the skill.

"In cases where studies reported the mean score of problem-solving

skills, we examined the standard mean difference between those with and without suicidal behaviors." SMD of which groups? does it a suicidal idea vs no suicidal ideation? if yes, then I think, it is a serious gap in the planning.

cross-sectional study and RCT can not be pooled in same study and should have followed different tools for doing the risk of bias and certainty of the evidence. meta-analysis should not be pooling apple and orange.

"This meta-analysis was conducted to determine to

what extent problem-solving skills can prevent suicidal behaviors" if this is the objective of this review and then I think this review failed to achieve the objective.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 2

Additional Editor Comments

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please revise the interpretation of the pooled estimate as the statistical significance should be not emphasized in the meta-analysis.

Answer: We omitted the terms "significant" and "significantly" from both the abstract and the main results and discussion sections, where we highlighted the outcomes of the meta-analysis.

Limitation section and a recommendation section are missing.

Answer: These sections were added to the end of the Discussion section.

Is it only search strategy, "The following keywords were searched: (problem solving OR problem-solving) AND (suicide OR suicidal OR suicidality)"? If yes, then the search is very narrow and may be no longer systematic research. Describe the details of the search like if you used the MES heading and keywords both. The search strategies should be provided in a supplementary file.

Answer: We have diligently expanded upon our search strategy and incorporated the latest search findings up until August 16, 2023. Our search encompassed a range of pertinent keywords, including terms such as (problem solving or coping skills or resilience skills or solution-oriented skills or cognitive flexibility or decision-making abilities or critical thinking or creative thinking or analytical thinking) and (suicide or suicidal or suicidality). It is noteworthy that both MeSH terms and keywords were thoughtfully integrated into our comprehensive search approach. Fortuitously, the implementation of the new search strategy yielded two additional studies, culminating in a total of 29 studies now included in our analysis. The detailed outline of our search strategies can be found in the supplementary file, providing a clear reference for the methods employed.

EMBASE and other databases were not covered which may be the potential limitation of the review.

Answer: Regrettably, we did not have access to the EMBASE database during our research phase. Nonetheless, a silver lining exists as both the EMBASE and Scopus databases fall under the umbrella of Elsevier Publications. This interconnection ensures that a substantial portion of the resources cataloged in EMBASE are encompassed within the scope of Scopus. Notably, Mann et al. conducted a thorough investigation in 2016 [1] aimed at evaluating coverage, overlap, and distinctive contributions of EMBASE and Scopus. Their findings revealed that 32 of the 34 studies included were sourced from either the EMBASE or Scopus searches. These results offer a compelling insight into the interplay between these databases.

[1] Mann M, Hood K, Trubey R, Powell C. A tale of two databases: a comparison of Embase versus Scopus. In: Challenges to evidence-based health care and Cochrane. Abstracts of the 24th Cochrane Colloquium; 2016 23-27 Oct; Seoul, Korea. John Wiley & Sons; 2016.

How was the RCT incorporated in this study along with other designs? Randomized clinical trials (RCT) addressing the association between problem-solving skills and suicide behaviors" RCT does not incorporate association. Use subheadings while reporting the results.

Answer: We acknowledge the distinct nature of observational studies and randomized controlled trials (RCTs), and we concur that they should be treated as separate entities when consolidating data. To address this valid concern, we have been diligent in our approach, ensuring that each study type receives the due attention it warrants. In the "Methodological Quality" subsection within the Methods section of our manuscript, we have clearly outlined our strategy. Specifically, we employed the Newcastle-Ottawa Scale (NOS) to assess the quality of observational studies and utilized the Delphi List to evaluate the quality of RCTs. Furthermore, we have taken into account the differentiation between the outcomes of observational studies and RCTs in our results. As a result, we have represented the results of observational studies in Figures 2 & 4 and RCTs in Figures 3 & 5. We deeply value your insights and have diligently addressed the issues raised to ensure the accuracy and clarity of our manuscript.

"Problem-solving skills" how this intervention was measured throughout the study?

Answer: In our study, the assessment of “problem-solving skills” was carried out through the utilization of dedicated questionnaires that have been developed and validated for the purpose of evaluating problem-solving abilities. These questionnaires have been widely recognized and accepted within the field as reliable tools for assessing the proficiency of individuals in problem-solving. We addressed this matter by incorporating an explanatory note at the outset of the Methods section to provide clarification. Additionally, a comprehensive listing of these questionnaires is available in Table 1 for reference.

Inclusion and exclusion are missing.

Answer: The inclusion and exclusion criteria for our meta-analysis were defined using the PICOS framework, which encompasses Population, Intervention/Exposure, Comparison, Outcome, and Study design characteristics. These criteria were systematically applied to identify relevant studies for our analysis. We incorporated these criteria at the outset of the Methods section to provide a clear understanding of our study's criteria for study selection.

“Control: In cases where studies categorized problem-solving skills, we examined the possibility of suicidal behaviors in individuals with high problem-solving skills compared to those with low problem solving skills as a control group.” What does it mean? Specify who is the comparator. If the intervention is problem-solving skills then the comparator should be something else, maybe not having the skill.

Answer: Certainly, I appreciate your feedback. In our study, we adopted two distinct approaches to investigate the association between problem-solving skills and suicidal behaviors.

Firstly, in cases where studies categorized individuals based on their problem-solving skills (high vs. low), we examined the odds of suicidal behaviors in those with high problem-solving skills compared to those with low problem-solving skills (reference group). This allowed us to assess the impact of varying problem-solving skill levels on suicidal behaviors.

Secondly, we encountered studies that measured the mean problem-solving skill scores among individuals with and without suicidal behaviors. In these cases, we calculated the standardized mean difference (SMD) of the problem-solving skill scores between these two groups. This approach enabled us to explore the magnitude of difference in problem-solving abilities between individuals exhibiting suicidal behaviors and those who did not.

To present these distinct analyses accurately, we reported the pooled odds ratios for the first approach and the SMD values for the second approach separately. By employing these two different methodologies, we aimed to comprehensively capture the relationship between problem-solving skills and suicidal behaviors, providing a more nuanced understanding of their interplay. We clarified these points further in revised manuscript for better clarity and transparency.

“In cases where studies reported the mean score of problem-solving skills, we examined the standard mean difference between those with and without suicidal behaviors.” SMD of which groups? Does it a suicidal idea vs no suicidal ideation? If yes, then I think, it is a serious gap in the planning.

Answer: Thank you for your feedback. We have taken your current comments into consideration and addressed the concerns raised in response to your previous comment. We are committed to ensuring the clarity and accuracy of our manuscript, and we have incorporated the suggestions and considerations discussed earlier. We appreciate your guidance and are dedicated to producing a thorough and well-structured manuscript that adheres to the highest standards of research integrity.

Cross-sectional study and RCT cannot be pooled in same study and should have followed different tools for doing the risk of bias and certainty of the evidence. Meta-analysis should not be pooling apple and orange.

Answer: We appreciate the editor's observation. We completely understand the importance of maintaining methodological rigor when conducting a meta-analysis. We agree that observational studies and randomized controlled trials (RCTs) are distinct in nature and should be treated as separate entities when pooling data. To address this concern, we would like to highlight that we were meticulous in our approach to ensure that each study type received appropriate attention. Specifically, under the "Methodological Quality" subsection in the Methods section of our manuscript, we clearly delineated our approach. For observational studies, we employed the Newcastle-Ottawa Scale (NOS) to assess their quality, while for RCTs, we used the Delphi List to evaluate their quality. This approach enabled us to rigorously evaluate the risk of bias and the certainty of evidence for each study type, ensuring that the distinct characteristics of observational studies and RCTs were appropriately considered. Certainly, we recognize the importance of maintaining a clear distinction between the results of observational studies and RCTs within our figures. To address this, the results of observational studies are depicted separately in Figures 2 & 4 and that of and RCTs in Figures 3 and 5.

“This meta-analysis was conducted to determine to what extent problem-solving skills can prevent suicidal behaviors”. If this is the objective of this review and then I think this review failed to achieve the objective.

Answer: Thank you for your feedback. We appreciate your insights, and we have carefully considered your comments. In response to your concern, we have revised the objective of the meta-analysis to ensure clarity and alignment with the study's findings. The modified objective now reads: “This meta-analysis was conducted to assess the association between problem-solving skills and suicidal behaviors and elucidate the potential role of problem-solving skills in influencing the occurrence of suicidal behaviors.”

We believe that this modified objective better captures the focus and outcomes of our study, and we are grateful for your input in refining our work.

Attachments
Attachment
Submitted filename: Response to Reviewers.docx
Decision Letter - Humayun Kabir, Editor

PONE-D-23-15949R2The role of problem-solving skills in the prevention of suicidal behaviors: A systematic review and meta-analysisPLOS ONE

Dear Dr. Poorolajal,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Nov 02 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Humayun Kabir

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #3: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #3: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #3: Thanks for giving me the opportunity to review this manuscript. After careful revision of this manuscript, I suggest the following minor edits -

1. Methods: the heterogeneity and publication bias section should be reported below the Data synthesis section.

2. Authors are suggested to report the detailed risk of bias assessment in the supplementary file.

3. The recommendation section should be merged with the discussion section without mentioning the heading "Recommendation"

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #3: Yes: Saifur Rahman Chowdhury

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 3

Reviewer #3

Thanks for giving me the opportunity to review this manuscript. After careful revision of this manuscript, I suggest the following minor edits.

1. Methods: the heterogeneity and publication bias section should be reported below the Data synthesis section.

Response: Thank you for your valuable feedback and for your careful review of our manuscript. We have carefully considered your suggestion regarding the placement of the "Heterogeneity and publication bias" section in our manuscript. Following your recommendation, we have moved this section below the "Data synthesis" section to enhance the logical flow and organization of our paper.

2. Authors are suggested to report the detailed risk of bias assessment in the supplementary file.

Response: Regarding your suggestion to report the detailed risk of bias assessment in the supplementary file, we have taken this recommendation into account. We have included a comprehensive risk of bias assessment in the supplementary material, providing a detailed and transparent account of our evaluation process.

3. The recommendation section should be merged with the discussion section without mentioning the heading "Recommendation"

Response: In accordance with your recommendation, we have removed the heading "Recommendation" and integrated the content seamlessly into the broader "Discussion" section.

Attachments
Attachment
Submitted filename: Response to Reviewers.docx
Decision Letter - Humayun Kabir, Editor

The role of problem-solving skills in the prevention of suicidal behaviors: A systematic review and meta-analysis

PONE-D-23-15949R3

Dear Dr. Poorolajal,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Humayun Kabir

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #3: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: (No Response)

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: (No Response)

Reviewer #3: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: (No Response)

Reviewer #3: (No Response)

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: (No Response)

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #3: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #3: No

**********

Formally Accepted
Acceptance Letter - Humayun Kabir, Editor

PONE-D-23-15949R3

The role of problem-solving skills in the prevention of suicidal behaviors: A systematic review and meta-analysis

Dear Dr. Poorolajal:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Humayun Kabir

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .