Peer Review History
| Original SubmissionFebruary 10, 2021 |
|---|
|
PONE-D-21-04597 Validity and reliability of the Polish version of the Self-Compassion Scale and its correlates PLOS ONE Dear Dr. Kocur, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript by Jan 15 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Frantisek Sudzina Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. Please note that PLOS ONE does not copy edit accepted manuscripts (https://journals.plos.org/plosone/s/criteria-for-publication#loc-5). To that effect, please ensure that your submission is free of typos and grammatical errors. 3. Your ethics statement should only appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please move it to the Methods section and delete it from any other section. Please ensure that your ethics statement is included in your manuscript, as the ethics statement entered into the online submission form will not be published alongside your manuscript. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Partly Reviewer #2: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: No Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: No Reviewer #2: No ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: Journal: PLOS ONE Manuscript ID: PONE-D-21-04597 Full title: Validity and reliability of the Polish version of the Self-Compassion Scale and its correlates The present paper, in two studies, reported the validation of the Polish version of the Self-Compassion Scale which encompassed: (1) testing its factor structure using confirmatory factor analytic (CFA) and exploratory structural equation modeling (ESEM) models; (2) calculating alternative reliability indices; (3) establishing its construct validity in relation to personality traits, self-judgment, depressive symptoms, trait anxiety, life satisfaction and emotional intelligence. Overall, I believe that the present work has its merits as it tackles an important question. At the same time, I had some questions regarding the theoretical foundations and the conducted analyses while reading the manuscript that might be helpful. Since there are two alternative approaches to how self-compassion should be understood (Neff with the notion that self-compassion is best represented by one global factor, and Gilbert with the notion that self-compassion is best represented by two global factors), the authors should emphasize that their paper (and the SCS) follows Neff’s operationalization of self-compassion. The Introduction contains some repetition: the authors first talk about self-compassion and its correlates on page 3 but then bring up roughly the same idea on page 8-9. These two parts could be merged to shorten the Introduction. While the authors did a good job in presenting the competing views on self-compassion, I feel this could be done in a more balanced way. Currently, the two-factor representation gets more discussion. I would suggest the authors to incorporate the recent work of Neff (2019, 2020). The description of the SCS appears to be missing. It is unclear why the authors tested gender differences. What is the importance of these tests? Is there a theoretical reason for conducting them? While it seems that the authors followed the analytic plan outlined by Neff et al. (2019), they also do not seem to follow it closely. For example, there is no word on whether bifactor models (including on or two global factors) which is an important part of this study and the whole discussion on the most optimal representation of self-compassion. The various omega indices appear to be mixed up. Although it is true that all are derivatives of McDonald’s original work, the equation of the original omega index (let’s call it composite reliability [CR] for the sake of simplicity) is different from the equation of the omega and omega hierarchical indices that have specifically been developed for bifactor models. This is because they refer to different aspects of reliability: CR refers to the actual reliability of a scale (akin to Cronbach’s alpha), while the other two refer to the amount of reliable variance attributed to the various factors. I suggest the authors to consult the work of McDonald (1970) as well as Rodriguez et al. (2016). When describing the alternative factor solutions, the authors spend way too much time on the improper solutions. Given the length of the paper, I would suggest to simply report all fit indices in a table, then quickly move to the comparison of the most adequate solutions. Again, consult with Neff et al. (2019) on the structure of how to report these models in a concise manner, and which aspects of the models (factor loadings, cross-loadings, factor correlations) to report. That is, the authors should first focus on the comparison of the first-order solutions, retain one. With the bifactor models, first test whether one or two global factors should be incorporated (focus on the definition of the global factors and the correlations between the two global factors), retain one of the bifactor models and compare this bifactor model to its first-order counterpart. According to APA guidelines, it is redundant to present detailed results both in tables/figures and in the text. Factor loading tables: add significance values to all factor loadings instead of using italics, there is plenty of space left. The degrees of freedoms of the single-bifactor model (unclear if CFA- or ESEM-based model) reported in Study 2 do not match the degrees of freedoms in Study 1 which means that different models were estimated. This gives me a lot of concern about the results. Where is the limitations section? There are a few sections in the paper which are not presented in their correct location. For example, the authors should not talk about prior ESEM-based studies and results in the Analyses section. Similarly, the authors should not talk about the ethical aspects of their study in the Present Study section. Finally, there are a fair few typos and unusual sentence structures throughout the manuscript which made it difficult to understand parts of the manuscript. Thus, I would suggest the authors to ask a colleague (whose native language is English) to read the paper before submission. References used in this review: McDonald, R. P. (1970). Theoretical foundations of principal factor analysis, canonical factor analysis, and alpha factor analysis. British Journal of Mathematical and Statistical Psychology, 23, 1–21. Neff, K. D. (2019). Setting the record straight about the Self-Compassion Scale. Mindfulness, 10(1), 200-202. Neff, K. D. (2020). Commentary on Muris and Otgaar (2020): let the empirical evidence speak on the self-compassion scale. Mindfulness, 11, 1900-1909. Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016). Applying bifactor statistical indices in the evaluation of psychological measures. Journal of Personality Assessment, 98, 223-237. Reviewer #2: Overall, this paper does a good job of creating a Polish version of the SCS. Moreover, this paper (to the best of my knowledge) is the first to attempt to independently replicate Neff & Toth-Kiraly's findings with the SCS using bifactor ESEM analyses. For this reason, the paper makes an important contribution to the field. However, there are numerous problems with the write up of the paper that will need to be addressed before it can be published. Also, there are numerous grammatical errors in the paper, and the authors should have their paper carefully proof-read by a native English speaker before resubmission. Introduction The introduction to the paper focuses too much on the theoretical debate between whether or not the SCS should be used as two scores or one, and does not focus enough on psychometric issues. This is primarily a psychometric paper focused on validating the factor structure of the Polish SCS. The one versus two-factor debate should therefore be discussed primarily in terms of prior psychometric analyses using CFA that have found various factor solutions to the SCS. In particular, the authors need to discuss Neff's conceptualization of the components of self-compassion operating as a system and explain why she argues that bifactor ESEM is the best way to analyze multi-dimensional constructs that operate as a system. Rather than stating that the 20-sample Neff, Toth-Kiraly et al (2019) paper "stresses the legitimacy of using a six-factor SCS structure or the overall score..." as if it was a theoretical paper, the authors should describe the empirical findings of that study, particularly because the current paper uses the same methods. They should describe how the single bifactor ESEM model of one general factor and six specific factors had the best fit, and also how the two-correlated bifactor ESEM model of two general factors with three specific factors each (positive and negative) had a good fit but inadequate factors loadings indicating that the positive and negative factors could not be differentiated. They should also stress that ESEM outperformed CFA for the SCS, and that this makes sense theoretically given that self-compassion is conceptualized as a multi-dimensional construct. The long discussion of the link between self-compassion and mental health is not appropriate here and can be greatly reduced. The authors state "The aim of the study was to adapt the Self-Compassion Scale by Kristin Neff on the basis of the methodological guidelines and instructions obtained from the test’s author." Instead, the authors should state that they are using the procedures laid out in Neff, Toth-Kiraly et al (2019) and highlight the importance of their analyses being replicated independently. The authors should also give more general background on bifactor ESEM, either in the introduction or in the analyses section. Study 1 Methods The authors need to describe the SCS in their methods section, including how it is scored, sample items, and so on. The authors should indicate that negative items are reverse-coded so that they indicate the absence of self-judgment, isolation and overidentification. Analyses. The authors should mention that ESEM uses target rotation (Browne, 2001), making it possible to rely on ESEM in a confirmatory manner as it allows the researcher to have more a priori control over the expected factor structure by targeting the cross-loadings to be as close to zero as possible, mimicking the specification of CFA. Many people mistakenly assume ESEM is like EFA and cannot be used in a confirmatory manner. The authors need to state more clearly that they used bifactor analyses and explain what that method entails. They should also lay out why they test the particular models they do, including one general bifactor model versus two-correlated factor bifactor model, in line with Neff, Toth-Kiraly et al (2019). The authors need to provide the goodness of fit cutoffs they are using. Results The authors should not repeat findings in the text that are given in the tables. The tables can speak for themselves and can be referred to without repeating their content. Mean self-compassion scores in Table 6 should be calculated as they are by Neff in her recent papers - a mean is taken of each subscale and a grand mean is taken of the six subscales (after negative items are reverse-coded). Scores should be on a 5-point scale. It is not clear when the authors reverse scored items and when they did not. It appears that they are not reverse scored in Table 7 but they are in Table 6? This needs to be clear as it's confusing now. Study 2 The authors need to explain why they conducted a second study. Presumably it was to confirm the findings of Study 1 but they need to say so. Methods. The authors should state that they used the same version of the SCS as used in Study 1. Analyses. Why did the authors only use CFA and not ESEM? The authors should conduct the same analyses they conducted in Study 1 to see if they replicate in study 2. Also, given the excellent fit indices obtained I have a hard time believing that the authors used CFA and not ESEM. Please repeat all the analyses with study 2 as were done with study 1. Results can be put in the supplementary materials. Once again, the authors should not give results in both the text and tables. There is no reason to calculate correlations (Table 8) and regressions (Table 9). The authors should cut the regressions as they add no useful information over and above the correlations. Discussion The discussion should focus on the purpose of the paper, to create a valid Polish translation of the SCS. The authors should also highlight the fact that they independently replicated the findings of Neff, Toth-Kiraly et al. Finally, the authors should highlight the fact that their data confirms that a two-factor solution to the SCS is not valid whereas a single general factor and six specific factors is valid. The authors appear to be confused about what constitutes psychometric validity for a scale. Strangely, they state: "Perhaps the division into self-compassion and self-coldness is more legitimate in the clinical groups. Many studies confirm the legitimacy of two-factor analysis, pointing to the significant role of self-coldness precisely among individuals experiencing disorders or difficulties in the psychological area (e.g. 17) , individuals experiencing other health problems (20) , or in the general population as a significant predictor of depressive symptoms (34)." Of the studies they cite, only Costa (17) was actually a psychometric study. However, Costa used a two-factor CFA, an approach which the authors found was inadequate with their own data. Instead of saying it was legitimate because it was a clinical sample, the authors should instead point out the inadequacy of using CFA, and the superiority of the ESEM bifactor approach. Their findings clearly show that a two-factor solution is not psychometrically valid (using either CFA or bifactor ESEM), and clinical populations have nothing to do with it (the same results that the authors obtained were also obtained with clinical samples by Neff, Toth-Kiraly et al, 2019). The studies which find that the negative subscales of the SCS (often termed coldness) predict depression and other negative outcomes more powerfully than the positive subscales (which can be termed warmth) does not "confirm the legitimacy of two-factor analysis." Instead, all these studies do is show that warmth and coldness predict outcomes differently. No sane person would say that because coldness predicts hand numbness more than warmth, that warmth and coldness must be measured separately. This is especially because warmth reduces coldness, just as compassionate self-responding reduces uncompassionate self-responding. They operate in tandem as a system, as clearly laid out by Neff, 2020. There is no known psychometric principle which states that the subscales of a multidimensional measure need to demonstrate the same strength of relationship with outcomes in order to justify use of a total score. The authors should rewrite this section or else drop it. The authors should only present their data on the SCS and their other outcome variables such as personality or self-esteem as it relates to the validation of the Polish translation of the SCS, and not discuss findings independently of this context. The authors state "Research by Charzyńska, Kocur, Działach, & Brenner (88) , carried out also on a Polish sample (but a different one), demonstrated the validity of analysing a two-factor model." The Charzynska paper did not demonstrate the validity of analyzing a two factor-model. It was not a psychometric paper. All that paper did was demonstrate that warmth and coldness have different associations with outcomes, which has nothing to do with the validity of a general factor versus two factors. If that study used the same translation of the Polish SCS used in this study, the authors instead need to clearly point out that the results of that study should be reconsidered because it used a two-factor solution to the SCS, which was shown to be psychometrically invalid in the current study. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
Validity and reliability of the Polish version of the Self-Compassion Scale and its correlates PONE-D-21-04597R1 Dear Dr. Kocur, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Frantisek Sudzina Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: |
| Formally Accepted |
|
PONE-D-21-04597R1 Validity and reliability of the Polish version of the Self-Compassion Scale and its correlates Dear Dr. Kocur: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Frantisek Sudzina Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .