Citation: Wigman J, van Os J, Wichers M (2016) Comment on Re-Analysis of Data by Terluin, de Boer and de Vet. PLoS ONE 11(11): e0162329. https://doi.org/10.1371/journal.pone.0162329
Editor: Ruud van Winkel, Katholieke Universiteit Leuven, BELGIUM
Received: May 13, 2016; Accepted: August 22, 2016; Published: November 23, 2016
Copyright: © 2016 Wigman et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: JW was funded by a Netherlands Organization for Scientific Research (NWO)-Veni Grant (016.156.019).
Competing interests: The authors of the current comment are also the authors of the original paper that was discussed in the disputing article by Terluin, de Boer and de Vet.
The disputing paper by Terluin, de Boer and de Vet  that was based on re-analysis of our data presents conclusions that contrast with the findings in our original paper. Their paper raises several important points that are relevant not only for our study but for the field at large. The problem they raise is that of unequal variances in the subgroups due to skewness of the data. This point is indeed important and was not addressed appropriately in our original paper. As Terluin and colleagues reported, the variances of the ESM variables increased with increasing severity groups, which we had not inspected in the original work. We agree that, given these new insights, it cannot be ruled out that differences in variance may account for between-group differences in connection strength.
Based on Terluin et al.’s results, it can thus be stated that our conclusions have “not been unequivocally confirmed”. However, it should be kept in mind that (i) although they tried to replicate our analyses as closely as possible, they took several ad hoc steps during their analysis process (e.g. grand mean centering; rescaling the scores) making it difficult to directly compare their results to our original results and to results that might have been obtained with other sets of preprocessing steps/analytic choices; and (ii) they focused only on our conclusions regarding staging but not regarding profiling. Based on this, we argue that our conclusions are not unequivocally disconfirmed either. Moreover, the ideas put forward in our original paper have been valuable as first steps into the field of longitudinal mental-state network modelling.
We agree with the authors on the importance of using appropriate methods in psychological research and acknowledge that, in retrospect, some of the analytic choices we made at the time of the original work were not optimal. However, it should be noted that the original article, published in 2013 , was pioneering work regarding the empirical testing of longitudinal dynamic networks in psychopathology. At the moment of publication, the use of multilevel time-lagged analyses in the context of network theory was quite still novel and analytic techniques and strategies were still being developed and optimized. Research is ever a process of working to the best of one’s knowledge, only to find out later that better, more optimal or improved methods exist.
Most psychopathology research in general population samples faces the problems of non-normally distributed measures and unequal variances across subgroups. The data in our original study form an illustrative example of these issues but are, however, by no means unique for the field. As such, we agree with the authors that the issue of unequal variance needs proper attention in all future psychopathology research.
- Conceptualization: JW JO MW.
- Writing – original draft: JW JO MW.
- Writing – review & editing: JW JO MW.
- 1. Terluin B, de Boer MR, de Vet HCW. Differences in Connection Strength Between Mental Symptoms Might Be Explained By Differences in Variance: Reanalysis of Network Data Did Not Confirm Staging. PLoS ONE. 2016 (doi pone.0155205).
- 2. Wigman JTW, van Os J, Thierry E, Derom C, Collip D, Jacobs N et al (2013). Psychiatric diagnosis revisited: Towards a system of staging and profiling combining nomothetic and idiographic parameters of momentary mental states. PLoS One 8(3): e59559. pmid:23555706