Peer Review History
| Original SubmissionJune 7, 2020 |
|---|
|
PONE-D-20-17299 Individual response to antidepressants for depression in adults - a meta-analysis and simulation study PLOS ONE Dear Dr. Munkholm, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. First I would like to thank the 2 reviewers for their important insights. Thank you also for being so fast. Then I would like to congratulate your for this nice piece of work. I really appreciate that it was registered a priori and that all the material needed to reproduce the results is transparently being shared. Please respond to all the reviewer's comments, and add a few words in your discussion about the overlap between you study and the two others, including some work about the overlap in terms of included studies and its possible implications. Please submit your revised manuscript by Aug 28 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols We look forward to receiving your revised manuscript. Kind regards, Florian Naudet, M.D., M.P.H., Ph.D. Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. We noted in your submission details that a portion of your manuscript may have been presented or published elsewhere. "An earlier version of the manuscript has been previously published as a preprint in Psyarxiv (doi: 10.31234/osf.io/m4aqc). The present manuscript is not currently under for publication by any other journal and has not been published in any other form elsewhere." Please clarify whether this publication was peer-reviewed and formally published. If this work was previously peer-reviewed and published, in the cover letter please provide the reason that this work does not constitute dual publication and should be included in the current manuscript. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: This is a well written and timely study. Although the research question was previously addressed by two other groups (Volkmann et al; Plöderl and Hengartner) I think this study is important as, first, it adds an insightful simulation analysis, and second, consistently replicates the findings of the previous studies. Having that said, I want to declare that I am one of the authors of these studies (M. Hengartner). I have a few suggestions: The authors may want to add on page 5 that the search for biomarkers and clinical predictors of differential treatment response has consistently failed thus far, which is clearly at odds with the prevailing belief that patients respond differently to antidepressants. Given that equal variance ratios do not exclude the possibility that treatment effect heterogeneity exists, as the authors also rightly state in the discussion, the lack of robust treatment effect modifiers, despite decades of research and millions spend on the search for it, speaks volumes in my opinion. The persistent claim that differential treatment response exists should be supported by evidence. Given that there is no consistent evidence for this claim, it would be more sensible to assume that there is no treatment effect heterogeneity, unless proven otherwise. That so many people firmly stick to this view probably indicates that most researchers and physicians conflate observed treatment outcomes with treatment effects. The study by Maslej et al (ref 36) was retracted after we pointed out in a letter to the editor that their analysis was flawed. See the retraction note here (https://jamanetwork.com/journals/jamapsychiatry/fullarticle/2767242) and our letter to the editor here (https://www.researchgate.net/publication/342083346_Commentary_on_Maslej_et_al_No_evidence_of_individual_differences_in_response_to_antidepressants). This reference thus needs to be removed. The authors claim that Volkmann et al as well as Plöderl and Hengartner did not address important methodological issues. I assume that they refer to the simulation study included in their manuscript. If so, they should specify. Otherwise, I don’t really see which methodological issues Munkholm et al addressed that were not addressed in the other two studies. In fact, in my view Volkmann et al. addressed various methodological issues that Munkholm et al. did not consider. For instance, Volkmann et al. empirically addressed the important question, why the VR is the more appropriate method than the CVR, which was erroneously applied in the now retracted paper by Maslej et al. Volkmann et al also empirically tested, how likely treatment-by-patient interaction would be if VR=1. Shortly after publication of our analysis (Plöderl and Hengartner), we were attacked by Fredrik Hieronymus on Twitter that our study, and by consequence also the present study by Munkholm et al., was severely flawed as it was based on trial-level data instead of individual-patient data. A few days ago, Hieronymus et al now published their own analysis based in IPD data (“Individual variability in treatment response to antidepressants in major depression: comparing trial-level and patient-level analyses”; Acta Psychiatrica Scandinavica, doi: 10.1111/ACPS.13205). To be honest, I don’t really know what to make of the Hieronymus study, as their methodological approach seems rather arbitrary and was not prespecified in a protocol. They corrected the placebo endpoint scores to match the mean scores in the active group and then compared the two distributions with a Kolmogorov-Smirnov test, which, as is well established, will almost always yield a statistically significant result when sample size is large. I also wonder how valid it is to artificially change the placebo endpoint scores, as there is no clear rational, what endpoint score an individual placebo recipient would have achieved had he/she received the antidepressant. The approach chosen by Hieronymus et al is just one possible option among many, and a different approach of course would have produced a different distribution. In any case, I suggest Munkholm et al. have a critical look at this paper and comment on it in the manuscript. On page 17 the authors discuss in detail the CVR. They make legitimate points, but in my view the main issue why the CVR is inappropriate is the assumption of linear association between the natural logarithm of the mean and the natural logarithm of the standard deviation with a slope coefficient of 1. As comprehensively shown by Volkmann et al., this assumption is severely violated, since the slope coefficient is only about 0.1. The VR assumes a slope coefficient of 0, thus has a much better fit to the data than the CVR. This should be added to the text. Reviewer #2: In the manuscript “Individual response to antidepressants for depression in adults - a meta-analysis and simulation study”, Munkholm et al. conducted a simulation study and inverse variance random-effects meta-analysis in order to compare the outcome variance in patients receiving antidepressants with the outcome variance in patients receiving placebo in randomized controlled trials of adults with major depressive disorder, as an indicator of individual differences in response to antidepressants. The authors found that there were no differences in variability ratios between across antidepressant vs. placebo comparisons, a result that indicates that the null hypothesis of equal variances cannot be rejected. In the opinion of this reviewer, the authors’ description of methods and results are comprehensive and the paper as a whole a strong contribution to the literature. The research has many strong points, such as: a) a pre-registered protocol, b) the use of a comprehensive dataset from which 222 studies comparing antidepressants vs placebo were extracted, c) all data and code are openly shared on the Open Science Framework, d) the use of relative variability as an indicator for treatment-by-patient interaction, e) conducting a simulation study to investigate possible components of variation in randomized controlled trials and, many more. The results of the simulation study are especially informative. On a final note, although the database that was used both for informing the simulation study and to conduct the meta-analysis is comprehensive and encompasses many trials, the search for RCTs ended in 2016. As a personal curiosity, although it is clearly stated in the protocol that no supplementary data would be used, it would be very interesting how the results would change if the authors actualized the search for the period 2016-2020 and integrated those results also. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: Yes: Michael P. Hengartner Reviewer #2: Yes: Liviu-Andrei Fodor [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
Individual response to antidepressants for depression in adults - a meta-analysis and simulation study PONE-D-20-17299R1 Dear Dr. Munkholm, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Florian Naudet, M.D., M.P.H., Ph.D. Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: (No Response) ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: Yes: Michael P. Hengartner |
| Formally Accepted |
|
PONE-D-20-17299R1 Individual response to antidepressants for depression in adults - a meta-analysis and simulation study Dear Dr. Munkholm: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Pr. Florian Naudet Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .