Peer Review History
| Original SubmissionNovember 7, 2022 |
|---|
|
PONE-D-22-30246Patterns of brain degeneration in early-stage relapsing-remitting multiple sclerosisPLOS ONE Dear Dr. Meijboom, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. As you will see, both Reviewers have major concerns regarding several methodological aspects of your study. There is a substantial amount of work to address these issues but all appear to be doable. Please submit your revised manuscript by Mar 12 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Niels Bergsland Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. Thank you for stating the following in the Acknowledgments Section of your manuscript: "Additional funding for authors came from the MS Society Edinburgh Centre for MS Research (grant reference 133; RM, AK), Chief Scientist Office – SPRINT MND/MS program (ENY), Anne Rowling Regenerative Neurology Clinic (ENY), NHS Lothian Research and Development Office (MJT), the Row Fogo Charitable Trust (grant reference BROD.FID3668413; MVH), and the UK Dementia Research Institute (SC), which receives its funding from UK DRI Ltd, funded by the UK Medical Research Council, Alzheimer’s Society and Alzheimer’s Research UK. Additional funding for the Edinburgh university 3T MRI Research scanner in RIE is funded by the Wellcome Trust (104916/Z/14/Z), Dunhill Trust (R380R/1114), Edinburgh and Lothians Health Foundation (2012/17), Muir Maxwell Research Fund, Edinburgh Imaging, and University of Edinburgh." We note that you have provided additional information within the Acknowledgements Section that is not currently declared in your Funding Statement. Please note that funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows: "With thanks to FutureMS, hosted by Precision Medicine Scotland Innovation Centre (PMS-IC) and funded by a grant from the Chief Scientist Office, Scotland, to PMS-IC and Biogen Idec Ltd Insurance (combined funding under reference Exemplar SMS_IC010). Additional funding for authors came from the MS Society Edinburgh Centre for MS Research (grant reference 133; RM, AK), Chief Scientist Office – SPRINT MND/MS program (ENY), Anne Rowling Regenerative Neurology Clinic (ENY), NHS Lothian Research and Development Office (MJT), the Row Fogo Charitable Trust (grant reference BROD.FID3668413; MVH), and the UK Dementia Research Institute (SC), which receives its funding from UK DRI Ltd, funded by the UK Medical Research Council, Alzheimer’s Society and Alzheimer’s Research UK. Additional funding for the Edinburgh university 3T MRI Research scanner in RIE is funded by the Wellcome Trust (104916/Z/14/Z), Dunhill Trust (R380R/1114), Edinburgh and Lothians Health Foundation (2012/17), Muir Maxwell Research Fund, Edinburgh Imaging, and University of Edinburgh. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript." Please include your amended statements within your cover letter; we will change the online submission form on your behalf. 3.We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. In your revised cover letter, please address the following prompts: a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent. b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. We will update your Data Availability statement on your behalf to reflect the information you provide 4. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Partly Reviewer #2: Partly ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: No Reviewer #2: No ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: Meijboom et al. performed an MRI evaluation of short-term atrophy progression over 1 year of follow-up in newly diagnosed relapsing-remitting MS patients using established segmentation methods. They showed widespread GM and NAWM atrophy occurring in the brainstem, cerebellar GM, and subcortical and occipital-temporal regions, which is in line with previous studies performed in this field. However, I do have several concerns mainly regarding the methodological aspects of this study. - Page 4, line 62-63: “There is currently no cure for MS and treatments targeting the neurodegenerative aspects of MS are limited.”; page 4, line 72-73 “However, these appear to have only a limited effect on reducing associated neurodegenerative processes”. These two sentences contain - more or less - the same statement. The authors should consider rephrasing. - Page 4, line 100: “This allows for identification of brain areas specifically affected by neurodegeneration”. This is not entirely true in my point of view. In view of the population studied and the time points (directly after MS diagnosis) selected by the investigators, changes in regional CNS volumes can be influenced by several factors, including inflammation and DMTs (see also next comments). Authors should consider rephrasing. - In general, the introduction could better highlight the points, that have not been addressed so far by previous studies, as well as how this study aims to fill these knowledge gaps. The aims of this study with regard to these knowledge gaps should be also stated more concretely. - Page 5, line 107. “Exclusion criteria were intake of DMTs prescribed prior to baseline assessment”. Please explain the rationale for this decision. - In my point of view the selected time points in this study pose a major methodological issue for this work. The investigators included only treatment naive patients at baseline. Then, during the observation time the majority of patients received DMT for the first time (as shown in table 2). DMTs have a significant effect on CNS volumetric measurements, especially in patients with significant ongoing inflammation as the patient population included in this work (recruited directly after a relapse leading to the diagnosis), as demonstrated in previous clinical trials in MS; as these immunomodulatory agents begin to reduce inflammatory activity in the CNS, they lead to an accelerated reduction of brain volumes, which is not thought to be related to neurodegeneration, also known as pseudoatrophy. Thus, the observed temporal differences between time points might well be due to a process not related to neurodegeneration, as the investigators claim, which is also the primary aim of this study. In addition, the authors do not mention how many patients started each DMT agent. High efficacy DMT could have produced a larger pseudoatrophy effect. Even though the investigators show no differences in volume changes over time between treated and untreated patients, selection bias is introduced in this analysis, since patients with a more severe clinical course are most likely to be treated and to receive higher-efficacy DMT. - As the authors also state in the study limitations, the absence of a control group to compare temporal volumetric changes is an important limitation in this study. Volumetric changes do take place due to “healthy” aging, are accelerated in older subjects and cannot be easily disentangled from MS-related neurodegeneration without a control group, especially in the way the investigators conducted their analysis (i.e. longitudinal voxel-based morphometry). Did the authors enter the interaction term between baseline age and follow-up time in their statistical models in order to at least account for the aging effect during the observation period? If not, it could be that a part of the results regarding volume reduction across different CNS studies is to be ascribed to aging and not ongoing MS-pathology. - Page 10, line 196-197: “WML volume change was added as a covariate to correct for GM and WM volume changes induced by expanding neuroinflammation”. WML can also shrink (e.g. as a result of remyelination). In addition, changes in WML volumes can also be influenced by factors other than neuroinflammation. The authors should consider rephrasing. - Table 2, Supplementary Tables 2-4: the regression coefficients are displayed in absolute volumes, which are hard to interpret. The authors should consider a presentation of their results in way that allows for better understanding from the reader (e.g. percentages). - The authors are sometimes vague regarding their results. For instance: Page 13, lines 252-253: “Site and WML change were significant for some regions…”. These results should be also at least briefly summed up. The authors cannot expect the reader to go through several pages of tables to identify the study results. - What was the rational for conducting both voxel-based morphometry and FreeSurfer segmentation and corresponding analysis. The authors also state (page 16, line 298-299): “In addition, the effects of different imaging analysis approaches were compared.” and (page 16, line 311-313): However, overall, fewer regions of GM change were observed than with the volumetric approach, particularly in the parietal and frontal lobes, without prominent hemispheric differences.” How do the authors interpret this? - The authors state (page 3, line 52-54): “Atrophy measures targeted to these most severely affected regions may be more sensitive and specific than whole-brain atrophy as imaging stratifiers and endpoints for clinical decision making and therapeutic trials.” However, the analysis of imaging data conducted in this study does not allow for identification of the most severely affected brain regions, but rather highlight, which regions are affected (even minimally). In order to pinpoint “hot spots” of brain atrophy, a comparison of volumetric changes over time between brain regions should have been conducted. I believe this study could profit from the addition of such an analysis. Reviewer #2: The current work aims to investigate regional patterns of neurodegeneration in RRMS and compare standard volumetry with a voxel-based morphometry approach. The presented work is interesting, but not very novel as regional patterns of neurodegeneration have been investigated before. One major concern about this work is that a lot of atrophy was found within only 1 year. In this early phase of MS neurodegeneration is expected to be mild, especially within this short time period. Methodologically, the results could have been influenced by (the resolution of) neuroinflammation. In fact, 2/3 of the cohort started DMT during the assessed year, so the large ‘atrophy’ found could have been pseudo-atrophy. Finally, although the concept is certainly of interest, the pipeline is rather simple and requires major improvements, including the use of lesion filling and using the same segmentation method for the volumetric and VBM approach. Abstract • Provide some information on the demographics of the cohort, how “early-stage” is the RRMS population? Introduction • In general the introduction is not very well structured, for example the effect of DMT on neurodegenerative processes is mentioned in both first and second part, try to integrate this. • It is not very relevant to note in the first part that MS prevalence is particularly high in Scotland, this does not lead up to this particular study (which is on disease severity, not prevalence, and does not compare findings with other regions). • “Less regional detail appears to be known about macrostructural WM volume”, rephrase? This is vague. • It is not introduced why it would be relevant to look at regional NAWM loss. Methods • The intracranial volume (ICV) estimation based on manually edited brain masks is not a standard way to correct for head size. This should be replaced, for example by the ICV estimated by FreeSurfer (eTIV). • “The edited w0 intracranial image was registered to the w1 T1W image”. So a skull-stripped image was registered to an image with skull? This is not correct, images should both be skull-stripped. • The input for FreeSurfer should be lesion filled T1w images, subtracting WML masks from the tissue segmentations is not a correct method to do this, as this will not influence the original T1 images and the segmentation itself is already influenced by these lesions. Tissue segmentations are effected by presence of WML. Use a lesion filling approach on the T1w images and repeat the FreeSurfer analysis with the filled T1w images. • Not a logical choice to calculate the tissue masks using fslstats, partial volume effects are not taking into account this way. Freesurfer provides volume measures as output (stats/aseg.stats), so please use this for the tissue volumes. • Since WML masks were substracted from the tissue segmentations, the decrease in regional NAWM could be confounded by increasing lesion volumes. Repeat the analysis with total WM volumes instead of only NAWM. • The chosen WML segmentation method is not standardly used in the field. As such it is important to provide some more details why this was used with references of a validation study or use a more widely used method for this. • For the VBM analysis a different segmentation method was used compared with the volumetric analysis with FreeSurfer. In order to compare these approaches, the same segmentation method should be used, this could also explain the discrepancy in results. In addition, input for VBM pipeline should also be the lesion-filled T1w images. • Why was WML change included in the model and not the WML at w0 and w1? Now the WML change is considered a constant factor over time which is not the case. • “For each outcome variable, extreme outliers (>3 SD) as well as participants with missing data at either time point were excluded”. Since visual inspection was performed, it should not be necessary to remove extreme outliers from the data, since these then are not errors but actual findings. In addition, subjects with missing timepoints do not have to be removed, as mixed effects analysis can also deal with missing datapoints. • The abbreviation FDR is not introduced. • “A general linear model (GLM) design matrix was created with GM difference, age, sex, imaging site, DMT status at w1 and subject-specific WML mask as explanatory variables (EV).” “WMLs were included as EVs to ensure their exclusion from the GM images.” This is not an appropriate method to exclude WML from GM images, lesion filling should have been applied (see earlier comments). • Imputing missing DMT status with “yes” is not the preferred approach to deal with missing values in the mixed effects analysis, would be better to insert it as a missing value in the mixed effects analysis as the number of subjects with missing data is small. • “Results were reported for voxels at p<0.001 and family-wise error (FWR) corrected for multiple comparisons.” Which p-value was chosen as significant threshold for FWR? Results • Findings are interesting but as mentioned can be significantly affected by the lack of lesion filling and the induction of DMT, as well as methodological differences between the two pipelines. This impairs interpretation of the data currently. Moreover, healthy controls are not available so it’s not possible to compare found atrophy rates of MS with healthy controls. • No information given in methods how the FreeSurfer segmentation quality control was exactly performed. Also, would be better to harmonize the subjects included in the FreeSurfer analyses with the VBM analyses since you are aiming for a direct comparison of the methods. • Table 2: Provide numbers how many patients were on which DMT. also provide baseline whole brain and GM volumes. Was the WML volume between w0 and w1 significantly different? Please statistically test this. • As mentioned, a large number of patients started DMT between w0 and w1, especially for high efficacy DMT’s it’s known that this can cause pseudo-atrophy in the first year. Please take this into account in the analysis or describe how you deal with this confounding effect. • Table 3: not clear if presented p-values were corrected or not, if not, please provide corrected p-values (q-values). • Since the aim of the paper is to compare the volumetric and VBM approach, it would be helpful to provide a table/figure comparing the regions found by both approaches. It will be rather hard for the reader now to see the overlap between the two approaches since figure 3 does not include subcortical areas. Discussion • Discussion is a bit generic but overall ok. The discussion could be improved by adding which atrophy rates you would expect for the different brain regions based on earlier studies and if the found atrophy rates are in line with that. Especially in terms of the relatively short follow-up of 1 year and early stage of the disease, reflect if your results are in line with literature. • What is cortical NAWM? • It is important to discuss in more detail why you think the volumetric approach found more atrophic regions compared with the VBM approach. This is not expected, how do you interpret and justify this difference? • “Surprisingly, we also did not detect volumetric changes within areas in the frontal lobe associated with sensorimotor functioning.” Explain in more detail why you expected this, is the other early MS cohort that found this comparable to yours in terms of disease duration and disability? • Do you have any recommendations which method should be used/is best to assess regional atrophy? What are the main advantages/disadvantages of both methods? Conclusion • “Atrophy measures targeted to the most affected regions may provide more sensitive and specific markers of neurodegeneration, as imaging stratifiers of disease progression and endpoints for future therapeutic trials.” Regional measures being more sensitive biomarkers than global ones has not been discussed in the discussion and has not been tested in this study. • “Analyses based on volumetry and VBM demonstrate different patterns of atrophy, albeit with some regional overlap.” Clarify which regions were most affected according to both analyses and what the differences where. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: Yes: Charidimos Tsagkas Reviewer #2: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
Patterns of brain atrophy in recently-diagnosed relapsing-remitting multiple sclerosis PONE-D-22-30246R1 Dear Dr. Meijboom, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Niels Bergsland Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: |
| Formally Accepted |
|
PONE-D-22-30246R1 Patterns of brain atrophy in recently-diagnosed relapsing-remitting multiple sclerosis Dear Dr. Meijboom: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Niels Bergsland Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .