Peer Review History
| Original SubmissionJuly 11, 2020 |
|---|
|
PONE-D-20-21528 In silico immune infiltration profiling combined with functional enrichment analysis reveals the specific role of naive B cells as a trigger for severe immune responses in the lungs of COVID-19 patients PLOS ONE Dear Dr. Chiu, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. The study is a very timely contribution by the authors to elucidate the etiology of lung damage in COVID-19 patients. In general, the manuscript is well written. The Reviewers and the Editor agree that this is an exciting study. We believe, addressing the Reviewer’s comments will significantly strengthen the manuscript. Please submit your revised manuscript by Oct 22 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols We look forward to receiving your revised manuscript. Kind regards, Mrinmoy Sanyal, PhD Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Partly Reviewer #2: Partly ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: No Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: Wu et al. employed CIBERSORT method to investigate common and differences in the level of immune cell infiltration in lung tissues of COVID-19 patients compared with patients of Idiopathic Pulmonary Fibrosis (IPF). They determined that several immune cell sub-types, particularly naive B-cells, are highly infiltrated in COVID-19 patients. Besides that they reported several other important findings using CIBERSORT and gene set enrichment based analysis (Figs 2-6). Overall this is an interesting study. However, the study is suffering from lack of validation results. Authors have stated this limitation and addressed this major issue only by indicating that in the midst of COVID-19 pandemic, they are eager to provide this data that can be used for interpretation or to increase confidence in COVID-19 treatment. Although rapid data generation is a critical step during this pandemic situation; however, ideally we should not compromise with reproducibility, scientific rigor, and quality of the data. Major comments ============= 1. It is understandable that the experimental validation of the major prediction results reported in this manuscript is a time consuming task; however, some levels of validation are required to determine the quality of the reported prediction results. Authors are suggested to evaluate single cell RNA-seq data and investigate whether the prediction results they obtained from the bulk RNA-seq data using the tool CIBERSORT are reproducible in the actual single cell resolution. A quick pubmed search shows, recently Liao et al. (Nature Medicine, May 2020; https://doi.org/10.1038/s41591-020-0901-9) published single cell landscape of bronchoalveolar immune cells extracted from moderate to sever patients with COVID-19 and healthy control and the data are publicly available (GSE128033 and GSM3660650). Authors are suggested to do a comprehensive literature search and check if this study or any additional studies could be used as the validation data. Furthermore, multiple single cell RNA-seq data on IPF (GSE94555 and GSE86618) are also available in the public repositories. Therefore, authors are suggested to take this opportunity and investigate whether their reported comparative results are reproducible in a completely independent validation data set. 2. If the single cell data are not suitable for the analysis because of some valid reasons, authors are suggested to at least evaluate independent RNA-seq data and examine whether the prediction results obtained from the training data are consistent in the independent validation data. 3. For the Gene set enrichment analysis FDR cut-off 0.25 was chosen to determine significantly enriched gene sets. Although this cut-off is not uncommon; however, a general trend is to use FDR < 0.05 to determine significance. I am wondering how much the results would be changed with the FDR < 0.05 compared with the current results. This is important to evaluate, particularly in the absence of validation data, because such a low cut-off value may introduce high-false positives. Reviewer #2: Summary: This is a timely manuscript presenting a comparative in silico analysis of estimated cell type frequencies and gene expression changes in the lungs of deceased COVID-19 patients and idiopathic pulmonary fibrosis patients. Using CIBERSORT to estimate cell subset abundancies from gene expression profiles, the authors find certain cell types, such as monocytes and naïve B cells, uniquely increased in fatal COVID-19 samples. Furthermore, gene set enrichment analysis revealed changes in functional and signaling pathways, including decreases in CD40/CD40L signaling and alterations in integrin expression. The authors suggest that these results implicate naïve B cells as a potential mediator of lung pathology in COVID-19. Overall, this manuscript presents original research and the conclusions are supported by the data. However, there are some concerns about the limitations of the study and presentation of the results that should be addressed prior to acceptance. Major concerns: 1. The title overstates the findings and should be changed to reflect the fact that the role for naïve B cells in COVID-19 lung pathology is not proven by this analysis. A potential title could be: “In silico immune infiltration profiling combined with functional enrichment analysis [suggests a/reveals a potential] role for naïve B cells as a trigger for severe immune responses in the lungs of COVID-19 patients”. 2. A significant limitation which is not addressed is that all of the COVID-19 samples analyzed were from fatal cases. To understand whether naïve B cell infiltration plays a specific role in the pathology of severe/fatal COVID-19, it would be important to examine whether these changes also occur in mild/moderate cases where there is a lack of significant lung damage or fibrosis. If the samples/data are not available to make this comparison, this limitation should be raised in the discussion. 3. The authors state the following rationale for comparing COVID-19 and IPF: “Nearly all of the patients who died from COVID-19 had severe lung tissue damage and pulmonary fibrosis[29]. On the other hand, mortality in IPF is generally the result of progressive fibrotic lung disease.” If pulmonary fibrosis is a cause of mortality in both cases, it would make sense to look for common signatures rather than those unique to COVID-19. I think further clarification on the rationale here would be useful. 4. Figures 2-4: CIBERSORT can return relative cellular fractions instead of absolute score. These would be easier to interpret as an estimated percentage of total cells. In some cases the y axis scale changes significantly between datasets, making it harder to compare. Additionally, as a positive control it would be good to show that the relative cellular fractions of different subsets in the healthy samples match the approximate expected distribution of cell types in normal lung tissue. This could be included as a supplementary figure. 5. Figure 5: Given that there are ~7000 GO gene sets, an FDR<0.25 cutoff is quite relaxed and will likely result in many false positives. Do the results change if using a stricter cutoff such as 0.05? 6. Figure 5-6: In panel 5A, it appears the results from the two IPF datasets have been merged, but in panel 5B and Figure 6 they are separated. The authors should merge these results as well in panel 5B/Figure 6 to simplify the visualization and make a clearer message. Furthermore, the method of merging is not described. I would suggest running the enrichment analysis separately in each dataset and identifying gene sets that are consistently enriched in both datasets to produce the most robust results. 7. Figure 5B: The figure legend mentions “positive correlations”. If these are correlations, what are the variables being correlated? Instead, are these gene set enrichments? If so, the authors should change “positive correlations” to “positive enrichments” or “upregulated pathways versus healthy”. The legend also states that the edge represent overlap in genes between different gene sets. If this is so, how can an edge be dataset specific (colored), since the members of a gene set are predefined and not dataset dependent? 8. Figures 5/6: As is suggested by the differences in estimated cell frequencies in Figures 2-4, the changes in gene expression between COVID-19/IPF and healthy can be driven both by alterations in cell type abundancies and by transcriptional changes within a given cell type. The authors of CIBERSORT recently released a newer version, CIBERSORTx (Newman et al. Nat. Biotech. 2019) which allows estimation of cell type-specific gene expression within a mixture. I believe a valuable extension to the analysis presented would be to compare estimated gene expression between COVID-19/IPF and healthy within particular subsets of interest, such as naïve/memory B cells. This could provide further clarity, for example by revealing whether the upregulation of integrin pathways is occurring within naïve B cells of COVID-19 patients or if it is occurring in other cell types or simply due to changes in B cell frequencies. 9. Figure 6: The results section describing changes in various interleukin signaling pathways is not clear about the disease specificity. It should mention that these changes are common to IPF and COVID-19. Furthermore, IL-4 signaling, which is upregulated in COVID-19 (and IPF), is known to induce proliferation and class switching in B cells (Gascan et al., J. Exp. Med. 1991). This appears at odds with the finding of increased naïve B cells in COVID-19 samples. How do the authors explain this apparent dichotomy? This should be addressed. Minor concerns: 1. Figure 5B: What does the size of the circles represent? 2. Figure 6: Are these enrichments significant? The cutoffs used to determine inclusion in the figure should be stated in the legend 3. Discussion: The authors refer to increased infiltration of different immune cells, it should be clarified that these are transcriptional estimates and not actual measurements of cell frequencies. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
PONE-D-20-21528R1 In silico immune infiltration profiling combined with functional enrichment analysis reveals a potential role for naive B cells as a trigger for severe immune responses in the lungs of COVID-19 patients PLOS ONE Dear Dr. Chiu, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript by Dec 21 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols We look forward to receiving your revised manuscript. Kind regards, Mrinmoy Sanyal, PhD Academic Editor PLOS ONE [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: All comments have been addressed Reviewer #2: (No Response) ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: (No Response) Reviewer #2: Partly ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: (No Response) Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: (No Response) Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: (No Response) Reviewer #2: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: (No Response) Reviewer #2: Summary: The authors have addressed most of my initial concerns. However, the updated analysis and results suggest that naïve B cells are not elevated in the BALF of severe COVID-19 patients relative to moderate cases, but that the B cells of severe patients may be enriched in antibody-secreting cells instead. This does not implicate naïve B cells in severe immune responses to COVID-19 and the conclusions of the manuscript need to be altered to be in agreement with these new findings. Major concerns: 1. Figure 5B: How do the authors define ‘top gene’ in the memory v naïve comparison? Is this based on the top 100 most highly expressed genes from the LM22 signature for both the memory and naïve B cell subsets? This is not an ideal way to define a naïve vs memory specific signature, because it is not guaranteed to identify the most distinctive genes. The 20 genes unique to naïve could be rank 101-120 in memory, just missing the cutoff, for example. Therefore, the authors should validate their analyses by using an alternative memory vs naïve signature and see if they produce consistent results. One approach could be to use up/down DEG memory vs naïve B cell gene sets included in the C7:immunologic signature gene sets from MSigDB. 2. Figure 7: The the moderate versus severe B cell comparison here is interesting and informative. However, as the authors correctly point out, the results indicate that severe patients likely have increased plasma cells or other antibody-secreting cells relative to mild/moderate patients. These cells, as well as DN2 B cells, are not naïve. Therefore, this would suggest that naïve B cells are not involved in the pathology of severe COVID-19, but that potentially antibody-secreting cells are instead. This is at odds with the conclusions of the manuscript, including the title. Unless the authors have some alternative explanation as to why these results do not implicate antibody-secreting cells rather than naïve B cells in severe COVID-19, the conclusions of the manuscript need to be changed to better match these findings. Minor concerns: 1. The end of the introduction mentions ‘anti-secretory cells’, is this supposed to be antibody-secreting cells (as in the abstract)? 2. Figure 5A: This panel might be easier to interpret if these results were separated into 3 plots (COVID-19, IPF, and common) 3. Figure 6: The Liao and Morse datasets both have ~40% B cells in control samples, but the Chua dataset has < 1% B cells in control samples. Why do these controls have such a low frequency of B cells? Are they appropriate controls? 4. Figure 7B: What is the source for these DN2 B cell gene markers? Are these differences significant? ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 2 |
|
In silico immune infiltration profiling combined with functional enrichment analysis reveals a potential role for naive B cells as a trigger for severe immune responses in the lungs of COVID-19 patients PONE-D-20-21528R2 Dear Dr. Chiu, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Mrinmoy Sanyal, PhD Academic Editor PLOS ONE Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #2: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #2: (No Response) ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #2: (No Response) ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #2: (No Response) ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #2: (No Response) ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #2: (No Response) ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #2: No |
| Formally Accepted |
|
PONE-D-20-21528R2 In silico immune infiltration profiling combined with functional enrichment analysis reveals a potential role for naïve B cells as a trigger for severe immune responses in the lungs of COVID-19 patients Dear Dr. Chiu: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Mrinmoy Sanyal Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .