Peer Review History
| Original SubmissionJuly 5, 2023 |
|---|
|
Dear Dr. Brunner, Thank you very much for submitting your manuscript "Inferring microbial interactions with their environment from genomic and metagenomic data" for consideration at PLOS Computational Biology. As with all papers reviewed by the journal, your manuscript was reviewed by members of the editorial board and by several independent reviewers. In light of the reviews (below this email), we would like to invite the resubmission of a significantly-revised version that takes into account the reviewers' comments. While all the major concerns raised by the reviewers need to be addressed, there are two major points that must be addressed thoroughly. The first is with respect to benchmarking, and importantly how this method compares with existing methods, particularly the dynamic FBA models now widely used. While a 10-member community may be cumbersome to solve, a smaller community could be studied to establish the similarities and differences between the present method and the existing formalisms. Second, a comparison of how the interaction networks differ between their smooth simulations and numerical solvers would be critical to address. We cannot make any decision about publication until we have seen the revised manuscript and your response to the reviewers' comments. Your revised manuscript is also likely to be sent to reviewers for further evaluation. When you are ready to resubmit, please upload the following: [1] A letter containing a detailed list of your responses to the review comments and a description of the changes you have made in the manuscript. Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out. [2] Two versions of the revised manuscript: one with either highlights or tracked changes denoting where the text has been changed; the other a clean version (uploaded as the manuscript file). Important additional instructions are given below your reviewer comments. Please prepare and submit your revised manuscript within 60 days. If you anticipate any delay, please let us know the expected resubmission date by replying to this email. Please note that revised manuscripts received after the 60-day due date may require evaluation and peer review similar to newly submitted manuscripts. Thank you again for your submission. We hope that our editorial process has been constructive so far, and we welcome your feedback at any time. Please don't hesitate to contact us if you have any questions or comments. Sincerely, Sunil Laxman, PhD Academic Editor PLOS Computational Biology Stacey Finley Section Editor PLOS Computational Biology *********************** Reviewer's Responses to Questions Comments to the Authors: Please note here if the review is uploaded as an attachment. Reviewer #1: Summary The authors provide a tool – MetConSIN (Metabolically Contextualized Species Interaction Networks) - to efficiently simulate community metabolism in an interpretable way. Computational efficiency is achieved by reducing the number of optimizations performed to calculate the optimal flux in the metabolic network through the transformation of the linear programming problem to a set of differential equations, who’s solution can be carried forward in time without the need to re-optimize the parameters of the problem. This computational transformation also paves the way for the second, and main contribution of the new tool, which is interpretability. Because the transformation effectively produces an interaction network between organisms and metabolites, this allows for an immediate visual understanding of the causal interactions leading to metabolite, and ultimately species dynamics in the community. Major comments While I see no technical flaw in this work, I simply do not think it is innovative enough to warrant publication in a journal like PLoS Computational Biology. Many other tools exist that perform similar analysis of genome-scale metabolic models. In fact, excellent tools exists, such as COMETS (which is not cited here for some reason, and I am also not an author of), that are scalable (a major novelty claim in this paper) and even offer spatially resolved simulations. Specifically, COMETS automatically offers similar analysis, where the major difference is the automatic creation of interaction networks in MetConSIN, which is, in my opinion, not enough to warrant publication in a non-specialized journal. The authors also offer no comparison with existing methods (which was done in their previous publication) or with real world data, which make this paper quite “thin”. A comparison of how the interaction networks differ between their smooth simulations and numerical solvers would go a long way. Finally, I think the figures with the networks would benefit from simplification. All of the nodes that are only connected by insignificant links (grey) could be removed, where the full network would be found in some supplementary figure. This would make reading the labels much easier and the interpretation and comparison of the different panels much easier, in my opinion. Minor Comments Line 146: Should it be “with non-decreasing c_ij^2 (y_j)”? Line 184: non -> not Line 340: Delete the word “in” in the sentence containing “but the strength of the competition may vary in with different” Reviewer #2: The authors developed a mathematical approach that can extract microbe-metabolite interaction network from dynamic flux balance analysis (dFBA). This approach is based on their previous method to convert dFBA into piecewise ODEs. Various networks were constructed by interpreting the structure of ODEs. This is very interesting approach and I am very excited about it. I only have a few minor comments: 1. Each optimization step in dFBA is not unique in terms of which metabolites are consumed and produced. Are the equivalent ODEs unique or not? I am not familiar with the details of SurfinFBA; I guess the uniqueness maybe related to the choice of index set B. Since the reconstructed metabolic networks are derived from these ODEs, are they unique or not? It would be great if the authors add a comprehensive discussion about the uniqueness of dFBA, equivalent ODEs, and the reconstructed networks. 2. The rationale of developing this approach needs to be better explained. The optimal solution at each time point in dFBA depicts a community-level metabolic network: the exchanged metabolites of each GSM are known and their rates are quantitatively solved. Then why did the authors develop an indirect method to infer the network which requires conversion of dFBA to ODEs? I understand that ODEs are way easier to solve than dFBA but, in terms of network construction, how do you compare the pros and cons of the two approaches? And how different are between the metabolic networks inferred between the two approaches? 3. Both dFBA and ODEs are first-principle approaches. It would be super interesting if the approach can be extended to introduce constraints from metabolomics data. Could you discuss the possibility of integrating dFBA/ODEs with metabolomics data to infer realistic metabolic networks? Reviewer #3: In this paper, the authors develop a nice method to perform dynamic FBA on multispecies microbial communities that is efficient and offers a time varying view of the interactions underlying the species and metabolites. Current dynamic FBA methods are time consuming and typically fail to offer insights into the interactions governing the dynamics. The present method overcomes both these limitations. The conceptual advance is in recognizing that the optimization problem governing FBA can be mapped to a system of linear equations and hence translated to a system of ODEs with parameters that remain constant over finite subintervals of time. The parameters change when metabolite concentrations change enough to violate the constraints on the original FBA problem. The authors present an elegant description of this new formalism and a software, MetConSIN, for implementing it. They apply it to a set of 10 soil microbial species, whose genomes they identify by sequencing and then construct genome scale metabolic models of each of the species to be used in MetConSIN. They deduce the interactions governing the species and the regimes over which the networks change. The proposed method, in my opinion, represents a significant advance over existing methods because of its ability to offer time varying interaction maps and hence insights not readily gained by existing methods. The computational gains are a bonus. The paper is well written overall. I have a few comments for the authors to consider. Major comments: 1. My first comment is with respect to benchmarking. While the authors demonstrate the applicability of their method to the 10-member soil community, they do not show how their method compares with existing methods, particularly the dynamic FBA set up in Eqs. (1)-(4). Are the time courses predicted in Fig. 2 similar to what might be expected from Eqs. (1)-(4)? If the 10-member community is cumbersome to solve, can a smaller subcommunity – even a 2 member community – be studied to establish the similarities and differences between the present method and the existing formalisms? 2. Along the same lines, is a comparison with any experimental system feasible? The authors seem to have cultured the 10-members they studied. Could their growth rates be monitored in multi-species cultures and then compared with corresponding model predictions? If co-culturing is not possible, are other previously published datasets amenable to comparisons with the present model? If this not possible too, the authors must discuss this and mention explicitly what prevents comparisons with experiments. The difficulty may exist with current methods too, in which case, this may not be a limitation of the present study alone, but it must be discussed nonetheless. 3. The analysis of the interaction networks and their evolution (Figs 2-4) is very nice. It highlights the strength of the method. I felt though that the interpretation of the transitions seen seemed somewhat superficial. The authors mention that the first transition is when bc1012 altered its connectivity three times in quick succession (lines 286-288). They, however, do not provide any explanation of these changes in connectivity. Thus, while knowledge of these transitions is indeed an advance over existing models and is thus welcome, a mechanistic understanding of the transitions based on the metabolic models of the species and the nutrients available could have been more satisfying. Are these explanations forthcoming? If not, the authors must discuss why. 4. My final comment is on the way interactions between species are deduced (Eq. 13). Pairs of species are chosen and their interactions mediated by metabolites are summed with suitable weights to yield the net interactions between the species. This method yields pairwise interactions. However, species often experience high-order interactions (e.g., see: 1) https://www.pnas.org/doi/10.1073/pnas.1809349115; 2) https://www.nature.com/articles/s43588-021-00131-x). Does the present method thus miss these high-order interactions? Because the dynamic FBA formalism does not make any assumptions on the interactions but only deduces them, any high-order interactions present must exist in the model calculations. The deduction method may have to be changed to consider triplets of species, quadruplets of species, etc. (instead of just pairs) in order to deduce third-order, fourth-order, etc. interactions. I wonder if currently, the pairwise interactions deduced yield ‘effective’ pairwise interactions, as has been suggested in the recent study above (https://www.nature.com/articles/s43588-021-00131-x)? Again, I feel that the authors must at least comment on high-order interactions, given their possible presence in multi-species communities and the focus of the present study on deducing interaction networks. Minor comment: 1. On lines 126-131, the authors indicate that the method to choose the matrices (Bik) are outlined elsewhere. For completeness, I feel that the authors may wish to provide a brief outline of how this choice is made. 2. On lines 140-142, the authors mention that holding the metabolite levels constant would yield a snapshot of the interaction may between the species. Could this be shown? Also, I would imagine that the species compositions would evolve with time even if the metabolite levels were held constant. Then, would the interaction map not also change? The authors may wish to comment on this. ********** Have the authors made all data and (if applicable) computational code underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data and code underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data and code should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data or code —e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: Yes ********** PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No Reviewer #3: No Figure Files: While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Data Requirements: Please note that, as a condition of publication, PLOS' data policy requires that you make available all data used to draw the conclusions outlined in your manuscript. Data must be deposited in an appropriate repository, included within the body of the manuscript, or uploaded as supporting information. This includes all numerical values that were used to generate graphs, histograms etc.. For an example in PLOS Biology see here: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001908#s5. Reproducibility: To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols |
| Revision 1 |
|
Dear Dr. Brunner, We are pleased to inform you that your manuscript 'Inferring microbial interactions with their environment from genomic and metagenomic data' has been provisionally accepted for publication in PLOS Computational Biology. Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests. Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated. IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript. Should you, your institution's press office or the journal office choose to press release your paper, you will automatically be opted out of early publication. We ask that you notify us now if you or your institution is planning to press release the article. All press must be co-ordinated with PLOS. Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Computational Biology. Best regards, Sunil Laxman, PhD Academic Editor PLOS Computational Biology Stacey Finley Section Editor PLOS Computational Biology *********************************************************** Reviewer's Responses to Questions Comments to the Authors: Please note here if the review is uploaded as an attachment. Reviewer #1: The authors addressed all of my concerns and I have no further comments. Reviewer #3: I am impressed with the work that the authors have done to address my concerns. I am quite satisfied with their responses and have no further comments. ********** Have the authors made all data and (if applicable) computational code underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data and code underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data and code should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data or code —e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #3: Yes ********** PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #3: No |
| Formally Accepted |
|
PCOMPBIOL-D-23-01066R1 Inferring microbial interactions with their environment from genomic and metagenomic data Dear Dr Brunner, I am pleased to inform you that your manuscript has been formally accepted for publication in PLOS Computational Biology. Your manuscript is now with our production department and you will be notified of the publication date in due course. The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript. Soon after your final files are uploaded, unless you have opted out, the early version of your manuscript will be published online. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers. Thank you again for supporting PLOS Computational Biology and open-access publishing. We are looking forward to publishing your work! With kind regards, Anita Estes PLOS Computational Biology | Carlyle House, Carlyle Road, Cambridge CB4 3DN | United Kingdom ploscompbiol@plos.org | Phone +44 (0) 1223-442824 | ploscompbiol.org | @PLOSCompBiol |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .