Peer Review History
| Original SubmissionMay 15, 2025 |
|---|
|
PCOMPBIOL-D-25-00953 Surrogate modeling of Cellular-Potts agent-based models as a segmentation task using the U-Net neural network architecture PLOS Computational Biology Dear Dr. Glazier, Thank you for submitting your manuscript to PLOS Computational Biology. After careful consideration, we feel that it has merit but does not fully meet PLOS Computational Biology's publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript within 60 days Sep 07 2025 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at ploscompbiol@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pcompbiol/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript: * A rebuttal letter that responds to each point raised by the editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'. This file does not need to include responses to formatting updates and technical items listed in the 'Journal Requirements' section below. * A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'. * An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'. If you would like to make changes to your financial disclosure, competing interests statement, or data availability statement, please make these updates within the submission form at the time of resubmission. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter We look forward to receiving your revised manuscript. Kind regards, Philip K Maini Academic Editor PLOS Computational Biology Mark Alber Section Editor PLOS Computational Biology Journal Requirements: 1) We ask that a manuscript source file is provided at Revision. Please upload your manuscript file as a .doc, .docx, .rtf or .tex. If you are providing a .tex file, please upload it under the item type u2018LaTeX Source Fileu2019 and leave your .pdf version as the item type u2018Manuscriptu2019. 2) Please ensure that the funders and grant numbers match between the Financial Disclosure field and the Funding Information tab in your submission form. Note that the funders must be provided in the same order in both places as well. Currently, the Financial Disclosure states there was no funding received. Reviewers' comments: Reviewer's Responses to Questions Comments to the Authors: Please note here if the review is uploaded as an attachment. Reviewer #1: This submission explores how machine learning can be used to significantly accelerate computationally expensive mechanistic models, focusing on the Cellular Potts Model (CPM). Given the CPM’s popularity and broad application, the work addresses an important and timely question with potential implications for simulating larger and more complex biological systems. The manuscript is well-written and easy to follow. The authors clearly describe the benefits of using a machine learning-based surrogate model, including improved computational speed and the ability to reproduce key features of the CPM such as vessel sprouting, branching behavior, and lacunae contraction. They also acknowledge the model’s limitations, notably its inability to prevent gradual lacunae growth—an effect not present in the original model. The figures are generally clear and informative. However, the numbering of figures in the main text does not align with the numbering in the figure captions, which should be corrected for consistency and ease of reference. Main Concerns My principal concern is that the success of the surrogate model is overstated in several key parts of the paper. While the authors acknowledge in the main text that the surrogate performs well for only one to three prediction steps, they still present the model as broadly useful in ways that are not fully supported by the results. This limitation substantially reduces the model’s practical utility, as the performance gain from faster simulations cannot be fully leveraged over such short prediction horizons. For example, the abstract states: “The surrogate model was trained to predict 100 computational steps ahead (Monte-Carlo steps, MCS), accelerating simulation evaluations by a factor of 590 times compared to CPM code execution. Over multiple recursive evaluations, our model effectively captures the emergent behaviors demonstrated by the original Cellular-Potts model such as vessel sprouting, extension and anastomosis, and contraction of vascular lacunae.” While technically accurate, this statement omits the critical issue that the model's predictions deteriorate over longer time horizons, particularly in representing lacunae size. For balance, the abstract should briefly mention these limitations. Similarly, at the end of the Introduction, the authors claim: “Our approach demonstrates the potential for deep neural networks to serve as efficient surrogate models for CPM simulations, enabling faster evaluation of computationally expensive CPM of biological processes at greater spatial and temporal scales.” Given the current model’s performance, this statement is overly optimistic. While the long-term potential of such approaches is promising, this particular implementation does not yet fulfill the goals set forth in the statement. In the Conclusion, the authors write: “Our surrogate predicts the simulation configuration significantly faster than native Cellular-Potts algorithm execution and can replicate emergent behaviors present but not explicitly defined in the Cellular-Potts model.” Again, this claim should be tempered by noting that the speed-up is only relevant for very short simulation times, beyond which the surrogate model’s predictions become unreliable. Minor Comment • The p-value reported in Figure 5 (1 × 10⁻¹⁸³) is unnecessary. Given the visual clarity of the differences between models, such an extreme level of significance adds little value to the reader’s understanding. Reviewer #2: This paper presents a U-Net CNN as a surrogate model to predict future behaviour of a two-dimensional individual cell cellular Potts model. 1. The study seems preliminary and inconclusive. While certainly worthwhile of publication, it would be preferred if the usefulness of predicting a mere 100 MCS could be shown to be useful. For example, if the hypothesised scheme presented in the paragraph at line 234 could be shown to give quantifiable, useful results in half the time of a cellular Potts model, then the paper would have a positive story to tell. 2. While it's reasonable to dismiss predicting over short/long time spans it is completely unclear why 100 MCS was selected as the quantity for prediction. Surely this is a hyper-parameter which ought to be study and tuned as part of the model? 3. The reading experience was impaired by presenting the figures in a permuted order. (The U-net architecture figure referred to as Figure 6 in the Supplementary appeared as Figure 1.) 4. Anastomosis and lacunae present different prediction problems in 3D where cellular Potts models become unfeasibly slow. Is it possible that the surrogate could be even more useful in 3D? 5. Ref 32 mentioned on line 32 seems to be key to whether the current study is useful or a poor substitute. What is the publication status of Ref 32? Minor points ------------ l11 "of as vessel" l235 "3 predictive steps" -> "3 predictive steps (300 MCS)" (for clarity, if that is what you mean). l256 Hamiltonian equation appears out of nowhere. Introduce it. l346 Fix double quotes l173 Is it possible to show CPU/CPU or GPU/GPU time comparisons? Ref 8: "potts" -> "Potts" Ref 28: "Elife" -> eLife" Reviewer #3: This paper presents an approach for surrogate modeling for the cellular Potts modeling (CPM) framework, which is evaluated on an example model of angiogenesis that involves both a diffusive field and a grid with cells. Surrogate modeling is an interesting approach that is being applied successfully to many complex simulation methods, e.g., molecular dynamics, and so it is interesting and relevant to investigate similar speedups for the CPM. Unfortunately, I think that the results presented in this paper are still too preliminary to be broadly relevant, and I consider it unlikely that the method proposed in this paper is actually useful; it is currently more an interesting proof of concept for people working in this field, but fundamentally different methods will probably need to be used to actually do surrogate modeling for the CPM. The main issue is simply that the CPM is a stochastic model, and so the premise of predicting the next configuration after say 100 steps is to some extent flawed. If we ran the CPM many times with different random seeds, it would also not produce the exact same configuration. However, in this paper this task is treated as a "segmentation problem" which is fundamentally a deterministic problem. Using a deterministic surrogate for a stochastic model would have profound implications that may make it very hard or even impossible to use the surrogate for the same research questions as the original model. There may be possible ways around this; for example there could be a subclass of models where the randomness itself may not be critical and simulating a "typical" trajectory may be enough; however without any discussion of such issues or examples how this kind of surrogate could be used the paper is unfortunately too preliminary to be useful. The authors are well aware of this issue, as they mention it in their discussion section, and have actually already begun a separate project where they use a denoising diffusion model as an architecture for the surrogate, which seems like a much better approach (https://arxiv.org/abs/2505.09630). In summary, this manuscript would be much stronger if it showed that there is an advantage of this deterministic approach compared to the seemingly more suitable one of using a stochastic generative model as a surrogate. I cannot currently discern such an advantage from the data being shown. While the results do demonstrate that the deterministic surrogate makes predictions that retain some characteristics of the actual model, they do not demonstrate that we can still generate the same kind of insights from it. ********** Have the authors made all data and (if applicable) computational code underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data and code underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data and code should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data or code —e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: Yes ********** PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No Reviewer #3: No Figure resubmission: While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. If there are other versions of figure files still present in your submission file inventory at resubmission, please replace them with the PACE-processed versions. Reproducibility: To enhance the reproducibility of your results, we recommend that authors of applicable studies deposit laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols |
| Revision 1 |
|
Dear Prof. Glazier, We are pleased to inform you that your manuscript 'Surrogate modeling of Cellular-Potts agent-based models as a segmentation task using the U-Net neural network architecture' has been provisionally accepted for publication in PLOS Computational Biology. Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests. Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated. IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript. Should you, your institution's press office or the journal office choose to press release your paper, you will automatically be opted out of early publication. We ask that you notify us now if you or your institution is planning to press release the article. All press must be co-ordinated with PLOS. Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Computational Biology. Best regards, Philip K Maini Academic Editor PLOS Computational Biology Mark Alber Section Editor PLOS Computational Biology *********************************************************** Reviewer's Responses to Questions Comments to the Authors: Please note here if the review is uploaded as an attachment. Reviewer #1: My concerns and suggestions have been incorporated into the text and I have no more concerns. Reviewer #2: Authors have addressed my criticisms (and those of another reviewer) to my satisfaction. Reviewer #3: Thank you for your responses to my concerns. I see that you have added a new paragraph to the discussion emphasizing again why you feel your approach can be useful. While I would have liked to see an explicit acknowledgement of the significant limitations that the current proof of concept still has, I have no further comments or requests at this stage. ********** Have the authors made all data and (if applicable) computational code underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data and code underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data and code should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data or code —e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: No: ********** PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No Reviewer #3: No |
| Formally Accepted |
|
PCOMPBIOL-D-25-00953R1 Surrogate modeling of Cellular-Potts agent-based models as a segmentation task using the U-Net neural network architecture Dear Dr Glazier, I am pleased to inform you that your manuscript has been formally accepted for publication in PLOS Computational Biology. Your manuscript is now with our production department and you will be notified of the publication date in due course. The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript. Soon after your final files are uploaded, unless you have opted out, the early version of your manuscript will be published online. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers. For Research, Software, and Methods articles, you will receive an invoice from PLOS for your publication fee after your manuscript has reached the completed accept phase. If you receive an email requesting payment before acceptance or for any other service, this may be a phishing scheme. Learn how to identify phishing emails and protect your accounts at https://explore.plos.org/phishing. Thank you again for supporting PLOS Computational Biology and open-access publishing. We are looking forward to publishing your work! With kind regards, Anita Estes PLOS Computational Biology | Carlyle House, Carlyle Road, Cambridge CB4 3DN | United Kingdom ploscompbiol@plos.org | Phone +44 (0) 1223-442824 | ploscompbiol.org | @PLOSCompBiol |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .