Peer Review History

Original SubmissionJune 26, 2024
Transfer Alert

This paper was transferred from another journal. As a result, its full editorial history (including decision letters, peer reviews and author responses) may not be present.

Attachments
Attachment
Submitted filename: diff.pdf
Decision Letter - Claudio Zandron, Editor

PONE-D-24-26146Expressive rule-based modeling and fast simulation for dynamic compartments PLOS ONE

Dear Dr. Henning,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Sep 26 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Claudio Zandron

Academic Editor

PLOS ONE

Journal Requirements:

1. When submitting your revision, we need you to address these additional requirements.

Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for stating the following in the Acknowledgments Section of your manuscript: 

Figures 1 was created with BioRender.com. This work was funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) SFB 1270 – 299150580 ELAINE and grant 225222086.

We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. 

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows: 

P.H. received frunding from the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation, https://www.dfg.de/en) SFB 1270 – 299150580 ELAINE.

T.K. received frunding from the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation, https://www.dfg.de/en) grant 225222086

The DFG did not play a role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

3. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments:

Both reviewers agree on the scientific merit of the paper. Please carefully address all minor changes/corrections they require.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

********** 

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: N/A

********** 

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

********** 

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

********** 

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors addressed all of the points I raised in my previous

review, and have improved the paper accordingly. I am satisfied with

the revised paper.

I have only some very minor changes to suggest.

In their rebuttal, the authors clarified their use of the partial

evaluation technique. I'd recommend adding those details in the paper

as well. They already added something (around line 446) but they did

not explain *in the paper* how partial evaluation is actually used.

I was particularly interested in the fact that structure-changing

reactions are rare, yet they have a very large impact on performance

since 87% of the time is spent on those. While I am sure that this

figure (87%) may vary on the actual model, it clearly shows where the

bottleneck is.

If the authors know how frequently these rare reactions occur, I would

recommend to add this information to the paper. In the captions of

fig. 2 and 3 we can find the number of structural changes, but not

their frequency (what is the total number of fired reactions?).

line 152

BioNetgen -> BioNetGen

(there might be other occurrences)

line 194

"the containment is compartments"

(?)

Reviewer #2: This paper addresses the modeling and the simulation of protein interaction systems with dynamical hierarchies of compartments.

This topic is important because of the causal interactions between populations of proteins and their compartments, and back and forth.

The simulation of these systems has been acknowledged to be scientific and technological lock, mainly for scalability issues.

The approach combines a clever simulation architecture with some compilation optimization. Few test cases are provided (including pointers to the code).

One key point for simulating protein interaction systems, is the dynamical update of the table of potential events. The simulation structure encapsulates such a table for each compartment. It is presented to be applied with a reaction-based simulation approach (where rules are expanded into reactions), but the approach seems quite modular and could likely be applied with a network-free approach. This choice is motivated by the assumption that most of the events will not change the hierarchy of compartments.

To reduce the overhead of having to consider the simulation steps and the next event table for each compartment, the authors combine partial evaluation, dynamic compilation and run-time optimization.

The paper also includes a presentation of literature.

---

In my opinion, this is an important contribution to the state of the art, and it will interest the PLOS-ONE community. I thus have no doubt that it should be accepted.

Nevertheless, I think that more details should be provided about compartment fission.

This is a key limiting factor when dealing with dynamic compartments, especially when the content of the two sibling compartments is drawn by splitting randomly the content of the parent compartment, which would require many random number generation.

Such phenomena occur when the dynamics of the compartment content are driven by the well-mixed assumption.

Maybe this overhead can be avoided by using attributes, but this would deserve at least a discussion, I think.

Also, focusing on the flat models (with network-free attributes potentially), the approach focuses on the model with few diversities in the molecular entities. Indeed, models with high combinatorics in protein binding cannot be modelled accurately with such approaches.

The operational semantics of the language is only sketched.

This is a good choice to explain the intuition about the approach, but some details about the models remain difficult to understand because of this (see for instance what is the meaning to multiple occurrences of the syntactic token ?c in a rhs).

---

Please find as follows some detailed comments.

--

Line 20 [3--6]

I would recommend including references to :

Troels C. Damgaard, Espen Højsgaard, Jean Krivine,

Formal Cellular Machinery,

SASB 2012

Electronic Notes in Theoretical Computer Science,

Volume 284,

2012,

Pages 55-74,

ISSN 1571-0661,

https://doi.org/10.1016/j.entcs.2012.05.015.

and

Cardelli, L. (2005). Brane Calculi. In: Danos, V., Schachter, V. (eds) Computational Methods in Systems Biology. CMSB 2004. Lecture Notes in Computer Science(), vol 3082. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-25974-9_24

--

Line 125

An important method to speed up the dynamic update, consists in over-approximating the set of potential events. This is interesting when the over-approximation is less expensive to maintain.

The drawback is that the validity of reactions must be checked at run-time when selected randomly.

An example is the rectangular approximation in Kappa which considers the left hand side of rule connected-component by connected-component.

(40, Section 4, Page 12)

--

The dynamic updates to the table of potential events can also be optimized by exploiting the common regions among the patterns that occur in the lhs of rules.

Boutillier, B, Ehrhard T., Krivine J. Incremental Update for Graph Rewriting. ESOP 2017

--

Line 193-207

The use of an associative and commutative operator to denote a set of concurrent entities seems to be borrowed from process calculi. (eg see Ambients, BioAmabients, Brane Calculi).

--

Line 220

Even worse, the distribution of the content of the sibling compartments at the fisson of their parent compartments may be drawn stochastically. (For instance, fission of a compartment under the well-mixed assumption).

Each entity having a probability to be in one or the other compartment after fission.

This induces a computation overhead since a random decision has to be made for each entity.

eg see:

Troels C. Damgaard, Espen Hojsgaard, Jean Krivine,

Formal Cellular Machinery,

SASB 2012

Electronic Notes in Theoretical Computer Science,

Volume 284,

2012,

Pages 55-74,

ISSN 1571-0661,

https://doi.org/10.1016/j.entcs.2012.05.015.

Additional information stored in attributes, about spatial position for instance, may be used to define in which compartment each entity will be after the fission, according to the value of their attributes.

--

Line 299

Another example of named attributes are the counters in Kappa which support some arithmetic operations (inequality tests, incrementat, decrementat) and can be used in the rate of rules)

Another example of named attributes are the counters in Kappa which support some arithmetic operations (inequality tests, increment, decrement) and can be used in the rate of rules.

Boutillier B., Critescu I., Feret J.

Counters in Kappa: Semantics, Simulation, and Static analysis. ESOP 2019

--

Line 317

Discussion:

The choice between network-free and flat model simulations is usually driven by the combinatorial complexity. Network-free attibutes may help, but what about binding between proteins which are central in Kappa and BNGL.

Note also that Kappa counters could be considered as 'network-free-integers'.

--

Line 333:

A reference to unit/dimension analysis could be provided, such as:

Generalized homogeneous polynomials for efficient template-based nonlinear invariant synthesis. Kensuke Kojima, Minoru Kinoshita1, and Kohei Suenaga. In: Static Analysis Symposium (SAS 2016).

--

Line 351.

The approach seems to me to be more modular than described in the presentation. It could likely be applied to network free, flat representation, and hybrid solutions between them, depending on the nature of the model.

Compartment fission has been identified to be costly, since the distribution of the content must be drawn.

--

Line 514

Is the content of a cell is split when the cell is divided, or duplicated?

In the source code, the syntactic token ?c appears twice in the rhs. What does it mean? Is the content of the place-holder duplicated?

********** 

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 1

We thank the reviewers for their time and dedication. These detailed reviews have helped us refine our paper. We have addressed the requests and made the changes detailed in the answer letter.

Attachments
Attachment
Submitted filename: Plos Answerletter.pdf
Decision Letter - Claudio Zandron, Editor

Expressive rule-based modeling and fast simulation for dynamic compartments

PONE-D-24-26146R1

Dear Dr. Henning,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Claudio Zandron

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I am satisfied with the revised paper.

The authors addressed all of the points I raised in my previous

reviews.

I have no more changes to suggest.

Reviewer #2: All my comments have been considered, or discarder with proper arguments.

This paper addresses the modeling and the simulation of protein interaction systems with dynamical hierarchies of compartments.

This topic is important because of the causal interactions between populations of proteins and their compartments, and back and forth.

The simulation of these systems has been acknowledged to be scientific and technological lock, mainly for scalability issues.

The approach combines a clever simulation architecture with some compilation optimization. Few test cases are provided (including pointers to the code).

One key point for simulating protein interaction systems, is the dynamical update of the table of potential events. The simulation structure encapsulates such a table for each compartment. It is presented to be applied with a reaction-based simulation approach (where rules are expanded into reactions), but the approach seems quite modular and could likely be applied with a network-free approach. This choice is motivated by the assumption that most of the events will not change the hierarchy of compartments.

To reduce the overhead of having to consider the simulation steps and the next event table for each compartment, the authors combine partial evaluation, dynamic compilation and run-time optimization.

The paper also includes a presentation of literature.

---

In my opinion, this is an important contribution to the state of the art, and it will interest the PLOS-ONE community. I thus have no doubt that it should be accepted.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

Formally Accepted
Acceptance Letter - Claudio Zandron, Editor

PONE-D-24-26146R1

PLOS ONE

Dear Dr. Henning,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Claudio Zandron

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .