Peer Review History

Original SubmissionSeptember 13, 2023
Decision Letter - Kazunori Nagasaka, Editor

PONE-D-23-29592Systematically mining genomic and proteomic variation linked to rare diseases: the example of monogenic diabetesPLOS ONE

Dear Dr. Kuznetsova,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jan 15 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Kazunori Nagasaka

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please update your submission to use the PLOS LaTeX template. The template and more information on our requirements for LaTeX submissions can be found at http://journals.plos.org/plosone/s/latex.

3. Please note that PLOS ONE has specific guidelines on code sharing for submissions in which author-generated code underpins the findings in the manuscript. In these cases, all author-generated code must be made available without restrictions upon publication of the work. Please review our guidelines at https://journals.plos.org/plosone/s/materials-and-software-sharing#loc-sharing-code and ensure that your code is shared in a way that follows best practice and facilitates reproducibility and reuse.

4. Note from Emily Chenette, Editor in Chief of PLOS ONE, and Iain Hrynaszkiewicz, Director of Open Research Solutions at PLOS: Did you know that depositing data in a repository is associated with up to a 25% citation advantage (https://doi.org/10.1371/journal.pone.0230416)? If you’ve not already done so, consider depositing your raw data in a repository to ensure your work is read, appreciated and cited by the largest possible audience. You’ll also earn an Accessible Data icon on your published paper if you deposit your data in any participating repository (https://plos.org/open-science/open-data/#accessible-data).

5. Thank you for stating the following financial disclosure:

“The work is supported by the Research Council of Norway https://www.forskningsradet.no/

Grant #301178 to M.V.”

Please state what role the funders took in the study.  If the funders had no role, please state: "The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript."

If this statement is not correct you must amend it as needed.

Please include this amended Role of Funder statement in your cover letter; we will change the online submission form on your behalf.

6. Thank you for stating the following in the Acknowledgments Section of your manuscript:

“This work was supported by the Research Council of Norway (project #301178 to MV), the

University of Bergen, and the Novo Nordisk Foundation (project NNF20OC0063872 to SJ).

This research was funded, in whole or in part, by the Research Council of Norway 301178. A CC

BY or equivalent license is applied to any Author Accepted Manuscript (AAM) version arising

from this submission, in accordance with the grant’s open access conditions.”

We note that you have provided funding information that is currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form.

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows:

“The work is supported by the Research Council of Norway https://www.forskningsradet.no/

Grant #301178 to M.V.”

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

7. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

8. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments:

Dear Authors,

Thank you very much for your submission to Plos One.

I think the manuscript is informative and describes some important points.

Sincerely,

Plos one editorial office

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Partly

Reviewer #4: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: N/A

Reviewer #3: N/A

Reviewer #4: N/A

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The study addresses the issue of pathogenic variation in monogenic diabetes. They developed an automated pipeline to mine the pathogenic variants in over 100 genes considering to be related with monogenic diabetes. By mining the variation data from both ClinVar and literatures and multiple processes, they identified the pathogenic variants in 36 genes, and further sorted out these causing translational changes. All the data from the study are available. The study is certainly a plus for further exploration in the subject.

Comments for improvement:

The definition of short deletions, short insertions, or other short fragment replacements needs to be given and justified. For example, how many bases deleted to be used as the cut off for short deletion?

The use of isoforms in the pipeline can cause mapping trouble as presented by the authors, as the number of isoforms in different genes can be substantial and lack of standardization and quality control. This is the reason to have RefSeq instead of isoforms in genomic annotation. The authors need to justify why use isoform instead of isoforms in their analysis.

“Note that not all these variants could be mapped automatically and those that did not map to Ensembl were formatted manually for input to Module 6. Detailed description needs to be given for formatted “manually”, and indicate the number of the variants under manually check.

ClinVar doesn’t have the classification of “unknown pathogenicity”. It should be the variants of unknown significance or VUS.

“For other types of consequence we focused on those presenting more than 80 % pathogenic and likely pathogenic variants”. Justification for 80% needs to be given, and the number at this cut-off needs to be given.

“We could map 2,701 of these variants to variants linked to monogenic diabetes according to

ClinVar or the literature”: should be “We mapped 2701 of….”

The version numbers for Ensembl, ClinVar and dbSNP need to be indicated. Different versions can be a reason for the inconsistence of the mapping results, such as “why the overlap of the variants taken from Rafique et al. and ClinVar seems limited in our analysis”.

The value of translation products has been repeatedly indicated to justify the development of translational products, as it “help predict the effect of genetic variation on the resulting protein structure and function”. However, there is no single example to justify their claim. I would suggest to present an example of coding changed protein with structural alteration as a proof of principle, considering they have generated rich coding-change pathogenic variants in multiple genes, like HNF1A.

The resolution is poor for all figures.

Reviewer #2: The authors present an interesting paper on the computational assessment of coding variants on protein sequences, categorizing these variants into different tiers depending on predicted pathogenicity.

Some minor comments to the authors

- The authors use the article by Rafique et al (2021). However, they should also mention the paper published by Bonnefond et al (2023) Nature Reviews particularly in their Discussion section (page 14) and how this compares to what they included in their study.

- Pg 4: Change port to import

- Page 3 “It is estimated that around 77 % of monogenic diabetes cases remain undiagnosed”. Specify why.

- Pg 3: Perhaps specify the total number of genes (to date) related to monogenic diabetes not just the 14 MODY genes

- I think it should be specified before (on page 5) which type of exonic variants were retained (listed on page 6)

- It would be good to specify the list of in silico tools used by Ensembl (VEP) to predict pathogenicity

- Did the authors consider cross checking some of the level 1/2 variants with ACMG/AMP predictions?

- Did the authors apply an alternative allele frequency cut-off? Perhaps some of the e.g. nonsense variants might be common.

- Page 8: Variants in BLK, KLF11 and PAX4 should be removed for dominant monogenic diabetes and it is still nonetheless considered controversial.

- Supp Table 5: would change to Yes/No in Rafique column

- Perhaps Links should be included as footnotes (rather than references in text)

Reviewer #3: This manuscript provides a modular Jupiter notebook approach for collecting information on monogenic diabetes variants across 108 genes. The authors compile their database from ClinVar and literature to generate a uniform list with annotations.

The work presented is thorough, though I was unable to personally validate the coding implementation. Additionally, the authors did not demonstrate this approach generalizes well to other diseases, making it difficult to assess wider utility.

Some of the approaches rely on circular logic - for example, the variants in Module 1 already include ClinVar data and use the Ensemble Variant Effect Predictor, which provides comprehensive annotations.

While this tool aims to fill a need, numerous established resources (DECIPHER, VEP etc.) and their continuous expansions already provide rich variant annotation and data integration. As more addons targeting monogenic diseases are actively developed and included in these tools actively the niche for this specific tool may diminish over time due to manual update needed for this work.

Overall, this manuscript describes a thoughtful effort to aggregate information on monogenic diabetes variants. However, given the breadth of existing tools, I am unable to clearly recognize the unmet need this resource fills in the community.

Reviewer #4: Authors developed automated and reproducible bioinformatics pipeline for mapping variants in genes related to MODY, and further collecting and harmonizing data about them. Their work addresses current challenges that geneticist face in the process of interpreting effect of rare/new genetic variants.

The pipeline has been described in detail and is made available for public use.

Additional value is that parts of this pipeline could be used to develop similar pipelines for other rare genetic disorders / groups of rare disorders. This is a needed tool in the rare disease ecosystem.

Therefore, I highly recommend publishing this manuscript in the current form.

Minor comment: I suggest including words “bioinformatics pipeline” in the title to facilitate bioinformaticians to find this valuable manuscript.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

Reviewer #4: Yes: Maja Stojiljkovic

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 1

We thank the editor and all the reviewers for their attention to our work and valuable comments. We have implemented all suggestions and as a result the manuscript is substantially improved.

We are providing the revised version in the form of a LaTex document as it was requested by the journal and also attaching the MS Word file with the changes highlighted.

We have not made any changes in the figures, but have added one supplementary table (S10_table), renamed the supplementary files, and updated all the in-text citations as required.

We have modified the reference list and added 5 more references (28, 30, 31, 32, 34). The updated reference list is included at the end of the LaTex file as required by the template.

We have added a license file to the GitHub repository and a file containing all the dependencies for creating the conda environment for running our pipeline with explanations in a readme file.

Reviewer #1:

We thank reviewer 1 for the thorough examination of our work and for their appreciation of its contribution to monogenic disease research. We have implemented all suggestions, as detailed in the answers below.

The definition of short deletions, short insertions, or other short fragment replacements needs to be given and justified. For example, how many bases deleted to be used as the cut off for short deletion?

Filtering the variants we did not set any limits deliberately, but out of the variants from ClinVar linked to monogenic diabetes, the indels were no longer than 30 bp. We have added this information to page 17.

The use of isoforms in the pipeline can cause mapping trouble as presented by the authors, as the number of isoforms in different genes can be substantial and lack of standardization and quality control. This is the reason to have RefSeq instead of isoforms in genomic annotation. The authors need to justify why use isoform instead of isoforms in their analysis.

In our study, we translated all variant genes into the possibly encoded proteins to enable protein-level analyses (e.g. structural or mass spectrometry-based analysis). In order to comprehensively cover all possibly encoded proteins, we chose to include all possible isoforms as provided by Ensembl. The reviewer is correct that analysts usually reduce the number of isoforms and in most cases use only canonical sequences, as provided by RefSeq or Ensembl. In the study of rare diseases, and monogenic diabetes in particular, it is important to be able to select between isoforms. For example, different isoforms of GCK are specific for different tissues https://www.degruyter.com/document/doi/10.1515/hsz-2018-0109/html?lang=de. It is therefore valuable for analysts to have all isoforms available and choose the ones relevant to their analysis, instead of being limited to canonical isoforms. This has been clarified in the text.

“Note that not all these variants could be mapped automatically and those that did not map to Ensembl were formatted manually for input to Module 6. Detailed description needs to be given for formatted “manually”, and indicate the number of the variants under manually check.

The description is added to page 8.

ClinVar doesn’t have the classification of “unknown pathogenicity”. It should be the variants of unknown significance or VUS.

We apologize for the incorrect formulation, it has been corrected with the denomination from ClinVar as suggested.

“For other types of consequence we focused on those presenting more than 80 % pathogenic and likely pathogenic variants”. Justification for 80% needs to be given, and the number at this cut-off needs to be given.

“We could map 2,701 of these variants to variants linked to monogenic diabetes according to

ClinVar or the literature”: should be “We mapped 2701 of….”

This has been corrected on page 10.

The version numbers for Ensembl, ClinVar and dbSNP need to be indicated. Different versions can be a reason for the inconsistence of the mapping results, such as “why the overlap of the variants taken from Rafique et al. and ClinVar seems limited in our analysis”.

This has been added.

The value of translation products has been repeatedly indicated to justify the development of translational products, as it “help predict the effect of genetic variation on the resulting protein structure and function”. However, there is no single example to justify their claim. I would suggest to present an example of coding changed protein with structural alteration as a proof of principle, considering they have generated rich coding-change pathogenic variants in multiple genes, like HNF1A.

We have added an example of structural changes in GCK due to sequence coding region mutation from doi.org/10.1016/j.bbadis.2012.07.005 and variant pathogenicity prediction using AlphaMissense that is based on the structural predictor AlphaFold doi/epdf/10.1126/science.adg7492 on page 16. We thank the reviewer for this suggestion.

The resolution is poor for all figures.

We have provided high-resolution figures as separate files along with the manuscript as well as on GitHub. Unfortunately, it seems that the compression of the submission system altered the resolution. We will ensure that resolution is sufficient in the resubmission, alternatively, all the files are available for download from https://github.com/kuznetsovaks/MD_variants

Reviewer #2:

We thank reviewer 2 for the careful analysis of our work and for pointing out our approach to dividing variants into tiers. We have implemented all suggestions, as detailed in our answers below.

- The authors use the article by Rafique et al (2021). However, they should also mention the paper published by Bonnefond et al (2023) Nature Reviews particularly in their Discussion section (page 14) and how this compares to what they included in their study.

We thank the reviewer for pointing out this important paper. We have now included this this review in the paper (See page 17 and Supplementary Table 10). However, unlike the work by Rafique et al., this manuscript provides an overview of MG at the gene level and lists the linked genes but not the variants. We have checked the overlap of the gene list in the review with the gene list in our work. As expected, the overlap is not perfect, but discussing the differences between the gene lists provided by different reviews is beyond the scope of our work.

- Pg 4: Change port to import

This has been corrected.

- Page 3 “It is estimated that around 77 % of monogenic diabetes cases remain undiagnosed”. Specify why.

Thank you for this suggestion, we have extended the text accordingly.

- Pg 3: Perhaps specify the total number of genes (to date) related to monogenic diabetes not just the 14 MODY genes

One of the points and conclusions of our study is that the list of genes related to monogenic diabetes is a matter of continuous discussion and revision. A gene can be included or excluded from this list based on the pathogenicity, frequency etc. of its genetic variants, which in turn is constantly being revised. We have extended the result section and discussion accordingly, but for the sake of clarity the introduction does not expand on these considerations.

- I think it should be specified before (on page 5) which type of exonic variants were retained (listed on page 6)

This has been added, thank you for the suggestion.

- It would be good to specify the list of in silico tools used by Ensembl (VEP) to predict pathogenicity

This has been specified.

- Did the authors consider cross checking some of the level 1/2 variants with ACMG/AMP predictions?

The main aim of our work was to collect, standardize, and translate the variants linked to monogenic diabetes using open-source and freely available tools and databases. There are many different tools for ACMG/AMP classification such as older ones (doi: 10.1186/s13059-017-1353-5) and newer machine learning-based ones (doi: 10.1038/s41598-022-06547-3) as well as commercial tools. To our understanding, these classifiers are designed to be used on datasets of variants called from actual sequencing data rather than genomic knowledgebases. We find this analysis an important and interesting part of the patient classification framework but it is outside the scope of our study.

- Did the authors apply an alternative allele frequency cut-off? Perhaps some of the e.g. nonsense variants might be common.

The main goal of our work was to collect and standardize the information on the possible protein alterations connected to monogenic diabetes. For this reason, we based our variant selection primarily on the variant location (exonic variants), secondarily on protein consequences (missense SNP, frameshift etc.), and thirdly on reported pathogenicity. For the latter, we separated our database into two levels: one including all the variants and the second one including just the pathogenic ones. This approach is implemented to address the limitations of the ‘street light effect’ appearing in mass spectrometry-based proteomics. Since the proteomics spectra are analyzed against a protein sequence database, the sequences not included in the database have no chance of being found in the samples. For this reason, we tried to keep the level 2 database as thorough as possible and create a strict version of the database limited to only pathogenic variants. Here we did not use any allele frequency cut-off. Nevertheless, we controlled for the alternative allele frequencies of the variants for which they were available using the Ensemple REST API and see that the level 2 database contains approximately 8.5% of common and 11% of low-frequency variants while the level 1 database contains 0.3% of low frequency variants and no common variants. We did not include this analysis in the manuscript as we believe that it will introduce complexity and distract attention from the main purpose of our study.

- Page 8: Variants in BLK, KLF11 and PAX4 should be removed for dominant monogenic diabetes and it is still nonetheless considered controversial.

We thank the reviewer for this suggestion, these genes have been discussed at length in our lab during the past years. We agree with the reviewer and have removed them from the level 2 database but kept them in level 1, as level 1 is the most complete collection of variants that have been reported. We mention the controversy on these three genes and cite the paper discussing it on page 12.

- Supp Table 5: would change to Yes/No in Rafique column

This has been corrected

- Perhaps Links should be included as footnotes (rather than references in text)

This has been corrected in the LaTex version following the template of the journal.

Reviewer #3:

We thank reviewer 3 for their critical review of our work. We have implemented all suggestions as detailed in the comments below.

The work presented is thorough, though I was unable to personally validate the coding implementation. Additionally, the authors did not demonstrate this approach generalizes well to other diseases, making it difficult to assess wider utility.

We have reproduced the pipeline on an example of a Hajdu-Cheney syndrome. All the files can be found in GitHub in the "HCS" directory. The text has been extended accordingly (see page 14).

Some of the approaches rely on circular logic - for example, the variants in Module 1 already include ClinVar data and use the Ensemble Variant Effect Predictor, which provides comprehensive annotations.

While this tool aims to fill a need, numerous established resources (DECIPHER, VEP etc.) and their continuous expansions already provide rich variant annotation and data integration. As more addons targeting monogenic diseases are actively developed and included in these tools actively the niche for this specific tool may diminish over time due to manual update needed for this work.

Overall, this manuscript describes a thoughtful effort to aggregate information on monogenic diabetes variants. However, given the breadth of existing tools, I am unable to clearly recognize the unmet need this resource fills in the community.

We are sorry to read that we failed to convey how our pipeline answers a need from the biomedical community. The main aim of our work is to collect genetic variants linked to monogenic information and translate them into protein sequences. While we acknowledge the value of resources like VEP, DECYPHER, and ClinVar, the nature of rare diseases makes it challenging for generalist solutions to stay updated with field-specific advances. When creating proteomic databases enhanced with genetic data to analyze patients' proteomes, the community currently often relies on manual sequence analysis. While we share the optimism of the reviewer that specialist addons will be included, eventually streamlining the work on rare diseases, we believe that to date, semi-automated approaches like ours provide a good compromise between exhaustivity and reproducibility.

Reviewer #4:

We thank Prof. Stojiljković for their appreciation of our contribution and a valuable suggestion to change the title. We have changed it accordingly: “Bioinformatics pipeline for the systematic mining genomic and proteomic variation linked to rare diseases: the example of monogenic diabetes”

Attachments
Attachment
Submitted filename: answers_to_reviewers.pdf
Decision Letter - Kazunori Nagasaka, Editor

Bioinformatics pipeline for the systematic mining genomic and proteomic variation linked to rare diseases: the example of monogenic diabetes

PONE-D-23-29592R1

Dear Dr. Kuznetsova,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Kazunori Nagasaka

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Dear Authors,

Thank you so much for submitting your manuscript to JOGR.

Now your manuscript is acceptable for publication in Plos One.

We look forward to your future submission.

Sincerely,

Kazunori Nagasaka

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

Reviewer #4: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #4: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: Yes

Reviewer #4: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #4: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #4: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The revision has addressed my questions with satisfaction. The quality of revision is substantially improved over the original version.

Reviewer #2: (No Response)

Reviewer #4: The authors made changes in line with the first round of the review. I do not have any further comments.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: San Ming Wang

Reviewer #2: No

Reviewer #4: Yes: Maja Stojiljkovic

**********

Formally Accepted
Acceptance Letter - Kazunori Nagasaka, Editor

PONE-D-23-29592R1

PLOS ONE

Dear Dr. Kuznetsova,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Professor Kazunori Nagasaka

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .