Peer Review History

Original SubmissionDecember 16, 2023
Decision Letter - Ilya Ioshikhes, Editor, Lewis M. Antill, Editor

Dear Prof .Dr. Klughammer,

Thank you very much for submitting your manuscript "BoReMi: Bokeh-based jupyter-interface for Registering spatio-molecular data to related Microscopy images" for consideration at PLOS Computational Biology.

As with all papers reviewed by the journal, your manuscript was reviewed by members of the editorial board and by several independent reviewers. In light of the reviews (below this email), we would like to invite the resubmission of a significantly-revised version that takes into account the reviewers' comments.

We cannot make any decision about publication until we have seen the revised manuscript and your response to the reviewers' comments. Your revised manuscript is also likely to be sent to reviewers for further evaluation.

When you are ready to resubmit, please upload the following:

[1] A letter containing a detailed list of your responses to the review comments and a description of the changes you have made in the manuscript. Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

[2] Two versions of the revised manuscript: one with either highlights or tracked changes denoting where the text has been changed; the other a clean version (uploaded as the manuscript file).

Important additional instructions are given below your reviewer comments.

Please prepare and submit your revised manuscript within 60 days. If you anticipate any delay, please let us know the expected resubmission date by replying to this email. Please note that revised manuscripts received after the 60-day due date may require evaluation and peer review similar to newly submitted manuscripts.

Thank you again for your submission. We hope that our editorial process has been constructive so far, and we welcome your feedback at any time. Please don't hesitate to contact us if you have any questions or comments.

Sincerely,

Lewis M. Antill

Guest Editor

PLOS Computational Biology

Ilya Ioshikhes

Section Editor

PLOS Computational Biology

***********************

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: Ishar et al. have developed an innovative python-based, interactive visual tool, BoReMi, for the manual alignment of spatial molecular data to images through rigid transformations. This tool emerges as a particularly valuable resource amid the growing adoption of spatial molecular profiling technologies, offering an integrative and interactive solution that stands out in the current landscape of similar software. BoReMi's functionality is both timely and highly beneficial, manuscript written clearly and code is clear. I recommend its publication after minor edits.

My comments below, largely reflective of enhancements for a potential version 2, are intended to further distinguish BoReMi from competing methodologies. Additionally, I suggest several improvements to the manuscript for a more impactful presentation of BoReMi's capabilities:

1- Non-linear Transformations: The tool currently supports rigid transformations, showcasing exceptional performance with large imaging files. This feature is invaluable for initial alignment tasks. However, for comprehensive utility, it would be beneficial if the discussion section could recommend non-linear alignment tools that complement BoReMi for subsequent alignment steps.

2- Streamlining the Results Section: The middle part of the Results section, which details a specific analysis process, could be condensed or moved to supplementary materials or an online guide. This adjustment would allow the main text to more effectively highlight BoReMi's versatile features and their applicability across various scenarios.

3- Visualization Capabilities: It would be valuable if the authors could discuss whether BoReMi can display cluster assignments in different colors and how it utilizes the inherent molecular information of spatial transcriptomics data. Additionally, the ability to handle and visually represent continuous molecular expression data would significantly enhance BoReMi. These points can be added as how to or in discussion.

4- Computational Performance: The manuscript should detail the computational requirements of BoReMi, especially how it scales with the size of the molecular data and image database. Given the substantial size of Merscope files, ensuring that user has the right tools to run BoReMi.

Minor Points:

- The manuscript hints at the potential for processing multiple spatio-molecular data sets simultaneously but does not delve into this feature. Clarification on the concurrent visualization and independent manipulation of different data sets would be beneficial.

- Introducing a record log of all performed transformations would aid reproducibility and enable users to replicate alignments with other tools.

- Further explanation on whether users can select which data set serves as the reference during alignment and the possibility of applying transformations in reverse would enhance BoReMi's flexibility.

In its current form, we will likely use BoReMi as the first step to check alignment pairs before applying elastic like tools. These suggestions aim to refine both BoReMi's functionality and its presentation which are already at a very high standard.

Reviewer #2: The manuscript from Ishar, Tam and Klughammer describes the tool BoReMi for aligning spatial molecular data (i.e., spatial distributions of transcripts or proteins) to imaging data such as from Haematoxylin & Eosin stains of tissue. Such alignment is key if one is to make biological sense of molecular data, since these data typically lack information about tissue structure. Further, more and more such spatio-molecular datasets are likely to be generated and analysed in the next years. Tools in this sphere are therefore important and timely, and as such this paper is potentially of wide interest. BoReMi is easy to use, doesn’t need coding experience, and has a nice interactive demo – these are all strengths.

In its present form however, the manuscript is very minimalist. To us it reads as more of an announcement of the tool than as a research paper. There are several points we think should be addressed before the paper can be published in PLoS Computational Biology.

Major points

1. Overall, the authors should make a better case for this tool. As they state, there are existing tools for doing such alignments. For instance, STAlign was recently published (PMID: 38065970) and landmark-based affine transformation has been used for some time. The authors cite existing approaches, but they don’t compare the performance of their tool to the state-of-the-art, or discuss in any depth the unique use cases for BoReMi-based alignment beyond the need for generating manual ground truth. At a minimum, this should be argued in more detail. Even better, the authors should compare performance to existing approaches and possibly even show an instance of how BoReMi alignment can be used to solve a problem or address a question inaccessible with existing approaches.

2. A single example of data integration with a single type of molecular data (MERFISH data) is given. This example is furthermore not at single-cell resolution and uses very structured image data (i.e., brain tissue, with alignment based on hippocampus structure). Does BoReMi work for single cells? For tissue with more homogenous structure (e.g., tumors)? Does it work for data types other than MERFISH? The manuscript and potential users would benefit from some more examples and a clearer assessment of cases where this approach is/is not likely to be beneficial.

3. Importantly, there is no assessment of how well the manual alignment with BoReMi works, neither any sort of sanity check (e.g., do well studied cell types or tissue regions show the expected molecular profiles?), nor any quantitative assessment. The authors are proposing that alignments generated by BoReMi can be used as ground truth to quantitatively check automated alignment methods; isn’t it crucial then that the manual alignment is accurate? How would the authors assess this in their own work and how would a user of BoReMi be expected to do so?

4. The manuscript states (lines 228-229) that cell type assignments or clusters are optional, but this did not seem to be the case when we tested the tool. These annotations appear mandatory, meaning that preprocessing of the molecular data is necessary to use BoReMi. What are the requirements for this preprocessing? There is no information provided on input file format specifications for the molecular data (e.g., csv with cell ids, center cell coordinates, other?); any requirements should be described in detail. If this type of preprocessing or annotation is not mandatory, the authors should then show how the alignment works without it.

5. How does BoReMi deal with any need for non-linear transformations, or combinations of linear and non-linear transformations? How does it deal with things like tissue tears or folds?

6. From a user perspective, it would be extremely practical to have a reset/undo button in BoReMi, for instance if one makes a mistake or decides to try a different strategy during alignment. At present it seems one must re-do the full alignment process in such cases.

7. In the README on GitHub, inexperienced users would benefit from a more detailed explanation of how to create the conda-environment (e.g. conda create -n) and how to install respective package from the .txt (e.g. conda install --file requirements.txt). In general, the more tutorial-like information that can be generated for users, the better.

Minor points

8. On lines 250-252, the manuscript refers to a new image having to be selected. This is confusing. Isn’t it the case that there is a single image (i.e., the consecutive section) that needs to be aligned to the molecular (MERFISH) data? Why should one be able to select one out of many images?

9. It was not possible to reproduce the results from the paper using the settings shown in Figure 2. Perhaps these settings were not intended for this purpose, but we suggest that the values shown in the figure should then be corrected, or the correct settings given somewhere clearly in the paper (if the tool is indeed deterministic).

10. Cluster selection no longer works once regions are selected with the toolbar (e.g. box selection) – is this a bug in the software?

11. The step sizes used for adjusting the data point size and the x/y coordinates are very small. Is there a reason for this? Is it tailored for single-cell matching? That would make it all the more compelling to show such an example.

12. It may be useful to include a small example dataset directly in the GitHub repository.

13. The authors could consider integrating this with popular python-based image viewers such as napari (as a plugin).

14. It would be helpful to mention minimal computational requirements for smooth running of BoReMi if any (e.g., memory use). Also, we also found no information on whether the software would be frozen or continually updated; it would be good to know in regard to software unit testing and validation checks.

**********

Have the authors made all data and (if applicable) computational code underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data and code underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data and code should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data or code —e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Ozgun Gokce

Reviewer #2: Yes: Dr. Natalie de Souza

Figure Files:

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org.

Data Requirements:

Please note that, as a condition of publication, PLOS' data policy requires that you make available all data used to draw the conclusions outlined in your manuscript. Data must be deposited in an appropriate repository, included within the body of the manuscript, or uploaded as supporting information. This includes all numerical values that were used to generate graphs, histograms etc.. For an example in PLOS Biology see here: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001908#s5.

Reproducibility:

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

Revision 1

Attachments
Attachment
Submitted filename: PbP_forSubmission.pdf
Decision Letter - Ilya Ioshikhes, Editor, Lewis M. Antill, Editor

Dear Prof .Dr. Klughammer,

We are pleased to inform you that your manuscript 'BoReMi: Bokeh-based jupyter-interface for Registering spatio-molecular data to related Microscopy images' has been provisionally accepted for publication in PLOS Computational Biology.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests.

Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated.

IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript.

Should you, your institution's press office or the journal office choose to press release your paper, you will automatically be opted out of early publication. We ask that you notify us now if you or your institution is planning to press release the article. All press must be co-ordinated with PLOS.

Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Computational Biology. 

Best regards,

Lewis M. Antill

Guest Editor

PLOS Computational Biology

Ilya Ioshikhes

Section Editor

PLOS Computational Biology

***********************************************************

We thank the authors for their revisions, to which the reviewers find the manuscript much improved and is now ready for publication after two minor corrections (please see comments from Reviewer 2).

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: I thank the authors for their thorough revisions and responses. The BoReMi tool effectively addresses the crucial need for registering spatio-molecular data to microscopy images, showcasing its versatility in this area. The manuscript is clearly written, the code is robust, and the figures are well-executed. I strongly support the publication of this elegant work.

Reviewer #2: I find the manuscript much improved and recommend publication.

Two v. small things:

- in the legend of Figure 3b (which is very nice), I found the term 'cell-segmented' odd since it isn't what is typically referred to as cell segmentation

- in the legend of Figure 4a, I would make clear that the molecular data is blue in the 'before alignment' panel and green in the 'after alignment' panel.

**********

Have the authors made all data and (if applicable) computational code underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data and code underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data and code should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data or code —e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Ozgun Gokce

Reviewer #2: Yes: Natalie de Souza

Formally Accepted
Acceptance Letter - Ilya Ioshikhes, Editor, Lewis M. Antill, Editor

PCOMPBIOL-D-23-02043R1

BoReMi: Bokeh-based jupyter-interface for Registering spatio-molecular data to related Microscopy images

Dear Dr Klughammer,

I am pleased to inform you that your manuscript has been formally accepted for publication in PLOS Computational Biology. Your manuscript is now with our production department and you will be notified of the publication date in due course.

The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript.

Soon after your final files are uploaded, unless you have opted out, the early version of your manuscript will be published online. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers.

Thank you again for supporting PLOS Computational Biology and open-access publishing. We are looking forward to publishing your work!

With kind regards,

Anita Estes

PLOS Computational Biology | Carlyle House, Carlyle Road, Cambridge CB4 3DN | United Kingdom ploscompbiol@plos.org | Phone +44 (0) 1223-442824 | ploscompbiol.org | @PLOSCompBiol

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .