Peer Review History

Original SubmissionJune 9, 2025
Decision Letter - Wei Lan, Editor

Inferring pathway activities for single-cell and spatial transcriptomics data with PaaSc

PLOS Computational Biology

Dear Dr. Shi,

Thank you for submitting your manuscript to PLOS Computational Biology. After careful consideration, we feel that it has merit but does not fully meet PLOS Computational Biology's publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript within 60 days Aug 30 2025 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at ploscompbiol@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pcompbiol/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

* A rebuttal letter that responds to each point raised by the editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'. This file does not need to include responses to formatting updates and technical items listed in the 'Journal Requirements' section below.

* A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

* An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, competing interests statement, or data availability statement, please make these updates within the submission form at the time of resubmission. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter

We look forward to receiving your revised manuscript.

Kind regards,

Wei Lan

Academic Editor

PLOS Computational Biology

Ilya Ioshikhes

Section Editor

PLOS Computational Biology

Journal Requirements:

1) We ask that a manuscript source file is provided at Revision. Please upload your manuscript file as a .doc, .docx, .rtf or .tex. If you are providing a .tex file, please upload it under the item type u2018LaTeX Source Fileu2019 and leave your .pdf version as the item type u2018Manuscriptu2019. 

2) Please provide an Author Summary. This should appear in your manuscript between the Abstract (if applicable) and the Introduction, and should be 150-200 words long. The aim should be to make your findings accessible to a wide audience that includes both scientists and non-scientists. Sample summaries can be found on our website under Submission Guidelines: 

https://journals.plos.org/ploscompbiol/s/submission-guidelines#loc-parts-of-a-submission 

3) Please upload all main figures as separate Figure files in .tif or .eps format. For more information about how to convert and format your figure files please see our guidelines:  

https://journals.plos.org/ploscompbiol/s/figures 

4) We notice that your supplementary Figures are included in the manuscript file. Please remove them and upload them with the file type 'Supporting Information'. Please ensure that each Supporting Information file has a legend listed in the manuscript after the references list. 

5) Some material included in your submission may be copyrighted. According to PLOSu2019s copyright policy, authors who use figures or other material (e.g., graphics, clipart, maps) from another author or copyright holder must demonstrate or obtain permission to publish this material under the Creative Commons Attribution 4.0 International (CC BY 4.0) License used by PLOS journals. Please closely review the details of PLOSu2019s copyright requirements here: PLOS Licenses and Copyright. If you need to request permissions from a copyright holder, you may use PLOS's Copyright Content Permission form. 

Please respond directly to this email and provide any known details concerning your material's license terms and permissions required for reuse, even if you have not yet obtained copyright permissions or are unsure of your material's copyright compatibility. Once you have responded and addressed all other outstanding technical requirements, you may resubmit your manuscript within Editorial Manager.  

Potential Copyright Issues: 

i) Figure 6. Please confirm whether you drew the images / clip-art within the figure panels by hand. If you did not draw the images, please provide (a) a link to the source of the images or icons and their license / terms of use; or (b) written permission from the copyright holder to publish the images or icons under our CC BY 4.0 license. Alternatively, you may replace the images with open source alternatives. See these open source resources you may use to replace images / clip-art:

- https://commons.wikimedia.org

- https://openclipart.org/.

6) We note that your Data Availability Statement is currently as follows: "All relevant data are within the manuscript and its Supporting Information files.". Please confirm at this time whether or not your submission contains all raw data required to replicate the results of your study. Authors must share the “minimal data set” for their submission. PLOS defines the minimal data set to consist of the data required to replicate all study findings reported in the article, as well as related metadata and methods (https://journals.plos.org/plosone/s/data-availability#loc-minimal-data-set-definition). 

For example, authors should submit the following data:  

1) The values behind the means, standard deviations and other measures reported;

2) The values used to build graphs;

3) The points extracted from images for analysis.. 

Authors do not need to submit their entire data set if only a portion of the data was used in the reported study. 

If your submission does not contain these data, please either upload them as Supporting Information files or deposit them to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of recommended repositories, please see https://journals.plos.org/plosone/s/recommended-repositories.  

If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent. If data are owned by a third party, please indicate how others may request data access. 

7) Please amend your detailed Financial Disclosure statement. This is published with the article. It must therefore be completed in full sentences and contain the exact wording you wish to be published. 

1) State the initials, alongside each funding source, of each author to receive each grant. For example: "This work was supported by the National Institutes of Health (####### to AM; ###### to CJ) and the National Science Foundation (###### to AM)."

2) State what role the funders took in the study. If the funders had no role in your study, please state: "The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript."

3) If any authors received a salary from any of your funders, please state which authors and which funders.. 

If you did not receive any funding for this study, please simply state: u201cThe authors received no specific funding for this work.u201d 

8) Please send a completed 'Competing Interests' statement, including any COIs declared by your co-authors. If you have no competing interests to declare, please state "The authors have declared that no competing interests exist". Otherwise please declare all competing interests beginning with the statement "I have read the journal's policy and the authors of this manuscript have the following competing interests"

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: In the manuscript, a method called the PaaSc is proposed for inferring pathway activities for single-cell data. Benchmark comparisons with some other existing methods are done on several publicly available datasets. However, the manuscript is written in an unintelligible way, and I found it hard to comprehend the novelty of the method accurately and understand why it is better than other benchmark methods. The manuscript should be thoroughly reorganized and rewritten in a clearer and more understandable way before I can better evaluate the strengths of the proposed method.

1. The introduction of the implementation of the proposed method is confusing. The authors should present a flowchart or an Algorithm box to show how the PaaSC method works.

2. The organization of the manuscript is somewhat confusing. The captions should align with the figures, and I found it very difficult to go back and forth to check the figures and then jump back to the captions for illustration.

3. In Fig. 2, the AUC scores from different methods are compared. Why does the AUC score matter? I am not fully convinced that the proposed method performs better than the other methods. Also, it seems that GSdensity and CelliD yield a similar AUC score to the proposed PaaSC method.

4. Continuing with 3, can the authors provide some theoretical justifications on why the proposed method performs better than the benchmarks? If some insightful understanding could be provided, readers would have a better understanding of the merits of the proposed method.

5. There are some abbreviations that make it harder to understand the manuscript. E.g., FDR, AUC, SMI... I would suggest making a list of notations at the beginning.

6. Introductions on distinct datasets and their underlying biological significance will be helpful for the readers to understand better why to use those datasets.

7. How are the thresholds for p and FDR determined? I noticed that different thresholds are used across different examples. Some are 0.001 while others are 0.05 or 0.0001.

Reviewer #2: The authors developed a computational method, named PaaSc, for inferring pathway activities at single cell level. The results on diverse benchmark datasets demonstrated superior performance over existing SOTA methods in multiple applications. This work has made certain improvements to the published methods. But there are several concerns should be addressed:

(1)The term "pathway activities" is mentioned in the title, yet it is not directly reflected in the subtitles. It gives the impression of being a compilation of experimental results. Is it necessary to include a paragraph elaborating the association between “pathway” and the experiments?

(2)The AUC metric in line 36 and line 90 is the same term? If the same, please maintain consistency in using the full term.

(3)In line 123, the name of the database should be TISCH.

(4)In line 177, “IL 16” does not appear in Figure 4E.

(5)In line 190, there should not be a space between “CD ” and “4”.

(6)In line 206, the middle panel should be the right panel.

(7)In line 210, the SMI approach is not described in detail in the Method section, and it's also unclear what the value of SMI represents.

(8)In line 313, what dose the “P12M” mean?

Reviewer #3: Manuscript Title: Inferring pathway activities for single-cell and spatial transciptomics data with PaaSC

Summary of the Study

This manuscript addresses a major problem that is being observed across science disciplines: “translating high-dimensional data into functional pathway insights”. This manuscript really begins to address a broader problem the scientific community faces in that we generate mass quantities of data but do not fully utilize the data for discovery due to limitations in tools easily accessible or even availablity. The authors developed PaaSC to address this problem with highlighting the novelty of using biologically informative components through linear regression relative to other similar models (CelliD, GSDensity) which they thoroughly benchmarked against. Through a series of rigorous computational benchmarks, the authors demonstrate that PaaSC outperforms other similar platforms in MOST scenarios. There is a need to really interrogate the processes on how data are processed for analysis. This is one area that biologist overlook not fully understanding the limitations of computational approaches in data analysis. The authors clearly understand this and have taken steps towards improving this. While the overall topic is of interest and relevant to the journal, the manuscript suffers from some minor technical, editorial, and conceptual weaknesses in its current form.

General comments:

• The manuscript was well written with clearly framing the gaps in knowledge, the current state of the field, and where improvements need to be made in data analysis. This was very thoughtfully put together. The authors did very well in presenting a current limitation in analyses that have difficulties reliably identifying subtle and contextual biological changes. There is huge value in understanding subtle changes which goes to understanding cell groundstate or plasticity, an area of research more and more are accepting and going towards in our fundamental understanding of developmental biology.

• The discussion section overall read more like a summary of findings rather than a discussion. I strongly suggest the authors reframe this section, consider what their approach means, where future improvements lie and what are the major next hurdles to conquer (not just PaaSC).

• Reading the text and assessing the data, the language used appears to exaggerate the findings and comes off as overstating the performance. “superior” is a qualitative term and I would suggest changing this to use more quantitative measure. This will overcome that issue. For example, in line 165 the authors have done this and therefore can now use that term because they included the quantitative value.

• Qualitative Overreliance in the Results Section: The manuscript repeatedly uses qualitative descriptors such as “increased,” “reduced,” and “enhanced” without reporting actual fold-changes or percent differences. This weakens the impact of the findings and makes it difficult to evaluate the robustness of the effects. As the authors have done the analyses, they should include them in the narrative of the results section.

• The spatial transcriptomic analysis rationale was strongly built but the outcome and what was delivered was quite underwhelming presented. This is huge area that needs to be highlighted more as there is a massive shift for people using these types of analyses. I strongly recommend the authors expand on this section. Because they spent so much time benchmarking the other data sets and approaches, they undermine themselves by not ding that here as well. Please keep the nice continuity you have built with this section and expand upon it in greater detail.

• Definitions: multiple terms are not defined in the manuscript including PaaSC, REAP-seq, etc….

• The authors discuss and analyze some biological features in Figure 4. I would suggest if they can highlight any novelty they found in these analyses that would have been overlooked by the other benchmarked approaches…this would really strengthen their arguments and convince non-computational individuals about the value of this work.

• Figure and Image Quality Figures general are difficult to follow. This may be a labelling problem. Color coordination patterns are mixed within figures which causes some confusion. A lot of this would be attributed to font size, scaling of the graphs, the tick marks on the axes, the labeling of the graphs. Visualization is extremely important. Figures 2 and 3 use a lot to the same box plots and when looking at this, it is too much data to take in as shown. I would suggest changing the visualization of these box blots to make it clearer what they want to show us.

**********

Have the authors made all data and (if applicable) computational code underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data and code underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data and code should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data or code —e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean? ). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy .

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

Figure resubmission:

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. If there are other versions of figure files still present in your submission file inventory at resubmission, please replace them with the PACE-processed versions.

Reproducibility:

To enhance the reproducibility of your results, we recommend that authors of applicable studies deposit laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

Revision 1

Attachments
Attachment
Submitted filename: Response-to-reviewers.docx
Decision Letter - Wei Lan, Editor

PCOMPBIOL-D-25-01147R1

Inferring pathway activities for single-cell and spatial transcriptomics data with PaaSc

PLOS Computational Biology

Dear Dr. Shi,

Thank you for submitting your manuscript to PLOS Computational Biology. After careful consideration, we feel that it has merit but does not fully meet PLOS Computational Biology's publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript within 30 days Nov 29 2025 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at ploscompbiol@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pcompbiol/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

* A rebuttal letter that responds to each point raised by the editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'. This file does not need to include responses to formatting updates and technical items listed in the 'Journal Requirements' section below.

* A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

* An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, competing interests statement, or data availability statement, please make these updates within the submission form at the time of resubmission. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

We look forward to receiving your revised manuscript.

Kind regards,

Wei Lan

Academic Editor

PLOS Computational Biology

Ilya Ioshikhes

Section Editor

PLOS Computational Biology

**********

Note: If the reviewer comments include a recommendation to cite specific previously published works, please review and evaluate these publications to determine whether they are relevant and should be cited. There is no requirement to cite these works unless the editor has indicated otherwise.

**********

Reviewers' comments:

Reviewer's Responses to Questions

Reviewer #1: The authors have addressed most of my concerns. However, I noticed that new typos and compiling errors were introduced. The mathematical formulas are not compiled corrected starting from Eq. 2. Therefore, I suggest that the authors check the manuscript thoroughly and revise any potential typos and compiling errors again.

Reviewer #3: Thank you for addressing my comments as well as the other reviewers. I am satisfied with the changes you have made. I agree that your manuscript and story have been greatly improved.

**********

Have the authors made all data and (if applicable) computational code underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data and code underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data and code should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data or code —e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #3: Yes

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean? ). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy .

Reviewer #1: No

Reviewer #3: Yes:  Eric Rahrmann

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

Figure resubmission:

Reproducibility:

To enhance the reproducibility of your results, we recommend that authors of applicable studies deposit laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

Revision 2

Attachments
Attachment
Submitted filename: Response-to-reviewers_auresp_2.docx
Decision Letter - Wei Lan, Editor

Dear Dr. Shi,

We are pleased to inform you that your manuscript 'Inferring pathway activity from single-cell and spatial transcriptomics data with PaaSc' has been provisionally accepted for publication in PLOS Computational Biology.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests.

Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated.

IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript.

Should you, your institution's press office or the journal office choose to press release your paper, you will automatically be opted out of early publication. We ask that you notify us now if you or your institution is planning to press release the article. All press must be co-ordinated with PLOS.

Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Computational Biology. 

Best regards,

Wei Lan

Academic Editor

PLOS Computational Biology

Ilya Ioshikhes

Section Editor

PLOS Computational Biology

***********************************************************

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: The authors have fixed the compiling issue and addressed my concerns.

**********

Have the authors made all data and (if applicable) computational code underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data and code underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data and code should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data or code —e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: None

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean? ). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy .

Reviewer #1: No

Formally Accepted
Acceptance Letter - Wei Lan, Editor

PCOMPBIOL-D-25-01147R2

Inferring pathway activity from single-cell and spatial transcriptomics data with PaaSc

Dear Dr Shi,

I am pleased to inform you that your manuscript has been formally accepted for publication in PLOS Computational Biology. Your manuscript is now with our production department and you will be notified of the publication date in due course.

The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript.

Soon after your final files are uploaded, unless you have opted out, the early version of your manuscript will be published online. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers.

For Research, Software, and Methods articles, you will receive an invoice from PLOS for your publication fee after your manuscript has reached the completed accept phase. If you receive an email requesting payment before acceptance or for any other service, this may be a phishing scheme. Learn how to identify phishing emails and protect your accounts at https://explore.plos.org/phishing.

Thank you again for supporting PLOS Computational Biology and open-access publishing. We are looking forward to publishing your work!

With kind regards,

Anita Estes

PLOS Computational Biology | Carlyle House, Carlyle Road, Cambridge CB4 3DN | United Kingdom ploscompbiol@plos.org | Phone +44 (0) 1223-442824 | ploscompbiol.org | @PLOSCompBiol

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .