Peer Review History

Original SubmissionOctober 19, 2023
Decision Letter - Lin Chen, Editor, Xiaofeng Zhu, Editor

Dear Dr Lin,

Thank you very much for submitting your Methods entitled 'INSIDER: Interpretable Sparse Matrix Decomposition for RNA Expression Data Analysis' to PLOS Genetics.

The manuscript was fully evaluated at the editorial level and by independent peer reviewers. The reviewers appreciated the attention to an important problem, but raised some concerns about the current manuscript. Based on the reviews, we will not be able to accept this version of the manuscript, but we would be willing to review a much-revised version. We cannot, of course, promise publication at that time.

Should you decide to revise the manuscript for further consideration here, your revisions should address the specific points made by each reviewer. We will also require a detailed list of your responses to the review comments and a description of the changes you have made in the manuscript.

If you decide to revise the manuscript for further consideration at PLOS Genetics, please aim to resubmit within the next 60 days, unless it will take extra time to address the concerns of the reviewers, in which case we would appreciate an expected resubmission date by email to plosgenetics@plos.org.

If present, accompanying reviewer attachments are included with this email; please notify the journal office if any appear to be missing. They will also be available for download from the link below. You can use this link to log into the system when you are ready to submit a revised version, having first consulted our Submission Checklist.

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

Please be aware that our data availability policy requires that all numerical data underlying graphs or summary statistics are included with the submission, and you will need to provide this upon resubmission if not already present. In addition, we do not permit the inclusion of phrases such as "data not shown" or "unpublished results" in manuscripts. All points should be backed up by data provided with the submission.

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool.  PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org.

PLOS has incorporated Similarity Check, powered by iThenticate, into its journal-wide submission system in order to screen submitted content for originality before publication. Each PLOS journal undertakes screening on a proportion of submitted articles. You will be contacted if needed following the screening process.

To resubmit, use the link below and 'Revise Submission' in the 'Submissions Needing Revision' folder.

We are sorry that we cannot be more positive about your manuscript at this stage. Please do not hesitate to contact us if you have any concerns or questions.

Yours sincerely,

Lin Chen, Ph.D.

Academic Editor

PLOS Genetics

Xiaofeng Zhu

Section Editor

PLOS Genetics

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: This article proposed a dimension reduction approach for RNA expression data to decompose variation from different biological variables, which overcomes some limitations of the existing methods and was shown to be useful in the real data analysis. My comments are as follows.

1. It is still not very clear to me how to interpret the metagenes together with the covariates, especially the matrix V. Because it seems that V has nothing to do with the covariates, but the metagenes from INSIDER would be different under the models with different covariates. Also, what is the difference in the interpretation of the metagenes obtained from INSIDER compared to those obtained from PCA or factor analysis?

2. The article mentioned that “INSIDER decomposes variation from different biological variables”, but only the discrete covariates have been discussed. Is INSIDER also able to handle the continuous covariates?

3. In the real data analysis of BrainSpan data, development stages and brain regions are used as covariates. However, the development stages are in chronological order. Does INSIDER handle the ordinal variables and the unordered categorical variables in the same manner?

4. In the section “Metagenes reveal development trajectories”, it said “The expression level of the most variable metagene is high before late fetal stages and decreases to a low level after early childhood”. I wonder how the expression level of the metagene is calculated. Is there an explicit formula of the metagene? Could the author give more details?

5. In the enrichment analyse for a metagene, say the 2nd metagene, it is not clear to me how to conduct the analyse because the metagene is a latent variable. It would be beneficial if more details could be provided.

Reviewer #2: Dimension reduction is critically important in data exploration analysis. Particularly it provides the stepstone to understand the biological signals in high dimensional RNA-seq data. In this paper, the authors propose INSIDER, a general and flexible statistical framework based on matrix factorization. INSIDER decomposes variation from different biological variables and their interactions into a shared low-rank latent space. Particularly, it introduces the elastic net penalty to induce sparsity while considering the grouping effects of genes. It can achieve dimension reduction of high-dimensional data (of >=3 dimensions), as opposed to conventional methods (e.g., PCA/NMF) which generally only handle 2D data (e.g., sample ´ expression). Besides, it enables computing 'adjusted' expression profiles for specific biological variables while controlling variation from other variables.

Overall, the idea is novel and to develop new method to explain the data. better. INSIDER is a general and flexible framework. It can capture interactions between variables or covariate and encourages sparsity in latent representations by imposing the elastic net penalty. The advantages have been highlighted. The paper is well written and the motivation is explained quite clear.

My minor concern is as follows,

1. To use INSIDER well, the users have to know the major variation sources. For example, it’s quite typical for expression data with donors, phenotypes, tissues information. But sometimes those information is not available. How should the method be used?

2. The authors added the phenotype by tissue interactions as an example. To make the method more general, it’s better to having one version without interaction term. It’s also good to demonstrate how the interaction term improves the results.

3. To highlight the high-dimensional data (of >=3 dimensions), it’s better to have more examples to show high-dimensional data is common and quite general case in practice.

4. The choice of K is a multi-scale problem. How should we choose it in practice.

5. It’s better to provide software in Github.

From the editorial board:

Two reviewers and the editorial team have reviewed the manuscript. They showed overall enthusiasm for the proposed method as a general and principled approach to dimension reduction, while also offering several suggestions as follow. Please carefully review those questions and suggestions and respond to them accordingly.

Firstly, the authors claim that the INSIDER method can manage missing data. However, this aspect isn't explored in depth. The effect of significant and complex missing data remains uncertain. It would be beneficial to conduct further evaluations through simulation studies.

Additionally, as one reviewer highlighted, the process for determining the rank K in the latent space is vague. A more clear, justifiable, and efficient method for the choice is needed.

Regarding the analysis of real data, the comparison to standard and frequently used methods like PCA or GLM-based approaches is inadequate. While some discussions are present, more detailed comparative analyses are required.

Lastly, showing additional simulation results in cases of model misspecification would be informative.

**********

Have all data underlying the figures and results presented in the manuscript been provided?

Large-scale datasets should be made available via a public repository as described in the PLOS Genetics data availability policy, and numerical data that underlies graphs or summary statistics should be provided in spreadsheet form as supporting information.

Reviewer #1: None

Reviewer #2: Yes

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Revision 1

Attachments
Attachment
Submitted filename: Insider_response_letter_v4.docx
Decision Letter - Lin Chen, Editor, Xiaofeng Zhu, Editor

Dear Dr Lin,

We are pleased to inform you that your manuscript entitled "INSIDER: Interpretable Sparse Matrix Decomposition for RNA Expression Data Analysis" has been editorially accepted for publication in PLOS Genetics. Congratulations!

Before your submission can be formally accepted and sent to production you will need to complete our formatting changes, which you will receive in a follow up email. Please be aware that it may take several days for you to receive this email; during this time no action is required by you. Please note: the accept date on your published article will reflect the date of this provisional acceptance, but your manuscript will not be scheduled for publication until the required changes have been made.

Once your paper is formally accepted, an uncorrected proof of your manuscript will be published online ahead of the final version, unless you’ve already opted out via the online submission form. If, for any reason, you do not want an earlier version of your manuscript published online or are unsure if you have already indicated as such, please let the journal staff know immediately at plosgenetics@plos.org.

In the meantime, please log into Editorial Manager at https://www.editorialmanager.com/pgenetics/, click the "Update My Information" link at the top of the page, and update your user information to ensure an efficient production and billing process. Note that PLOS requires an ORCID iD for all corresponding authors. Therefore, please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field.  This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager.

If you have a press-related query, or would like to know about making your underlying data available (as you will be aware, this is required for publication), please see the end of this email. If your institution or institutions have a press office, please notify them about your upcoming article at this point, to enable them to help maximise its impact. Inform journal staff as soon as possible if you are preparing a press release for your article and need a publication date.

Thank you again for supporting open-access publishing; we are looking forward to publishing your work in PLOS Genetics!

Yours sincerely,

Lin Chen, Ph.D.

Academic Editor

PLOS Genetics

Xiaofeng Zhu

Section Editor

PLOS Genetics

www.plosgenetics.org

Twitter: @PLOSGenetics

----------------------------------------------------

Comments from the reviewers (if applicable):

The reviewers are satisfied with the revision and I would recommend to accept the work.

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: The authors have addressed my comments. No more comments.

Reviewer #2: The authors have fully addressed my concerns by performing additional experiments and adding discussions. The manuscript has been greatly improved.

One follow-up suggesting for optimal k selection is as follows. The training and test data split and RMSE calculation is reasonable and rigorous. In dimension reduction, people use the variance explained by the k latent variables to better understand the data structure. It would be nice to provide this index for INSIDER method and also compare with different k choices with shuffled data.

**********

Have all data underlying the figures and results presented in the manuscript been provided?

Large-scale datasets should be made available via a public repository as described in the PLOS Genetics data availability policy, and numerical data that underlies graphs or summary statistics should be provided in spreadsheet form as supporting information.

Reviewer #1: None

Reviewer #2: Yes

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

----------------------------------------------------

Data Deposition

If you have submitted a Research Article or Front Matter that has associated data that are not suitable for deposition in a subject-specific public repository (such as GenBank or ArrayExpress), one way to make that data available is to deposit it in the Dryad Digital Repository. As you may recall, we ask all authors to agree to make data available; this is one way to achieve that. A full list of recommended repositories can be found on our website.

The following link will take you to the Dryad record for your article, so you won't have to re‐enter its bibliographic information, and can upload your files directly: 

http://datadryad.org/submit?journalID=pgenetics&manu=PGENETICS-D-23-01170R1

More information about depositing data in Dryad is available at http://www.datadryad.org/depositing. If you experience any difficulties in submitting your data, please contact help@datadryad.org for support.

Additionally, please be aware that our data availability policy requires that all numerical data underlying display items are included with the submission, and you will need to provide this before we can formally accept your manuscript, if not already present.

----------------------------------------------------

Press Queries

If you or your institution will be preparing press materials for this manuscript, or if you need to know your paper's publication date for media purposes, please inform the journal staff as soon as possible so that your submission can be scheduled accordingly. Your manuscript will remain under a strict press embargo until the publication date and time. This means an early version of your manuscript will not be published ahead of your final version. PLOS Genetics may also choose to issue a press release for your article. If there's anything the journal should know or you'd like more information, please get in touch via plosgenetics@plos.org.

Formally Accepted
Acceptance Letter - Lin Chen, Editor, Xiaofeng Zhu, Editor

PGENETICS-D-23-01170R1

INSIDER: Interpretable Sparse Matrix Decomposition for RNA Expression Data Analysis

Dear Dr Lin,

We are pleased to inform you that your manuscript entitled "INSIDER: Interpretable Sparse Matrix Decomposition for RNA Expression Data Analysis" has been formally accepted for publication in PLOS Genetics! Your manuscript is now with our production department and you will be notified of the publication date in due course.

The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript.

Soon after your final files are uploaded, unless you have opted out or your manuscript is a front-matter piece, the early version of your manuscript will be published online. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers.

Thank you again for supporting PLOS Genetics and open-access publishing. We are looking forward to publishing your work!

With kind regards,

Anita Estes

PLOS Genetics

On behalf of:

The PLOS Genetics Team

Carlyle House, Carlyle Road, Cambridge CB4 3DN | United Kingdom

plosgenetics@plos.org | +44 (0) 1223-442823

plosgenetics.org | Twitter: @PLOSGenetics

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .