Peer Review History

Original SubmissionJune 27, 2020
Decision Letter - David Balding, Editor, Xiaofeng Zhu, Editor

Dear Dr Love,

Thank you very much for submitting your Research Article entitled 'MOSTWAS: Multi-Omic Strategies for Transcriptome-Wide Association Studies' to PLOS Genetics. Your manuscript was fully evaluated at the editorial level and by independent peer reviewers and the editors. Based on the reviews, we will not be able to accept this version of the manuscript, but we would be willing to review again a much-revised version. We cannot, of course, promise publication at that time.

Although both reviewers found the work to be interesting, they  raised substantial concerns. Both reviewers noted that TWAS approaches using cis- and trans-eQTLs have been published. Therefore, further comparisons of the proposed methods (MeTWAS amd DePMA) with existing methods should be performed to demonstrate the advances of the proposed approaches in both simulations and real data analysis, rather than only a broad discussion.  In addition, a definition of distal-eQTL with a distance of 0.5Mb or more is not consistent with the literature.  We would also like to see the effect of using the more standard definition.

Should you decide to revise the manuscript for further consideration here, your revisions should address the specific points made by each reviewer. We will also require a detailed list of your responses to the review comments and a description of the changes you have made in the manuscript.

If you decide to revise the manuscript for further consideration at PLOS Genetics, please aim to resubmit within the next 60 days, unless it will take extra time to address the concerns of the reviewers, in which case we would appreciate an expected resubmission date by email to plosgenetics@plos.org.

If present, accompanying reviewer attachments are included with this email; please notify the journal office if any appear to be missing. They will also be available for download from the link below. You can use this link to log into the system when you are ready to submit a revised version, having first consulted our Submission Checklist.

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see our guidelines.

Please be aware that our data availability policy requires that all numerical data underlying graphs or summary statistics are included with the submission, and you will need to provide this upon resubmission if not already present. In addition, we do not permit the inclusion of phrases such as "data not shown" or "unpublished results" in manuscripts. All points should be backed up by data provided with the submission.

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool.  PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org.

PLOS has incorporated Similarity Check, powered by iThenticate, into its journal-wide submission system in order to screen submitted content for originality before publication. Each PLOS journal undertakes screening on a proportion of submitted articles. You will be contacted if needed following the screening process.

To resubmit, use the link below and 'Revise Submission' in the 'Submissions Needing Revision' folder.

[LINK]

We are sorry that we cannot be more positive about your manuscript at this stage. Please do not hesitate to contact us if you have any concerns or questions.

Yours sincerely,

Xiaofeng Zhu

Associate Editor

PLOS Genetics

David Balding

Section Editor: Methods

PLOS Genetics

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: Bhattacharya et al. developed two novel TWAS (Transcriptome-Wide Association Studies) methods to incorporate multi-omics data: mediator-enriched TWAS (MeTWAS) and distal-eQTL prioritization via mediation analysis (DePMA). As compared to most existing TWAS methods that only relies on local-eQTLs, the two proposed methods borrow additional information from distal-eQTLs and other omics data such as DNA methylation and microRNA. Both methods adopt rigorous mediation analysis approaches. Below I list some minor issues that may further improve the manuscript.

1. Incorporating omics data in TWAS has become a hot research topic recently. For instance, the following related paper, initially been posted on bioRxiv on March 6, also considers distal-eQTLs in TWAS.

“Bayesian Genome-wide TWAS method to leverage both cis- and trans-eQTL information through summary statistics”

https://www.biorxiv.org/content/10.1101/2020.03.05.979187v2

It is worth discussion if a comparison is too much work. It is especially key for reproducibility across methods. A quick look does not find overlap genes for Alzheimer’s disease.

2. Which local-only methods were used for comparison in simulations and data analysis? Given different local-only algorithms, it would be precise to explicitly note what exact method was used each time when local-only models were mentioned.

3. The authors defined distal-eQTL with a distance of 0.5 Mb, while many other studies used a distance of 1 Mb. I am wondering if this would affect the performance of the proposed TWAS methods and biological interpretation.

4. Some figures need improvement.

Fig 3, making each subfigure square would facilitate reading;

Fig 4 AB, no legends for the three colors. What do P and D mean in Fig 4B?

5. There are some typos.

Line 70, “many distal-eQTLs are often eQTLs for one of more of their local genes”

“one of more of” should be “one or more of”?

In the section of “real data applications in brain tissue,” “tumor” appeared multiple times. It should be avoided because the data are about Alzheimer’s disease.

Line 400, typo “sties”.

Line 472, redundant words, “we considered two scenarios.”

Supplemental Methods, formula (2), the second equation, \\beta_M should be w_G?

Reviewer #2: The authors proposed two approaches to consider potential distal-eQTL for improving the prediction accuracy of gene expression and then the TWAS power. Here are my comments:

1. Although it is good to see that additional distal-eQTL could play an important role in TWAS, the authors did not describe their methods clearly in the main text. I think it would be helpful to include brief formulas to introduce the models of these two proposed methods in the main text. Include Figure S1 as part of Figure 1 would also help.

2. The authors shall also compare with the recently published BGW-TWAS method (https://doi.org/10.1016/j.ajhg.2020.08.022) that considers both cis- and trans- eQTL for TWAS, and used the same ROS/MAP application data set.

3. It is not clearly stated about the number of mediators of different omics- types that were considered in the application studies. For the gene expression trait of each gene, will all mediators available for the study cohort be considered by MeTWAS and DePMA?

4. For the computation time mentioned in the main text, it is not clear whether additional computation time about generating standard eQTL p-values, or identifying associated mediators are included or not.

5. The authors need to be specific about which local-only models were compared in the application studies, as PrediXcan, Fusion, and TIGAR use different statistical models and perform differently.

6. In the application study of using ROS/MAP data, as mentioned from lines 199-201, does it mean only 267 genes has training R2 > 0.01 by local-only models, 911 by MeTWAS, and 2934 by DePMA? The number of genes is much less than reported in the TIGAR paper.

7. Similar number of genes with training R2>0.01 were also identified for the transcriptomic profiles of breast tissue type. This is also much less than what was published for studying breast cancer using TCGA data (https://www.nature.com/articles/s41588-018-0132-x). The number of significant TWAS genes were also much less than published for using the same BRCA GWAS data set.

8. A discussion about which TWAS method (MeTWAS or DePMA) would be preferred by what type of genetic architecture, or multi-omics network for the test gene will be helpful.

9. Color legend need to be included for Figure 4A, 4B.

**********

Have all data underlying the figures and results presented in the manuscript been provided?

Large-scale datasets should be made available via a public repository as described in the PLOS Genetics data availability policy, and numerical data that underlies graphs or summary statistics should be provided in spreadsheet form as supporting information.

Reviewer #1: Yes

Reviewer #2: Yes

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Revision 1

Attachments
Attachment
Submitted filename: Response to Reviewers.docx
Decision Letter - David Balding, Editor, Xiaofeng Zhu, Editor

* Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out. *

Dear Dr Love,

Thank you very much for submitting your Research Article entitled 'MOSTWAS: Multi-Omic Strategies for Transcriptome-Wide Association Studies' to PLOS Genetics.

The manuscript was fully evaluated at the editorial level and by independent peer reviewers. Reviewer 1 has been satisfied but reviewer 2 identified some minor concerns that we ask you address in a revised manuscript

We therefore ask you to modify the manuscript according to the review 2's recommendations. Your revisions should address the specific points made by the reviewer.  In particular we encourage you to put an outline of the method before the results, this deviates from the traditional PLOS Genetics format but is now encouraged for methods papers.

In addition we ask that you:

1) Provide a detailed list of your responses to the review comments and a description of the changes you have made in the manuscript.

2) Upload a Striking Image with a corresponding caption to accompany your manuscript if one is available (either a new image or an existing one from within your manuscript). If this image is judged to be suitable, it may be featured on our website. Images should ideally be high resolution, eye-catching, single panel square images. For examples, please browse our archive. If your image is from someone other than yourself, please ensure that the artist has read and agreed to the terms and conditions of the Creative Commons Attribution License. Note: we cannot publish copyrighted images.

We hope to receive your revised manuscript within the next 30 days. If you anticipate any delay in its return, we would ask you to let us know the expected resubmission date by email to plosgenetics@plos.org.

If present, accompanying reviewer attachments should be included with this email; please notify the journal office if any appear to be missing. They will also be available for download from the link below. You can use this link to log into the system when you are ready to submit a revised version, having first consulted our Submission Checklist.

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org.

Please be aware that our data availability policy requires that all numerical data underlying graphs or summary statistics are included with the submission, and you will need to provide this upon resubmission if not already present. In addition, we do not permit the inclusion of phrases such as "data not shown" or "unpublished results" in manuscripts. All points should be backed up by data provided with the submission.

PLOS has incorporated Similarity Check, powered by iThenticate, into its journal-wide submission system in order to screen submitted content for originality before publication. Each PLOS journal undertakes screening on a proportion of submitted articles. You will be contacted if needed following the screening process.

To resubmit, you will need to go to the link below and 'Revise Submission' in the 'Submissions Needing Revision' folder.

[LINK]

Please let us know if you have any questions while making these revisions.

Yours sincerely,

Xiaofeng Zhu

Associate Editor

PLOS Genetics

David Balding

Section Editor: Methods

PLOS Genetics

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: My comments have been addressed.

Reviewer #2: The authors have addressed most of my comments. I only have the following minor comments:

1. For the R2 comparison between BGW-TWAS and MOSTWAS, the figure showed there are more number of genes have greater R2 by BGW-TWAS method. It is not fair to compare the proportion of genes that have greater R2 as the total number of gene models fitted by BGW-TWAS method is >twice of the ones by MOSTWAS.

2. Please note that the BGW-TWAS computation time include single-variant eQTL test for genome-wide genotypes.

3. I think MOSTWAS might have an advantage over BGW-TWAS by extensively testing the mediation effect for some genes, but might miss some mediating effects that are too weak to be detected. The number of gene models fitted by MOSTWAS now is approximately similar to the so called local method but smaller than the BGW-TWAS method, which is mainly due to the Elastic-Net regression model. This could be improved if the Bayesian DPR model as used by TIGAR is used to fit the gene expression prediction model.

4. Since MOSTWAS may not be able to screen all other genome-wide multi-omics factors for each test gene, it would help to discuss how to select a set of “mediating omics factors” to start. And make it clear that if users need to first conduct single variant eQTL analysis for genome-wide genotypes per gene to identify all potential distal eQTL for mediation test?

5. I feel like a simplified method section could go ahead of the Results section to help reader to understand the method and results better. And more details could go to supplement. The editors can see if this would make sense.

**********

Have all data underlying the figures and results presented in the manuscript been provided?

Large-scale datasets should be made available via a public repository as described in the PLOS Genetics data availability policy, and numerical data that underlies graphs or summary statistics should be provided in spreadsheet form as supporting information.

Reviewer #1: None

Reviewer #2: Yes

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Revision 2

Attachments
Attachment
Submitted filename: Response to Reviewers.docx
Decision Letter - David Balding, Editor, Xiaofeng Zhu, Editor

Dear Dr Love,

We are pleased to inform you that your manuscript entitled "MOSTWAS: Multi-Omic Strategies for Transcriptome-Wide Association Studies" has been editorially accepted for publication in PLOS Genetics. Congratulations!

Before your submission can be formally accepted and sent to production you will need to complete our formatting changes, which you will receive in a follow up email. Please be aware that it may take several days for you to receive this email; during this time no action is required by you. Please note: the accept date on your published article will reflect the date of this provisional acceptance, but your manuscript will not be scheduled for publication until the required changes have been made.

Once your paper is formally accepted, an uncorrected proof of your manuscript will be published online ahead of the final version, unless you’ve already opted out via the online submission form. If, for any reason, you do not want an earlier version of your manuscript published online or are unsure if you have already indicated as such, please let the journal staff know immediately at plosgenetics@plos.org.

In the meantime, please log into Editorial Manager at https://www.editorialmanager.com/pgenetics/, click the "Update My Information" link at the top of the page, and update your user information to ensure an efficient production and billing process. Note that PLOS requires an ORCID iD for all corresponding authors. Therefore, please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field.  This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager.

If you have a press-related query, or would like to know about making your underlying data available (as you will be aware, this is required for publication), please see the end of this email. If your institution or institutions have a press office, please notify them about your upcoming article at this point, to enable them to help maximise its impact. Inform journal staff as soon as possible if you are preparing a press release for your article and need a publication date.

Thank you again for supporting open-access publishing; we are looking forward to publishing your work in PLOS Genetics!

Yours sincerely,

Xiaofeng Zhu

Associate Editor

PLOS Genetics

David Balding

Section Editor: Methods

PLOS Genetics

www.plosgenetics.org

Twitter: @PLOSGenetics

----------------------------------------------------

Comments from the reviewers (if applicable):

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #2: All of my comments are addressed.

**********

Have all data underlying the figures and results presented in the manuscript been provided?

Large-scale datasets should be made available via a public repository as described in the PLOS Genetics data availability policy, and numerical data that underlies graphs or summary statistics should be provided in spreadsheet form as supporting information.

Reviewer #2: None

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

----------------------------------------------------

Data Deposition

If you have submitted a Research Article or Front Matter that has associated data that are not suitable for deposition in a subject-specific public repository (such as GenBank or ArrayExpress), one way to make that data available is to deposit it in the Dryad Digital Repository. As you may recall, we ask all authors to agree to make data available; this is one way to achieve that. A full list of recommended repositories can be found on our website.

The following link will take you to the Dryad record for your article, so you won't have to re‐enter its bibliographic information, and can upload your files directly: 

http://datadryad.org/submit?journalID=pgenetics&manu=PGENETICS-D-20-01017R2

More information about depositing data in Dryad is available at http://www.datadryad.org/depositing. If you experience any difficulties in submitting your data, please contact help@datadryad.org for support.

Additionally, please be aware that our data availability policy requires that all numerical data underlying display items are included with the submission, and you will need to provide this before we can formally accept your manuscript, if not already present.

----------------------------------------------------

Press Queries

If you or your institution will be preparing press materials for this manuscript, or if you need to know your paper's publication date for media purposes, please inform the journal staff as soon as possible so that your submission can be scheduled accordingly. Your manuscript will remain under a strict press embargo until the publication date and time. This means an early version of your manuscript will not be published ahead of your final version. PLOS Genetics may also choose to issue a press release for your article. If there's anything the journal should know or you'd like more information, please get in touch via plosgenetics@plos.org.

Formally Accepted
Acceptance Letter - David Balding, Editor, Xiaofeng Zhu, Editor

PGENETICS-D-20-01017R2

MOSTWAS: Multi-Omic Strategies for Transcriptome-Wide Association Studies

Dear Dr Love,

We are pleased to inform you that your manuscript entitled "MOSTWAS: Multi-Omic Strategies for Transcriptome-Wide Association Studies" has been formally accepted for publication in PLOS Genetics! Your manuscript is now with our production department and you will be notified of the publication date in due course.

The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript.

Soon after your final files are uploaded, unless you have opted out or your manuscript is a front-matter piece, the early version of your manuscript will be published online. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers.

Thank you again for supporting PLOS Genetics and open-access publishing. We are looking forward to publishing your work!

With kind regards,

Alice Ellingham

PLOS Genetics

On behalf of:

The PLOS Genetics Team

Carlyle House, Carlyle Road, Cambridge CB4 3DN | United Kingdom

plosgenetics@plos.org | +44 (0) 1223-442823

plosgenetics.org | Twitter: @PLOSGenetics

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .