Peer Review History
| Original SubmissionAugust 21, 2024 |
|---|
|
Dear Dr Pullin, Thank you very much for submitting your Methods entitled 'Variant-specific priors in colocalisation analysis' to PLOS Genetics. The manuscript was fully evaluated at the editorial level and by independent peer reviewers. The reviewers appreciated the attention to an important problem, but raised some substantial concerns about the current manuscript. Based on the reviews, we will not be able to accept this version of the manuscript, but we would be willing to review a much-revised version. We cannot, of course, promise publication at that time. A major concern raised by both reviewers is the minimal impact of the proposed variant-specific prior, with the practical gains appearing incremental. This issue needs to be clearly addressed, and the advantages of the proposed method, along with its contributions, should be more convincingly demonstrated before the work can be further considered. Should you decide to revise the manuscript for further consideration here, your revisions should address the specific points made by each reviewer. We will also require a detailed list of your responses to the review comments and a description of the changes you have made in the manuscript. If you decide to revise the manuscript for further consideration at PLOS Genetics, please aim to resubmit within the next 60 days, unless it will take extra time to address the concerns of the reviewers, in which case we would appreciate an expected resubmission date by email to plosgenetics@plos.org. If present, accompanying reviewer attachments are included with this email; please notify the journal office if any appear to be missing. They will also be available for download from the link below. You can use this link to log into the system when you are ready to submit a revised version, having first consulted our Submission Checklist. To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols Please be aware that our data availability policy requires that all numerical data underlying graphs or summary statistics are included with the submission, and you will need to provide this upon resubmission if not already present. In addition, we do not permit the inclusion of phrases such as "data not shown" or "unpublished results" in manuscripts. All points should be backed up by data provided with the submission. While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. PLOS has incorporated Similarity Check, powered by iThenticate, into its journal-wide submission system in order to screen submitted content for originality before publication. Each PLOS journal undertakes screening on a proportion of submitted articles. You will be contacted if needed following the screening process. To resubmit, log into your Editorial Manager account and select the option 'Revise Submission' in the 'Submissions Needing Revision' folder. We are sorry that we cannot be more positive about your manuscript at this stage. Please do not hesitate to contact us if you have any concerns or questions. Yours sincerely, Lin Chen, Ph.D. Academic Editor PLOS Genetics Michael Epstein Section Editor PLOS Genetics Reviewer's Responses to Questions Comments to the Authors: Please note here if the review is uploaded as an attachment. Reviewer #1: Summary of the Paper: The manuscript addresses the challenge of linking GWAS variants to their causal genes using the coloc method, a widely used approach for statistical colocalisation analysis. The authors propose incorporating variant-specific prior probabilities, based on diverse data sources such as PolyFun, non-coding constraint (Gnocchi), and enhancer-gene link scores (ABC), into coloc to improve performance. Their findings show that using these priors improves colocalisation accuracy in up to 13.5% of loci, demonstrating the benefits of integrating additional variant-level information. Scientific Novelty: The study is novel in extending the coloc method by introducing variant-specific prior probabilities to account for the heterogeneity of variant information, a concept well established in GWAS fine-mapping but not previously explored in colocalisation. This work bridges the gap between fine-mapping and colocalisation analysis, addressing the limitations of uniform priors in coloc. The systematic evaluation of multiple sources of variant information in real-world pQTL-eQTL and GWAS-eQTL colocalisation adds to the value of this contribution. Major Concerns: 1. Limited improvement in both simulation and real data scenarios: Despite the potential of variant-specific priors, the reported improvement in performance (2-3% increase in recall and precision) is modest. The study highlights that the impact of these priors was often small, especially in GWAS-eQTL colocalisation. This may question the practical utility of the method for large-scale applications, where computational costs must be justified by substantial performance gains. 2. Lack of technical contribution: The author did not make attempt to improve the co-localization fine-mapping performance. For instance, the importance of the annotations may change depending on the traits. In PolyFun and SparsePro, the annotation weights are learned as *empirical priors*. But in the proposed approach the prior (while variant-specific) are fixed. 3. Lack of direct application of PolyFun to the GWAS traits of interest: The authors mention that, for computational reasons, PolyFun was not directly applied to the GWAS datasets analyzed, and pre-computed priors from UK Biobank traits were used instead. Given that PolyFun is dataset-specific, this compromises the applicability of these results to different traits, and the conclusions drawn may not fully reflect the method’s potential. Another alternative is SparsePro (Zhang et al., PloS Genetics 2024) and SharePro (Zhang et al., Bioinformatics 2024), which was published more recently and more efficient than PolyFun. 4. Generalizability to other GWAS contexts: The study largely focuses on pQTL-eQTL colocalisation with minimal testing on diverse GWAS traits. The results of colocalisation in autoimmune disease, type 2 diabetes, and hypertension in FinnGen are briefly mentioned, but the manuscript would benefit from further exploration and a broader comparison to other trait categories. 5. Absence of strong benchmarks for comparison: While the study uses pQTL-eQTL colocalisation as a ground truth benchmark, it remains unclear how the method compares against other cutting-edge colocalisation methods (e.g., SharePro) or how well it would perform in a setting with more complex polygenic traits. Introducing stronger benchmarks would improve the robustness of the results. Minor Concerns: 1. Code and reproducibility: The paper references that the code for implementing the method is available in a GitHub repository. It would be beneficial to explicitly include a link in the manuscript and provide a minimal working example to allow users to apply the methods on their own data. 2. The first two sections under Results are mostly method description would be more appropriate under Methods section 3. Threshold choices: The manuscript uses a threshold of Pr(H4) > 0.8 to define colocalisation significance. It would be useful to provide additional context or references for why this threshold was chosen, particularly since other colocalisation studies may use different thresholds. 4. It would be helpful to have an overview Figure as Figure 1 to give a high-level conceptual diagram of the proposed method. 5. Supplementary material integration: There is heavy reliance on supplementary material for important methodological details. Integrating more of this content into the main manuscript, or at least summarizing key points, would improve readability and allow for a more thorough understanding without requiring extensive cross-referencing. Reviewer #2: The goal of this manuscript is to improve current coloc approaches by adding weights to each variant based on heritabilities, functional annotation and eQTL-TSS weights. This is an interesting paper as coloc approaches are becoming very popular to integrate genetics of complex diseases with QTL for molecular traits. The authors demonstrate that adding the weights (based on eQTLs, ABC, Gnocchi and PolyFun) the coloc results improve but only 2-3% in both simulated and real data. I think that adding the option “variant-specific-priors” to coloc is great, specially when people can add their own weights. As mentioned the authors used several approaches to calculate the weights and perform the benchmarking. However there are several major assumptions in this manuscript that are not totally real and can lead to wrong inferences that need to be taken into account and also mention as limitations. The first one is that the authors mention: “This analysis showed relatively little variation between tissues in GTEx or the eQTL catalogue, suggesting that tissue-specific densities are not needed.”, which I am not sure, I agree, as in Figure 1, there is not analyses by tissue. There are plenty of studies that indicate that many QTLs are tissue specific, and this may have an impact of the coloc results, if the weights are variant and tissue specific The second is the “central dogma” in molecular biology of protein and mRNA levels are correlated, which is not clearly not true. The production of a protein is clearly associated with mRNA levels. But once the protein is produced, their stability in the cell, whether is secreted, cleavage …. does not depend on the mRNA levels. There are many studies that demonstrate that protein levels in humans does not correlate with mRNA levels. The authors also say that if there is a pQTL there needs to be a eQTL is also not true. Proteogenomic studies have demonstrated that pQTL are enriched for coding variants, likely affecting intracellular trafficking, membrane affinity, cleavage, protein binding among others. Those pQTL are not eQTL and not an artifact of the antibody or aptamer binding. Also pQTL are highly tissue specific, which connect to the previous critique. Therefore, using eQTLgen or OneK1K as a weights for pQTL will lead to wrong inferences. The inferences here will be lower in this scenario as both eQTL and pQTL are from blood, but it is not clear if this will be translated well for QTL generate in other tissues. The other major limitation, not mentioned or discussed on the manuscript is that all the databases uses here are based on Non-Hispanic white datasets (I think OneK1K has some non-white datasets, but not clear how many and how was used). Different populations have different LD and different QTLs. Leverage other LD maps may have more impact on improving coloc results that incorporating weights. At least a discussion of this should be included on the manuscript. ********** Have all data underlying the figures and results presented in the manuscript been provided? Large-scale datasets should be made available via a public repository as described in the PLOS Genetics data availability policy, and numerical data that underlies graphs or summary statistics should be provided in spreadsheet form as supporting information. Reviewer #1: Yes Reviewer #2: Yes ********** PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No |
| Revision 1 |
|
PGENETICS-D-24-00952R1 Variant-specific priors clarify colocalisation analysis PLOS Genetics Dear Dr. Pullin, Thank you for submitting your manuscript to PLOS Genetics. The revised manuscript is improved over the previous submission. However, one reviewer still have some concerns regarding the interpretation of the results. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised. Please submit your revised manuscript within 30 days . If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosgenetics@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pgenetics/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript: * A rebuttal letter that responds to each point raised by the editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'. This file does not need to include responses to formatting updates and technical items listed in the 'Journal Requirements' section below. * A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'. * An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'. If you would like to make changes to your financial disclosure, competing interests statement, or data availability statement, please make these updates within the submission form at the time of resubmission. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. We look forward to receiving your revised manuscript. Kind regards, Lin Chen, Ph.D. Academic Editor PLOS Genetics Michael Epstein Section Editor PLOS Genetics Aimée Dudley Editor-in-Chief PLOS Genetics Anne Goriely Editor-in-Chief PLOS Genetics Journal Requirements: 1) Please provide an Author Summary. This should appear in your manuscript between the Abstract (if applicable) and the Introduction, and should be 150-200 words long. The aim should be to make your findings accessible to a wide audience that includes both scientists and non-scientists. Sample summaries can be found on our website under Submission Guidelines: https://journals.plos.org/plosgenetics/s/submission-guidelines#loc-parts-of-a-submission 2) Please ensure that your article adheres to the standard Methods article layout and order of Abstract, Author Summary, Introduction, Description of the Method, Verification and Comparison, Applications, Discussion, Acknowledgements, References, and Supplementary Information. For details on what each section should contain, see our Methods article guidelines: https://journals.plos.org/plosgenetics/s/submission-guidelines#loc-manuscript-organization. Reviewers' comments: Reviewer's Responses to Questions Reviewer #1: All my comments are addressed. Reviewer #2: This is a revised manuscript focused on improving coloc approaches by adding variant specific weights. My previous concerns were related to having weights based only on eQTL and using only EUR-specific weights. The authors have addressed my comments related with the European-specific weights. I still do fully not agree with their justification for the pQTL. The authors indeed indicate that only 65% of the pQTL colocalize with eQTL, so a large number of then, 35% do not. And most of this pQTLs that do not colocalize are due to posttranslational events. I think that talking here about the central dogma, is indeed, simplifying biology too much that is misleading. Proteins levels are regulated at many more levels than mRNA, and proteins, a and not RNA, are normally the effector molecules in diseases and biological traits. Saying that mRNA -related data can just be translated into protein data is one of the reasons so many loci are still no solved. I would suggest removing the wording related the central dogma and that the pQTLs are expected to be eQTL as this is clearly erroneous and misleading. It would be ok with me, if the authors just have a few sentences in the discussion that including tissue-specific and other molecular traits QTL can improve the coloc. The can add it to the sentence where they mention the users can include their own weight. ********** Have all data underlying the figures and results presented in the manuscript been provided? Large-scale datasets should be made available via a public repository as described in the PLOS Genetics data availability policy, and numerical data that underlies graphs or summary statistics should be provided in spreadsheet form as supporting information. Reviewer #1: None Reviewer #2: Yes ********** PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] Figure resubmission: While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. If there are other versions of figure files still present in your submission file inventory at resubmission, please replace them with the PACE-processed versions. Reproducibility: To enhance the reproducibility of your results, we recommend that authors deposit laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols |
| Revision 2 |
|
Dear Dr Pullin, We are pleased to inform you that your manuscript entitled "Variant-specific priors clarify colocalisation analysis" has been editorially accepted for publication in PLOS Genetics. Congratulations! Before your submission can be formally accepted and sent to production you will need to complete our formatting changes, which you will receive in a follow up email. Please be aware that it may take several days for you to receive this email; during this time no action is required by you. Please note: the accept date on your published article will reflect the date of this provisional acceptance, but your manuscript will not be scheduled for publication until the required changes have been made. Once your paper is formally accepted, an uncorrected proof of your manuscript will be published online ahead of the final version, unless you’ve already opted out via the online submission form. If, for any reason, you do not want an earlier version of your manuscript published online or are unsure if you have already indicated as such, please let the journal staff know immediately at plosgenetics@plos.org. In the meantime, please log into Editorial Manager at https://www.editorialmanager.com/pgenetics/, click the "Update My Information" link at the top of the page, and update your user information to ensure an efficient production and billing process. Note that PLOS requires an ORCID iD for all corresponding authors. Therefore, please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. If you have a press-related query, or would like to know about making your underlying data available (as you will be aware, this is required for publication), please see the end of this email. If your institution or institutions have a press office, please notify them about your upcoming article at this point, to enable them to help maximise its impact. Inform journal staff as soon as possible if you are preparing a press release for your article and need a publication date. Thank you again for supporting open-access publishing; we are looking forward to publishing your work in PLOS Genetics! Yours sincerely, Lin Chen, Ph.D. Academic Editor PLOS Genetics Michael Epstein Section Editor PLOS Genetics Aimée Dudley Editor-in-Chief PLOS Genetics Anne Goriely Editor-in-Chief PLOS Genetics Twitter: @PLOSGenetics ---------------------------------------------------- Comments from the reviewers (if applicable): ---------------------------------------------------- Data Deposition If you have submitted a Research Article or Front Matter that has associated data that are not suitable for deposition in a subject-specific public repository (such as GenBank or ArrayExpress), one way to make that data available is to deposit it in the Dryad Digital Repository. As you may recall, we ask all authors to agree to make data available; this is one way to achieve that. A full list of recommended repositories can be found on our website. The following link will take you to the Dryad record for your article, so you won't have to re‐enter its bibliographic information, and can upload your files directly: http://datadryad.org/submit?journalID=pgenetics&manu=PGENETICS-D-24-00952R2 More information about depositing data in Dryad is available at http://www.datadryad.org/depositing. If you experience any difficulties in submitting your data, please contact help@datadryad.org for support. Additionally, please be aware that our data availability policy requires that all numerical data underlying display items are included with the submission, and you will need to provide this before we can formally accept your manuscript, if not already present. ---------------------------------------------------- Press Queries If you or your institution will be preparing press materials for this manuscript, or if you need to know your paper's publication date for media purposes, please inform the journal staff as soon as possible so that your submission can be scheduled accordingly. Your manuscript will remain under a strict press embargo until the publication date and time. This means an early version of your manuscript will not be published ahead of your final version. PLOS Genetics may also choose to issue a press release for your article. If there's anything the journal should know or you'd like more information, please get in touch via plosgenetics@plos.org. |
| Formally Accepted |
|
PGENETICS-D-24-00952R2 Variant-specific priors clarify colocalisation analysis Dear Dr Pullin, We are pleased to inform you that your manuscript entitled "Variant-specific priors clarify colocalisation analysis" has been formally accepted for publication in PLOS Genetics! Your manuscript is now with our production department and you will be notified of the publication date in due course. The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript. Soon after your final files are uploaded, unless you have opted out or your manuscript is a front-matter piece, the early version of your manuscript will be published online. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers. Thank you again for supporting PLOS Genetics and open-access publishing. We are looking forward to publishing your work! With kind regards, Anita Estes PLOS Genetics On behalf of: The PLOS Genetics Team Carlyle House, Carlyle Road, Cambridge CB4 3DN | United Kingdom plosgenetics@plos.org | +44 (0) 1223-442823 plosgenetics.org | Twitter: @PLOSGenetics |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .