Peer Review History

Original SubmissionAugust 7, 2021
Decision Letter - Scott M. Williams, Editor, Giorgio Sirugo, Editor

Dear Dr Warmerdam,

Thank you very much for submitting your Research Article entitled 'Increased genetic contribution to wellbeing during the COVID-19 pandemic' to PLOS Genetics.

The manuscript was fully evaluated at the editorial level and by independent peer reviewers. The reviewers appreciated the attention to an important problem, but raised some substantial concerns about the current manuscript. Based on the reviews, we will not be able to accept this version of the manuscript, but we would be willing to review a much-revised version. We cannot, of course, promise publication at that time.

Should you decide to revise the manuscript for further consideration here, your revisions should address the specific points made by each reviewer. We will also require a detailed list of your responses to the review comments and a description of the changes you have made in the manuscript.

If you decide to revise the manuscript for further consideration at PLOS Genetics, please aim to resubmit within the next 60 days, unless it will take extra time to address the concerns of the reviewers, in which case we would appreciate an expected resubmission date by email to plosgenetics@plos.org.

If present, accompanying reviewer attachments are included with this email; please notify the journal office if any appear to be missing. They will also be available for download from the link below. You can use this link to log into the system when you are ready to submit a revised version, having first consulted our Submission Checklist.

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

Please be aware that our data availability policy requires that all numerical data underlying graphs or summary statistics are included with the submission, and you will need to provide this upon resubmission if not already present. In addition, we do not permit the inclusion of phrases such as "data not shown" or "unpublished results" in manuscripts. All points should be backed up by data provided with the submission.

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool.  PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org.

PLOS has incorporated Similarity Check, powered by iThenticate, into its journal-wide submission system in order to screen submitted content for originality before publication. Each PLOS journal undertakes screening on a proportion of submitted articles. You will be contacted if needed following the screening process.

To resubmit, use the link below and 'Revise Submission' in the 'Submissions Needing Revision' folder.

[LINK]

We are sorry that we cannot be more positive about your manuscript at this stage. Please do not hesitate to contact us if you have any concerns or questions.

Yours sincerely,

Giorgio Sirugo

Associate Editor

PLOS Genetics

Scott Williams

Section Editor: Natural Variation

PLOS Genetics

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: The paper reports on PGS prediction for a number of traits that were assessed repeatedly during the COVID-19 pandemic. The sample derives from the Northern part of the Netherlands, which represents a part of the country that was not hit very hard by the virus, although lockdown was implemented in a similar manner as the rest of the country, which might have had differential effects: are there possibilities to collaborate with other biobanks in the Netherlands to test for replication?

The Lifelines study has 167,000 participants, this project included 27,537 participants: are these people with genotype data who returned at least one survey? (how many people were approached? Did the people with and without genotype data differ in the traits that were studied?).

Does the group of people that returned surveys include family members? Did their responses resemble each other? Did familial resemblance change during the pandemic?

There were 17831 Ss with genotype data and at least 2 surveys? (one survey in the beginning and one in the second half of the study). Do the PGS of the Ss without survey information differ from those who completed the surveys? I do not understand how figure S9 demonstrates “that sample selection based on quality control has been favourable for controlling false positives caused by loss to follow-up”.

Genotype data were used to obtain PGS for 17 traits: did the GWA discovery studies include Lifelines participants? (or their family members?). If yes, were LOO results obtained before PGS were constructed? Please note: figure 2 does not report on 17, but on 14 PGS. The choice for the discovery GWAS is not fully explained: why the focus on lifestyle and psychological traits?

Baseline / univariate analyses: on how many Ss, from which survey? (the first survey, any survey?).

The 2 arrays (N is given for the 27537 Ss by array but not for the 17831 Ss?) were imputed separately? Were SNPs for PGS harmonized across arrays? (e.g. same numbers of variants?).

Please explain: “We recoded questionnaire items to either an ordinal or dichotomous data type when this was not already the case”: continuous traits were not analyzed as continuous? (line 325 suggests they were?).

Regression (Line 341): did confounders correct for familial relatedness? Or only sex and age?

What is u(s) in regression equation?

How were missing data handled? (e.g. there were Ss with 11 vs 16 returned surveys? How many surveys were required to be included in the longitudinal analyses, or were all data analyzed?).

Reviewer #2: Increased genetic contribution to wellbeing during the COVID-19 pandemic

PGENETICS-D-21-01054

Warmerdam et al

Comments to the authors:

Immediate thoughts re. this paper are that this is a potentially interesting areas as it challenges the dynamic relationship between environmental and heritable contributions to trait variability using a universal (though variable) exposure. in COVID-19. From a basic point of view, one might anticipate a constriction of heritable variance for a complex outcome like well-being in the presence of an environmental challenge. However, in the presence of genetic contributions to COVID-19 experience itself (infection/outcome/the demographics of lockdown and exposure), there may be theoretical reasons as to why an inflation in heritable contributions to wellbeing. Whilst the authors present an examination of a series of PRS and their performance during the pandemic and longitudinal data available, there is no systematic assessment of the heritability of the outcomes in question here through time. This could be achieved using multiple methods and would give an important umbrella assessment of heritable contributions through time (and potentially by inceptive events during the pandemic).

The work presented looks to examine genetic contributions to wellbeing in a collection of ~25000 (17k with at least one questionnaire) participants with data collected through the course of the pandemic (lifelines). In brief, PRS were derived for a series of complex traits (including BMI, COVID risk and severity, EA, and psycho-behavioural traits) and these were associated with 288 questionnaire items running across the sampling period. This includes interesting association patterns such as that between PRS neuroticism/schiz’/depression and questionnaire outcomes re. personality traits and exhaustion. Further, the authors observe associations between other complex factors (EA, alcohol consumption, risky behaviour) and a series of variables recorded through the pandemic by questionnaire. This is interesting - though difficult to interpret clearly, however it does demonstrate the existence of analytical power across the data set available.

Followup analyses used the longitudinal nature of data collection to examine the possibility of varying genetic contributions to recorded outcomes through time (in those cases where there is association in baseline data). In this analysis, 11 associations showed some time dependence with 2 beating chance. Mean perceived quality of life varied and there was an apparent increase in the association between PRS for life satisfaction with some (who had high PRSs) showing resilience. This effect was reassessed in a sub analysis of 7500 participants with compete data at 4 time points.

The authors also show interesting relationships between COVID-19 PRS (susceptibility) and both incidence of infection (with increased incidence by score) and susceptibility - but with contributions to overall susceptibility (magnitude of effect) going down with time.

These are extremely interesting observations and the authors are conservative with both their interpretation of effect sizes and also the inferences drawn about these variable observations - this is great. However, there are a series of specific queries which need to be addressed:

- Given the nature of the analyses and the PRS being deployed here, the structure of the lifelines sampling frame will have an important effect on the presence and interpretation of estimates. One assumes that the ~25k respondents are not completely representative of the overall lifelines study and it would be good to have more analytical description of the actual sample and discussion on how this might influence outcomes. For example, the analysis of volunteers who are self-selected (a status likely correlated with many of the outcomes being assessed) may have an influence on the association seen through time in this data set.

- How are PRS chosen and constructed?

- Related to the question above, what is the underlying correlation structure for heritable contributions to the risk factors (PRS) and outcomes being assessed? This is difficult for the questionnaire outcomes, but for the PRS, it is possible to generate estimates of shared heritability across the traits taken into PRS exposures and to ask about the relative independence of these. Ie. what is the rg across the GWAS that formed the PRS?

- The analysis of COVID-19 risk and or severity genetics is tricky. As to the former, whilst case control analysis may be possible, the nature of the cases (in particular) will be important here re. the changing nature of COVID-19 case status through time in this data set. It is likely the case that the cases in the later stages of he longitudinal data here are substantively different to those at the start (when the HGI was run) and that these differences lend to a lessening of overlap between the heritable contributions to case at later stages of the pandemic (notwithstanding the complications of vaccination). Further, the analysis of severity is necessarily a case-only assessment. Again, features which are associated with case status are likely also to be associated with the other questionnaire derived variables here. As a consequence, when stratifying GWAS on case status to undertake severity analyses in the HGI, biases can be introduced which alter the interpretation of the PRS severity and therefore the downstream associations with lifelines variables. These types of complexity do need to be considered in this paper as they will not only influence baseline associations, but also are likely to influence the longitudinal associations see in this work.

- One technical point - whilst the trends in PRS association seen are compelling, they are not so strong as to overcome the limited power in these analyses. Correlations with time are fascinating here, but there should be emphasis put on the scale of these differences (which is there I concede) and also the power of the analyses. Replication would of course be excellent - especially as there are a series of large studies with comparable - cross-pandemic - longitudinal data and genetics.

- Lastly - referring to my point above - if it is possible to assess variation in heritable contributions to questionnaire responses and or exposures in this sample through time, then a coincident assessment of the variation in PRS effects but he same time points (i.e. superimposed onto heritability changes) would be an excellent addition.

Taken together, this is an interesting field and one which could take advantage of unique conditions.

Reviewer #3: The main objective of the manuscript is to investigate the effect of genetic predisposition to certain traits and conditions on the physical and mental health of individuals affected by the COVID-19 pandemic. They conducted a study on 17,831 participants from Lifeline’s biobank with genetic data (total N=167,000). Nineteen repeated questionnaires were sent out to the participants between March 30, 2020 and January 5 2021. This included total of 288 questions related to sociodemographic parameters, chronic diseases, COVID-19 infection, general health and symptoms, medication use, mental health, well-being, social life, and lifestyle. They computed polygenic scores on 17 traits and conditions by applying PRS-CS methods on GWAS summary statistics of these traits. Then, they conducted series of analyses to test for association between 1) PGSs and baseline questionnaire responses. 2) Longitudinal models on the significant PGS-Question from baseline. The analysis with the baseline questionnaire identified 30 significant associations with the most significant association between Neuroticism-PGS and “depression, schizophrenia, felt nervous, felt tired quickly”, Life satisfaction-PGS, and “excessive worrying, quality of life”. Other interesting finding includes a positive association between educational attainment and trust in the government response to COVID-19. Longitudinal models identified 11 FDR significant associations, and authors mainly focused on Life satisfaction PGS and perceived quality of life in the paper. It is an exciting finding showing that individuals with higher PGS for Life satisfaction have increased perceived quality of life compared to individuals with low PGS for life satisfaction even though mean the perceived quality of life decreased at the end of their follow-up period.

Main comments:

• Authors have presented an interesting study that gives insight on the impact of the COVID-19 pandemic on the perceived quality of life. Overall results and data are well presented, and the manuscript is written well.

• Although Figure 2 shows the association results, it would be great if Zscore could be made available in the supplementary files.

• Models are adjusted for chronic conditions. However, there was no mention of what and how the chronic disease was selected? Is BMI included in the chronic condition? As obesity has a high correlation with depression. I would assume adjusting the model with BMI would be necessary.

• Since the genotype data was generated on two different platforms, the authors said they performed the analysis on the two sets separately and then performed a meta-analysis. If the genetic data was imputed already, why didn’t author consider merging the data and run as a single set rather than a meta-analysis? This will increase the power. Of course, they need to adjust for the genotyping panel – which is standard practice in the field.

• Figure 3b and 4b shows the PGS vs Quality of life for 12,522 samples. However, earlier in the paper, they state ~17 samples were selected for the study. Can they clarify the discrepancy? Is the rest of the data in these two figures are from 12k samples or 17k?

• The paper does not follow the PLoS gen format. There is no introduction section in the paper. Authors should revise the paper and adhere to formatting guidelines.

• The discussion section is surprisingly short. My suggestion would be to restructure the paper and move several discussion points from the results section to the discussion.

• Also, highlighting limitations and future directions for the paper would be great. There are several typos across the manuscript and figure. For example, Typo in figure 4b

**********

Have all data underlying the figures and results presented in the manuscript been provided?

Large-scale datasets should be made available via a public repository as described in the PLOS Genetics data availability policy, and numerical data that underlies graphs or summary statistics should be provided in spreadsheet form as supporting information.

Reviewer #1: No: Not entirely clear what the procedures are to access the data (through Life Lines in the Netherlands?)

Reviewer #2: Yes

Reviewer #3: Yes

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: Yes: Anurag Verma

Revision 1

Attachments
Attachment
Submitted filename: Response_to_reviewers.docx
Decision Letter - Scott M. Williams, Editor, Giorgio Sirugo, Editor

Dear Dr Warmerdam,

Thank you very much for submitting your Research Article entitled 'Increased genetic contribution to wellbeing during the COVID-19 pandemic' to PLOS Genetics.

The manuscript was fully evaluated at the editorial level and by independent peer reviewers. The reviewers appreciated the attention to an important topic but identified some concerns that we ask you address in a revised manuscript. Specifically, prior to publication we request that you amend your manuscript and briefly address the concerns raised by referee # 1, in particular the one regarding the non inclusion of Lifelines samples/data in COVID-19 susceptibility GWAS.  Please explicitly state how that may or may not affect results in your discussion.

We therefore ask you to modify the manuscript according to the review recommendations. Your revisions should address the specific points made by each reviewer.

In addition we ask that you:

1) Provide a detailed list of your responses to the review comments and a description of the changes you have made in the manuscript.

2) Upload a Striking Image with a corresponding caption to accompany your manuscript if one is available (either a new image or an existing one from within your manuscript). If this image is judged to be suitable, it may be featured on our website. Images should ideally be high resolution, eye-catching, single panel square images. For examples, please browse our archive. If your image is from someone other than yourself, please ensure that the artist has read and agreed to the terms and conditions of the Creative Commons Attribution License. Note: we cannot publish copyrighted images.

We hope to receive your revised manuscript within the next 30 days. If you anticipate any delay in its return, we would ask you to let us know the expected resubmission date by email to plosgenetics@plos.org.

If present, accompanying reviewer attachments should be included with this email; please notify the journal office if any appear to be missing. They will also be available for download from the link below. You can use this link to log into the system when you are ready to submit a revised version, having first consulted our Submission Checklist.

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org.

Please be aware that our data availability policy requires that all numerical data underlying graphs or summary statistics are included with the submission, and you will need to provide this upon resubmission if not already present. In addition, we do not permit the inclusion of phrases such as "data not shown" or "unpublished results" in manuscripts. All points should be backed up by data provided with the submission.

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

PLOS has incorporated Similarity Check, powered by iThenticate, into its journal-wide submission system in order to screen submitted content for originality before publication. Each PLOS journal undertakes screening on a proportion of submitted articles. You will be contacted if needed following the screening process.

To resubmit, you will need to go to the link below and 'Revise Submission' in the 'Submissions Needing Revision' folder.

[LINK]

Please let us know if you have any questions while making these revisions.

Yours sincerely,

Scott M. Williams

Section Editor: Human Variation

PLOS Genetics

Scott Williams

Section Editor: Human Variation

PLOS Genetics

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: The authors have responded well to some of the questions and concerns that were raised. However, their reply to the construction of PRS raises concerns about the validity of their approach and hence the results in the paper.

The question was: "Genotype data were used to obtain PGS for 17 traits: did the GWA discovery studies include Lifelines participants? (or their family members?). If yes, were LOO results obtained before PGS were constructed?"

Reply: "Lifelines was one of the 126 studies included in the BMI GWAS, and contributed approximately 1% of the total samples for the COVID-19 susceptibility GWAS. Since the Lifelines samples represented, for each of these GWASs, only a very small part of the total number of samples, we expect that the effect of this on our PGSs is very limited. We therefore did not use LOO results before constructing the PGSs."

The expectation of the authors is unfounded. Please consult: Tutorial: a guide to performing polygenic risk score analyses. Choi SW, Mak TS, O'Reilly PF. Nat Protoc. 2020 Sep;15(9):2759-2772. doi: 10.1038/s41596-020-0353-1 and the references therein.

I cannot asses from the authors' reply: were BMI and covid-19 susceptibility the only two discovery GWAMA's in which Lifelines participated? (this seems unlikely).

Reviewer #3: The revised version of the manuscript is much improved and authors have addressed all the comments aptly.

Minor comment: Figure S11 is not mentioned in the main text.

**********

Have all data underlying the figures and results presented in the manuscript been provided?

Large-scale datasets should be made available via a public repository as described in the PLOS Genetics data availability policy, and numerical data that underlies graphs or summary statistics should be provided in spreadsheet form as supporting information.

Reviewer #1: Yes

Reviewer #3: None

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #3: No

Revision 2

Attachments
Attachment
Submitted filename: ResponseToReviewers.docx
Decision Letter - Scott M. Williams, Editor, Giorgio Sirugo, Editor

Dear Dr Warmerdam,

We are pleased to inform you that your manuscript entitled "Increased genetic contribution to wellbeing during the COVID-19 pandemic" has been editorially accepted for publication in PLOS Genetics. Congratulations!

Before your submission can be formally accepted and sent to production you will need to complete our formatting changes, which you will receive in a follow up email. Please be aware that it may take several days for you to receive this email; during this time no action is required by you. Please note: the accept date on your published article will reflect the date of this provisional acceptance, but your manuscript will not be scheduled for publication until the required changes have been made.

Once your paper is formally accepted, an uncorrected proof of your manuscript will be published online ahead of the final version, unless you’ve already opted out via the online submission form. If, for any reason, you do not want an earlier version of your manuscript published online or are unsure if you have already indicated as such, please let the journal staff know immediately at plosgenetics@plos.org.

In the meantime, please log into Editorial Manager at https://www.editorialmanager.com/pgenetics/, click the "Update My Information" link at the top of the page, and update your user information to ensure an efficient production and billing process. Note that PLOS requires an ORCID iD for all corresponding authors. Therefore, please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field.  This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager.

If you have a press-related query, or would like to know about making your underlying data available (as you will be aware, this is required for publication), please see the end of this email. If your institution or institutions have a press office, please notify them about your upcoming article at this point, to enable them to help maximise its impact. Inform journal staff as soon as possible if you are preparing a press release for your article and need a publication date.

Thank you again for supporting open-access publishing; we are looking forward to publishing your work in PLOS Genetics!

Yours sincerely,

Giorgio Sirugo

Associate Editor

PLOS Genetics

Scott Williams

Section Editor: Human Variation

PLOS Genetics

www.plosgenetics.org

Twitter: @PLOSGenetics

----------------------------------------------------

Comments from the reviewers (if applicable):

----------------------------------------------------

Data Deposition

If you have submitted a Research Article or Front Matter that has associated data that are not suitable for deposition in a subject-specific public repository (such as GenBank or ArrayExpress), one way to make that data available is to deposit it in the Dryad Digital Repository. As you may recall, we ask all authors to agree to make data available; this is one way to achieve that. A full list of recommended repositories can be found on our website.

The following link will take you to the Dryad record for your article, so you won't have to re‐enter its bibliographic information, and can upload your files directly: 

http://datadryad.org/submit?journalID=pgenetics&manu=PGENETICS-D-21-01054R2

More information about depositing data in Dryad is available at http://www.datadryad.org/depositing. If you experience any difficulties in submitting your data, please contact help@datadryad.org for support.

Additionally, please be aware that our data availability policy requires that all numerical data underlying display items are included with the submission, and you will need to provide this before we can formally accept your manuscript, if not already present.

----------------------------------------------------

Press Queries

If you or your institution will be preparing press materials for this manuscript, or if you need to know your paper's publication date for media purposes, please inform the journal staff as soon as possible so that your submission can be scheduled accordingly. Your manuscript will remain under a strict press embargo until the publication date and time. This means an early version of your manuscript will not be published ahead of your final version. PLOS Genetics may also choose to issue a press release for your article. If there's anything the journal should know or you'd like more information, please get in touch via plosgenetics@plos.org.

Formally Accepted
Acceptance Letter - Scott M. Williams, Editor, Giorgio Sirugo, Editor

PGENETICS-D-21-01054R2

Increased genetic contribution to wellbeing during the COVID-19 pandemic

Dear Dr Warmerdam,

We are pleased to inform you that your manuscript entitled "Increased genetic contribution to wellbeing during the COVID-19 pandemic" has been formally accepted for publication in PLOS Genetics! Your manuscript is now with our production department and you will be notified of the publication date in due course.

The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript.

Soon after your final files are uploaded, unless you have opted out or your manuscript is a front-matter piece, the early version of your manuscript will be published online. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers.

Thank you again for supporting PLOS Genetics and open-access publishing. We are looking forward to publishing your work!

With kind regards,

Livia Horvath

PLOS Genetics

On behalf of:

The PLOS Genetics Team

Carlyle House, Carlyle Road, Cambridge CB4 3DN | United Kingdom

plosgenetics@plos.org | +44 (0) 1223-442823

plosgenetics.org | Twitter: @PLOSGenetics

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .