Peer Review History

Original SubmissionFebruary 1, 2021
Decision Letter - Ricarda Nater-Mewes, Editor

PONE-D-20-29015

The association between self-reported stress and cardiovascular measures in daily life: A systematic review

PLOS ONE

Dear Dr. Vaessen,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jul 11 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Ricarda Nater-Mewes, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

3. The PRISMA checklist requires that the quality or risk of bias of the included studies is assessed. Furthermore, conclusions in a systematic review or meta-analysis should be related to the quality of the included publications. In light of this concern we would be grateful if you could please update your systematic review to include a formal quality assessment. Please ensure that your quality assessment is suitable for the study type included in your systematic review. Please also note that reporting checklists (e.g. STROBE) are not suitable for use as quality assessment tools.

4. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

5. Please include captions for ALL your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is an interesting and relevant overview of the literature on associations between self-reported stress and selected cardiovascular measures. As with all reviews, the outcome is dependent on a variety of choices made by the authors – some might be debatable (such as the focus on at least one day of assessments), but as long as these choices are justified, the end result stands on a relatively firm basis. I have only a few suggestions on how to further improve the paper:

- The main query I have is that that I would want to ask the authors to put together a brief list of recommendations at the end of their discussion. I think they provide a clear-cut discussion on their findings, and it becomes quite clear what the limitations in the literature are, but at the end the reader is left wondering what to take from the paper for his or her own research. What is, e.g., an ideal segment for the association between self-reported stress and HRV? What is the ideal statistical approach based on which data characteristics? What is the ideal time-lag between self-reported stress and selected measures? Just a few questions I had.

- The main variables in this review should probably be justified a little more in detail. The authors start with an overview of the biological stress systems, but I don´t think this is of great relevance, when in the end they are only focusing on a few selected cardiovascular measures. They could simply skip to the role of the cardiovascular system and its role in the overall stress process. In this context, it should be noted that there are literally hundreds of ESM studies which measured cortisol, so the statement on page 4 regarding HPA axis markers is not correct.

- I cannot agree that laboratory studies are showing heterogeneous results due to a lack of ecological validity. If one wants to follow the stress appraisal model by Lazarus (and most studies seem to do to some degree), then it doesn´t matter where the stressor takes place. The authors could leave out that statement and still have enough to justify their focus on ESM studies.

- I agree that it is difficult to compare studies due to the wide variety of statistical approaches. One of the conclusions could be that it will be of importance to follow-up with a meta-analysis, which would allow for tackling the main research question using one unified statistical approach.

Reviewer #2: This systematic review evaluated the evidence for studies that have assessed daily stress using ambulatory methods and associated ratings of self-reported stress with cardiovascular measures. The most interesting point is that it focuses on daily stress. I agree that the results from laboratory setting studies using standardized stress task are different from those measured in the real-life stressful condition. This paper is interesting throughout, but I have a few minor comments.

1. One of the aims of this review is to investigate an association between acute stress and physiological measures. It would be interesting if the analysis could be limited to only those studies that assessed acute stress.

2. P33 line 3: “One possible explanation for sample differences is that patients and individuals at risk may experience more stress during the day, providing for more variability in the data and hence increase the likelihood of finding an association.” Does this mean that the patients and individuals at risk are more frequently exposed to chronic stress, or does it mean that they are more sensitive to stressors?

3. P34 line2: Validation of BP monitoring device evaluates the accuracy of BP values measured by BP monitoring devices compared with those measured by mercury sphygmomanometers, that is, Spacelabs 90207 is a validated device for monitoring BP.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Urs Nater

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 1

Comments from the reviewers:

Reviewer #1: This is an interesting and relevant overview of the literature on associations between self-reported stress and selected cardiovascular measures. As with all reviews, the outcome is dependent on a variety of choices made by the authors – some might be debatable (such as the focus on at least one day of assessments), but as long as these choices are justified, the end result stands on a relatively firm basis. I have only a few suggestions on how to further improve the paper:

1. The main query I have is that that I would want to ask the authors to put together a brief list of recommendations at the end of their discussion. I think they provide a clear-cut discussion on their findings, and it becomes quite clear what the limitations in the literature are, but at the end the reader is left wondering what to take from the paper for his or her own research. What is, e.g., an ideal segment for the association between self-reported stress and HRV? What is the ideal statistical approach based on which data characteristics? What is the ideal time-lag between self-reported stress and selected measures? Just a few questions I had.

Response: This is a very good suggestion. Although it is difficult to provide strong suggestions for all points the referee suggests based on the results of the current review, we have changed the title of the final paragraph to read “Conclusions and recommendations” and added some recommendations based on our findings. This can be found on page 35.

“Therefore, based on this review, we recommend researchers to use the following when investigating the association between self-reported stress and cardiovascular measures:

- Perceived stress or high-arousal NA self-report measures

- High-quality wearable sensors that have been validated in ambulatory settings

- Time windows of max 30 minutes prior to self-report for the calculation of continuously assessed cardiovascular measures

- Study periods of at least 6 days with multiple assessments per day to capture enough variability in both measures

- Multilevel modelling for the statistical analyses”

2. The main variables in this review should probably be justified a little more in detail. The authors start with an overview of the biological stress systems, but I don´t think this is of great relevance, when in the end they are only focusing on a few selected cardiovascular measures. They could simply skip to the role of the cardiovascular system and its role in the overall stress process. In this context, it should be noted that there are literally hundreds of ESM studies which measured cortisol, so the statement on page 4 regarding HPA axis markers is not correct.

Response: Although we do agree with the referee that it is unnecessary to mention the HPA axis in the introduction, our intention was to review studies investigating ANS measures (ie including skin conductance). As we only found out after our search that there were not enough studies that looked at the association between skin conductance and self-reported stress, we chose to focus on cardiovascular measures only. In our opinion, altering the introduction accordingly would not be in line with our procedures. We therefore deleted the two sentences on the HPA axis on page 4, but left the motivation to investigate the ANS intact. We hope the referee agrees with this decision.

3. I cannot agree that laboratory studies are showing heterogeneous results due to a lack of ecological validity. If one wants to follow the stress appraisal model by Lazarus (and most studies seem to do to some degree), then it doesn´t matter where the stressor takes place. The authors could leave out that statement and still have enough to justify their focus on ESM studies.

Response: We fully agree with the referee that the stress system does not differentiate between a laboratory stress task or a daily stressor. However, depending on the nature of the stressor, we do believe the stress response differs between different instances. The very abrupt on- and offset of stressor exposure in the lab, where often anticipatory stress is tried to be kept to a minimum by inclusion of a baseline period, is arguably not comparable to typical daily-life stressors such as work stress, social stressors, ruminative thoughts, etc. that have much less clear start- and endpoints. In that sense, the stress response that we typically observe in the lab probably does not reflect stress system activity in daily life. However, we do agree with the referee that we cannot conclude that this is the reason for heterogeneous results from lab tasks and have therefore deleted this sentence on page 5.

4. I agree that it is difficult to compare studies due to the wide variety of statistical approaches. One of the conclusions could be that it will be of importance to follow-up with a meta-analysis, which would allow for tackling the main research question using one unified statistical approach.

Response: This is a very good suggestion and we have added the following sentence to our discussion on page 34.

“Although most studies used MLM, the large diversity between models prevented us from conducting meta-analyses based on the reported values of the associations per stress measure. Therefore, an accurate estimate of the strength of the association could not be provided. Future investigations should put in effort to mirror the statistical models and methods previously used to estimate the association between self-reported and cardiovascular measures of stress so that meta-analyses can be conducted.”

Reviewer #2: This systematic review evaluated the evidence for studies that have assessed daily stress using ambulatory methods and associated ratings of self-reported stress with cardiovascular measures. The most interesting point is that it focuses on daily stress. I agree that the results from laboratory setting studies using standardized stress task are different from those measured in the real-life stressful condition. This paper is interesting throughout, but I have a few minor comments.

1. One of the aims of this review is to investigate an association between acute stress and physiological measures. It would be interesting if the analysis could be limited to only those studies that assessed acute stress.

Response: We agree with the referee that looking at associations for acute stress only would be very interesting. However, it is, using these data, impossible to disentangle acute from chronic stress. Therefore, to prevent confusion, we have removed the word “acute” from our aims paragraph on page 5.

2. P33 line 3: “One possible explanation for sample differences is that patients and individuals at risk may experience more stress during the day, providing for more variability in the data and hence increase the likelihood of finding an association.” Does this mean that the patients and individuals at risk are more frequently exposed to chronic stress, or does it mean that they are more sensitive to stressors?

Response: Good point. We meant overall more fluctuations in their stress levels due to both more exposure to stressors and increased sensitivity to stress, as only higher overall levels of stress would not result in more fluctuations throughout the day. We have clarified this as follows:

“One possible explanation for sample differences is that patients and individuals at risk may experience more fluctuations in their stress levels during the day, providing for more variability in the data and hence increase the likelihood of finding an association.”

3. P34 line2: Validation of BP monitoring device evaluates the accuracy of BP values measured by BP monitoring devices compared with those measured by mercury sphygmomanometers, that is, Spacelabs 90207 is a validated device for monitoring BP.

Response: We agree with the reviewer. However, we also believe that we have made this point very clear in our manuscript. In the line the referee refers to, we explicitly state that Spacelabs 90207 indeed is a valid tool for BP monitoring. We do feel that we have to mention the limitations that are described in the literature regarding the device. We hope the referee agrees that our current phrasing accurately describes both.

Attachments
Attachment
Submitted filename: Response to Reviewers.docx
Decision Letter - Ricarda Nater-Mewes, Editor

The association between self-reported stress and cardiovascular measures in daily life: A systematic review

PONE-D-20-29015R1

Dear Dr. Vaessen,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Ricarda Nater-Mewes, PhD

Academic Editor

PLOS ONE

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #2: The manuscript is well revised for the points commented by reviewers.

Compared to the previous version, this revised manuscript is more systematically organized and easier to understand.

I have no further comments.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Urs M. Nater

Reviewer #2: No

Formally Accepted
Acceptance Letter - Ricarda Nater-Mewes, Editor

PONE-D-20-29015R1

The association between self-reported stress and cardiovascular measures in daily life: A systematic review

Dear Dr. Vaessen:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Ricarda Nater-Mewes

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .