This systematic review examines the relationship between sympathetic and parasympathetic activity on the one hand and job stress and burnout on the other, and is registered at PROSPERO under CRD42016035918. Background: Previous research has shown that prolonged job stress may lead to burnout, and that differences in heart rate variability are apparent in people who have heightened job stress. Aims: In this systematic review, the associations between job stress or burnout and heart rate (variability) or skin conductance are studied. Besides, it was investigated which–if any–guidelines are available for ambulatory assessment and reporting of the results. Methods: We extracted data from relevant databases following the PRESS checklist and contacted authors for additional resources. Participants included the employed adult population comparing validated job stress and burnout questionnaires examining heart rate and electrodermal activity. Synthesis followed the PRISMA guidelines of reporting systematic reviews. Results: The results showed a positive association between job stress and heart rate, and a negative association between job stress and heart rate variability measures. No definite conclusion could be drawn with regard to burnout and psychophysiological measures. No studies on electrodermal activity could be included based on the inclusion criteria. Conclusions: High levels of job stress are associated with an increased heart rate, and decreased heart rate variability measures. Recommendations for ambulatory assessment and reporting (STROBE) are discussed in light of the findings.
Citation: de Looff PC, Cornet LJM, Embregts PJCM, Nijman HLI, Didden HCM (2018) Associations of sympathetic and parasympathetic activity in job stress and burnout: A systematic review. PLoS ONE 13(10): e0205741. https://doi.org/10.1371/journal.pone.0205741
Editor: Enzo Pasquale Scilingo, Universita degli Studi di Pisa, ITALY
Received: January 11, 2018; Accepted: October 1, 2018; Published: October 18, 2018
Copyright: © 2018 de Looff et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This research was funded by a grant from “De Borg” and “DForZo”(Directie Forensische Zorg). De Borg is a collaboration of four mental health organizations for the clinical treatment of people with behavior disorders and mild intellectual disabilities or borderline intellectual disabilities (MID- BIF). DForZo is part of “DJI” (Dienst Justitiele Inrichtingen) and is responsible for executing detention sentences on people that are sentenced by the justice system. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. PdL received funding.
Competing interests: The authors have declared that no competing interests exist.
Job stress can be divided into momentary and prolonged stress. Particularly, prolonged job stress may lead to burnout [1–3], which has substantial negative socioeconomic consequences. Traditionally, job stress and burnout are measured with self-report questionnaires that are often based on a specific theoretical model. For instance, the Effort Reward Model defines job stress as an imbalance between the efforts and rewards on the job  while the often used Maslach Burnout Inventory defines burnout as a combination of exhaustion, cynicism and decreased personal accomplishment . In addition to cognitive, emotional, and behavioral effects, prolonged job stress has detrimental effects on cardiovascular functioning of human beings , which is primarily controlled by the autonomic nervous system . In this systematic review, we focus on the association between job stress and burnout on heart rate (variability) and skin conductance.
The human body maintains balance of key regulatory functions such as temperature, metabolism and heart rate through the autonomic nervous system (ANS) . This system consists of two major branches; a sympathetic nervous system (SNS) and a parasympathetic nervous system (PNS). Both branches play a crucial role in the immediate stress regulatory response of the body . The SNS facilitates behavioral activation in response to perceived threat (fight/flight response), resulting in, for instance, increased heart rate and sweat production. The PNS, on the other hand, facilitates homeostasis of the body (rest/digest situation), resulting in, for instance, reduced heart rate .
The human body maintains balanced through the ANS by efferent (neurons that carry impulses outward from the brain and spinal cord to an effector such as organs) and afferent (neurons that carry peripheral impulses to the brain or spinal cord) nerves . In the face of a stressor, which can be both physical and nonphysical , a range of complex reverberating systems is activated to deal with the stressor  such as higher order brain processes, coordination of blood flow, heart rate, breathing rate, release of hormones, and activation of muscle fiber to react to the stressor . In terms of time, the parasympathetic effects on heart rate act within milliseconds, while the sympathetic effects on heart rate and skin conductance act in seconds [12,13].
Heart rate is primarily controlled by tonic vagal (parasympathetic) inhibition of the heart. The vagus nerve primarily acts on the sinoatrial node (responsible for pace of the heart rate), while the SNS primarily acts on the atrioventricular node (responsible for the force of contraction). The inhibitory effects of the vagus nerve result in slower heart rate while disinhibitory effects increase heart rate [8,14].
The Polyvagal theory explains the flow from body to brain from an evolutionary perspective. According to this evolutionary perspective, the vagus nerves (which is the tenth cranial nerve) plays a key role in the ANS. The myelinated branch of the vagus nerve is assumed to be the most sophisticated part and to control SNS activity [15,16]. Lower PNS activity therefore indicates less control of the myelinated branch, resulting in less inhibition of the fight/flight characteristic of the SNS. Although the Polyvagal perspective on PNS and SNS control is under debate [17,18], there is a relatively broad consensus that especially dysregulation of the PNS underlie emotional and behavioral problems. In line with this, in chronic stressed participants, a hypoactive PNS is usually observed with disinhibition of sympathoexcitatory circuits with the phenomena of increased HR and increased blood pressure. As a result of prolonged energy mobilization different phenomena occur such as allostatic load , irritability  or a feeling of exhaustion . Feeling stressed or burned out from work is the result of a complex interplay between the brain, spinal cord, and ANS in which the interoceptive afferent neural system is responsible for becoming aware of the physiological state of the body , and is mainly caused by the afferent function (80%) of the vagus nerve .
According to Vrijkotte et al. , the detrimental effects of job stress are the result of sympathetic activation in combination with parasympathetic withdrawal. In the following paragraphs we will first focus on the stress response in relation to job stress and burnout in order to provide the reader with some common conceptualizations of job stress and burnout. Following this, we will discuss heart rate and skin conductance measures that were analyzed in this review.
According to Boucsein , stress “can be defined as a state of high general arousal and negatively tuned but unspecific emotion, which appears as a consequence of stressors (i.e., stress-inducing stimuli or situations) acting upon individuals. Stressors can be defined as subjective and/or objective challenges exceeding a critical level with respect to intensity and/or duration” (p.381), which is in accordance with the theory of cognitive appraisal . A stress reaction can be described in cognitive, emotional and physiological responses . The cognitive and emotional responses traditionally have been measured with self-report questionnaires, whereas the physiological response can be quantified through both biomedical (e.g., blood, urine, and saliva) and autonomic nervous system markers (blood pressure, respiration rate, heart rate, and skin conductance) [12,23,24].
More specific cases of stress, i.e. job stress and burnout have been described in association with autonomic nervous system markers. These markers have increasingly been the subject of research over the past decades . Technological advances enable users to monitor these markers over a prolonged period of time using ambulatory devices. Both autonomic nervous system markers of heart rate and Electrodermal Activity (EDA; often recorded as skin conductance, or skin resistance p. 2)  have been shown to be related to job stress and burnout, and are the primary focus of the current systematic review.
1.1 Theoretical models on job stress and burnout
Burnout has been proposed as one possible outcome of prolonged job stress since the 1980’s . Job stress and burnout are mostly measured with self-report questionnaires. The two most often used models to assess job stress are the demand-control model  (and the more recent demand-control-support model)  and the effort-reward imbalance model [4,29]. The first model distinguishes between demands and control on the job. Demands are measured in terms of time, quantity, and mental variables on the job whereas control is measured as the amount of decision latitude, growth possibilities, and the amount of creativity one is able to put in one’s work . There is a reciprocal relationship between demands and control, where an imbalance towards high demands/low control is used to describe job stress. The second theoretical model distinguishes effort and reward on the job. Efforts are measured with variables such as demands, workload, and work pressure whereas reward is measured in terms of monetary incentives, self-esteem, and career opportunities . An imbalance between the two is referred to as high cost and low gain. Siegrist et al.  put it as follows: “in the long run, the imbalance between high effort and low reward at work increases illness susceptibility as a result of continued strain reactions” (p. 1485).
Next to job stress, burnout is also defined in various theoretical models. A well-known and influential model of Maslach  characterizes burnout as a feeling of exhaustion and depersonalization, with low levels of personal accomplishment. Exhaustion includes feelings of being used up or emotionally drained by one’s work . Depersonalization is characterized by feelings of callousness towards other people, while low personal accomplishment is described in terms of the perceived impact of one’s work. Considering that burnout is a possible severe reaction to (prolonged) job stress, we hypothesize that if burnout is the result of job stress, the effect of burnout on the autonomic nervous system might have an even stronger influence than the effect of job stress alone.
In the following paragraphs we will first discuss some common heart rate measures followed by the skin conductance measures that were analyzed in this systematic review.
1.2 Physiological measures of job stress and burnout
HR can be analyzed both in terms of beats per minute and in terms of the inter-beat interval (IBI). The mathematical analysis of HRV is based on the variation of the IBI interval , and can be divided in the amount of parasympathetic or mixed (both parasympathetic and sympathetic) activity that is reflected [9,13,34–36]. HRV can be calculated in both time domains and frequency domains  (and nonlinear analysis, but this was not included in the current review). Three time domain measures are used in the current review and are based on the variation in peak to peak interval. The standard deviation of these peak-to-peak intervals is also referred to as the standard deviation of normal-to-normal intervals (SDNN), which is a measure of overall HRV . In addition, the percentage of adjacent cycles greater than 50ms apart (PNN50) and the root mean square of successive differences (RMSSD) are used. A Frequency domain measure is also included. These measures are based on the analysis of peak-to-peak (RR) interval sequences  as well. The frequency components can be calculated as the distribution of power (i.e. variance of the peak-to-peak interval) as a function of frequency. The high frequency power is thought to primarily reflect parasympathetic activity while the other measures reflect mixed activity . Only the HF component is included in the current review (0.15–0.4 Hz).
The measures in the current review are predominantly parasympathetic (PNN50, RMSDD, HF) or sympathetic (EDA measures) in nature. Besides HR, a second mixed measure was included (SDNN) that is traditionally viewed as HRV . SDNN is sometimes considered as the total measure of autonomic nervous system activity (see for an overview, p. 1813) .
There is considerable heterogeneity in methodology and measurement that might influence the recordings of HR. For instance, studies report rest measures [38,39], 24 hour recordings [40,41], HR measures during controlled breathing  or during a specific task . In addition, ECG (electrocardiogram) devices [30,43,44], blood pressure devices [45,46] or ambulatory PPG (photoplethysmography) sensors  are used. Studies report on measures during work , leisure time , rest  or at night . Studies report on untransformed values [45,50], linear transformations [41,51] or both . Bivariate measures are sometimes reported [13,39] or studies report on adjusted models [6,52]. These choices might seriously influence the results that are reported. Moreover, there is significant diurnal variation in both HR [53,54] and EDA  which makes the comparability between studies that use different lengths of recording or different time intervals challenging.
EDA is relevant with respect to skin conductance or skin potential . It is one of the most sensitive markers of arousal [12,56], and solely the result of the sympathetic activation of the autonomic nervous system . Although EDA has been studied extensively in experimental research on (among others) anxiety, stress, depression, and personality, it has not often been reported as a marker specifically in association with job stress. This might be due in part to the equipment that was needed to measure EDA in the workplace (e.g., multiple sensors on the fingers and/or hand palm). Recent technological advances make it easier and less intrusive to measure EDA [57,58]. EDA has both tonic (level) and phasic (responses) components. The typical form of a response is well described , and several parameters can be extracted such as the height, rising time, area under the curve, or decay time of a response. For this review we will focus on the skin conductance level (SCL), the number of non-specific skin conductance responses per minute (ns.SCR) and the height (amplitude) of the non-specific responses (SCR.amp), as these have been associated most with emotional load in job-related EDA research (pp. 460–462) . Boucsein  reported results from a few studies on the association between EDA and job stress. There is a tendency of increased SCL, ns.SCR, and SCR.amp with increased strain and stress. Therefore, these markers will also be addressed in this systematic review.
A recent systematic review on job stress and HRV concluded that “stress at work is generally associated with increased risk of disease and worsened health profiles as indicated by decreases in vagally-mediated HRV.” (p. 1814) . Where these authors looked at both mixed and vagally (parasympathetic) mediated HRV measures in association with job stress, we will focus on these measures (RMSSD, PNN50, HF, HR, SDNN), as well as on EDA in association with both job stress and burnout. Moreover, we will also assess the direction of the associations, even if the effect is non-significant . In addition, the former review analyzed both total as well as subscales of job stress, while this review will solely rely on total validated scales for both job stress and burnout. Only the full scales of the questionnaires were used as the current review focused on the association between both EDA and HR(V) with job stress and burnout. This served as a means to compare the results on ‘job stress’, and is an important distinction with the Jarczok  review that investigated the more general ‘workplace stressors’ as both full and subscales were considered . For instance, Jarczok et al.,  reported that need for control significantly decreased HF in the Hanson  study. Although need for control is a subscale of the job stress questionnaire, it is not necessarily considered to be job stress. People can experience heightened demands, but if control is not decreased there is not a ‘pure’ association with job stress as a full scale. The results are thus only applicable to workplace stressors, but not job stress. As the current review compared job stress to burnout, only full scales were considered to compare the job stress-burnout association instead of making comparisons between depersonalization and demands for instance.
This systematic review could therefore be considered, at least in part, as both a replication, update and an extension of their previous work. In sum, we want to know what the association is between job stress/burnout and HR(V)/EDA, which parameters might prove useful, and which recording periods are favorable over others to analyze.
Based on the outcomes of the previous review, three specific hypotheses are formulated. First, it is expected that there are positive associations between job stress/burnout and HR and EDA. Second, negative associations between job stress/burnout and HRV are expected. Third, the association between burnout and HR(V)/EDA is stronger than the association between job stress and HR(V)/EDA as burnout is a possible result of severe, enduring and prolonged job stress. Participants will include the employed adult population comparing validated job stress and burnout questionnaires examining heart rate and electrodermal activity. In addition, the timeframes that are used to assess the physiological measures vary considerably, therefore this review also aims to provide some guidelines of measurement and reporting.
2.1 Literature search and screening criteria
The literature search focused on the relationship between job stress and burnout on the one hand, and EDA, and HR(V) on the other. The review protocol was registered in the international prospective register of systematic reviews (PROSPERO) with ID number CRD42016035918. We used the Preferred Reporting Items for Systematic reviews and meta-analysis (PRISMA) to guide the reporting on the systematic review . The databases that were searched for this systematic review were PsychINFO, Medline, Embase, and Web of Science. For this, we used the subscription of the Radboud University in Nijmegen, the Netherlands. The search engines, and accordingly, the search terms of the databases differ; for this reason we included the search terms in S1 Appendix which included search terms on HR, HRV, EDA, burnout and job stress. The search terms were peer-reviewed by three librarians using the Peer Review of Electronic Search Strategies (PRESS) checklist , which resulted in some additional suggestions, the narrowing of search terms and addition of relevant keywords. As the task force guidelines for HR measurement were published in 1996  and needed some time to be adopted, it was decided to include articles from 2000 upwards. Zotero (v. 5.0.52) and Refworks were used to process the references.
The final search was conducted on December 23rd 2016. The final searches yielded a total number of 1,814 studies. Besides citation snowballing, every included study author (only the corresponding authors) was contacted to ask if they were aware of any further or so-called ‘grey’ literature, which yielded an additional 13 studies. In the end, we included 38 articles (see Fig 1).
2.2. Study selection
The following inclusion criteria were applied:
- The studies focused on the employed adult population and should concern job stress or burnout related measures, as predictor variables and HR(V) or EDA as outcome variables.
- The studies focused on baseline, workdays, leisure time or combinations of those.
- The studies included a validated subjective measure of job stress or burnout.
- The included studies were English articles published between 2000 and 2016.
We had no further requirements as far as the study design or participants were concerned. Comparisons were made based on validated questionnaires. The HR(V) and EDA measures were divided in separate outcomes for rest, task, workday, leisure, sleep time or combinations of the entire period. We performed an initial screening with three (PCdL, HN, PE) reviewers to establish if the inclusion and exclusion criteria were transparent. For this purpose, two sets of 50 randomly sampled articles were used to establish interrater agreement. This initial screening resulted in 85% interrater agreement on the title and abstract screening, and consensus on transparency of the inclusion and exclusion criteria.
We set out to perform a meta-analysis as this would allow for explaining heterogeneity in effect sizes through moderator analysis [62, pp. 198–228]. However, most of the articles did not report on bivariate correlations or means. A meta-analysis therefore would have resulted in a limited number of processed articles. We could have opted for the use of partial correlations, but there is debate on the use of them , even if the results of the bivariate and partial analyses are reported separately. Because we were unable to perform moderator analyses in a meta-analysis we decided to do an exploratory analysis on sample size, sex differences and age as these are expected to moderate the association between psychophysiology and job stress/ burnout.
2.3 Coding and reporting
Two authors double coded the effect directions and significance levels of the included articles (performed by PCdL and LJMC), and the interrater agreement was 88%. After a consensus meeting, both authors agreed on 100% of directions and significant associations. In addition, the articles were coded on the HR(V) or EDA outcomes, and the period of analysis, the time of the HR(V) and EDA measurement, the applied stress model (job stress, burnout), the time of stress measures, and the cut-off used for making subgroups of the participants. Furthermore, several other measures were coded (21 of 38 articles were double coded by (PE, HN, RD)). The risk of bias assessment for all articles are presented in S3 Appendix. In order to avoid simply looking at p-values (vote counting), we also looked at the direction of the comparisons. A positive direction means that higher levels of job stress and burnout were associated with higher levels of HR(V) and EDA. In case the articles reported mean differences or correlation coefficients these were used to describe the found effects. If no tables or information was available the wording of the authors was coded. For instance, Uusitalo  only reported all significant correlations in a table and concluded in the text that “the pure vagal time-domain index RMSSD was the only HRV measure which correlated with ER-imbalance” (p. 835). Since that was the only significant effect, it was assumed that the other investigated measures in the study, that is both HF and SDNN, were non-significant. These measures were therefore set to “no effect” and significance level as “not reported” because we also did not have information on the direction of the association. If tables were available we extracted the direction of the association from the tables, if no significance test was applied to the subgroups in those tables we reported that the significance was n.r. (not reported). All significance levels were set at p < .05. All available data is included with the article to both enhance reproducibility and compliance with the PLOS policy.
3.1 Study characteristics
We included 38 articles which reported on 119 outcome measures (Table 1). All reported outcomes in these 38 articles turned out to be HR(V) measures; No EDA studies met the inclusion criteria. In the initial full text review, we did identify 4 EDA studies that were possibly eligible, but they were excluded because of the use of a non-validated job stress questionnaire (2 studies) or because it was a simulation study (1 study), or a real-life stress exposure (1 study).
Nineteen of 38 study authors responded to requests of grey literature or additional information. For four authors we were unable to retrieve a valid email address.
3.2 Association between both burnout and job stress with (para)sympathetic measures
The first hypothesis states that there is a positive association between HR and job stress/burnout. The associations between HR/SDNN and job stress/burnout are summarized by recording period in S2 Appendix. There were thirty-five reported outcomes on HR, of which 32 outcomes are reported in the Appendix. As can be seen in S2 Appendix, the majority of articles on HR and job stress/burnout found positive associations. The three non-reported outcomes were difficult to categorize (see Table 2). First, Poorabdian et al.  reported on an omnibus Chi-square test of which it was unclear at which time point the measures were taken. However, the direction of the association was significantly positive. Second, only one reported outcome for the Moya-Albiol et al.  study was significantly negative while one outcome was mixed. The study reported a significant negative association caused by measures in the middle of the workday. Third, Borchini et al.  reported on a non-significant positive relationship during a period of leisure and night. Therefore, in sum, twelve reported outcomes were significantly positive effects. The ratio of significant effects is in favor of a positive association (12 positive effects vs 2 negative effects; 12:2). Finally, seventeen outcomes reported on SDNN, of which three reported outcomes were significantly negative, and one was significantly positive.
The second hypothesis states that there is a negative association between the reported parasympathetic outcomes and job stress/burnout. Reported outcomes on HF, RMSSD and PNN50 were included in this systematic review. The association between parasympathetic measures and job stress/burnout are also summarized in S2 Appendix. Thirty-four outcomes were reported on HF. Only 33 outcomes are reported in S2 Appendix as Hanson et al.  reported on a non-significant negative association for work leisure period, which was not a defined category in our study. Seven reported outcomes were significantly negative, two were significantly positive. Twenty-seven outcomes were reported on RMSSD, five of the reported outcomes were significantly negative, one was significantly positive. One study outcome was mixed on the conclusion; on the first day of the assessment no effect was found, whereas on the second day a significant and negative effect was found . Six outcomes were reported on PNN50. Only one of the reported outcomes was significantly negative. One further remark has to be made for S2 Appendix. For PNN50, two of the outcomes were measured in rest. One of the outcomes was reported on a significant negative effect for the female sample  while the other reported outcome was positive, but non-significant for the male sample.
To summarize, we found 13 significantly negative reported outcomes for the parasympathetic outcomes, compared to 3 significantly positive reported outcomes. The relatively high number of negative effects seems to be in support of the second hypothesis, at least as far as the HF and RMSSD outcomes are concerned. However, most of the 67 reported outcomes were non-significant.
3.3 Burnout and job stress
The third hypothesis states that the association between burnout and HR(V)/EDA is stronger than the association between job stress and HR(V)/EDA. Six outcomes were reported on the HR-burnout association, however, only one was significantly positive , with the caution that the burnout group was entered as a dummy variable and part of a multiple regression analysis. Twenty-nine outcomes were reported on the HR-job stress association. Eleven outcomes were significantly positive. These results indicate the opposite of the hypothesis, the association between job stress and HR seems to be found more often than the association between burnout and HR.
As for the parasympathetic outcomes, seven outcomes were reported on the HF-burnout association. Only one reported outcome had a significant negative effect. Twenty-seven outcomes were reported on the HF-job stress association. Five reported outcomes were significantly negative. Five outcomes reported on the RMSSD-burnout association. Only one reported outcome had a significant negative effect. Twenty-two outcomes were reported on the RMSSD-job stress association. Four reported outcomes were significantly negative, one of the effects was mixed . Note that there are two articles and 11 reported outcomes using both JDC and ERI to divide subjects in high/low strain. In sum, these results do not indicate that the parasympathetic association between burnout and HRV is found more often than the association between job stress and HRV.
3.4 Exploratory analysis
Because we were unable to perform a meta-analysis and for purposes of generating hypotheses, we explored whether the effects changed as a result of sample size, sex, or age (Table 3). In order to get a good contrast between samples, the results were analyzed by median splits based on these three variables. We expected HR to have a positive association with job stress and burnout. For the parasympathetic measures, a negative direction was expected. Interestingly, articles with higher sample sizes, and thus presumably providing more power to find a true effect, indeed found twice as much of the hypothesized effects than articles with lower sample sizes. The interpretation of the sex split is less clear as the samples are mixed, but the samples with a higher percentage of women seem to have more negative parasympathetic effects (11 vs 1). No age effects were found.
This systematic review focuses on the relationship between job stress and burnout on the one hand and parasympathetic and sympathetic activity on the other hand. The current review could be considered as both a replication, update and an extension of previous work on this topic. The overall aim of this review was to better understand the association between job stress/burnout and HR(V)/EDA, which parameters might prove useful, and which recording periods are favorable over others to analyze.
4.1 Main findings for the hypotheses
The first hypothesis stated that there is a positive association between HR measures and job stress/burnout. First, support for this hypothesis came from both the high number of positive associations and the ratio of positive and negative effects (12 vs. 2), which clearly showed that the likelihood of a positive association between HR and job stress/burnout is higher. In other words, the results of this review support that high levels of job stress and burnout are associated with an increased HR. Second, one-third of all reported outcomes (12/35) showed a significant positive association between HR and job stress/burnout. However, if we leave burnout out of the analysis, 11 of 29 of the effects for job stress were positive. The number of articles on burnout included in this systematic review was too small to draw any firm conclusions. As van Doornen  also pointed out, the daily hassles of job stress may be incomparable with scales of exhaustion, depersonalization and personal accomplishment as a result of enduring job stress, but further research is necessary to investigate this claim.
Hypothesis 2 stated that there is a negative association between parasympathetic outcomes, indicated by HRV parameters, and job stress/burnout. Support for this hypothesis came from both the number of negative directions and the ratio of negative and positive effects (13 vs. 3), which showed that the likelihood of a negative association is higher. In addition to the ratio, one fifth (13/67) of all reported outcomes showed a significant negative association. If we leave burnout out of the analysis, one sixth (7/42) of the effects were negative. Twelve of the 19 articles included by Jarczok et al.  were also included in this systematic review. The twelve articles included in both systematic reviews showed comparable results, although Jarczok et al.  included fewer reported outcomes for the parasympathetic measures than in our study (38 articles). In Jarczoks’ sample, half of the parasympathetic outcomes were significantly negative (17/33) on the (sub)scales. Our analysis resulted in a significant negative effect in only one fifth (6/29) of the outcomes on the full scales, which explains the difference as the unit of analysis of the scales is different. For example, Jarczok et al.  also included effects of the separate scales for demands, control, effort or reward of the JDC and ERI (workplace stressors vs job stress) models while we only considered articles that reported results on the entire scale. However, the direction of the effect in both studies (i.e. the study by Jarczok et al.  and the current study) was overwhelmingly negative, that is, higher levels of job stress are associated with lower parasympathetic activation. It is worth mentioning that the correlation between HF and RMSSD is usually high (>.90) . Therefore, it seems intuitive to expect a significant association of RMSSD if HF also has an effect, and vice versa, which results in an overestimation of the effects found in our study, due to multicollinearity. Finally, although SDNN is not a primarily sympathetic or parasympathetic outcome measure, there was a tendency towards a negative association between SDNN and job stress/burnout in our study.
The third hypothesis stated that there is a stronger association between psychophysiological measures and burnout than between psychophysiological measures and job stress. However, this hypothesized relationship could not be confirmed. One explanation for this might be the small number of included articles on burnout. Another potential reason might be that people with burnout symptoms do not experience job stress symptoms anymore as they are on sick leave which might have a calming effect on the body, and thus the (para)sympathetic measures.
In conclusion, it is important to state that most of the reported outcomes were non- significant, and for some articles that reported that there was no effect, we could not determine the direction of association. We did find partial support for the two hypotheses regarding a positive direction for the HR measures and a negative direction for the associations of parasympathetic measures with job stress and burnout. The ratio for the HR measures (12 vs. 2) was slightly higher than the ratio for the parasympathetic measures (13 vs. 3). Also, some evidence was found that articles with a larger sample size more often found a significant association. However, the third hypothesis regarding a stronger association between psychophysiological measures and burnout as opposed to job stress was not supported.
4.2 Methodological considerations
Related to the findings for the three hypotheses, four observations can be made regarding methodology and measurement. First, most reported HR outcomes came from rest (n = 11) measures. The number of reported parasympathetic outcomes was almost twice as high, most measures were taken at rest (n = 16), workday (n = 13), for 24 hours (n = 14), and at night (n = 13). It is remarkable that only few articles used rest measures since these seem to be most easily obtained, although some researchers may disagree. However, a rest protocol does assure that there is no movement or psychosocial demand on the participants, which might result in an artifact free signal. Also, there is some heterogeneity within these rest measures. Borchini et al.  pointed out that a strict standardized ECG protocol is necessary to obtain precise results. We recommend to include rest as a baseline measure in future studies. The baseline measure could also be used to adjust for between-person variation in psychophysiological recordings. It is worth noting that both HR and EDA show diurnal variation which suggests that this has to be taken into account as well when obtaining rest measures [53–55].
Second, regarding the prolonged measurements of HRV there are two points worth noting. First, Uusitalo et al.  suggest that nonlinear measures of HRV are less movement prone. In comparison with frequency domain measures, they argue that time domain and nonlinear HRV might prove to be more stable and suitable for situations in which a person may show a lot of movement resembling the real-life situations. Only few included articles report on controlling for physical activity, which is expected to have an influence. It is recommended to adjust for these movement artifacts if possible. In addition, Kamath et al.  mentioned the influence of respiration on the HF component of frequency domain measures; as breathing decreases, HF decreases as well. The authors state that HF measures can only be obtained in case one controls for breathing which might not be possible for all mobile devices that are currently on the market. We recommend careful consideration controlling for movement and breathing if possible.
Third, Clays et al.  point at the fact that one cannot compare all parameters obtained in different time intervals as they are dependent on time of analysis. For instance, SDNN is highly dependent on the length of the recording, and there are apparent differences in the duration of measurement intervals between studies. SDNN is typically used for 24-h recordings only. This is in line with remarks made by Kamath et al.  that long term measurements are preferably analyzed by time domain methods, and short term measures are preferably analyzed by frequency domain methods. With time domain measures it is difficult to discriminate between sympathetic and parasympathetic measures. In the current review, five of the outcomes on rest measures, which are usually 3–15 minutes long, were time domain measures as opposed to 11 outcomes on the frequency domain. There is a need for guidelines on the use of time domain or frequency domain methods and the duration of assessment from different laboratories . Although a recommendation on duration of measurement is beyond the implications of this review, we would recommend reporting exact timeframes, methods of analysis, and transformations and filters applied to compare data more easily, even if mobile devices are not used in laboratories, but in real life situations.
Fourth, a final notion on real-life measurement is made by Rau et al., . The authors suggest that the assessment of leisure time differs between studies, which may consequently lead to differences in findings. Some studies operationalize leisure time as the time between work and sleep while others consider resting days as leisure time. We recommend the use of after work leisure time as a separate terminology from a day that is completely without work.
Many of the reported outcomes are not independent. Therefore, we evaluated how many of the significant associations came from the same study. For the HR outcomes, the 12 significant positive outcomes came from 11 articles, whereas the 19 non-significant reported outcomes came from 14 articles (no significance test was reported for 3 outcomes; and 1 study reported mixed effects.) Thus, there appeared to be more independency among the significant associations than among the non-significant associations, which increases the reliability of the significant relationships. For the parasympathetic reported outcomes, the 13 significant negative outcomes came from 10 articles, whereas the 49 non-significant outcomes came from 22 articles (no significance test was reported for 2 outcomes; and the association for 3 outcomes was in the opposite direction of our hypothesis–positive instead of negative.) Again, there was more independency among the significant associations than among the non-significant associations.
Regarding the exploratory analyses it is worth noting that for sample size both sympathetic and parasympathetic measures show a tendency to obtain more associations in the hypothesized directions if the sample size is larger. A larger sample size often means a higher power, which implies a higher chance of obtaining a true effect, in this case a positive relationship between HR and a negative relationship between parasympathetic functioning and job stress/burnout which increases our trust in the relationships that we found. We do not want to extrapolate conclusions based on sex as we had less female samples, which is an indication that more female samples are needed in future studies to increase our confidence.
4.3 Directions for further research
A particular strength of the current study is that the results reported by Jarczok et al.  were replicated. This is especially relevant as psychological research is currently dealing with a replication crisis . Second, this review extended the former one by only considering the full scales of job stress, adding the concept of burnout, and including EDA as a purely sympathetic marker. A third strength of this review is the additional search that was performed for gray literature by emailing all included authors. In spite of this strength, this study has a limitation on ‘vote counting’. If bivariate correlations or adjusted models with the same covariates are unavailable, it is difficult to summarize the true effect. The problem with vote counting is that it does not consider the magnitude of an effect, and control for heterogeneity or moderation is impossible. A second limitation is that we were unable to perform a meta-analysis which makes the results less compelling than they could have been.
We also have some additional recommendations. First, there is high variability in the number of covariates and bivariate or partial correlations reported. We strongly recommend to report both bivariate relations and adjusted models as this can seriously alter the effects that are found. This becomes even more evident as we consider that, as mentioned earlier, there is dependency between the reported outcome measures as they are all based on (variation in) HR, and some outcome measures have high correlations (i.e. the correlation between HF and RMSSD is usually high (>.90) . We recommend that studies use the STROBE (Strengthening the Reporting of Observational Studies in Epidemiology;  statement to guide reporting for future studies.
Second, the use of validated questionnaires is highly recommended, there was an abundance of studies using only one job stress question making it unclear what the construct of the measure was (none of those non validated studies were included in this review). As the subjective meaning of job stress differs between jobs and people within these jobs, for comparability a thorough investigation is important.
Third, in burnout research there is often a predisposed clinical cut-off. In the job stress samples this is not always the case as some report on the quadrants while others use a median split or a 20/80 division. It is recommended to use the same validated cut-offs. A problem with comparability between articles arises as some articles included relatively healthy employees while others included a relatively large number of stressed individuals. In addition, providing the data along with the publication would allow for a meta-analysis of individual data.
Fourth, it is essential to report on both sex and age as there are few articles that report differences between men and women [38,39]. The concept of job stress might not be applicable to men and women alike as Riese  already mentioned. The original constructs might hold true more to men than to women. The psychophysiological profile of stress and burnout in women might be different.
Of course the question remains to what extent self-report questionnaire measures correspond to physiological measures of job stress. HRV is often used as a measure of stress while it does not always match the subjective stress that people experience. It would therefore be worth constructing a psychophysiological profile in which the within-subject baseline is taken into account, which would be possible with a baseline measurement. People differ from each other in baseline measures. It is unclear if their baseline is the same in all circumstances, let alone if the baseline can change in situations where they get stressed. In other words, people might have a moving baseline. However, the vast majority of research until now has been cross-sectional in nature, and comparisons were made between subjects or between groups. The baseline of the subjects is only considered in some of the more recent research .
The fact that there is a small difference in the number of reported parasympathetic associations between our study and the study by Jarczok et al.  stresses the importance of reporting all bivariate correlations or means on all scales, for this will enable a meta-analysis, as was also suggested in more recent research . Moderation analysis can then be performed on different sets of confounders and covariates. The current systematic review includes articles that use a variety of confounding adjustments and covariates, which makes it difficult to compare them.
Lastly, no EDA studies were found that met our criteria. A few studies were considered for inclusion. For instance, Cendales-Ayala et al.  did a simulation study in which it was shown that high demands in bus drivers resulted in significantly increased EDA. Considering the sympathetic nature of the EDA, we expected to find more studies. However, only recently it is possible to obtain EDA measures via mobile devices, such as wristbands, in real life during prolonged periods of time. Based on this development we expect to find more studies on EDA and job stress in the near future.
In conclusion, this study examined whether HR was positively associated with job stress and burnout. In addition, it examined whether there was a negative association between parasympathetic markers, and job stress and burnout. Support was found for both hypotheses. No support was found for the hypothesis that the association with burnout was stronger than it was for job stress. There is a need for more extensive reporting of effect directions, and on female samples, which were underrepresented in the current review. In this sample job stress was mostly related to increases in HR and decreases in RMSSD, HF and SDNN. Maybe these measures can be used as indicators and warning signals of increases in job stress, whereas the relationship with burnout is less clear.
S2 Appendix. Association between HR/SDNN/HF/RMSSD/PNN50 and job stress/burnout by recording period.
S3 Appendix. Newcastle- Ottowa Risk of Bias table for all studies.
- 1. de Vente W, van Amsterdam JGC, Olff M, Kamphuis JH, Emmelkamp PMG. Burnout Is Associated with Reduced Parasympathetic Activity and Reduced HPA Axis Responsiveness, Predominantly in Males. BioMed Res Int. 2015; 431725.
- 2. Hasselberg K, Jonsdottir IH, Ellbin S, Skagert K. Self-reported stressors among patients with Exhaustion Disorder: an exploratory study of patient records. BMC Psychiatry. 2014; 14. pmid:24592907
- 3. Jönsson P, Österberg K, Wallergård M, Hansen ÅM, Garde AH, Johansson G, et al. Exhaustion-related changes in cardiovascular and cortisol reactivity to acute psychosocial stress. Physiol Behav. 2015; 151: 327–37. pmid:26210042
- 4. Siegrist J, Starke D, Chandola T, Godin I, Marmot M, Niedhammer I, et al. The measurement of effort–reward imbalance at work: European comparisons. Soc Sci Med. 2004 Apr; 58: 1483–99. pmid:14759692
- 5. Maslach C, Schaufeli WB, Leiter MP. Job burnout. Annu Rev Psychol. 2001; 52: 397–422. pmid:11148311
- 6. Van Doornen LJP. Work-stress and cortisol; measurements and results. [Werkstress en cortisol; meetfilosofie en bevindingen]. Tijdschr Psychiatr. 2009: 51: 587–594. pmid:19658071
- 7. Bergmann Sverrisdóttir Y. Sympathetic Nerve Activity, Stress, and Cardiovascular Risk. In: Alvarenga M, Byrne D, editors.) Handbook of Psychocardiology. Singapore: Springer; 2016. pp. 760–768.
- 8. Ulrich-Lai YM, Herman JP. Neural regulation of endocrine and autonomic stress responses. Nat Rev Neurosci. 2009 Jun; 10: 397–409. pmid:19469025
- 9. Andreassi JL. Psychophysiology: Human Behavior and Physiological Response. 5th ed. Mahwah, N.J.: Psychology Press; 2006.
- 10. Craig AD. How do you feel? Interoception: the sense of the physiological condition of the body. Nat Rev Neurosci. 2002 Aug; 3: 655–66. pmid:12154366
- 11. Thayer JF, Lane RD. A model of neurovisceral integration in emotion regulation and dysregulation. J Affect Disord. 2000 Dec; 61: 201–16. pmid:11163422
- 12. Boucsein W. Electrodermal Activity. 2nd ed. Boston, MA: Springer US; 2012. https://doi.org/10.1007/978-1-4614-1126-0
- 13. Jarczok MN, Koenig J, Li J, Mauss D, Hoffmann K, Schmidt B, et al. The Association of Work Stress and Glycemic Status Is Partially Mediated by Autonomic Nervous System Function: Cross-Sectional Results from the Mannheim Industrial Cohort Study (MICS). PLOS ONE. 2016 Aug 17; 11: e0160743. pmid:27532642
- 14. Warner HR, Russell RO. Effect of combined sympathetic and vagal stimulation on heart rate in the dog. Circ Res. 1969 Apr; 24: 567–73. pmid:5780152
- 15. Porges SW. The polyvagal theory: phylogenetic substrates of a social nervous system. Int J Psychophysiol Off J Int Organ Psychophysiol. 2001 Oct; 42: 123–46.
- 16. Porges SW. The Polyvagal Perspective. Biol Psychol. 2007 Feb;74: 116–43. pmid:17049418
- 17. Farmer DGS, Dutschmann M, Paton JFR, Pickering AE, McAllen RM. Brainstem sources of cardiac vagal tone and respiratory sinus arrhythmia. J Physiol. 2016 Dec 15; 594: 7249–65. pmid:27654879
- 18. Gourine AV, Machhada A, Trapp S, Spyer KM. Cardiac vagal preganglionic neurones: An update. Auton Neurosci Basic Clin. 2016; 199: 24–8.
- 19. McEwen BS. Stress, adaptation, and disease. Allostasis and allostatic load. Ann N Y Acad Sci. 1998 May 1; 840: 33–44. pmid:9629234
- 20. Groves DA, Brown VJ. Vagal nerve stimulation: a review of its applications and potential mechanisms that mediate its clinical effects. Neurosci Biobehav Rev. 2005 May 1;29: 493–500. pmid:15820552
- 21. Vrijkotte TG, van Doornen LJ, de Geus EJ. Effects of work stress on ambulatory blood pressure, heart rate, and heart rate variability. Hypertens Dallas Tex 1979. 2000 Apr; 35: 880–6.
- 22. Folkman S. Personal control and stress and coping processes: A theoretical analysis. J Pers Soc Psychol. 1984; 46: 839–52. pmid:6737195
- 23. Moksnes UK, Espnes GA. Stress: Concepts, Models, and Measures. In: Alvarenga ME, Byrne D, editors. Handbook of Psychocardiolog. Springer Singapore; 2016. p. 143–62. https://doi.org/10.1007/978-981-287-206-7_11
- 24. Brindle RC, Ginty AT, Phillips AC, Carroll D. A tale of two mechanisms: A meta-analytic approach toward understanding the autonomic basis of cardiovascular reactivity to acute psychological stress. Psychophysiology. 2014 Oct 1; 51: 964–76. pmid:24924500
- 25. Byrne D, Alvarenga ME. Psychogenesis and Heart Disease Now: The Thinking Heart in Action. In: Alvarenga ME, Byrne D, editors. Handbook of Psychocardiology. Springer, Singapore; 2016. p. 1–10. https://doi.org/10.1007/978-981-4560-53-5_2–1
- 26. Cherniss C. Staff burnout: job stress in the human services. Beverley Hills, CA: Sage Publications; 1980. 204 p.
- 27. Karasek RA. Job Demands, Job Decision Latitude, and Mental Strain: Implications for Job Redesign. Adm Sci Q. 1979 Jun; 24: 285.
- 28. Häusser JA, Mojzisch A, Niesel M, Schulz-Hardt S. Ten years on: A review of recent research on the Job Demand–Control (-Support) model and psychological well-being. Work Stress. 2010 Jan 1; 24:1–35.
- 29. Siegrist J, Klein D, Voigt KH. Linking sociological with physiological data: the model of effort-reward imbalance at work. Acta Physiol Scand Suppl. 1997; 640: 112–6. pmid:9401620
- 30. Loerbroks A, Schilling O, Haxsen V, Jarczok MN, Thayer JF, Fischer JE. The fruits of ones labor: Effort–reward imbalance but not job strain is related to heart rate variability across the day in 35–44-year-old workers. J Psychosom Res. 2010 Aug; 69: 151–9. pmid:20624513
- 31. Maslach C, Jackson SE, Leiter MP. Maslach Burnout Inventory Manual. 3rd ed. Palo Alto, CA: Consulting Psychologists Press; 1996.
- 32. Morgan CA, Cho T, Hazlett G, Coric V, Morgan J. The impact of burnout on human physiology and on operational performance: a prospective study of soldiers enrolled in the combat diver qualification course. Yale J Biol Med. 2002; 75: 199–205. pmid:12784969
- 33. Stapelberg NJC, Neumann DL, Shum DHK, McConnell H, Hamilton-Craig I. A preprocessing tool for removing artifact from cardiac RR interval recordings using three-dimensional spatial distribution mapping: Preprocessing tool for RR interval data. Psychophysiology. 2016 Jan; 53: 482–92. pmid:26751605
- 34. Alvarenga ME, Byrne DG. Handbook of Psychocardiology. Springer Singapore; 2016.
- 35. Jarczok MN, Jarczok M, Mauss D, Koenig J, Li J, Herr RM, et al. Autonomic nervous system activity and workplace stressors—A systematic review. Neurosci Biobehav Rev. 2013 Sep; 37: 1810–23. pmid:23891906
- 36. Thayer JF, Verkuil B, Brosschot JF, Kampschroer K, West A, Sterling C, et al. Effects of the Physical Work Environment on Physiological Measures of Stress. Eur J Cardiovasc Prev Rehabil Off J Eur Soc Cardiol Work Groups Epidemiol Prev Card Rehabil Exerc Physiol. 2010 Aug; 17: 431–9.
- 37. Task Force Electrophysiology TF of the ES of C the NAS of P. Heart Rate Variability Standards of Measurement, Physiological Interpretation, and Clinical Use. Circulation. 1996 Jan 3; 93: 1043–65. pmid:8598068
- 38. Eller NH, Blønd M, Nielsen M, Kristiansen J, Netterstrøm B. Effort reward imbalance is associated with vagal withdrawal in Danish public sector employees. Int J Psychophysiol Off J Int Organ Psychophysiol. 2011 Sep; 81: 218–24.
- 39. Hintsanen M, Elovainio M, Puttonen S, Kivimaki M, Koskinen T, Raitakari OT, et al. Effort-reward imbalance, heart rate, and heart rate variability: the Cardiovascular Risk in Young Finns Study. Int J Behav Med. 2007; 14: 202–12. pmid:18001235
- 40. Borchini R, Ferrario MM, Bertù L, Veronesi G, Bonzini M, Dorso M, et al. Prolonged job strain reduces time-domain heart rate variability on both working and resting days among cardiovascular-susceptible nurses. Int J Occup Med Environ Health. 2014 Sep 24; 28: 42–51.
- 41. Herr RM, Bosch JA, van Vianen AEM, Jarczok MN, Thayer JF, Li J, et al. Organizational justice is related to heart rate variability in white-collar workers, but not in blue-collar workers-findings from a cross-sectional study. Ann Behav Med Publ Soc Behav Med. 2015 Jun; 49: 434–48.
- 42. Ohira H, Matsunaga M, Kimura K, Murakami H, Osumi T, Isowa T, et al. Chronic stress modulates neural and cardiovascular responses during reversal learning. Neuroscience. 2011 Oct 13; 193: 193–204. pmid:21763760
- 43. Clays E, De Bacquer D, Crasset V, Kittel F, de Smet P, Kornitzer M, et al. The perception of work stressors is related to reduced parasympathetic activity. Int Arch Occup Environ Health. 2011 Feb; 84: 185–91. pmid:20437054
- 44. van Amelsvoort LG, Schouten EG, Maan AC, Swenne CA, Kok FJ. Occupational determinants of heart rate variability. Int Arch Occup Environ Health. 2000 May; 73: 255–62. pmid:10877031
- 45. Hamer M, Williams E, Vuonovirta R, Giacobazzi P, Gibson EL, Steptoe A. The effects of effort-reward imbalance on inflammatory and cardiovascular responses to mental stress. Psychosom Med. 2006 Jun; 68: 408–13. pmid:16738072
- 46. Rau R, Georgiades A, Fredrikson M, Lemne C, de Faire U. Psychosocial work characteristics and perceived control in relation to cardiovascular rewind at night. J Occup Health Psychol. 2012; 6: 171–181.
- 47. Henning MA, Sollers J, Strom JM, Hill AG, Lyndon MP, Cumin D, et al. Junior doctors in their first year: mental health, quality of life, burnout and heart rate variability. Perspect Med Educ. 2014 Apr; 3: 136–43. pmid:24706177
- 48. Moya-Albiol L, Serrano MÁ, Salvador A. Burnout as an important factor in the psychophysiological responses to a work day in Teachers. Stress Health. 2010 Dec 1; 26: 382–93.
- 49. Kang MG, Koh SB, Cha BS, Park JK, Woo JM, Chang SJ. Association between job stress on heart rate variability and metabolic syndrome in shipyard male workers. Yonsei Med J. 2004 Oct 31; 45: 838–46. pmid:15515194
- 50. Kotov AV, Revina NE. Heart rate variability during “alarm stage” of burnout syndrome in emergency doctors. Bull Exp Biol Med. 2012 Sep; 153: 598–600. pmid:23113234
- 51. Uusitalo A, Mets T, Martinmäki K, Mauno S, Kinnunen U, Rusko H. Heart rate variability related to effort at work. Appl Ergon. 2011 Nov; 42: 830–8. pmid:21356531
- 52. Lennartsson A-K, Jonsdottir I, Sjörs A. Low heart rate variability in patients with clinical burnout. Int J Psychophysiol. 2016 Dec; 110: 171–8. pmid:27535344
- 53. Bexton RS, Vallin HO, Camm AJ. Diurnal variation of the QT interval—influence of the autonomic nervous system. Heart. 1986 Mar 1; 55: 253–8.
- 54. Kamath MV, Fallen EL. Diurnal variations of neurocardiac rhythms in acute myocardial infarction. Am J Cardiol. 1991 Jul 15; 68: 155–60. pmid:1676558
- 55. Hot P, Leconte P, Sequeira H. Diurnal autonomic variations and emotional reactivity. Biol Psychol. 2005 Jul 1; 69: 261–70. pmid:15925029
- 56. Boucsein W, Ottmann W. Psychophysiological stress effects from the combination of night-shift work and noise. Biol Psychol. 1996 Feb 5; 42: 301–22. pmid:8652750
- 57. Kuijpers E, Nijman H, Bongers IMB, Lubberding M, Ouwerkerk M. Can mobile skin conductance assessments be helpful in signalling imminent inpatient aggression? Acta Neuropsychiatr. 2012; 24: 56–59. pmid:25288460
- 58. Poh M-Z, Swenson NC, Picard RW. A Wearable Sensor for Unobtrusive, Long-Term Assessment of Electrodermal Activity. IEEE Trans Biomed Eng. 2010; 57: 1243–52. pmid:20172811
- 59. Hanson EK, Godaert GL, Maas CJ, Meijman TF. Vagal cardiac control throughout the day: the relative importance of effort-reward imbalance and within-day measurements of mood, demand and satisfaction. Biol Psychol. 2001 Mar; 56: 23–44. pmid:11240313
- 60. Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015; 4: 1. pmid:25554246
- 61. McGowan J, Sampson M, Salzwedel DM, Cogo E, Foerster V, Lefebvre C. PRESS Peer Review of Electronic Search Strategies: 2015 Guideline Statement. J Clin Epidemiol. 2016 Jul; 75: 40–6. pmid:27005575
- 62. Card NA. Applied Meta-Analysis for Social Science Research (Methodology in the Social Sciences). 1st ed. New York, NY: Guilford Press; 377 p.
- 63. Rothstein HR, Bushman BJ. Methodological and Reporting Errors in Meta-Analytic Reviews Make Other Meta-Analysts Angry: A Commentary on Ferguson (2015). Perspect Psychol Sci. 2015 Sep; 10: 677–9. pmid:26386006
- 64. Poorabdian S, Mirlohi AH, Habibi E, Shakerian M. Association between job strain (high demand-low control) and cardiovascular disease risk factors among petrochemical industry workers. Int J Occup Med Environ Health. 2013 Aug; 26: 555–62. pmid:24310920
- 65. Bishop GD, Enkelmann HC, Tong EMW, Why YP, Diong SM, Ang J, et al. Job demands, decisional control, and cardiovascular responses. J Occup Health Psychol. 2003 Apr; 8: 146–56. pmid:12703880
- 66. Butterbaugh G, Blackwell P, Aguilar E, Costa R, Reisin T, Roques B, et al. Impact of job or life stresses and affective states on resting blood pressure and heart rate in female nurses. J Hypertens. 2003; 21(suppl 4): S278.
- 67. Chandola T, Britton A, Brunner E, Hemingway H, Malik M, Kumari M, et al. Work stress and coronary heart disease: what are the mechanisms? Eur Heart J. 2008 Mar; 29: 640–8. pmid:18216031
- 68. Collins SM, Karasek RA, Costas K. Job strain and autonomic indices of cardiovascular disease risk. Am J Ind Med. 2005 Sep; 48: 182–93. pmid:16094616
- 69. van Doornen LJP, Houtveen JH, Langelaan S, Bakker AB, van Rhenen W, Schaufeli WB. Burnout versus work engagement in their effects on 24-hour ambulatory monitored cardiac autonomic function. Stress Health. 2009 Oct 1; 25: 323–31.
- 70. Ekstedt M, Akerstedt T, Söderström M. Microarousals during sleep are associated with increased levels of lipids, cortisol, and blood pressure. Psychosom Med. 2004 Dec; 66: 925–31. pmid:15564359
- 71. Eriksson P, Schiöler L, Söderberg M, Rosengren A, Torén K. Job strain and resting heart rate: a cross-sectional study in a Swedish random working sample. BMC Public Health. 2016 Dec; 16: 1–9.
- 72. Fauvel JP, Quelin P, Ducher M, Rakotomalala H, Laville M. Perceived job stress but not individual cardiovascular reactivity to stress is related to higher blood pressure at work. Hypertension. 2001 Jul; 38: 71–5. pmid:11463762
- 73. Hernández-Gaytan SI, Rothenberg SJ, Landsbergis P, Becerril LC, De León-León G, Collins SM, et al. Job strain and heart rate variability in resident physicians within a general hospital. Am J Ind Med. 2013 Jan; 56: 38–48. pmid:22886873
- 74. Johnston D, Bell C, Jones M, Farquharson B, Allan J, Schofield P, et al. Stressors, Appraisal of Stressors, Experienced Stress and Cardiac Response: A Real-Time, Real-Life Investigation of Work Stress in Nurses. Ann Behav Med. 2016 Apr; 50: 187–97. pmid:26608281
- 75. Karhula K, Henelius A, Härmä M, Sallinen M, Lindholm H, Kivimäki M, et al. Job strain and vagal recovery during sleep in shift working health care professionals. Chronobiol Int. 2014 Dec; 31: 1179–89. pmid:25216071
- 76. Lee K-H, Yoon K, Ha M, Park J, Cho S-H, Kang D. Heart rate variability and urinary catecholamines from job stress in korean male manufacturing workers according to work seniority. Ind Health. 2010; 48: 331–8. pmid:20562509
- 77. Nomura K, Nakao M, Karita K, Nishikitani M, Yano E. Association between work-related psychological stress and arterial stiffness measured by brachial-ankle pulse-wave velocity in young Japanese males from an information service company. Scand J Work Environ Health. 2005 Oct; 31: 352–9. pmid:16273961
- 78. Riese H, Doornen LJV, Houtman IL, Geus EJD. Job strain in relation to ambulatory blood pressure, heart rate, and heart rate variability among female nurses. Scand J Work Environ Health. 2004 Dec 1; 30: 477–85. pmid:15635758
- 79. Salavecz G, Kopp M, Steptoe A. The association of work stress with heart rate variability over the working day. Int J Behav Med. 2010; 17(Suppl 1): S192.
- 80. Teisala T, Mutikainen S, Tolvanen A, Rottensteiner M, Leskinen T, Kaprio J, et al. Associations of physical activity, fitness, and body composition with heart rate variability–based indicators of stress and recovery on workdays: a cross-sectional study. J Occup Med Toxicol. 2014; 9: 16. pmid:24742265
- 81. Kamath MV, Watanabe M, Upton A. Heart Rate Variability (HRV) Signal Analysis: Clinical Applications. 1st ed. CRC Press; 2016. 523 p.
- 82. Collaboration OS. Estimating the reproducibility of psychological science. Science. 2015 Aug 28; 349: aac4716.
- 83. Massin MM, Derkenne B, von Bernuth G. Correlations between Indices of Heart Rate Variability in Healthy Children and Children with Congenital Heart Disease. Cardiology. 1999; 91: 109–13. pmid:10449882
- 84. Vandenbroucke JP, von Elm E, Altman DG, Gøtzsche PC, Mulrow CD, Pocock SJ, et al. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration. PLoS Med. 2007 Oct 16; 4: e297. pmid:17941715
- 85. Wulsin L, Herman J, Thayer JF. Stress, autonomic imbalance, and the prediction of metabolic risk: A model and a proposal for research. Neurosci Biobehav Rev. 2018 Mar 1; 86: 12–20. pmid:29277456
- 86. Cendales-Ayala B, Useche SA, Gómez-Ortiz V, Bocarejo JP. Bus Operators’ Responses to Job Strain: An Experimental Test of the Job Demand–Control Model. J Occup Health Psychol. 2017. pmid:27214600