Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Stress entropic load: New stress measurement method?

  • Filip Zlámal ,

    Contributed equally to this work with: Filip Zlámal, Peter Lenart

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Software, Writing – review & editing

    Affiliations Research Center for Toxic Compounds in the Environment (RECETOX), Faculty of science, Masaryk University, Brno, Czech Republic, Department of Pathological Physiology, Faculty of Medicine, Masaryk University, Brno, Czech Republic

  • Peter Lenart ,

    Contributed equally to this work with: Filip Zlámal, Peter Lenart

    Roles Conceptualization, Writing – original draft

    Affiliations Research Center for Toxic Compounds in the Environment (RECETOX), Faculty of science, Masaryk University, Brno, Czech Republic, Department of Pathological Physiology, Faculty of Medicine, Masaryk University, Brno, Czech Republic

  • Daniela Kuruczová,

    Roles Data curation, Investigation

    Affiliation Department of Pathological Physiology, Faculty of Medicine, Masaryk University, Brno, Czech Republic

  • Tomáš Kalina,

    Roles Investigation, Resources

    Affiliation Department of Athletics, Swimming and Outdoor Sports, Faculty of Sports Studies, Masaryk University, Brno, Czech Republic

  • Gabriel de la Torre,

    Roles Resources, Software, Writing – review & editing

    Affiliation Department of Psychology, University of Cadiz, Campus Rio San Pedro, Puerto Real, Cadiz, Spain

  • Miguel A. Ramallo,

    Roles Resources, Software

    Affiliation Department of Psychology, University of Cadiz, Campus Rio San Pedro, Puerto Real, Cadiz, Spain

  • Julie Bienertová-Vašků

    Roles Conceptualization, Funding acquisition, Project administration, Supervision, Writing – review & editing

    jbienert@med.muni.cz

    Affiliations Research Center for Toxic Compounds in the Environment (RECETOX), Faculty of science, Masaryk University, Brno, Czech Republic, Department of Pathological Physiology, Faculty of Medicine, Masaryk University, Brno, Czech Republic

Abstract

While stress is a widely utilized concept, no direct methods facilitating its measurement are currently available. In our previous work we proposed stress entropic load (SEL) as a potential new marker of stress response in the human body. However, at that time no method for SEL measurement existed. In this pilot study we devised and then tested methodology for SEL measurement. Healthy male participants were monitored by indirect calorimetry and thermography while resting and subsequently while under prolonged mental effort. The acquired data was then used to calculate the temporal development of SEL for each participant. Our results show that SEL production increased significantly in participants subjected to prolonged mental effort. Furthermore, we observed that the calculated development of SEL over time may be used to accurately determine the time point at which participants started performing stressful tasks.

Introduction

Chronic environmental influences undoubtedly play an important role in shaping human health. However, while many explanations have been proposed, no completely satisfactory theory describing the interaction between organisms and the surrounding environment is currently available.

One of the most robust existing explanations focusing on the effect of chronic environmental influences is the stress theory developed by Hans Selye. In 1936 Selye noted that when organisms are severely damaged a typical three-stage syndrome appears regardless of the cause of the damage (surgery, chemical, etc.) [1]. Although this article did define the concept of the general adaptation syndrome, the paper did not mention the concept of “stress”–nor did it provide a useful tool for its measurement. Ten years later, Selye published a full account of his further experimental findings entitled “The general adaptation syndrome and diseases of adaptation” [2] where he defined stress as the “nonspecific response of the body to any demand made on it”. Within this paper Selye’s concept of stress „denotes”the bodily reaction to environmental stimuli. The primary weakness of Selye’s concept of stress is that it ignores interindividual differences in the perception of stressor or the effector pathway of the general adaptation to this stressor. Indeed, dissatisfaction with the vagueness of his definition of what constitutes stress plagued Hans Selye throughout his entire scientific career. On the other hand, this broad generalized view might be considered a major strength of his theory, especially as it corresponds rather well with our current understanding of interactions of an individual with his/her environment. However, any direct whole-body measurement of stress response remains elusive and available methods facilitate only an indirect measurement of stress based on parameters presumably associated with stress response severity such as blood pressure.

The concept of allostatic load provides a rough estimation of stress adaptation costs, in that it reflects the wear and tear experienced by individuals coping with repeated stressors and perturbations in a given system caused by environmental influences [3]. This concept of stress measurement, proposed by McEwen and Wingfield, facilitates the approximation of stress response using indirect parameters associated with HPA axis activation. While substantial limitations exist due to the indirect character of measured values, the methods based on allostatic load or its components measurements represent currently the most robust methodology for measuring biological correlates of stress.

Using entropy as a departure point, we previously proposed a holistic thermodynamic model of health and disease whose universal character incidentally corresponds to Selye’s general theory of stress but which does not contradict currently known concepts of environmental interactions with an individual or a population [4]. The proposed model enables the calculation of stress as well as the quantification of stress over a given period. The calculation of stress in this model is based on the cumulative production of entropy associated with a given stressor or a combination of stressors in a specific individual and/or in a specific regulatory feedback loop in a given interval.

In our previous study [4] we introduced stress entropic load (SEL), a variable designed to facilitate the objective physical measurement of the stress load of a human body. Mathematically, SEL is an explicitly time-dependent function expressed implicitly by different types of heat and temperature changes. Furthermore, in our previous article, we also described an equation calculating approximate SEL for a short measurement interval [4]. In this article we present a novel approach to measure SEL development in humans and we further test this approach on healthy male volunteers subjected to prolonged mental effort.

Methods

Derivation of SEL variables

The variables necessary for calculating SEL are typically time-dependent. However, these variables may also be calculated from other measurable variables based on known formulas. Specifically, heat exchanges can be expressed as follows, with all variables appearing in Eqs 27 listed in Table 1.

  1. Radiation heat exchange rate (1)
  2. Convection heat loss rate (2)
  3. Evaporation heat loss rate (3)
    1. by diffusion (4) with
    2. by sweating (5)
  4. Respiration heat loss rate (6)

All variables used in Eqs 27 are listed in Table 1.

Including the above equations, i.e. 1 to 6, to the previously published formula [4] provides the following derived formula for the calculation of SEL: (7)

This derived SEL relation comprises three kinds of variables:

  1. time-dependent: TA, TB, TC, TS, M, Ṁ(O2), Ṁ(CO2), HR
  2. constants: ε, η, σSB, p0, λ, μ
  3. time-dependent quantities which may be considered constant under certain conditions: Ae, w, TRES, p, , , σprod,no stress

The formula 7 enables us to calculate SEL from measurements of temperatures of a body, ambient air characteristics and breathing air exchange rates. This can be realized using indirect calorimetry methods (for measuring metabolic activity M, oxygen uptake and carbon dioxide liberation rates Ṁ(O2) and Ṁ(CO2)) and thermography (measuring temperatures of a body TB, TC and TS). Characteristics of an ambient air TA and HR can be obtained by a special thermometer as well as atmospheric pressure p is measurable by a barometer.

Experimental validation of SEL as a marker of prolonged mental effort

Subjects.

We recruited 12 healthy male participants aged 20–30 years. The first 10 participants were part of the group exposed to the prolonged mental effort induced by WinSCAT tool (see below). The participants 11–12 were part of a control group which underwent the measurement without doing tasks requiring mental effort. The study was conducted at the Faculty of Sports Studies of Masaryk University in Brno, Czech Republic. Informed consent was obtained from all patients prior to the beginning of the experiment and the study was approved by the Ethics Committee of the Faculty of Sports Studies of Masaryk University. The characteristics of all study participants are summarized in Table 2.

thumbnail
Table 2. Basic anthropometric characteristics of study participants.

https://doi.org/10.1371/journal.pone.0205812.t002

Experiment—WinSCAT software.

In order to induce prolonged mental effort, we used Spaceflight Cognitive Assessment Tool for Windows (WinSCAT). WinSCAT was developed as a tool designed to support medical operations at NASA’s Johnson Space Center, specifically to monitor the neurocognitive status of space crews [57]. The test is composed of several cognitive subtests which measure sustained concentration, working memory, attention, short-term memory, spatial processing, mathematical skills and processing efficiency. The current version of WinSCAT includes four cognitive subtests:

Mathematical Processing (MTH). The participant is required to solve a sequence of mathematical problems calling for addition and subtraction and to press either the right or left mouse button to determine if the correct response is greater or smaller than 5. The problems appear one at a time on screen, and each problem requires either addition or subtraction. Two scores quantify the performance of the participant. The mathematical processing response time which quantifies reaction speed and the mathematical processing accuracy which asses percentual accuracy of answers.

Running Memory Continuous Performance Test (CPT). During this test, single numbers are shown on the screen. Participants need to determine if the number shown is the same than the one immediately before it. Buttons of the mouse need to be pressed each time a number appears on screen except for the first one. Left or right clicks will be used to determine if the current number shown was shown before. Three scores quantify the performance of the participant. Repeating numbers response time which quantifies reaction speed, the repeating numbers accuracy which asses percentual accuracy of answers and the repeating numbers time misses which counts how many times participants didn’t answer.

Delayed Matching to Sample (MSP). In this test, first, a sample stimulus in the form of a large box with colored squares is shown on the screen. After a while, the sample box disappears and two comparison boxes appear side by side. Participants need to decide, which one of these two comparison boxes matches the sample box. Left or right mouse buttons need to be clicked. Two scores quantify the performance of the participant. The pattern memory response time which quantifies reaction speed and the pattern memory accuracy which asses percentual accuracy of answers.

Codes Substitution (CDS). In CDS test, a row of symbols and a row of numbers are shown on the screen. Each number has a symbol which appears in the box above the number. During the test a sample box with a symbol and a number will be displayed below the rows. For each trial, participants are asked to determine whether the sample box was shown with the correct corresponding symbol and to indicate their choice with a left- or right-click of the mouse. The CDS measures sustained attention and concentration, visual search, verbal learning, and recall. Two scores quantify the performance of the participant. The symbol memory response time which quantifies reaction speed and the symbol memory accuracy which asses percentual accuracy of answers.

All tests were designed for analysis using repeated measures. The interface is simplified so that all tests are presented in a for- mat allowing the user to respond by pushing either the left or the right mouse button [6].

Experiment—Preparation.

Two days before the experiment, each participant was emailed a set of basic instructions, namely to: avoid alcohol consumption for at least 24 hours before the start of an experiment, avoid hard physical activity for at least 12 hours before the start of an experiment, get at least 8 hours of sleep and come on an empty stomach.

Participants were invited to arrive by 8.45 a.m. to the faculty examination room. Upon arrival, each participant read and signed the informed consent form. Subsequently, each participant from WinSCAT group was provided with a tablet installed with WinSCAT software; a basic demo version was used to demonstrate the utilized tests and to provide basic insight into the required procedure. Next, basic anthropometric characteristics (e.g. weight and height) were measured. In all experiments, the participants used WinSCAT software on a tablet with the connected computer mouse, to minimize physical effort and discomfort.

Afterward, the main part of an experiment started. Each participant was seated on a medical folding bed in a Semi-Fowler`s position for the entire duration of the measurement. Each participant was asked to remove clothing from the upper part of the body to facilitate the collection of thermograms by means of a thermal camera in order to record changes in body temperature (every 20 seconds). The participant’s legs were covered with thermoinsulating foil to eliminate heat loss from the lower part of the body. A silicon mask was attached to the participant’s face and connected to a spirometry system which continuously recorded breathing air exchange rates and metabolic activity. This setting provided the maximum possible comfort and minimized the physical activity of each participant throughout the experiment. During the entire duration of each experiment, ambient air characteristics were recorded intermittently every 15 minutes as well as the participant’s blood pressure and heart rate. The experiment started once the spirometry system and the thermal camera were turned on, i.e. approximately 30 minutes after the arrival of each participant. All devices utilized throughout the experiment are listed in Table 3.

Average skin temperature TS and average body temperature TC were calculated from thermograms using FLIR Tools software, v. 6.3.17214.1005. The latter was estimated from the temperature of the supraclavicular fossa [8]. The temperature of the entire body was subsequently calculated using the following formula: TB = 0.65TC+0.35TS [9]. The temperature of respirated air TRES was assumed to be constant and equal to 34°C throughout the experiment.

Experiment—Measurement.

The measurement itself consisted of two parts. In the first part, the participant was asked to calm down and breathe freely to attain resting metabolic rate (RMR) defined by i) maximum deviation 10% of oxygen uptake rate, ii) maximum deviation 10% of carbon dioxide liberation rate, iii) maximum deviation 5% of respiratory quotient (RQ), continously during 5 minutes of measurement. In case a participant failed to satisfy all three criteria in the first 40 minutes of the measurement phase, the experiment continued as if RMR had been attained. The time interval containing information about RMR is called the RMR subphase. Data from this phase were then used to calculate the entropy production of a resting body as specified in Eq (7) as σprod, no stress as well as additional characteristics: average Ṁ(O2), average Ṁ(CO2), average M, average temperatures TS, TC, TB.

In the second part of the experiment, which started once RMR was attained or after 40 minutes of measurement, each participant from the WinSCAT group received a tablet with WinSCAT software and began to complete assigned tasks. The time limit for completing one series of tests (i.e., one run of the WinSCAT program) was 15 minutes; each participant was required to complete 12 series of tests. The completion of all tests thus took approximately 3 hours. The process may be divided into two subphases. The first subphase consists of the first 6 test series (i.e. the first 1.5 hours of the task) and serves as a learning part in which a participant acquires better control and insight. In the second subphase, consisting of the second batch of 6 test batteries (i.e. the second 1.5 hours of the task), the participant experiences stress due to the prolonged mental effort. This subphase is considered to be stressful for the purposes of this study. Accordingly, data obtained from this subphase were used to calculate entropy production during stressful experience.

SEL calculation.

The development of SEL over time is calculated by subtracting the two time series. The first time series is extrapolated from data from the RMR subphase. Entropy production during the RMR subphase is extrapolated to the entire duration of the experiment and serves as a baseline entropy production value. The second time series contains data about entropy production from measurement during the entire course of the experiment.

Therefore, expected SEL production during the RMR subphase is zero, i.e..

Calculating the slopes of SEL (i.e. average SEL change per unit of time) during the stressful subphase can lead to three scenarios:

  1. : SEL increases with time; positive response in SEL production; SEL production is positive during the stressful subphase of the experiment; SEL increase is associated with stress induction,
  2. : SEL remains constant; no response in SEL production; SEL production is zero during the stressful subphase of the experiment and SEL is thus not associated with stress induction,
  3. : SEL decreases with time; negative response in SEL production; SEL production is negative during the stressful subphase of the experiment and SEL is thus negatively associated with stress induction.

Data analysis.

For the purpose of the statistical comparison of selected characteristics between RMR and stressful subphases, average characteristics of obtained time series of Ṁ(O2), Ṁ(CO2), M, specific cumulative entropy production rate (cEPR) and SEL rate of the study participants were calculated for RMR and stressful subphases. The descriptive characteristics of the variables are expressed as mean ± standard deviation. Furthermore, we compared values of selected variables between RMR and stressful subphases using a paired t-test. Body temperatures TS, TC and TB were also calculated for the RMR subphase.

The calculation of the SEL time series required special treatment due to different time steps for different variables. The time series were first smoothed by means of kernel smoothing [10]. Then, all time series and other variables were imputed to the formula (7) and integrated by means of numerical integration using the rectangular rule [11]. Slopes in SEL time series were calculated using linear regression.

To test whether using WinSCAT software influenced the SEL development we constructed two mixed effects models. First model contained only time while second model contained time and group as independent variables (in both model SEL was considered as dependent variable, with "subject" as random effect). Consecutively, we tested the significance of the variable “group” by employing the principle of testing submodels via likelihood ratio test.

Data analysis was performed using statistical software R, v. 3.3.3. p-values less than 0.05 were considered statistically significant.

Results

Data for all participants were obtained using the above mentioned procedure. The scores in WinSCAT (S1 Table) were assed for each participant. The variables measured during experimental procedures (S2 Table) were used to calculate the cEPR and SEL rate for RMR and stressful subphase respectively (Table 4). Our calculations show that all study participants exhibited higher cEPR and increased SEL rate during the stressful subphase in comparison with the RMR subphase.

thumbnail
Table 4. Comparison of cEPR and SEL rate between RMR and stressful subphases.

https://doi.org/10.1371/journal.pone.0205812.t004

In the next step, we statistically compared several selected variables between the RMR and the stressful subphase (Table 5). Several of the tested variables were significantly higher in the stressful subphase of the WinSCAT group: Ṁ(O2) (p < 0.001), Ṁ(CO2) (p < 0.001), M (p < 0.001), cEPR (p < 0.001) and SEL (p = 0.002). On the other hand, no significant differences in systolic and diastolic blood pressure or heart rate were established (p = 0.692; p = 0.800; p = 0.481 respectively). Interestingly, in the control group the Ṁ(O2) and Ṁ(CO2) were almost constant with time (S2 Table). Furthermore, we have found no statistically significant association between SEL change and and outputs of WinSCAT test for participants (S3 Table).

thumbnail
Table 5. Statistical comparison of selected variables between RMR and stressful subphases in WinSCAT group.

https://doi.org/10.1371/journal.pone.0205812.t005

SEL has been observed to develop over time; calculated SEL development for one selected participant is shown in Fig 1. The temporal development of SEL has different dynamics for RMR and for the stressful subphases and can therefore be used on its own to determine the begnning of the stressful activity. The temporal development of SEL as an effect of the stressful phase has been observed similarly in all but one participant in the WinSCAT group (Fig 2).

thumbnail
Fig 1. Example of calculated SEL time development of selected participant.

https://doi.org/10.1371/journal.pone.0205812.g001

thumbnail
Fig 2. SEL development over time for all participants.

Red lines represents a SEL development for participants in WinSCAT grop, while the blue lines represent SEL development for control group. Bold red and blue lines represent average SEL development for WinSCAT and control group respectively.

https://doi.org/10.1371/journal.pone.0205812.g002

To compare time development of SEL between WinSCAT and control group we constructed two mixed effects models. First model considered only effect of time while second model contained time and group as independent variables (in both model SEL was considered as dependent variable, with "subject" as random effect). Then we tested the significance for the “group” variable by the principle of testing submodels via likelihood ratio test. The two models were found to be highly significantly different (D = 5040.6, df = 9, p<0.001) meaning the group variable seems to be important explanatory variable for SEL variability.

Discussion

In our previous study we hypothesized that specific entropy production and specifically the calculated SEL rate may function as stress marker. Consecutively, we have devised and tested method for measuring SEL rate. Our results further show that stress caused by prolonged mental effort induced by long and standardized repetitive usage of WinSCAT software under specific time constraints, significantly increases specific entropy production rate and more specifically, SEL rates. Furthermore, the temporal development of SEL over time can be used to accurately determine the time point at which each participant started performing stressful tasks. Our results thus support the notion that SEL can be used as a biology-based marker of prolonged mental effort. Interestingly, the prolonged mental effort caused by WinSCAT tasks does not increase systolic and diastolic blood pressure or heart rate, i.e., long-standing indirect stress markers. On the other hand, the group using the WinSCAT group had significantly higher Ṁ(O2) and Ṁ(CO2) while the control group showed only minimal difference in Ṁ(O2) and Ṁ(CO2) between the same time periods. Because, the respiratory volumes have been reported to increase with mental stress [12] this may be used to argue that the use of WinSCAT was more demanding for the participants. While our results support our hypothesis that SEL can be used as a stress marker they are not conclusive due to the limitations and pilot character of this study.

The primary strength of this study is that it provides a relatively easy method for the calculation of SEL by means of indirect calorimetry and thermography. Furthermore, our study is the first to explore the use of SEL as a marker of stress caused by prolonged mental effort in experimental fashion. However, we are aware that even though the results seem quite promising, our study suffers from several weaknesses. Arguably the most significant weakness of our study is that it employed a relatively small number of participants, all of whom were male. However, this study was intended only as a pilot study designed to test the method of measuring SEL by means of relatively inexpensive and easily accessible indirect calorimetry. The logical next step would thus be a more extensive study utilizing direct calorimetry. Nevertheless, our results constitute the first validation of the concept of SEL as a maker of stress caused by the prolonged mental effort which is an important precondition for any future investment into time-consuming and costly measurements utilizing direct calorimetry. We would also like to note that the absence of female participants in our study is the outcome of the fact that our experimental procedure required all participants to undergo the testing procedure with a naked torso.

While our data show that all participants had higher SEL rate during the stressful phase than during the RMR phase, in case of one participant SEL development over time was negative, as evident from Fig 2. The possible explanation could be this participant (number 10) did not attain RMR by satisfying all three criteria described in methods during first 40 minutes, and thus experiment continued as if RMR was attained, which could have led us to overestimate the basal entropy production for this participant.

Furthemore, while our results suggest a difference in SEL production between the WinSCAT and control group it is notable that in control group the SEL rate still increased with time. However, this may not be a limitation of SEL as a potential objective marker of stress. SEL was designed to measure all kinds of reactions to the environenmental conditions and siting with naked torso for four hours in Semi-Fowler`s possition while on spirometry with no task to keep you occupied for several hours may have consituted significant stress for the participants in our control group. Accordingly, even participants in control group reported that they precieved the experimental procedure as stresfull.

We believe that concept of SEL exhibits several important benefits in comparison with currently used markers of stress (e.g. parameters associated with the HPA axis). Most importantly, it measures stress in the whole organism instead of focusing on the response of selected organs. In addition, while many other stress markers can only be measured at specific time points, the development of SEL over time may be monitored continuously. Moreover, SEL provides an interesting opportunity to monitor stress in organisms without the HPA axis.

While our results suggest that SEL is measurable and serve as marker of stress induced by prolonged mental effort, this notion and feasibility of SEL as a general stress marker requires further testing. We believe that the concept of SEL could be applicable to a diverse set of situations where the monitoring of stress levels may be critical in terms of the prediction and prevention of an upcoming adverse events within the human body. For example, stress is a great challenge for manned spaceflight; according to Kanas & Manzey [13] astronauts encounter various types of stress, and an excessive amount of stress may have adverse effects on the health and well-being of astronauts. Thus, measurement of SEL may be useful for future long-duration human spaceflight including a manned mission to Mars. Others examples in which SEL measurement may be useful may include even military application, but we believe that SEL can be especially helpful and beneficial in medicine, e.g. as a method for the estimation of time to failure of ICU patients.

Supporting information

S2 Table. The variables measured during experimental procedures.

https://doi.org/10.1371/journal.pone.0205812.s002

(XLSX)

S3 Table. Relation between SEL changes and WinSCAT results.

https://doi.org/10.1371/journal.pone.0205812.s003

(XLSX)

References

  1. 1. Selye H. A Syndrome produced by Diverse Nocuous Agents. Nature. 1936;138: 32.
  2. 2. Selye H. THE GENERAL ADAPTATION SYNDROME AND THE DISEASES OF ADAPTATION. J Clin Endocrinol. 1946;6: 117–230.
  3. 3. McEwen BS, Wingfield JC. The concept of allostasis in biology and biomedicine. Horm Behav. 2003;43: 2–15. pmid:12614627
  4. 4. Bienertová-Vašků J, Zlámal F, Nečesánek I, Konečný D, Vasku A. Calculating Stress: From Entropy to a Thermodynamic Concept of Health and Disease. Criscuolo F, editor. PLOS ONE. 2016;11: e0146667. pmid:26771542
  5. 5. Kane RL, Short P, Sipes W, Flynn CF. Development and Validation of the Spaceflight Cognitive Assessment Tool for Windows (WinSCAT). Aviat Space Environ Med. 2005;76: B183–B191. pmid:15943211
  6. 6. De la Torre GG, Mestre Navas JM, Guil Bozal R. Neurocognitive performance using the Windows spaceflight cognitive assessment tool (WinSCAT) in human spaceflight simulations. Aerosp Sci Technol. 2014;35: 87–92.
  7. 7. Seaton KA, Slack KJ, Sipes WA, Bowie KE. Cognitive functioning in long-duration head-down bed rest. Aviat Space Environ Med. 2009;80: A62–65. pmid:19476171
  8. 8. Boon MR, Bakker LEH, van der Linden RAD, Pereira Arias-Bouda L, Smit F, Verberne HJ, et al. Supraclavicular Skin Temperature as a Measure of 18F-FDG Uptake by BAT in Human Subjects. PLoS ONE. 2014;9. pmid:24922545
  9. 9. Rahman AM. A novel method for estimating the entropy generation rate in a human body. Therm Sci. 2007;11: 75–92.
  10. 10. Ghosh S. Kernel Smoothing: Principles, Methods and Applications. 2018.
  11. 11. Davis PJ, Rabinowitz P, Mathematics. Methods of Numerical Integration: Second Edition. Second Edition edition. Mineola, N.Y: Dover Publications; 2007.
  12. 12. Masaoka Y, Homma I. Anxiety and respiratory patterns: their relationship during mental stress and physical load. Int J Psychophysiol. 1997;27: 153–159. pmid:9342646
  13. 13. Kanas N, Manzey D. Space Psychology and Psychiatry [Internet]. 2nd ed. Springer Netherlands; 2008. www.springer.com/gp/book/9781402067693