Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The measurement of mental fatigue following an overnight on-call duty among doctors using electroencephalogram

  • Anselm Ting Su ,

    Contributed equally to this work with: Anselm Ting Su, Gregory Xavier, Jew Win Kuan

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing

    stanselm@unimas.my

    Affiliation Department of Community Medicine and Public Health, Universiti Malaysia Sarawak, Kota Samarahan, Malaysia

  • Gregory Xavier ,

    Contributed equally to this work with: Anselm Ting Su, Gregory Xavier, Jew Win Kuan

    Roles Data curation, Formal analysis, Investigation, Methodology

    Affiliation Kinta District Health Office, Ministry of Health Malaysia, Malaysia

  • Jew Win Kuan

    Contributed equally to this work with: Anselm Ting Su, Gregory Xavier, Jew Win Kuan

    Roles Investigation, Methodology, Supervision, Writing – review & editing

    Affiliation Department of Medicine, Universiti Malaysia Sarawak, Kota Samarahan, Malaysia

Abstract

This study aimed to measure the spectral power differences in the brain rhythms among a group of hospital doctors before and after an overnight on-call duty. Thirty-two healthy doctors who performed regular on-call duty in a tertiary hospital in Sarawak, Malaysia were voluntarily recruited into this study. All participants were interviewed to collect relevant background information, followed by a self-administered questionnaire using Chalder Fatigue Scale and electroencephalogram test before and after an overnight on-call duty. The average overnight sleep duration during the on-call period was 2.2 hours (p<0.001, significantly shorter than usual sleep duration) among the participants. The mean (SD) Chalder Fatigue Scale score of the participants were 10.8 (5.3) before on-call and 18.4 (6.6) after on-call (p-value < 0.001). The theta rhythm showed significant increase in spectral power globally after an overnight on-call duty, especially when measured at eye closure. In contrast, the alpha and beta rhythms showed reduction in spectral power, significantly at temporal region, at eye closure, following an overnight on-call duty. These effects are more statistically significant when we derived the respective relative theta, alpha, and beta values. The finding of this study could be useful for development of electroencephalogram screening tool to detect mental fatigue.

Introduction

Although sleep deprivation and mental fatigue are two distinguishable conditions [1], they often occurred together in real life, especially among occupations requiring overnight on-call, extended shift, and shift work. Sleep deprivation is a continuous and prolonged period of lack of sleep whereas mental fatigue implies reduced psychophysiological efforts due to prolonged and demanding mental activities [1]. Despite the scientific distinction, both conditions contribute to performance impairments and are often considered interchangeable.

Overnight on-call doctors typically experiencing mental fatigue in addition to sleep deprivation due to the nature of the demanding and busy hospital workload. Overnight on-call causes disturbed sleep [2], and is associated with higher medication errors among doctors [3, 4], procedural errors [5], stress reactivity [6], and impairment of attentional networks [7]. Nevertheless, not all post-call doctors are sleepy, mentally fatigue and is at risk of inflicting errors in carrying out their tasks. Hence, from the perspective of occupational health and safety, as well as patient’s safety, it is of utmost importance to find a method to detect mental fatigue following sleep deprivation due to overnight on-call duty among doctors, to prevent them from carrying out emergency and surgical procedures which might impose danger to themselves and others.

Electroencephalography (EEG) has been widely used in the evaluation of sleep [812], alertness [1316], and mental fatigue [1720], especially in the field of transportation medicine [17, 2024]. There has never been a study to evaluate EEG changes following an overnight on-call duty among the doctors. In this study, we compared the EEG characteristics among the doctors before and after an overnight on-call duty, to identify differences that could be useful for future brain-computer interface system development to detect resting state drowsiness or mental fatigue following overnight on-call duty for healthcare personnel. The objective of this study is to determine the significant differences in the power spectral of EEG rhythms at different brain regions before and after an overnight on-call duty among a group of doctors who actively perform on-call work on regular basis. The findings of this study could contribute to address the gap in the literature by evaluating EEG changes following overnight on-call duty among doctors and develop a brain-computer interface system to detect mental fatigue and drowsiness in healthcare personnel.

Materials and methods

This was a repeated cross-sectional study on a group of doctors who performed overnight on-call duty in a tertiary government hospital in Sarawak, Malaysia. The inclusion criteria were all doctors who are on a regular on-call work schedule with a working period of more than 12 hours during the overnight calls. We excluded the participants with any history of organic neurophysiological or developmental disorders, neurophysiological injuries, psychiatric illness, taking regular medication, pregnancy at the time of recruitment and illnesses that may affect the neurophysiological function of the brain. All doctors fitting the inclusion and exclusion criteria were invited to participate in the study and the acceptance was voluntary. The participants were free to decide on an on-call day which they would like to carry out this study, but they must ensure that they were present for two sessions, before, and after their on-call work schedule. Prior to the start of the study, all participants would be interviewed to collect the information on their age, gender, education level, duration of work, usual overnight sleep duration, medical history, and alcohol, tea, and smoking consumption. This was followed by the first EEG recording prior to the on-call duty. The participants were then released to perform usual on-call duty and were asked to return on the following day for the second EEG recording. The participants were asked to answer a the Chalder Fatigue Scale [25] questionnaire before and after on-call, prior to the EEG test. The duration of sleep during the overnight on-call duty was determined by self-reporting.

The Chalder Fatigue Scale questionnaire consists of 11 items assessing symptoms of fatigue, such as lack of strength in the muscles, tiredness, lack of energy, sleepiness, memory, and difficulties in concentration, requiring a participant to rate each item on its frequency of occurrence: less than usual, no more than usual, more than usual, and much more than usual. With the use of the Likert scoring system, a score ranging from 0 to 3 is given. The total score of the scale is calculated by adding the rating for each item, which ranges from 0 to 33. With the use of the Likert scale, a score of less than 15 is considered to have ‘no fatigue’ and 15 and above means ‘fatigue’ is present. A study by Wessely et al. to distinguish between mild and severe fatigue among chronic fatigue patients in primary care setting used the similar cut-off point [26]. The internal consistency, calculated by the Cronbach’s alpha, for the 11 items of the scale ranged between 0.88 and 0.90 [25].

The EEG recording was performed by a trained and experienced EEG technician who usually performed EEG on patients in the hospital, using Nicolet® Monitor by Natus. The EEG electrodes were arranged according to the International 10–20 systems using the Mitsar® Cap-EEG cap placement on the participants’ head and recording in 19-channel (Fp1, Fp2, F7, F3, Fz, F4, F8, T3, T4, T5, T6, C3, Cz, C4, P3, Pz, P4, O1 and O2). The EEG signals data were recorded in .EDF file format and converted into .EEG file format using Mitsar® EEG Studio Processing Software for spectral analysis using WinEEG software version 2.90.

The sampling rate was set at 1 kHz, high pass filter at 0.3 Hz, low pass filter at 50 Hz, notch filter at 45–55 Hz, and the recording was carried out in average reference montage. The band pass filter was set at a range of 0.3 Hz to 49 Hz to remove the low and high frequency noises and other artifacts such as electrical power line interference, eye movement, and muscles activities, from the raw EEG data. As all subjects were working doctors without medical history, we do not expect any potential seizures, and since gamma waves are not the focus of the study in sleepiness and fatigue, setting low pass filter at 50 Hz is acceptable. The notch filter in WinEEG software is set as a range and since the electrical frequency of Malaysia is 50 Hz, the notch filter is set as 45–55 Hz. The average montage was preferred during analysis to identify the brain waves that stand out in background significantly for the changes in spectral power before and after on-call sessions.

During the recording, the participants were seated in front of a laptop placed on a writing table with a black dot on its screen. The first EEG recording was done in the morning before 10 am on the day of the on-call duty, and the second was done in the afternoon after 3.30 pm on the post-call day. Ideally the EEG should be performed before the start and after the end of the on-call period, namely 8 am and 5 pm respectively. However, due to logistic reasons, where the doctors were required to conduct rounds and wrap up before the start and end of the o-call period, we conducted EEG later than 8 am but set to complete it before 10 am for the before on-call data collection, and between 3.30 pm to 5 pm for after on-call data collection. The EEG recording was carried out continuously for 14 minutes, starting with 3.5 minutes of open eye, followed by 3.5 minute of close eye, then 3.5 minute of re-open eye, and finally 3.5 minute of completing the Stroop Test. The research assistant timed the recording and instructed verbally the participant to close eye, open eye and perform Stroop Test at the stipulated time.

The EEG signal was computed using a short time Fourier transformation every second with 50% overlap by the Welch periodograms method. The output power spectral density was measured in microvolt square (μV2) corresponding to the respective brain wave defined by its typical frequency range, as per default setting in the WinEEG software, namely theta (4 to 7.5 Hz), alpha (7.5 to 15 Hz) and beta (above 14 Hz). We also calculated three additional derived relative theta, alpha and beta values, by obtaining the ratio of the respective power spectral density value of the corresponding brain waves over the total EEG spectral power. We compared the power spectral density and the derived relative values across different brain regions namely frontal (Fp1, Fp2, F7, F3, Fz, F4, F8), centro-parietal (C3, Cz, C4, P3, Pz, P4), temporal (T3, T4, T5, T6), occipital (O1, O2) and globally, before and after the overnight on-call duty. The differences in the values before and after the overnight on-call duty were tested by paired t-test using SPSS version 20.

We carried out the Stroop Test during the last section of EEG monitoring to detect any deterioration in the participants’ attention capacity and processing speed following a night of on-call duty. The test required the participants to press the key of the first letter of the displayed word’s colour. For an example, if the word ‘BLUE’ is displayed in red colour, the participant will have to press the ‘B’ key on the keyboard. There were six colours (red, yellow, blue, green, purple, and orange) with their corresponding word used in this test. The colours and corresponding words were presented either congruent or incongruently in a random manner for each trial. After each trial, the participant will have to hit the space bar to proceed to the next trial. A total of 21 trials were conducted, and the speed (in milliseconds) to answer each trial and the percentage correct were recorded.

The study was registered with the Malaysian National Medical Research Registry (NMRR) (ID: NMRR-18-3104-44693) and obtained ethical approval from the Malaysian Research Ethics Committee (MREC) (KMM/NIHSEC/P19-90(12)) and Universiti Malaysia Sarawak Medical Research Ethics Committee (UNIMAS/NC-21.02t03-02 Jld.3 (74)). Written informed consent were obtained from all participants before the commencement of the study.

Results

A total of 32 volunteer doctors consented to participate in this study. The volunteered participants consisted of 24 male and 8 female doctors, with then mean (SD; min; max) age of 30 (2; 27; 35) years. All participants declared no history of chronic medical illness, and alcohol consumption or smoking 24 hours prior to the study. There were 24 participants declared drinking some amount of tea or coffee during the on-call period. All participants had basic medical degree, and two of them had additional postgraduate degree. The mean (SD; min; max) duration of working was 5 (2; 2; 11) years, and the body mass index was 25.8 (5.2; 17.2; 37.2) kg/m2.

Prior to the on-call duty, the participants declared mean (SD; min; max) usual overnight sleep duration of 6.7 (1.3; 5.0; 10) hours. The mean (SD; min; max) sleep duration of all participants during the on-call period was 2.2 (1.2; 0.5; 5.0) hours (p<0.001, paired t-test), significantly shorter than their usual overnight sleep duration. The mean (SD) Chalder Fatigue Scale score of the participants were 10.8 (5.3) before on-call and 18.4 (6.6) after on-call (p-value < 0.001). The mean scores for individual items in the scale were all less than 1.3 before the on-call but more than 1.6 after the on-call. This indicates all participants responded either tired, fatigued, or sleepy after the overnight on-call. Table 1 shows the distribution of participants according to Chalder Fatigue Scale cut-off score at 15. Seventy eight percent of the after on-call doctors scored ‘fatigue’ and 84% of before on-call doctors scored ‘no fatigue’ using Chalder Fatigue Scale. The difference was statistically significant using McNemar’s test, indicating the doctors after on-call were indeed in the ‘fatigue’ status. With this verification, it is meaningful to compare the power spectral differences in the EEG rhythms before and after on-call among the doctors.

thumbnail
Table 1. Distribution of participants based on Chalder Fatigue Scale cut-off of 15 before and after an overnight on-call.

https://doi.org/10.1371/journal.pone.0287999.t001

The average power spectrum comparison of brain waves at different brain regions for all participants before and after the on-call duty is shown in Table 2. The alpha rhythm attenuation during eye open was consistent across all brain regions and the theta rhythm was maximal at the frontal regions in both sessions (before and after on-call). These are consistent with normal adult EEG patterns. The theta rhythm showed significant increase in power globally after an overnight on-call duty, especially when measured in eye closure phase. In contrast, the alpha and beta rhythms showed reduction in power globally, significantly at temporal region following an overnight on-call duty, when measured in eye closure phase. These effects are more statistically significant when we calculated the respective relative values, namely relative theta, relative alpha, and relative beta as shown in the Table 2.

thumbnail
Table 2. Power spectrum comparison of electroencephalogram before and after on-call duty for all participants.

https://doi.org/10.1371/journal.pone.0287999.t002

The Stroop test alone showed despite answering more trials, there were longer response time and lower correct percentage for both congruent and incongruent trials among the participants after on-call as compared to before on-call, although the differences were not statistically significant (Table 3). This is consistent with the reduced cognitive capability after an overnight on-call duty. Nevertheless, the EEG power spectrum during Stroop test did not show significant differences before and after on-call duty.

thumbnail
Table 3. The Stroop test result during EEG recording before and after an overnight on-call.

https://doi.org/10.1371/journal.pone.0287999.t003

Discussion

A normal adult exhibit small amplitude beta rhythm during awake, posterior dominant alpha rhythm during relaxation, and appearance of theta rhythm from drowsiness to sleep [27]. In our study, we found significant increase in the spectral power of theta rhythm after an overnight on-call sleep deprivation, especially when we measured the EEG signal during eye closure. Conversely, both alpha and beta rhythms showed reduction in spectral power at post-call compared to pre-call session. These observations were more apparent when we calculated the respective relative values against the total EEG spectral power. The findings were consistent with the cognitive assessment responses—indicating the participants were experiencing mental fatigue following an overnight on-call duty with average sleeping duration of two hours—and the result of Stroop test.

The findings of this study are in consistence with studies conducted among long distance drivers that showed an increase in theta activity associated with driver’s fatigue which is likely to reflect the decrease in cortical arousal [17, 2830]. Studies investigating driver’s fatigue utilised continuous monitoring of EEG over a period of time, which is impractical if it is going to be implemented among the doctors during on-call duty. For on-call doctors, it is of utmost important to detect mental fatigue or sleepiness following an overnight on-call, to prevent them from performing further duty which may endanger themselves or patients due to the nature of the duty.

Cognitive assessment questionnaires and tests could be used as single time point screening tools for mental fatigue detection [29, 3133]. However, these tools are subjective, time consuming and subject to respondent and measurement biases. On the other hand, EEG is more objective when it is carried out in a standard protocol. Based on the results of this study, it is possible to detect increase and decrease in the spectral power of the theta rhythm and alpha and beta rhythms respectively, at two time points, before and after the on-call duty. Hence, the finding of this study is useful for possible development a simplified EEG screening tool with algorithms to detect mental fatigue or sleepiness for workers performing high risk job.

Despite the presence of spectral power differences between the before and after on-call recordings, there was lack of statistical significance when the results were stratified according to brain regions. This could be due to small number of samples. Besides, the study was not carried out under a controlled induced mental fatigue environment. There was a dilution in the after on-call data as not all participants were deprived of sleep in this study. The inconsistency in the nature of the on-call duty among the participants and undergoing of regular on-calls among the participants prior to the conduct of the study could have further confounded the results of this study. Despite these limitations, the current study revealed the differences in the EEG signals among the doctors before and after an overnight on-call duty in a real-life situation.

In the current study, we used Chalder Fatigue Scale to elucidate self-perceived fatigue among the study subjects. The result presented in Table 1 supports the presence of self-perceived fatigue among the doctors after on-call. We did not use other questionnaires due to time constraints. From the physiological point of view, it is intuitive—from the fact that the mean sleeping duration for on-call doctors in our study was only 2.2 hours—that the study subjects should be in the state of sleep deprived condition after on-call.

We acknowledge the limitation of small sample size in this study, as it was extremely difficult to get full cooperation of on-call doctors to undergo the EEG test before and after their hectic on-call period. The proposed model of EEG response to sleep deprivation with possible fatigue may not be confidently generalisable to a bigger population but the fact that the differences in theta waves globally and at centro-parietal regions were statistically significant despite small differences and sample size warrants attention. We recommend similar studies to be conducted in the future so that systematic reviews and meta-analyses could be carried out to consolidate the evidence.

Conclusion

Following an overnight on-call duty, the spectral power of the theta rhythm increases globally, and the alpha and beta rhythm decrease mainly at temporal region, most prominent during eye closure measurement. These changes were observed after a period of sleep deprived on-call duty with average of only 2.2 hours of sleep and were consistent with the average Chalder Fatigue Scale score of 18.4.

References

  1. 1. Ackerman PL, American Psychological Association. Cognitive fatigue: multidisciplinary perspectives on current research and future applications. 1st ed. Washington, DC: American Psychological Association; 2011. xviii, 333 p. p.
  2. 2. Torsvall L, Akerstedt T. Disturbed sleep while being on-call: an EEG study of ships’ engineers. Sleep. 1988;11(1):35–8. pmid:3363267
  3. 3. Hendey GW, Barth BE, Soliz T. Overnight and postcall errors in medication orders. Acad Emerg Med. 2005;12(7):629–34. pmid:15995095
  4. 4. Landrigan CP, Rothschild JM, Cronin JW, Kaushal R, Burdick E, Katz JT, et al. Effect of reducing interns’ work hours on serious medical errors in intensive care units. N Engl J Med. 2004;351(18):1838–48. pmid:15509817
  5. 5. Stepan ME, Fenn KM, Altmann EM. Effects of sleep deprivation on procedural errors. J Exp Psychol Gen. 2019;148(10):1828–33. pmid:30265024
  6. 6. Minkel J, Moreta M, Muto J, Htaik O, Jones C, Basner M, et al. Sleep deprivation potentiates HPA axis stress reactivity in healthy adults. Health Psychol. 2014;33(11):1430–4. pmid:24818608
  7. 7. Jugovac D, Cavallero C. Twenty-four hours of total sleep deprivation selectively impairs attentional networks. Exp Psychol. 2012;59(3):115–23. pmid:22044791
  8. 8. Ke M, Li J, Wang L. Alteration in Resting-State EEG Microstates Following 24 Hours of Total Sleep Deprivation in Healthy Young Male Subjects. Front Hum Neurosci. 2021;15:636252. pmid:33912019
  9. 9. Gibbings A, Ray LB, Berberian N, Nguyen T, Shahidi Zandi A, Owen AM, et al. EEG and behavioural correlates of mild sleep deprivation and vigilance. Clin Neurophysiol. 2021;132(1):45–55. pmid:33248433
  10. 10. Prabhakar SK, Rajaguru H, Ryu S, Jeong IC, Won DO. A Holistic Strategy for Classification of Sleep Stages with EEG. Sensors (Basel). 2022;22(9). pmid:35591246
  11. 11. Wang YJ, Duan W, Lei X. Impaired Coupling of the Brain’s Default Network During Sleep Deprivation: A Resting-State EEG Study. Nat Sci Sleep. 2020;12:937–47. pmid:33204197
  12. 12. Lechat B, Hirotsu C, Appleton S, Younes M, Adams RJ, Vakulin A, et al. A novel EEG marker predicts perceived sleepiness and poor sleep quality. Sleep. 2022;45(5). pmid:35554584
  13. 13. Subasi A. Application of classical and model-based spectral methods to describe the state of alertness in EEG. J Med Syst. 2005;29(5):473–86. pmid:16180483
  14. 14. Vuckovic A, Radivojevic V, Chen AC, Popovic D. Automatic recognition of alertness and drowsiness from EEG by an artificial neural network. Med Eng Phys. 2002;24(5):349–60. pmid:12052362
  15. 15. Walter N, Hinterberger T. Determining states of consciousness in the electroencephalogram based on spectral, complexity, and criticality features. Neurosci Conscious. 2022;2022(1):niac008. pmid:35903410
  16. 16. Jung TP, Makeig S, Stensmo M, Sejnowski TJ. Estimating alertness from the EEG power spectrum. IEEE Trans Biomed Eng. 1997;44(1):60–9. pmid:9214784
  17. 17. Borghini G, Vecchiato G, Toppi J, Astolfi L, Maglione A, Isabella R, et al. Assessment of mental fatigue during car driving by using high resolution EEG activity and neurophysiologic indices. Annu Int Conf IEEE Eng Med Biol Soc. 2012;2012:6442–5. pmid:23367404
  18. 18. Rifai C, Tran Y, Naik GR, Nguyen TN, Sai Ho L, Craig A, et al. Classification of EEG based-mental fatigue using principal component analysis and Bayesian neural network. Annu Int Conf IEEE Eng Med Biol Soc. 2016;2016:4654–7. pmid:28269312
  19. 19. Li G, Huang S, Xu W, Jiao W, Jiang Y, Gao Z, et al. The impact of mental fatigue on brain activity: a comparative study both in resting state and task state using EEG. BMC Neurosci. 2020;21(1):20. pmid:32398004
  20. 20. Dimitrakopoulos GN, Kakkos I, Thakor NV, Bezerianos A, Yu S. A mental fatigue index based on regression using mulitband EEG features with application in simulated driving. Annu Int Conf IEEE Eng Med Biol Soc. 2017;2017:3220–3.
  21. 21. Peng Y, Xu Q, Lin S, Wang X, Xiang G, Huang S, et al. The Application of Electroencephalogram in Driving Safety: Current Status and Future Prospects. Front Psychol. 2022;13:919695. pmid:35936295
  22. 22. Perrier J, Jongen S, Vuurman E, Bocca ML, Ramaekers JG, Vermeeren A. Driving performance and EEG fluctuations during on-the-road driving following sleep deprivation. Biol Psychol. 2016;121(Pt A):1–11. pmid:27697552
  23. 23. Gibbings A, Ray LB, Gagnon S, Collin CA, Robillard R, Fogel SM. The EEG correlates and dangerous behavioral consequences of drowsy driving after a single night of mild sleep deprivation. Physiol Behav. 2022;252:113822. pmid:35469778
  24. 24. Ahn S, Nguyen T, Jang H, Kim JG, Jun SC. Exploring Neuro-Physiological Correlates of Drivers’ Mental Fatigue Caused by Sleep Deprivation Using Simultaneous EEG, ECG, and fNIRS Data. Front Hum Neurosci. 2016;10:219. pmid:27242483
  25. 25. Chalder T, Berelowitz G, Pawlikowska T, Watts L, Wessely S, Wright D, et al. Development of a fatigue scale. J Psychosom Res. 1993;37(2):147–53. pmid:8463991
  26. 26. Wessely S, Chalder T, Hirsch S, Wallace P, Wright D. The prevalence and morbidity of chronic fatigue and chronic fatigue syndrome: a prospective primary care study. Am J Public Health. 1997;87(9):1449–55. pmid:9314795
  27. 27. Eoh HJ, Chung MK, Kim S-H. Electroencephalographic study of drowsiness in simulated driving with sleep deprivation. International Journal of Industrial Ergonomics. 2005;35(4):307–20.
  28. 28. Lal SK, Craig A. A critical review of the psychophysiology of driver fatigue. Biol Psychol. 2001;55(3):173–94. pmid:11240213
  29. 29. Lal SK, Craig A. Driver fatigue: electroencephalography and psychological assessment. Psychophysiology. 2002;39(3):313–21. pmid:12212650
  30. 30. Borghini G, Astolfi L, Vecchiato G, Mattia D, Babiloni F. Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neurosci Biobehav Rev. 2014;44:58–75. pmid:23116991
  31. 31. Zwahlen D, Jackowski C, Pfäffli M. Sleepiness, driving, and motor vehicle accidents: A questionnaire-based survey. J Forensic Leg Med. 2016;44:183–7. pmid:27821309
  32. 32. Westwell A, Cocco P, Van Tongeren M, Murphy E. Sleepiness and safety at work among night shift NHS nurses. Occup Med (Lond). 2021;71(9):439–45. pmid:34693974
  33. 33. Van Cutsem J, Marcora S, De Pauw K, Bailey S, Meeusen R, Roelands B. The Effects of Mental Fatigue on Physical Performance: A Systematic Review. Sports Med. 2017;47(8):1569–88. pmid:28044281