Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Social media does not elicit a physiological stress response as measured by heart rate and salivary cortisol over 20-minute sessions of cell phone use

  • Suzanne Oppenheimer ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    suzanneoppenheimer@cwi.edu

    Affiliation Department of Biological Sciences, College of Western Idaho, Boise, Idaho, United States of America

  • Laura Bond,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Methodology, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Biomolecular Research Center, Boise State University, Boise, Idaho, United States of America

  • Charity Smith

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Visualization, Writing – original draft, Writing – review & editing

    Current address: TRIO Academic Coaching & Education Support, Boise State University, Boise, Idaho, United States of America

    Affiliation Department of Biological Sciences, College of Western Idaho, Boise, Idaho, United States of America

Abstract

The pervasive use of social media has raised concerns about its potential detrimental effects on physical and mental health. Others have demonstrated a relationship between social media use and anxiety, depression, and psychosocial stress. In light of these studies, we examined physiological indicators of stress (heart rate to measure autonomic nervous system activation and cortisol to assess activity of the hypothalamic-pituitary-adrenal axis) associated with social media use and investigated possible moderating influences of sex, age, and psychological parameters. We collected physiological data from 59 subjects ranging in age from 13 to 55 across two cell phone treatments: social media use and a pre-selected YouTube playlist. Heart rate was measured using arm-band heart rate monitors before and during cell phone treatments, and saliva was collected for later cortisol analysis (by enzyme immunoassay) before and after each of the two cell phone treatments. To disentangle the effects of cell phone treatment from order of treatment, we used a crossover design in which participants were randomized to treatment order. Our study uncovered a significant period effect suggesting that both heart rate and cortisol decreased over the duration of our experiment, irrespective of the type of cell phone activity or the order of treatments. There was no indication that age, sex, habits of social media use, or psychometric parameters moderated the physiological response to cell phone activities. Our data suggest that 20-minute bouts of social media use or YouTube viewing do not elicit a physiological stress response.

Introduction

With widespread use of individually-accessible screens (e.g., smart phones, tablets, and computers), many people have expressed concern over excessive use; for example, the American Academy of Pediatrics [1], Britain’s Chief Medical Officer [2], and eminent psychologist Jean Twenge [3] have issued warnings against overuse of smartphones by children. Problematic smart-phone use is most common in adolescents [4], but there is also evidence that excessive smart-phone use has negative repercussions across all age groups [5]. While screens are the instrument, social media is one of the elements often implicated in the dangers associated with screen time. Unlike in-person social interactions, which are often associated with higher psychological well-being [6,7], excessive social media interactions have been linked to poor psychological well-being [810].

Some studies have suggested that social media use may influence psychosocial stress [1113], and social media use has frequently been linked to conditions such as anxiety and depression [1416]. Fear of missing out, the worry that one may miss out on important interpersonal interactions or events [17], seems to both drive excessive use of social media and contribute to depression and anxiety associated with its use [18,19]. In some cases, social media elicits low self-esteem, poor body image, and envy [20,21]; such feelings are thought to be evoked when social media users evaluate their social and personal worth by comparing themselves to others who have curated and/or enhanced an idealistic online image [22]. Poor sleep quality, which has been linked to computer, internet, and social media use [16], is also thought to contribute to depression, anxiety, and low self-esteem [23,24]. Taken together, the body of literature suggests that multiple factors related to social media contribute to its association with psychosocial stress. However, it is unclear whether social media use leads to stress or if stress leads to social media use. This study attempts to fill this gap in the literature by addressing whether short bouts of social media use evoke stress.

Psychological stress is known to stimulate a physiological stress response, mediated by the endocrine and autonomic nervous systems [2527]. Stress activates the hypothalamic-pituitary-adrenal (HPA) axis and the sympathetic division of the autonomic nervous system, and salivary cortisol and heart rate are commonly measured biomarkers of this activity [28,29]. While the stress response helps maintain physiologic balance in the face of sudden physiological or psychological perturbations [30], chronic activation of this response can result in an increased allostatic load and disease [31]; for example, stress has been linked to depression, cardiovascular disease, and type 2 diabetes [3234, respectively]. If the use of social media causes psychosocial stress and subsequent activation of the physiological stress response, then protracted use could have deleterious consequences for both psychological and physical health. Several studies have examined the relationship between physiological variables (e.g., cardiovascular measures and cortisol) and social media use, but the findings are not consistent (Table 1). This points to a more nuanced relationship between social media use and physiological and psychological stress; we feel that there is a need for further research in this area to help tease apart this relationship.

thumbnail
Table 1. Summary of key findings in studies examining the relationship between physiological variables and social media.

https://doi.org/10.1371/journal.pone.0298553.t001

Unlike these studies (Table 1) that examine correlations or social media’s influence on an acute social stressor (i.e. TSST), the focus of our controlled study is to evaluate the physiological response to a short-term bout of social media use and indirectly take into account the potential moderating effects of age, sex, and psychosocial factors. We hypothesized that social media use would impart some degree of psychosocial stress that would activate the physiological stress response more so than our control treatment (non-evocative You-tube playlist). To assess the physiological response, we measured salivary cortisol to quantify activity of the HPA axis and heart rate to assess activation of the sympathetic nervous system. We examine the physiological effects of short bouts of social media because this is often how it is accessed (e.g., as we wait for a friend or take a break from another task). If this type of usage results in a stress response, then this could be one potential mechanism by which social media poses a health risk.

Material and methods

Ethics statement

The study protocol was approved by the Institutional Review Board of The College of Idaho (1819-CWI00039.3). Adult subjects signed written informed consent forms, and those under the age of 18 years old obtained written consent from a parent, guardian, or legally authorized representative. Participants self-reported their biological sex and age on surveys.

Participants & overall procedures

Participants were recruited in July 2019 using fliers, internet announcements, and direct oral solicitation, primarily directed toward faculty, students, and staff at the College of Western Idaho. The study was broadly open to adults, but individuals under 18 years were encouraged to join with parental consent. Because cortisol levels are elevated during pregnancy [39], pregnant women were excluded from the study. Those with Cushing’s syndrome were also excluded because of pathologically elevated cortisol levels [40]. Subjects included in cortisol analyses had not consumed alcohol within 12 hours and had not eaten a meal within 60 minutes (identified through questionnaires). Because our cortisol assay exhibited low cross-reactivity (≤0.015%) with steroids commonly used in hormonal contraceptives [41], women on birth control were not excluded from our analyses (12.5% of females reported the use of hormonal contraceptives).

Participants included 40 women and 19 men, ranging in age from 13 to 55 with a mean of 25.8 years and a standard deviation of 11.5 years. Twelve participants were under 18 (5 women and 7 men). The study was conducted over three days, with 15 participants on the first day, 21 on the second day, and 23 on the third day. On each of the three days, all participated simultaneously and were randomly assigned to each experimental group order. Heart rate data were not available for six participants. The cortisol data from three participants were not used in the analysis because they ate within the hour prior to the study. Cortisol values from two individuals at a single time point were unavailable for analysis due to processing issues. Otherwise, all individuals completed the entire study, including completing all questionnaires.

Participants were asked to attend a single experimental session on one of three testing days at 12:30PM and to refrain from eating at least one hour prior to testing. The standardization of time across sessions was important to avoid the influence of the cortisol circadian rhythm [42] and participants were asked to refrain from eating and drinking because some foods and alcohol can compromise performance of the assay used [41]. Participants were assigned a random number, and all collected data were linked to the participants’ numbers and not their names or other identifiers. Subjects signed informed consent forms and were randomized into one of two groups.

We employed a two-period crossover design [43,44] to evaluate the physiological responses to social media (experimental treatment) and a non-evocative YouTube playlist (control treatment). With this approach, all participants experienced both treatments but the order in which they experienced them was randomized (Social Media first or YouTube playlist first). The two orders allow clarification of a treatment effect (Social Media vs. YouTube), in addition to an order effect (Social Media first vs YouTube playlist first) and a period effect (first 20-minute period vs. the second 20-minute period, regardless of treatment). Crossover designs are commonly used in medicine [45,46], but have also been used in wildlife [47] and metagenomics [48] studies. They are effective for comparing treatments within the same subject because they differentiate the treatment effect from the period, order, and possibly carryover effects (e.g., the possibility that responses in the second 20-minute period are influenced by responses in the first 20-minute period).

On the day of testing, participants entered the testing room and were fitted with arm-band heart rate monitors by our research team. Heart rate monitors continuously collected data until the conclusion of our protocol. During the pre-test ‘Baseline’ Period, participants sat quietly (without interacting with their cell phones or each other) for 5–15 minutes (depending on order of entry) and waited for instructions (Fig 1). Subjects were briefed on the study protocol and baseline saliva samples were collected. On each of the three testing days, participants were sampled simultaneously; heart rate recordings and cortisol samples were collected at the same time, and cell phone treatments (while on individuals’ cell phones) were administered simultaneously to the entire group. Among the three testing days, sampling times varied by up to eight minutes.

thumbnail
Fig 1. Schematic of study design.

Study periods are Baseline (the five minutes prior to the first cell phone activity), T1 and T2 identify the two 20-minute periods during which cell phones were used for Social Media or YouTube, Interim identifies the five-minute period between the two 20-minute periods, and Final reflects the period of the final saliva collection and when participants filled out the survey. The saliva samples collected in the Interim and Final periods reflect the response from the first and second 20-minute periods, respectively.

https://doi.org/10.1371/journal.pone.0298553.g001

During the first 20-minute period, “T1,” participants were asked to use their personal cell phones to view either a non-evocative YouTube playlist (YouTube treatment) or to browse their Facebook or Instagram accounts (Social Media treatment). Participants wore headphones during cell phone activities to avoid distracting one another. Because we were interested in the effect of participants’ typical social media experiences, rather than the effect of a particular platform, we asked participants to select their customary social media platforms from among the two most popular: Instagram and Facebook [49]. The non-evocative YouTube playlist was used as a negative control and consisted of a selection of videos (e.g., Neutral Emotion Pictures Video and Things You Did Not Know the Use Of) from which participants could select content to view (a link to this playlist and a list of and links to videos found within this playlist can be found in S1 Appendix); we chose to use this as a negative control because when interacting with this playlist, participants engaged in a similar scrolling and viewing behavior as when selecting content on their social media accounts. This cell phone activity lasted 20 minutes and was followed by a 5-minute interim period. This five-minute interim period encompassed the time that was required to collect the saliva samples; the cortisol measurement taken during the interim period reflects the cortisol response during the first 20-minute period. Participants did not interact with their cell phones or each other during this interim period.

During the second 20-minute period, “T2,” subjects were again asked to use their personal cell phones for 20 minutes to view either YouTube or Social Media; this selection alternated from the subject’s first treatment, so that each subject completed both treatments but in random order. Following this 20-minute cell phone activity, a third saliva sample (“Final”) was collected, after which participants completed an online demographic and psychological survey via google forms (see Psychological measures). Surveys were administered at the end of our data collection to avoid the possibility that the surveys would themselves cause stress and influence our results. We chose 20-minute experimental periods because several studies have shown that salivary cortisol peaks 20 minutes after a psychological stressor [5052]. Heart rate monitors were collected from participants after they completed the questionnaires. Fig 1 provides a schematic of the overall study design, indicating the study periods and the identifying terms used throughout this article.

Physiological measures

To evaluate subjects’ physiological responses, both heart rate and salivary cortisol levels were measured. Subjects wore Polar OH1 (Polar Electro Oy, Finland) optical heart rate sensors around their upper arm to continuously record heart rate for the duration of the experiment. These sensors utilize photoplethysmography technology to determine heart rate and have a sampling rate of 50Hz.

Using time records, heart rate data were encoded to match the study periods described in Fig 1. We calculated the average heart rate from the final five minutes prior to T1 and T2 and identified them as the Baseline and Interim periods, respectively. For T1 and T2, we used the average heart rate from the full 20 minutes of each period. Unreported comparisons based on the last five minutes of all periods yielded no change in the results.

Subjects provided saliva samples before the first cell phone treatment and immediately after each of the two treatments. To collect saliva, subjects placed absorbent swabs (SalivaBio Oral Swabs, Salimetrics; State College, PA) in their mouths for 2 minutes and then removed and sealed the swabs in purposely designed tubes. Swabs were centrifuged and the resulting saliva samples (approximately 1ml) were frozen at -20°C for up to one week before analysis. Salivary free cortisol was measured using a commercially available enzyme immunoassay kit (Salivary Cortisol ELISA Kit, Salimetrics) [41].

All samples, standards, and controls were run in duplicate, and the manufacturer’s protocol was followed without modification. A standard curve was run with each assay, as were high and low standards (provided with the kit). Briefly, cortisol in the provided standards and in our unknown samples competed with cortisol conjugated to horseradish peroxidase for binding sites on capture antibodies (bound to the microtiter plate). After an incubation and wash step, tetramethylbenzidine was added and changed color when it reacted with the horseradish peroxidase (conjugated to cortisol). The amount of color change, quantified by a plate reader (Bio-Rad, iMark Microplate Absorbance Reader; Hercules, CA), was inversely proportional to the amount of cortisol present in the unknown samples. Data reduction software provided with the plate reader was used to interpolate our data using a 4-parameter non-linear regression curve fit. The lower limit of sensitivity for this assay was 0.007μg/dl, and the inter-assay variation was 5.6% and 5.4% for high and low controls, respectively. Intra-assay variation ranged from 2.3–5.4%. All indicate acceptable limits of variation. The cortisol antiserum cross-reacts with dexamethasone (19.2%), but all other cross-reactivity values were less than 0.6%. To stabilize the variance, the base 10 logarithm of cortisol was used in data analysis [53].

Psychological measures

Because psychological factors can influence one’s physiological response [54], we surveyed participants about their social media use, self-esteem, tendency to make social comparisons, and their ongoing stress, using validated and widely used assessments (Table 2). These factors were examined because they could alter the relationship between the physiological stress response and cell phone activities in this study. Assessments were self-reported with personal cell phones via Google Forms, following saliva sampling in the “Final” period (see Fig 1), and scale outcomes were calculated as defined by their developers. To avoid the possibility that thoughts of stress prompted by the Perceived Stress Scale could influence responses on other scales, this was the last scale to be administered. Scales are briefly described in Table 2, and additional details can be found in the S2 Appendix.

thumbnail
Table 2. Validated psychological scales used in our study to quantify psychosocial factors.

https://doi.org/10.1371/journal.pone.0298553.t002

Statistical analysis

Using 2-group t-tests, we confirmed equality of the two groups (Social Media then YouTube and YouTube then Social Media) for age, psychological measures, and baseline measures of heart rate and cortisol. We confirmed our groups were similar in terms of sex and social media preference using chi-square tests. Because we randomly assigned individuals to group order, this assessment was necessary to ensure group equality on these key elements.

We confirmed a lack of carryover from the first 20-minute period to the second following standard protocol [43,44]. We fit a repeated measures model in a mixed model framework, incorporating fixed factors of treatment group (order), period, their interaction, and random effect of participant. We then added each potential moderator (sex, age, and the four psychological measures) to the model to examine whether there was a change in the observed relationship between the treatments and physiological stress response; moderators were added independently and were not combined into a single model. We used self-reported sex and discretized age as under 25 years (“digital natives” who have grown up with social media) and 25 years or older. In the event of statistical significance in the 3-way interaction, we used model-based estimates of the outcomes at selected values of the moderator to better understand these interactions. Based on the model results (indicating a significant effect of period), we explicitly tested for a treatment effect on heart rate and cortisol using only the first 20-minute period in a two-group t-test. We adjusted for multiplicity using the false discovery rate (FDR) adjustment [60].

All statistical models used were evaluated for appropriateness with residual plots, including whether there were differences in mean response or variance among the study days. Statistical significance was defined as p (or adjusted p) ≤ 0.05. Linear modeling was completed with SAS 9.4 and all other descriptive statistics and plotting were completed in R version 4.0.2 [61] using the tidyverse library [62] in the RStudio IDE [63].

Results

We first verified that our two groups (Social Media then YouTube and YouTube then Social Media) were equivalent with respect to survey measures and demographics (Table 3). We noted that Facebook Intensity was slightly higher in the Social Media than YouTube group. Men and women were equally likely to use Facebook or Instagram (χ21 = 0.240, p = 0.624), but on average those using Facebook were older than those using Instagram regardless of group (T36.2 = 4.36, p<0.001; Facebook mean age 33.6 (2.5), Instagram mean age 21.5 (1.2)).

thumbnail
Table 3. Summary statistics of key demographics and test of equivalence.

https://doi.org/10.1371/journal.pone.0298553.t003

Carryover effects did not significantly differ for the two group orders for either heart rate (F1,50 = 0.02, p = 0.878) or cortisol (F1,51 = 1.21, p = 0.277). Heart rate and cortisol measures by study period are displayed in Fig 2. At baseline, heart rate was equivalent between groups (T51 = 0.59, p = 0.555) as was cortisol (T54 = 0.63, p = 0.53).

thumbnail
Fig 2. Summary of physiological measures by study period.

Left panel shows mean heart rate (BPM) ± standard error of the mean; right panel shows mean cortisol (μg/dL) ± standard error of the mean. Raw cortisol values are plotted and reflect titers at baseline and during the two 20-minute treatment periods (T1 and T2); the inference is made from the mixed model using log10(Cortisol) values. Because there was no significant effect of Treatment Order or Treatment Order X time, comparisons of period are based on the main effect of period in the mixed model. Bars identify significantly different periods, *** indicates padj < 0.001, ** indicates padj < 0.01, and * indicates padj < 0.05. Adjustment using FDR [60].

https://doi.org/10.1371/journal.pone.0298553.g002

The period effect was statistically significant for both heart rate and cortisol in the linear models (Table 4), and the decrease in physiological response over the course of the study was not different between the two group orders (non-significant group order by period interaction, Table 4). Heart rate differed in all four periods (Fig 2), declining from Baseline to T1 and from Interim to T2, with a slight increase from T1 to Interim. This occurred regardless of group order. Heart rate during the Interim period was lower than during Baseline (Fig 2). From Baseline to T2, heart rate dropped an average of 7.3 (SE = 0.65) beats per minute (BPM). Cortisol concentrations were significantly lower following the second cell phone period (T2) than in the first two study periods (Fig 2). Participants’ heart rates and cortisol levels ultimately decreased across the duration of the study, regardless of the cell phone treatments.

thumbnail
Table 4. Analysis of variance results for study outcomes.

https://doi.org/10.1371/journal.pone.0298553.t004

Considering the statistically significant period effect and non-significant interaction between treatment order and period, we directly compared heart rate and cortisol responses between cell phone treatments during T1 only. There were no significant differences in mean heart rate (T153 = -0.22, p = 0.827) or cortisol (T106 = 0.40, p = 0.687) between those viewing Social Media and YouTube during the T1 period.

We separately added sex and age to our models examining the effects of order and period (as indicated by a 3-way interaction) and found that neither heart rate nor cortisol responses were moderated by participants’ sex (heart rate p = 0.361, cortisol p = 0.442) or age (heart rate = 0.545, cortisol p = 0.837). Next, we considered the moderating effects of social media platform (Facebook or Instagram) and psychological measures (as described in Table 2) on heart rate and cortisol measurements. We found only a single significant 3-way interaction when examining the moderating effect of Intensity of Social Media Use on cortisol (F2,100 = 3.15, p = 0.047). High Intensity of Social Media use was associated with elevated cortisol at the baseline experimental period among those in the Social Media then YouTube group. As this only affects measurements before the experiment occurs, and doesn’t reflect our experimental conditions, we do not believe it is relevant to our study conclusions and do not discuss it further.

Data availability statement

Accession numbers and/or DOIs will be made available after acceptance and title and abstract have been accepted by reviewers.

Discussion

Because of concerns surrounding the pervasive use of social media, we set out to examine whether social media provokes a physiological stress response. The crossover design of our experiment allowed us to differentiate the effect of our social media treatment from the effect of treatment period, and we found a period effect but no treatment effect. Among those participating in our study, 20 minutes of social media use did not elicit a physiological stress response and instead, the use of smartphones seemed to reduce activity of the sympathetic nervous system and HPA axis. Further, despite evidence of sex and age-specific differences in digital media use and psychological well-being [64], we found no evidence of age or sex modifying the physiological responses to our smartphone treatments. Additionally, neither psychological traits nor habits of social media use modified the physiological responses in our experiment. We were surprised by these findings because a growing body of literature suggests that excessive smartphone use, and social media use in particular, is detrimental to mental and physical health [10,16,65]. We expected to find that social media use would trigger a measurable physiological stress response and that this might help explain its contribution to psychiatric and physical morbidities. Instead, our findings seem to lend credence to the suggestion [36,37] that accessing social media (and in the case of our study, YouTube) acts to assuage stress.

Nevertheless, despite the absence of a physiological stress response to our social media treatment, our findings do not preclude the possibility that social media use induces psychological stress as has been frequently posited [6668]. Among studies examining the physiological response to psychological stressors, some have elicited robust physiological responses [6971], while other studies fail to find an association [26,72]. These contradictory findings may be explained by variations in the cognitive appraisal of a stressor; some perceptions of stress are more likely to elicit a physiological response than others [70,73,74]. Specifically, stressors that are appraised as uncontrollable, novel, challenging, and/or threatening are most likely to activate the HPA axis and sympathetic division of the autonomic nervous system [73]. When stressors are appraised in this way, the situation may be perceived as requiring extra resources and thus physiological and behavioral modification are initiated to help provide these resources. In reference to the findings in our study, content viewed for 20 minutes on smartphones may not have been appraised as uncontrollable, novel, challenging, or threatening and thus did not provoke a physiological stress response.

Mobile devices are controllable and are not novel. While cell phone alerts solicit attention, users can control the amount and type of information disseminated in their feeds. Further, cell phones have lost their novelty and are ubiquitous in our culture. Perhaps when cell phones were novel their use prompted a physiological response, but more recently this response has become habituated, such that a diminished physiological response occurs with repeated exposure to the same stimulus [75,76]. Our participants may have been habituated individuals using their cell phones in the manner to which they have become accustomed. Consequently, a physiological stress response was not provoked by our experimental treatment.

When we gave our study instructions, fitted heart rate monitors, and collected saliva samples, we may have inadvertently introduced a sense of novelty and uncontrollability, which has been shown to elicit a physiological stress response [7779]. This could explain the relatively higher heart rate during the Baseline and Interim study periods than during the cell phone treatment periods; the sympathetic nervous system seemed to be more active during periods of smartphone abstinence than during periods of smartphone use. Similar findings have been reported by Johnshoy et al. [37] and Rus and Tiemensma [36] who found that social media use on personal devices attenuated the physiological stress response to an acute stressor (Trier Social Stress Test). It may be that contact with smartphones offers a form of social support, even if an individual does not interact with members of one’s social group through social media. Access to the phone itself may be a reassuring comfort in times of uncertainty.

Social media and YouTube may not have been perceived as challenging or threatening. While we did not directly survey feelings of challenge or threat, we surmise our social comparison and self-esteem scales offer insight into such emotions. Those who consistently rank themselves as inferior on the social comparison scale may have felt threatened by online interactions with their “friends,” and those who ranked themselves as superior might have felt challenged. Similarly, it can be assumed that those with low self-esteem may have felt more challenged or threatened by social media than those with higher self-esteem. Studies have suggested that threats to the social self (i.e. situations that could lead to rejection of an individual’s self-worth) often result in psychobiological responses, including HPA axis and cardiovascular activation [70,71]. As such, we expected to find a heightened physiological stress response when individuals in our study viewed social media. However, we found no relationships between physiological measures of stress and the responses to self-esteem or social comparison scales.

Psychological stressors are first processed by higher brain centers before activating physiological responses [80]. Further studies may attempt to elucidate if higher-order processing results in the social media and YouTube content being appraised as benign; posts that could be construed as either threatening or challenging may undergo refinement by cognitive processes so that they are appraised as harmless. It may not be social media, per se, that evokes a response but rather the perception of social media content that determines the physiological response. Further, social media users may “prune their feed” such that threatening or challenging posts are entirely eliminated from view, but our research did not examine this possibility.

Because cell phones and social media have only recently come into widespread use, much is left to learn about the social, psychological, and physiological implications of this novel technology. Previous studies have examined social media use with various methodologies [e.g., 13,20,38], and our study is unique in that it evaluated the physiological consequence of social media use using a robust cross-over design. Our findings add to a growing body of knowledge and imply that short-term bouts of cell phone use may not stimulate an acute physiological stress response.

Limitations and future directions

As our study population reflected a subpopulation of individuals who consented to engage with their social media accounts and smartphones for an hour, this group may not be representative of the general population. Also, we did not control the social media content viewed by any of the participants. While we maintain that our study adequately assessed responses to participants’ typical use of social media, we acknowledge that our design, which allowed participants to view their preferred content, may have introduced some uncontrolled variability to our study. In addition, it is possible that smartphone use does induce a physiological response but that it might be delayed or only noticeable with extended bouts of use. Our study, in which we examined only the first 20 minutes of use, did not assess this possibility due to participant burden.

Beyond excluding those who ate within one hour of our study from cortisol analyses, we did not control for food or beverage consumption or emotional state (e.g., caffeine consumption, hard exercise, exogenous stressors, or calming activities), prior to collecting our data. It is possible that such events could have altered participants’ responses to cell phone treatments throughout the duration of our measurements, and our analyses could not have controlled for this variation in response. However, even if such uncontrolled variables had an effect, it would not change our conclusion. If social media did provoke a stress response, then we would have seen either no change in or an increase in heart rate and cortisol across the duration of our study period and not the observed decrease in these biomarkers.

Lastly, because we used a convenience sample of participants, we may have had an inadequate number of teenagers and older adults participating, which may skew our results and conclusions. To adequately test the moderating effects of sex and age, a larger sample size across both variables may be required.

Our study does not preclude the possibility that social media use can be harmful. Several studies have suggested that social media use can promote negative emotions and distress [8183], and digital technologies (including social media) have been shown to displace beneficial activities [84], such as school work [85] and exercise [65]. We did not measure such potential negative outcomes. In light of the current online environment, in which divisive discourse and extremist views are commonplace, it may be important to examine the emotional and behavioral responses to social media activities even if they do not increase heart rate and cortisol levels.

Conclusions

While it may be prudent to consider the physiological and psychological effects of social media, the dangers of new technologies are often overblown. In the Victorian age, print publications were thought to distort human learning and communications, and the wireless telegraph was feared to isolate users from human interactions [86]. The results of our study add to a small body of evidence suggesting that social media use may in fact serve to mitigate stress [36,37]. Recognizing the limitations of this study, we found that 20 minutes of social media use among our study participants did not provoke a physiological stress response but instead that sitting still and scrolling through content on smart phones likely depressed activity of both the sympathetic nervous system (as evidenced by a decreased heart rate) and the HPA axis (as evidenced by decreased cortisol). More research is needed, to disentangle the physiological stress response from the psychological stress response, and emotional and behavioral responses in general, to more intensive periods of social media use.

Supporting information

S1 Appendix. YouTube videos included in our non-evocative playlist.

https://doi.org/10.1371/journal.pone.0298553.s001

(DOCX)

Acknowledgments

This study was conducted as part of a summer research experience for undergraduates who participated in the INBRE Summer Scholars program at College of Western Idaho. We are indebted to the following students for their help with and dedication to this project: Brittany Beers, Zoey Carr, Elizabeth Carter, Cristiana Holmes, Abdi Mohamed, Brandi Sweet, Riley Woodworth.

Special thanks to Michelle Fellows for her support in early concept development and Devaleena Pradhan and Keith Sockman for helpful comments on the manuscript.

References

  1. 1. American Academy of Pediatrics Council on Communications and Media. Media Use in School-Aged Children and Adolescents. Pediatrics. 2016;138(5):e20162592. pmid:27940794
  2. 2. House of Commons Science and Technology Committee. Impact of social media and screen-use on young people’s health: Fourteenth report of Session 2017–2019. Select Committee on Science Technology, issuing body [Internet]. 2019; Available from: https://publications.parliament.uk/pa/cm201719/cmselect/cmsctech/822/822.pdf.
  3. 3. Twenge JM. Have smartphones destroyed a generation? The Atlantic [Internet]. 2017 Sep; Available from: https://www.theatlantic.com/magazine/archive/2017/09/has-the-smartphone-destroyed-a-generation/534198/.
  4. 4. Busch PA, McCarthy S. Antecedents and consequences of problematic smartphone use: A systematic literature review of an emerging research area. Vol. 114, Computers in Human Behavior. Elsevier Ltd; 2021.
  5. 5. Jiaxin Y, Xi F, Xiaoli L, Yamin L. Association of problematic smartphone use with poor sleep quality, depression, and anxiety: A systematic review and meta-analysis. Vol. 284, Psychiatry Research. Elsevier Ireland Ltd; 2020.
  6. 6. Baumeister RF, Leary MR. The need to belong: Desire for interpersonal attachments as a fundamental human motivation. Psychol Bull [Internet]. 1995;117(3):497–529. Available from: https://doi.org/10.1037/0033-2909.117.3.497.
  7. 7. Diener E, Suh EM, Lucas RE, Smith HL. Subjective well-being: Three decades of progress. Psychol Bull [Internet]. 1999;125(2):276–302. Available from: https://doi.org/10.1037/0033-2909.125.2.276.
  8. 8. Lin LY, Sidani JE, Shensa A, Radovic A, Miller E, Colditz JB, et al. Association between social media use and depression among US. young adults. Depress Anxiety. 2016;33:323–31.
  9. 9. Shakya HB, Christakis NA. Association of Facebook use with compromised well-being: a longitudinal study. Am J Epidemiol [Internet]. 2017;185(3):203–11. Available from: pmid:28093386
  10. 10. Twenge JM, Martin GN, Campbell WK. Decreases in psychological well-being among american adolescents after 2012 and links to screen time during the rise of smartphone technology. Emotion [Internet]. 2018;18(6):765–80. Available from: pmid:29355336
  11. 11. Afifi TD, Zamanzadeh N, Harrison K, Callejas MA. WIRED: The impact of media and technology use on stress (cortisol) and inflammation (interleukin IL-6) in fast paced families. Comput Human Behav [Internet]. 2018;81:265–73. Available from: https://doi.org/10.1016/j.chb.2017.12.010.
  12. 12. Rauch SM, Strobel C, Bella M, Odachowski Z, Bloom C. Face to face versus Facebook: Does exposure to social networking web sites augment or attenuate physiological arousal among the socially anxious? Cyberpsychol Behav Soc Netw [Internet]. 2014;17(3):187–90. Available from: pmid:24180223
  13. 13. Rus HM, Tiemensma J. Social media under the skin: Facebook use after acute stress impairs cortisol recovery. Front Psychol [Internet]. 2017;8:1–10. Available from: https://doi.org/10.3389/fpsyg.2017.01609.
  14. 14. Barry CT, Sidoti CL, Briggs S, Reiter S, Lindsey RA. Adolescent social media use and mental health from adolescent and parent perspectives. J Adolesc [Internet]. 2017;61:1–11. Available from: pmid:28886571
  15. 15. Ehrenreich SE, Underwood MK. Adolescents’ internalizing symptoms as predischoctors of the content of their Facebook communication and responses received from peers. Transl Issues Psychol Sci [Internet]. 2016;2(3):227–37. Available from: https://doi.org/10.1037/tps0000077.
  16. 16. Woods HC, Scott H. #Sleepyteens: Social media use in adolescence is associated with poor sleep quality, anxiety, depression and low self-esteem. J Adolesc [Internet]. 2016;51:41–9. Available from: pmid:27294324
  17. 17. Wang P, Xie X, Wang X, Wang X, Zhao F, Chu X, et al. The need to belong and adolescent authentic self-presentation on SNSs: A moderated mediation model Involving FoMO and perceived social support. Pers Individ Dif [Internet]. 2018;128:133–8. Available from: https://doi.org/10.1016/j.paid.2018.02.035.
  18. 18. Dempsey AE, O’Brien KD, Tiamiyu MF, Elhai . Fear of missing out (FoMO) and rumination mediate relations between social anxiety and problematic Facebook use. Addictive Behaviors Reports [Internet]. 2019;9(1000):150–10015. Available from: pmid:31193746
  19. 19. Przybylski AK, Murayama K, DeHaan CR, Gladwell V. Motivational, emotional, and behavioral correlates of fear of missing out. Comput Human Behav [Internet]. 2013;29(4):1841–8. Available from: https://doi.org/10.1016/j.chb.2013.02.014.
  20. 20. Kelly Y, Zilanawala A, Booker C, Sacker A. Social media use and adolescent mental health: Findings from the UK millennium cohort study. EClinicalMedicine [Internet]. 2018;6:59–68. Available from: pmid:31193561
  21. 21. Verduyn P, Ybarra O, Résibois M, Jonides J, Kross E. Do social network sites enhance or undermine subjective well-being? A critical review. Soc Issues Policy Rev [Internet]. 2017;11(1):274–302. Available from: https://doi.org/10.1111/sipr.12033.
  22. 22. Hawes T, Zimmer-Gembeck MJ, Campbell SM. Unique associations of social media use and online appearance preoccupation with depression, anxiety, and appearance rejection sensitivity. Body Image [Internet]. 2020;33:66–76. Available from: pmid:32113009
  23. 23. Alfano CA, Zakem AH, Costa NM, Taylor LK, Weems CF. Sleep problems and their relation to cognitive factors, anxiety, and depressive symptoms in children and adolescents. Depress Anxiety [Internet]. 2009;26(6):503–12. Available from: pmid:19067319
  24. 24. Fredriksen K, Rhodes J, Reddy R, Way N. Sleepless in Chicago: Tracking the effects of adolescent sleep loss during the middle school years. Child Dev [Internet]. 2004;75(1):84–95. Available from: https://www.jstor.org/stable/3696567. pmid:15015676
  25. 25. Jezova D, Makatsori A, Duncko R, Moncek F, Jakubek M. High trait anxiety in healthy subjects is associated with low neuroendocrine activity during psychosocial stress. Prog Neuropsychopharmacol Biol Psychiatry [Internet]. 2004;28(8):1331–6. Available from: pmid:15588760
  26. 26. Lupis SB, Lerman M, Wolf JM. Anger responses to psychosocial stress predict heart rate and cortisol stress responses in men but not women. Psychoneuroendocrinology [Internet]. 2014;49(1):84–95. Available from: https://doi.org/10.1016/j.psyneuen.2014.07.004.
  27. 27. Owens AP, Low DA, Iodice V, Mathias CJ, Critchley HD. Emotion and the autonomic nervous system—a two-way street: insights from affective, autonomic and dissociative disorders. In: Stein John (ed) Reference module in neuroscience and biobehavioral psychology. Elsevier; 2017. p. 1–15.
  28. 28. Allen AP, Kennedy PJ, Cryan JF, Dinan TG, Clarke G. Biological and psychological markers of stress in humans: Focus on the Trier Social Stress Test. Vol. 38, Neuroscience and Biobehavioral Reviews. 2014. p. 94–124. pmid:24239854
  29. 29. Dickerson SS, Kemeny ME. Acute stressors and cortisol responses: A theoretical integration and synthesis of laboratory research. Psychol Bull [Internet]. 2004;130(3):355–91. Available from: pmid:15122924
  30. 30. Sapolsky RM. Social status and health in humans and other animals. Annu Rev Anthropol [Internet]. 2004;33(1):393–418. Available from: https://doi.org/10.1146/annurev.anthro.33.070203.144000.
  31. 31. Juster RP, McEwen BS, Lupien SJ. Allostatic load biomarkers of chronic stress and impact on health and cognition. Neurosci Biobehav Rev. 2010;35:2–16. pmid:19822172
  32. 32. Bhagwagar Z, Hafizi S, Cowen PJ. Increased salivary cortisol after waking in depression. Psychopharmacology (Berl) [Internet]. 2005;182(1):54–7. Available from: pmid:15991000
  33. 33. McEwen BS. Protective and damaging effects of stress mediators. New England Journal of Medicine [Internet]. 1998;338(3):171–9. Available from: pmid:9428819
  34. 34. Rosmond R. Stress induced disturbances of the HPA axis: A pathway to Type 2 diabetes? Med Sci Monit. 2003;9(2):35–9.
  35. 35. Morin-Major JK, Marin MF, Durand N, Wan N, Juster RP, Lupien SJ. Facebook behaviors associated with diurnal cortisol in adolescents: Is befriending stressful? Psychoneuroendocrinology [Internet]. 2016;63:238–46. Available from: pmid:26519778
  36. 36. Rus HM, Tiemensma J. Social media as a shield: Facebook buffers acute stress. Physiol Behav [Internet]. 2018;185:46–54. Available from: pmid:29273455
  37. 37. Johnshoy Q, Moroze E, Kaser I, Tanabe A, Adkisson C, Hutzley S, et al. Social media use following exposure to an acute stressor facilitates recovery from the stress response. Physiol Behav [Internet]. 2020;223(12):11301–3012. Available from: https://doi.org/10.1016/j.physbeh.2020.113012.
  38. 38. Shafi RMA, Nakonezny PA, Miler KA, Desai J, Almorsy AG, Ligezka AN, et al. An exploratory study of clinical and physiological correlates of problematic social media use in adolescents. Psychiatry Res [Internet]. 2021;302:11402. Available from: pmid:34098156
  39. 39. Obel C, Hedegaard M, Henriksen TB, Secher NJ, Olsen J, Levine S. Stress and salivary cortisol during pregnancy. Psychoneuroendocrinology. 2005;30(7):647–56. pmid:15854781
  40. 40. Barbot M, Zilio M, Scaroni C. Cushing’s syndrome: Overview of clinical presentation, diagnostic tools and complications. Vol. 34, Best Practice and Research: Clinical Endocrinology and Metabolism. Bailliere Tindall Ltd; 2020.
  41. 41. Salimetrics. Expanded Range High Sensitivity Salivary Cortisol Enzyme Immunoassay Kit. State College, PA; 2015.
  42. 42. Spencer RL, Chun LE, Hartsock MJ, Woodruff ER. Glucocorticoid hormones are both a major circadian signal and major stress signal: How this shared signal contributes to a dynamic relationship between the circadian and stress systems. Vol. 49, Frontiers in Neuroendocrinology. Academic Press Inc.; 2018. p. 52–71.
  43. 43. Jones B, Kenward MG. Design and analysis of cross-over trials. 3rd Edition. Monographs on Statistics and Applied Probability. 2015;138.
  44. 44. Milliken GA, Johnson DE. Analysis of messy data volume 1. Designed experiments. 2nd Edition. Chapman and Hall / CRC: Boca Raton, FL; 2009.
  45. 45. Aprile I, Rizzo RS, Romanini E, De Santis F, Marsan S, Rinaldi G, et al. Group rehabilitation versus individual rehabilitation following knee and hip replacement: a pilot study with randomized, single-blind, cross-over design. European Journal of Physical and Rehabilitative Medicine. 2011;47:551–9. pmid:21666574
  46. 46. Berkowitz SA, Delahanty LM, Terranova J, Steiner B, Ruazol MP, Singh R, et al. Medically Tailored Meal Delivery for Diabetes Patients with Food Insecurity: a Randomized Cross-over Trial. J Gen Intern Med. 2019 Mar 15;34(3):396–404. pmid:30421335
  47. 47. Benten A, Hothorn T, Vor T, Ammer C. Wildlife warning reflectors do not mitigate wildlife–vehicle collisions on roads. Accid Anal Prev. 2018 Nov 1;120:64–73. pmid:30096449
  48. 48. van Zanten GC, Krych L, Röytiö H, Forssten S, Lahtinen SJ, Al-Soud WA, et al. Synbiotic Lactobacillus acidophilus NCFM and cellobiose does not affect human gut bacterial diversity but increases abundance of lactobacilli, bifidobacteria and branched-chain fatty acids: A randomized, double-blinded cross-over trial. FEMS Microbiol Ecol. 2014 Oct 1;90(1):225–36. pmid:25098489
  49. 49. Smith A, Anderson M. Social Media Use in 2018. Pew Research Center [Internet]. 2018; Available from: https://www.pewresearch.org/internet/2018/03/01/social-media-use-in-2018/.
  50. 50. Becker L, Rohleder N. Time course of the physiological stress response to an acute stressor and its associations with the primacy and recency effect of the serial position curve. PLoS One [Internet]. 2019;14(5):e0213883. Available from: pmid:31100063
  51. 51. Engert V, Vogel S, Efanov SI, Duchesne A, Corbo V, Ali N, et al. Investigation into the cross-correlation of salivary cortisol and alpha-amylase responses to psychological stress. Psychoneuroendocrinology [Internet]. 2011;36(9):1294–302. Available from: pmid:21470780
  52. 52. Kudielka BM, Schommer NC, Hellhammer DH, Kirschbaum C. Acute HPA axis responses, heart rate, and mood changes to psychosocial stress (TSST) in humans at different times of day. Psychoneuroendocrinology [Internet]. 2004;29(8):983–92. Available from: pmid:15219648
  53. 53. Kutner M, Nachtscheim CJ, Neter J, Li W. Applied Linear Statistical Models (5th ed.). McGraw-Hill Irwin; 2005.
  54. 54. Reyes-Mota AR, Cerda-Molina AL, Mayagoitia-Novales L, Viveros-Sandoval ME, Borráz-León JI. Reduced cortisol response to traumatic images, self-esteem and stress levels in Emergency Medical Technicians from the Red Cross. Pers Individ Dif. 2021 Sep 1;179.
  55. 55. Ellison NB, Steinfield C, Lampe C. The benefits of Facebook “friends:” Social capital and college students’ use of online social network sites. Journal of Computer-Mediated Communication [Internet]. 2007;12(4):1143–68. Available from: https://doi.org/10.1111/j.1083-6101.2007.00367.x.
  56. 56. Teo NSY, Collinson SL. Instagram and risk of rumination and eating disorders: An Asian perspective. Psychol Pop Media Cult [Internet]. 2019;8(4):491–508. Available from: https://doi.org/10.1037/ppm0000205.
  57. 57. Rosenberg M. Society and the adolescent self-image. Princeton, NJ: University Press; 1965.
  58. 58. Allan S, Gilbert P. A social comparison scale: Psychometric properties and relationship to psychopathology. Pers Individ Dif [Internet]. 1995;19(3):293–9. Available from: https://doi.org/10.1016/0191-8869(95)00086-L.
  59. 59. Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav [Internet]. 1983;24(4):385. Available from: https://doi.org/10.2307/2136404. pmid:6668417
  60. 60. Benjamini Y, Hochberg Y. Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing. Journal of the Royal Statistical Society: Series B (Methodological) [Internet]. 1995;57(1):289–300. Available from: http://dx.doi.org/10.1111/j.2517-6161.1995.tb02031.x.
  61. 61. R Core Team. R: A Language and Environment for Statistical Computing [Internet]. Vienna, Austria: R Foundation for Statistical Computing; 2020 [cited 2023 Aug 15]. Available from: https://www.r-project.org/.
  62. 62. Wickham H, Averick M, Bryan J, Chang W, McGowan LD, François R, et al. Welcome to the tidyverse. J Open Source Softw. 2019;4(43):1686.
  63. 63. RStudio Team. RStudio: Integrated Development Environment for R [Internet]. Boston, MA; 2020. Available from: http://www.rstudio.com/.
  64. 64. Twenge JM, Martin GN. Gender differences in associations between digital media use and psychological well-being: Evidence from three large datasets. J Adolesc [Internet]. 2020;79:91–102. Available from: pmid:31926450
  65. 65. Anderson SE, Economos CD, Must A. Active play and screen time in US children aged 4 to 11 years in relation to sociodemographic and weight status characteristics: A nationally representative cross-sectional analysis. BMC Public Health [Internet]. 2008;8(1):366. Available from: pmid:18945351
  66. 66. Wolfers LN, Utz S. Social media use, stress, and coping. Curr Opin Psychol. 2022 Jun 1;45. pmid:35184027
  67. 67. van der Schuur WA, Baumgartner SE, Sumter SR. Social Media Use, Social Media Stress, and Sleep: Examining Cross-Sectional and Longitudinal Relationships in Adolescents. Health Commun. 2019 Apr 16;34(5):552–9. pmid:29313723
  68. 68. Steele RG, Hall JA, Christofferson JL. Conceptualizing Digital Stress in Adolescents and Young Adults: Toward the Development of an Empirically Based Model. Clin Child Fam Psychol Rev. 2020 Mar 1;23(1):15–26. pmid:31392451
  69. 69. Bae YJ, Reinelt J, Netto J, Uhlig M, Willenberg A, Ceglarek U, et al. Salivary cortisone, as a biomarker for psychosocial stress, is associated with state anxiety and heart rate. Psychoneuroendocrinology [Internet]. 2019;101:35–41. Available from: pmid:30408721
  70. 70. Dickerson SS, Kemeny ME. Acute stressors and cortisol responses: A theoretical integration and synthesis of laboratory research. Psychol Bull [Internet]. 2004;130(3):355–91. Available from: pmid:15122924
  71. 71. Woody A, Hooker ED, Zoccola PM, Dickerson SS. Social-evaluative threat, cognitive load, and the cortisol and cardiovascular stress response. Psychoneuroendocrinology [Internet]. 2018;97:149–55. Available from: pmid:30029158
  72. 72. Leis O, Lautenbach F. Psychological and physiological stress in non-competitive and competitive esports settings: A systematic review. Psychol Sport Exerc [Internet]. 2020;51:101738. Available from: https://doi.org/10.1016/j.psychsport.2020.101738.
  73. 73. Denson TF, Spanovic M, Miller N. Cognitive appraisals and emotions predict cortisol and immune responses: A meta-analysis of acute laboratory social stressors and emotion inductions. Psychol Bull [Internet]. 2009;135(6):823–53. Available from: pmid:19883137
  74. 74. Tomaka J, Blascovich J, Kelsey RM, Leitten CL. Subjective, physiological, and behavioral effects of threat and challenge appraisal. J Pers Soc Psychol [Internet]. 1993;65(2):248–60. Available from: https://doi.org/10.1037/0022-3514.65.2.248.
  75. 75. Costoli T, Bartolomucci A, Graiani G, Stilli D, Laviola G, Sgoifo A. Effects of chronic psychosocial stress on cardiac autonomic responsiveness and myocardial structure in mice. Am J Physiol Heart Circ Physiol [Internet]. 2004;286(6):2133–40. Available from: pmid:14962836
  76. 76. Grissom N, Bhatnagar S. Habituation to repeated stress: Get used to it. Neurobiol Learn Mem [Internet]. 2009;92(2):215–24. Available from: pmid:18667167
  77. 77. Salvador A, Suay F, González-Bono E, Serrano MA. Anticipatory cortisol, testosterone and psychological responses to judo competition in young men. Psychoneuroendocrinology [Internet]. 2003;28(3):364–75. Available from: pmid:12573302
  78. 78. van Paridon KN, Timmis MA, Nevison CM, Bristow M. The anticipatory stress response to sport competition; A systematic review with meta-analysis of cortisol reactivity. In: Exerc BOS, editor. Med [Internet]. e000261: 3(1); 2017. Available from: https://doi.org/10.1136/bmjsem-2017-000261.
  79. 79. Peters ML, Godaert GLR, Ballieux RE, Van Vliet M, Willemsen JJ, Sweep FCGJ, et al. Cardiovascular and endocrine responses to experimental stress: Effects of mental effort and controllability. Psychoneuroendocrinology [Internet]. 1998;23(1):1–17. Available from: pmid:9618748
  80. 80. Kudielka BM, Kirschbaum C. Sex differences in HPA axis responses to stress: A review. Biol Psychol [Internet]. 2005;69:113–32. Available from: pmid:15740829
  81. 81. Tobin SJ, Vanman EJ, Verreynne M, Saeri AK. Threats to belonging on Facebook: Lurking and ostracism. Soc Influ [Internet]. 2015;10(1):31–42. Available from: https://doi.org/10.1080/15534510.2014.893924.
  82. 82. Verduyn P, Lee DS, Park J, Shablack H, Orvell A, Bayer J, et al. Passive Facebook usage undermines affective well-being: Experimental and longitudinal evidence. J Exp Psychol Gen [Internet]. 2015;144:480–8. Available from: pmid:25706656
  83. 83. Wenninger H, Krasnova H, Buxmann P. Activity matters: Investigating the influence of Facebook on life satisfaction of teenage users. Proc European Conf on Information Systems (ECIS). 2014;2014.
  84. 84. Przybylski AK, Weinstein N. A large-scale test of the goldilocks hypothesis: Quantifying the relations between digital-screen use and the mental well-being of adolescents. Psychol Sci [Internet]. 2017;28(2):204–15. Available from: https://doi.org/10.1177/0956797616678438.
  85. 85. Neuman SB. The displacement effect: Assessing the relation between television viewing and reading performance. Read Res Q [Internet]. 1988;23(4):414. Available from: https://doi.org/10.2307/747641.
  86. 86. Dickson M. The Victorians had the same concerns about technology as we do [Internet]. The Conversation; 2016. Available from: http://theconversation.com/the-victorians-had-the-same-concerns-about-technology-as-we-do-60476.