Figures
Abstract
Background
Psychological stress experienced by inpatients has been shown to be associated with poorer post-hospital outcomes. Research that explores and intervenes to address in-hospital stress and ameliorate negative patient outcomes requires a valid measurement tool. The Hospital Stress Questionnaire (HSQ) was developed for this purpose. The aims of the current study were to psychometrically validate the HSQ, identify latent factors, reduce the number of items within the HSQ, and explore the psychometric properties of longer and shorter versions of the scale.
Methods
A nationally representative sample of recent NHS hospital inpatients (N = 660; mean age = 54.0, range = 18–97) completed the HSQ within a survey of patient experiences; 32 of which completed the measure a second time two weeks later. Factor structure, convergent validity, known-groups validity, predictive validity, and test-retest reliability were assessed.
Results
Seven domains of in-hospital stress were identified: quality of care, away from home, inconvenienced, health anxiety, negative effects of treatment, ward environment, and disrupted patient experience. Long (55 items), medium (28 items), and short (10 items) versions of the measure were produced, all exhibiting excellent psychometric properties. The highest rated stressor was “poor sleep”.
Citation: Ford DM, Lawton R, Teale EA, O’Connor DB (2025) Psychometric validation of the Hospital Stress Questionnaire. PLoS ONE 20(4): e0321188. https://doi.org/10.1371/journal.pone.0321188
Editor: Maria José Nogueira, School of Nursing Sao Joao de Deus, Evora University, PORTUGAL
Received: December 23, 2024; Accepted: February 24, 2025; Published: April 9, 2025
Copyright: © 2025 Ford et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All data and R code are accessible here: https://github.com/DMFord97/Validation.
Funding: This research was funded by the National Institute for Health and Care Research (NIHR) Yorkshire and Humber Patient Safety Research Collaboration (NIHR Yorkshire and Humber PSRC) and the NIHR Yorkshire and Humber Applied Research Collaboration (NIHR Yorkshire and Humber ARC). The views expressed in this article are those of the authors and not necessarily those of the NIHR, or the Department of Health and Social Care.
Competing interests: The authors have declared that no competing interests exist.
1. Introduction
Background
While in hospital, patients are exposed to an abundance of hospital-related stressors, including those relating to physical, psychological, interpersonal, and environmental factors [1]. For example, Goldwater et al [2] identified a number of physical stressors, such as sleep, malnourishment, dehydration, mobility, and pain; while Detsky and Krumholz [3] have proposed several psychological stressors, such as depersonalisation and uncertainty. Interpersonal stressors concern the patient’s relationship with hospital staff and other patients [e.g., 4], and environmental stressors focus on aspects of the hospital room or ward, such as lighting and temperature [e.g., 5].
Throughout the hospital stay, the psychological and physiological strain experienced in response to these stressors can lead the body into a state of allostatic overload [6], causing deleterious effects on the patient’s health and wellbeing [7,8]. In their review, Guidi and colleagues [7] highlighted that allostatic load has been linked to an increased risk for cardiovascular disease, high systolic and diastolic blood pressure, and depressive symptoms. These effects may then follow the patient home, impeding their recovery, and potentially resulting in an unplanned readmission [9,10] or other poor post-hospital outcomes [11].
Taken together, the above series of events describe a phenomenon known as post-hospital syndrome [12]: an acquired period of generalised vulnerability to adverse events (e.g., post-operative wound infection) following hospitalisation. A growing post-hospital syndrome literature is emerging that outlines associations between hospital-related stressors and patient outcomes [11,13]. For example, Rawal et al. [13] showed that inpatients reporting more disturbances in sleep, mobility, nutrition, and mood – known hospital-related stressors [2] – had a significantly greater risk of unplanned readmission or emergency department visit than their less affected counterparts. This literature presents a clear need to reduce patients’ exposure to in-hospital stressors, with the hopes of improving patient outcomes and saving health authorities both money and resources. However, in order to do this, we must first identify, understand, and measure the hospital-related stressors in question.
The Hospital Stress Questionnaire
The Hospital Stress Questionnaire (HSQ [14]) is a newly developed self-report tool to measure the perceived psychological stress of inpatients in UK hospitals. It identifies 67 hospital-related stressors and allows respondents to rate how stressful they perceived each stressor to be during their hospital stay. The HSQ items were informed by interviewing recent hospital inpatients, who were asked what they found stressful about their hospital stay. The questionnaire builds on previous attempts to measure in-hospital stress, which are often outdated, do not allow for individual differences in perceived stress [15], or are specific to certain populations (e.g., older adults [16,17]).
Aims of the current study
In its current form, the HSQ has not yet been shown to be valid and reliable, and the length of the questionnaire may be burdensome for patients. Therefore, the aims of the current study were to: (i) test the psychometric properties of the HSQ, (ii) reduce the number of items, (iii) group the remaining items into factors, and (iv) produce medium and short versions of the measure.
2. Materials and methods
Design
A cross-sectional online survey was conducted from March to December 2023. Within psychometric theory, a subject-to-item ratio of 10:1 is recommended for conducting an exploratory factor analysis [18,19], therefore, we aimed to recruit a sample size of 670 participants. This study received ethical approval from the University of Leeds, School of Psychology Research Ethics Committee (PSYC-774), and was preregistered (AsPredicted #153763).
Participants
Six hundred and seventy-two completed responses were received, 12 of which were excluded for not meeting the below criteria, leaving a total of 660 participants. Inclusion criteria were the same as for the initial validation of the HSQ (see Ford et al. [14] for justifications), which were as follows: (i) participants were required to be at least 18 years old, (ii) have stayed in a UK hospital as an inpatient, (iii) in the past 12 months, (iv) for at least 24 hours, (v) not for paediatric, maternity, or psychiatric care. A consultee was permitted to assist with or complete the survey on behalf of a relative/friend that was unable to participate themselves.
Participants were recruited between 21st March 2023 and 15th November 2023 from a variety of sources: Prolific (www.prolific.com), Care Opinion (www.careopinion.org.uk), the University of Leeds, School of Psychology Successful Ageing Panel, social media, and word of mouth. All participants provided written informed consent. Those participating via Prolific were compensated with £2 for completion of the study; those recruited via other methods were eligible to be entered into a prize draw to win a £100 gift voucher, or one of three £50 gift vouchers. From the 660 eligible responses, 32 participants were invited to complete the HSQ again, to assess test-retest reliability. For an intraclass correlation coefficient (ICC), a minimum sample of 30 participants has been recommended [20]. These participants were recruited via Prolific, 14 days after their initial response, and were compensated with a further £1.50.
As this study recruited primarily online, several measures were taken to identify bots (automated software misrepresenting as participants [21]) and fraudulent responses – submissions made with fictional data, in an attempt to receive payment for participation (see [22]). To identify such responses, screening questions were placed at the beginning of the survey, three attention checks were added within the survey (e.g., “Please select ‘7’ to show you are paying attention”), and participants were asked for the name of the hospital at which they were admitted. Should a participant fail any screening or attention question, or name a hospital not based in the UK, that response was excluded.
Measures
The survey was conducted online and took approximately 15 minutes to complete via Qualtrics software (2023). Questions focused on the participant’s most recent hospital experience, and began with five screening questions to assess the respondent’s eligibility to participate. These were followed by demographic questions including the participant’s age, gender, ethnicity, level of education, and marital status. The survey then moved onto hospital-related information such as when their most recent hospital stay was, how long they were in hospital for, which hospital they stayed in, whether or not they had surgery, and whether their stay was planned or an emergency. The survey then presented the following questionnaires: the HSQ (with three attention checks), the Perceived Stress Scale (PSS), and the EuroQol 5-Dimension Health Questionnaire (EQ-5D). See Appendix S1 in S1 File for the full survey.
The Hospital Stress Questionnaire.
The HSQ [14] is a self-report measure of inpatient psychological stressors, consisting of 67 items measured between 1 (no stress) and 10 (extreme stress). The HSQ has been piloted on 10 laypersons, confirming face validity, and presented to the Yorkshire Quality and Safety Research Group, confirming content validity. Additionally, the measure was completed by 200 persons who had been in hospital in the past 12 months for at least 24 hours, in order to provide initial validation: both internal consistency (α = 0.97) and convergent validity (r = 0.77 with PSS-10) were excellent.
Perceived Stress Scale.
The PSS was included to assess convergent validity of the HSQ. Each item on the scale was reworded from “In the last month…” to “While in hospital…” The PSS-10 [23] was chosen as it is one of the most widely used measures of psychological stress, and has consistently been shown to be reliable and valid [24]. The 10-item version was chosen over the 14-item version due to its shorter length, and chosen over the 4-item version due to its superior internal reliability (Cronbach’s alpha: 0.78 vs 0.60 [25]).
EuroQol 5-dimension health questionnaire.
The EQ-5D was included to assess the predictive validity of the HSQ. It is a widely-used measure for describing and valuing health, composed of five dimensions: Mobility, Self-Care, Usual Activities, Pain/Discomfort, and Anxiety/Depression [26]. Each of these dimensions can be measured using a three-level (EQ-5D-3L) or five-level (EQ-5D-5L) Likert scale [27], both of which have excellent psychometric properties but the five-level version is more sensitive to change [28]. A participant’s responses to the EQ-5D reveal their health state (e.g., 11111 is indicative of full health); a formula can be applied to this 5-digit code to derive an index value, which reflects how good or bad a health state is according to the preferences of the general population of a country/region. These preferences are determined using a value set; a representative sample from that country/region – the value set for England was used in the current study. The EQ-5D also includes a visual analogue scale (the EQ VAS): a thermometer where the respondent can indicate self-rated health between 0 (worst possible health) and 100 (best possible health).
Analysis
Data was analysed using R Statistical Software (v4.3.1) (data and code can be accessed at: https://github.com/DMFord97/Validation). Descriptive statistics were conducted in order to assess the appropriateness of the sample. To identify the latent factor structure of the measure, exploratory factor analysis (EFA) was employed following Watkins’ [29] guide to best practice. Bartlett’s test of sphericity [30] and the KMO statistic [31] were used to evaluate the suitability of EFA. To determine the number of factors to retain, parallel analysis [32], minimum average partial method [33], visual scree test [34], and Kaiser’s criterion [35] were consulted. The oblimin rotation [36] was chosen as it was assumed that factors would be correlated. Due to the large sample size, factor loadings above 0.30 were retained [37].
Internal consistency reliability was assessed using Cronbach’s alpha, it has been suggested that acceptable values range between 0.70 and 0.95 [38]. Convergent validity and predictive validity were assessed using Pearson’s correlations, where r = 0.10, 0.30, and 0.50 were considered small, medium, and large, respectively [39]. Test-retest reliability was assessed using intraclass correlation coefficients (ICC); values less than 0.5, between 0.5 and 0.75, between 0.75 and 0.9, and greater than 0.90 are indicative of poor, moderate, good, and excellent reliability, respectively [20]. Known-groups validity was assessed using an independent samples t-test, exploring mean differences in hospital stress between patients with planned and emergency admissions.
3. Results
Descriptive statistics
To assess the representativeness of our sample, demographics of participants that completed the survey were compared against the latest NHS hospital admission data [40]. Table 1 shows the NHS figures for age, sex, and ethnicity, desired figures adjusted for a sample size of 670, and actual figures from the recruited sample (18–19 year olds were included in the 20–29 group). Ages within the recruited sample ranged from 18–97 (M = 54.0, SD = 17.3) and were representative of NHS inpatients aged 18 to 80 years old, but were lacking in the > 80 groups. Sample demographics were representative in sex and ethnicity. See Appendix S2 in S1 File for more details of the current sample, such as education, marital status, and whether or not the patient had surgery.
Hospital Stress Questionnaire
Total scores for the HSQ ranged from 67 to 609 out of maximum score of 670 (M = 250.3, SD = 112.6). The item rated as most stressful, on average, was “1. Not sleeping well”, followed by “2. Feeling helpless or not in control” and “19. Missing loved ones” – see Appendix S3 in S1 File for the mean and standard deviation of each item, sorted from most to least stressful. The items rated as least stressful were “59. Not being able to pray or do other religious activities”, “67. Not being able to smoke, drink alcohol, or use other substances”, and “66. The hospital not meeting your individual needs (e.g., disability)”. However, this is likely to be explained due to their lack of applicability to the majority of respondents rather than their salience to a few; a large proportion of respondents selecting 1 (not at all stressful) or N/A (scored in the analysis as 1), lowering the mean scores substantially.
Exploratory factor analysis
The sampling adequacy was well above the acceptable standard (KMO = 0.97) and Bartlett’s test of sphericity demonstrated that correlations between items were large enough to perform a factor analysis (χ2 (2211) = 28,724.73, p < 0.001). Considering the number of factors to retain, Kaiser’s criterion and the scree plot suggested four factors, minimum average partial (MAP) test suggested six factors, and parallel analysis suggested eight factors. All three suggestions were examined: the four- and six-factor solutions had inadequate model fit statistics (CFI < 0.90), the eight-factor solution was also inadequate as only two items loaded onto the eighth factor without cross-loading. Therefore, a seven-factor solution was examined, which was deemed appropriate.
Within the seven-factor model, seven items did not load onto any of the factors (items #22, #23, #26, #30, #50, #55, #65). These items were excluded and the model was re-run, one item did not load onto any factors in this second iteration of the model (item #35), and so it too was excluded. After observing inter-item correlations, three items (#5, #20, and #29) correlated very highly (r ≥ 0.70) with one or more other items, where each pertained to a similar stressor (e.g., listening and communicating, or rude and unfriendly), and so were considered to be repetitive, leading to a decision to exclude the redundant items. Finally, the model was run without the 11 above listed items, and in this last iteration of the model, only one item (#49) did not load onto any factor. Once this item was removed, all 55 remaining items loaded onto one of the seven factors, and the resulting model had acceptable fit statistics (CFI = 0.93, TLI = 0.90, RMSR = 0.03, RMSEA = 0.05), and accounted for 53.0% of the total variance. See Table 2 for the seven factors and their respective items, variance, and Cronbach’s alpha values.
Internal consistency reliability
For the resulting 55-item scale, a Cronbach’s alpha value of 0.97 was obtained, this is above the accepted range of 0.70–0.95, likely due to the large number of items in the scale, which directly influences the value of alpha [41]. The scale has an average inter-item correlation of 0.36, which is within the acceptable range of 0.15–0.5 [42,43]. The corrected item-total correlation of each item was examined, where only one item (#67) had a correlation low enough (r = 0.29) to consider it for exclusion – recommendations of below 0.2 [44] or 0.3 [45] have been offered, since the correlation in question was on the upper end of these values, it was not excluded. Cronbach’s alpha values for each factor were acceptable (0.73–0.91).
Convergent validity
Convergent validity was assessed using Pearson’s correlation coefficient. A large and significant correlation between the total scores of the PSS-10 and the final 55-item version of the HSQ (r = 0.71, p < 0.001) was found, suggesting that the HSQ is measuring the desired construct.
Known-groups validity
Total scores on the HSQ-55 were compared between groups of participants. Mean differences were tested between those who had planned to stay in hospital (predicted to be subject to fewer stressors) (n = 223) versus those who were hospitalised in an emergency (n = 437). A t-test was performed (t (438.3) = –5.89, p < 0.001), indicating that those with planned stays (M = 179.1) were significantly less stressed than patients with unplanned admissions (M = 223.3). Additionally, HSQ-55 scores were correlated with length of stay – a small, positive effect size was found (r = 0.08, p = 0.049), indicating that patients who stay in hospital longer are exposed to more stressors. However, we noted that this correlation was on the threshold of statistical significance.
Predictive validity
A correlation was conducted between perceived in-hospital stress, using the HSQ-55, and both parts of the EQ-5D. The HSQ-55 asks questions pertaining to the in-hospital period (“during your hospital stay”), while the EQ-5D was adapted to pertain to the post-hospital period (“in the two weeks after being discharged from hospital”). A medium-sized, negative association was found between the HSQ-55 and both the EQ-5D-5L index values (r = –0.35, p < 0.001) and the EQ VAS (r = –0.32, p < 0.001), implying that as in-hospital stress increases, post-hospital health-related quality of life and self-rated health decrease.
Test-retest reliability
The retest period was 14 days after the initial test. Test-retest reliability for the overall 55-item scale was excellent (ICC = 0.90, 95% CI = 0.81–0.95, p < 0.001). For the seven individual factors, ICC values ranged from 0.77–0.91, where each correlation was statistically significant (all p < 0.001), indicating “good” to “excellent” test-retest reliability.
Medium-length version (28 items)
It was deemed necessary to produce shorter versions of the HSQ, as a 55-item questionnaire may be burdensome for particularly vulnerable groups (e.g., older adults with dementia or delirium, who make up a large proportion of NHS patients) or in surveys which already include several other measures. To produce a medium-length version of the HSQ, the four highest loading items within each factor were selected (see Table 3). Cronbach’s alpha was good for the overall scale (α = 0.94), and for each of the seven factors (0.71–0.88). The HSQ-28 also showed good convergent validity (r = 0.70), known-groups validity (planned (M = 89.2), unplanned (M = 113.2), t (449.6) = –6.28, p < 0.001), predictive validity (EQ-5D-5L: r = –0.35; EQ VAS: r = –0.32), and test-retest reliability (ICC = 0.87, 95% CI = 0.76–0.94).
Short version (10 items)
A short version was also produced by selecting the ten items of the HSQ-55 with the highest corrected item-total correlations (see [46,47]). Within these ten items, all seven factors were represented (one item from each of factors 2–7, and four items from factor 1; see Table 4). The HSQ-10 showed good internal consistency (α = 0.91), convergent validity (r = 0.68), known-groups validity (planned (M = 33.6), unplanned (M = 44.2), t (458.5) = –6.16, p < 0.001), predictive validity (EQ-5D-5L: r = –0.32; EQ VAS: r = –0.30), and test-retest reliability (ICC = 0.90, 95% CI = 0.80–0.95).
4. Discussion
The current study explored the psychometric properties of the HSQ, including reliability, validity, and factor structure. This was accomplished via a retrospective survey, completed by a diverse and representative sample of 660 recent inpatients. Results show that the measure is a valid and reliable tool for quantifying in-hospital psychological stress and is ready for use in future research – although it is yet to be tested on current inpatients. Item reduction, from an exploratory factor analysis, led to three versions of the HSQ being developed (55-item long version; 28-item medium version; 10-item short version), where each has been shown to have good psychometric properties.
The EFA also identified seven latent factors, each with an acceptable level of internal consistency, forming the subscales of the HSQ: quality of care, away from home, inconvenienced, health anxiety, negative effects of treatment, ward environment, and disrupted patient experience. Previous, similar in-hospital stress measures (HSRS [15], HSI [16], HRSQ-EP [17]) have produced comparable factors. Most, if not all, have a factor relating to the hospital environment (HSQ: ward environment), a change in lifestyle (HSQ: away from home), health-related fears (HSQ: health anxiety), difficulties with treatment (HSQ: negative effects of treatment), and a factor relating to the care received from hospital staff (HSQ: quality of care). The current measure introduced two new factors: being inconvenienced, and having a disrupted patient experience. The individual items and factors within the HSQ are capable of identifying clear areas of focus for improvement within the hospital setting, paving the way for future studies and policy decisions to improve the experience of hospitalisation.
Individual items were also examined, the highest scoring of which was “Not sleeping well”. In a recent study, patients reported significant decline in sleep quality and quantity while in hospital, and these problems persisted for more than three months post-discharge [48]. Sleep disruptions in hospital such as early morning phlebotomy [49] and overnight NEWS observations [50] remain high, despite sleep loss in hospital being associated with cardio-metabolic derangements and an increased risk of delirium [51]. Other hospital-related stressors that were rated highly in the current study, such as pain (“Having pain or discomfort from your treatment”) and noise (“Staying in a noisy room”), can exacerbate the problem of sleep disruption, leading to the risk of deleterious effects in immune function, wound healing, and mental health [52,53].
As seen above, Goldwater and colleagues [2] predicted problems with sleep and pain in their list of five hospital-related stressors: sleep disruptions, malnourishment and dehydration, mobility restriction, pain, and distressing environment and events. However, items in the HSQ that were designed to capture malnourishment (HSQ: “The food being bad or not meeting your dietary requirements”), dehydration (HSQ: “Not getting enough to drink”), and mobility restriction (HSQ: “Feeling like you could not leave your bed or ward”) were reported as relatively low-ranking stressors in the current study. Goldwater’s list is heavily weighted towards physiological stressors, and so is lacking in psychological (HSQ: “Feeling helpless or not in control”) and environmental factors (HSQ: “Feeling like you had no privacy”). Such stressors comprised the majority of high-ranking items in the HSQ, and ought to be acknowledged more in the post-hospital syndrome literature. For example, feelings of helplessness and not being in control was the second highest ranking item, and yet there is a paucity of research on this topic (see [54–56]).
It is clear that the hospital environment is acutely stressful, and aspects of the inpatient experience may not be conducive to a patient’s recovery. Therefore, the authors recommend that interventions be designed to address the stressors rated most salient by patients in the current study, first and foremost of these is disrupted sleep, which leads to adverse effects both indirectly (via allostatic overload and post-hospital syndrome) and directly (see [57] for effects of sleep loss on recovery, and steps recommended to improve sleep in hospitals). Secondly, the HSQ may be used in future studies or clinical practice as an indicator of which patients may be most susceptible to the effects of post-hospital syndrome.
Limitations
Several limitations were apparent within the current study. First, the representativeness of the sample is limited, due to the majority of the cohort being recruited via Prolific; a research participant platform. Notably, the current sample was more educated than the general public, and was lacking in participants aged over 80 years, a population which made up approximately 20% of NHS inpatients in 2022–23 (NHS Digital, 2023). Secondly, the retrospective nature of the current study raises concerns about the accuracy of the results, as it relies on the participant’s ability to recall events from up to one year ago. Nevertheless, it is worth noting that issues relating to recall, if at play, are likely to have led to evidence of weaker psychometric properties than those observed here. Additionally, the predictive validity reported may be questioned by some, as the survey design was cross-sectional. Therefore, the authors suggest that future research addresses some of these limitations by employing the HSQ in hospitals to current inpatients, and adopting a longitudinal design to better assess the predictive validity of the measure with a battery of health outcomes.
5. Conclusion
The HSQ exhibits excellent reliability and validity, and an appropriate factor structure was identified. Three versions of the measure are available for use (short, medium, and long), each with acceptable psychometric properties. The HSQ may be used to justify and assess the effectiveness of interventions to reduce in-hospital stress, or to identify patients most at risk of experiencing post-hospital syndrome. However, the measure is yet to be tested on current inpatients, and further research is required to support the tool’s ability to predict post-hospital adverse events and self-rated health.
References
- 1. Krampe H, Denke C, Gülden J, Mauersberger V-M, Ehlen L, Schönthaler E, et al. Perceived severity of stressors in the intensive care unit: a systematic review and semi-quantitative analysis of the literature on the perspectives of patients, health care providers and relatives. J Clin Med. 2021;10(17):3928. pmid:34501376
- 2. Goldwater D, Dharmarajan K, McEwan B, Krumholz H. Is posthospital syndrome a result of hospitalization-induced allostatic overload?. Journal of Hospital Medicine. 2018;13(5).
- 3. Detsky AS, Krumholz HM. Reducing the trauma of hospitalization. JAMA. 2014;311(21):2169–70.
- 4. Zengin N, Ören B, Üstündag H. The relationship between stressors and intensive care unit experiences. Nurs Crit Care. 2020;25(2):109–16. pmid:31407452
- 5. Andrade C, Devlin A. Stress reduction in the hospital room: Applying Ulrich’s theory of supportive design. J Environ Psychol. 2015;41(1):125–34.
- 6. McEwen BS. Redefining neuroendocrinology: Epigenetics of brain-body communication over the life course. Frontiers in Neuroendocrinology. 2018;49(1):8–30.
- 7. Guidi J, Lucente M, Sonino N, Fava GA. Allostatic load and its impact on health: a systematic review. Psychother Psychosom. 2021;90(1):11–27. pmid:32799204
- 8. O’Connor DB, Thayer JF, Vedhara K. Stress and health: A review of psychobiological processes. Annu Rev Psychol. 2021;72:663–88. pmid:32886587
- 9. Dharmarajan K, Krumholz HM. Strategies to Reduce 30-Day Readmissions in Older Patients Hospitalized with Heart Failure and Acute Myocardial Infarction. Curr Geriatr Rep. 2014;3(4):306–15. pmid:25431752
- 10. Edmondson D, Green P, Ye S, Halazun HJ, Davidson KW. Psychological stress and 30-day all-cause hospital readmission in acute coronary syndrome patients: an observational cohort study. PLoS One. 2014;9(3):e91477. pmid:24621575
- 11. Ford D, Budworth L, Lawton R, Teale E, O’Connor D. In-hospital stress and patient outcomes: a systematic review and meta-analysis. PLOS ONE. 2023;18(3):e0282789.
- 12. Krumholz H. Post-hospital syndrome–a condition of generalized risk. The New England J Medicine. 2013;368(2):100.
- 13. Rawal S, Kwan JL, Razak F, Detsky AS, Guo Y, Lapointe-Shaw L, et al. Association of the trauma of hospitalization with 30-day readmission or emergency department visit. JAMA Intern Med. 2019;179(1):38–45. pmid:30508018
- 14. Ford DM, Lawton R, Travis E, Teale EA, O’Connor DB. Development and initial validation of a hospital stress questionnaire. Health Psychol Behav Med. 2024;12(1):2396135. pmid:39219596
- 15. Volicer BJ, Bohannon MW. A hospital stress rating scale. Nurs Res. 1975;24(5):352–9. pmid:1041618
- 16. Koenig HG, George LK, Stangl D, Tweed DL. Hospital stressors experienced by elderly medical inpatients: developing a hospital stress index. Int J Psychiatry Med. 1995;25(1):103–22. pmid:7649715
- 17. Musavi Z, Alavi M, Alimohammadi N, Hosseini H. Development and initial psychometric evaluation of the hospitalization-related stressors questionnaire for elderly patients. Iran J Nurs Midwifery Res. 2016;21(5):516–20. pmid:27904637
- 18. Costello AB, Osborne J. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical assessment, research, and evaluation. 2019;10(1):7.
- 19.
Nunnally JC. Psychometric theory. 3rd ed. New York: McGraw-Hill; 1994.
- 20. Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–63. pmid:27330520
- 21. Teitcher JEF, Bockting WO, Bauermeister JA, Hoefer CJ, Miner MH, Klitzman RL. Detecting, preventing, and responding to “fraudsters” in internet research: ethics and tradeoffs. J Law Med Ethics. 2015;43(1):116–33. pmid:25846043
- 22. Silverstein P, Pennington C, Branney P, O’Connor D, Lawlor E, O’Brien E, et al. A registered report survey of open research practices in psychology departments in the UK and Ireland. British Journal of Psychology. 2024.
- 23. Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav. 1983;24(4):385–96. pmid:6668417
- 24. Lee E-H. Review of the psychometric evidence of the perceived stress scale. Asian Nurs Res (Korean Soc Nurs Sci). 2012;6(4):121–7. pmid:25031113
- 25.
Cohen S. Perceived stress in a probability sample of the United States. The social psychology of health. Thousand Oaks, CA, US: Sage Publications, Inc.; 1988.
- 26. Brooks R, Group E. EuroQol: The current state of play. Health policy. 1996;37(1):53–72.
- 27. Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20(10):1727–36. pmid:21479777
- 28. Feng YS, Kohlmann T, Janssen MF, Buchholz I. Psychometric properties of the EQ-5D-5L: a systematic review of the literature. Qual Life Res. 2021;30(3):647–73. pmid:33284428
- 29. Watkins MW. Exploratory Factor Analysis: A Guide to Best Practice. Journal of Black Psychology. 2018;44(3):219–46.
- 30. Bartlett MS. Tests of significance in factor analysis. Br J Stat Psychol. 1950;3(2):77–85.
- 31. Kaiser HF. An index of factorial simplicity. Psychometrika. 1974;39(1):31–6.
- 32. Horn JL. A rationale and test for the number of factors in factor analysis. Psychometrika. 1965;30:179–85. pmid:14306381
- 33. Velicer WF. Determining the number of components from the matrix of partial correlations. Psychometrika. 1976;41(3):321–7.
- 34. Cattell RB. The scree test for the number of factors. Multivariate Behav Res. 1966;1(2):245–76. pmid:26828106
- 35. Kaiser HF. The application of electronic computers to factor analysis. Educational and Psychological Measurement. 1960;20(1):141–51.
- 36. Jennrich RI, Sampson PF. Rotation for simple loadings. Psychometrika. 1966;31(3):313–23. pmid:5221128
- 37.
Hair J, Black W, Babin B, Anderson R. Multivariate data analysis. Person: London, UK; 2010.
- 38. Tavakol M, Dennick R. Making sense of cronbach’s alpha. Int J Med Educ. 2011;2:53–5. pmid:28029643
- 39. Cohen J. A power primer. Psychol Bull. 1992;112(1):155–9. pmid:19565683
- 40. Hospital admitted patient care and adult critical care activity 2022-23. Available from: https://digital.nhs.uk/data-and-information/publications/statistical/hospital-admitted-patient-care-activity/2022-23. 2023.
- 41. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16(3):297–334.
- 42. Briggs SR, Cheek JM. The role of factor analysis in the development and evaluation of personality scales. J Personality. 1986;54(1):106–48.
- 43. Clark L, Watson D. Constructing validity: Basic issues in objective scale development. J Consulting and Clinical Psychology. 1995;7(3):309–19.
- 44.
Streiner DL, Norman GR, Cairney J. Health measurement scales: A practical guide to their development and use. Oxford university press; 2024.
- 45.
Field A. Discovering statistics using IBM SPSS statistics. Sage publications limited. 2024.
- 46. Louch G, Reynolds C, Moore S, Marsh C, Heyhoe J, Albutt A, et al. Validation of revised patient measures of safety: PMOS-30 and PMOS-10. BMJ Open. 2019;9(11):e031355.
- 47. Marteau TM, Bekker H. The development of a six-item short-form of the state scale of the Spielberger State-Trait Anxiety Inventory (STAI). Br J Clin Psychol. 1992;31(3):301–6. pmid:1393159
- 48. Willinger CM, Waddell KJ, Arora V, Patel MS, Ryan Greysen S. Patient-reported sleep and physical function during and after hospitalization. Sleep Health. 2024;10(2):249–54. pmid:38151376
- 49. Caraballo C, Mahajan S, Murugiah K, Mortazavi BJ, Lu Y, Khera R, Krumholz HM. Timing of blood draws among patients hospitalized in a large academic medical center. JAMA. 2023;329(3):255–7.
- 50. Hope J, Recio-Saucedo A, Fogg C, Griffiths P, Smith GB, Westwood G, et al. A fundamental conflict of care: Nurses’ accounts of balancing patients’ sleep with taking vital sign observations at night. J Clin Nurs. 2018;27(9–10):1860–71. pmid:29266489
- 51. Stewart NH, Arora VM. Sleep in hospitalized older adults. Sleep Med Clin. 2022;17(2):223–32. pmid:35659075
- 52. Kamdar BB, Needham DM, Collop NA. Sleep deprivation in critical illness: its role in physical and psychological recovery. J Intensive Care Med. 2012;27(2):97–111. pmid:21220271
- 53. Stewart N, Arora V. Let’s not sleep on it: Hospital sleep is a health issue too. Joint Commission Journal on Quality and Patient Safety. 2021;47(6):337–9.
- 54. Douglas CH, Douglas MR. Patient-centred improvements in health-care built environments: Perspectives and design indicators. Health Expect. 2005;8(3):264–76. pmid:16098156
- 55. Taylor S. Hospital patient behavior: Reactance, helplessness, or control. Journal of Social Issues. 1979;35(1):156–84.
- 56. Williams AM, Dawson S, Kristjanson LJ. Exploring the relationship between personal control and the hospital environment. J Clin Nurs. 2008;17(12):1601–9. pmid:18482122
- 57. Hillman DR. Sleep loss in the hospitalized patient and its influence on recovery from illness and operation. Anesth Analg. 2021;132(5):1314–20. pmid:33857973