Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Exploring the association between patient satisfaction and hospital quality in the United States

  • Sora Kang,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing

    Affiliation Florida State University College of Medicine, Tallahassee, Florida, United States of America

  • Huazhi Liu,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Software, Validation, Writing – review & editing

    Affiliation HCA Florida Ocala Hospital, Ocala, Florida, United States of America

  • Charles Ledonio,

    Roles Project administration, Writing – review & editing

    Affiliation University of Central Florida, Orlando, Florida, United States of America

  • Darwin Ang

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Writing – original draft, Writing – review & editing

    darwin.ang@hcahealthcare.com, darwin.ang@surgery.ufl.edu

    Affiliations Florida State University College of Medicine, Tallahassee, Florida, United States of America, HCA Florida Ocala Hospital, Ocala, Florida, United States of America, University of Central Florida, Orlando, Florida, United States of America

Abstract

Background

Patient experience is increasingly used as a public quality metric, but its relationship to hospital safety grades remains incompletely characterized because patient reported experience and technical safety measures capture different dimensions of care.

Methods

We performed a retrospective cross-sectional analysis of publicly available hospital level data from 2023. Leapfrog Hospital Safety Grades were linked with Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) patient experience scores. The linked dataset included 1,442 U.S. hospitals; 1,390 hospitals with letter grades A through F were included in grade stratified and regression analyses. HCAHPS domains were analyzed on a 1–5 scale, with higher scores indicating more favorable patient reported experience. One way ANOVA compared mean HCAHPS scores across Leapfrog grades. Multivariable logistic regression with hospital size adjustment evaluated HCAHPS domains associated with Leapfrog Grade A versus grades B through F.

Results

Mean HCAHPS domain scores declined across most domains as Leapfrog grades worsened from A to F. In multivariable analysis, nurse communication was associated with higher odds of receiving a Grade A safety rating (odds ratio [OR] 1.54, 95% confidence interval [CI] 1.11 to 2.13; p = 0.01), as was the hospital recommendation score (OR 1.54, 95% CI 1.15 to 2.06; p = 0.004). Doctor communication showed an inverse conditional association (OR 0.75, 95% CI 0.59 to 0.97; p = 0.03). Other HCAHPS domains were not independently associated with Grade A after adjustment.

Conclusions

Hospitals with higher Leapfrog safety grades generally had more favorable patient reported experience scores, and nurse communication and hospital recommendation were the most clinically interpretable independent predictors of Grade A status. The inverse association for doctor communication should be interpreted cautiously because HCAHPS domains are correlated and the analysis used hospital level cross-sectional data. These findings support the complementary role of patient experience in hospital quality assessment but do not establish causality.

Introduction

Healthcare quality is commonly understood as the delivery of safe, effective, timely, efficient, equitable, and patient centered care. In the United States, these dimensions are measured through a fragmented ecosystem of public and private quality programs, each emphasizing different aspects of hospital performance [1,2]. Patient centered care has therefore become an important component of quality measurement because it captures domains of care that may not be reflected by mortality, readmission, infection, or process measures alone [3].

HCAHPS provides a national, standardized, publicly reported measure of hospitalized patients’ experiences, including communication with nurses and physicians, staff responsiveness, communication about medications, discharge information, care transitions, cleanliness, quietness, overall hospital rating, and willingness to recommend the hospital. Prior national work has shown that hospitals can provide both strong clinical care and favorable patient experience, and systematic reviews have found positive associations between patient experience, patient safety, and clinical effectiveness across multiple settings [4,5]. Other studies have found that patient experience surveys can complement technical quality measures, but the magnitude and consistency of these relationships vary by outcome, hospital type, patient population, and measurement strategy [610].

Hospital safety ratings are also heterogeneous. The Leapfrog Hospital Safety Grade was developed as a composite patient safety score using multiple safety indicators, but public hospital ratings systems often disagree because they use different measures, weights, data sources, and inclusion criteria [11,12]. In addition, studies of Leapfrog related measures have raised concerns about voluntary reporting, self-reported components, and imperfect alignment with other publicly reported quality measures [13,14]. These concerns do not make Leapfrog grades invalid; rather, they underscore that Leapfrog safety grades and HCAHPS patient experience scores are related but nonidentical indicators of hospital performance.

The current literature therefore leaves a practical question for hospital leaders and quality teams. Specifically, which HCAHPS domains are most closely associated with top tier hospital safety grades when multiple patient experience domains are considered simultaneously? Prior work has emphasized the importance of communication, particularly nursing and physician communication, but studies vary in their adjustment strategies and quality endpoints [1518]. Understanding these associations may help identify patient experience domains that are most aligned with broader safety and quality performance while also clarifying the limitations of using patient satisfaction as a proxy for clinical quality.

The objective of this study was to evaluate the association between HCAHPS patient experience domains and Leapfrog Hospital Safety Grades in a national sample of U.S. hospitals. We hypothesized that higher patient experience scores would be associated with higher Leapfrog safety grades, but that individual HCAHPS domains would differ in their independent associations after adjustment for hospital size.

Methods

Study design and data sources

This was a retrospective cross-sectional study using publicly available, de-identified, hospital level data from 2023. Leapfrog Hospital Safety Grades were linked with HCAHPS patient experience measures. Because all data were publicly available and de-identified at the hospital level, no patient level information was accessed and institutional review board review was not required under our institutional policy.

The linked dataset included 1,442 U.S. hospitals. Leapfrog grades were distributed as follows: A, 407 hospitals; B, 312 hospitals; C, 573 hospitals; D, 91 hospitals; F, 7 hospitals; no grade, 11 hospitals; and not available, 41 hospitals. Hospitals with no grade or not available Leapfrog status were included only in descriptive data source accounting and were excluded from grade stratified and regression analyses. The final analytic sample for comparisons across A through F grades was therefore 1,390 hospitals.

Variables and measures

The primary hospital quality outcome was Leapfrog Grade A versus all other graded hospitals, B through F. This dichotomization was selected because Grade A represents a readily interpretable top tier safety benchmark for consumers, quality leaders, and hospital administrators. We also reported the full grade distribution to make the implications of this dichotomization transparent. HCAHPS domains were analyzed as hospital level 1–5 scores, with higher values indicating more favorable patient-reported experience. Domains included overall hospital rating, nurse communication, doctor communication, staff responsiveness, communication about medicines, discharge information, care transition, cleanliness, quietness, and recommend hospital. Hospital size, measured as staffed beds, was included as an adjustment variable.

Statistical analysis

Descriptive statistics summarized hospital grade distribution and HCAHPS domain scores. Mean HCAHPS scores were compared across Leapfrog grade categories using one-way ANOVA; the associated F-test evaluated whether mean HCAHPS scores differed across more than two grade groups. Because Leapfrog grade is categorical/ordinal, descriptive figures were not used to generate trendline derived R-squared values. Multivariable logistic regression was used to estimate the association between HCAHPS domains and Leapfrog Grade A status. Odds ratios, 95% confidence intervals, and p values were reported. The model included all HCAHPS domains and staffed beds. Statistical significance was defined as p < 0.05. Because the HCAHPS domains are conceptually and statistically correlated, model coefficients were interpreted as conditional associations rather than causal effects.

Results

The linked dataset included 1,442 hospitals, of which 1,390 had Leapfrog grades A through F and were included in grade stratified and regression analyses. Among graded hospitals, 407 (29.3%) had Grade A, 312 (22.4%) had Grade B, 573 (41.2%) had Grade C, 91 (6.5%) had Grade D, and 7 (0.5%) had Grade F.

Across nearly all HCAHPS domains, mean scores decreased as Leapfrog grades worsened from A to F (Table 1; Fig 1). For example, the mean overall hospital rating was 3.337 among Grade A hospitals, 3.119 among Grade B hospitals, 2.770 among Grade C hospitals, 2.198 among Grade D hospitals, and 1.571 among Grade F hospitals. Similarly, mean nurse communication scores decreased from 3.518 among Grade A hospitals to 2.143 among Grade F hospitals, and recommend hospital scores decreased from 3.794 to 1.857.

thumbnail
Table 1. Mean HCAHPS domain scores by Leapfrog Hospital Safety Grade.

https://doi.org/10.1371/journal.pone.0352756.t001

thumbnail
Fig 1. Mean HCAHPS domain scores by Leapfrog Hospital Safety Grade.

Heatmap shows hospital level mean HCAHPS scores on a 1 to 5 scale, with higher values indicating more favorable patient reported experience. No trendline derived R-squared values are shown because Leapfrog grade is categorical/ordinal.

https://doi.org/10.1371/journal.pone.0352756.g001

State level HCAHPS summary star ratings varied across the analytic dataset (Table 2; Fig 2). Because state sample sizes differed substantially, including small numbers of hospitals in several states, these state level values were interpreted descriptively and were not used as stand alone evidence of state quality differences.

thumbnail
Table 2. State-level distribution of HCAHPS summary star ratings in the linked dataset.

https://doi.org/10.1371/journal.pone.0352756.t002

thumbnail
Fig 2. State level variation in mean HCAHPS summary star rating.

Tile map shows state level mean summary star ratings with the number of hospitals in each state shown within the tile. Values should be interpreted descriptively because state sample sizes varied and several states had small numbers of linked hospitals.

https://doi.org/10.1371/journal.pone.0352756.g002

In the multivariable logistic regression model, nurse communication was associated with higher odds of achieving Leapfrog Grade A (OR 1.54, 95% CI 1.11 to 2.13; p = 0.01), as was recommend hospital rating (OR 1.54, 95% CI 1.15 to 2.06; p = 0.004) (Table 3; Fig 3). Doctor communication had an inverse conditional association with Grade A status (OR 0.75, 95% CI 0.59 to 0.97; p = 0.03). Overall hospital rating, staff responsiveness, communication about medicines, discharge information, care transition, cleanliness, and quietness were not independently associated with Grade A status after adjustment. Staffed beds had a statistically significant but very small association with Grade A status (OR 1.001, 95% CI 1.000 to 1.001; p = 0.03), suggesting limited practical importance.

thumbnail
Table 3. Multivariable logistic regression model predicting Leapfrog Grade A.

https://doi.org/10.1371/journal.pone.0352756.t003

thumbnail
Fig 3. Multivariable associations between HCAHPS domains and Leapfrog Grade A. Forest plot shows odds ratios and 95% confidence intervals for Leapfrog Grade A versus grades B through F. The model included all HCAHPS domains and staffed beds.

https://doi.org/10.1371/journal.pone.0352756.g003

Discussion

In this national hospital level analysis, higher Leapfrog Hospital Safety Grades were generally accompanied by more favorable HCAHPS patient experience scores. The strongest descriptive gradients were observed across overall hospital rating, nurse communication, discharge information, care transition, cleanliness, and recommend hospital scores. In the adjusted model, nurse communication and recommend hospital rating were the most clinically interpretable HCAHPS domains associated with Grade A safety status. These findings support the concept that patient experience and technical safety performance are not isolated constructs; instead, they may reflect overlapping features of hospital culture, communication, reliability, and organizational performance.

Our findings are consistent with prior work suggesting that patient experience is linked to clinical safety and effectiveness, although the relationship is neither universal nor causal [57]. National surgical studies have similarly reported associations between patient satisfaction and some objective quality indicators, including mortality, failure to rescue, process performance, and resource use [810]. The present analysis extends this literature by examining multiple HCAHPS domains against Leapfrog Hospital Safety Grades in a national sample.

Nurse communication emerged as an important predictor of Grade A safety status. This finding is clinically plausible because nurses are the most continuous bedside interface between patients and the hospital system. Nursing communication may reflect not only interpersonal skill but also staffing, care coordination, medication explanation, discharge preparation, and responsiveness to patient concerns. Prior HCAHPS focused literature has identified communication as a recurrent driver of patient satisfaction, and nursing communication frameworks emphasize listening, empathy, clarity, and individualized interaction as central elements of effective care [15,16].

The inverse adjusted association between doctor communication and Grade A status deserves caution. This result should not be interpreted as evidence that poorer physician communication improves hospital safety. Prior literature generally supports positive relationships between effective physician communication, adherence, satisfaction, and health outcomes [17,18]. A more likely explanation is both statistical and contextual. HCAHPS domains are highly correlated, and when multiple overlapping patient experience domains are entered into the same model, coefficient direction can change because of multicollinearity or suppression effects. In addition, physician communication may be influenced by case complexity, patient expectations, duration and frequency of contact, rounding structures, health literacy mismatch, and hospital workflow. The result is therefore best viewed as a conditional association that requires further study rather than a clinically actionable negative finding.

The broad hospital recommendation score was also independently associated with Grade A. This domain likely integrates multiple dimensions of the patient experience, including perceived communication, trust, coordination, cleanliness, comfort, and confidence in the hospital. Because recommendation scores are global and subjective, they should not replace technical safety measures. However, the association with Grade A status suggests that patients’ overall appraisal of the hospitalization may capture a meaningful signal about organizational performance.

The use of Leapfrog grades as the outcome also requires careful interpretation. The Leapfrog composite safety score was developed to synthesize multiple safety indicators into a consumer facing measure [11]. However, studies comparing hospital rating systems have shown substantial discordance among public rating programs, and Leapfrog related measures may be influenced by reporting structure and voluntary components [1214]. For this reason, our findings should be interpreted as associations with one prominent safety grade system rather than definitive evidence of overall hospital quality.

From a practical standpoint, the findings suggest that hospitals seeking to improve both patient experience and quality performance should not treat HCAHPS as a customer service exercise alone. Communication, especially nursing communication, may be part of a broader reliability infrastructure that affects patient understanding, escalation of concerns, discharge readiness, and confidence in care. Interventions such as structured interdisciplinary bedside rounding, teaching, empathy training, and standardized discharge communication may be reasonable targets, but future prospective studies are needed to determine whether improving these domains changes safety grade performance or simply reflects hospitals that are already performing well.

Finally, statistical significance should be interpreted alongside clinical importance. In large hospital level datasets, small differences can become statistically significant, especially when domain scores are highly correlated. The staffed bed association in this study, for example, was statistically significant but had little practical interpretability. Similarly, the negative physician communication result should be interpreted in the context of effect size, model structure, and external clinical knowledge [19].

This study has several limitations. First, the cross-sectional, hospital level design precludes causal inference. The results cannot definitively establish that improved patient experience causes better Leapfrog grades or that safety grade performance causes better patient experience. Second, the analysis is ecological and hospital level averages cannot determine whether individual patients who reported better experiences received safer or higher quality care.

Third, the public datasets did not provide sufficient patient level, community level, or hospital structural covariates to adjust for case mix, socioeconomic status, teaching status, ownership, system affiliation, payer mix, local post-acute care access, or neighborhood deprivation. Prior HCAHPS studies have shown that survey mode, patient mix, response rates, and hospital size can influence HCAHPS results [20,21]. Fourth, Leapfrog participation and reporting may introduce selection bias, and Leapfrog grades may not align perfectly with other hospital quality rating systems [1214]. In addition, although state-level HCAHPS variation was described, the multivariable model did not include state fixed effects; residual geographic confounding may remain. Fifth, the decision to dichotomize Leapfrog Grade A versus all other grades improves interpretability but loses ordinal information. The full grade distribution was therefore reported, and future analyses could consider ordinal or multinomial models if model assumptions and sample sizes are adequate. Sixth, HCAHPS domains are highly correlated, which can make multivariable coefficients sensitive to collinearity and suppressor effects. This is particularly relevant to the inverse doctor communication association. Finally, HCAHPS scores reflect patient reported experience, not direct measures of morbidity, mortality, adverse events, or clinical process adherence. Patient experience is an important component of quality, but it should be interpreted as complementary to, rather than interchangeable with, technical quality and safety measures.

Conclusions

In this national hospital level analysis, higher Leapfrog safety grades were generally associated with higher patient reported experience scores. In adjusted models, nurse communication and hospital recommendation were the most clinically interpretable HCAHPS domains associated with Leapfrog Grade A status. The inverse conditional association observed for doctor communication should be interpreted cautiously and should not be understood as evidence that physician communication is not important for patient safety. These findings support patient experience as a meaningful but imperfect complement to hospital safety metrics and underscore the need for a comprehensive dataset with benchmarks that rigorously captures both patient safety and satisfaction simultaneously.

References

  1. 1. Allen-Duck A, Robinson JC, Stewart MW. Healthcare quality: a concept analysis. Nurs Forum. 2017;52(4):377–86. pmid:28407249
  2. 2. Moses H 3rd, Matheson DHM, Dorsey ER, George BP, Sadoff D, Yoshimura S. The anatomy of health care in the United States. JAMA. 2013;310(18):1947–63. pmid:24219951
  3. 3. Bokhour BG, Fix GM, Mueller NM, Barker AM, Lavela SL, Hill JN, et al. How can healthcare organizations implement patient-centered care? Examining a large-scale cultural transformation. BMC Health Serv Res. 2018;18(1):168. pmid:29514631
  4. 4. Jha AK, Orav EJ, Zheng J, Epstein AM. Patients’ perception of hospital care in the United States. N Engl J Med. 2008;359(18):1921–31. pmid:18971493
  5. 5. Doyle C, Lennox L, Bell D. A systematic review of evidence on the links between patient experience and clinical safety and effectiveness. BMJ Open. 2013;3(1):e001570. pmid:23293244
  6. 6. Anhang Price R, Elliott MN, Zaslavsky AM, Hays RD, Lehrman WG, Rybowski L, et al. Examining the role of patient experience surveys in measuring health care quality. Med Care Res Rev. 2014;71(5):522–54. pmid:25027409
  7. 7. Isaac T, Zaslavsky AM, Cleary PD, Landon BE. The relationship between patients’ perception of care and measures of hospital quality and safety. Health Serv Res. 2010;45(4):1024–40. pmid:20528990
  8. 8. Tsai TC, Orav EJ, Jha AK. Patient satisfaction and quality of surgical care in US hospitals. Ann Surg. 2015;261(1):2–8. pmid:24887985
  9. 9. Sacks GD, Lawson EH, Dawes AJ, Russell MM, Maggard-Gibbons M, Zingmond DS, et al. Relationship between hospital performance on a patient satisfaction survey and surgical quality. JAMA Surg. 2015;150(9):858–64. pmid:26108091
  10. 10. Lyu H, Wick EC, Housman M, Freischlag JA, Makary MA. Patient satisfaction as a possible indicator of quality surgical care. JAMA Surg. 2013;148(4):362–7. pmid:23715968
  11. 11. Austin JM, D’Andrea G, Birkmeyer JD, Leape LL, Milstein A, Pronovost PJ, et al. Safety in numbers: the development of Leapfrog’s composite patient safety score for U.S. hospitals. J Patient Saf. 2014;10(1):64–71. pmid:24080719
  12. 12. Austin JM, Jha AK, Romano PS, Singer SJ, Vogus TJ, Wachter RM, et al. National hospital ratings systems share few common scores and may generate confusion instead of clarity. Health Aff (Millwood). 2015;34(3):423–30. pmid:25732492
  13. 13. Smith SN, Reichert HA, Ameling JM, Meddings J. Dissecting leapfrog: how well do leapfrog safe practices scores correlate with hospital compare ratings and penalties, and how much do they matter? Med Care. 2017;55(6):606–14. pmid:28288072
  14. 14. Hwang W, Derk J, LaClair M, Paz H. Hospital patient safety grades may misrepresent hospital performance. J Hosp Med. 2014;9(2):111–5. pmid:24420641
  15. 15. Mazurenko O, Collum T, Ferdinand A, Menachemi N. Predictors of hospital patient satisfaction as measured by HCAHPS: a systematic review. J Healthc Manag. 2017;62(4):272–83. pmid:28683051
  16. 16. O’Hagan S, Manias E, Elder C, Pill J, Woodward-Kron R, McNamara T, et al. What counts as effective communication in nursing? Evidence from nurse educators’ and clinicians’ feedback on nurse interactions with simulated patients. J Adv Nurs. 2014;70(6):1344–55. pmid:24224663
  17. 17. Stewart MA. Effective physician-patient communication and health outcomes: a review. CMAJ. 1995;152(9):1423–33. pmid:7728691
  18. 18. Riedl D, Schüßler G. The influence of doctor-patient communication on health outcomes: a systematic review. Z Psychosom Med Psychother. 2017;63(2):131–50. pmid:28585507
  19. 19. McGlothlin AE, Lewis RJ. Minimal clinically important difference: defining what really matters to patients. JAMA. 2014;312(13):1342–3. pmid:25268441
  20. 20. Elliott MN, Zaslavsky AM, Goldstein E, Lehrman W, Hambarsoomians K, Beckett MK, et al. Effects of survey mode, patient mix, and nonresponse on CAHPS hospital survey scores. Health Serv Res. 2009;44(2 Pt 1):501–18. pmid:19317857
  21. 21. Rodriguez-Homs LG, Hammill BG, Ryser MD, Phillips HR, Mosca PJ. Relationship between HCAHPS scores and survey response rate is linked to hospital size. J Patient Exp. 2020;7(6):1543–8. pmid:33457612