Exploring association between certified EHRs adoption and patient experience in U.S. psychiatric hospitals

Objective Certified Electronic Health Records (EHR) have been shown to improve the health service quality in some health settings, but there is scant evidence related to its adoption in psychiatric hospitals. This paper aimed to examine the relationship between certified EHR adoption and patient experience across psychiatric hospitals in the United States. Methods A cross-sectional study design compared the difference in patient experience measures between psychiatric hospitals with and without certified EHR. Data were drawn from the American Hospital Association (AHA) Annual Survey Database and Hospital Compare datasets. Eleven publicly reported measures for patient experience from the Consumer Assessment of Healthcare Providers and Systems Hospital Survey (HCAHPS) were applied for analysis. Independent relationship of certified EHR adoption and patient experience was explored with multiple linear regression models adjusted for hospital organizational characteristics. Results Positive associations were identified between certified EHR adoption and five patient perception measures—“recommend hospital” (β = 0.66, 95% CI = [0.16,1.16]; t = 2.68, p = 0.010), “overall hospital rating” (β = 0.39, 95% CI = [0.03,0.75]; t = 2.11, p = 0.035), “discharge information” (β = 0.45, 95% CI = [0.03,0.86]; t = 2.09, p = 0.037), “care transition” (β = 0.44, 95% CI = [0.14, 0.75]; t = 2.84, p = 0.005), and “responsiveness of hospital staff” (β = 0.47, 95% CI = [0.04, 0.90]; t = 2.13, p = 0.033). Conclusion Our results suggest the positive association between certified EHR adoption and patient experience. More studies are needed to explore impacts of certified EHR adoption and potential improvement in patient experience to quality of care.


Methods
A cross-sectional study design compared the difference in patient experience measures between psychiatric hospitals with and without certified EHR. Data were drawn from the American Hospital Association (AHA) Annual Survey Database and Hospital Compare datasets. Eleven publicly reported measures for patient experience from the Consumer Assessment of Healthcare Providers and Systems Hospital Survey (HCAHPS) were applied for analysis. Independent relationship of certified EHR adoption and patient experience was explored with multiple linear regression models adjusted for hospital organizational characteristics.

Results
Positive associations were identified between certified EHR adoption and five patient perception measures-"recommend hospital" (β = 0.66, 95% CI = [0. 16,1.16]; t = 2.68, p = 0.010), "overall hospital rating" (β = 0. 39 . [1] An unprecedented progress has been made in utilization of certified EHR in U.S. health settings and large numbers of studies have demonstrated its substantial influences on the quality, safety, and efficiency of health services. [2][3][4] However, psychiatric hospitals are ineligible for the financial incentive programs, and the rate of EHR adoption is noticeably lower among psychiatric hospitals [5,6] compared to other hospitals. While more than 80 percent of general hospitals adopted EHR by 2015, only 15 percent of psychiatric hospitals adopted at least a basic EHR system produced by different vendors. [7] There might be multiple barriers impeding adoption of certified EHR, including initial financial pressure of providers, narrative and non-structure feature of patient records, confidentiality of psychiatric care and stigma of mental illness. [8,9] Lag in certified EHR adoption among psychiatric hospitals might not only limit quality improvement of psychiatric care but also stymie efforts to achieve the targeted benefits, such as interoperability, across the health care continuum. [6,10] Therefore, it is necessary to identify the evidence to prove if certified EHR adoption has positive impacts to quality improvement and patient experience in psychiatric hospitals, and also if health policymakers should expand the incentive programs to psychiatric hospitals. According to prior published studies conducted in psychiatric settings, positive impacts of certified EHR utilization can be found on the therapeutic communications, [11,12] hospital readmission, [13] adverse drug events [14] and psychiatrist-patient relationship [15][16][17] as well as other quality measures [18][19][20] based on psychiatric patient or practitioner level instead of hospital level. A gap was identified with very limited literature in the relationship between patient experience and certified EHR adoption in psychiatric care using nationally representative data.
As more emphasis is placed on the concept of patient-centered care, patient experience has become the integral component to evaluate the health quality. Some studies have examined the impact of the EHR adoption on the patient satisfaction in general health settings. [21,22] However, previous findings about such relationship are mixed. Some studies suggested that EHR use could significantly improve patient experience [23][24][25] whereas other showed insignificant [26][27][28][29][30] or even inverse associations. [31,32] Additionally, most literature on the relationship between patient experience and EHR adoption were conducted in non-psychiatric settings. [9,[22][23][24][25][26][27][28]30] Due to the confidentiality and sensitive nature in psychiatric records, and the special reliance on information for psychiatric diagnosis and treatment, the findings of previous works in non-psychiatric hospitals may not apply equally to psychiatric hospitals. [17] The aim of this cross-sectional study is to examine the relationship between certified EHR adoption and patient experience at hospital level in psychiatric care setting in the U.S. We hypothesized that certified EHR use would positively influence the patient experience across psychiatric hospitals.

Data source and sample
This study was a cross-sectional, secondary analysis based on data from two primary databases which were open and publicly available: American Hospital Association (AHA) Annual Survey Database and the Centers for Medicare and Medicaid Services (CMS) Hospital Compare datasets. AHA Annual Survey Database provides the characteristics information for 6,251 hospitals, including teaching status, bed size, metropolitan status, ownership, system membership status, primary service classification, and length of stay. Hospital Compare datasets include information on the patient experience from the Consumer Assessment of Healthcare Providers and Systems Hospital Survey (HCAHPS) conducted in 4,806 hospitals during the period from April 1 st 2016 to March 31 st 2017. The HCAHPS survey is administered to a random sample of adult patients across medical conditions between 48 hours and 6 weeks after discharge. Hospital Compare datasets provide data on the adoption of certified EHR from the Inpatient Psychiatric Facility Quality Reporting (IPFQR) Program in 2016, with data for 1,655 psychiatric hospitals.
Using the Medicare identification number issued by the Medicare Administrative Contractor's (MAC) Provider Enrollment Department to a unique provider, data from different sources were merged into a master dataset. For the purpose of better assess the reliable of hospital performance from the HCAHPS survey, 649 hospitals that received fewer than 100 responses to HCAHPS surveys were excluded from the total 1,655 psychiatric hospitals in our analysis. The final study sample included 1,006 psychiatric hospitals with total 1,101,140 unique patients involved as respondents to the HCAHPS surveys from those hospitals. Because the information was anonymous and no personal information was collected, this study was exempt from requirement for institutional review board approval.

Certified EHR adoption and cohorts
In IPFQR Program, there was a structural measure evaluating the degree to which hospitals adopted certified EHR in health services. Hospitals were required to attest to one of three statements that best represented hospital's highest typical adoption of EHR: 1) Certified EHR technology (certified under the Office of the National Coordinator(ONC) for Health Information Technology (HIT) Certification Program) is employed most commonly to exchange health information at times of transitions in care; 2) Non-Certified EHR Technology (that is, not certified under the ONC HIT Certification Program) is used most commonly to transfer health information at times of transitions in care; 3) Paper or Other Form (for example, email) is the most common approach to conduct information exchange not involving the transfer of health information using EHR technology at times of transitions in care. The psychiatric hospitals choosing the first statement were included into observation group defined as hospitals with Certified EHR, whereas those responding with the second or third statement were categorized into a control group defined as hospitals with non-certified EHR. Only 20 hospitals using "non-certified EHR" in our dataset, which we combined with those hospitals using "Paper or Other Form" into the control group as "Paper-based/Non-Certified" (refers to without certified EHR).

Outcome measures of patient experience
There were 11 publicly reported measures for patient experience in HCAHPS database: communication with nurses, communication with doctors, responsiveness of hospital staff, pain management, communication about medicines, discharge information, care transition, cleanliness of hospital environment, quietness of hospital environment, overall hospital rating and recommend the hospital. Each measure was constructed from an individual item or composited based on two/three items on the HCAHPS survey which includes 25 items in total. A 0-100 linear-scaled score ("Linear Score") for each measure was calculated using a set of algorithms based on the responses to the survey items. [33,34] Details regarding the specifics of how these measures were constructed and how the "Linear Score" were calculated are available online at www.hcahpsonline.org/en/hcahps-star-ratings/.
We hypothesize that there will be positive associations between certified EHR adoption and those measures related to information communication: communication with nurses, communication with doctors, responsiveness of hospital staff, communication about medicines, discharge information, care transition, overall hospital rating and recommend the hospital.

Data analysis
Independent samples t-tests were employed to examine the statistic differences in patient experience between certified EHR adoption (coded as "1") and paper-based/non-certified EHR (coded as "0"). However, previous research have indicated that patient experience may potentially be correlated to hospital characteristics including ownership, [35,36] hospital location, [36,37] hospital bed size, [38,39] and teaching status [40]. To determine independent association between certified EHR adoption and outcome of patient perception, variables about hospital characteristics were entered into a multiple linear regression model that also accounted for significant correlations between variables. The regression model is given below/ was as follows.
All p values were 2-tailed and p < 0.05 was considered statistically significant. Data analyses were conducted using IBM SPSS statistical software program, version 24.0 (IBM SPSS, 2017).

Hospital characteristics and certified EHR adoption
Hospital organizational characteristics, presented by certified EHR adoption status, are summarized in Table 1. Of the 1,006 sampled psychiatric hospitals in the U.S., the majority were affiliated with the healthcare systems (71.3%), located in urban area (77.8%), and belong to teaching hospitals (61.7%); slightly more than half (51.4%) were non-government & non-profit entities. The majority (74.1%) had less than 400 beds.

Association of patient experience and certified EHR adoption
Among the 11 measures of patient experience, only two measures ("cleanliness" and "doctor communication") saw subtly but non-significantly lower scores in hospitals with certified EHR, whereas all other measures scored slightly higher in univariate analyses. Hospitals with certified EHR had significantly higher average scores in three measures of "recommend hospital" (Mean difference = 1.05; t = 4.0, p<0.001), "overall hospital rating' (Mean difference = 0.46; t = 2.5, p = 0.013), and "care transition" (Mean difference = 0.38; t = 3.1, p = 0.002) ( Table 1). In addition, Pearson's correlation analysis showed associations between certified EHR adoption and measures of patient experience including "care transition", "discharge information", "responsiveness of hospital staff", "overall hospital rating" and "recommendation" ( Table 2). Table 3 presents the results from multiple linear regression that test the association between patient experience and certified EHR adoption. Controlled for hospital organizational    t = 2.68, p = 0.010), and "overall hospital rating" (β = 0.39, 95% CI = [0.03,0.75]; t = 2.11, p = 0.035). These results almost remained consistent with those from univariate analysis. The adjusted R 2 values in all the five regression models indicated that those regression models had explained 4% to 22% of variance in each patient experience measure respectively (Table 3). In multivariate analysis, all multiple linear regression models had significant F tests, indicating the overall significance of the models.

Discussion
There is widespread agreement that the certified EHR is a lever to the care quality among hospitals which theoretically is helpful to improve service process and result in better patient experience. [9,41] Empirical evidence is needed to testify about the implications of certified EHR use on the patient experience in psychiatric hospitals. This study sought to explore association between certified EHR adoption and patient experience in U.S. psychiatric hospitals by assessing the disparities in patient perception between psychiatric hospitals with and without certified EHR. Results in this study revealed that certified EHR adoption is positively and significantly associated with several categories of patient experience elements.
Our results reveal that a higher level of patient satisfaction with care transition was found in psychiatric hospitals which have adopted of certified EHRs. According to the HCAHPS survey, highly scored satisfaction with care transition means that patients could understand better about their care when leaving hospitals, such as clearly understanding the purpose for taking each of their medications and their own responsibilities for managing their health. The implementation of certified EHR could lead to improvements in care information availability for patients and/or their families, [19,42] which may be beneficial and helpful for patients to better manage their care. Certified EHR may also help mental health providers take patients' preferences (and those of their families or caregivers) into account in deciding what patients' health care needs would be when patients were discharged [25]. In addition, certified EHR advance the data interoperability and promote sharing of information among providers, which potentially improve service coordination across different settings. [8] We also identified positive relationships between patient satisfaction with discharge information in hospitals adopting certified EHR. Compared to the information provided in a paper format, certified EHR adoption proved to be a more accurate, accessible and safer form of communication between patients and providers. It is critical for psychiatric patients and their families/caregivers to receive information about their health conditions and patient's care plan at the discharge. Safety features of certified EHR, such as storability of data and spell check, may provide patients with easier access to the correct health information after discharge. [25] In contrast, patients may be likely to be worried about illegibility of handwriting and reading information correctly in paper health records. [25,43,44] Also, EHR systems can provide easy and quick access to patients' data, such as test results and billings for multiple services and strategies, which is useful to improve availability of discharge information for patients.
Our study results showed that certified EHR adoption is positively related to the patient perception of the responsiveness of hospital staff. On the one hand, staff may be free from the manual task with digital technology and have more time for the attention to patient progress and subsequent problem solving; [45] on the other hand, certified EHR may assist mental health practitioners timely tracking the patient situation and behavior changes, manage risk with incident notification, and automatically remind staff of the upcoming events in the care plan [9]. All the efficient interaction between patients and mental health practitioners could potentially reduce their waiting time for services and thus improve their patient experience with responsiveness. Furthermore, hospitals with certified EHR embraced higher overall patient experience and were more likely to be recommended by patients to their friends and family members. These two comprehensive measures, "recommend hospital" and "overall hospital rating", were more robust to totally demonstrate the positive effect of certified EHR on the patient satisfaction than those individual measures above which showed consistent positive results.
Despite of results mentioned above, patient experience with interpersonal care, including doctor and nurse communication were not found significant difference between with and without certified EHR. These results were consistent with previous works that there was no relationship between EHR adoption and patient perceptions about patient-doctor communication. [30,46,47] Some prior relevant work even found that patient-doctor communication may be negatively impacted by EHR adoption, possibly due to less experience and comfort of mental health practitioners incorporating EHR technology into patient care, [25,31,48] as well as distraction to patients and reduction in eye-contact. [32] Those neutral or negative results remind that interpersonal care should be a focus to reduce the unexpected adverse effects of certified EHR adoption in psychiatric hospitals [49] as communication skills and psychodynamic interpretations are arguably more highlighted in psychiatric hospitals than in non-psychiatric settings.
In all, positive findings in this paper should lessen the concerns of psychiatric hospitals over potentially patient dissatisfaction because of adoption of certified EHR. To our knowledge, this is the first study that provides empirical evidence at hospital level using national data to support that policy makers should advocate incentive programs in psychiatric hospitals. Federal and state governments should expand the incentive program to psychiatric providers for the certified EHR adoption and sponsor to update certified EHR to meet the requirements of psychiatric privacy laws. [50,51] There are limitations to our study that should be noticed. First, we excluded hospitals with missing values in key variables when merging the data from different data sources. This may create selection bias. There may also be selection bias in patients that chose to respond to the HCAHPS survey. [52] Second, as an observational study, it cannot identify the causal mechanisms underlying the relationships between patient perceptions and certified EHR adoption, although we adjusted for several potential confounders (e.g., teaching status, location, ownership). In addition, our findings may not be generalizable to non-psychiatric hospitals or outpatient settings. Finally, analysis of this study at hospital level did not consider patient demographic characteristics which were not available from the original data but may potentially inform patient experience and bring about bias.
Further study should apply longitudinal national data to testify about the causal association between certified EHR and patient experience, with considering more potential confounders like patient characteristics. Also, intrinsic mechanism should be examined to explain how certified EHR adoption is able to improve overall patient evaluation in psychiatric hospitals.

Summary
In conclusion, we found marked variation in patient experience between hospitals with and without certified EHR across U.S. psychiatric hospitals. Psychiatric hospitals with certified EHR are more likely to get higher level of patient experience. While results of this study do not imply causality between patient experience and certified EHR adoption, they suggest the positive association between certified EHR adoption and patient experience.