http://orcid.org/0000-0001-9194-6472
Figures
Abstract
Background
In 2011, the Australian government introduced national healthcare reforms aimed at increasing the timeliness and quality of hospital care. The healthcare reforms included, but were not limited to, emergency department (ED) time-based targets, financial incentives, and public performance reporting of hospital data. We sought to evaluate the impact of the national healthcare reforms on ED time-based process outcomes.
Methods
A quasi-experimental study of ED presentations from 2006 to 2016 in the state of Victoria, Australia. Uncontrolled, interrupted time-series analyses were used to evaluate, by hospital peer groups, the effect of national healthcare reforms on: patient wait times for treatment; treatment within recommended time; and patient departure within four hours of arrival in ED.
Results
There were small improvements in ED time-based process outcomes following the introduction of the national healthcare reforms. These occurred in most hospital peer groups immediately and over the longer term, across the various triage categories. The largest improvements occurred in small hospitals and smallest improvements in medium sized hospitals. ED time-based targets, now abolished by the Australian government, were not achieved in any hospital peer groups.
Conclusions
Our findings suggest that national healthcare reforms had the potential to prompt fundamental changes in ED processes leading to significant improvements in ED performances across most hospital peer groups but were generally unable to reach the ED targets imposed nationally. ED performances also varied by hospital peer groups. Attention to ED time-based process outcomes within hospital peer groups may provide insights into hospital practices that could improve the quality and efficiency of ED care.
Citation: Prang K-H, Canaway R, Bismark M, Dunt D, Kelaher M (2018) The impact of Australian healthcare reforms on emergency department time-based process outcomes: An interrupted time series study. PLoS ONE 13(12): e0209043. https://doi.org/10.1371/journal.pone.0209043
Editor: Sandra C. Buttigieg, University of Malta Faculty of Health Sciences, MALTA
Received: August 6, 2018; Accepted: November 27, 2018; Published: December 12, 2018
Copyright: © 2018 Prang et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Per the conditions of release of Victorian Health Data by the Department of Health and Human Services, our data cannot be shared publicly because they contain sensitive patient information. However, data are available from the Victorian Agency for Health Information for researchers who meet the criteria for access to confidential data. Information related to the process for requesting data is contained on the Victorian Agency for Health Information website at: https://bettersafercare.vic.gov.au/our-work/performance-and-safety-reporting/HOSdata.
Funding: This research was funded by Medibank Better Health Foundation. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Increased demands for emergency care due to changes in population growth, an ageing population and increasing prevalence of chronic diseases, have led to overcrowding, increased waiting times and length of stay (LOS) in emergency departments (ED) worldwide [1, 2]. ED crowding and delays are associated with adverse outcomes for patients including increased mortality [3, 4] and length of hospital stay [5, 6], and lowered levels of satisfaction [7, 8].
To ameliorate ED crowding, the United Kingdom introduced a time-based emergency care target in 2004, which stipulated a maximum limit of four hours on the LOS from time of arrival to discharge or transfer to an inpatient ward [9]. Many countries, including Australia [10], New Zealand [11] and some Canadian provinces [12], similarly introduced ED time-based targets for time spent in ED from arrival to departure, ranging from 4 to 8 hours. In Australia, the National Emergency Access Target (NEAT) was introduced in 2011 as part of the National Health Reform Agreement (NHRA) [13] and the National Partnership Agreement on Improving Public Hospital Services [14]. The goal of NEAT was to increase (towards 90% by 2015) the proportion of patients discharged, admitted or transferred to another hospital within four hours of arrival at an ED. Initially, state and territory governments received significant financial incentives from the Australian government when ED targets were achieved; however, these payments ceased in 2014.
Furthermore, the NHRA mandated that all public hospitals report their performance data to the National Health Performance Authority (reporting transferred to the Australian Institute of Health and Welfare (AIHW) in 2016) for public reporting on the MyHospitals website [15]. In contrast, public reporting on the MyHospitals website is voluntary for private hospitals. Other ED performance indicators publicly reported on the MyHospitals website include the proportion of patients seen within clinically recommended triage times, as recommended by the Australasian College for Emergency Medicine [16]. This target was set at 80% across all triage categories. The MyHospitals website allows the public to access national, comparable performance information on hospitals and hospital providers.
Previous studies have demonstrated that the introduction of time-based targets with sanctions (i.e. publicly naming and shaming hospitals) have led to improvement in waiting times for elective care [17, 18]. Similarly, other studies reported that ED time-based targets resulted in a reduction in LOS in emergency care [19–21] and in-hospital mortality [22, 23]. In Australia, NEAT was found to be associated with an increase in the number of patients treated and discharged from ED within four hours [24, 25] and a decrease in ‘access block’ (the inability of ED patients from accessing inpatient care due to lack of available inpatient beds) [26, 27]. Of these studies, two were conducted in the state of Victoria, with n = 1 and n = 2 hospital sites respectively, and relatively short study periods [25, 26] limiting their generalisability and ability to identify trends over time. To our knowledge, analysis of state-wide EDs in Victoria has not previously been conducted. Therefore, this study aimed to evaluate the impact of government national healthcare reforms on ED time-base process outcomes, in particular those publicly reported on the MyHospitals website—patients waiting time to treatment; treatment within recommended time; and departing ED within four hours of arrival for public hospitals in Victoria, Australia.
Methods
Study design
This study is a component of a larger mixed-methods research program aimed at increasing understanding of how public reporting may improve quality of care in public and private hospitals in Australia. Previous components of the research program included examining the perspectives of multiple stakeholders including consumer advocates, providers, purchasers [28], public hospital medical directors[29, 30], general practitioners (GPs) [31] and patients [32]. This component used a quantitative approach to understand the effect of national healthcare reforms on various ED time-based process outcomes.
This study involved an uncontrolled, interrupted time series (ITS) analysis of Victorian ED presentations data. ITS is a powerful quasi-experimental research design for evaluating the effect of an intervention when random allocation is not feasible. ITS contains a series of observations related to the outcome of interest at multiple time points before and after the introduction of an intervention. The trends before and after the intervention are compared to determine the effect of the intervention from its secular (underlying) trend [33–35]. It is particularly useful in the analysis of ‘natural experiments’ in real world settings, for example the introduction of a national policy or incentive.
Data source
A data request was submitted to the Victorian Department of Health and Human services (DHHS) (data requests activities transferred to The Victorian Agency for Health Information in 2017) for data access to the Victorian Emergency Minimum Dataset (VEMD) [36]. De-identified patient-level data from VEMD spanning years 2006 to 2016 were provided by DHHS. The VEMD records all presentations to EDs in Victorian public hospitals that have a designated 24-hour ED. The VEMD includes de-identified demographic, administrative and clinical data. Data are collected by individual hospitals using standard definitions and protocols, then transferred to the Data Collections Unit (DCU) which manages VEMD operations. Thirty-nine hospitals currently provide data to the VEMD, of those, one hospital provided data only from 2011 onwards (n = 78,139) and therefore was excluded from the analyses.
Inclusion and exclusion criteria
We selected all ED presentations between 2006 and 2016. Cases were excluded if the: a) type of visit was a planned return visit, pre-arranged admission or patient in transit (n = 314,857); b) patient was dead on arrival (n = 20,274); c) patient did not wait to be attended by a healthcare professional (n = 909,012); c) hospital was others than public acute hospitals (e.g. specialised hospital—women or children hospitals) (n = 1,505,268); or d) waiting time to treatment was greater than eight hours (n = 2,957). With regard to (c), we excluded hospital that had only small numbers of their type. With regard to (d), a wait time more than eight hour was considered a potential data error or may have represented a patient who did not require emergency care.
Government emergency department targets
Australian national healthcare reforms relevant to this study began in August 2011. The VEMD provided by DHHS did not include the full date of patient presentations, only year of presentations. For these analyses, we defined the pre-reform period as 2006 through to 2010, and the post-reform period as 2011 through to 2016.
Outcomes measures
Outcomes of interest were waiting time to treatment, treatment within recommended time, and departing ED within four hours of arrival. Waiting time to treatment was defined as the time between a patient’s arrival at the ED and the commencement of their clinical care and measured in minutes. Treatment within recommended time referred to the recommended maximum waiting times for commencement of clinical care based on patient’s urgency need for care. There are five urgency categories defined by the Australasian Triage Scale [16]: 1) resuscitation (immediate treatment–defined as within two minutes in this study [as per the MyHospitals website]); 2) emergency (within 10 minutes); 3) urgent (within 30 minutes); 4) semi-urgent (within 60 minutes); and 5) non-urgent (within 120 minutes). Treatment within recommended time was coded as yes or no and was derived from waiting time to treatment and urgency category variables. Departing ED within four hours of arrival was defined as the time between a patient’s arrival at the ED and their physical departure from the ED. Departing ED within four hours of arrival was coded as yes or no and was derived from length of stay in ED variable.
Explanatory variables
Gender, age, triage and diagnosis were all based on VEMD variables as defined at the time of the ED presentation. Gender was categorised into three groups: male; female; and intersex. Age was categorised into 11 groups: 0–4; 5–14; 15–24; 25–34; 35–44; 45–54; 55–64; 65–74; 75–84; 85–94; and ≥95. Triage was based on the five Australasian Triage Scale [16] classification categories described above. Diagnosis was based on the best information available after the patient’s ED presentation using the International Classification of Diseases, 10th Revision, Australian Modification (ICD 10-AM) diagnosis codes [37]. Diagnosis was grouped into 23 categories (S1 Text).
Statistical analyses
Descriptive statistics of key variables were used to characterise the differences before and after the introduction of national healthcare reforms stratified by hospital peer groups. Hospitals were categorised into four groups as defined by the AIHW [38]: 1) major hospitals (principal referral); 2) large metropolitan and regional hospitals (public acute group A); 3) medium metropolitan and regional hospitals (public acute group B); and 4) small hospitals all areas (public acute group C).
Segmented linear regression analyses, adjusted for demographic and clinical factors, were conducted to assess the significance of change in level and slope of the regression lines of waiting time to treatment, before and after the introduction of national healthcare reforms. Interaction effects between triage category and year of presentation were conducted. Similarly, segmented logistic regression analyses, adjusted for demographic and clinical factors, were conducted to estimate treatment within recommended time, and departing ED within four hours of arrival. All models were stratified by hospital peer groups to allow valid comparisons across similar hospitals. Residual analyses were conducted to examine the presence of serial autocorrelation. A p-value of less than 0.05 was considered statistically significant in all analyses. Data analyses were conducted using STATA version 14 (StataCorp, College Station, TX, USA). Ethical approval for this study was obtained from the Melbourne School of Population and Global Health Human Ethics Advisory Group, The University of Melbourne.
Results
Over the 11-year period 2006–2016, there were 13,241,509 ED presentations in 34 Victorian hospitals. Of these, 3,615,442 (27.30%) presentations were in six major hospitals, 5,786,885 (43.70%) in 14 large hospitals, 3,123,792 (23.59%) in nine medium hospitals, and 715,390 (5.40%) in five small hospitals.
Patient characteristics
Patient characteristics and ED outcomes for pre and post reform periods, stratified by hospital peer groups are described in Table 1. Across all hospital peer groups and periods, the proportion of presentations by females and males was similar. Presentations were most common among those aged 15–34 years. The majority of presentations were classified as urgent and semi-urgent. There was a decrease in the number of presentations classified as non-urgent in the post reform period.
Following the introduction of national healthcare reforms, all hospital peer groups showed a decline in the mean waiting time to treatment and an increase in the proportion of patients treated within the recommended time. There was an increase in the proportion of patients who departed ED within four hours of arrival in the post reform period among major and large hospitals, whereas there was a decrease among medium and small hospitals.
Waiting time to treatment stratified by hospital peer groups
Results of the segmented linear regressions for waiting time to treatment, adjusted for gender, age, triage and diagnosis, and stratified by hospital peer groups, are presented in Fig 1 (S1 Table). Immediately after the implementation of national healthcare reforms (as judged by intercepts), waiting times to treatment improved significantly across all hospital peer groups, with the largest improvement observed in small hospitals (-12.44 minutes). In the post reform period, all hospital peer groups continued significant improvements in waiting time to treatment, with the exception of medium hospitals (+1.14 minutes per year compared to the pre-intervention trend).
The largest improvements in waiting time to treatment was observed among small hospitals (-6.62 minutes per year compared to the pre-intervention trend).
Waiting time to treatment by triage categories and stratified by hospital peer group
To assess whether waiting time to treatment differ by triage categories, interaction effects between triage category and year of presentation adjusted for age, gender and diagnosis, and stratified by hospital peer groups were conducted (Fig 2). There were significant triage differences in the trends of waiting time to treatment by hospital peer groups, with the exception of resuscitation. After the implementation of national healthcare reforms, waiting time to treatment was significantly shorter across all triage categories and hospital peer groups (S2 Table), with the exception of the non-urgent category in major hospitals, which showed an immediate increase of 3.53 minutes. In the post reform period, there was a decline in the mean waiting time to treatment for urgent, semi-urgent and non-urgent presentations in major hospitals, large and small hospitals. In contrast, medium hospitals experienced an increase in the mean waiting time to treatment for urgent (+1.38 minutes per year), semi-urgent (+0.26 minutes per year) and non-urgent (+1.42 minutes per year) presentations.
Treatment within recommended time stratified by hospital peer groups
Results of the segmented logistic regressions for treatment within recommended time adjusted for age, gender and diagnosis, and stratified by hospital peer groups are presented in Table 2. Across all hospital peer groups, the odds of patients being treated within recommended time increased following the implementation of national healthcare reforms. The largest increase was observed among small hospitals (odds ratio (OR) 1.79; 95% confidence intervals (CI) 1.74–1.83). Compared to the pre-intervention trends, the odds of patients being treated within the recommended time in the post-reform period continued to increase in major (OR 1.02; 95% CI 1.01–1.02), large (OR 1.12; 95% CI 1.12–1.12) and small (OR 1.33; 95% CI 1.32–1.35) hospitals. In contrast, patients were less likely to be treated within the recommended time in medium hospitals compared to the pre-intervention trend (OR 0.96; 95% CI 0.96–0.96).
Departing emergency department within four hours of arrival stratified by hospital peer groups
Results of the final segmented logistic regressions for patients departing ED within four hours of arrival, adjusted for age, gender, triage and diagnosis, and stratified by hospital peer groups, are presented in Table 2. Following the implementation of national healthcare reforms, the odds of patients departing ED within four hours of arrival increased across all hospital peer groups, except for medium hospitals (OR 0.98; 95% CI 0.97–0.99). In the post reform period, across all hospital peer groups, patients were likely to depart ED within four hours of arrival.
Discussion
Main findings
This natural experiment study investigated the impact of national healthcare reforms on ED time-based process outcomes in Victoria, Australia. Our findings suggest that reforms influenced ED time-based process outcomes, but the recommended ED time-based targets were generally not achieved. Following implementation of reforms, waiting time to treatment, treatment within recommended time, and departure within four hours of arrival improved immediately across all hospital peer groups. Long-term improvements for waiting time to treatment, and treatment within the recommended time, were observed across all hospital peer groups with the exception of medium hospitals. Departure within four hours of arrival also exhibited long-term improvements across all hospital peer groups. ED waiting times to treatment varied across triage categories.
Improvement in the timeliness of accessing emergency care and the LOS following the introduction of national healthcare reforms varied across hospital peer groups, with the greatest improvement in small hospitals. This is consistent with previous Australian research which showed that small hospitals have the shortest waiting time to treatment [39] and patients were more likely to depart the ED within four hours of arrival than in major, large and medium hospitals [40]. Such improvements are likely to be dependent on individual hospitals’ behavioural responses to government targets and initiatives undertaken to address them. It is unclear how small hospitals improved their ED time-based process outcomes; particularly as NEAT does not provide specific guidance on change processes. Instead, individual hospitals are responsible for the development and implementation of change processes based on their own perceived issues. A review by Crawford et al. [41] described a number of initiatives implemented in Australia to address ED time-based process targets, including waiting room nurses, streaming (directing patient flow based on illness or injury severity), rapid assessment teams, short stay units, and care coordination programs, but the authors did not differentiate between hospital types. Future research investigating ED initiatives to reduce patient waiting times and LOS in small hospitals should seek to provide insights into successful practices which could be applied in other hospitals.
The study was not designed to determine why and how hospitals improved or worsened their performance in the post reform period. Therefore, it is not known why the results of medium hospitals worsened compared to other hospital peer groups. Following the introduction of national healthcare reforms, patients presenting to medium hospitals waited an additional 1.14 minutes per year and 4% were less likely to be treated within recommended time compared to the pre-intervention trends. It is unclear if these results are clinically important as we did not have patient’s outcomes measures. A case study evaluation of an Australian regional hospital clinical redesign activities following the reforms suggested that targets were important drivers for improvement in ED access, however not at the expense of patient safety [42]. The authors identified strong clinical leadership, support from management, and investment into infrastructure and workforce as essential for improvement in ED access [42]. Similarly, our previous qualitative study with medical directors of public hospitals in Victoria highlighted lack of leadership from government and within hospitals (i.e. boards and executives) and lack of resources (i.e. staff expertise, sufficient staff numbers, existing data) as barriers to quality improvement within hospitals [30]. Further research at individual hospital level is required to identify change processes that lead to or impede improvements in ED performance.
The timeliness of accessing emergency care improved significantly for all triage categories, with the exception of resuscitation. As expected, there was minimal to no effects of national healthcare reforms on waiting time to treatment among resuscitation across all hospital peer groups, which suggests that patients were treated within an appropriate time frame before and after the introduction of reforms. Semi-urgent and non-urgent presentations (also referred to as GP-type presentations) exhibited the greatest reduction in waiting time to treatment, in particular among small hospitals. Of note, the proportion of semi-urgent and non-urgent presentations were greatest among small hospitals, whereas, as expected, major and large hospitals had a greater proportion of emergency and urgent presentations. Green et al. [43] have similarly found that smaller Australian hospitals, which have greater volume of non-urgent patients, have better wait time performance than larger Australian hospitals which proportionally have far lower numbers of non-urgent patients.
Despite significant improvements in ED time-based process outcomes following the introduction of national healthcare reforms, ED time-based targets of 90% of patients being treated and departing the ED within 4 hours, were generally not met across any of the hospital peer groups. Less than 80% of patients classified as urgent and semi-urgent were seen within the recommended time. This is consistent across Australia [40, 44] and internationally [45, 46]. The 4-hour rule was implemented with a limited evidence base [47] and debate surrounding its suitability and sustainability continues [48].
Past research suggests that publicly reporting ED time-based targets may results in perverse incentives, such as gaming of the system by increasing hospital in-patient admission rates and therefore reducing ED LOS [49]. We did not evaluate these unintended consequences. Further research is warranted to assess whether the reductions apparent in ED LOS are associated with increased admissions rates. Perhaps as a response to the 4-hour rule and unattainable 90% target, NEAT has recently been abolished by the Australian government [50], but it has remained a key ED performance indicator on the MyHospitals [15] and some states performance websites [51, 52]. Research also recommends the inclusion of patients’ ED clinical outcomes alongside ED time-based targets to minimise perverse incentives and unintended consequences [10, 53]. Clinical outcomes of patients in emergency care are currently not publicly reported in Australia.
Strengths and limitations
By employing ITS, a powerful quasi-experimental research design, evaluation of the effect of national healthcare reforms on ED time-based process outcomes was possible. The analyses included state-wide population coverage of ED presentations over a period of 11 years, allowing identification of secular trends. Multilevel analysis, adjusting for clustering at the hospital level, were initially conducted, however, the model showed low intra class correlation of 2% (i.e. variation attributed to the hospital). Analyses were instead conducted separately for each hospital peer group to ensure equitable comparisons across hospitals types.
Limitations of the study included confounding influences making it difficult to attribute the observed changes to a specific intervention [33]. For example, financial incentives for achieving ED targets were introduced concurrently with public reporting. However, most states and territories were unable to reach the ED targets over the study period [40, 44], therefore it is unlikely that financial incentives had a substantial impact on ED time-based process outcomes. Nevertheless, given that financial incentives were removed in 2014, there is an opportunity to evaluate and isolate the effects of public reporting from financial incentives on ED time-based process outcomes when sufficient data points are available. Introducing a suitable comparator group may alleviate misattribution of cause. However, we were unable to select a comparator group given that the healthcare reforms were implemented nationally. Finally, improvement in ED time-based process outcomes does not necessarily represent an improvement in patient care. We did not objectively measure clinical outcomes of patients; therefore, we are unable to comment on whether process improvements led to better quality of care and patient outcomes. Future research is warranted to better understand the relationships between ED targets, ED time-based process measures and patient clinical outcomes.
Conclusions
Australian national healthcare reforms appear, in the state of Victoria, to have encouraged improved ED patient waiting times, treatment within recommended time, and departure within four hours of arrival. Despite these improvements, the reforms were not able to stimulate attainment of the recommended Australian national targets. ED performance varied widely depending on hospital size, with small hospitals significantly improving their performance after the introduction of the reforms. The study highlights the potential for nationally implemented healthcare system reforms to prompt fundamental changes in ED processes, despite being linked to targets that proved to be generally unattainable. The variation across triage categories and hospital peer groups provides unique future opportunities to understand behavioural change at the hospital level toward quality and safety improvement.
Supporting information
S1 Table. Segmented linear regression models of the relations between government targets and waiting time to treatment stratified by hospital peer groups.
https://doi.org/10.1371/journal.pone.0209043.s001
(DOCX)
S2 Table. Segmented linear regression models of the relations between government targets, triage categories and waiting time to treatment stratified by hospital peer groups.
https://doi.org/10.1371/journal.pone.0209043.s002
(DOCX)
Acknowledgments
We wish to thank the Victorian Department of Health and Human Services for allowing access to the Victorian Emergency Minimum Dataset.
References
- 1. Di Somma S, Paladino L, Vaughan L, Lalle I, Magrini L, Magnanti M. Overcrowding in emergency department: an international issue. Internal and Emergency Medicine. 2015;10(2):171–5. pmid:25446540
- 2. Pines JM, Hilton JA, Weber EJ, Alkemade AJ, Al Shabanah H, Anderson PD, et al. International perspectives on emergency department crowding. Academic Emergency Medicine. 2011;18(12):1358–70. pmid:22168200
- 3. Guttmann A, Schull MJ, Vermeulen MJ, Stukel TA. Association between waiting times and short term mortality and hospital admission after departure from emergency department: population based cohort study from Ontario, Canada. BMJ. 2011;342.
- 4. Richardson DB. Increase in patient mortality at 10 days associated with emergency department overcrowding. The Medical Journal of Australia. 2006;184(5):213–6. pmid:16515430
- 5. Liew D, Liew D, Kennedy MP. Emergency department length of stay independently predicts excess inpatient length of stay. The Medical Journal of Australia. 2003;179(10):524–6. pmid:14609414
- 6. Derose SF, Gabayan GZ, Chiu VY, Yiu SC, Sun BC. Emergency department crowding predicts admission length-of-stay but not mortality in a large health system. Medical Care. 2014;52(7):602–11. pmid:24926707
- 7. Pines JM, Iyer S, Disbot M, Hollander JE, Shofer FS, Datner EM. The effect of emergency department crowding on patient satisfaction for admitted patients. Academic Emergency Medicine. 2008;15(9):825–31. pmid:19244633
- 8. Tekwani KL, Kerem Y, Mistry CD, Sayger BM, Kulstad EB. Emergency department crowding is associated with reduced satisfaction scores in patients discharged from the emergency department. Western Journal of Emergency Medicine. 2013;14(1):11–5. pmid:23447751
- 9. Hughes G. Four hour target for EDs: The UK experience. Emergency Medicine Australasia. 2010;22(5):368–73. pmid:21040479
- 10. Staib A, Sullivan C, Griffin B, Bell A, Scott I. Report on the 4-h rule and National Emergency Access Target (NEAT) in Australia: time to review. Australian Health Review. 2016;40(3):319–23. pmid:26433943
- 11. Jones P, Wells L, Harper A, Le Fevre J, Stewart J, Curtis E, et al. Impact of a national time target for ED length of stay on patient outcomes. The New Zealand Medical Journal. 2017;130(1455):15–34. pmid:28494475
- 12. Ovens H. ED Overcrowding: the Ontario approach. Academic Emergency Medicine. 2011;18(12):1242–5. pmid:22168186
- 13.
Council of Australian Government (COAG). National Healthcare Agreement Canberra: COAG; 2011.
- 14.
Council of Australian Government (COAG). The National Health Reform Agreement—National Partnership Agreement on improving public hospital services. Canberra: COAG; 2011.
- 15.
AIHW. MyHospitals 2017 [Available from: http://www.myhospitals.gov.au/.
- 16.
Australasian College for Emergency Medicine (ACEM). Guidelines on the implementation of the Australasian triage scale in emergency departments. ACEM; 2016.
- 17. Besley TJ, Bevan G, Burchardi K. Naming & shaming: the impacts of different regimes on hospital waiting times in England and Wales. 2009.
- 18. Propper C, Sutton M, Whitnall C, Windmeijer F. Did 'targets and terror' reduce waiting times in England for hospital care? The BE Journal of Economic Analysis & Policy. 2008;8(2).
- 19. Mason S, Weber EJ, Coster J, Freeman J, Locker T. Time patients spend in the emergency department: England's 4-hour rule—a case of hitting the target but missing the point? Annals of Emergency Medicine. 2012;59(5):341–9. pmid:22088495
- 20. Freeman JV, Croft S, Cross S, Yap C, Mason S. The impact of the 4 h target on patient care and outcomes in the Emergency Department: an analysis of hospital incidence data. Emergency Medicine Journal. 2010;27(12):921–7. pmid:20466827
- 21. Tenbensel T, Chalmers L, Jones P, Appleton-Dyer S, Walton L, Ameratunga S. New Zealand’s emergency department target–did it reduce ED length of stay, and if so, how and when? BMC health services research. 2017;17(1):678. pmid:28950856
- 22. Sullivan C, Staib A, Khanna S, Good NM, Boyle J, Cattell R, et al. The National Emergency Access Target (NEAT) and the 4-hour rule: time to review the target. The Medical Journal of Australia. 2016;204(9):354. pmid:27169971
- 23. Geelhoed GC, de Klerk NH. Emergency department overcrowding, mortality and the 4-hour rule in Western Australia. The Medical Journal of Australia. 2012;196(2):122–6.
- 24. Ngo H, Forero R, Mountain D, Fatovich D, Man WN, Sprivulis P, et al. Impact of the four-hour rule in Western Australian hospitals: trend analysis of a large record linkage study 2002–2013. Plos One. 2018;13(3):e0193902. pmid:29538401
- 25. Lowthian J, Curtis A, Straney L, McKimm A, Keogh M, Stripp A. Redesigning emergency patient flow with timely quality care at the Alfred. Emergency Medicine Australasia. 2015;27(1):35–41. pmid:25582966
- 26. Perera ML, Davies AW, Gnaneswaran N, Giles M, Liew D, Ritchie P, et al. Clearing emergency departments and clogging wards: National Emergency Access Target and the law of unintended consequences. Emergency Medicine Australasia. 2014;26(6):549–55. pmid:25332129
- 27. Lawton LD, Thomas S, Morel DG. Trends in access block 2011 to 2013: the Redcliffe National Emergency Access Target experience. Emergency Medicine Australasia. 2015;27(1):11–5. pmid:25627568
- 28. Canaway R, Bismark M, Dunt D, Kelaher M. Perceived barriers to effective implementation of public reporting of hospital performance data in Australia: a qualitative study. BMC Health Services Research. 2017;17(1):391. pmid:28592277
- 29. Canaway R, Bismark M, Dunt D, Kelaher M. Public reporting of hospital performance data: views of senior medical directors in Victoria, Australia. Australian Health Review. 2017: Oct 9. [Epub ahead of print]. pmid:28988569
- 30. Canaway R, Bismark M, Dunt D, Kelaher M. Medical directors’ perspectives on strengthening hospital quality and safety. Journal of Health Organization and Management. 2017;31(7–8):696–712. pmid:29187081
- 31. Prang K-H, Canaway R, Bismark M, Dunt D, Kelaher M. The use of public performance reporting by general practitioners: a study of perceptions and referral behaviours. BMC Family Practice. 2018;19(1):29. pmid:29433449
- 32. Prang K-H, Canaway R, Bismark M, Dunt D, Miller JA, Kelaher M. Public performance reporting and hospital choice: a cross-sectional study of patients undergoing cancer surgery in the Australian private healthcare sector. BMJ Open. 2018;8(4).
- 33. Bernal JL, Cummins S, Gasparrini A. Interrupted time series regression for the evaluation of public health interventions: a tutorial. International Journal of Epidemiology. 2017;46(1):348–55. pmid:27283160
- 34. Kontopantelis E, Doran T, Springate DA, Buchan I, Reeves D. Regression based quasi-experimental approach when randomisation is not an option: interrupted time series analysis. BMJ. 2015;350:h2750. pmid:26058820
- 35. Taljaard M, McKenzie JE, Ramsay CR, Grimshaw JM. The use of segmented regression in analysing interrupted time series studies: an example in pre-hospital ambulance care. Implementation Science. 2014;9(1):77.
- 36.
Victorian Agency for Health Information. HOSdata—Victorian hospital data reports 2018 [Available from: https://bettersafercare.vic.gov.au/our-work/performance-and-safety-reporting/HOSdata.
- 37.
Australian Consortium for Classification Development. ICD-10-AM/ACHI/ACS 2018 [Available from: https://www.accd.net.au/Icd10.aspx.
- 38.
AIHW. Hospital resources 2014–15: Australian hospital statistics. Canberra: AIHW; 2016.
- 39. Green J, Dawber J, Masso M, Eagar K. Emergency department waiting times: do the raw data tell the whole story? Australian Health Review. 2014;38(1):65–9. pmid:24433850
- 40.
AIHW. Emergency department care 2016–17: Australian hospital statistics. Canberra: AIHW; 2017.
- 41. Crawford K, Morphet J, Jones T, Innes K, Griffiths D, Williams A. Initiatives to reduce overcrowding and access block in Australian emergency departments: a literature review. Collegian. 2014;21(4):359–66. pmid:25632734
- 42. Reddy S, Carey TA, Wakerman J. A realist case study of a regional hospital’s response to improve emergency department access in the context of Australian health care reforms. Health Services Research and Managerial Epidemiology. 2016;3:1–18.
- 43. Greene J, Hall J. The comparability of emergency department waiting time performance data. Medical journal of Australia. 2012;197(6):345. pmid:22994833
- 44.
Australian Medical Association (AMA). Public hospital report card 2017: An AMA analysis of Australia's public hospital system. Barton, ACT: AMA; 2017.
- 45. Horwitz LI, Green J, Bradley EH. US emergency department performance on wait time and length of visit. Annals of emergency medicine. 2010;55(2):133–41. pmid:19796844
- 46. Blunt I. Focus on: A&E attendances. Why are patients waiting longer?: The Health Foundation and Nuffield Trust; 2014.
- 47. Boyle DA, Mason PS. What has the 4-hour access standard achieved? British Journal of Hospital Medicine. 2014;75(11):620–2. pmid:25383430
- 48. Campbell P, Boyle A, Higginson I. Should we scrap the target of a maximum four hour wait in emergency departments? BMJ. 2017;359.
- 49.
Commission H, Commission HC. Investigation into mid staffordshire NHS foundation trust. London: Healthcare Commission. 2009.
- 50.
Emergency Care Institute. ETP—The Basics 2018 [Available from: https://www.aci.health.nsw.gov.au/networks/eci/administration/neat/neat-the-basics.
- 51.
Victoria State Government. Victorian Health Services Performance 2016 [Available from: http://performance.health.vic.gov.au/Home.aspx).
- 52.
Bureau of Health Information. Healthcare Observer 2017 [Available from: http://www.bhi.nsw.gov.au/Healthcare_Observer/_nocache.
- 53. Scott I, Sullivan C, Staib A, Bell A. Deconstructing the 4-h rule for access to emergency care and putting patients first. Australian Health Review. 2017:Oct 16. [Epub ahead of print] pmid:29032791