Browse Subject Areas

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The Effect of Out of Hours Presentation with Acute Stroke on Processes of Care and Outcomes: Analysis of Data from the Stroke Improvement National Audit Programme (SINAP)

  • James T. P. Campbell ,

    Affiliation Royal College of Physicians, London, United Kingdom

  • Benjamin D. Bray,

    Affiliation King's College London, Division of Health and Social Care Research, London, United Kingdom

  • Alex M. Hoffman,

    Affiliation Royal College of Physicians, London, United Kingdom

  • Sara J. Kavanagh,

    Affiliation Royal College of Physicians, London, United Kingdom

  • Anthony G. Rudd,

    Affiliations King's College London, Division of Health and Social Care Research, London, United Kingdom, National Institute for Health Research Comprehensive Biomedical Research Centre, Guy's and St Thomas' NHS Foundation Trust, London, United Kingdom

  • Pippa J. Tyrrell,

    Affiliation University of Manchester MAHSC, Salford Royal NHS Foundation Trust, Salford, United Kingdom

  • on behalf of the Intercollegiate Stroke Working Party

The Effect of Out of Hours Presentation with Acute Stroke on Processes of Care and Outcomes: Analysis of Data from the Stroke Improvement National Audit Programme (SINAP)

  • James T. P. Campbell, 
  • Benjamin D. Bray, 
  • Alex M. Hoffman, 
  • Sara J. Kavanagh, 
  • Anthony G. Rudd, 
  • Pippa J. Tyrrell, 
  • on behalf of the Intercollegiate Stroke Working Party



There is inconsistent evidence that patients with stroke admitted to hospital out of regular working hours (such as weekends) experience worse outcomes. We aimed to identify if inequalities in the quality of care and mortality exist in contemporary stroke care in England.


SINAP is a prospective database of acute stroke patients, documenting details of processes of care over the first 72 hours. We compared quality of care indicators and mortality at 72 hours, 7 days and 30 days, for patients who arrived within normal hours (Monday–Friday 8am to 6pm) and for those who arrived out of hours, using multivariable logistic and Cox proportional hazard models. Quality of care was defined according to time from arrival at hospital to interventions (e.g., brain scan), and whether the patient received therapeutic interventions (such as thrombolysis).


45,726 stroke patients were admitted to 130 hospitals in England between 1 April 2010 and 31 January 2012. Patients admitted out of hours (n = 23779) had more features indicative of worse prognosis (haemorrhagic stroke, reduced consciousness, pre stroke dependency). Out of hours admission was significantly associated with longer delays in receiving a CT scan or being admitted to a stroke unit, and reduced odds of receiving thrombolysis. After adjusting for casemix, there was no consistent evidence of higher mortality for patients admitted out of hours, but patients admitted at the weekends had a higher risk of 30 day mortality (OR 1.14, 95% CI 1.06–1.21)


Inequalities in the provision of stroke care for people admitted out of regular hours persist in contemporary stroke in England. The association with mortality is small and largely attributable to higher illness severity in patients admitted out of hours.


Stroke is the third commonest cause of death [1] and the commonest cause of complex disability [2] in the UK. There is evidence that some interventions (for example stroke unit admission [3] and thrombolysis for acute ischaemic stroke [4]) improve outcome. “Out of hours care”, particularly weekend care, is associated with reduced staffing levels, fewer senior staff, more cross cover, and reduced access to imaging and other services [5], [6]. Across a number of care settings, including emergency admissions [7], [8], [9] pulmonary embolism [10] and myocardial infarction [11], admission at nights and weekends is reported to be associated with worse outcome. Specifically in stroke, there have been a number of studies that suggest that weekend admission is associated with higher in-hospital mortality [12], [13]. Admission at weekends with intracerebral haemorrhage, one subtype of stroke, is associated with increased risk adjusted in hospital mortality [14]. There is evidence from a previous cohort in the UK that weekend admissions with acute stroke are less likely to be admitted to a stroke unit, receive thrombolysis or have a CT scan than those admitted during the week [15]. There have been major changes in the organisation of stroke care since this study was published and it is not known if these changes have reduced inequalities in care for patients admitted out of regular working hours.

We aimed to review data from a large prospective dataset of acute stroke admissions in England to compare the quality of care and mortality in patients admitted out of hours (weekday evenings and overnight, weekends and public holidays) to determine whether inequalities in stroke care for patients admitted out of hours persist.


The Stroke Improvement National Audit Programme (SINAP) is a continuous, prospective national clinical audit of acute stroke care in England, coordinated by the Royal College of Physicians London. The aim of SINAP is to audit against national guidelines on best practice for stroke patients in order to inform hospitals about their current performance and to identify national performance against key measures. 130 out of 186 (70%) hospitals in England which admit patients with acute stroke submitted data to the audit. Hospitals are encouraged to enter data on all admissions to the hospital with stroke regardless of ward to which they were admitted or what treatment they received. Patients with subarachnoid haemorrhage are not included. Uniformity in approach to data collection is achieved by providing audit participants with help notes on how to interpret the questions in the dataset and a dedicated email and telephone helpdesk to clarify queries about the dataset. The audit documents aspects of process of care in the first 72 hours of admission, including time from arrival to assessment by the stroke team, to CT scan and to a stroke unit, and interventions such as thrombolysis and administration of anti-platelet agents. Data were submitted by hospitals via a secure web tool with built-in validation checks. Mortality is reported via data linkage with the national death register (the Office for National Statistics).

Patients admitted between 1 April 2010 and 31 January 2012 are included in the cohort. Admission data including time of onset (where known), arrival at hospital time, stroke team assessment time, brain scan time and time of admission to the stroke unit are recorded. The dataset includes patient characteristics (including stroke type and severity) and interventions (such as thrombolysis or admission to stroke unit). There are also 5 care “bundles” which demonstrate the achievement of multiple related care processes on an “all or none” basis. These bundles were defined by the Intercollegiate Stroke Working Party. Patients can be excluded from care bundles based on pre-specified exclusion criteria. ‘Normal hours’ are defined as weekdays between 8am and 6pm and ‘out of hours’ as weekdays before 8am or after 6pm or at any time on a weekend day or English public holiday. Patients who were already in hospital at time of stroke (2,871 patients, 5.9%) are excluded from the analysis. Patients defined in the audit as eligible for thrombolysis have the following characteristics: ischaemic stroke; age less than 81 years; an onset of symptoms to arrival at hospital time of less than 3 hours; no contra-indications for thrombolysis; and did not decline treatment. These eligibility criteria are based on European licensing indications at the time.

The aim of our study was to determine whether patients admitted out of hours to hospital with acute stroke have worse care or higher mortality than people admitted within hours. Logistic regression was used to test the relationship between arrival category and outcomes. Mortality was analysed at 72 hours, 7 days and 30 days after admission. Sensitivity analyses were carried out in which patients dying within the first 3 days following admission were excluded, on the basis that such early mortality may be a marker of stroke severity and co-morbidities, rather than reflect process of care. A further sensitivity analysis was carried out adjusting for stroke syndrome type using the Oxford classification [16] (OCSP). A Cox proportional hazards model was used to test the relationship between arrival category and time taken for patients to progress along the stroke care pathway. In this analysis, a hazard ratio above one is interpreted as faster progress, and below one as slower progress. Analyses were adjusted for age, sex, worst level of consciousness in the first 24 hours (a surrogate for stroke severity), stroke type (ischaemic versus primary intracerebral haemorrhage) and pre stroke independence. Regression analysis results are presented as odds ratios or hazard ratios with analytical 95% confidence intervals. Categorical data are presented as N (%), and continuous data are presented as mean (SD) or median (IQR) as appropriate. All analysis was performed using Stata 12.1.

Ethics Statement

Ethical approval of the SINAP audit and associated data linkage was granted by the Ethics and Confidentiality Committee of the National Information Governance Board. This included Section 251 (under the NHS Act 2006) approval to collect data without active patient consent and patients are able to request for any identifiable data to not be included. Patients and patient representatives are involved in the design, reporting and oversight of SINAP.


Of the 45,726 stroke patients, 21,947 patients (48%) arrived at hospital within normal hours and 23,779 patients (52%) arrived out of hours. Whilst the two groups were similar in terms of age and sex, there were significant clinical differences between them [Table 1]. There were a greater proportion of patients with primary intracerebral haemorrhage amongst the out of hours group (12.2% versus 10.0%, p<0.0001), fewer patients with lacunar infarct (16.6% versus 18.0%, p<0.001) and fewer patients who were fully conscious in the first 24 hours (73.8% versus 78.2%, p = 0.003). In univariable analysis, out of hours patients had a significantly higher mortality at 72 hours (2.3% versus 1.9%, p = 0.007), 7 days (6.5% versus 5.8%, p<0.001) and 30 days (14.3% versus 12.1%, p<0.001).

Table 1. Demographics and unadjusted mortality for normal hours versus out of hours patients.

In univariable analysis, there was a significant difference (favouring normal hours arrivals) in the proportion of patients receiving several audited processes of care (Table 2). A higher proportion of patients arriving in normal hours received Bundles 1, 3 and 5 and thrombolysis if eligible, and a lower proportion were catheterised. These patients also had faster arrival to scan (Figure 1; median 114 minutes versus 155 minutes, p<0.001) and arrival to stroke unit times. There was no significant difference between the two arrival groups for Bundles 2 and 4. A greater proportion of out of hours patients were estimated to be eligible for thrombolysis, based on shorter times from onset to admission (median 349 versus 576 minutes, p<0.001) (Table 2 and Figure 1).

Figure 1. Cumulative frequency plot of arrival to scan and symptom to arrival delays for normal hours and out of hours patients.

Table 2. Unadjusted results for processes of care comparing normal hours with out of hours patients.

Similar associations were observed in the multivariable analysis of process of care [Table 3 and Figure 2]. Out of hours patients had a higher odds being eligible for thrombolysis (OR 1.25, 95% CI 1.17–1.33, p<0.001), but reduced odds of receiving it if eligible (OR 0.62, 95% CI 0.55–0.70, p<0.001). The adjusted mortality results are shown in Figure 3 and Table 4. After adjusting for patient casemix, there were no significant differences in 72 hour and 7 day mortality for out of hours admissions. There was a small higher risk of 30 day mortality, but only at a borderline level of statistical significance (OR 1.07, 95% CI 1.00–1.14, p = 0.040). Using a different measure of out of hours (weekends but not overnight) yielded a slightly higher odds ratio of death (OR 1.14, 95%CI 1.06–1.21, p<0.001). In sensitivity analysis, excluding the 72 hour deaths increased the odds ratio of 30 day mortality for out of hours patients, (OR 1.10, 95% CI 1.03–1.18, p = 0.008). Patients admitted out of hours were not at higher risk of mortality when adjusting for OCSP subtype (OR 0.96, 95% CI 0.86–1.06, p = 0.41).

Figure 2. Eligibility for and compliance with process measures for normal hours and out of hours patients (adjusted odds ratios).

Figure 3. Adjusted mortality odds ratios for normal hours and out of hours patients.

Table 3. Adjusted results for processes of care comparing normal hours with out of hours patients.


This study shows that there are significant differences both in the patient population admitted with stroke out of usual working hours, and in the quality of the care that they receive. Patients admitted out of hours are more likely to present with haemorrhagic stroke, have reduced consciousness and have pre-morbid dependency; those patients with ischaemic stroke are more likely to present with more severe stroke subtypes. These data suggest that the observed excess mortality associated with out of hours admission reported in previous studies can largely be explained by un-measured differences in severity and prognosis. However, despite presenting with a greater illness severity, patients admitted out of hours are also less likely to receive timely access to key investigations and interventions, such as brain scanning and stroke unit admission. These data show that in this large sample of contemporary stroke care in England, there remain significant inequalities in care standards depending on the time of day and day of week that a patient has a stroke.

Comparison with Other Studies

Several previous observational studies have demonstrated excess mortality associated with out of hours or weekend admission for acute stroke, although the effect size has generally been modest and not all studies have demonstrated such an effect. In the largest previous cohort study from England, patients admitted on a Sunday were found to have 26% higher odds of inpatient mortality compared to those admitted on a weekday [17]. However, the study was based on administrative data returns and was therefore limited in its ability to control for stroke severity between weekend and weekday admissions. Data from the Canadian Stroke Registry showed a similar excess risk of 7 day mortality in patients admitted at weekends [18]. More modest estimates of excess mortality risk were observed in data from the US Get With The Guidelines register, where out-of-hours admission was associated with 9% and 19% higher odds of in-patient mortality in patients with ischaemic stroke and haemorrhagic stroke respectively [13]. By contrast, studies in other settings have not observed higher mortality in weekend admissions [19], [20]. In our study, no significant differences were observed in mortality at 72 hours or 7 days for patients admitted out of hours when adjusting for patient casemix. 30 day mortality was higher in some but not all of the analyses, and with only borderline levels of statistical significance. These suggest that more complete adjustment for casemix can explain most if not all of the observed excess mortality for patients admitted out of hours. Patients admitted out of hours had a greater number of features associated with worse prognosis (such as haemorrhagic stroke, reduced consciousness, dependency in activities of daily living prior to stroke). These differences in casemix may reflect differences in access to community medical care services out of hours, less awareness of minor stroke symptoms that occur during sleep or reduced propensity of patients to seek medical attention out of regular hours. Interestingly, patients admitted out of hours presented to hospital quicker after the onset of their symptoms. This may reflect greater urgency in referral and transfer to hospital in response to more severe acute symptoms (such as reduced consciousness) or possibly may reflect differences in pre-hospital transport (reduced demand for ambulances, lower traffic levels) for out of hours admissions.

There was a stronger association with weekend admission and mortality, which was associated with a 14% higher odds of 30 day mortality. The reasons for differences between weekend admission compared to a broader definition of out of hours care (including overnight admissions) are not clear. It is possible that the effect of weekend admission on mortality relates to the prolonged period of exposure to out of hours working (up to 56 hours versus up to 14 hours for overnight admissions).

This study found significant differences in the quality of care received by patients admitted out of hours. Patients admitted out of hours waited longer to receive a brain scan or be admitted to a stroke unit and were less likely to be admitted to a stroke unit directly or to receive thrombolysis, multidisciplinary stroke specific care and therapy early after admission (Bundle 1). Other aspects of care quality were equivalent, including nutritional and swallow screening and administration of antiplatelet therapy, adequate fluid and nutrition. Differences in care quality may reflect the differences in the organisation of out of hours care – access to brain scanning may be restricted out of hours, and many hospitals have reduced nursing and medical staff rostered at weekends [16]. In particular, the difference in thrombolysis rates suggests that patients admitted out of hours have inequitable access to one of the key evidence based therapies for acute stroke [4]. This is even more unfortunate given that patients presenting out of hours presented quicker to hospital and thus potentially have most to gain from timely administration of thrombolysis [21].

These findings are similar to those reported in the United Kingdom from 2005, which demonstrated reduced access to early CT scanning and stroke unit admission for weekend admissions. Since then, changes in stroke service organisation in England have significantly increased the number of stroke unit beds and CT scan availability (RCP Sentinel Audit 2010). These data show however that these improvements have not eradicated inequality in stroke care arising from out of hours admission. There is evidence that reorganisation for stroke care can reduce these inequalities – outcomes from out-of-hours admissions to Comprehensive Stroke Centres in the USA has been reported as being no worse for weekend admissions [20].

Strengths and limitations

These data represent a large, national cohort of patients, with high levels of data completeness and linkage with national mortality records to generate accurate estimates of mortality rates. Several previous studies have used in-patient mortality as the outcome of interest: this may underestimate true mortality rates, particularly in a changing health care environment where patients may be discharged early to nursing home or intermediate care facilities. The dataset is also specifically designed to capture accurate information concerning the process of acute stroke care, and therefore is likely to give more accurate estimates than those derived from routine coding of administrative data. The outcomes data are however limited to mortality, and no data was available on other important stroke outcomes such as disability and quality of life. It is therefore not possible to determine if inequalities in process of care for patients admitted out of hours influenced these outcomes. Adjustment for stroke severity also was limited by lack of availability of the National Institutes of Health Stroke Scale (NIHSS), which is commonly used in stroke research, and other prognostic variables such as cardiovascular comorbidities. Adjustment for stroke severity was therefore carried out using other measures of severity (consciousness level and OCSP subtype). SINAP is not a population based register, and hospital participation is voluntary. Differences in case ascertainment and reporting between hospitals cannot therefore be excluded. Both the voluntary participation and differing case ascertainment may be a source of bias as non-participating hospitals may have different processes of care. Nevertheless, our results are based on patient level data rather than hospital level, so the effect of low and non-participation should not be overstated.


Despite improvements in the organisation of stroke care in England over recent years, significant inequalities in care remain for patients with acute stroke admitted out of regular working hours. Observed excess mortality for patients admitted with stroke out of hours are largely explained by higher illness severity, although patients admitted at the weekend had a small but significant increased risk of mortality. Despite worse illness severity, patients admitted out of hours wait longer for key investigations and interventions, and are less likely to receive several aspects of multidisciplinary stroke care. Strategies to improve 24/7 emergency care generally should allow more hospitals to provide high quality specialist care regardless of time of presentation.


The authors would like to thank the many hundreds of individuals who have contributed to SINAP. The audits would not be possible without their hard work and dedication. We would also like to thank the Intercollegiate Stroke Working Party for their guidance and work to support SINAP.

Author Contributions

Conceived and designed the experiments: JC AH SK AR PT. Performed the experiments: JC AH SK. Analyzed the data: BB JC. Wrote the paper: JC PT BB. Revised manuscript: AH AR.


  1. 1. Office for National Statistics (2011) Mortality statistics: Deaths registered in England and Wales.
  2. 2. Adamson J, Beswick A, Ebrahim S (2004) Is stroke the most common cause of disability? J Stroke Cerebrovasc Dis 13: 171–7.
  3. 3. Stroke Unit Triallists Collaboration (2002) Organized inpatient (stroke unit)care for stroke. Cochrane Database Syst Rev;(1):CD000197.
  4. 4. Wardlaw JM, Murray V, Berge E, Del Zoppo GJ (2009) Thrombolysis for acute ischemic stroke. Cochrane Database Syst Rev Oct 7;(4):CD000213.
  5. 5. Wong HJ, Morra D (2011) Excellent hospital care for all: open and operating 24/7. J Gen Intern Med 26: 1050–2.
  6. 6. Sentinel Stroke National Audit Project (Organisational) (2012) Royal College of Physicians, London
  7. 7. Aylin P, Yunus A, Bottle A, Majeed A, Bell D (2010) Weekend admission for emergency admissions. Qual Saf Health Care 19: 213–7.
  8. 8. Marco J, Barba R, Plaza S, Losa JE, Canora J, et al. (2010) Analysis of the mortality of patients admitted to internal medicine wards over the weekend. Am J Med Qual 25: 312–8.
  9. 9. Sharp Al, Choi H, Hayward RA (2013) Don't get sick on the weekend: an evaluation of the weekend effect on mortality for patients visiting US EDs. Am J Emerg Med 31: 835–7.
  10. 10. Aujesky D, Jimenez D, Mor MK, Geng M, Fine MJ, et al. (2009) Weekend versus weekday admission and mortality after acute pulmonary embolism. Circulation 119(7):962–8.
  11. 11. Kostis WJ, Demissie K, Marcella SW, Shao YH, Wilson AC, et al. (2007) Weekend versus weekday admission and mortality from myocardial infarction. N Engl J Med 356(11):1099–109.
  12. 12. Ogbu UC, Westert GP, Stobbe LC, Stronks K, Arah OA (2011) A multifaceted look at the time of admission and its impact on case-fatality among a cohort of ischemic stroke patients. J Neurol Neurosurg Psychiatry 82: 8–13.
  13. 13. Reeves MJ, Smith E, Fonarow G, Hernandez A, Pan W, et al. (2009) on behalf of the GWTG-Stroke Steering Committee and Investigators (2009) Off-hour admission and in-hospital stroke case fatality in the get with the guidelines-stroke program. Stroke 40: 569–576.
  14. 14. Crowley RW, Yeoh HK, Stukenborg GJ, Ionescu AA, Kassell NF, et al. (2009) Influence of weekend versus weekday hospital admission on mortality following subarachnoid hemorrhage: clinical article. J Neurosurg 111(1):60–66.
  15. 15. Rudd A, Hoffman A, Down C, Pearson M, Lowe D (2007) Access to stroke care in England, Wales and Northern Ireland: the effect of age, gender and weekend admission. Age and Aging 36: 247–255.
  16. 16. Bamford J, Sandercock P, Dennis M, Burn J, Warlow C (1991) Classification and natural history of clinically identifiable subtypes of cerebral infarction. Lancet 337: 1521–6.
  17. 17. Palmer WL, Bottle A, Davie C, Vincent CA, Aylin P (2012) Dying for the weekend: a retrospective cohort study on the association between day of hospital presentation and the quality and safety of stroke care. Arch Neurol 69: 1296–302.
  18. 18. Fang J, Saposnik G, Silver FL, Kapral MK (2010) Investigators of the registry of the Canadian Stroke Network (2010) Association between Weekend Hospital Presentation and Fatality. Neurology 75(18):1589–96.
  19. 19. Albright KC, Raman R, Ernstrom K, Hallevi H, Martin-Schild S, et al. (2009) Can Comprehensive Stroke Centers Erase the ‘Weekend Effect’? Cerebrovasc Dis 27: 107–113.
  20. 20. Albright KC, Savitz SI, Raman R, Martin-Schild S, Broderick J, et al. (2012) Comprehensive stroke centers and the “weekend effect”: the SPOTRIAS experience. Cerebrovasc Dis 34: 424–9.
  21. 21. Lees KR, Bluhmki E, von Kummer R, Brott TG, Toni D, et al. (2010) Time to treatment with intravenous alteplase and outcome in stroke: an updated pooled analysis of ECASS, ATLANTIS, NINDS and EPITHET trials. Lancet 375: 1695–703.