Browse Subject Areas

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Heart Failure Re-Admission: Measuring the Ever Shortening Gap between Repeat Heart Failure Hospitalizations

  • Jeffrey A. Bakal,

    Affiliations Patient Health Outcomes Research and Clinical Effectiveness Unit, University of Alberta, Edmonton, Alberta, Canada, Division of General Internal Medicine, University of Alberta, Edmonton, Alberta, Canada

  • Finlay A. McAlister,

    Affiliations Patient Health Outcomes Research and Clinical Effectiveness Unit, University of Alberta, Edmonton, Alberta, Canada, Division of General Internal Medicine, University of Alberta, Edmonton, Alberta, Canada

  • Wei Liu,

    Affiliation Division of Cardiology, University of Alberta, Edmonton, Alberta, Canada

  • Justin A. Ezekowitz

    Affiliation Division of Cardiology, University of Alberta, Edmonton, Alberta, Canada

Heart Failure Re-Admission: Measuring the Ever Shortening Gap between Repeat Heart Failure Hospitalizations

  • Jeffrey A. Bakal, 
  • Finlay A. McAlister, 
  • Wei Liu, 
  • Justin A. Ezekowitz


Many quality-of-care and risk prediction metrics rely on time to first rehospitalization even though heart failure (HF) patients may undergo several repeat hospitalizations. The aim of this study is to compare repeat hospitalization models. Using a population-based cohort of 40,667 patients, we examined both HF and all cause re-hospitalizations using up to five years of follow-up. Two models were examined: the gap-time model which estimates the adjusted time between hospitalizations and a multistate model which considered patients to be in one of four states; community-dwelling, in hospital for HF, in hospital for any reason, or dead. The transition probabilities and times were then modeled using patient characteristics and number of repeat hospitalizations. We found that during the five years of follow-up roughly half of the patients returned for a subsequent hospitalization for each repeat hospitalization. Additionally, we noted that the unadjusted time between hospitalizations was reduced ∼40% between each successive hospitalization. After adjustment each additional hospitalization was associated with a 28 day (95% CI: 22-35) reduction in time spent out of hospital. A similar pattern was seen when considering the four state model. A large proportion of patients had multiple repeat hospitalizations. Extending the gap between hospitalizations should be an important goal of treatment evaluation.


Heart Failure (HF) is a common disease with a high morbidity and mortality. Each year in the United States, 5.1 million individuals with heart failure undergo ∼1 million hospitalizations, 668,000 emergency department visits and ∼3 million physician outpatient visits resulting in an overall cost of approximately $40 billion per year [1]. Given this public health issue, understanding the patterns of recurrent hospitalizations related to HF is important in order to design therapy or management strategies that can help reduce this burden for individual patients and the system.

The 30 day rehospitalization rates for patients with HF remain high in clinical trials (6.0%) [2], registries (24.5%) and in population health studies (18%) [3]. However, the modeling of rehospitalization remains challenging even using models incorporating a large number of patient characteristics [4]. Most analyses attempting to model re-hospitalizations utilize only the first re-hospitalization and fail to incorporate for the repetitive nature or trajectory of re–hospitalizations in patients with HF. A recent study in Olmstead county showed that while 83% of HF patients were hospitalized at least once, 43% were hospitalized four or more times within five years of diagnosis [5]. Several repeated events methods have been considered for these data and have seen limited uptake in part due to the assumptions required for each model [6].

The temporal trends in these data have been explored previously [7] however to this point in time, few studies examining rehospitalization risk have explored the amount of time between hospitalizations (the “gap-time”) [8], which may play a role in identifying patients at increased risk for morbid events. Conceivably, while two patients may exhibit a similar risk of at least one hospitalization, a sicker patient may be re-admitted to hospital more than once and/or with a shorter duration between hospitalizations.

The objective of this study was to describe the gap-time and transitions in a cohort of patients who were hospitalized more than once with heart failure, and explore the patient and system level features associated with the gap-time. We developed a model to examine the timing and risk of both HF-specific and all-cause hospitalization while simultaneously considering the competing risks of all-cause hospitalization and mortality in HF patients, allowing combined modeling of parameters. An improved understanding of the trajectory of heart failure patients is important for determining changes in health state and planning resources.


Ethics statement

The study was approved by the Health Research Ethics Board at the University of Alberta. Patient consent was not obtained; therefore patient records/information were anonymized and de-identified prior to analysis.


The province of Alberta has a single payer, government funded health care system, Alberta Health that provides universal access to its 3.7 million residents. Using the data linked from four administrative databases, a cohort was created that identified patients by identifying their first visit with an inpatient diagnosis of heart failure between January 1, 1999, and December 1, 2008.

The four linked databases include: i) the Discharge Abstract Database (DAD), which records dates for all admissions to acute care facilities with the most responsible and up to 25 other diagnoses or comorbidities; ii) the Ambulatory Care Database (which tracks visits to the Emergency Departments and hospital-based clinics and allows for coding of up to 10 conditions; iii) the physician claims database (which tracks all physician claims for outpatient services and includes up to three diagnoses per encounter); and iv) the registry which contains the birth, death and immigration information for all Alberta residents.


HF hospitalizations were identified as those hospitalizations with a main diagnosis of HF using ICD-9-CM code 428.x (1999–2002) and ICD-10 code I50.x (2002–2008). The accuracy of these ICD codes for HF has been previously validated against chart audit in Alberta and elsewhere [9][11]. Other (non-HF) hospitalizations were those associated with any acute hospitalization for any other main diagnosis. Due to differences in care patterns for patients with hospitalizations in non-acute facilities, patients entering from or discharged to long term care were censored and removed from further analysis.

The cohort was separated into three groups: patients with a single HF hospitalization; patients with two HF hospitalizations in the five years of follow-up; and patients with three or more HF hospitalizations. Patients were followed for up to five years from their index visit (median: 952 days; IQR: 188–1826).

Statistical analysis

Patient characteristics are presented as numbers and percentages for categorical variables and means and standard deviations or medians and IQRs where relevant. Baseline characteristics were compared according to those with a single hospitalization against those with two and three or more hospitalizations.

Comorbidities were evaluated at every hospitalization so that as patients moved through the maximum five years of follow-up, new diagnoses recorded in hospital, an outpatient clinic or an emergency department could be added. Additionally, at each transition outlined below, the total number of emergency department visits where patients were directly discharged without admission (“treat and release”) and physician office visits were counted.

Multivariable models

A series of models were generated adjusted for age, sex, length of stay, acuity of admission, Charlson index, which provides a weighted score based on the number and type of comorbidities, and number of emergency department visits in the six months prior, consistent with the LACE index, which includes the length of stay at the last hospitalization(L), the acuity of the admission (A), the patient's Charlson score (C), and the number of Emergency Department visits in the last six months (E) [12]. Patients were followed for up to five years from their initial HF hospitalization (Figure 1a) to explore changes in gap times as well as the length of stay for each hospitalization. The first set of models utilized a Generalized Estimating Equation (GEE) [8], [13] for the time between hospitalizations. The standard GEE framework examines a single gap-time without consideration for censoring. As such, in the GEE model, we considered the gap-time to be the number of days between discharge from one HF hospitalization until the start of the next hospitalization. Using the GEE approach suggest by Clement, there are limited assumptions about the total number and distribution of events. The GEE model provides a baseline for subsequent model development.

Figure 1. Schematic of timeline for HF patients indicating hospitalizations and Gap times (a); States and transitions for multistate model.

Arrows indicate modeled transformations(b).

The second model used was a multi-state model [14], [15] where patients are assumed to be in one of four states: 1) Community dwelling (i.e., out of hospital); 2) In hospital with HF as a main diagnosis; 3) In hospital for another reason; or 4) Dead. A multistate model was developed based on both the transitions and time spent in each state; the seven permitted transitions are depicted in Figure 1b. This model considers each non-absorbing state (1 to 3) as a competing risk regression on each available transition, conditional on the patients who have arrived at that state. For example a patient not in hospital is eligible to be hospitalized with HF, hospitalized for another reason, or die as available transitions. This type of model allows for the adjustment of patient factors comorbidities and repeat hospitalizations with a primary diagnosis of HF conditional on the current state. The adjusted times estimates are calculated by comparing the fitted sojourn time (time spent in a given state) between the indicated levels of the target covariate with the other covariates set at the mean level to give an estimate of the effect of changing each variable individually. The index hospitalization is considered to be their first hospitalization with a most responsible diagnosis of HF.

The hospitalizations are considered as episodes of care so that if there are multiple hospitalization records within 24 hours they are treated as a single episode of care. We categorized an episode that had at least one admission with HF as the most responsible diagnosis as an “HF hospitalization” (HFH) while any episode with another main diagnosis as an “Other hospitalization”. The model estimates a fitted hazard ratio for the transitions based on the number of hospitalizations, comorbid conditions and outpatient clinic, physician office and emergency department use in the 180 days prior to the hospitalization. From this model, the sojourn time, i.e., the time spent in a given state, was estimated. Two variants of this model are considered: 1) include the number of times that a patient had a HFH to assess the adjusted change in time for repeat hospitalizations; and 2) exclude this information to account only for independent predictors of transition. As a sensitivity analysis we consider the days alive and out of hospital in the year following the discharge from the index episode. In this model we examine the number of days each patient is both alive and not in acute care as a continuous variable during the subsequent year in a multivariable linear regression framework [2].

All Analyses were complete in SAS v. 9.4 (Cary, NC) and R 2.15.2 (Vienna, Austria) using the “msm” package [14].


We identified 40,667 patients with a first HFH between January 1, 1999 and December 1, 2008 who were not discharged to long term care (Figure 2). During five years of follow-up, this cohort accounted for 127,927 emergency department visits with discharge (“treat and release” visits), 93,924 total hospitalizations, 794,004 total days in hospital, 59,591 HFH and 14,235 deaths (of which 53% [n = 7,590] occurred during a HF hospitalization. Nearly half of the cohort had no further HFH (27,106) during the median follow-up of 2.6 years. The cohort was split into three groups based on whether or not they had one, two or ≥ three HF hospitalizations. Patients hospitalized more often for HF were older and were more likely to have virtually all comorbidities such as diabetes, peripheral arterial disease and COPD but not dementia or cancer (Table 1).

Although approximately half of the patients were not re-hospitalized for HF after each subsequent hospitalization, as the number of successive HF hospitalizations increased, the number of days between both HF specific and all cause hospitalizations dropped (Figure 3, Table 2). The median and IQR days between the first and second hospitalization for patients was 168 (41–533) and then 126 (35–378), 103 (28–280), 80 (23–235) for the 2nd 3rd and fourth gap between hospitalizations. The distribution of patient events (censored alive, re-hospitalized or died) by time groups are given in Figure 4.

Figure 3. Unadjusted mean times between HF hospitalizations and times to death for HF patients with at least two hospitalizations (1 gap).

Figure 4. Distribution and times of patients next event following first hospitalization (a); Distribution and times of patients next event following second hospitalization(b).

Table 2. Adjusted ‘Gap-time’ between hospitalizations in days in GEE model.

For each additional point on the Charlson score at baseline, patients exhibited 13.2 (95% CI: 11.2 to 15.1) fewer days between HF hospitalizations and 14.6 (95% CI: 13.6 to 15.7) fewer days between any hospitalizations (Table 2). Similarly, for each additional year of age there were 2.1 (95% CI: 1.6 to 2.5) fewer days between HF hospitalizations and 1.7 (95% CI: 1.4 to 1.9) fewer days between any hospitalizations. The time between HF hospitalizations was on average reduced by approximately one month (mean 28.6 days; 95%CI 22.4 to 34.8) for each subsequent HF hospitalization. With the exception of gender, the direction and relative magnitude of each covariate was similar between HF and non HF hospitalizations. As a sensitivity analysis, we explored adjusted days alive and out of hospital in the year following the index HF hospitalization and found that the relevant variables in Table 2 exhibited similar associations with this outcome (although length of stay could not be included as it was in the adjusted model; data available on request). We found that the time to first event analysis and the gap time models display similar coefficients; however we note that the precision and thus statistical significance of each parameter is less in the time to first event model. The gap time and the days alive and out of hospital model were similar with the exception of the impact of number of visits to the Emergency Department in the six months prior. This difference is likely due to the insensitivity of the days alive and out of hospital model to differentiate between long hospitalizations, multiple short hospitalizations and deaths. As a sensitivity analysis we re-examined the data using only patients who were alive at the end of the follow-up time and the results were similar (data available on request).

The competing risk hazards for each transition in the multi-state model are presented in Table 3. For example, for each additional point on the Charlson scale, a patient currently out of hospital has a 4% (95% CI 4% to 5%) higher risk of another HF hospitalization, an 7% higher risk (95%CI 7% to 8%) of being hospitalized for another reason, and a 10% (95%CI 8% to 11%) increased risk of out of hospital death. If the number of prior HF hospitalizations is also considered as a factor in the model, a patient with two prior HFH currently out of hospital has a 28% (95% CI 23% to 33%) higher risk of another HF hospitalization, a 4% higher risk (95%CI 1% to 7%) of being hospitalized for another reason, and a 23% (95%CI 13% to 34%) increased risk if they have already had 3 or more HF hospitalizations.

The multistate model extends the days alive and out of hospital model as it allows the estimation of the covariate adjusted time spent in each state (Table 4), as there is no pre-specified or fixed amount of follow-up time. For example, the LOS gives the expected length of stay for a given hospitalization for a patient with the specified demographic/comorbidity level. Each row in the table gives the estimate for that covariate with the other covariates set at their mean values. For example, males spend approximately 5% less time out of hospital despite the fact their length of stay is 10% shorter than female patients (Table 4) – this is because they are more likely to have repeat hospitalizations (Table 3). The time spent out of hospital is reduced with increasing comorbidity load. Increasing age did not appear to affect the time spent in hospital with HF.

Table 4. Expected Changes in Adjusted times spent in each state prior to transition with all other covariates set to the mean level.


Our study demonstrates that the gap-time decreases between each successive hospitalization and this pattern is consistent in both models after adjusting for key prognostic variables such as age, number of Emergency Department visits, and Charlson score. Reporting gap times represent an alternative means of understanding the patient experience that traditional outcomes such as time to first event or proportion of patients who have that event in a defined time frame cannot.

There are a variety of other proportional hazards based repeated events models that have been proposed in the literature [6], these models have the advantage of providing additional information with respect to the models. The Andersen-Gill modifies the proportional hazards model by allowing patients to remain a risk even after the event has occurred, and assumes all events are equal. Other formulations consider stratification and ordering of the events, and do not directly model the time between events. There are important considerations in these models in terms of understanding if there are limits on the number of events and the distribution expected time between events, as well as how to consider the end of follow-up [13].

The use of gap time for evaluating the impact of interventions allows insight beyond simple proportion of patients with mortality/re-hospitalization (after all, if follow-up is sufficiently long then this rate approaches 100% for all patients). This is possible by first separating the re-hospitalizations from the mortality events, then separating the HF hospitalizations from the other hospitalizations, and finally considering both the changing risk and the time spent in the community between multiple hospitalizations. Future studies can utilize this framework to increase the information included in the models. Indeed, there are increasing calls to consider multiple events when evaluating interventions for HF patients but it is important to remember that improved survival outcomes may create multiple re-hospitalizations [16], [17].

The gap time concept is similar in concept to the “days alive and out of hospital” which has been reported in several clinical trials [2], [18], [19]. As an outcome measurement, “days alive and out of hospital” has the advantage of being a simple metric, but it cannot provide information on how the time was distributed between hospitalizations nor does it differentiate if an intervention reduced in-hospital time, death, or both.

There have been numerous attempts to develop prediction scores for HF patients (CMS, LACE etc.) [4], [20], [21]. These models, typically based on 30 day outcomes have not been highly predictive with c-indices between 0.5 and 0.7 [4]. There are three principal reasons that these models do not achieve higher predictive accuracy. First, some (e.g., LACE, LaCE) combine the death and rehospitalization endpoints resulting in a lack of differentiation between those risk factors related to dying and those associated with being re-hospitalized. Secondly, 30 day follow-up windows have no direct physiological implication (i.e., a patient having an event on day 31 is likely similar to one having an event on day 30). Third, these scores typically predict time to first event rather than consideration of total number of events over a longer duration of time. The gap-time method allows the incorporation of the factors related to the multiple events, and additionally provides an indication of whether that gap is increasing or decreasing in length between events. Given the high rate of events and observational data our ability to observe and identify repeat events provides a large cohort on which to model the event patterns. We have used data from an administrative database which, while providing a census of HF hospitalizations in the province of Alberta, does not contain other important indicators of clinical significance. Additional data such as ejection fraction or degree of cardiac remodeling may improve the prediction of our models.

One limitation of the multistate methods is that the outcome states need to be defined and each additional state increases the model complexity exponentially. As such there is still a requirement to create reasonably “simple” groupings and it is difficult to consider every possibility. The multi-state strategy does allow for the important comparison of competing risk conditional on the current state of the patient. For example, a patient with advanced age has a slightly increased risk of another HF hospitalization but is at much higher risk of death out of hospital; if in hospital, for any reason, the hazard ratio of death is smaller. The reasons for the differences in hazard ratio may lie in which patients are healthy enough to be re-hospitalized, are more aware of their condition and seek treatment sooner or some other feature worthy of further investigation. Additionally it is important to consider the impact of each state, a patient in hospital can be discharged home (another transient state) or have a death even in hospital (an “absorbing” state, meaning that the patient does not leave). The inclusion of a treatment strategy could be included as a factor in the model which would allow the identification of which transitions are impacted and to what degree. This type of model could form the foundation for a Markov model (which typically requires the transition probabilities to be pre-specified rather than estimated) and may be clinically useful if deployed in an electronic health record in order to deploy appropriate resources for individual patients flagged as being at above average risk for adverse outcomes. For example, a targeted outpatient intervention may be possible for patients at a high risk of re-hospitalization. We were unable to include medications in our study but this would be next step if it were to include drug type and dose or other interventions into the model.

The development of multi-state models is complex and would benefit from longer term follow-up data and registry/population level data to populate the transitions between states. In the current era of quality metrics, monitoring of these data is becoming increasingly common.

We described the ‘gap-time’ for patients with heart failure and demonstrated the importance of separating the sources of competing risk for HF patients during follow-up. The gap-time decreased between successive HF hospitalizations, even after accounting for mortality. The use of information such as the gap time provides additional insight into patient experiences (and a potential other outcome for comparative effectiveness studies) beyond the occurrence of short term composite endpoints or time to first even analyses, and is particularly important for chronic diseases like heart failure.

Author Contributions

Analyzed the data: WL. Contributed to the writing of the manuscript: JAB FAM WL JAE.


  1. 1. Go AS, Mozaffarian D, Roger VL, Benjamin EJ, Berry JD, et al. (2013) Heart disease and stroke statistics–2013 update: A report from the American Heart Association. Circulation 127(1): e6–e245.
  2. 2. O′Connor CM, Starling RC, Hernandez AF, Armstrong PW, Dickstein K, et al. (2011) Effect of nesiritide in patients with acute decompensated heart failure. N Engl J Med 365(1): 32–43.
  3. 3. McAlister FA, Bakal JA, Kaul P, Quan H, Blackadar R, et al. (2013) Changes in heart failure outcomes after a province-wide change in health service provision a natural experiment in Alberta, Canada. Circ Heart Fail 6(1): 76–82.
  4. 4. Au AG, McAlister FA, Bakal JA, Ezekowitz J, Kaul P, et al. (2012) Predicting the risk of unplanned readmission or death within 30 days of discharge after a heart failure hospitalization. Am Heart J 164(3): 365–372.
  5. 5. Dunlay SM, Redfield MM, Weston SA, Therneau TM, Hall Long K, et al. (2009) Hospitalizations after heart failure diagnosis a community perspective. J Am Coll Cardiol 54(18): 1695–1702.
  6. 6. Kelly PJ, Lim LL (2000) Survival analysis for recurrent event data: An application to childhood infectious diseases. Stat Med 19(1): 13–33.
  7. 7. Ezekowitz JA, Kaul P, Bakal JA, Quan H, McAlister FA (2011) Trends in heart failure care: has the incident diagnosis of heart failure shifted from the hospital to the emergency department and outpatient clinics? Eur J Heart Fail 13(2): 142–147.
  8. 8. Hardin J, Hilbe J (2003) Generalized estimating equations. Vol 68(2). London: Chapman and Hall/CRC: 373–379.
  9. 9. Lee DS, Donovan L, Austin PC, Gong Y, Liu PP, et al. (2005) Comparison of coding of heart failure and comorbidities in administrative and clinical data for use in outcomes research. Med Care 43(2): 182–188.
  10. 10. Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, et al. (2005) Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care 43(11): 1130–1139.
  11. 11. Goff DC Jr, Pandey DK, Chan FA, Ortiz C, Nichaman MZ (2000) Congestive heart failure in the united states: Is there more than meets the I(CD code)? the corpus christi heart project. Arch Intern Med 160(2): 197–202.
  12. 12. van Walraven C, Dhalla IA, Bell C, Etchells E, Stiell IG, et al. (2010) Derivation and validation of an index to predict early death or unplanned readmission after discharge from hospital to the community. CMAJ 182(6): 551–557.
  13. 13. Clement D, Strawderman R (2009) Conditional GEE for gap times. Biostatistics 10(3): 451–467.
  14. 14. Jackson CH (2011) Multi-state models for panel data: The msm package for R. Journal of Statistical Software 38(8): 1–29.
  15. 15. Putter H, Fiocco M, Geskus RB (2007) Tutorial in biostatistics: Competing risks and multi-state models. Stat Med 26(11): 2389–2430.
  16. 16. Anker SD, McMurray JJ (2012) Time to move on from ‘time-to-first’: Should all events be included in the analysis of clinical trials? Eur Heart J 33(22): 2764–2765.
  17. 17. Claggett B, Wei LJ, Pfeffer MA (2013) Moving beyond our comfort zone. Eur Heart J 34(12): 869–871.
  18. 18. Cuffe MS, Califf RM, Adams KF Jr, Benza R, Bourge R, et al. (2002) Short-term intravenous milrinone for acute exacerbation of chronic heart failure: A randomized controlled trial. JAMA 287(12): 1541–1547.
  19. 19. Teerlink JR, Cotter G, Davison BA, Felker GM, Filippatos G, et al. (2013) Serelaxin, recombinant human relaxin-2, for treatment of acute heart failure (RELAX-AHF): A randomised, placebo-controlled trial. Lancet 381(9860): 29–39.
  20. 20. Keenan PS, Normand SL, Lin Z, Drye EE, Bhat KR, et al. (2008) An administrative claims measure suitable for profiling hospital performance on the basis of 30-day all-cause readmission rates among patients with heart failure. Circ Cardiovasc Qual Outcomes 1(1): 29–37.
  21. 21. van Walraven C, Dhalla IA, Bell C, Etchells E, Stiell IG, et al. (2010) Derivation and validation of an index to predict early death or unplanned readmission after discharge from hospital to the community. CMAJ 182(7): 798–803.