Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Persistent frequent emergency department users with chronic conditions: A population-based cohort study

  • Yohann Moanahere Chiu ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    yohann.chiu@usherbrooke.ca

    Affiliations Département de médecine de famille et de médecine d’urgence, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, Quebec, Canada, Centre de recherche du Centre hospitalier universitaire de Sherbrooke, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, Quebec, Canada

  • Alain Vanasse,

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – review & editing

    Affiliations Département de médecine de famille et de médecine d’urgence, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, Quebec, Canada, Centre de recherche du Centre hospitalier universitaire de Sherbrooke, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, Quebec, Canada

  • Josiane Courteau,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Software, Validation, Visualization, Writing – review & editing

    Affiliation Département de médecine de famille et de médecine d’urgence, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, Quebec, Canada

  • Maud-Christine Chouinard,

    Roles Conceptualization, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Writing – review & editing

    Affiliation Département des sciences de la santé, Université du Québec à Chicoutimi, Chicoutimi, Quebec, Canada

  • Marie-France Dubois,

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Writing – review & editing

    Affiliation Département des sciences de la santé communautaire, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, Quebec, Canada

  • Nicole Dubuc,

    Roles Conceptualization, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Writing – review & editing

    Affiliation École des sciences infirmières, Université de Sherbrooke, Sherbrooke, Quebec, Canada

  • Nicolas Elazhary,

    Roles Conceptualization, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Writing – review & editing

    Affiliation Département de médecine de famille et de médecine d’urgence, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, Quebec, Canada

  • Isabelle Dufour,

    Roles Software, Validation, Writing – review & editing

    Affiliations Département de médecine de famille et de médecine d’urgence, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, Quebec, Canada, École des sciences infirmières, Université de Sherbrooke, Sherbrooke, Quebec, Canada

  • Catherine Hudon

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliations Département de médecine de famille et de médecine d’urgence, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, Quebec, Canada, Centre de recherche du Centre hospitalier universitaire de Sherbrooke, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, Quebec, Canada

Abstract

Background

Frequent emergency department users are patients cumulating at least four visits per year. Few studies have focused on persistent frequent users, who maintain their frequent user status for multiple consecutive years. This study targets an adult population with chronic conditions, and its aims are: 1) to estimate the prevalence of persistent frequent ED use; 2) to identify factors associated with persistent frequent ED use (frequent use for three consecutive years) and compare their importance with those associated with occasional frequent ED use (frequent use during the year following the index date); and 3) to compare characteristics of “persistent frequent users” to “occasional frequent users” and to “users other than persistent frequent users”.

Methods

This is a retrospective cohort study using Quebec administrative databases. All adult patients who visited the emergency department in 2012, diagnosed with chronic conditions, and living in non-remote areas were included. Patients who died in the three years following their index date were excluded. The main outcome was persistent frequent use (≥4 visits per year during three consecutive years). Potential predictors included sociodemographic characteristics, physical and mental comorbidities, and prior healthcare utilization. Odds ratios were computed using multivariable logistic regression.

Results

Out of 297,182 patients who visited ED at least once in 2012, 3,357 (1.10%) were persistent frequent users. Their main characteristics included poor socioeconomic status, mental and physical comorbidity, and substance abuse. Those characteristics were also present for occasional frequent users, although with higher percentages for the persistent user group. The number of previous visits to the emergency department was the most important factor in the regression model. The occasional frequent users’ attrition rate was higher between the first and second year of follow-up than between the second and third year.

Conclusions

Persistent frequent users are a subpopulation of frequent users with whom they share characteristics, such as physical and mental comorbidities, though the former are poorer and younger. More research is needed in order to better understand what factors can contribute to persistent frequent use.

Introduction

Frequent emergency department (ED) users constitute a small number of ED users, but account for a disproportionately large number of total ED visits [1]. Definition of frequent users varies, though the most common definitions include having more than three or four visits during a 12-month period [2, 3]. As each type of population has its own characteristics, those definitions are context dependent and therefore may vary. For instance, timely palliative care reduces number of ED visits near the end of life because of specific care given to patients [4, 5] while patients with asthma may require more ED visits, as they are more prone to exacerbations. [6, 7]. Even though, ED visits are not necessarily evitable, for instance regarding older adults [8]. Frequent ED users often receive non-optimal and fragmented care in EDs [9], due to their complex healthcare needs. Furthermore, they have higher hospital admissions and outpatient visits along with higher mortality rate [3]. In addition to higher healthcare costs, health outcomes associated with frequent ED use are non-optimal, in contrast to timely interventions from more appropriate health resources, such as in primary care [10]. A significant proportion of frequent ED users are patients with vulnerability factors, such as poor mental health [11], socio-economic precarity [12], or chronic conditions [1, 13, 14].

Among frequent users, a subgroup of persistent users keeps on visiting EDs frequently over a multiple-year period [1, 1518]. Definitions of persistent frequent ED use vary in the number of visits per year (from more than three visits to more than five visits per year) and in the considered period (from a two-year period to a five-year period). Although their prevalence ranges from 1 to 20%, they can account for more than 60% of the total visit volume [2]. Factors associated with persistent frequent use are physical disorders, mental health disorders, substance abuse, previous number of ED visits, and being a frequent ED user the previous year [2]. Many studies have examined frequent ED use, but few have explored persistent frequent ED use. Besides, few studies have explored persistent frequent use considering chronic conditions.

The study targets an adult population with chronic conditions, and its aims are 1) to estimate the prevalence of persistent frequent ED use; 2) to identify factors associated with persistent frequent ED use (frequent use for three consecutive years) and compare their importance with those associated with occasional frequent ED use (frequent use during the year following the index date); and 3) to compare characteristics of “persistent frequent users” to “occasional frequent users” and to “users other than persistent frequent users” (which include non-frequent users and occasional frequent users).

Materials and methods

This research was completed in accordance with the TRIPOD guidelines (see the Table in S1 Table) [19].

Design and data sources

The provincial health insurance board of the Quebec Province (Régie de l’assurance maladie du Québec or RAMQ) is the provincial organism in charge of universal healthcare services for all of Quebec residents. We conducted a population-based retrospective cohort study using its health databases:

  • The patient demographic register, which contains information about the sex, date of birth, date of death, and place of residence of the patient;
  • The physician reimbursement claim register, which contains information about medical services provided by a fee-for-service physician in Quebec: date of service, place of service (emergency, medical clinic, etc.), physician specialty, diagnosis (International Classification of Diseases, ninth revision or ICD-9), and the medical act procedure performed by the physician;
  • The hospital register (MED-ECHO), which contains information about the reasons for hospitalization (main diagnosis and up to 25 secondary diagnoses coded in ICD-10), dates of admission and release from hospital, and all medical procedures performed during the hospitalization.

Patient information from those databases were linked using unique encrypted identifiers.

Study population

The study population included all adults (≥18 years old) living in the province of Quebec, with at least one ED visit during the inclusion period, i.e. between the 1st of January 2012 and the 31st of December 2012, and diagnosed with one or more chronic conditions. In this study, we considered the Canadian Institute for Health Information definitions for ambulatory care sensitive conditions (see S1 and S2 Tables) [20]: asthma, chronic obstructive pulmonary disease or COPD, congestive heart failure or CHF, coronary heart disease or CHD, diabetes, epilepsy, and high blood pressure or HBP. Diagnoses were considered during a hospitalization or during two physician visits in the two-year period before the index date. The index date was randomly assigned as one ED visit among all ED visits occurring during the inclusion period [21].

There were two exclusion criteria (Fig 1). First, ED use can be different between urban and remote areas since remote residents tend to use it as an alternative to walk-in clinics as there are fewer primary care alternatives [22, 23]. Thus, patients living in municipalities with fewer than 10,000 inhabitants with weak or no metropolitan influence zone (remote areas, i.e. the percentage of resident employed labour force who commute to work in urban areas is less than 5%) were excluded from the study population. However, patients living in municipalities with fewer than 10,000 inhabitants with high or moderate metropolitan influence were included. Secondly, patients who died during the three years after their index date were excluded as they tend to require specialized healthcare (i.e. patients at the end of life [24, 25]). Besides, that last exclusion helps reduce immortal time bias [26]. Each patient had a follow-up time of three years.

Outcome and independent variables

The outcome was defined as being a persistent frequent user (binary variable, yes/no). In this study, frequent ED use was defined as having four or more ED visits in the year following their index date, while persistent frequent ED use was defined as frequent ED use during three consecutive years. To emphasize the difference between persistent frequent ED use and frequent ED use, we define a frequent ED user as “occasional frequent ED user”. Occasional frequent ED users and persistent frequent ED users are two mutually exclusive categories, while “users other than persistent frequent users” exclude persistent frequent users but include occasional frequent users.

Independent variables considered were: sex, age category (18-34, 35-54, 55-64, 65-74, 75-84, and ≥85), the type of residential area (categorical variable: metropolitan: ≥100,000 inhabitants; small town: 10,000–100,000 inhabitants; rural: <10,000 inhabitants with high or moderate metropolitan influence), material and social deprivation indices [27], public prescription drug insurance plan status (PPDIP, see below for the different statuses), diagnosis for each chronic condition (yes/no), diagnosis of depression or psychosis (yes/no), diagnosis of substance or drug abuse (yes/no), diagnosis of dementia (yes/no), having at least one hospitalization episode in the two years before the index date (yes/no), the number of ED visits during the year before the index date (≤1, 2, 3, 4, ≥5), and the combined comorbidity index of Charlson and Elixhauser [28]. This index was modified to exclude the considered chronic conditions and was constructed using the following comorbidities: cardiac arrhythmia, any tumor without metastasis, peripheral vascular disorders, neurological disorders, cerebrovascular disease, renal disease, metastatic cancer, fluid and electrolyte disorders, liver disease, rheumatoid arthritis/collagen vascular disease, coagulopathy, weight loss, paralysis, and HIV/AIDS. The reported diagnoses in MED-ECHO (one diagnosis) or in the physician claims records (at least two diagnoses) were used to identify each condition during a two-year period before the index date.

Regarding PPDIP status, it is subdivided according to four different statuses: “not admissible to PPDIP” (individuals with a private insurance plan), “admissible to PPDIP and age ≥65 years with guaranteed income supplement” (GIS), “admissible to PPDIP and being a recipient of last-resort financial assistance” (LRFA), or “regular recipient of PPDIP”.

Statistical analysis

First, we reported the prevalence of persistent frequent ED use and the associated 99.9% confidence interval. Second, we used multivariable logistic regression to identify characteristics associated with persistent frequent ED use, since the outcome is a binary variable (“persistent frequent ED users” versus “users other than persistent frequent ED users”), and those associated with occasional frequent ED use (“occasional frequent ED users” versus “users other than occasional frequent ED users and persistent frequent ED users”). We reported odds ratios and associated 99.9% confidence intervals. Furthermore, given the small prevalence of the outcome, we used Firth’s correction for logistic regression to reduce potential bias in the parameter estimations [29]. The models controlled for sex and age category. For others independent variables, automatic variable selection was implemented using backward selection, which consists in starting with a full model containing all variables, then deleting one at a time based on its statistical significance (Wald test) [30]. We used a split-sample approach in our models: we defined development and validation samples using a temporal split (at July 1st, 2012, Fig 1), as it is considered a stronger approach for developing and validating prognostic models [31]. Variable selection was performed on the development sample (first 50% of the cohort, n = 150,209), while odds ratios were obtained on the validation sample (remaining 50%, n = 146,973). Third, to compare characteristics between persistent frequent users and occasional frequent users or users other than persistent frequent users, chi-square tests of independence were used. Given the large sample size, statistical significance level was set at α = 0.001. All analyses were performed with SAS version 9.4.

Ethics approval

The research ethics board of the Centre intégré universitaire de santé et de services sociaux de l’Estrie–Centre hospitalier universitaire de Sherbrooke approved this study. All data used in this study were fully anonymized.

Results

Out of 297,182 patients who met the eligibility criteria, 1.1% (confidence interval 1.0-1.2%) were considered persistent frequent users (Table 1). Out of the 17,981 frequent users who were followed during their first year, 6,132 were still frequent users after two years and 3,357 after three years. Those users represented respectively 34.1% and 18.7% of the frequent users. The latter were thus characterized as persistent frequent users, as they maintained their status over three consecutive years. Furthermore, they used 9.5%, 9.2% and 8.9% of total ED visits during their three years of follow-up (Fig 2). Their number of ED visits per year ranged from 4 to 59 (median of 7 visits).

thumbnail
Table 1. Number of frequent users each year and relative to the first year.

Prevalence for persistent frequent use is in italic.

https://doi.org/10.1371/journal.pone.0229022.t001

thumbnail
Fig 2. Percentages of non-frequent (gray), occasional frequent (blue), and persistent frequent (orange) users relative to a) the number of ED visits (three bottom rows) and b) the number of ED users (three top rows) for each year of follow-up (Y1, Y2 and Y3).

https://doi.org/10.1371/journal.pone.0229022.g002

Odds ratios and model fit criteria for frequent use are presented in Table 2, based on the validation sample (n = 146,973). Two models are presented: one for occasional frequent use and one for persistent frequent use, both compared to the entire validation sample. Significant associated variables selected in the development sample (n = 150,209) were age, PPDIP admissibility, presence of COPD, CHD and diabetes, number of previous ED visits, comorbidity index, and diagnosis of depression or drug abuse. Besides those variables, occasional frequent ED use was associated with presence of asthma, coronary heart disease, and diabetes, social and material deprivation indices, and type of residential area. Being a recipient of LRFA and the previous number of ED visits were associated with the two largest odds ratios for persistent frequent ED use (respectively 2.8 and 39.1 for at 5 ED visits or more). We also evaluated our models on the full sample (without splitting) and we obtained similar results.

thumbnail
Table 2. Odds ratios (99.9% confidence interval) and model fit criteria from multiple logistic regression for occasional frequent users and persistent frequent users, based on the validation sample (n = 146,973).

https://doi.org/10.1371/journal.pone.0229022.t002

There were slightly more women in the persistent frequent user group than in the occasional frequent user group (59% and 56% respectively, Table 3). Persistent frequent users were also younger than occasional frequent users (higher proportion in the 35-54 category and lower proportions especially in the ≥85 category). Furthermore, there was a larger proportion of recipients of LRFA for persistent frequent users (31% versus 15% for occasional frequent users) and a reduced proportion of other PPDIP statuses. This indicates low socioeconomic standing, which relates to the distribution of those users in the higher material and social deprivation indices. However, repartition in the residential areas was similar. Except for high blood pressure, persistent frequent users had higher chronic condition prevalence than the occasional frequent users had. Persistent frequent users also had higher comorbidity indices. Furthermore, an important proportion of persistent frequent users were already frequent users in the year before their index dates since more than 60% had four or more previous ED visits. In comparison, this percentage was 28% for occasional frequent users. Drug and alcohol abuse, depression and psychoses were also more prevalent in the persistent frequent user group, whereas dementia was slightly less prevalent. Overall, the differences mentioned in this paragraph were also noticeable between users other than persistent frequent users, and occasional frequent users and persistent frequent users. For instance, chronic obstructive pulmonary disease prevalence increased from 14% to 25% and 37% for each type of users, respectively.

thumbnail
Table 3. Descriptive statistics for the cohort, users other than persistent frequent users, occasional frequent users, and persistent frequent users.

https://doi.org/10.1371/journal.pone.0229022.t003

Discussion

To the best of our knowledge, this work is the first to focus on persistent frequent ED users with chronic conditions. In this study, persistent frequent users represented 1.1% of the cohort, adding up to 9% of total ED visits each year. This prevalence is consistent with other studies about persistent frequent users in children and nonelderly adults [3234]. Those studies used the same definition (≥4 ED visits during three consecutive years). Hudon et al. (2017) reported a higher prevalence of 2.6%, but their threshold for defining persistent frequent use was lower (≥3 ED visits during three consecutive years) and they focused on a diabetic population [35].

The variables associated with persistent frequent use found in this study were all reported by previous studies [32, 33, 35, 36], while some studied both occasional frequent use and persistent frequent use [32, 33, 36]. In those same studies, depending on the studied population, some specific diagnoses were also associated with persistent frequent use, such as COPD diagnosis. Besides, a few studies mentioned race [32, 33] and deprivation indices [32, 35, 36] as significant, though those latter were not necessarily the same indices as ours. Race was not available in our databases and deprivation indices were not significant in our analyses of persistent frequent use. Andren and Rosenqvist (1987) mentioned that patient’s loneliness and good rating of how they have been received at the ED increased the risk of returning to the ED in the next year in a two-year follow-up study [15]. Those variables had been collected during interviews and were not available in our databases. Thus, it would be relevant to include self-reported variables in a future work, complementary to administrative data.

Understanding reasons that may lead occasional frequent use to persistent frequent use is not trivial, as one type was not so different from the other one. In our study, they both were patients with a high comorbidity burden, diagnosed with depression and drug abuse, and with a history of ED visits. Regarding occasional frequent users with chronic conditions, Hudon et al. (2019) highlighted those same characteristics [21]. However, there were differences in our results. For instance, the social deprivation index, diagnosis of diabetes, or the type of residential area were not included in the persistent frequent use model, although they were in the occasional frequent use one. Furthermore, persistent frequent users were younger and had a heavier ED history (60% had more than four ED visits while this proportion was 27% for occasional frequent users). Finally, odds ratios for PPDIP status (being a recipient of LRFA) and number of previous ED visits were larger for persistent frequent use than for occasional frequent use, while other odds ratios were comparable in the two cases. We are not aware of other studies comparing those two variables between persistent frequent and occasional frequent users, but some reported Medicaid, an American federal insurance for patients with low-income amongst others [37], as associated with persistent frequent use [32, 38].

Previous use of ED turned out to be the most important associated factor for all the models, though its impact was stronger in the case of persistent frequent use (larger odds ratios) than in the case of occasional frequent use. The importance of previous ED use has been stated in previous studies, in the cases of occasional frequent use and persistent frequent use [2, 6, 17, 39, 40]. In particular, when studied in the baseline year, it has been reported as the strongest predictor of persistent frequent ED use in the subsequent year [32]. This may be explained by the fact that many occasional frequent ED users will not keep on visiting ED frequently and most of them will not have as many previous ED visits as already established persistent frequent ED users. Thus, previous use of ED has greater importance when it comes to studying persistent frequent ED use.

Many of the persistent frequent users in this study were already frequent users in the year before their index dates. They may have been frequent users for an even longer time than studied here. More precisely, frequent use attrition (i.e. proportion of frequent users who do not maintain their status the following year) was higher after the first year, compared to the second year (Table 1). Relative to the first-year frequent users, 34.0% maintained their status over the next year and 18.7% over the next two years. Two other studies reported this rate of decline slowing after the first year, with similar rates [15, 18], though they did not focus on a population with chronic conditions. In particular, Mandelberg et al. (2000) found that frequent users in their first year had a probability of 37.9% to maintain their status for another consecutive year [18]. This probability increased to 56.1% after two years of frequent use and to 78.7% after five years of frequent use. This suggests a “core” group in persistent frequent users.

Targeting persistent frequent users for specific interventions (such as case management [10]) may be even more relevant than targeting occasional frequent users. However, identifying them may also be more challenging. Firstly, administrative and medical data usually do not include self-perceived variables. Secondly, the high imbalance of class (persistent frequent users represent 1.1% of our cohort) means that traditional statistical models may not perform well. Since the majority of cases are not persistent frequent users, most of the statistical models will mainly use information from those cases, resulting in a suboptimal use of the information. One study showed that when the class of interest amounts to 1% of the observations, logistic regression has limited power compared to more advanced techniques, such as random forests [41]. Some adaptations exist for imbalanced data, but none has been applied to frequent ED users yet [42]. For instance, artificially balanced datasets or cost-sensitive methods, which have been used in medical sciences [43, 44], could be of interest for increasing the classification performances.

Limitations

We did not include self-perceived variables, such as physical pain or mental distress. Those variables were not available in our databases and are associated with occasional frequent use [45, 46], though they have not been studied with persistent frequent use. We also did not have access to financial status or education at the individual level. Proxy variables such as social and material deprivation and PPDIP were used instead. Lastly, our study investigated ED users with chronic conditions (defined as 1 hospitalization or 2 physician visits related to a chronic condition in the two year period before the index date, though we did not investigate the reasons for ED visits during the follow-up period), thus limiting its generalization to all ED users.

Conclusions

This paper focuses on persistent frequent ED users with chronic conditions. It highlights the fact that those users, who are a special case of frequent ED users over three consecutive years (1.1% of the total cohort), share similarities with occasional frequent users such as physical and mental comorbidities, though with higher rates. However, they are younger and poorer than occasional frequent users. Those characteristics would make them priority targets for specialized interventions. More studies are needed in order to fully characterize persistent frequent use and to understand what factors can transform occasional frequent use into persistent frequent use, especially using other databases than administrative ones or specialized statistical methods for imbalanced data.

Supporting information

S1 Table. TRIPOD checklist for reporting cohort studies.

https://doi.org/10.1371/journal.pone.0229022.s001

(DOCX)

S2 Table. International classification of diseases for diagnoses used in this study.

https://doi.org/10.1371/journal.pone.0229022.s002

(DOCX)

Acknowledgments

The authors would like to thank Tina Wey (PhD) for revising the text and two anonymous reviewers whom helped improve the quality of this paper.

References

  1. 1. Billings J, Raven MC. Dispelling an urban legend: frequent emergency department users have substantial burden of disease. Health Aff (Millwood). 2013;32(12):2099–108.
  2. 2. Krieg C, Hudon C, Chouinard MC, Dufour I. Individual predictors of frequent emergency department use: A scoping review. BMC Health Serv Res. 2016;16(1).
  3. 3. Moe J, Kirkland S, Ospina MB, Campbell S, Long R, Davidson A, et al. Mortality, admission rates and outpatient use among frequent users of emergency departments: A systematic review. Emerg Med J. 2016;33(3):230–6. pmid:25953837
  4. 4. McNamara BA, Rosenwax LK, Murray K, Currow DC. Early admission to community-based palliative care reduces use of emergency departments in the ninety days before death. J Palliat Med. 2013;16(7):774–9. pmid:23676094
  5. 5. Spilsbury K, Rosenwax L, Arendts G, Semmens JB. The Association of Community-Based Palliative Care With Reduced Emergency Department Visits in the Last Year of Life Varies by Patient Factors. Ann Emerg Med. 2017;69(4):416–25. pmid:28169049
  6. 6. Grinspan ZM, Shapiro JS, Abramson EL, Hooker G, Kaushal R, Kern LM. Predicting frequent ED use by people with epilepsy with health information exchange data. Neurology. 2015;85(12):1031–8. pmid:26311752
  7. 7. Griswold SK, Nordstrom CR, Clark S, Gaeta TJ, Price ML, Camargo CA Jr. Asthma exacerbations in North American adults: who are the “frequent fliers” in the emergency department? Chest. 2005;127(5):1579–86. pmid:15888831
  8. 8. Gruneir A, Silver MJ, Rochon PA. Review: Emergency department use by older adults: A literature review on trends, appropriateness, and consequences of unmet health care needs. Med Care Res Rev. 2011;68(2):131–55. pmid:20829235
  9. 9. Shumway M, Boccellari A, O’Brien K, Okin RL. Cost-effectiveness of clinical case management for ED frequent users: results of a randomized trial. Am J Emerg Med. 2008;26(2):155–64. pmid:18272094
  10. 10. Kumar GS, Klein R. Effectiveness of case management strategies in reducing emergency department visits in frequent user patient populations: A systematic review. J Emerg Med. 2013;44(3):717–29. pmid:23200765
  11. 11. Hunt KA, Weber EJ, Showstack JA, Colby DC, Callaham ML. Characteristics of Frequent Users of Emergency Departments. ANN EMERG MED. 2006;48(1):1–8. pmid:16781914
  12. 12. Bieler G, Paroz S, Faouzi M, Trueb L, Vaucher P, Althaus F, et al. Social and medical vulnerability factors of emergency department frequent users in a universal health insurance system. Acad Emerg Med. 2012;19(1):63–8. pmid:22221292
  13. 13. Kirby SE, Dennis SM, Jayasinghe UW, Harris MF. Patient related factors in frequent readmissions: The influence of condition, access to services and patient choice. BMC Health Serv Res. 2010;10.
  14. 14. Chukmaitov AS, Tang A, Carretta HJ, Menachemi N, Brooks RG. Characteristics of all, occasional, and frequent emergency department visits due to ambulatory care-sensitive conditions in Florida. J Ambul Care Manage. 2012;35(2):149–58. pmid:22415289
  15. 15. Andrén KG, Rosenqvist U. Heavy users of an emergency department-A two year follow-up study. Soc Sci Med. 1987;25(7):825–31. pmid:3686111
  16. 16. Rask KJ, Williams MV, McNagny SE, Parker RM, Baker DW. Ambulatory health care use by patients in a public hospital emergency department. J Gen Intern Med. 1998;13(9):614–20. pmid:9754517
  17. 17. Okuyemi KS, Frey B. Describing and predicting frequent users of an emergency department. J Assoc Acad Minor Phys. 2001;12(1–2):119–23. pmid:11851196
  18. 18. Mandelberg JH, Kuhn RE, Kohn MA. Epidemiologic analysis of an urban, public emergency department’s frequent users. Academic Emergency Medicine. 2000;7(6):637–46. pmid:10905642
  19. 19. Collins GS, Reitsma JB, Altman DG, Moons KGM. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMC Med. 2015;13(1):1.
  20. 20. Canadian Institute for Health Information. Ambulatory Care Sensitive Conditions 2019 [http://indicatorlibrary.cihi.ca/display/HSPIL/Ambulatory+Care+Sensitive+Conditions.
  21. 21. Hudon C, Courteau J, Chiu Y, Chouinard MC, Dubois MF, Dubuc N, et al. Risk of frequent ED utilization among an ambulatory care sensitive condition population: a population-based cohort study. Med Care. In press.
  22. 22. Rechel B, Dzakula A, Duran A, Fattore G, Edwards N, Grignon M, et al. Hospitals in rural or remote areas: An exploratory review of policies in 8 high-income countries. Health Policy. 2016;120(7):758–69. pmid:27312144
  23. 23. Haggerty JL, Roberge D, Pineault R, Larouche D, Touati N. Features of primary healthcare clinics associated with patients’ utilization of emergency rooms: urban–rural differences. Healtc Policy. 2007;3(2):72.
  24. 24. Rosenwax LK, McNamara BA, Murray K, McCabe RJ, Aoun SM, Currow DC. Hospital and emergency department use in the last year of life: a baseline for future modifications to end-of-life care. Med J Aust. 2011.
  25. 25. Barbera L, Taylor C, Dudgeon D. Why do patients with cancer visit the emergency department near the end of life? Canadian Medical Association Journal. 2010;182(6):563–8. pmid:20231340
  26. 26. Lévesque LE, Hanley JA, Kezouh A, Suissa S. Problem of immortal time bias in cohort studies: example using statins for preventing progression of diabetes. Bmj. 2010;340:b5087. pmid:20228141
  27. 27. Pampalon R, Hamel D, Gamache P. The Quebec index of material and social deprivation: methodological follow-up, 1991 through 2006: Institut national de santé publique du Québec; 2011.
  28. 28. Simard M, Sirois C, Candas B. Validation of the Combined Comorbidity Index of Charlson and Elixhauser to Predict 30-Day Mortality Across ICD-9 and ICD-10. Med Care. 2018;56(5):441–7 pmid:29578951
  29. 29. Firth D. Bias reduction of maximum likelihood estimates. Biometrika. 1993;80(1):27–38.
  30. 30. Harrell FE Jr. Regression Modeling Strategies With Applications to Linear Models, Logistic and Ordinal Regression, and Survival Analysis. 2 ed. Switzerland: Springer International Publishing; 2015.
  31. 31. Moons KG, Altman DG, Reitsma JB, Ioannidis JP, Macaskill P, Steyerberg EW, et al. Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): explanation and elaboration. Ann Intern Med. 2015;162(1):W1–73. pmid:25560730
  32. 32. Kanzaria HK, Niedzwiecki MJ, Montoy JC, Raven MC, Hsia RY. Persistent Frequent Emergency Department Use: Core Group Exhibits Extreme Levels Of Use For More Than A Decade. Health Affairs. 2017;36(10):1720–8. pmid:28971916
  33. 33. Peltz A, Samuels-Kalow ME, Rodean J, Hall M, Alpern ER, Aronson PL, et al. Characteristics of children enrolled in medicaid with high-frequency emergency department use. Pediatrics. 2017;140(3).
  34. 34. Colligan EM, Pines JM, Colantuoni E, Howell B, Wolff JL. Risk Factors for Persistent Frequent Emergency Department Use in Medicare Beneficiaries. Ann Emerg Med. 2016;67(6):721–9. pmid:26947801
  35. 35. Hudon C, Courteau J, Krieg C, Vanasse A. Factors associated with chronic frequent emergency department utilization in a population with diabetes living in metropolitan areas: A population-based retrospective cohort study. BMC Health Serv Res. 2017;17(1).
  36. 36. Lee J, Lin J, Suter LG, Fraenkel L. Persistently Frequent Emergency Department Utilization among Persons with Systemic Lupus Erythematosus. Arthritis Care Res (Hoboken). 2018.
  37. 37. Centers for Medicare & Medicaid Services. Eligibility|Medicaid.gov 2019 [https://www.medicaid.gov/medicaid/eligibility/index.html.
  38. 38. Colligan EM, Pines JM, Colantuoni E, Wolff JL. Factors Associated with Frequent Emergency Department Use in the Medicare Population. Med Care Res Rev. 2017;74(3):311–27. pmid:27030234
  39. 39. Das LT, Abramson EL, Stone AE, Kondrich JE, Kern LM, Grinspan ZM. Predicting frequent emergency department visits among children with asthma using EHR data. Pediatr Pulmonol. 2017;52(7):880–90. pmid:28557381
  40. 40. Hudon C, Courteau J, Chiu Y, Chouinard MC, Dubois MF, Dubuc N, et al. Risk of frequent ED utilization among an ambulatory care sensitive condition population: a population-based cohort study. Submitted. 2019.
  41. 41. Brown I, Mues C. An experimental comparison of classification algorithms for imbalanced credit scoring data sets. Expert Systems with Applications. 2012;39(3):3446–53.
  42. 42. Haixiang G, Yijing L, Shang J, Mingyun G, Yuanyue H, Bing G. Learning from class-imbalanced data: Review of methods and applications. Expert Systems with Applications. 2017;73:220–39.
  43. 43. Richardson AM, Lidbury BA. Infection status outcome, machine learning method and virus type interact to affect the optimised prediction of hepatitis virus immunoassay results from routine pathology laboratory assays in unbalanced data. BMC Bioinformatics. 2013;14(1):206.
  44. 44. Cheng T-H, Hu PJ-H. A data-driven approach to manage the length of stay for appendectomy patients. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans. 2009;39(6):1339–47.
  45. 45. Blyth FM, March LM, Brnabic AJ, Cousins MJ. Chronic pain and frequent use of health care. Pain. 2004;111(1–2):51–8. pmid:15327808
  46. 46. Byrne M, Murphy AW, Plunkett PK, McGee HM, Murray A, Bury G. Frequent attenders to an emergency department: a study of primary health care use, medical profile, and psychosocial characteristics. ANN EMERG MED. 2003;41(3):309–18. pmid:12605196