to develop and validate the Drug Derived Complexity Index (DDCI), a predictive model derived from drug prescriptions able to stratify the general population according to the risk of death, unplanned hospital admission, and readmission, and to compare the new predictive index with the Charlson Comorbidity Index (CCI).
Population-based cohort study, using a record-linkage analysis of prescription databases, hospital discharge records, and the civil registry. The predictive model was developed based on prescription patterns indicative of chronic diseases, using a random sample of 50% of the population. Multivariate Cox proportional hazards regression was used to assess weights of different prescription patterns and drug classes. The predictive properties of the DDCI were confirmed in the validation cohort, represented by the other half of the population. The performance of DDCI was compared to the CCI in terms of calibration, discrimination and reclassification.
One year and overall mortality rates, unplanned hospitalization rates and hospital readmission rates progressively increased with increasing DDCI score. In the overall population, the model including age, gender and DDCI showed a high performance. DDCI predicted 1-year mortality, overall mortality and unplanned hospitalization with an accuracy of 0.851, 0.835, and 0.584, respectively. If compared to CCI, DDCI showed discrimination and reclassification properties very similar to the CCI, and improved prediction when used in combination with the CCI.
Citation: Robusto F, Lepore V, D'Ettorre A, Lucisano G, De Berardis G, Bisceglia L, et al. (2016) The Drug Derived Complexity Index (DDCI) Predicts Mortality, Unplanned Hospitalization and Hospital Readmissions at the Population Level. PLoS ONE 11(2): e0149203. https://doi.org/10.1371/journal.pone.0149203
Editor: Chunxue Bai, Zhongshan Hospital Fudan University, CHINA
Received: October 2, 2015; Accepted: January 28, 2016; Published: February 19, 2016
Copyright: © 2016 Robusto et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Our research involves administrative data with clinical and demographical information. There are legal restrictions on the data, which are owned by the Regional Health Authority and cannot be transferred in their actual format to other entities, particularly private ones, such as the Harvard Dataverse Network. An anonymized dataset will be made available upon request for qualified researchers. In this case, the reference person for the Regional Health Authority is Dr. Ettore Attolini (email: firstname.lastname@example.org).
Funding: This study was developed as a part of ASSEHS (Activation of Stratification Strategies and Results of the intervention on frail patients of Healthcare Services) EU project (2013 12 04), with no direct funding for its implementation. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
What is new?
Administrative health databases can be used to obtain algorithms useful to forecast readmission and reduce in-care cost. Validated comorbidity indexes (such as Charlson Comorbility Index) have been applied on hospitalization data to predict the risk of death or readmission, but these models do not permit to define the out-patient risk profile. More complex predictive models were obtained to overcome this limitation through the integration of several data-sources, including outpatients, accident and emergency, electronic clinical data from general practitioners, socio-economic data, and community dispensed prescriptions. Unfortunately, the different data-bases required are not always available and/or standardized. Our data show that a much simpler scoring system, solely based on drug prescriptions, can accurately predict one-year and long-term mortality, as well as the risk of unplanned hospitalization and hospital readmission.
Healthcare utilization, unnecessary care and health care spending increase linearly with the number of chronic conditions affecting an individual. In U.S., 25% of the population with multiple chronic conditions account for two-thirds of total health care spending[1,2].
An accurate prediction of the risk of poor outcomes in individuals with multiple comorbidities would allow health care professionals to focus on patients who are at highest risk of hospital readmissions, inappropriate care, elevated healthcare costs, and mortality. Stratifying patients according to risk can help identifying individuals candidate to an appropriate intervention in order to improve health outcomes, allocate resources more efficiently, reduce costs and facilitate better planning. As an example, several studies have shown that focused care after discharge can decrease the risk of readmission to hospital[3–8]. Several predictive models have been developed, mainly based on clinical, hospital discharge data, or validated comorbidity indexes[7,9,10]. The main limitation of these tools is represented by the difficulty to apply them at the population level, and not only to individuals admitted in hospital or undergoing ad hoc assessments.
An alternative approach can be represented by the use of drug prescription data, using the chronic use of specific classes of drugs as a proxy of chronic diseases and an expression of healthcare complexity. The possibility to use prescription data as indicators of underlying diseases was experienced in many clinical contexts[11–15], and their use to define the clinical risk profile represents the evolution of this process.
The aim of the study was to develop and validate the Drug Derived Complexity Index (DDCI), a predictive model derived from drug prescriptions. In particular, we evaluated whether DDCI was able to stratify the general population according to the risk of death, unplanned hospital admission, and readmission, and compared it with the Charlson Comorbidity Index in terms of discrimination and reclassification.
Research design and methods
We conducted a population-based retrospective cohort study, using a record-linkage analysis of prescription databases, hospital discharge records, and the civil registry, including data on the population aged 40 years or over of the Puglia region in Italy (approximately 2 million out 4.1 citizens in 6 local health authorities).
All Italian citizens have equal access to health care services and are cared for by a general practitioner as part of the National Health System (NHS). With the only exception of some drugs delivered directly by hospital pharmacy (biological agents, some anticancer drugs), prescription databases provide information on all community prescriptions reimbursed by the NHS with drugs coded according to the Anatomical Therapeutic Chemical (ATC) classification system. Hospital discharge records include information about primary diagnoses and up to five co-existing conditions, performed procedures, and in-hospital death. All diagnoses are coded according to the International Classification of Disease, Ninth Revision (ICD-9 CM) . Civil registry provides information on age, sex, and death or migration.
The reliability of data sources and their linkage to produce epidemiological information have been previously described[18,19]. All security and protection measures for data from patients were performed according to the national law. Data were obtained from the regional health authority in Puglia, Italy, providing data on all residents and were not generated or collected for this study. Data protection was ensured by the Healthcare Agency of Puglia. All data were anonymized prior to being accessed by the authors and none of the authors were involved in data anonymization. In Italy no ethical approval is required for aggregated-anonymous data.
Baseline risk factors
Data from January 1st 2003 to December 31st 2010 were used to develop and validate the DDCI. A fixed cohort of all residents at 01/01/2004 and aged 40 years or above was identified from the civil registry of the Puglia region. Index date was represented by January 1st 2004 for all citizens registered at the local health authority and alive at that time. The year of observation prior to the index date was used to define baseline characteristics. Patients were followed up from their index date to the earliest of death, migration, or the end of the study period. Prescription patterns indicative of chronic diseases (PPCD) and chronic exposure to drugs were derived from prescription databases.
Charlson Comorbidity Index (CCI) was calculated based on the diagnoses contained in hospital discharge databases.
The main outcome was overall mortality. The first unplanned hospital admission occurred after the index date, hospital readmissions, and 1-year mortality were considered as secondary outcomes. Overall survival was defined as the time between index date and death. For subjects who did not die, survival time was censored at the end of follow-up period or the date of leaving the region. The time horizon for risk prediction was set at 7 years.
To control the accuracy of predictions and to increase the reliability of all statistical analyses, the whole population was divided into 2 random samples (Fig 1):
- Training set, including 50% of subjects, in which different PPCDs and drug classes were included in a predictive model to develop the DDCI;
- Validation set, including the other half of the population, in which the predictive properties of the in DDCI were confirmed.
In addition, two cohorts were selected from the validation set:
- a first cohort of randomly selected residents, in which the discrimination and reclassification power of DDCI were assessed;
- a second cohort of all subjects hospitalized during 2003, in which the performance of DDCI was compared to that of the Charlson Comorbidity Index.
Model building and statistical analysis
Patients’ baseline characteristics are reported as frequency (percentage) and mean±standard deviation (SD). A multivariate Cox proportional hazard regression model including all the PPCDs and drugs to which patients were chronically exposed at baseline was performed to identify predictors of overall mortality. All drug classes significantly associated with mortality risk were included in the final model. A weight assigned to each drug class was derived from regression coefficient value divided by 0.3; the value obtained was rounded to the nearest integer, as proposed by Gagne et al. . The overall sum of weights determined the score of DDCI.
Overall mortality and time-to-first unplanned hospitalization analyses were performed using multivariate Cox proportional hazards regression models, and risks were reported as hazard ratios (HRs) with their 95% confidence interval (95% CI). Survival curves and probabilities were reported according to the Kaplan-Meier method. We evaluated the performance of the score in terms of discrimination and reclassification, with mortality and first unplanned hospitalization as outcomes. A model including age and sex was considered the reference model to which DDCI was added. In hospitalized subjects selected from the validation sample the same age and sex based reference model was used. Models adding separately the Charlson Comorbidity (CCI) index or the DDCI were tested. The final model included age, sex and both CCI and DDCI. Accurate predictions discriminate between those with and those without the outcome. Discrimination power was assessed by estimating survival C index with their 95% CI22. The reclassification extends the concept of discrimination by evaluating separately the subjects with and without outcome. The interpretation is opposite for subjects with and without the outcome. The proportion of events correctly reclassified and not-events correctly reclassified are summed. This sum was labeled as Net Reclassification Improvement (NRI) [22,23]. Subsequently, indices of discrimination and reclassification of the models were compared with the reference (adjusted only for age and sex). Readmissions to hospital were estimated as incidence rates (IRs; number of hospital readmissions per person years). A Poisson regression model was applied to estimate incidence rate ratios (IRRs) for individuals in the different DDCI score classes, taking the lowest class as the reference category. All statistical analyses were performed using SAS Software Release 9.4 (SAS Institute, Cary, NC).
Overall, a cohort of 1,998,948 subjects aged > = 40 years (mean age 60.17 ± 13.57 years, males 46.29%) was identified. The mean follow-up period was of 6.62±1.28 years, 12.53% had experienced at least 1 hospitalization for any cause and 76.25% had at least one drug prescription in the 12 months prior the index date. The training and the validation data sets included 999,391 and 999,557 subjects, respectively (Fig 1). During 7 years 106,664 deaths were registered in the training set and 106,590 in the validation set, corresponding to a cumulative mortality proportion of 10.67% and 10.66%, respectively. There were no statistically significant differences between the two groups in terms of age, gender, previous hospitalization, chronic exposure to the different drug types, and mortality rates (Table 1).
Development of DDCI in training sample
In the training set, time-to-death analysis was used to assess weights of different PPCDs and drug classes. All the classes of drugs not significantly associated with overall mortality were excluded from the final model. Among the drug classes included in the final model, some (such as “antidepressants” and “nonsteroidal anti-inflammatory drugs”) showed a poor contribution to mortality risk, totalizing a score of 0. Opioids appeared to be the drugs more related to mortality risk. The use of lipid modifying agents and immunosuppressants was associated with a risk of death lower than the reference category, represented by individuals not taking any of the drugs considered, and therefore a negative score was assigned to them. The regression coefficient values calculated on overall mortality and the weight assigned to each drug class of the best-in-class model are shown in Table 2. DDCI was obtained through the algebraic sum of the weights of the different drug classes. The score of DDCI ranges between -3 and 33. Due to the small number of cases, subjects with a negative score of DDCI were incorporated into the lowest risk class, represented by individuals with a score of 0; similarly, the upper class contains values of 11 or greater; therefore, 12 classes of DDCI score were eventually identified.
Results of DDCI application on validation set
A statistically significant increase in hazard ratios values with the increase in DDCI score was documented in the validation cohort, closely reproducing the results obtained in the training sample (Table 3). In particular, overall mortality was below 5% in the lowest risk group, while it exceeded 70% in the highest risk group. Survival curves with Kaplan-Meier method according to DDCI score values are reported in Fig 2 Panel A.
Panel A: overall survival; Panel B: time to first hospitalization.
DDCI was also able to predict time to first unplanned hospitalization; Kaplan-Meier curve showed a progressive increase in unplanned hospital admission risk with increasing DDCI score (Fig 2, Panel B). Among the 485,445 subjects with a first unplanned hospitalization in the follow-up period, the DDCI score also predicted hospital readmission. The age and gender adjusted risk of hospital readmission during the period of observation increased with the DDCI score, and the highest risk group had an incidence rate ratio of hospital readmission per person-year equal to 5.62 (5.48–5.66) when compared to the lowest risk class (Table 4).
The evaluation of accuracy, discrimination and reclassification capacity of DDCI was performed for the residents of the largest local health authority (N = 306,016) (Table 5, Model A). As for 1-year mortality the estimated survival C index pointed out that in the model with age, sex and DDCI the discrimination power was slightly better than the model with only age and sex (0.851 [0.846–0.856], 0.815 [0.809–0.820], respectively). In other words, age, sex and DDCI altogether had a probability of 85.1% to predict 1-yearmortality. As for overall mortality the gain in the discrimination power by adding DDCI was slightly lower (0.835 [0.83–0.837]) than the analogous model relative to the 1-year mortality analysis. A slight improvement in term of discrimination masked a much greater improvement in terms of reclassification. In fact, the 1-year mortality analysis showed that the model including DDCI was much more accurate than the reference model (NRI = 0.698 [0.673–0.725]) with a 16.3% of events correctly reclassified and 53.5% of non-events correctly reclassified. As for the overall mortality, despite a reclassification improvement (NRI = 0.586 [0.571–0.600]), a decrease of 7% of events correctly reclassified was shown. DDCI performed better in the correct reclassification of non-events, demonstrating an excellent capacity in the identification of the low risk population. DDCI showed a better performance in term of events correctly reclassified for one-year mortality compared to overall mortality and first unplanned hospitalization (with respect to overall mortality and first unplanned hospitalization).
Comparison between DDCI and Charlson Comorbidity Index
In the validation data set, 125,094 citizens had had at least one hospitalization during the 12 months prior the index-date. The clinical risk for these subjects was assessed through the application of the Charlson Comorbidity Index and the DDCI. When compared to the reference model (age and sex), both DDCI (Table 5 - Model B) and CCI (Table 5 - Model C) markedly improved prediction. In particular, CCI showed a better survival C index on short and long-term outcomes and a better performance than DCCI in reclassification on overall-mortality.
In the final model (Table 5 - Model D), the 1-year-mortality analysis showed that the model including also DDCI was more accurate than the model with age, sex and CCI (NRI = 0.263 [0.239–0.284]) with 11.8% of events correctly reclassified and 14.5% of non-events correctly reclassified. The overall mortality analysis showed that the model including also DDCI was more accurate than the model with age, sex and CCI (NRI = 0.342 [0.329–0.357]), with 5.4% of events correctly reclassified and 28.7% of non-events correctly reclassified
As for the prediction of first unplanned hospitalization, both DDCI and CCI showed a better performance when compared to the reference model, with a further improvement when used simultaneously.
Our study shows that a simple score, based on drug prescriptions as proxies of chronic conditions, is able to stratify the risk of the general population in terms of short and long term mortality, unplanned hospital admission and readmission. In hospitalized individuals, the performance of the DDCI score was similar to that of the Charlson index. When used in combination with the Charlson index, the DCCI significantly improved the prediction, thus representing an added value even in the presence of clinical information. Since the DCCI score is solely based on drug prescriptions, it allows the risk stratification of entire populations, without the need for clinical data, hardly available at the population level.
Comparison with existing data
Many clinical risk models are been proposed to predict death or unplanned hospitalization risk4, using different approaches:
- “threshold modelling” [24,25], that has proven to be more accurate when used within a specific clinical context than within a general population[26–28];
- “clinical knowledge”, in which physicians may be able to identify current high risk patients. Exportability of these models presents limitations due to problems in standardizing clinical judgements of different physicians in predicting citizens that may become high risk patients;
- “predictive modeling”, that uses regression models and appears to be more effective than other techniques.
There are a variety of predictive tools used for the identification of high risk patients through the integration of clinical, laboratory, functional, socio-familiar, and care variables into statistical predictive models[30–37]. Obtaining all this information in large populations requires an expensive ad-hoc clinical data collection, making this approach unfeasible in many instances. In alternative, administrative health databases can be used to obtain algorithms useful to forecast readmission[38,39] and reduce in-care cost[7,40]. Validated comorbidity indexes have also been applied on hospitalization data to predict the risk of death or readmission[8,9]. These models do not permit to define the out-patient risk profile, unless full clinical documentation is available. More complex predictive models were obtained to overcome this limitation through the integration of several data-sources[41–44], including outpatients, accident and emergency, electronic clinical data from general practitioners, socio-economic data, and community dispensed prescriptions. Unfortunately, the different data-bases required are not always available and/or standardized. Our data show that a much simpler scoring system, solely based on drug prescriptions, can accurately predict one-year and long-term mortality, as well as the risk of unplanned hospitalization and hospital readmission, thus overcoming many of the limitations of previous predictive instruments. These outcomes are the most important determinant of “frailty” [46,47] and a standardized tool able to stratify the clinical risk profile of patients is a priority in many healthcare settings.
Some predictive models derived by prescribed drug registers are been experienced; nevertheless, the drug-based comorbidity scores previously developed address other issues or show some limitations: 1) the small sample; 2) the arbitrary choices of the class of drugs to be included in the model[50,51]; 3) the objective of the tool circumscribed to the prediction of health care costs; 4) the poor ability to predict mortality; 5) the lack of a sufficient spatial and temporal coverage to perform the analysis[50–52].
Implications for clinical practice
The DDCI score can be used to help policy planners to identify at the population level those individuals showing a higher likelihood of intensive resource utilization. A focused, proactive approach targeted to these individuals may avoid that their health deteriorate to such a point that they need to be hospitalized, with positive implications also in terms of costs of care. As an example, several studies suggest that focused care after discharge can improve post-discharge outcomes and avoid readmission[54–56].
Since hospital admission, particularly early readmissions can be considered to be an indicator of poor quality of care (i.e. unsuccessful discharge processes or inadequate social care), the DDCI score can also be used as a case-mix measure to compare the performance of different structures/health districts.
The availability of a tool capable to capture the level of clinical complexity of patients could assist physician in their everyday practice, allowing to make more objective their clinical judgments. The possibility of an uniform assessment of the complexity of the patients could also facilitate the definition of guidelines and care models centered on patients with multiple morbidities and carrying a high risk of unfavorable outcomes.
Moreover, since the last year of life is characterized by high healthcare costs, the identification of individuals at high risk of short-term death can be of great significance to health providers and insurers.
Strengths and limitations
The major strength of the DDCI score is its reliance on a single source of administrative data based on the ATC coding system, widely utilized in many countries. For this reasons the DDCI can be applied in all the healthcare contexts in which there is a lack of clinical data; it can be easily applicable at population level, requiring only the availability of data on drug prescriptions.
The study also has limitations. First the application of DDCI at the population level is not generalizable outside of comprehensive health networks or all-payer administrative datasets. Nevertheless, the score can be used in any database containing drug prescriptions (for example general practitioners databases) or within studies to stratify the clinical risk profile of specific cohorts. It can be also used as a case-mix adjustment measure whenever clinical data needed to calculate CCI are not available.
Second, in our cohort, the use of lipid modifying agents and immunosuppressants was associated with a risk of death lower than the reference category. These results could appear counterintuitive. However, the use of lipid lowering drugs was very limited (6.7% of the population). We can thus hypothesize that within the reference group represented by individuals not treated with any of the drug classes considered there were also individuals candidate to lipid lowering treatment but not receiving the drug. This can be responsible for a higher risk of death in the reference category as compared to people treated with statins. As for immunosuppressants, we do not have an obvious explanation. Nevertheless, it should be noted that this class represented less than 0.2% of the whole cohort, making its contribution to the scoring almost irrelevant. Third, it should be emphasized that the scoring system can underestimate the risk in some individuals, due to the lack of information on those drugs, particularly cancer drugs, dispensed at the hospital. Furthermore, it reflects the risk of the Italian population, and its testing in other healthcare systems is warranted.
Finally, DDCI was not externally validated, but the random split in 2 equally large dataset (training and validation set) of a whole regional population of approximately 2 million of people constitutes a reliable methodology for the validation. Anyway, further studies are needed to evaluate the performance of DDCI as compared to CCI on an external outpatients population.
We developed and validated a prognostic index derived from prescription data, able to stratify the entire population into homogeneous risk groups. DDCI can represent a useful tool for risk-adjustment and for policy planning, as well as an instrument for the identification of patients needing a focused approach in the everyday practice. Its use can thus help improving the quality of care and optimize resource allocation.
We thank the Regional Health Agency and the Department of Health of the Puglia Region for the cooperation, general interest, and provision of data. The research leading to these results has received funding from the European Community’s Seventh Framework Programme (FR7/ EU project (2013 12 04)–the ASSEHS project (Activation of Stratification Strategies and Results of the intervention on frail patients of Healthcare Services).
Conceived and designed the experiments: FR VL GD LB GT AN. Performed the experiments: FR VL GD AN. Analyzed the data: FR VL AD GL AN. Contributed reagents/materials/analysis tools: AD GL. Wrote the paper: FR VL GL GD GT VL. Study supervision: AN FR VL GT. Critical revision of the manuscript for important intellectual content: GD GT VL LB.
- 1. Naessens JM, Stroebel RJ, Finnie DM, Shah ND, Wagie AE, Litchy WJ, et al. Effect of multiple chronic conditions among working-age adults. Am J Manag Care. 2011;17(2):118–22. pmid:21473661
- 2. Vogeli C, Shields AE, Lee TA, Gibson TB, Marder WD, Weiss KB, et al. Multiple Chronic Conditions: Prevalence, Health Consequences, and Implications for Quality, Care Management, and Costs. J Gen Intern Med. 2007;22 Suppl 3:391–5. pmid:18026807
- 3. Wennberg D, Siegel M, Darin B, Filipova N, Russel R, Kenney L. Combined predictive model: final report & technical documentation. London: Health Dialog/King’s Fund/New York University, December 2006. Available from: http://www.kingsfund.org.uk/sites/files/kf/field/field_document/PARR-combined-predictive-model-final-report-dec06.pdf
- 4. Curry N, Billings J, Darin B, Dixon J, Williams M, Wennberg D. Predictive risk project. Literature review. London: King’s Fund; 2005. Available from: http://www.kingsfund.org.uk/sites/files/kf/field/field_document/predictive-risk-literature-review-june2005.pdf
- 5. Cousins MS, Liu Y. Cost savings for a preferred provider organization population with multi condition disease management: evaluating program impact using predictive modeling with a control group. Dis Manag. 2003;6(4):207–17. pmid:14736345
- 6. Castlefields Health Centre. Chronic Disease management. Available at: http://www.natpact.nhs.uk/uploads/Castlefields%20Report.doc
- 7. Zekry D, Loures Valle BH, Graf C, Michel GP, Gold G, Krause KH, et al. Prospective comparison of 6 comorbidity indices as predictors of 1-year post-hospital discharge istituzionalization, readmission, and mortality in elderly individuals. J Am Med Dir Assoc. 2012;13(3): 272–278. pmid:21450226
- 8. Billing J, Dixon J, Mijanovich T, Wennberg D. Case finding for patients at risk of readmission to hospital: development of algorithm to identify high risk patients. BMJ. 2006;333(7563):327. pmid:16815882
- 9. von Walraven C, Dhalla I, Bell C, Etchells E, Stiell IG, Zarnke K, et al. Derivation and validation of an index to predict early death or unplanned readmission after discharge from hospital to community. CMAJ. 2010;182(6):551–7. pmid:20194559
- 10. D’Hoore W, Bouckaert A, Tilquin C. Practical considerations on the use of the Charlson Comorbidity Index with administrative data bases. J Clin Epidemiol. 1996;49(12):1429–33. pmid:8991959
- 11. Monte S, Macchia A, Pellegrini F, Romero M, Lepore V, D'Ettorre A, et al. Antithrombotic treatment is strongly underused despite reducing overall mortality among high-risk elderly patients hospitalized with atrial fibrillation. Eur Hearth J. 2006;27(18):2217–23.
- 12. Monte S, Fanizza C, Romero M, Rossi E, De Rosa M, Tognoni G. Administrative databases as a basic tool for the epidemiology of cardiovascular disease. G Ital Cardiol. 2006;7(3):206–16.
- 13. Macchia A, Monte S, Romero M, D’Ettorre A, Tognoni G. The prognostic influence of chronic obstructive pulmonary disease in patients hospitalized for chronic heart failure. European J Heart Failure. 2007;9(9):942–8.
- 14. Scurti V, Font M, Anecchino C, Monte S, Fanizza C, Tognoni G et al. Pharmacoepidemiology of chronic treatments. Definitions, methodology, model scenarios. Ital J Clin Pharm. 2005;19:102–109.
- 15. De Berardis G, D’Ettorre A, Graziano G, Lucisano G, Pellegrini F, Cammarota S, et al. The burden of hospitalization related to diabetes mellitus: a population-based study. Nutr Metab Cardiovasc Dis. 2012;22(7):605–12. pmid:21333508
- 16. WHO Collaborating Centre for Drug Statistics Methodology. ATC Index with DDDs. In: WHO Collaborating Centre for Drug Statistic Methodology, Norway, Oslo; 2003.
- 17. International Classification of Diseases, 9th Revision (Clinical Modification). Public Health Service, US Department of Health and Human Services, Washington; 1998.
- 18. De Berardis G, Lucisano G, D’Ettorre A, Pellegrini F, Lepore V, Tognoni G, et al. Association of aspirin use with major bleeding in patients with and without diabetes. JAMA. 2012;307(21):2286–94. pmid:22706834
- 19. Erviti J, Alonso A, Oliva B, Gorricho J, López A, Timoner J, et al. Oral bisphosphonates are associated with increased risk of subtrochanteric and diaphyseal fractures in elderly women: a nested case-control study. BMJ Open. 2013;3(1):e002091. pmid:23370011
- 20. Costituzione della Repubblica italiana. Articolo 32 e successiva riforma sanitaria del 1978. Available at: http://www.governo.it/governo/costituzione/principi.html
- 21. Gagne JJ, Glynn RJ, Avorn J, Levin R, Schneeweiss S. A combined comorbidity score predicted mortality in elderly patients better than existing scores. J Clin Epidemiol. 2011;64(7):749–59. pmid:21208778
- 22. Pencina MJ, D'Agostino RB. Overall C as a measure of discrimination in survival analysis: model specific population value and confidence interval estimation. Stat Med. 2004;23(13):2109–23. pmid:15211606
- 23. D'Agostino RB, Nam BH. Evaluation of the Performance of Survival Analysis Models: Discrimination and Calibration Measures. Handbook of Statistics. Vol 23. Amsterdam, The Netherlands, Elsevier Science B.V., 2004.
- 24. Cousins MS, Liu Y. Cost savings for a preferred provider organization population with multi condition disease management: evaluating program impact using predictive modeling with a control group. Dis Manag. 2003;6(4):207–17. pmid:14736345
- 25. Castlefields Health Centre. Chronic Disease management. Available at: http://www.natpact.nhs.uk/uploads/Castlefields%20Report.doc
- 26. Hsot MW. Rapid overview of the evidence on the use of predictive risk tools in chronic disease management. National Public Health Service for Wales. April 2006. Available at: http://www2.nphs.wales.nhs.uk:8080/HealthServiceQDTDocs.nsf/public/9237C2D7690C06298025719D0038006F/$file/PREDICTIVE%20RISK%20TOOLS%20IN%20CHRONIC%20DISEASE%20MANAGEMENTv3.doc
- 27. Department of Health. NHS Modernisation Agency; Matrix Research and Consultancy. Learning distillation of chronic disease management programmes in the UK. London: DH, 2004.
- 28. Cousins MS; Shickle LM; Bander JA. An introduction to predictive modeling for disease management risk stratification. Disease Management. 2002;5(3):157–167.
- 29. Dudley RA, Medlin CA, Hammann LB, Cisternas MG, Brand R, Rennie DJ, et al. The best of both worlds? Potential of hybrid prospective/concurrent risk adjustment. Medical Care. 2003;41(1):56–69. pmid:12544544
- 30. HARP. Chronic Disease Management. Available at: http://www.health.vic.gov.au/harp-cdm/harppubs.htm
- 31. InterRAI. The integrated suite of instruments. Available at: http://www.interrai.org/section/view/?fnode=38
- 32. High-impact User Manager (HUM) Tool. Available at http://www.drfosterintelligence.co.uk/managementinformation/HUM/
- 33. The King’s Fund. Patients at Risk of Rehospitalisation (PARR) case finding tool. Available at: http://www.kingsfund.org.uk/health_topics/patients_at_risk/index.html
- 34. The King’s Fund. Predicting and reducing re-admission to hospital (PARR). Available at: http://www.kingsfund.org.uk/projects/predicting-and-reducing-re-admission-hospital.
- 35. Wennberg JE, Fischer ES. Finding high quality, efficient providers for value purchasing: cohort methods better than methods based on events. Medical Care. 2002;40(10):853–5. pmid:12395019
- 36. Boult C, Dowd B, McCaffrey D, Boult L, Hernandez R, Krulewitch H. Screening elders at risk for hospital admission. J Am Geriatr Soc.1993;41(8):811–7. pmid:8340558
- 37. Pacala JT, Boult C, Boult L. Predictive validity of a questionnaire that identifies older persons at risk for hospital admission. J Am Geriatr Soc. 1995;43(4):374–7. pmid:7706626
- 38. Gorman J, Vellinga A, Gilmartin JJ. Frequency and risk factors associated with emergency medical readmission in Galway University Hospitals. Ir J Med Sci. 2010;179(2):255–8. pmid:20091137
- 39. Billings J, Mijanovich T. Improving the management of care for high-cost Medicaid patients. Available on content.healthaffairs.org by Health Affairs Oct 2012.
- 40. Wong ELY, Cheung AWL, Leung MCM, Yam CH, Chan FW, Wong FY, et al. Unplanned readmission rates, length of hospital stay, mortality and medical cost of ten common medical condition: a retrospective analysis of Hong Kong hospital data. BMC Health Serv Res. 2011;11:149. pmid:21679471
- 41. Falasca P, Berardo A, Di Tommaso F. Development and validation of predictive MoSaiCo (Modello Statistico Combinato) on emergency admissions: can it also identify patients at high risk of frailty? Ann Ist Super Sanita. 2011;47(2):220–228. pmid:21709393
- 42. Adie E, Baird D, Bridger P. SPARRA: Scottish patients at risk of readmission and admission 2006. Available on: www.isdscotland.org/health-topics/health-and-social-community-care/SPARRA/SPARRA-history/SPARRA_report.pdf.
- 43. Bernabeu-Wittel M, Ollero-Baturone M, Moreno-Gavino L, Baron-Franco B, Fuentes A, Murcia-Zaragoza J, et al. Development of a new predictive model for polyphatological patients. The PROFUND index. Eur J Intern Med. 2011; 22(3):311–317. pmid:21570654
- 44. Johns Hopkins University. Johns Hopkins ACG Case-Mix Adjustment System. Available on: http://www.acg.jhsph.edu; 2011.
- 45. Bisharat N, Handler C, Schwartz N. Readmission to medical wards: analysis of demographic and socio-medical factors. Eur J Intern Med. 2012;23(5):457–60. pmid:22726376
- 46. De Lepeleire J, Iliffe S, Mann E, Degryse JM. Frailty: an emerging concept for general practice. Br J Gen Pract. 2009;59(562):e177–82. pmid:19401013
- 47. Clegg A, Young J, Iliffe S, Rikkert MO, Rockwood K. Frailty in elderly people. Lancet. 2013; 381(9868):752–762. Epub 2013 Feb 8. Review. Erratum in: Lancet. 2013 19;382(9901):1328. pmid:23395245
- 48. de Manuel Keenoy a E., David M., Mora J., Prieto L., Domingo C., Orueta J., E. , et al. Activation of Stratification Strategies and Results of the interventions on frail patients of Healthcare Services (ASSEHS) DG Sanco Project No. 2013 12 04. European Geriatric Medicine. European Geriatric Medicine 2014 Oct: 5(5):342–346.
- 49. Yurkovich M, Avina-Zubieta JA, Thomas J, Gorenchtein M, Lacaille D. A systematic review identifies valid comorbidity indices derived from administrative health data. J Clin Epidemiol 68 (2015):3–14.
- 50. Von Korff M, Wagner EH, Saunders . A chronic disease score from automated pharmacy data. J Clin Epidemiol 1992 Feb;45(2):197–203. pmid:1573438
- 51. Maio V, Rabinowitz C, Louis D, Jimbo M, Donatini A, Mali S, et al. Using pharmacy data to identify those with chronic condition in Emilia Romagna, Italy. J Health Serv Res Policy 2006 Oct;10(4):232–8.
- 52. Fishman PA, Goodman MJ, Hornbrook MC, Meenan RT, Bachman DJ, O’Keeffe Rosetti MC. Risk adjustment using automated ambulatory pharmacy data: the RxRisk model. Med Care 2003;41:84–99. pmid:12544546
- 53. George J, Voung T, Bailey MJ, Kong DC, Marriott JL, Stewart K. Development and validation of the medication-based disease burden index. Ann Pharmacother 2006;40:645–50. pmid:16569815
- 54. van Walraven C, Wong J, Forster AJ. LACE+ index: extension of a validated index to predict early death or urgent readmission after hospital discharge using administrative data. Open Med.2012;6:e80–90. pmid:23696773
- 55. van Walraven C, Dhalla IA, Bell C, Etchells E, Stiell IG, Zarnke K, et al. Derivation and validation of an index to predict early death or unplanned readmission after discharge from hospital to the community. CMAJ. 2010;182(6):551–7. pmid:20194559
- 56. Kansagara D, Englander H, Salanitro A, Kagen D, Theobald C, Freeman M, et al. Risk prediction models for hospital readmission: a systematic review. JAMA.2011;306(15):1688–98. pmid:22009101
- 57. Tsai TC, Joynt KE, Orav EJ, Gawande AA, Jha AK. Variation in surgical-readmission rates and quality of hospital care. N Engl J Med. 2013;369(12):1134–42. pmid:24047062
- 58. Polder JJ, Barendregt JJ, van Oers H. Health care costs in the last year of life—the Dutch experience. Soc Sci Med. 2006;63(7):1720–31. pmid:16781037