http://orcid.org/0000-0001-5301-6370
Figures
Abstract
Background
Health care systems that succeed in preventing long term care and hospital admissions of frail older people may substantially save on their public spending. The key might be found in high-quality care in the community. Quality Indicators (QIs) of a sufficient methodological level are a prerequisite to monitor, compare, and improve care quality. This systematic review identified existing QIs for community care for older people and assessed their methodological quality.
Methods
Relevant studies were identified by searches in electronic reference databases and selected by two reviewers independently. Eligible publications described the development or application of QIs to assess the quality of community care for older people. Information about the QIs, the study sample, and specific setting was extracted. The methodological quality of the QI sets was assessed with the Appraisal of Indicators through Research and Evaluation (AIRE) instrument. A score of 50% or higher on a domain was considered to indicate high methodological quality.
Results
Searches resulted in 25 included articles, describing 17 QI sets with 567 QIs. Most indicators referred to care processes (80%) and measured clinical issues (63%), mainly about follow-up, monitoring, examinations and treatment. About two-third of the QIs focussed on specific disease groups. The methodological quality of the indicator sets varied considerably. The highest overall level was achieved on the domain ‘Additional evidence, formulation and usage’ (51%), followed by ‘Scientific evidence’ (39%) and ‘Stakeholder involvement’ (28%).
Conclusion
A substantial number of QIs is available to assess the quality of community care for older people. However, generic QIs, measuring care outcomes and non-clinical aspects are relatively scarce and most QI sets do not meet standards of high methodological quality. This study can support policy makers and clinicians to navigate through a large number of QIs and select QIs for their purposes.
PROSPERO Registration: 2014:CRD42014007199
Citation: Joling KJ, van Eenoo L, Vetrano DL, Smaardijk VR, Declercq A, Onder G, et al. (2018) Quality indicators for community care for older people: A systematic review. PLoS ONE 13(1): e0190298. https://doi.org/10.1371/journal.pone.0190298
Editor: Lamberto Manzoli, Universita degli Studi di Ferrara, ITALY
Received: May 5, 2017; Accepted: December 12, 2017; Published: January 9, 2018
Copyright: © 2018 Joling et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This study was conducted within the IBenC project (Identifying best practices for care-dependent elderly by Benchmarking Costs and outcomes of community care) (FP7, grant no. 305912). The IBenC project was supported by the Seventh Framework Programme (CORDIS FP7) of the European Commission, 30 HEALTH (FP7-HEALTH-2012). The contents of this article reflect only the authors’ views and the European Commission is not liable for any use that may be made of the information contained therein. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist. AD, GO, HvH, and HvdR are fellows of the interRAI consortium (www.interrai.org).
Introduction
In the world’s aging population, a growing number of older people will lead to a rapid increase in the demand for health care services. At the same time, a shortage of professional and informal caregivers is projected [1, 2]. Policy makers need to anticipate on these trends and prepare health care systems to function as efficiently as possible in order to serve all future older citizens with appropriate and affordable care.
A majority of older people prefers to remain living at home for as long as possible and receive care at home when needed [3, 4]. In many countries, current policies aim to follow up on this preference and strongly promote the use of community-based services, which is also expected to help keeping health care sustainable. Almost 40% of public spending on health care concerns persons over 65 years of age, with long term care and hospital admissions being the most important cost drivers [5, 6]. Health care systems that succeed to provide effective community-based care and services are likely to optimise their public spending substantially [7].
As a result, community care services are becoming more important for older people to rely on. To monitor and stimulate high-quality community care, valid indicators are a prerequisite for being able to identify where, when and under which conditions quality deficiencies exist. Quality Indicators (QIs) are measurable elements of practice performance for which there is evidence or consensus that they can be used for assessing and changing the provided quality of care [8]. They can provide quantified indications for various stakeholders. Clinicians can use them for bench learning, and to set priorities for improvement and education. QIs can also provide transparency about the quality of care delivery and the performance of care professionals for patients (or their representatives). Health care insurers, Ministries of Health, and Health Care Inspectorates can use QIs for monitoring, supervision and policy making.
According to Donebedian’s widely used model for assessing health care quality, QIs can be related to process, outcomes and structure of care. Process indicators denote what is actually done while giving and receiving care, for example developing a care plan, or conducting an annual medication review. Structure indicators involve the attributes of the care setting, such as materials and resources [9]. Outcome indicators describe the effect of care on patients’ health status, such as a reduction in pain since intake, or improved quality of life. Following this model, patient satisfaction can be defined as a patient-reported outcome measure, while the structures and processes of care can be measured by patient-reported experiences [10]. There is debate about the most useful types of indicators to assess the quality of care. Process indicators are direct measures of quality, are considered to be more sensitive to differences in the quality of care, and can be more straightforward to interpret without extensive risk adjustment. On the other hand, outcome indicators reflect the interplay of a wide variety of factors and are of greater intrinsic interest as they assess the effect of health care services on desired outcomes [11, 12].
Regardless of whether structural, process or outcome indicators are chosen, it is important that QIs adhere to certain quality requirements to produce an accurate measure of quality. Criteria of the National Quality Forum are widely recognized as important for evaluating quality indicators and include ‘importance’, ‘scientific acceptability of measure properties’, ‘usability’, and ‘feasibility’ [13]. ‘Importance’ covers the extent to which the focus of the QI is evidence-based and important to making significant improvements in healthcare quality where there is variation in or overall less-than-optimal performance [13]. Where possible, this should be based directly upon rigorous scientific evidence. When such evidence is absent, consensus techniques and guideline driven approaches can be used [14]. The criterion ‘Scientific acceptability’ requires that the QI is well defined and precisely specified, and addresses whether it produces consistent (reliable) and credible (valid) results about the quality of care when implemented. Additional requirements, such as specification of a risk adjustment strategy to account for case-mix differences, are also included within this criterion. Feasibility depends on the extent to which the required data are readily available or could be obtained without excessive burden and demonstrates whether the data collection strategy can be implemented. Lastly, ‘usability’ represents the extent to which potential stakeholder groups are using or could use the results for both accountability and quality improvement [13].
Although these criteria clearly indicate the key quality requirements for indicators, in a real world, the quality of QIs varies considerably, which hinders meaningful reflection and comparison of quality of care. An overview of QIs that are available to measure the quality of care for older persons in community care settings (e.g. primary care and home care services) and the extent to which these QIs meet quality requirements is currently lacking. Knowing which QIs are available, and having insight in their characteristics and methodological quality can support relevant stakeholder groups in selecting the right indicators for their quality purposes, and prevent the development of new indicators for quality domains that are already covered sufficiently. Such an overview will also identify shortcomings in QIs that are currently being applied, along with giving guidance for further development or improvement. Therefore, the objectives of this systematic review are to provide a comprehensive overview of existing QIs developed or applied to assess the quality of community care provided to older people, to differentiate between types of indicators, and to evaluate the methodological quality of the identified QI sets.
Materials and methods
The protocol for this systematic review has been published on PROSPERO (2014:CRD42014007199) and is available at: http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42014007199. The PRISMA guidelines for reporting systematic reviews were used in undertaking the review.
Search strategy
A search strategy was developed to identify publications concerning the development, testing or implementation of indicators of the quality of community care for older people. Searches were conducted in consultation with a librarian in electronic reference databases (Medline, PsycINFO, EMBASE, CINAHL and Cochrane) on September 25, 2013, with no restriction to language or publication year. We combined key words and medical-subject headings for home care, quality indicators and older-aged people. S1 Appendix presents the search strategy in Medline. Comparable searches were performed in the other databases and are available on request. The searches in the databases were updated up to November 21st, 2016 to examine if new QI sets meeting the inclusion criteria had appeared since our initial search.
Study selection
Publications were included if:
- They described the development and/or characteristics of QIs specifically developed for older people or applied in an older aged sample (i.e. 65 years or older). Disease specific QI sets should have a specific connection to older people (e.g. focus on core geriatrics topics, such as falls or dementia). If there was no clear connection, the QI set should have an explicit goal of measuring the quality of care in older people with the condition in question.
- The QIs were developed or applied to assess the quality of care in the community (e.g. home care, primary care, community care and ambulatory care).
- Numerators and denominators of the QIs were defined or could be deduced from the descriptions of the QIs.
Editorials, letters to the editor, comments, narrative case-reports and articles written in a language other than English, Dutch, German or Italian were excluded. When a set of QIs was updated, we selected the publication describing the updated QIs. The identified references were entered in a bibliographical database and duplicates were removed. First, the title and abstracts of these references were assessed for relevance by two reviewers independently (KJ and LvE, DV or VS). Next, the full text of the selected references was obtained and reviewed by two reviewers independently (KJ and LvE, DV or VS). Any disagreements between reviewers were resolved by consensus. If no consensus could be reached a third reviewer (HvdR) was consulted. The reference lists of the obtained full-text publications were checked to identify any relevant publications that had not been identified in the searches. In addition, we solicited several researchers evaluating the quality of community care for older people in Europe (www.ibenc.eu/) to identify additional unpublished or grey literature.
Data extraction
A data extraction form was used to extract the following information about the QIs: the general description of the QI, the numerator and denominator, and if applicable its performance standard and exclusion criterion. Furthermore, the QIs were classified as either a structure, process, or outcome measure and were categorized into the domain(s) they covered. To give more insight into the areas that were addressed by the QIs, we searched for an existing framework or domains of community care for older people that could be applied to categorize the QIs. As far as we are aware, such a classification or framework does not yet exist. Therefore, based on categorizations and useful (sub)headings used in the identified QI sets we included, the first author drafted a domain classification. The other research team members, with (clinical) backgrounds in geriatrics, psychology, sociology and epidemiology, commented on the draft and this resulted in a classification of the following nine domains:
- Clinical issues, e.g. falls and mobility disorders, pain, ulcers, clinical conditions, nutrition, weight loss, dehydration, feeding tube, medications, tobacco and alcohol use, injuries, hearing and vision loss, clinical examinations, infections, mortality. Given the wide variety of clinical aspects covered in this domain, these QIs were further classified into the subcategories ‘screening and prevention’, ‘follow-up / monitoring and examinations’, clinical events and targets’ and ‘treatment (medication and non-pharmacological treatments)’.
- Cognition/ Mental health, e.g. cognitive loss/ dementia, delirium, communication, mood, behavior, abuse.
- Structure of care, e.g. budget resources, staff training, facilities and equipment.
- Continuity and coordination of care, e.g. communication between care professionals, development of an individualized care plan.
- End of life care, e.g. advanced care planning.
- Psycho-social aspects, e.g. social activities, informal caregiving, loneliness.
- Service utilization, e.g. hospitalizations, use of emergency services.
- Functional performance, e.g. (Instrumental) Activities of Daily Living, home environment optimization, physical activities promotion, physical restraints.
- Patient perceptions and interaction, e.g. satisfaction with care services, patient preferences.
Methodological assessment
The methodological characteristics of the QI sets were assessed with the Appraisal of Indicators through Research and Evaluation (AIRE) Instrument [15]. The AIRE is a valid and reliable instrument specifically designed to appraise the quality of QIs [16]. It was derived from the Appraisal of Guidelines Through Research and Evaluation (AGREE) instrument [17], a widely used standard for assessing the methodological quality of practice guidelines. The AIRE has been used previously in several systematic reviews on QIs [18–22], and in studies developing QI sets [23, 24] for other patient groups. It includes 20 items that address four quality domains of a QI. Each item involves a statement about the quality of the QIs and is scored on a 4-point scale (1 ‘strongly disagree or no information provided’ to 4 ‘strongly agree’). The three domains reflecting the methodological quality were used to address the research objectives: ‘Stakeholder involvement’, ‘Scientific evidence’ and ‘Additional evidence formulation and usage’. Items of these domains were scored by two reviewers independently (KJ and VS) and summed per domain. Next, a standardized domain score was calculated according to the instrument’s guidelines with the following formula: (total score—minimum possible score) / (maximum score—minimum possible score) x 100%. A higher standardized score indicates a higher methodological level of quality (range 0–100%). QI sets were considered to have a high methodological quality on a domain if they scored 50% or higher, which correlates with an overall “agree” or “strongly agree” [21]. Domain scores are independent and should not be combined into a single quality score [15]. When more than one included article used (part of) the QI set, we incorporated all the information from these articles in the judgement. References were checked to be able to include information about for example the development process of QI sets. When a QI set was updated, we also examined the information from publication(s) which described the development of the original set for the scoring of the methodological quality.
Results
Selection of articles
A total of 1,839 unique publications were identified from the databases. Fig 1 presents a flow chart of the selection process and reasons for exclusion. After full-text screening, 22 articles met the selection criteria. Reference tracking of the publications identified three additional eligible articles. As a result, 25 articles were included in this review. These articles described a total of 17 QI sets, covering 567 unique QIs (S2 Appendix).
Characteristics of the quality indicator sets
Table 1 presents a general overview of the included studies and the QI sets. Almost half of the studies originated from the USA (n = 12) [25–36], followed by the United Kingdom (n = 4) [37–40]. Other studies were from Canada [41], Taiwan [42], Sweden [43], The Netherlands [44–46], and two studies were performed in several European countries as part of an EU project [47, 48]. Six QI sets were developed or used in primary care settings [31, 37, 39, 45, 46, 49] and seven in home care settings [29, 38, 40, 42, 43, 47, 48]. Furthermore, one set was applied in a combination of primary care clinics and community agencies [34], two studies did not further specify community care [36, 41] and one set assessed the quality of ‘outpatient care’ for older people [28].
Eleven articles used QIs from the Assessing Care Of Vulnerable Elders-3 set (ACOVE-3), a comprehensive set of indicators specifically developed to assess the medical care provided to vulnerable elders and covering a wide variety of conditions [36]. Four of these studies used an adapted version or part of the ACOVE indicators, in combination with other QIs [39, 41, 45, 46].
Of the 17 sets, five targeted persons with dementia or cognitive impairments [34, 40, 41, 45, 47], one assessed the care for older persons with diabetes [49], and one focused on older persons with chronic diseases (coronary heart disease, stroke, atrial fibrillation, and diabetes) [39]. The other sets were developed or applied in (frail) older samples, without focusing on a specific disease. The quality aspects that these QIs sets aimed to address varied, and included, for example, communication between physicians, potentially preventable hospitalization for ambulatory care sensitive conditions, home care service user experiences, and the quality of medication prescribing. The majority of the sets (10 out of 17) included one type of indicators. Only the set of Perry et al. (2010) [45] covered process, outcome and structure indicators (Table 1).
Characteristics of the quality indicators
The Excel spreadsheet (S2 Appendix) shows the description of the 567 QIs, their numerator and denominator, the domain(s) they covered, the type (process, outcome or structure), and the specific community setting in which the QI was developed or applied. When applicable, the exclusion criterion, its performance standard, and the condition/ disease the indicator addresses are listed. Table 2 shows that 455 QIs (80%) referred to processes of care. A considerably smaller number of indicators measured the structure (n = 59, 10%) or outcome of care (n = 53, 9%). Most indicators (n = 355) assessed clinical issues, mainly with regard to follow-up, monitoring, examinations and treatment (Table 2), followed by indicators that evaluated the quality of care in the domain ‘Cognition or mental health’ (n = 67), ‘Structure of care’ (n = 59), and ‘Continuity and coordination of care’ (n = 36). About two third of the QIs focussed on a specific disease or were applied in a patient group with a particular disease (Table 2), mostly for people with dementia (n = 138), followed by several types of cancer (n = 65) and cardiovascular diseases (n = 61). Table 2 provides also insight in the QIs per domain and disease across the primary care, home care and other community care settings. The majority of QIs (68%) were developed or applied for community care (not further specified), or for a combination of community care providers. This was mainly due to the extensive number of QIs from the ACOVE indicator set represented within this category. Furthermore, respectively 17% and 14% of the QIs were developed or applied in home care and primary care settings.
Methodological quality of the QI sets
Table 3A and 3B present the results of the methodological assessment of the 17 QI sets as assessed with the AIRE Instrument. Overall, the sets scored highest on the domain, ‘Additional evidence, formulation and usage’ (domain score of 51%), with 53% of the studies within the high quality level (i.e. a score of 50% or higher). The methodological level in terms of ‘Stakeholder involvement’ and ‘Scientific evidence’ was lower, with mean domain scores of respectively 28% and 39%, and with 41% and 18% of the studies meeting the high-quality threshold in these domains. In most studies, the target patient population of the indicators was clearly defined, and the numerator and denominator were described in detail (mean item scores of 3.5 and 3.3). Also, indicators were frequently based on recommendations from an evidence-based guideline (mean score 2.9). Furthermore, the QIs were, to some extent, piloted in practice, and efforts needed for data collection were quite well considered (mean scores 2.7). In contrast, indicators were rarely formally endorsed (mean score 1.4), hardly appraised the supporting evidence critically (mean score 1.6) and had demonstrated sufficient reliability to a limited extent (mean score 1.7).
The methodological quality of the QI sets varied. Two QI sets were considered to have a high methodological quality on all three quality domains [31, 36], and four reached this level on two of the domains [28, 34, 45, 48]. The interRai-Home Care QI set [48, 50] scored highest on the domains ‘Stakeholder involvement’ and ‘Additional evidence, formulation and usage’. The Agency for Healthcare Research and Quality (AHRQ) prevention QI set [28, 51] and ACOVE-3 indicators set [36] achieved the best score on the domain ‘Scientific evidence’.
Discussion
Through a systematic review of the literature, we identified 17 QI sets that covered a substantial number of 567 QIs, developed or applied to assess the quality of care for older people in the community. The majority of these QIs assessed processes of care (80%), and measured clinical issues (63%). Most QIs focussed on a specific disease. Although we identified a high number of indicators, there was some overlap in the content of QIs. For example, QIs for diabetes care measured the same aspects to evaluate whether physicians monitored their patients according to national guidelines or standards [36, 37, 39, 49]. Furthermore, several studies used indicators that were based on the comprehensive set of QIs developed by the ACOVE group, but modified the indicators to enable application in another country or by another community care provider [45, 46].
In terms of methodological quality, overall, the target population of the indicators was clearly defined, numerators and denominators were described in sufficient detail and indicators were based on evidence- based recommendations. On the other hand, there is still room for improvement, particularly with regard to the extent to which supporting evidence was critically appraised during the development process, a sufficient demonstration of the QIs’ reliability, and formal endorsement of QI sets. Besides, taking account of the purpose of the indicators, not all relevant stakeholders were involved in the development process in many of the studies, and a strategy for risk adjustment was frequently not considered or described. Often, studies did not describe these aspects at all or did not provide enough detail to obtain a good score.
There was considerable variability in the methodological quality between indicator sets. Six of the 17 sets (35%) were found to have a high methodological quality on at least two of the three quality domains [28, 31, 34, 36, 45, 48]. The ACOVE and AHRQ indicator sets almost achieved the maximum score on the domain ‘Scientific evidence’ and described in detail which methods were used to search for scientific evidence and how the evidence was appraised and supported the selection of the indicators. The interRai-HC set provided the best evidence in terms of reliability, and discriminative power, and used a thorough risk adjustment method. Risk adjustment is particularly important for outcome measures, because patient outcomes are not just determined by quality of care but also by patient characteristics, such as age, and level of impairment. Without adjusting for the effects of patient characteristics that may vary across providers, this could lead to incorrect conclusions about the quality of care, because organizations or providers with the worst outcomes may also have the most severely impaired patients. Stakeholders, such as health care insurers and the Health Inspection who may judge the quality of care based on QIs and use this information to make future decisions should strongly take into account whether QI outcome scores were correctly adjusted for differences in case mix. Besides, risk-adjusted quality measures creates the opportunity for benchmarking within and between countries and identify best practices. The high number of process indicators with, generally, a clearly defined target patient population may have reduced the need for risk adjustment.
Strengths and limitations
To our knowledge, this is the first review that provides an overview of the QIs that are available to assess the quality of community care for older people and assessed their methodological quality. We systematically searched the literature in five electronic reference databases and thoroughly reviewed and evaluated a vast number of articles. The selection of articles, data extraction and quality assessment was conducted by two reviewers independently, which increases the reliability of the results. We included different types of community care settings, such as general practice and home care services. In addition to sets that were specifically developed for older people, we also included existing QIs that were used in older samples with the explicit goal of measuring the quality of care in older people. Therefore, we can be confident that this review provides a comprehensive overview of the available indicators. This can potentially be used to assess the quality of care for older people in the community and supports stakeholders to navigate through the QIs and to select QIs for their specific situation and purposes. The supplementary Excel spreadsheet (S2 Appendix) enables readers to filter QIs in a particular community care setting, care domain or for a specific disease.
Although this systematic review makes a significant contribution to the quality of care literature, some limitations must be acknowledged. First, despite the wide scope and substantial number of identified QIs, some (sets of) indicators could have been missed. The searches in the international literature databases mainly identified scientific research papers. We attempted to track down relevant grey literature through manually checking the reference lists during the full-text screening and data extraction phase, soliciting colleagues who investigate the quality of community care for older people about missing relevant QI sets, and using Google’s internet search engine when links to webpages did not work anymore. Nevertheless, this could not avoid that QI sets that have not been published in an article or report, or were published in another language than we could understand were not found. On the other hand, it is not very likely that QI sets which are well validated and reliable have not published yet in peer-reviewed literature. In addition, following the third inclusion criterion, QIs which were expressed as a continuous measure, such as some summary measures, or satisfaction measures expressed with a scale score were excluded.
Second, this review mainly captured QIs which measured quality of care from the perspective of the care provider. Over the past years, there has been a growing interest to involve the patient’s perspective to inform health care quality improvement. For example, patients are asked about the impact of treatments and care on their health through the use of patient-reported outcome measures (PROMs). Besides, patient experience measures (PREMs) are used to assess patient satisfaction with a health care service [52]. A few of these were included in our review within the domain “Patient perceptions and interaction”. The absence of PROMs and limited number of PREMs that were selected could suggest that these measures have not yet been widely implemented in geriatric care and are more common in adult patient groups. This is in line with findings from a recent literature review which reported that the implementation of PROMs is most advanced in specific settings or disease-groups [53]. It could also be possible that papers described these measures in other words than included in our search terms and might have been missed, although we used a broad range of terms, such as for example ‘health care quality’, ‘treatment outcome’ and ‘care performance’ (S1 Appendix). As PROMs and PREMs are often measured with self-completed questionnaires, and expressed as a score, they might also have been excluded because one of our inclusion criterion required that the numerator and denominator of the QIs were defined or could be deduced from the description. Nevertheless, when collected systematically across providers, and measured in a valid and reliable way, PROMs can generate valuable data to improve quality and support patient-centered care.
Lastly, as mentioned, the methodological quality of the QI sets could have been underestimated to some extent. Following the instructions from the AIRE instrument, the lowest score was assigned on an item if no information was provided in the publication. Particularly the development process of the indicators and the evidence on these were based were not always described, or sufficient details were lacking, while the AIRE instrument puts relatively much emphasis on development aspects. Also, information about formal endorsement of QIs was barely available in the included articles. Research papers may put less emphasize on this type of information, which may have resulted in lower quality scores on these aspects. We have tried to resolve this by incorporating as much information as possible about the indicator sets when evaluating their quality. For example, we examined the relevant references and searched the internet. However, it was not always possible to find a report or website link from the reference lists, or to obtain enough detail about the development process from the references.
Conclusion and implications
This systematic literature review shows that, over the last decades, a substantial number of QIs has been developed or applied to assess the quality of care for older people in the community. When monitoring the quality of care, it would be useful for policy makers, researchers, clinicians and other relevant stakeholders to first consider the QIs that are already available before developing new indicators. Given the variation in methodological quality and rather low scores on some aspects, a priority could be to further improve the existing indicators. For example, the supporting evidence can be appraised more critically, QIs can be further tested in daily practice, adapted for use in other countries and the efforts needed for data collection can be decreased where possible. Currently, process QIs, focusing on clinical aspects and specific diseases are overrepresented. While the tendency to measure care performance is shifting from process to (patient-reported) outcome measures, this review shows that valid outcome indicators for the quality of care for older people are still relatively limited. It would be desirable to find a better balance between measuring processes and outcomes. Both types of indicators have their particular strengths and weaknesses, depending on the purpose for which the indicator is used and by whom [11, 12]. For clinicians, process indicators could be more interesting as these are direct measures of quality and give straightforward information. It may thus be more clear what action needs to be taken to improve the quality of care. The interpretation of differences in outcome indicators can be more difficult, as alternative explanations should be considered before it can be concluded that the difference truly reflects variations in the quality of care [11]. However, for other stakeholders, such as health care insurers or patients, the cause of differences in quality of care may be less importance and outcomes are likely to be more interesting. In this review, we identified only one QI set included a mix of process, outcome and structure [45]. As processes, outcomes and the structure of care are related to each other, we would recommend to consider all types of QIs when measuring the quality of care In addition, the findings suggest that more attention can be paid to non-clinical domains. Particularly for frail older people, remaining functionally stable, and living at home as long as possible in good (psycho-social) health are just as important as the treatment of medical problems. Lastly, generic indicators, measuring aspects of care that are relevant to most older patients (e.g. preventing acute hospitalization, loneliness, pain), were underrepresented. The stakeholder groups should realize these gaps when developing or utilizing QIs to optimize the care for older people in the community.
Supporting information
S3 Appendix. PRISMA checklist for systematic reviews.
https://doi.org/10.1371/journal.pone.0190298.s003
(PDF)
Acknowledgments
We would like to thank dr. Pam Kaspers for her help in searching the electronic databases.
References
- 1.
Eurostat. Eurostat Statistics Explained. Population Structure and ageing.: Eurostat; 2017 [updated 31 October 2017; cited 2017 8 November 2017]. http://ec.europa.eu/eurostat/statistics-explained/index.php/Population_structure_and_ageing.
- 2. Holm AL, Berland AK, Severinsson E. Managing the needs of older patients with multimorbidity. A systematic review of the challenges faced by the healthcare services. Open Journal of Nursing. 2016;6(10):10.
- 3. Cartier C. From home to hospital and back again: economic restructuring, end of life, and the gendered problems of place-switching health services. Soc Sci Med. 2003;56(11):2289–301. Epub 2003/04/30. pmid:12719182.
- 4.
Wiener JM, Tilly J, Cuellar AE. Consumer-Directed Home Care in the Netherlands, England and Germany. Washington, DC.: 2003.
- 5.
Colombo F, Llena-Nozal A, Mercier J, Tjadens F. Help wanted? Providing and paying for long-term care. Paris: 2011.
- 6.
WHO. The Solid Facts. Home Care in Europe. Milan: Università Commerciale Luigi Bocconi, 2008.
- 7. Leendertse AJ, Van Den Bemt PM, Poolman JB, Stoker LJ, Egberts AC, Postma MJ. Preventable hospital admissions related to medication (HARM): cost analysis of the HARM study. Value Health. 2011;14(1):34–40. Epub 2011/01/08. pmid:21211484.
- 8.
Jones R. Quality of primary care. In: Westert G J L. Schellevis FG., editor. Morbidity, performance and quality in primary care. Oxford: Dutch General Practice on Stage; 2006. p. 189–94.
- 9. Donabedian A. The quality of care. How can it be assessed? JAMA. 1988;260(12):1743–8. Epub 1988/09/23. pmid:3045356.
- 10. Bjertnaes OA, Sjetne IS, Iversen HH. Overall patient satisfaction with hospitals: effects of patient-reported experiences and fulfilment of expectations. BMJ Qual Saf. 2012;21(1):39–46. Epub 2011/08/30. pmid:21873465.
- 11. Mant J. Process versus outcome indicators in the assessment of quality of health care. Int J Qual Health Care. 2001;13(6):475–80. Epub 2002/01/05. pmid:11769750.
- 12. Rubin HR, Pronovost P, Diette GB. The advantages and disadvantages of process-based measures of health care quality. Int J Qual Health Care. 2001;13(6):469–74. Epub 2002/01/05. pmid:11769749.
- 13.
NQF. Measure Evaluation Criteria and Guidance for Evaluating Measures for Endorsement. 2016 August 2016. Report No.
- 14. Campbell SM, Braspenning J, Hutchinson A, Marshall M. Research methods used in developing and applying quality indicators in primary care. Qual Saf Health Care. 2002;11(4):358–64. Epub 2002/12/07. pmid:12468698
- 15.
de Koning J, Smulders A, Klazinga N. Appraisal of Indicators through Research and Evaluation (AIRE). Amsterdam: Academic Medical Center- University of Amsterdam, Medicine S; 2007.
- 16.
de Koning J. Development and validation of a measurement instrument for appraising indicator quality: appraisal of indicators through research and evaluation (AIRE) instrument. Kongress Medizin und Gesellschaft 2007; 17-09-2007; Augsburg. Düsseldorf: German Medical Science GMS Publishing House; 2007.
- 17. AGREE. Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project. Qual Saf Health Care. 2003;12(1):18–23. Epub 2003/02/07. pmid:12571340
- 18. De Roo ML, Leemans K, Claessen SJ, Cohen J, Pasman HR, Deliens L, et al. Quality indicators for palliative care: update of a systematic review. J Pain Symptom Manage. 2013;46(4):556–72. Epub 2013/07/03. pmid:23809769.
- 19. Pasman HR, Brandt HE, Deliens L, Francke AL. Quality indicators for palliative care: a systematic review. J Pain Symptom Manage. 2009;38(1):145–56. Epub 2009/07/21. pmid:19615636.
- 20. Smeulers M, Verweij L, Maaskant JM, de Boer M, Krediet CT, Nieveen van Dijkum EJ, et al. Quality indicators for safe medication preparation and administration: a systematic review. PLoS One. 2015;10(4):e0122695. Epub 2015/04/18. pmid:25884623
- 21. Strudwick K, Nelson M, Martin-Khan M, Bourke M, Bell A, Russell T. Quality indicators for musculoskeletal injury management in the emergency department: a systematic review. Acad Emerg Med. 2015;22(2):127–41. Epub 2015/02/14. pmid:25676528.
- 22.
Voeten S, Voeten D, Hegeman H, Wouters M, Krijnen P, Schipper I. Quality indicators in hip fracture management: a systematic review. PROSPERO 2016:CRD42016053425. 2016.
- 23. de Bruin-Kooistra M, Amelink-Verburg MP, Buitendijk SE, Westert GP. Finding the right indicators for assessing quality midwifery care. Int J Qual Health Care. 2012;24(3):301–10. Epub 2012/03/30. pmid:22457241.
- 24. Van Damme N, Buijck B, Van Hecke A, Verhaeghe S, Goossens E, Beeckman D. Development of a Quality of Meals and Meal Service Set of Indicators for Residential Facilities for Elderly. J Nutr Health Aging. 2016;20(5):471–7. Epub 2016/04/23. pmid:27102782.
- 25. Chodosh J, Pearson ML, Connor KI, Vassar SD, Kaisey M, Lee ML, et al. A dementia care management intervention: which components improve quality? Am J Manag Care. 2012;18(2):85–94. pmid:22435836
- 26. Ganz DA, Koretz BK, Bail JK, McCreath HE, Wenger NS, Roth CP, et al. Nurse practitioner comanagement for patients in an academic geriatric practice. Am J Manag Care. 2010;16(12):e343–e55. pmid:21291291
- 27. Jennings LA, Tan Z, Wenger NS, Cook EA, Han W, McCreath HE, et al. Quality of Care Provided by a Comprehensive Dementia Care Comanagement Program. J Am Geriatr Soc. 2016;64(8):1724–30. Epub 2016/06/30. pmid:27355394
- 28. Kim H, Helmer DA, Zhao Z, Boockvar K. Potentially preventable hospitalizations among older adults with diabetes. Am J Manag Care. 2011;17(11):e419–e26. pmid:22200058
- 29. Kogan P, Underwood S, Desmond D, Hayes M, Lucien G. Performance improvement in managed long-term care: physician communication in managing community-dwelling older adults. Home healthcare nurse. 2010;28(2):105–14. pmid:20147805
- 30. Lemus FC, Tan A, Eschbach K, Freeman DHJ, Freeman JL. Correlates of bacterial pneumonia hospitalizations in elders, Texas border. J Immigr Minor Health. 2010;12(4):423–32. pmid:19294512
- 31. Lund BC, Charlton ME, Steinman MA, Kaboli PJ. Regional differences in prescribing quality among elder veterans and the impact of rural residence. J Rural Health. 2013;29(2):172–9. pmid:23551647
- 32. Reuben DB, Ganz DA, Roth CP, McCreath HE, Ramirez KD, Wenger NS. Effect of nurse practitioner comanagement on the care of geriatric conditions. J Am Geriatr Soc. 2013;61(6):857–67. pmid:23772723
- 33. Roth CP, Ganz DA, Nickles L, Martin D, Beckman R, Wenger NS. Nurse care manager contribution to quality of care in a dual-eligible special needs plan. J Gerontol Nurs. 2012;38(7):44–54. pmid:22833891
- 34. Vickrey BG, Mittman BS, Connor KI, Pearson ML, Della Penna RD, Ganiats TG, et al. The effect of a disease management intervention on quality and outcomes of dementia care: a randomized, controlled trial. Ann Intern Med. 2006;145(10):713–26. Epub 2006/11/23. pmid:17116916.
- 35. Wenger NS, Roth CP, Martin D, Nickels L, Beckman R, Kamberg C, et al. Quality of care provided in a special needs plan using a nurse care manager model. J Am Geriatr Soc. 2011;59(10):1810–22. pmid:22091494
- 36. Wenger NS, Roth CP, Shekelle P. Introduction to the assessing care of vulnerable elders-3 quality indicator measurement set. J Am Geriatr Soc. 2007;55 Suppl 2:S247–52. Epub 2007/10/04. pmid:17910544.
- 37. Fahey T, Montgomery AA, Barnes J, Protheroe J. Quality of care for elderly residents in nursing homes and elderly people living at home: Controlled observational study. British Medical Journal. 2003;326(7389):580–3. pmid:12637404
- 38. Jones K, Netten A, Francis J, Bebbington A. Using older home care user experiences in performance monitoring. Health Soc Care Community. 2007;15(4):322–32. pmid:17578393
- 39. Shah SM, Carey IM, Harris T, DeWilde S, Cook DG. Quality of chronic disease care for older people in care homes and the community in a primary care pay for performance system: retrospective study. BMJ. 2011;342:d912. pmid:21385803
- 40. Venables D, Reilly S, Challis D, Hughes J, Abendstern M. Standards of care in home care services: a comparison of generic and specialist services for older people with dementia. Aging & Mental Health. 2006;10(2):187–94.
- 41. Kroger E, Tourigny A, Morin D, Cote L, Kergoat MJ, Lebel P, et al. Selecting process quality indicators for the integrated care of vulnerable older adults affected by cognitive impairment or dementia. BMC health services research. 2007;7:195. pmid:18047668
- 42. Chang SC, Shiu MN, Chen HT, Ng YY, Lin LC, Wu SC. Evaluation of care quality for disabled older patients living at home and in institutions. J Clin Nurs. 2015;24(23–24):3469–80. Epub 2015/09/04. pmid:26333176.
- 43. Kajonius PJ, Kazemi A. Safeness and Treatment Mitigate the Effect of Loneliness on Satisfaction With Elderly Care. Gerontologist. 2016;56(5):928–36. Epub 2015/01/30. pmid:25628300
- 44. Askari M, Eslami S, van Rijn M, Medlock S, Moll van Charante EP, van der Velde N, et al. Assessment of the quality of fall detection and management in primary care in the Netherlands based on the ACOVE quality indicators. Osteoporos Int. 2016;27(2):569–76. Epub 2015/07/22. pmid:26194490
- 45. Perry M, Draskovic I, van Achterberg T, van Eijken M, Lucassen P, Vernooij-Dassen M, et al. Development and validation of quality indicators for dementia diagnosis and management in a primary care setting. J Am Geriatr Soc. 2010;58(3):557–63. pmid:20210818
- 46. van der Ploeg E, Depla MF, Shekelle P, Rigter H, Mackenbach JP. Developing quality indicators for general practice care for vulnerable elders; transfer from US to The Netherlands. Qual Saf Health Care. 2008;17(4):291–5. Epub 2008/08/06. pmid:18678728.
- 47. Beerens HC, Sutcliffe C, Renom-Guiteras A, Soto ME, Suhonen R, Zabalegui A, et al. Quality of life and quality of care for people with dementia receiving long term institutional care or professional home care: the European RightTimePlaceCare study. J Am Med Dir Assoc. 2014;15(1):54–61. Epub 2013/11/14. pmid:24220139.
- 48. Foebel AD, van Hout HP, van der Roest HG, Topinkova E, Garms-Homolova V, Frijters D, et al. Quality of care in European home care programs using the second generation interRAI Home Care Quality Indicators (HCQIs). BMC Geriatr. 2015;15:148. Epub 2015/11/18. pmid:26572734
- 49. Neumark AS, Brudin L, Neumark T. Adherence to national diabetes guidelines through monitoring quality indicators—A comparison of three types of care for the elderly with special emphasis on HbA1c. Prim Care Diabetes. 2015;9(4):253–60. Epub 2015/04/14. pmid:25865853.
- 50. Morris JN, Fries BE, Frijters D, Hirdes JP, Steel RK. interRAI home care quality indicators. BMC Geriatr. 2013;13:127. Epub 2013/11/20. pmid:24245920
- 51.
AHRQ, cartographer Agency for Healthcare Research and Quality Prevention Quality Indicators. Rockville, MD: Agency for Healthcare Research and Quality; 2016.
- 52. Weldring T, Smith SM. Patient-Reported Outcomes (PROs) and Patient-Reported Outcome Measures (PROMs). Health Serv Insights. 2013;6:61–8. Epub 2013/01/01. pmid:25114561
- 53.
Williams K, Sansoni J, Darcy M, Grootemaat P, Thompson C. Patient-reported outcome measures. Literature review. Sydney: Australian Commission on Safety and Quality in Health Care, 2016.