http://orcid.org/0000-0002-6736-3098
Figures
Abstract
Background
Integrated care is recognised as an important enabler to healthy ageing, yet few countries have managed to sustainably deliver integrated care for older people. We aimed to gather global consensus on the key actions required to realign health and long-term systems and integrate services to implement the World Health Organization (WHO) Integrated Care for Older People (ICOPE) approach.
Methods
A two-round eDelphi study, including a global consultation meeting, was undertaken to identify, refine and generate consensus on the actions required across high-, middle- and low-income countries to implement the WHO ICOPE approach. In round 1, a framework of 31 actions, empirically derived from previous WHO evidence reviews was presented to panellists to judge the relative importance of each action (numeric rating scale; range:1–9) and provide free-text comments concerning the scope of the actions. These outcomes were discussed and debated at the global consultation meeting. In round 2, a revised framework of 19 actions was presented to panellists to measure their extent of agreement and identify ‘essential’ actions (five-point Likert scale; range: strongly agree to strongly disagree). A threshold of ≥80% for agree/strongly agree was set a priori for consensus.
Results
After round 1 (n = 80 panellists), median scores across 31 actions ranged from 6 to 9. Based on pre-defined category thresholds for median scores, panellists considered 28 actions (90·3%) as ‘important’ and three (9·7%) as ‘uncertain’. Fifteen additional actions were suggested for inclusion based on free-text comments, creating 46 for consideration at the global consultation meeting. In round 2 (n = 84 panellists), agreement (agree or strongly agree) ranged from 84·6–97·6%, suggesting consensus. Fourteen (73·7%) actions were rated as essential.
Citation: Briggs AM, Araujo de Carvalho I (2018) Actions required to implement integrated care for older people in the community using the World Health Organization's ICOPE approach: A global Delphi consensus study. PLoS ONE 13(10): e0205533. https://doi.org/10.1371/journal.pone.0205533
Editor: Peter Van Bogaert, University of Antwerp, BELGIUM
Received: July 18, 2018; Accepted: September 26, 2018; Published: October 11, 2018
Copyright: © 2018 Briggs, Araujo de Carvalho. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The German Federal Ministry of Health and the Japanese Ministry of Health, Labour and Welfare supported the global consultation meeting financially and in kind. AMB is supported by Fellowships awarded by the Australian National Health and Medical Research Council (#1132548) and the Bone and Joint Decade Foundation. The funding bodies had no role in the study design, in collection, analysis or interpretation of data, writing of the manuscript, or the decision to submit the manuscript for publication.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The global population is ageing more rapidly than ever before–from 2015 to 2050, the proportion of the global population aged 60 years and over will nearly double [1]. This change will happen across high-, middle- and low-income settings, highlighting the need for a realigning health systems to the needs of the older populations they now serve [1]. Population ageing is largely attributed to longer life expectancy, lower fertility rates and increasing prevalence of chronic health conditions, which commonly manifest as multi-morbidities in older people [2]. Many other major social changes are occurring alongside population ageing, for example urbanization and globalization have been accompanied by increased migration, in which younger generations migrate to areas of growth, while older people are left in poorer rural areas without family structures and social safety. Collectively, these issues create new and complex challenges for health and long-term care systems.
There is an urgent need to realign health systems and build sustainable long-term care systems to better respond to the health and social care needs of older populations [3, 4]. Providing person-centred and integrated care and guaranteeing access to it will require systems to be organized around older people’s needs and preferences, and will require services to be age-friendly and closely engaged with families and communities [1]. The World Health Organization (WHO) defines integrated care as “services that are managed and delivered so that people receive a continuum of health promotion, disease prevention, diagnosis, treatment, disease-management, rehabilitation and palliative care services, coordinated across the different levels and sites of care within and beyond the health sector, and according to their needs throughout the life course” [4]. Integration initiatives therefore need to involve multiple sites and levels, including: system-level (macro), service/organisational-level (meso) and clinical-level (micro) activities [5, 6]. In the context of care delivery for older people, WHO operationalized this concept of integrated care through the Integrated Care for Older People (ICOPE) approach [5]. The ICOPE approach is aimed at improving or maintaining older people’s intrinsic capacity and functional ability to support healthy ageing [1], through community- level health and social care interventions [3].
Integration of health and social care is widely advocated as a way to improve the management and outcomes for the increasing numbers of older people with varying and complex health needs [1, 7]. Despite this, the evidence for the effectiveness of integrated care approaches remains inconsistent across care settings [8–14] and there is variability in the elements within integrated care interventions [5, 15]. Support for implementation efforts of integrated care approaches such as ICOPE are needed to ensure sustainability and scalability beyond pilot initiatives and trials, and critically, that are transferable across economies and care settings. While evidence is accumulating to support implementation efforts [6, 16–18], there remains no global consensus concerning actions required at the service (meso) or system (macro) levels to achieve sustainable implementation of integrated care approaches for older people. The majority of research directed at enabling care integration has been undertaken at the micro (clinical) level [5, 19], with less attention devoted to supporting implementation at meso and macro levels. WHO has also undertaken research at the micro level through the development of clinical guidelines and is currently translating that evidence into practical support tools for community-based health workers [20]. Therefore, the aim of this study was to evaluate and generate consensus on specific actions required for implementation of the WHO ICOPE approach at the meso and macro levels.
Methods
Design
A two-round eDelphi study and global consultation meeting undertaken between Round 1 and Round 2, were used to address the research aim. Ethical approval to conduct the study was granted by the WHO Research Ethics Review Committee and participants provided consent to participate in the research. Specifically, participants enrolled in the study through an electronic survey platform (described below) where they could review a Participant Information Statement and consent or decline to participate by selecting an on-screen button.
Sampling
A multinational and multidisciplinary panel of experts, service providers and policy makers in integrated care for older people was recruited by WHO in 2017. The panel was constructed to be representative across professional disciplines; diverse research, policy and service design and delivery foci; and across high-, middle- and low-income economies of the UN Member States. While we did not include individual older people themselves on the panel, since the intended primary users of the research outcomes were service providers, service managers and system managers; national and international organisations representing health and social care for older people were included.
Round 1.
In constructing the Delphi panel for round 1, potential research, policymaker, practitioner and civil society panellists were identified from a number of sources, including the professional contact network of the WHO Department of Ageing and Life Course; the six WHO regional offices; and relevant academic journal publications on integrated care approaches for older people using a systematic search strategy published in aligned work [5]. Using these sampling methods, 150 individuals were identified to participate in Round 1. Each received a direct email invitation from WHO to participate and respond to screening questions to determine eligibility and provide consent to participate.
Potential panellists were considered eligible to join the panel if they: 1) were currently involved in policy development or implementation related to health or social care for older people; or 2) had five or more years of professional engagement or experience in implementation of integrated care approaches; or 3) had published three or more peer-reviewed journal papers on integrated care approaches.
Global consultation meeting.
A three-day global consultation was undertaken in Berlin in October 2017 (http://www.who.int/ageing/health-systems/icope/icope-consultation/en/) [21]. Panellists who participated in Round 1 (n = 80) and representatives from Member States and organisations that represented older people or were involved in health or social care delivery for older people were invited to participate in the global consultation (n = 49).
Round 2.
Whereas the focus of Round 1 was largely exploratory in nature and aimed to evaluate the relative importance and content validity of an empirically-derived initial framework of ICOPE elements with a more narrow expert Delphi panel, Round 2 aimed to sample experts more broadly in order to comprehensively evaluate the acceptability of a revised framework of ICOPE actions developed as an outcome of the global consultation meeting. For this reason, the Round 2 panel was expanded beyond Round 1 participants.
Panellists from Round 1 were invited to participate in Round 2. The Round 2 panel was expanded from Round 1 by sampling WHO staff from across the globe to ensure that all relevant WHO program areas had the opportunity to contribute. The systematic search strategy used in sampling researchers for Round 1 was repeated for the time period between the end of Round 1 and commencement of Round 2 to identify any researchers with recently published papers who could participate in Round 2. 194 direct email invitations to participate in Round 2 were issued, consisting of 80 Round 1 participants, 60 WHO staff, 49 participants from the global consultation meeting who did not participate in Round 1, and 5 additional (first-author) research experts identified through an updated systematic literature search.
eDelphi protocol and analysis
For each round, an online survey platform was created in LimeSurveyTM software (LimeSurvey GmbH, Hamburg, Germany). The survey collected demographic information to characterise the panel at each phase and presented a framework of ICOPE elements.
In Round 1, a framework of 31 elements relating to implementation of the ICOPE approach in health and long-term care systems was presented to panellists. An ‘element’ was defined as ‘a component of care or an action that is implementable to enable integrated care for older people’. Elements were empirically-derived from existing WHO evidence reviews [1, 5, 7], a pre-established taxonomy of 59 elements of integrated care [15], the WHO Framework on Integrated People Centred Health Services [4], and through internal consultation within WHO. For each of the 31 elements presented, panellists were asked to rate its level of importance in implementation of the WHO ICOPE approach using a 9-point numeric rating scale (1 = lowest importance to 9 = highest importance). Panellists were also invited to suggest revisions to elements or additional elements in free-text fields.
The criteria of the RAND UCLA appropriateness method were used to analyse data from Round 1.[22] For each element, the panel median was categorized as follows: 1–3 as not important, 4–6 as equivocal and 7–9 as important. The threshold for panel agreement was determined a priori as ≥ 70% of panellists’ ratings within the same 3-point region (that is, 1–3, 4–6, or 7–9) as the observed median. An element was defined as “important” where the overall panel median score was ≥ 7 with level of agreement of ≥ 70% within the 3-point region 7–9. An element with a panel median of 4–6 or median with a consensus of ≤ 70% within the same 3-point region was defined as “uncertain” and flagged for discussion at the global consultation meeting. An element with a panel median of 1–3 and a level of agreement of ≥ 70% within the 3-point region 1–3, was defined as “unimportant” and was removed from the framework of elements. Free text comments were content-analysed using a standard summative content analysis approach [23]. The analysis was restricted to comments relating to specific elements within the framework of 31 presented, and/or comments relating to new elements for consideration. Each comment was reviewed and like comments combined to create a list of additional elements suggested by the panellists. All comments were considered valid and presented for consideration at the global consultation meeting.
In Round 2, panellists were asked to review a revised framework of ‘actions’, presented as a detailed consultation document (available on request from the authors), and rate their level of agreement with each action as a required action to implement the WHO ICOPE approach using a 5-point Likert scale (1 = strongly disagree to 5 = strongly agree). In round 1, the components of the framework were referred to as ‘elements’, whereas in round 2, they were re-framed as ‘actions’. Typically, 9 or 10-point numeric ratings scales are used to measure a continuous construct such as importance, whereas a 5-point Likert scale is more appropriate when measuring latent constructs such as agreement [24]. Where panellists responded with a rating of ≤3 for an action, they were prompted to provide an explanatory response in a free-text field. Where panellists provided a response of ≥4 for an action, they were asked to consider whether the action was essential (i.e. a fundamental requirement) or non-essential (i.e. important, but not essential) for implementing the ICOPE approach. Panellists were also asked to provide their level of agreement with the revised overall framework of actions using the same 5-point scale, optionally provide general free-text comments on the revised overall framework, and rate the revised framework according to the five dimensions of the Honeycomb Model of User Experiences, using the same 5-point Likert scale [25, 26]. Nominal responses were analyzed using frequency statistics. A pooled panel threshold of ≥80% for “agree [4]” or “strongly agree [5]” responses was set a priori for retaining actions or identifying if an action was ‘essential’. The free-text comments from round 2 were similarly content-analysed using a summative content-analysis approach [23]. Each response was reviewed and categorized by one author (AMB) as either ‘relating to the action’, ‘relating to implementation of the action’, ‘an overarching guiding principle’, or ‘other’. Data categorised as ‘relating to the action’ were used to refine the actions and these were verified by a second author (IAC). Data relating to any other category were used by WHO to develop an implementation toolkit. The design and thresholds for Round 2 was consistent with a previously used method to develop a system-level framework [26].
Descriptive statistics were used to characterize the panel at each stage. The authors and broader group of collaborators (see Acknowledgments) reviewed the framework at each round for clarity and meaningfulness.
Global consultation
As part of the global consultation small group (n = 9–10), facilitated discussions were held to consider the quantitative and qualitative outcomes of Round 1. Each group was led by two WHO facilitators to consider clarity of the elements, the appropriateness of new elements suggested by panellists in Round 1 and interpret reasons for lack of consensus for some elements in Round 1.
Results
Fig 1 summarises the stages and outcomes of the consensus exercise.
Panel and global consultation characteristics
The demographic characteristics of the Delphi panels are summarised in Table 1. Of the 150 stakeholders invited to participate in Round 1, 85 (56·7%) participated, of which 80 (94%) were deemed eligible. In Round 2, 92 (47·4%) of the 194 invitees participated, of which 84 (91·3%) were deemed eligible. Of these, 35 (41·7%) and 40 (47·6%) also participated in Round 1 and global consultation meeting, respectively.
81 delegates participated in the global consultation meeting, of which 31 (38·3%) participated in Round 1. Delegates represented international research or service delivery experts (n = 37, 45·7%), Member States (n = 28, 34·6%) and WHO technical and support staff (n = 16, 19·7%).
Round 1 outcomes
Across the 31 elements, median scores ranged from 6 to 9 and agreement within pre-specified median bands from 51·2–96·2%. Based on RAND UCLA criteria, panellists considered 28 of the 31 elements (90·3%) as important and three (9·7%) elements as uncertain after Round 1 and flagged for discussion at the global consultation meeting (#12: use of provider report cards; #18: integration of traditional and complementary medicines into health services; #21: development of new work cadres). No elements were ranked as unimportant (S1 Table). Compared to a pooled sample, panellists from high-income settings considered two additional elements (#2: active case finding; #19: establishment of performance management practices) as uncertain (n = 5 uncertain in total, 16.1%), whereas panellists from middle- and low-income settings considered only one element each as uncertain (n = 1, 3·2% and n = 1, 3·2%; respectively). In analysing free-text responses, an additional 15 elements were proposed (S1 File), culminating in 28 definitive elements, 3 uncertain elements and 15 potential additional elements for consideration at the end of Round 1 (N = 46). The additional 15 elements represented 7 themes, including: greater emphasis on ICT systems; specialised hospital and out of hospital services (public or private); outcomes-based funding models; workforce capacity building strategies; clinical guidelines to support care delivery; long-term care insurance; and age-friendly infrastructure.
Global consultation outcomes
The 46 elements from Round 1 were considered and interpreted at the global consultation meeting. In discussing the three uncertain elements from round 1, participants concluded these elements were important considerations for ICOPE but needed to better contextualised in an overall approach to the implementation of ICOPE. Delegates recommended re-framing of all the elements as implementation-based action statements, pooling of like elements, and categorisation of elements into logical domains [21]. The WHO technical unit undertook a phased revision process, including: reducing redundancy across the 46 elements by pooling like-elements, grouping elements according to the WHO Framework on integrated people-centred health services [4], re-framing elements into action statements (henceforth, we refer to the components of the framework as ‘actions’, rather than ‘elements’) and undertaking an internal and external review of a revised framework of 19 actions.
Round 2 outcomes
The pooled panel strength of agreement (agree or strongly agree) across the 19 actions ranged from 84·6–97·6%, suggesting consensus across the final set of all 19 (100%) actions; 9 (47·4%) targeted at the meso-level and 10 (52·6%) at the macro-level (Table 2). Similarly, all actions were scored as ≥80% agree and strongly agree by respondents in low-, middle- and high-income settings, other than action #18 (‘Utilise digital strategies to support self-management’) by high-income country respondents (79·5%; Table 2). Fourteen (73·7%) actions were rated as essential. Actions #10–12, #17 and #18 were ranked below the threshold for inclusion as essential by the pooled panel (range: 52·1–79·7%), largely due to responses from panellists in high-income settings.
Actions are presented by domains of the WHO Framework on integrated people centred health services (IPCHS) and include an action title, target level for the health/social care system and a summative description. Responses presented as percentages (%) from 84 respondents, pooled and disaggregated by economic band.
The panel strongly supported the revised framework of actions with ratings of agree or strongly agree across the five dimensions of the User Experience model of 79·6–98·0% (Fig 2).
Discussion
While previous literature has synthesised evidence for the components of integrated care approaches for older people and barriers and enablers to their implementation [5, 6], to our knowledge this is the first study to examine the specific actions required to implement integrated care at community level and identify actions needed in systems (macro-level) and services (meso-level) globally. WHO has already undertaken research at the micro level [20]. These data are essential for WHO to take evidence-informed actions in supporting implementation of the ICOPE approach in Member States. In particular, the actions will contribute to improving quality of care for older people, which is critical to achieving universal health coverage [27]. The final set of 19 actions (10 macro-level and 9 meso-level focussed) was strongly supported by the Delphi panel and the construction of the framework deemed highly useful, usable, credible, valuable and appealing according to the User Experience model. The specific actions guide policy makers and service managers to provide integrated care for older people through harnessing community involvement; building capacity in the paid and unpaid workforce; establishing appropriate governance, policy and financing models; prioritising service delivery in community settings; and levering health information and digital systems.
The Delphi panel was representative of a broad cross-section of experienced stakeholders across disciplines, care settings and geographies and was comparable between rounds 1 and 2. However, the panel was over-represented by research/academic participants and stakeholders from high-income settings in Asia and the European Union. Although this may introduce some sampling bias and influence the uptake and transferability of the final framework, we observed infrequent differences in the ranking of actions between high-, middle-, and low-income settings. It may be that with greater sampling of participants from low and middle-income settings, the frequency distributions may shift somewhat and this represents an important area for further research.
At the conclusion of round 1, three elements were flagged as uncertain, and none were excluded. This suggests that the initial, empirically derived set of 31 elements for ICOPE largely reflected contemporary approaches to integrated care for older people and the state of the evidence for interventions and implementation priorities. The uncertain elements (provider report cards, traditional and complementary medicines, new work cadres) were perhaps the most controversial of the initial set of 31 elements and insufficiently described. The additional elements identified by panellists from high-income settings as uncertain (case finding and performance management practices) may have also reflected a perception of overly burdensome system reform requirements for implementation of the ICOPE approach in systems that are already highly structured with relatively less flexibility than those of low- and middle-income settings. Notably, evidence synthesis suggests that macro-level contextual factors, such as cultural inertia and system instability; as well as specific provider-level factors in engagement, understanding and communication may stymie implementation efforts [6]. The opportunity to debate these uncertainties at the global consultation meeting facilitated a shared understanding of meaning of the elements and how they could be considered in implementing the ICOPE approach.
Round 2 outcomes confirmed consensus around a revised framework of 19 actions (re-framed from elements), with no actions eliminated, and support for the construction of the framework organised by WHO Framework on integrated people-centred health services. Although meeting the threshold for inclusion, the use of digital technologies to support self-management of health in older people (action #18) was ranked relatively the least important for implementing integrated care for older people, driven largely by responses from panellists in high-income settings. Conversely, panellists from middle- and low-income agreed more strongly that such digital technologies were needed to implement integrated care for older people. This geographic variance may indicate an increased awareness of the potential for remote monitoring, decision aids and communication offered by smart and mobile technologies [28, 29], on a background of widespread use of mobile phones in low- and middle-income settings offering opportunities at scale through mHealth technologies [30]. While not considered essential for implementation of the ICOPE approach, digital technologies are increasingly likely to support ageing in place and enable access to health services for older people, particularly as design moves towards a more person-centred focus [31].
Five actions were considered non-essential for implementation of the ICOPE approach. This outcome was largely influenced by respondents from high-income settings. Three actions related to information and communication technologies (ICT) and likely reflect concerns about capacity of health systems, particularly those in low- and middle-income settings, to implement and finance ICT systems with appropriate interoperability and security features, consistent with aligned evidence [32]. Respondents from low- and middle-income settings considered case finding processes essential, which may reflect greater care and access disparities for older people in these settings compared with high-income settings. High- and middle-income respondents did not consider human resources processes essential, perhaps due to the existence of such processes already in these settings. Nonetheless, the WHO Global strategy on human resources for health identifies human resources processes as a key component of workforce capacity building to meeting the Sustainable Development Goals [33].
While our findings relate to specific implementation actions for the WHO ICOPE approach, the domains align with evidence from prior reviews on components of integrated care for older adults and foci for implementation [5, 6], suggesting construct validity. Unlike other approaches supporting implementation of integrated care approaches, this framework particularly highlights the central role of unpaid carers, such as family members [34], as a critical component of the workforce, particularly in long-term care systems [35], and the need to appropriately support this workforce. Our data similarly reflect the view that older people and their families should be active partners in care planning and delivery across the care continuum to facilitate health system strengthening and its resilience [34]. Our research has a number of strengths. First, these data will inform WHO actions to support implementation of the ICOPE approach in Member States, reflecting a pre-planned, direct translation pathway to implementation tools that target meso and macro-level processes–levels that are largely underrepresented in implementation research [5, 6]. While evidence for components of integrated care interventions for older adults is evolving [5, 6], major gaps exist in the sustainable implementation of effective models into systems and services, likely due to the complexities of implementation [17, 18]. Second, we initiated the Delphi process with an empirically derived, evidence-informed framework of elements, rather than seeking expert opinion. Thus, we relied on experts to judge the feasibility and suitably of the elements, rather than the evidence underpinning them–creating an implementation rather than efficacy focus. Third, inclusion of a global consultation meeting between rounds 1 and 2 provided the opportunity to interpret and contextualise the findings from round 1, and develop a more user-centred and intuitive framework of actions in the subsequent round. The data presented should be interpreted in the context of some limitations. Sampling bias may represent an important limitation in this study. First there is a sampling bias towards panellists in high-income settings with oversampling of academic participants. Nonetheless, we achieved good representation and engagement from Member States, which will ultimately assist in supporting implementation efforts. In this context, it will be important to evaluate acceptability of any implementation tools developed by WHO by the anticipated end users of the research outcomes. It is important that future research and implementation efforts also specifically involve stakeholders from low and middle-income settings to ensure transferability of findings to these settings and to overcome limited research involving these settings [36]. Second, the sampling method did not include older people (consumers) as panel members. While we recognise the importance of appropriately including consumers in research, from inception through to implementation, the focus of the study was at the service and system levels with anticipated primary users of the research product/outcome being service and system-level managers/decision makers, thus not directly relevant to consumers. While existing research has identified consumers’ views on integrated care approaches [37, 38], it will be critical to involve consumers at all stages of implementation, as identified in final consensus framework of actions.
Supporting information
S1 File. Additional 15 elements proposed in Round 1.
https://doi.org/10.1371/journal.pone.0205533.s001
(DOCX)
Acknowledgments
We gratefully acknowledge Professor Michael Kidd (University of Toronto), Assistant Professor Michelle Nelson (University of Toronto), Dena Jevadi (WHO), Nuria Toro Polano (WHO), Dr John Beard (WHO) and Dr Jotheeswaran Thiyagarajan (WHO) for independently reviewing the frameworks of elements and supporting the Delphi study. We acknowledge Dr Pim Valentijn (Essenburgh Research & Consultancy) for input into developing the protocol for Delphi round 1.
References
- 1.
World Health Organisation. World Report on Ageing and Health. Geneva: WHO, 2015.
- 2. Afshar S, Roderick PJ, Kowal P, Dimitrov BD, Hill AG. Multimorbidity and the inequalities of global ageing: a cross-sectional study of 28 countries using the World Health Surveys. BMC Public Health. 2015;15:776. pmid:26268536
- 3.
World Health Organisation. Global strategy and action plan on ageing and health. Geneva: World Health Organization, 2016.
- 4.
World Health Organization. Framework on integrated, people-centred health services. Geneva: World Health Organization, 2016 Contract No.: A69/39.
- 5. Briggs AM, Valentijn PP, Thiyagarajan JA, Araujo de Carvalho I. Elements of integrated care approaches for older people: a review of reviews. BMJ Open. 2018;8(4):e021194. pmid:29627819
- 6. Threapleton DE, Chung RY, Wong SYS, Wong E, Chau P, Woo J, et al. Integrated care for older populations and its implementation facilitators and barriers: A rapid scoping review. Int J Quality Health Care. 2017;29(3):327–34. pmid:28430963
- 7. Araujo de Carvalho I, Epping-Jordan J, Pot AM, Kelley E, Toro N, Thiyagarajan JA, et al. Organizing integrated health-care services to meet older people’s needs. Bull World Health Organ. 2017;95(11):756–63. pmid:29147056
- 8. Beswick AD, Rees K, Dieppe P, Ayis S, Gooberman-Hill R, Horwood J, et al. Complex interventions to improve physical function and maintain independent living in elderly people: a systematic review and meta-analysis. Lancet. 2008;371(9614):725–35. pmid:18313501
- 9. Bouman A, van Rossum E, Nelemans P, Kempen G, Knipschild P. Effects of intensive home visiting programs for older people with poor health status: A systematic review. BMC Health Serv Res. 2008;8. pmid:18387184
- 10. Huss A, Stuck AE, Rubenstein LZ, Egger M, Clough-Gorr KM. Multidimensional preventive home visit programs for community-dwelling older adults: A systematic review and meta-analysis of randomized controlled trials. J Gerontol Ser A-Biol Sci Med Sci. 2008;63(3):298–307.
- 11. Stuck AE, Egger M, Hammer A, Minder CE, Beck JC. Home visits to prevent nursing home admission and functional decline in elderly people—Systematic review and meta-regression analysis. JAMA-J Am Med Assoc. 2002;287(8):1022–8.
- 12. Tappenden P, Campbell F, Rawdin A, Wong R, Kalita N. The clinical effectiveness and cost-effectiveness of home-based, nurse-led health promotion for older people: a systematic review. Health Techno Assess. 2012;16(20):1–72. pmid:22490205
- 13. van Haastregt JCM, Diederiks JPM, van Rossum E, de Witte LP, Crebolder H. Effects of preventive home visits to elderly people living in the community: systematic review. Br Med J. 2000;320(7237):754–8.
- 14. You EC, Dunt D, Doyle C, Hsueh A. Effects of case management in community aged care on client and carer outcomes: a systematic review of randomized trials and comparative observational studies. BMC Health Serv Res. 2012;12. pmid:23151143
- 15. Valentijn PP, Boesveld IC, van der Klauw DM, Ruwaard D, Struijs JN, Molema JJ, et al. Towards a taxonomy for integrated care: a mixed-methods study. Int J Integr Care. 2015;15:e003. pmid:25759607
- 16. Valentijn PP, Schepman SM, Opheij W, Bruijnzeels MA. Understanding integrated care: a comprehensive conceptual framework based on the integrative functions of primary care. Int J Integr Care. 2013;13:e010. pmid:23687482
- 17. Angus L, Valentijn PP. From micro to macro: assessing implementation of integrated care in Australia. Aust J Prim Health. 2018;24(1):59–65. pmid:29132497
- 18. Kirst M, Im J, Burns T, Baker GR, Goldhar J, O'Campo P, et al. What works in implementation of integrated care programs for older adults with complex needs? A realist review. Int J Quality Health Care. 2017;29(5):612–24. pmid:28992156
- 19. Briggs AM, Chan M, Slater H. Models of Care for musculoskeletal health: Moving towards meaningful implementation and evaluation across conditions and care settings. Best Pract Res Clin Rheumatol. 2016;30(3):359–74. pmid:27886937
- 20.
World Health Organization. Guidelines on community-level interventions to manage declines in intrinsic capacity. Geneva: WHO, 2017.
- 21.
World Health Organization. Global consultation on integrated care for older people (ICOPE)–the path to universal health coverage: report of consultation meeting 23–25 October 2017 in Berlin, Germany. Geneva: WHO, 2018.
- 22.
Fitch K, Bernstein SJ, Aguilar MA, Burnard B, Ramon LaCalle J, van het Loo M, et al. The RAND/UCLA Appropriateness Method User’s Manual. Santa Monica, CA: RAND; 2001.
- 23. Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88. pmid:16204405
- 24. Giannarou L, Zervas E. Using Delphi technique to build consensus in practice. Int J Business Science Applied Management. 2014;9(2):65–82.
- 25.
Moreville P. User Experience Design Michigan: Semantic Studios; 2014 [cited 2016 5 January]. Available from: http://semanticstudios.com/user_experience_design/.
- 26. Briggs AM, Jordan JE, Jennings M, Speerin R, Bragge P, Chua J, et al. Supporting the evaluation and implementation of musculoskeletal Models of Care: A globally informed framework for judging readiness and success. Arthritis Care Res. 2017;69(4):567–77. pmid:27273891
- 27.
World Health Organization., Organisation for Economic Co-operation and Development., The World Bank. Delivering quality health services: a global imperative for universal health coverage. Geneva: WHO, OECD and The World Bank, 2018.
- 28. Liu LL, Stroulia E, Nikolaidis I, Miguel-Cruz A, Rincon AR. Smart homes and home health monitoring technologies for older adults: A systematic review. Int J Med Inform. 2016;91:44–59. pmid:27185508
- 29. Free C, Phillips G, Watson L, Galli L, Felix L, Edwards P, et al. The effectiveness of mobile-health technologies to improve health care service delivery processes: A systematic review and meta-analysis. PLOS Medicine. 2013;10(1):e1001363. pmid:23458994
- 30. Davey S, Davey A. Mobile-health technology: Can it strengthen and improve public health systems of other developing countries as per Indian strategies? A systematic review of the literature. Int J Med Public Health. 2014;4(1):40–5.
- 31. Wildenbos GA, Peute L, Jaspers M. Aging barriers influencing mobile health usability for older adults: A literature based framework (MOLD-US). Int J Med Inform. 2018;114:66–75. pmid:29673606
- 32. Slater H, Campbell JM, Stinson JN, Burley MM, Briggs AM. End user and implementer experiences of mHealth technologies for noncommunicable chronic disease management in young adults: Systematic review. J Med Internet Res. 2017;19(12):e406. pmid:29233804
- 33.
World Health Organization. Global strategy on human resources for health: Workforce 2030. Geneva: WHO, 2016.
- 34. O'Hara JK, Aase K, Waring J. Scaffolding our systems? Patients and families 'reaching in' as a source of healthcare resilience. BMJ Qual Saf. 2018. pmid:29764929
- 35. Pot AM, Briggs AM, Beard JR. The sustainable development agenda needs to include long-term care. J Am Med Dir Assoc. 2018;19(9):725–7. pmid:30149838
- 36. Lloyd-Sherlock P. Beyond neglect: Long-term care research in low and middle income countries. Int J Gerontol. 2014;8(2):66–9. https://doi.org/10.1016/j.ijge.2013.05.005.
- 37. D'Avanzo B, Shaw R, Riva S, Apostolo J, Bobrowicz-Campos E, Kurpas D, et al. Stakeholders' views and experiences of care and interventions for addressing frailty and pre-frailty: A meta-synthesis of qualitative evidence. PLoS ONE. 2017;12(7):e0180127. https://dx.doi.org/10.1371/journal.pone.0180127. pmid:28723916
- 38. Spoorenberg SLW, Wynia K, Fokkens AS, Slotman K, Kremer HPH, Reijneveld SA. Experiences of community-living older adults receiving integrated care based on the Chronic Care Model: A qualitative study. Plos One. 2015;10(10). pmid:26489096