Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Do family physicians with focused practice or Care of the Elderly training practice differently than others? A population-based, propensity score-matched cohort study

  • Rebecca H. Correia ,

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Visualization, Writing – original draft

    correirh@mcmaster.ca

    Affiliations Department of Health Research Methods, Evidence and Impact, Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada, Department of Family Medicine, Faculty of Medicine, Dalhousie University, Halifax, Nova Scotia, Canada

  • David Kirkwood,

    Roles Data curation, Investigation, Writing – review & editing

    Affiliation ICES, McMaster University, Hamilton, Ontario, Canada

  • Aaron Jones,

    Roles Investigation, Methodology, Writing – review & editing

    Affiliations Department of Health Research Methods, Evidence and Impact, Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada, ICES, McMaster University, Hamilton, Ontario, Canada

  • Henry Yu-Hin Siu,

    Roles Investigation, Methodology, Writing – review & editing

    Affiliation Department of Family Medicine, Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada

  • Meredith Vanstone,

    Roles Investigation, Methodology, Supervision, Writing – review & editing

    Affiliation Department of Family Medicine, Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada

  • Steve Slade,

    Roles Writing – review & editing

    Affiliation College of Family Physicians of Canada, Mississauga, Ontario, Canada

  • Andrew P. Costa

    Roles Conceptualization, Investigation, Methodology, Supervision, Validation, Writing – review & editing

    Affiliations Department of Health Research Methods, Evidence and Impact, Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada, Centre for Integrated Care, St. Joseph’s Health System, Hamilton, Ontario, Canada

Abstract

Background

Family physicians play a key role in the care of older adults, yet the impact of additional geriatric training or focused practice remains unclear.

Objective

We compared performance on established clinical practice measures among family physicians with/without evidence of elderly-focused practice or training.

Methods

We used linked administrative data to conduct a population-based, propensity score-matched cohort study. Participants included family physicians in Ontario, Canada with rostered patients in 2019. Using logistic regression, we established propensity scores to match physicians with a focused alternative funding plan and/or a Certificate of Added Competence in ‘Care of the Elderly’ at a 1:4 ratio to a control group without focused practices or added competence certificates. We compared 11 practice-based measures endorsed by Canadian clinicians and researchers, adjusting for physician factors, medical practice characteristics, and primary care activities.

Results

We identified 232 family physicians with elderly-focused practices or training and 928 comparable controls. While differences in study group clinical practices were not statistically significant for most processes, they were in three areas. More physicians with elderly-focused practice or training conducted testing aligned with the most recent Canadian Consensus on Dementia and were more likely to prescribe potentially inappropriate medications and antipsychotics to older attached patients.

Conclusions

We observed limited to no differences in clinical practice measures between family physicians with ‘Care of the Elderly’ focused practice or certification to those without. The lack of differences may reflect true performance, the effect of uniform constraints of primary care practice, or inherent limitations of objective performance measurement.

Introduction

Primary care of older adults is complex due to multimorbidity, chronicity, polypharmacy, and the need for care integration across settings and multiple providers. [13] In Canada, older adults constitute a large proportion of family physicians’ (FPs) overall medical practice and, compared to specialists, FPs provide the majority of older adult care. [46] Older adults’ use of primary care services is expected to increase given demographic shifts, [7] but FPs vary in their confidence and skillset to care for older patients. [810] Physicians report interpersonal challenges, administrative burdens, inadequate time and remuneration, and gaps in knowledge of community resources/services as barriers to caring for older adults [4,10,11].‌‌

Family medicine is faced with adapting to the changing needs of aging populations, but FPs often struggle to deliver comprehensive, continuous, and coordinated care to older patients. [12,13] While all FPs achieve foundational knowledge and clinical skills to care for older adults, [14] some pursue additional training to hone geriatric competencies [15,16] and/or dedicate a portion of their medical practice exclusively to older patients. [17] At this time, the impacts of elderly-focused practice and training are largely unknown, [18] although some descriptive work has characterized these providers. [1928] Recent advances have allowed FPs with focused practice or additional training to be identified within administrative data, enabling new analyses of their practice. [26] However, it is unclear whether these physicians with focused practice or additional training have different practice patterns that demonstrate an advanced level of care to older patients.

We previously established consensus on measurable practice-based activities that are relevant to caring for older adults. [29] Endorsed by a panel of Canadian clinicians and researchers, we developed technical specifications for the established performance measures by referencing a population-based, health administrative data source. In this study, we aimed to compare the clinical practice of FPs with/without focused practice or additional training to care for older adults on the consensus-based practice measures. We hypothesized that elderly-focused practice and enhanced geriatric training would contribute to variations in clinical activities.

Materials and Methods

Design/setting

We conducted a population-based, propensity score-matched cohort study to compare FP clinical practice in Ontario, Canada. Our reporting concords with REporting of studies Conducted using Observational Routinely collected health Data (S1 Appendix in S1 File) [30].

Data source

We accessed multiple datasets at ICES, an independent, non-profit research institute that collects and analyzes health care and demographic data about publicly-funded encounters (S2 Appendix in S1 File). [31] Datasets were linked using unique encoded identifiers and analyzed via the Remote Access Environment. We conducted a project-specific data linkage with the College of Family Physicians of Canada (CFPC) Membership Database to identify FPs with a ‘Care of the Elderly’ (COE) Certificate of Added Competence (CAC). The authors did not have access to information that could potentially identify individual participants.

Participants

We established a cohort of FPs who submitted at least one Ontario Health Insurance Plan (OHIP) fee claim in the calendar year, 2019. We excluded non-residents of Ontario and physicians whose main specialty did not indicate family medicine. FPs without rostered patients were subsequently excluded, as the performance measures pertain to the ongoing care of attached patients [32].

We identified FPs with a focused practice billing designation and/or additional training to care for older adults based on a classification developed previously by our team. [26] A focused practice designation was attributed to FPs who bill OHIP fee codes eligible to those enrolled in an alternative funding plan by the Ministry of Health. To apply for a focused practice billing designation, FPs demonstrate need within their community, relevant training/qualifications, and evidence of dedicating >20% of their practice time to caring for older patients. [33] Additional training was demonstrated by holding a COE CAC from the CFPC. [34] COE CAC holders have achieved a defined level of competence in caring for older adults across 18 Priority Topics. [15,35] There may be some overlap between CAC holders and focused practice FPs, but the groups are not identical [26].

Outcomes

The Donabedian model – the dominant health services paradigm to assess, evaluate, and improve quality – conceptualizes the interrelationships of structures and processes affecting outcomes. [36] Process measures include interactions between patients and health care providers for clinical practice activities or service provision. Per Donabedian’s model, we can identify and quantify FP practice activities that serve as process factors. [37] While these factors are relevant to quality measurement, they do not by themselves constitute complete measures of quality.

In this study, we trialed and refined the measurement of 11 practice-based processes endorsed using the RAND/UCLA Appropriateness Method (RAM). [29] These established measures characterize appropriate and important primary care activities for older across four COE Priority Topics. [35] In the RAM study, health services researchers (RHC, AJ, APC) drafted technical definitions corresponding to endorsed measures. Panelists reviewed the specifications in a synchronous group meeting and rated items in two questionnaires. The technical definitions examined in this work reflect panelists’ feedback and review by a physician (HS) for clinical accuracy.

Although 12 processes were endorsed in the RAM study, we assessed 11 outcomes here due to considerable overlap in the measurement and interpretation of two items. S3 Appendix in S1 File details the relevant dataset/variable names and steps in computation. For each process, the presence or absence of the practice activity was determined and summarized as a proportion at the physician-level. This approach resulted in each measure representing the average proportion of FPs who delivered/performed the practice-based activity to attached older patients. Missing data resulted in the exclusion of matched individuals (S4 Appendix in S1 File).

Analysis

We used propensity score matching to identify a comparable control group of FPs without evidence of a COE focused practice designation or CAC. These FPs may represent those with naturally aged practices [38] and/or physicians who acquired additional geriatric competencies through educational opportunities other than CAC training. [3942] Propensity scores estimate the probability of assignment to an exposure and are used to balance baseline characteristics between two otherwise non-comparable groups. [43] Matching on propensity scores enabled us to reduce the effects of confounding on estimates of the association between our exposure (i.e., having a focused practice or CAC) and practice measures.

We calculated propensity scores using logistic regression to model the probability of exposure while adjusting for physician factors (i.e., years in practice, community size of primary practice location), medical practice characteristics (i.e., practice type and patient enrolment model), and primary care activities (i.e., long-term care [LTC] practice and number of patients cared for aged ≥65). These matching variables were selected based on their relevance to family medicine practice organization, care for older adults, and significant differences at baseline. FPs with evidence of elderly-focused practice or additional training were matched at a 1:4 ratio to controls without replacement using a caliper of 0.2 times the standard deviation of the logit of the propensity score [4446].

We reported provider and practice characteristics using measures of general frequency, central tendency, dispersion, and standardized differences. [47] We reported mean differences to compare rates between groups. We then compared practice differences between FP groups by conducting t-tests with the conventional alpha = 0.05 threshold for significance. In a sensitivity analysis, we compared practice differences between FPs with evidence of elderly-focused practice versus additional training. All analyses were performed using Statistical Analysis Software, version 9.4. Data were accessed between February 22, 2024 and March 15, 2024 for research purposes.

Ethics

This study was approved by the Hamilton Integrated Research Ethics Board (11391). The use of ICES data is authorized under Section 45 of Ontario’s Personal Health Information Protection Act, which allows for the collection and analysis of health care and demographic data, without consent, for health system evaluation and improvement.

Results

12,701 FPs met our selection criteria and 232 (1.83%) had evidence of an elderly-focused practice or CAC (Fig 1). Of the 232 FPs, 94 (40.52%) had COE CACs without a focused practice, 98 (42.24%) had evidence of a focused practice but no COE CAC, and 40 (17.24%) had both a COE CAC and focused practice. Propensity score-matching resulted in 232 FPs with an elderly-focused practice or CAC and 928 controls (n = 1,160).

thumbnail
Fig 1. Flow diagram of participant selection and matching.

OHIP = Ontario Health Insurance Plan; FP = family physician; COE = Care of the Elderly.

https://doi.org/10.1371/journal.pone.0347828.g001

Before matching, the groups were imbalanced on numerous covariates. After matching, the standardized differences for all descriptive factors were ≤0.1, suggesting comparability between groups (Table 1). FPs with COE focused practice designations or training tended to practice comprehensively (n = 146; 62.93%) with 382.57 (SD = 249.57) unique encounters, on average, with patients aged ≥65. Ninety-one exposed FPs (39.22%) were most responsible physicians in LTC.

thumbnail
Table 1. Participant characteristics after matching (n = 1,160).

https://doi.org/10.1371/journal.pone.0347828.t001

We observed significant differences on three practice-based measures on the basis of elderly-focused practices and CACs (Table 2). On average, FPs with elderly-focused practices and CACs performed more testing for older patients aligned with the most current Canadian Consensus on Dementia (mean difference: 1.82%; CI = 0.44–3.20) compared to controls (Indicator 3). In contrast to other FPs, more COE physicians with focused practices and CACs prescribed one or more potentially inappropriate prescriptions (PIPs) to a greater proportion of attached older patients (mean difference: 8.35%; CI = 4.94–11.76) (Indicator 7). Further, for attached older patients living with dementia, FPs with elderly-focused practices or training prescribed more antipsychotics (mean difference: 5.00%; CI = 1.73–8.28) versus controls (Indicator 10). We observed no significant differences for the remaining processes (n = 8).

thumbnail
Table 2. Clinical activities of family physicians with/without elderly-focused practices or certification.

https://doi.org/10.1371/journal.pone.0347828.t002

In contrast to the main findings, we identified significant differences between the elderly-focused FP sub-groups on the basis of managing medical conditions (Indicators 1–4) and reporting potential driving issues (Indicator 11) (S5 Appendix in S1 File).

Discussion

We observed similarities on eight of eleven clinical practice measures between FPs with focused practice or certification in COE to those without additional training or focused practice. The lack of differences for most performance measures may suggest that FPs who pursue focused practices or CACs in COE function like other FPs whose medical practice comprises a comparable number of older adults and levels of LTC activity. Similarities in clinical practice between the groups may reflect that additional performance is difficult to accomplish in the constraints of practice that limit comprehensive care and follow-up. Another possibility is that FPs without focused practices or CACs who are in practice longer may attain elderly-related competencies over time, resulting in comparable skillsets. Clinical activities that did not demonstrate differences, such as immunization schedules or medication reviews, may reflect similar levels of expertise developed in foundational family medicine training to manage risks. Both FPs with focused practice or enhanced training and matched controls demonstrated some increased interest or commitment to care for older adults – signifying the important roles of all FPs in caring for older adults.

Slightly higher rates of consensus-based dementia testing and prescribing potentially inappropriate and antipsychotic medications were observed among FPs with elderly-focused practices or enhanced training. These processes – safe prescribing and adhering to guidelines – are emphasized in enhanced skills training and may reflect the expertise of FPs who self-designate a medical practice focused on aged patients. Seven Key Features for COE CAC assessment relate to appropriate prescribing, [35] suggesting greater knowledge/awareness of PIP risks. Our observed practice differences may be explained by FPs with elderly-focused practices or CACs having greater comfort with the use of PIPs and antipsychotics, which may be warranted or beneficial in some circumstances. [48] Further, these physicians are more likely to care for patients with greater medical complexity (i.e., frailty, cognitive impairment, multimorbidity) and possess additional expertise to manage and understand the nuances of appropriately prescribing PIP to older patients. [49,50] Our study data could not control for patient-level factors (e.g., sex, multimorbidity) that have been shown to increase PIP use. [5154] Therefore, it is not possible to comment on the appropriateness of using these medications or to make inferences about their impacts on patient outcomes. If focused practice or CAC training enables FPs to better discern when to prescribe or not, then there is increased potential for improved patient outcomes.

We also observed greater adherence to testing aligned with the Canadian Consensus on Dementia among FPs with elderly-focused practices or CACs. For those FPs who earned CACs, this may point to a general strength of enhanced skills training in terms of increased awareness and alignment of practice with current evidence-based guidelines. While dementia care knowledge is required for family medicine certification, [14] COE CAC holders are expected to exhibit additional competence related to the nuances of assessing, diagnosing, and managing cognitive impairment. [35] Their enhanced training and greater exposure/experience caring for older patients with memory concerns in a focused setting may explain the observed difference. FPs with a focused practice or CAC in COE may feel more able and, therefore, continue to care for patients as the effects of aging become more complex and require specialized knowledge. Future work can examine the impacts of elderly-focused practice and CACs on specialist referral patterns for patients with varying indications of cognitive impairment.

FPs with focused practices and CACs in COE are well-positioned to care for the rapidly aging and increasingly complex population of older adults who rely on community-based primary care. [4,55] Despite this growing and urgent need, COE CAC holders acknowledge limited incentives to establish focused practices, [18,19,56] which may be a factor limiting the potential impact of their added training. CAC holders are not expected to restrict or narrow their scope of practice to their domain of expertise; instead, enhanced skills training is considered an opportunity for FPs to extend their comprehensive skills while maintaining competence across the broad family medicine scope. [34] Prior estimates indicate that less than one-third of COE CACs directly support specialized services for older adults, such as memory clinics, rehabilitation units, retirement homes, and LTC. [21,26,27,57] While some FPs greatly contribute to specialized geriatric services, others maintain family practice models caring for patients of all ages. [26] Those who continue to care for patients across all life stages may see the diminishing influence of their specialized training for geriatric care, resulting in similar performance over time due to reduced exposure to higher-level geriatric presentations.

Beyond CAC training and focused practice, other practice considerations related to how FPs organize or are supported in their practice could be shaping care delivery and, in turn, performance on the assessed indicators. For example, preventative care incentives or team-based care models may result in similarities from targeted incentives and shared clinical responsibilities, irrespective of additional training or focused practice. Resumption of practice as a generalist after earning a CAC, with marginal remuneration incentives encouraging increased care of older patients or opportunities to apply domain-specific skills, may explain similarities in practice performance observed here. Our findings suggest that health care system infrastructure and remuneration are key influencers of FPs’ future practice style, and could be barriers for FPs to make full use of their CAC and training. These insights point to the need to better align COE training with real-world practice environments, strengthen remuneration structures that support geriatric-focused care, and enhance the integration of geriatric expertise within primary care teams. Education programs alone cannot supersede structural barriers. Ensuring the sustainability and longevity of COE CACs and focused practice will require coordinated reforms in training, compensation, and primary care organization.

Limitations

While the performance measures were valid in construction, [29] our assessment and interpretation of clinical practice was limited by available information within the data source. Given measurement challenges, the absolute indicator rates are knowingly imperfect, though the relative comparisons are robust. The performance metrics relied largely on physician remuneration data and Ontario Drug Benefit claims, which may not have been sensitive to distinguish practice differences. For measures with low rates in both groups, it is unknown whether these processes are not frequently occurring or if they reflect poor measurement.

In addition, we could not adjust for unmeasured confounders that may have affected practice differences (e.g., clinical indication) or disparities in access. Although the process indicators used in this study reflect meaningful aspects of FP practice in caring for older adults, they do not fully capture the downstream impacts of care, such as health service utilization or changes in patient function. As a result, our findings cannot directly link observed changes in practice activities to patient outcomes, highlighting the need for future research that examines whether differences in FP processes relate to measurable improvements in clinical outcomes for older adults. Lastly, FPs had an average practice duration of 19 years; the training and expectations of CAC graduates today differ from those two decades ago. Assessing practice activities that are more closely tied to COE expected competencies may elucidate performance differences.

Conclusions

We observed limited to no differences in clinical practice measures between FPs with focused practice and certification in COE compared to FPs without additional training or focused practice. The lack of differences may reflect true performance, the effects of uniform constraints of primary care practice, or inherent limitations of objective performance measurement. Future work can examine the impacts of practice differences on variations in quality of care as measured by patient outcomes.

Supporting information

S1 File. Supporting Information File.

Contains the completed RECORD checklist (S1 Appendix), description of relevant datasets (S2 Appendix), technical definitions of process measures (S3 Appendix), summary of missing data (S4 Appendix), and sensitivity analysis (S5 Appendix).

https://doi.org/10.1371/journal.pone.0347828.s001

(DOCX)

Acknowledgments

This study was supported by ICES, which is funded by an annual grant from the Ontario Ministry of Health (MOH) and the Ministry of Long-Term Care (MLTC). This document used data adapted from the Statistics Canada Postal CodeOM Conversion File, which is based on data licensed from Canada Post Corporation, and/or data adapted from the Ontario Ministry of Health Postal Code Conversion File, which contains data copied under license from ©Canada Post Corporation and Statistics Canada. The opinions, results and conclusions reported in this paper are those of the authors and are independent from the funding sources. No endorsement by ICES, the MOH or MLTC is intended or should be inferred. Parts of this material are based on data and/or information compiled and provided by CIHI, Ontario Health (OH) and the Ontario Ministry of Health. The analyses, conclusions, opinions and statements expressed herein are solely those of the authors and do not reflect those of the funding or data sources; no endorsement is intended or should be inferred. Lastly, we acknowledge the College of Family Physicians of Canada for facilitating a data linkage that enabled our study and thank IQVIA Solutions Canada Inc. for use of their Drug Information File.

The dataset from this study is held securely in coded form at ICES. While legal data sharing agreements between ICES and data providers (e.g., healthcare organizations and government) prohibit ICES from making the dataset publicly available, access may be granted to those who meet pre-specified criteria for confidential access, available at www.ices.on.ca/DAS (email: das@ices.on.ca). The full dataset creation plan and underlying analytic code are available from the authors upon request, understanding that the computer programs may rely upon coding templates or macros that are unique to ICES and are therefore either inaccessible or may require modification.

References

  1. 1. Public Health Agency of Canada. Aging and Chronic Diseases: A Profile of Canadian Seniors [Internet]. Ottawa: Public Health Agency of Canada; 2020. https://www.canada.ca/en/public-health/services/publications/diseases-conditions/aging-chronic-diseases-profile-canadian-seniors-executive-summary.html
  2. 2. Valaitis R, Cleghorn L, Ploeg J, Risdon C, Mangin D, Dolovich L, et al. Disconnected relationships between primary care and community-based health and social services and system navigation for older adults: A qualitative descriptive study. BMC Fam Pract. 2020;21(1):69. pmid:32326880
  3. 3. Demurtas J, Veronese N. The Role of Family Physicians in Older People Care. Cham: Springer International Publishing. 2022.
  4. 4. Lam RE, Gallinaro A, Adleman J. Medical problems referred to a care of the elderly physician: Insight for future geriatrics CME. Can Geriatr J. 2013 [cited 2020 Aug 25];16(3):114–9. http://www.cgjonline.ca/index.php/cgj/article/view/58
  5. 5. Slade S, Shrichand A, Dimillo S. Health care for an aging population: A study of how physicians care for seniors in Canada. Ottawa, ON: Royal College of Physicians and Surgeons of Canada. 2019.
  6. 6. Vegda K, Nie JX, Wang L, Tracy CS, Moineddin R, Upshur REG. Trends in health services utilization, medication use, and health conditions among older adults: A 2-year retrospective chart review in a primary care practice. BMC Health Serv Res. 2009;9:217. pmid:19948033
  7. 7. Government of Canada S. A portrait of Canada’s growing population aged 85 and older from the 2021 Census. 2022. https://www12.statcan.gc.ca/census-recensement/2021/as-sa/98-200-X/2021004/98-200-X2021004-eng.cfm
  8. 8. Robinson BE, Barry PP, Renick N, Bergen MR, Stratos GA. Physician confidence and interest in learning more about common geriatric topics: a needs assessment. J Am Geriatr Soc. 2001;49(7):963–7.
  9. 9. Herzog A, Gaertner B, Scheidt-Nave C, Holzhausen M. “We can do only what we have the means for” general practitioners’ views of primary care for older people with complex health problems. BMC Fam Pract. 2015;16:35. pmid:25886960
  10. 10. Adams WL, McIlvain HE, Lacy NL, Magsi H, Crabtree BF, Yenny SK. Primary care for elderly people: why do doctors find it so hard?. The Gerontologist. 2002;42(6):835–42.
  11. 11. Drickamer MA, Levy B, Irwin KS, Rohrbaugh RM. Perceived needs for geriatric education by medical students, internal medicine residents and faculty. J Gen Intern Med. 2006;21(12):1230–4. pmid:17105521
  12. 12. Elliott J, Stolee P, Boscart V, Giangregorio L, Heckman G. Coordinating care for older adults in primary care settings: Understanding the current context. BMC Fam Pract. 2018;19(1):137. pmid:30086707
  13. 13. Gill A, Kuluski K, Jaakkimainen L, Naganathan G, Upshur R, Wodchis WP. Where do we go from here? Health system frustrations expressed by patients with multimorbidity, their caregivers and family physicians. Healthc Policy. 2014;9(4):73–89.
  14. 14. Defining competence for the purposes of certification by the College of Family Physicians of Canada. 2020.
  15. 15. Correia RH, Jabbar A, Siu HY-H, Hogeveen S, Dash D, Mowbray FI, et al. Comparing the scopes of practice of geriatric-focused physicians in Canada: A qualitative study of core competencies. CMAJ Open. 2022;10(2):E563–9. pmid:35728839
  16. 16. Charles L, Triscott JAC, Dobbs BM, McKay R. Geriatric core competencies for family medicine curriculum and enhanced skills: Care of elderly. Can Geriatr J. 2014;17(2):53–62.
  17. 17. Government of Ontario M of H and LTC. Primary Care Payment Models in Ontario - Health Care Professionals - MOHLTC. Government of Ontario, Ministry of Health and Long-Term Care. https://www.health.gov.on.ca/en/pro/programs/pcpm/. Accessed 2022 November 15.
  18. 18. Correia RH, Grierson L, Allice I, Siu HY-H, Baker A, Panday J, et al. The impact of care of the elderly certificates of added competence on family physician practice: Results from a pan-Canadian multiple case study. BMC Geriatr. 2022;22(1):840. pmid:36344937
  19. 19. Elma A, Vanstone M, Allice I, Barber C, Howard M, Mountjoy M. The Certificate of Added Competence credentialling program in family medicine: A descriptive survey of the family physician perspective of enhanced skill practices in Canada. Can Med Educ J. 2023.
  20. 20. Correia RH, Dash D, Hogeveen S, Woo T, Kay K, Costa AP, et al. Applicant and Match Trends to Geriatric-Focused Postgraduate Medical Training in Canada: A Descriptive Analysis. Can J Aging Rev Can Vieil. 2023 [cited 2023 May 3];1–8. https://www.cambridge.org/core/product/identifier/S071498082200054X/type/journal_article
  21. 21. Basu M, Cooper T, Kay K, Hogan DB, Morais JA, Molnar F, et al. Updated inventory and projected requirements for specialist physicians in geriatrics. Can Geriatr J. 2021;24(3):200–8.
  22. 22. Marbeen M, Freeman TR, Terry AL. Focused practice in family medicine: Quantitative study. Can Fam Physician. 2022;68(12):905–14.
  23. 23. Grierson L, Allice I, Baker A, Farag A, Guscott J, Howard M, et al. Impacts of the Certificates of Added Competence credentialling program: A qualitative case study of enhanced-skill family medicine practice across Canada. Can Med Assoc Open Access J. 2021;9(4):E966-72.
  24. 24. Green M, Birtwhistle R, MacDonald K, Kane J, Schmelzle J. Practice patterns of graduates of 2- and 3-year family medicine programs: In Ontario, 1996 to 2004. Can Fam Physician. 2009;55(9):906-907.e12.
  25. 25. Collier R. A comprehensive view of focused practices. CMAJ. 2011;183(18):E1289-90.
  26. 26. Correia RH, Frank C, Kirkwood D, Siu HYH, Jones A, Vanstone M. Characteristics of family physicians with additional training or focused practices in caring for older adults: Population-based retrospective cohort study. Can Fam Physician. 2024;70(9):559–69.
  27. 27. Dash D, Kirkwood D, Siu HYH, Boyd H, Correia RH. Describing nursing home physicians with competence or focused practice in caring for older adults. J Am Med Dir Assoc. 2024;25(9).
  28. 28. Chaytors RG, Spooner GR, Moores DG, Woodhead-Lyons SC. Postgraduate training positions. Follow-up survey of third-year residents in family medicine. Can Fam Physician. 1999;45:88–91.
  29. 29. Correia RH, Dash D, Jones A, Vanstone M, Aryal K, Siu HY-H, et al. Primary care quality for older adults: Practice-based quality measures derived from a RAND/UCLA appropriateness method study. PLoS One. 2024;19(1):e0297505. pmid:38241388
  30. 30. Benchimol EI, Smeeth L, Guttmann A, Harron K, Moher D, Petersen I, et al. The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) Statement. PLOS Medicine. 2015;12(10):e1001885.
  31. 31. About Us. ICES. https://www.ices.on.ca/our-organization/. Accessed 2023 June 20.
  32. 32. McLeod L, Buckley G, Sweetman A. Ontario primary care models: A descriptive study. Can Med Assoc Open Access J. 2016;4(4):E679-88.
  33. 33. OMA. GP Focused Practice Designation: Policy and Program Overview [Internet]. 2018. https://docplayer.net/93133960-Gp-focused-practice-designation-policy-and-program-overview.html
  34. 34. The College of Family Physicians of Canada. Residency Training Profile for Family Medicine and Enhanced Skills Programs Leading to Certificates of Added Competence. 2021. https://www.cfpc.ca/CFPC/media/Resources/Education/Residency-Training-Profile-ENG.pdf
  35. 35. Arcand M, Charles L, Feldman S, Frank C, Lam R, Mehta P. Priority Topics and Key Features for the Assessment of Competence in Care of the Elderly. The College of Family Physicians of Canada. 2017. https://www.cfpc.ca/CFPC/media/Resources/Education/COE_KF_Final_ENG.pdf
  36. 36. Donabedian A. Evaluating the quality of medical care. Milbank Q. 2005;83(4):691–729.
  37. 37. Stange KC, Etz RS, Gullett H, Sweeney SA, Miller WL, Jaén CR, et al. Metrics for assessing improvements in primary health care. Annu Rev Public Health. 2014;35:423–42. pmid:24641561
  38. 38. Premji K, Green ME, Glazier RH, Khan S, Schultz SE, Mathews M, et al. Characteristics of patients attached to near-retirement family physicians: A population-based serial cross-sectional study in Ontario, Canada. BMJ Open. 2023;13(12):e074120.
  39. 39. 14th Annual Care of the Elderly. Continuing Professional Development Office. [cited 2023 Oct 21]. https://cpd.healthsci.mcmaster.ca/events/14th-annual-care-of-the-elderly/
  40. 40. 2023 Toronto geriatrics update course. Sinai Health. https://sinaigeriatrics.ca/events-and-education/geriatrics-update-course/. 2023. Accessed 2023 October 21.
  41. 41. MINT Memory Clinics - Collaborative Primary Care - Mint [Internet]. MINT Memory Clinic. [cited 2023 Oct 23]. https://mintmemory.ca/
  42. 42. Geriatric Certificate Program. https://www.geriatriccp.ca/courses/10. Accessed 2023 October 21.
  43. 43. Austin PC. An introduction to propensity score methods for reducing the effects of confounding in observational studies. Multivariate Behav Res. 2011;46(3):399–424. pmid:21818162
  44. 44. Austin PC. Optimal caliper widths for propensity-score matching when estimating differences in means and differences in proportions in observational studies. Pharm Stat. 2011;10(2):150–61. pmid:20925139
  45. 45. Austin PC. A comparison of 12 algorithms for matching on the propensity score. Stat Med. 2014;33(6):1057–69.
  46. 46. Austin PC. Statistical criteria for selecting the optimal number of untreated subjects matched to each treated subject when using many-to-one matching on the propensity score. Am J Epidemiol. 2010;172(9):1092–7. pmid:20802241
  47. 47. Austin PC. Balance diagnostics for comparing the distribution of baseline covariates between treatment groups in propensity-score matched samples. Stat Med. 2009;28(25):3083–107. pmid:19757444
  48. 48. Bala SS, Chen TF, Nishtala PS. Reducing potentially inappropriate medications in older adults: A way forward. Can J Aging Rev Can Vieil. 2019;38(4):419–33.
  49. 49. Roux B, Sirois C, Simard M, Gagnon M-E, Laroche M-L. Potentially inappropriate medications in older adults: A population-based cohort study. Fam Pract. 2020;37(2):173–9. pmid:31602472
  50. 50. Voigt K, Gottschall M, Köberlein-Neu J, Schübel J, Quint N, Bergmann A. Why do family doctors prescribe potentially inappropriate medication to elderly patients?. BMC Fam Pract. 2016;17:93.
  51. 51. Jungo KT, Streit S, Lauffenburger JC. Patient factors associated with new prescribing of potentially inappropriate medications in multimorbid US older adults using multiple medications. BMC Geriatr. 2021;21(1):163. pmid:33676398
  52. 52. Fialová D, Topinková E, Gambassi G, Finne-Soveri H, Jónsson PV, Carpenter I, et al. Potentially inappropriate medication use among elderly home care patients in Europe. JAMA. 2005;293(11):1348–58. pmid:15769968
  53. 53. Oliveira MG, Amorim WW, de Jesus SR, Rodrigues VA, Passos LC. Factors associated with potentially inappropriate medication use by the elderly in the Brazilian primary care setting. Int J Clin Pharm. 2012;34(4):626–32.
  54. 54. Alhawassi TM, Alatawi W, Alwhaibi M. Prevalence of potentially inappropriate medications use among older adults and risk factors using the 2015 American Geriatrics Society Beers criteria. BMC Geriatr. 2019;19(1):154. pmid:31142286
  55. 55. Boult C, Counsell SR, Leipzig RM, Berenson RA. The urgency of preparing primary care physicians to care for older people with chronic illnesses. Health Aff (Millwood). 2010;29(5):811–8. pmid:20439866
  56. 56. Mah JC, Kanagalingam T, Best S, Elhayek S, Thain J, Morais JA. Determinants of first practice location among Canadian geriatric medicine trainees and recent graduates: Findings of a cross-sectional survey in 2023. Can Geriatr J. 2024;27(4):485–99.
  57. 57. Borrie M, Cooper T, Basu M, Kay K, Prorok JC, Seitz D. Ontario geriatric specialist physician resources 2018. Can Geriatr J. 2020;23(3):219–27. pmid:32904648