Browse Subject Areas

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

What Are Priorities for Deprescribing for Elderly Patients? Capturing the Voice of Practitioners: A Modified Delphi Process

  • Barbara Farrell ,

    Contributed equally to this work with: Barbara Farrell, Corey Tsang, Kevin Pottie

    Affiliations Bruyère Research Institute, Ottawa, Canada, Department of Family Medicine, University of Ottawa, Ottawa, Canada, School of Pharmacy, University of Waterloo, Waterloo, Canada

  • Corey Tsang ,

    Contributed equally to this work with: Barbara Farrell, Corey Tsang, Kevin Pottie

    Affiliations Bruyère Research Institute, Ottawa, Canada, School of Pharmacy, University of Waterloo, Waterloo, Canada

  • Lalitha Raman-Wilms ,

    ‡ These authors also contributed equally to this work.

    Affiliation Leslie Dan Faculty of Pharmacy, University of Toronto, Toronto, Canada

  • Hannah Irving ,

    ‡ These authors also contributed equally to this work.

    Affiliation Bruyère Research Institute, Ottawa, Canada

  • James Conklin ,

    ‡ These authors also contributed equally to this work.

    Affiliations Bruyère Research Institute, Ottawa, Canada, Department of Applied Human Sciences, Concordia University, Montreal, Canada

  • Kevin Pottie

    Contributed equally to this work with: Barbara Farrell, Corey Tsang, Kevin Pottie

    Affiliations Bruyère Research Institute, Ottawa, Canada, Department of Family Medicine, University of Ottawa, Ottawa, Canada

What Are Priorities for Deprescribing for Elderly Patients? Capturing the Voice of Practitioners: A Modified Delphi Process

  • Barbara Farrell, 
  • Corey Tsang, 
  • Lalitha Raman-Wilms, 
  • Hannah Irving, 
  • James Conklin, 
  • Kevin Pottie


Polypharmacy and inappropriate medication use among older adults contribute to adverse drug reactions, falls, cognitive impairment, noncompliance, hospitalization and mortality. While deprescribing - tapering, reducing or stopping a medication - is feasible and relatively safe, clinicians find it difficult to carry out. Deprescribing guidelines would facilitate this process. The aim of this paper is to identify and prioritize medication classes where evidence-based deprescribing guidelines would be of benefit to clinicians. A modified Delphi approach included a literature review to identify potentially inappropriate medications for the elderly, an expert panel to develop survey content and three survey rounds to seek consensus on priorities. Panel participants included three pharmacists, two family physicians and one social scientist. Sixty-five Canadian geriatrics experts (36 pharmacists, 19 physicians and 10 nurse practitioners) participated in the survey. Twenty-nine drugs/drug classes were included in the first survey with 14 reaching the required (≥ 70%) level of consensus, and 2 new drug classes added from qualitative comments. Fifty-three participants completed round two, and 47 participants completed round three. The final five priorities were benzodiazepines, atypical antipsychotics, statins, tricyclic antidepressants, and proton pump inhibitors; nine other drug classes were also identified as being in need of evidence-based deprescribing guidelines. The Delphi consensus process identified five priority drug classes for which expert clinicians felt guidance is needed for deprescribing. The classes of drugs that emerged strongly from the rankings dealt with mental health, cardiovascular, gastroenterological, and neurological conditions. The results suggest that deprescribing and overtreatment occurs through the full spectrum of primary care, and that evidence-based deprescribing guidelines are a priority in the care of the elderly.


Overdiagnosis and overtreatment are potentially harmful and expensive [13]. In 2012, BMJ launched a series of articles exploring the potential for overdiagnosis in specific conditions. The call for new research in this field led to the inaugural Preventing Overdiagnosis conference in 2013 [4]. Linked to overdiagnosis is the challenge of overtreatment, and in particular polypharmacy in the elderly. This paper provides direction to those seeking to develop approaches to reducing overtreatment in the elderly.

Polypharmacy and inappropriate medication use among older adults are known to contribute to adverse drug reactions, falls, cognitive impairment, noncompliance, hospitalization and mortality [511]. While deprescribing—the act of tapering, reducing or stopping a medication—has been shown in small studies to be feasible and relatively safe [1214], clinicians continue to find it difficult to stop medications [15,16]. Barriers include difficulty making decisions to stop medications (both from the clinician and patient perspective), worry about stopping medications started by others, limited knowledge about how to stop medications, and concern about medication withdrawal effects [15]. In addition, clinicians feel pressured to prescribe according to clinical guidelines but recognize that such guidelines are rarely based on evidence from studies in older populations and rarely address modifying clinical targets with advancing age or care goals [15,17,18].

Innovative approaches are needed to address these barriers in order to limit the negative impact of polypharmacy on our older population. Such approaches should facilitate decision-making about stopping a medication and provide clear recommendations for tapering and monitoring impact to ensure safety and effectiveness of the process. To achieve this, the Ontario (Canada) Ministry of Health and Long-Term Care has supported the systematic development and testing of a series of evidence-based guidelines for deprescribing.

Given the large number of drug classes felt to be potentially inappropriate or risky in the elderly [19,20], determining priorities for developing such guidelines is challenging. In keeping with initiating a successful guideline enterprise and seeking input from relevant professional groups, we elected to conduct a priority setting process to identify, balance and rank priorities by expert stakeholders [21,22]. The aim of this Delphi consensus process was to engage physicians, pharmacists and nurses in identifying and prioritizing medication classes where evidence-based deprescribing guidelines would be of benefit to clinicians.

Participants and Methods

Study design

A modified Delphi approach [23], beginning with a literature review to identify potentially inappropriate medications for the elderly and existing approaches to deprescribing, followed by expert panel discussion and three rounds of surveys, was used to generate and achieve consensus among experts regarding priorities for deprescribing guidelines for the elderly.

Ethics approval

Ethics approval was obtained from the following Research Ethics Boards: Bruyère Continuing Care and Ottawa Health Science Network (Ottawa, Ontario), Concordia University (Montreal, Quebec), University of Toronto (Toronto, Ontario) and University of Waterloo (Waterloo, Ontario). All participants provided informed consent with each survey iteration.

Delphi working group

Six members of the research team, which included two family physicians and three pharmacists, all with expertise in geriatrics, and a social scientist with expertise in evaluating change, met in person in July 2013. The group reviewed literature and reports outlining the prevalence and impact of polypharmacy and potentially inappropriate medication use (e.g. propensity for adverse events and related hospital admissions, and cost-related impacts) [5,2433], as well as current approaches to deprescribing [1214,31,3441]. They next developed a list of drugs and drug classes for experts to consider in recommending priorities for deprescribing guidelines (S1 File).

Delphi expert panel (survey participants)

Canadian clinical experts from medicine, pharmacy and nursing were purposely identified using the following inclusion criteria: a) geriatrics expertise and/or b) academic appointment in teaching and/or c) research in the area of geriatric pharmacotherapy. Research team members considered those who had a background and experience with polypharmacy management and deprescribing in the elderly, ensuring that participants were highly trained and knowledgeable about the target subject [42]. We used a pragmatic approach to select primary care experts who were in touch with their clinician communities and in tune with emerging changes in their professions for the Delphi consensus. We included professionals in our personal networks, those who had contacted us with interest in the project as well as faculty members listed in applicable departments at universities across Canada. E-mail invitations were sent to each expert to determine interest and to explain the time commitment involved in participating in the Delphi process.

Survey administration and analysis

Three rounds of surveys were administered via Fluid Surveys ( from November 2013 to February 2014. Each survey was live for two weeks; two reminders were sent. The definition of consensus was determined before the analysis of each round, by the investigator team, and in consultation with a statistician. Investigators were blinded to the results during analysis. Specific definitions of consensus are explained in each round described below.

Round one

Participants’ demographics such as health professional background, type of practice, age range and gender were collected. Participants were provided with a clinical scenario (S1 File) and the four criteria commonly used in guideline development (adapted from the GRADE guideline development approach) [43]: 1) benefits vs. harms of medication therapy; 2) certainty of estimate of effects; 3) patient preference and values; and 4) feasibility and cost. They were also asked to consider the need for guidance in relation to both stopping the medication and managing the impact of stopping the medication. They rated each drug/drug class on a 5-point Likert-type scale indicating the ‘usefulness’ of an evidence-based ‘deprescribing guideline’: “1—Definitely not useful”, “2—Likely not useful”, “3—Might be useful”, “4—Probably useful”, “5—Definitely useful”. Free-text boxes were included for each drug/drug class to capture optional comments; these were reviewed by the research team to determine whether such comments could assist in understanding similarities or differences in rating of the drugs/drug classes. Microsoft Excel was used to run descriptive statistical analysis, including mean and standard deviation. A priori, investigators determined that drugs or drug classes identified by ≥70% of participants as either probably or definitely useful would be retained for inclusion in round two [44]. Participants were also asked to provide the names of drugs or drug classes felt to be a priority but that were missing from the expert panel generated list. If more than 10% of respondents included a new drug or drug class, it was added to the list for round two. See S1 File for a copy of the round one survey.

Round two

Round two of the survey consisted of two sections. In the first section, participants were asked to use the same instructions as for round one to rate two new drug classes added as a result of the round one survey; investigators agreed these new drug classes would be included in round three if ≥70% of participants rated them as either probably or definitely useful. In the second section, participants received an individualized e-mail containing histograms for each drug/drug class showing overall round one results [44] and indicating their personal rating (Fig 1). For new drugs added from the results of round one, no histograms were available. Experts were asked to rank each drug/drug class in order (from 1—highest priority to 16—lowest priority) with respect to the need for a deprescribing guideline; this approach was chosen in order to induce participants to make choices about priorities [45]. A mean rank (and standard deviation) was calculated for each drug/drug class [45]. Kendall’s W coefficient of concordance was calculated for the overall group of respondents and within each health care professional group to assist in determining whether consensus (W = 0.7) had been reached and whether a third round was warranted [46,47]. For their top 5 choices, participants were required to complete a free-text section providing justification for ranking these drugs/drug classes as highest priority. This qualitative text was analyzed by a research team member using simple content analysis[48,49] to identify themes that arose as participants considered ranking priorities; Each research team member then read the qualitative comments and themes independently and discussed them together with the initial coder at a team meeting, using group discussion to verify the themes and resolve disagreements. See S2 File for a copy of the round two survey.

Fig 1. Example histogram showing overall first round and personal results.

Round three

Round three of the survey included drug classes only. Two individual drugs were removed from the list in an effort to establish priorities for more widely applicable guidelines. All results from round two were presented to participants in the order of their mean rank. Participants were asked to consider the following criteria generated from respondent comments in round two: 1) uncertainty of benefit in the elderly; 2) high risk of harms in the elderly; 3) availability of suitable alternatives; 4) potentially high impact of a deprescribing guideline for the elderly; and 5) feasibility for guideline development (i.e. an adequate amount of literature to create an evidence-based guideline). Using these criteria, they were asked to identify only the top five drug classes that they felt had an urgent and clear need for a deprescribing guideline. Similar to round two, mean rank with standard deviation was calculated. In addition, the number of respondents who chose each drug class as one of their top five choices was calculated [50]. Investigators planned to consider both results: mean rank and number of respondents choosing each drug class, in determining consensus about priority drug classes. No free-text option was provided and no qualitative data was gathered during this round. See S3 File for a copy of the round three survey.


The expert panel identified 29 drug/drug classes for inclusion in the first survey. Sixty-five experts agreed to participate in the Delphi process, including 8 geriatricians, 11 family physicians, 36 pharmacists and 10 nurse practitioners representing eight of the 10 Canadian provinces. (see Table 1 for survey participant characteristics and Fig 2 for participant flow through the Delphi process)

Fig 2. Participant flow diagram through three rounds of the Delphi consensus process.

Round one

Sixty-four participants correctly completed the first survey; one participant’s responses were removed from the analysis after they contacted us to indicate they had applied the rating scale in the opposite order for some responses. Fourteen of the 29 drug/drug classes reached ≥ 70% level of consensus as being probably or definitely useful and are listed in Table 2 in order of the level of consensus achieved (in ties, the drug or drug class with the higher mean rating is ranked higher). Two new drug classes (anticonvulsants and bisphosphonates) were identified as priorities by >10% of participants in round one. The top five rated drugs/drug classes included benzodiazepines followed by atypical antipsychotics, proton pump inhibitors, typical antipsychotics and zopiclone.

Table 2. Round One Ranking: Drug/drug classes identified by ≥ 70% of participants as probably or definitely useful.

Respondents’ optional comments indicated strong support for a number of classes as priorities for deprescribing guidelines, as well as divergence of opinion for a number of classes. Strong support is exemplified through comments made in support of rating proton pump inhibitors as higher priority: “SOOOOO [sic] over used. When and how to stop would be useful for folks!” and “Please please please provide help on why we don’t need to use these. MDs are reluctant to taper or DC [discontinue] as there is history of PUD [peptic ulcer disease] 20 years ago…” Divergence in opinion is exemplified with this comment from one who rated selective serotonin reuptake inhibitors as low priority: “these drugs are underused, and in general, it is likely that patients need ongoing therapy as first episode of depression in older age is less common than adult onset depression”, and this comment from a second respondent who rated the class as high priority indicating they are “always questioning value of antidepressants in patients over 85 years of age.” Similarly, with regard to prioritizing cholinesterase inhibitors for a guideline, one respondent stated “Please! With patient/family handouts too. Unfortunately, [journal name] etc. have been publishing papers that support using these, but previous cost analyses showed otherwise,” whereas another respondent stated “These drugs are underused and though there is uncertainty regarding when to stop, they are lower priority compared to others.”

From the general comments section, these quotes struck the research team as important to consider: “Deprescribing should like be a component of all treatment guidelines. To date it has not been given the attention it deserves. I feel focusing in on a few drugs, developing the methods for deprescribing guidelines and getting a few guidelines into play is what is needed to catalyze a larger deprescribing movement.” and “I really think all prevention-oriented meds deserve a deprescribing guide.”

Round two

The 14 drugs/drug classes and two new drug classes from round one were ranked in round two. Fifty-three of the 65 (82%) round one participants (including the respondent who incorrectly completed round 1 but completed rounds 2 and 3 correctly) completed round two. Twelve participants did not complete the round two ranking within the two week allotted timeframe; of these, we received 2 automatic replies indicating the recipient was away on vacation (over the annual December holiday season). The 16 drugs/drug classes are shown in order of their mean rank in Table 3. This table also includes the subgroup findings within each profession, as well as Kendall’s W coefficient of concordance for each group. Kendall’s W values were low across all respondents, as well as within each health care professional group, demonstrating low agreement among participants on the rank order of drugs/drug classes in round two, and the need for a third survey round.

Content analysis of qualitative comments suggested that respondents used five main criteria in making their selections for determining guideline priorities: a) risk of continuing the drug; 2) questions about ongoing indication or benefit of the drug; 3) prevalence of overuse of the drug; 4) challenge in stopping the drug; and 5) the availability of other treatment options. See Table 4 for examples of comments illustrating each criterion.

Table 4. Themes identified from content analysis of Round Two comments.

In round two, benzodiazepines remained the top priority and atypical antipsychotics remained the second-highest priority for most participants, followed by tricyclic antidepressants, typical antipsychotics and statins. The qualitative comments suggest that those who ranked benzodiazepines highly did so because it is included in Beers Criteria [51], a consensus-developed list of potentially inappropriate medications in the elderly, and because, as one expert stated, it is “likely to have withdrawal” effects. Some experts also considered this group of drugs to be “most difficult to convince patients or physicians when they feel it is not causing a problem or if other alternatives not as effective”. Similarly, comments related to tricyclic antidepressants and other drug/drug classes rated as high priorities seemed to focus on the potential for adverse events and on being on the Beers Criteria list.

No participant rated bisphosphonates, zopiclone or trazodone as the highest priority (i.e. a score of one). Zopiclone and trazodone were the two drugs that were excluded at the end of round two.

Round Three

Of the round three surveys sent to the 53 round two responders, 47 were completed. Therefore, 47 of the 65 (72%) round one participants (including the respondent who incorrectly completed round 1 but completed rounds 2 and 3 correctly) completed the survey in round three. We received one automatic reply indicating the recipient was away during the timeframe allotted to complete the round three survey. Table 5 shows the final rankings of all 14 drug classes included in round three in the order of number of respondents choosing that class for their top five priorities for deprescribing guidelines. In the event of a tie, the drug class with the lower mean rank is considered the higher priority. Benzodiazepines and atypical antipsychotics remained at the top of the priority list for most participants, followed by statins, tricyclic antidepressants and proton-pump inhibitors.

Table 5. Round Three Ranking: by number of participants who indicated drug class was a high priority for deprescribing guideline development.


Adults, especially elderly adults, often live with chronic diseases that are managed with multiple medications [5]. Health care providers work in a culture that facilitates diagnosing and prescribing, and that pays relatively little attention to deprescribing or reducing chronic medications. This can lead to overtreatment and drug-related illness [2]. Our Delphi consensus process mobilized experienced practitioners who care for the elderly, to identify drug classes in need of guidelines to assist with the deprescribing of medications that are no longer needed or may be causing problems. With these priorities in mind, we are able to move ahead in developing approaches to address overtreatment in the elderly and ultimately improve patient care.

A central goal of our guideline development project is to develop strategic evidence-based deprescribing guidelines to improve patient outcomes [43]. The drug/drug class selection focused on perceived need (considering a patient scenario), clinical gaps and usefulness for practitioners. We thus selected practitioners who work with older patients with chronic illness: primary care physicians, geriatricians, pharmacists, and nurse practitioners. Using practitioners to select drug/drug classes ensured that our process for selecting topics for guidelines was sensitive to the needs of the future guideline users, and that the drug/drug classes we selected represented important clinical deprescribing challenges. However, in working with the perceived needs of guideline users we risked a selection bias [52] (which could potentially lead to overemphasizing newer drugs such as atypical antipsychotics and underemphasizing older drug classes such as tricyclic antidepressants). Surveying and synthesizing rankings from practitioners across Canada could also result in a loss of precision in terms of potential local prescribing trends. Significantly more pharmacists than physicians and nurses participated in, and completed all survey waves. More than 50% of physicians and 40% of nurse practitioners dropped out, while more than 90% of pharmacists completed all surveys. The findings showed the participating pharmacists were most committed to the Delphi process and had a strong influence on the final ranking. It is unclear if the final priorities identified would have been different if more physicians or nurse practitioners had participated or completed all waves. The Delphi consensus process ultimately allowed the research team to narrow down drug/drug classes for guideline development that reflect the needs and priorities of practitioners working with older adults. The low agreement on the ranking of classes that was observed in round two may reflect the large number of drug classes that experts feel could benefit from the development of deprescribing guidelines and clinician bias towards those commonly seen in their own practices. Indeed, the qualitative comments provided insight into respondents thought processes in assigning particular ratings and demonstrate the significant variation in practitioners’ needs and wants for deprescribing guidelines. The classes of drugs that ultimately emerged as priorities from the final rankings dealt with mental health, cardiovascular, gastroenterological, and neurological conditions. Three of the five drug classes selected as highest priority dealt with mental health conditions. Benzodiazepines stood out in the consensus with the number one ranking in all three waves and atypical antipsychotics also retained a high rank across the three rounds. Both of these medication classes appear on the Beers Criteria, and Delphi participants commented on both the potential for adverse events and the withdrawal effects of deprescribing. Analysis of public drug program expenditures in Canada demonstrate that 21% of seniors had at least one claim for a benzodiazepine-type drug in 2009–2010 [53], despite recommendations to minimize their use due to risk of adverse effects [54] and the existence of effective approaches to reducing their use [55]. Given the prevalence of use, it’s not surprising that this group of medications consistently rank as the number one priority for deprescribing guidelines. While effective approaches to discontinuation exist, clinicians clearly still need assistance with negotiating changes with patients, finding non-pharmacologic approaches to manage symptoms and managing the process of tapering. While antipsychotic use is not as prevalent (5% of seniors in Canada having had a claim in 2009–2010) [53], concern over limited effectiveness for neuropsychiatric symptoms in dementia and potential adverse effects, including higher mortality with long-term use [56], is likely prompting clinicians desire for guidance in stopping these agents.

In our final wave, statins ranked 3rd and based on respondent comments, this may be related to concerns about benefit given the lack of elderly patients in trials, lack of clarity around ongoing indication and when they can be stopped, as well as an emerging recognition of side effects and overtreatment of low risk patients [57,58]. Tricyclic antidepressants ranked 4th and based on respondent comments, this may be related to both challenges in stopping them, for example, managing family physician reluctance to alter sleep or mood stability while trying to limit risk, for example, known side effects such as confusion and falls [59]. Finally, proton pump inhibitors, which ranked 5th, were seen by respondents as being overused and relatively easy to stop despite concerns over symptom recurrence [6062].

In addition to the top five drug classes outlined above, the Delphi process identified nine other drug classes in need of evidence-based guidelines (see Table 4). These include treatments for a range of mental health and chronic disease conditions, often highlighting drug classes where prolonged use has recently come into question (e.g. bisphosphonates, anticonvulsants etc) [63,64], drug classes where a specialist may have initiated therapy but a primary care practitioner needs to determine ongoing need (e.g. beta-blockers, antiplatelets, cholinesterase inhibitors), or symptomatic treatments where ongoing benefit versus harm of the medication remains in doubt (e.g. urinary anticholinergics, opioids, serotonin reuptake inhibitors, typical antipsychotics). This broad range of drug classes suggests that overtreatment occurs through the full spectrum of primary care. While we were able to rank drug classes in order, there was little agreement among respondents regarding priorities for evidence-based deprescribing guidelines. There could be many reasons for this including differences in local prescribing needs, patient or health system barriers or perhaps personal self-efficacy for deprescribing tasks for certain drug classes. All of these are worthy of further study. Continuing to develop evidence-based deprescribing guidelines remains a priority; however, given the wide range of drug classes identified as needing evidence-based guidelines, we recognize that it would be prudent for all chronic disease and mental illness disease guidelines to include deprescribing components.

We note that all participants from our Delphi process were Canadian clinicians, and that the resulting priorities reflect the conditions, drug benefit plans, experiences and judgments of prescribers operating within the multi-jurisdictional Canadian health system. Canada has a single payer universal access health system but it does not have a universal drug coverage plan. It is likely that deprescribing priorities are influenced by prescribing patterns, health conditions, and health system pressures that arise within specific contexts in different geographies and countries.


This Delphi consensus process helped to identify and prioritize the five medication classes that clinicians believed would most benefit from deprescribing guidelines. The classes of drugs that emerged strongly from the rankings dealt with mental health, cardiovascular, gastroenterological, and neurological conditions. The process also identified nine other drug classes in need of evidence-based guidelines, including treatments for a range of chronic disease conditions. The results suggest that deprescribing and overtreatment occur through the full spectrum of primary care, and that the development of evidence-based deprescribing guidelines, and the inclusion of deprescribing components in all chronic disease guidelines, are a priority in the care of the elderly.


We wish to acknowledge Dr. Kalpana Nair, Dr. Beverley Shea and Dr. Catherine Dalzell for their valuable time and contributions in the methodology of the Delphi consensus process.

Author Contributions

Conceived and designed the experiments: BF KP LRW CT HI. Performed the experiments: BF KP LRW CT HI. Analyzed the data: BF CT HI KP LRW JC. Wrote the paper: BF KP LRW CT HI JC.


  1. 1. Moynihan R, Doust J, Henry D. Preventing overdiagnosis: how to stop harming the healthy. BMJ. 2012;344: e3502. pmid:22645185
  2. 2. Heath I. Overdiagnosis: when good intentions meet vested interests—an essay by Iona Heath. BMJ. 2013;347: f6361. pmid:24162944
  3. 3. Welch GH, Schwartz LM, Woloshin S. Overdiagnosed: Making People Sick in the Pursuit of Health. Boston: Beacon Press; 2011
  4. 4. Godlee F. Preventing overdiagnosis. BMJ. 2012;344: e3783.
  5. 5. Hajjar ER, Cafiero AC, Hanlon JT. Polypharmacy in elderly patients. Am J Geriatr Pharmacother. 2007;5: 345–51. pmid:18179993
  6. 6. Ziere G, Dieleman JP, Hofman A, Pols HA, van der Cammen TJ, Stricker BH. Polypharmacy and falls in the middle age and elderly population. Br J Clin Pharmacol. 2006;61: 218–23. pmid:16433876
  7. 7. Huang AR, Mallet L, Rochefort CM, Eguale T, Buckeridge DL, Tamblyn R. Medication-related falls in the elderly: causative factors and preventive strategies. Drugs Aging. 2012;29: 359–376. pmid:22550966
  8. 8. Jyrkka J, Enlund H, Korhonen MJ, Sulkava R, Hartikainen S. Polypharmacy status as an indicator of mortality in an elderly population. Drugs Aging. 2009;26: 1039–48. pmid:19929031
  9. 9. Reason B, Terner M, McKeag MA, Tipper B, Webster G. The impact of polypharmacy on the health of Canadian seniors. Fam Pract. 2012;29: 427–32. pmid:22223743
  10. 10. Budnitz DS, Lovegrove MC, Shehab N, Richards CL. Emergency hospitalizations for adverse drug events in older Americans. N Engl J Med. 2011;365: 2002–12. pmid:22111719
  11. 11. Wu C, Bell CM, Wodchis WP. Incidence and economic burden of adverse drug reactions among elderly patients in Ontario emergency departments, a retrospective study. Drug Saf. 2012;35: 769–781. pmid:22823502
  12. 12. Iyer S, Naganathan V, McLachlan AJ, Le Couteur DG.Medication withdrawal trials in people aged 65 years and older: a systematic review. Drugs Aging. 2008;25: 1021–31. pmid:19021301
  13. 13. Gnjidic D, Le Couteur DG, Kouladjian L, Hilmer SR. Deprescribing trials: methods to reduce polypharmacy and the impact on prescribing and clinical outcomes. Clin Geriatr Med. 2012;28: 237–253. pmid:22500541
  14. 14. Garfinkel D, Zur-Gil S, Ben-Israel J.The war against polypharmacy: a new cost-effective geriatric-palliative approach for improving drug therapy in disabled elderly people. Isr Med Assoc J. 2007;9: 430–34. pmid:17642388
  15. 15. Anthierens S, Tansens A, Petrovic M, Christiaens T. Qualitative insights into general practitioners views on polypharmacy. BMC Fam Pract. 2010;11: 65[6 p.]. pmid:20840795
  16. 16. Reeve E, To J, Hendrix I, Shakib S, Roberts MS, Wiese MD. Patient barriers to and enablers of deprescribing: a systematic review. Drugs Aging. 2013;30: 793–807. pmid:23912674
  17. 17. Zulman DM, Sussman JB, Chen X, Cigolle CT, Blaum CS, Hayward RA. Examining the evidence: A systematic review of the inclusion and analysis of older adults in randomized controlled trials. J Gen Intern Med. 2011;26: 783–790. pmid:21286840
  18. 18. Wehling M. Guideline-driven polypharmacy in elderly, multimorbid patients is basically flawed: there are almost no guidelines for these patients. J Am Geriatr Soc. 2011;59: 376–77. pmid:21314663
  19. 19. The American Geriatrics Society 2012 Beers Criteria Update Expert Panel. American Geriatrics Society updated Beers Criteria for potentially inappropriate medication use in older adults. J Am Geriatr Soc. 2012;60: 616–31. pmid:22376048
  20. 20. O’Mahony D, Gallagher P, Ryan C, Byrne S, Hamilton H, Barry P, et al. STOPP and START criteria: a new approach to detecting potentially inappropriate prescribing in old age. Eur Geriatr Med. 2010;1: 45–51.
  21. 21. Schunemman HJ, Wiercioch W, Etxeandia I, Falavigna M, Santesso N, Mustafa R, et al. Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise. CMAJ. 2014;186: E123–E142. pmid:24344144
  22. 22. Brouwers M, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, Fervers B, Graham ID, Grimshaw J, Hanna S, Littlejohns P, Makarski J, Zitzelsberger L for the AGREE Next Steps Consortium. AGREE II: Advancing guideline development, reporting and evaluation in healthcare. Can Med Assoc J. 2010. Dec 2010; 182:E839–842.
  23. 23. Keeney S, Hasson F, Mckenna H. The Delphi Technique in Nursing and Health Research. West Sussex: John Wiley & Sons Ltd; 2010.
  24. 24. Hamilton H, Gallagher PF, O’Mahony D. Inappropriate prescribing and adverse drug events in older people. BMC Geriatr. 2009;9: 5. [4 p.] pmid:19175914
  25. 25. Lane CJ, Bronskill SE, Sykora K, Dhalla IA, Anderson GM, Mamdani MM, et al. Potentially inappropriate prescribing in Ontario community-dwelling older adults and nursing home residents. J Am Geriatr Soc. 2004;52: 861–6. pmid:15161447
  26. 26. Canadian Institute for Health Information. Drug Claims by Seniors: An Analysis Focusing on Potentially Inappropriate Medication Use, 2000 to 2006. Canadian Institute for Health Information. 2007. Available:
  27. 27. Bierman AS, Pugh MJ, Dhalla I, Amuan M, Fincke BG, Rosen A, et al. Sex differences in inappropriate prescribing among elderly veterans. Am J Geriatr Pharmacother. 2007;5: 147–61. pmid:17719517
  28. 28. Ontario Drug Benefit Program. 2010/11 Report Card for the Ontario Drug Benefit Program. Ministry of Health and Long-Term Care. 2012. Available:
  29. 29. Wu C, Bell CM, Wodchis WP. Incidence and economic burden of adverse drug reactions among elderly patients in Ontario emergency departments: a retrospective study. Drug Saf. 2012;35: 769–81. pmid:22823502
  30. 30. Canadian Institute for Health Information. Adverse Drug Reaction-Related Hospitalizations Among Seniors, 2006 to 2011. Canadian Institute for Health Information. 2013. Available at:
  31. 31. Bain KT, Holmes HM, Beers MH, Maio V, Handler SM, Pauker SG. Discontinuing medications: a novel approach for revising the prescribing stage of the medication-use process. J Am Geriatr Soc. 2008;56: 1946–52. pmid:18771457
  32. 32. Sergi G, De Rui MD, Sarti S, Manzato E. Polypharmacy in the elderly: can comprehensive geriatric assessment reduce inappropriate medication use? Drugs Aging. 2011;28: 509–18. pmid:21721596
  33. 33. Steinman MA, Hanlon JT. Managing medications in clinically complex elders: “There’s got to be a happy medium”. JAMA. 2010;304: 1592–601. pmid:20940385
  34. 34. Garfinkel D, Mangin D. Feasibility study of a systematic approach for discontinuation of multiple medications in older adults: addressing polypharmacy. Arch Intern Med. 2010;170: 1648–54. pmid:20937924
  35. 35. bpacnz. A practical guide to stopping medicines in older people. Best Practice Journal 2010;27: [4 p.].
  36. 36. Holmes HM, Hayley DC, Alexander GC, Sachs GA. Reconsidering medication appropriateness for patients late in life. Arch Intern Med. 2006;166: 605–9. pmid:16567597
  37. 37. Hardy JE and Hilmer SN. Deprescribing in the Last Year of Life. Journal of Pharmacy Practice and Research. 2011;41: 146–51.
  38. 38. Le Couteur D, Banks E, Gnjidic D, McLachlan A. Deprescribing. Aust Prescr 2011;34: 182–5.
  39. 39. Woodward MC. Deprescribing: Achieving Better Health Outcomes for Older People Through Reducing Medications. Journal of Pharmacy Practice and Research. 2003;33: 323–8.
  40. 40. Gokula M and Holmes HM. Tools to reduce polypharmacy. Clin Geriatr Med. 2012;28: 323–41. pmid:22500546
  41. 41. Voshaar RC, Couvee JE, van Balkom AJ, Mulder PG, Zitman FG. Strategies for discontinuing long-term benzodiazepine use: meta-analysis. Br J Psychiatry. 2006;189: 213–20. pmid:16946355
  42. 42. Hsu CC and Sandford BA. The Delphi Technique: Making Sense of Consensus. Practical Assessment, Research and Evaluation. 2007;12: 10 [8 p.].
  43. 43. Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, et al. GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. 2011;64: 383–94. pmid:21195583
  44. 44. Hasson F, Keeney S and McKenna H.Research guidelines for the Delphi Survey. J Adv Nurs. 2000;32: 1008–15. pmid:11095242
  45. 45. Schmidt RC. Managing Delphi Surveys using nonparametric Statistical Techniques. Decision Sciences. 1997;28: 763–74.
  46. 46. Field A. Non-parametric tests. In: Wright DB, editor. Discovering statistics using SPSS;2009 pp. 539–583.
  47. 47. Pare G, Cameron AF, Poba-Nazaou P, Templier M. A systematic assessment of rigor in information systems ranking-type Delphi studies. Information & management. 2013;50: 201–217.
  48. 48. Patton MQ. Qualitative Analysis and Interpretation. In: Laughton CD, editor. Qualitative Research and Evaluation Methods;2002 pp. 431–540.
  49. 49. Hsieh H and Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15: 1277–1288. pmid:16204405
  50. 50. Holey EA, Feeley JL, Dixon J, Whittaker VJ. An exploration of the use of simple statistics to measure consensus and stability in Delphi studies. BMC Med Res Methodol. 2007;7: 52–62. pmid:18045508
  51. 51. American Geriatrics Society. AGS Updated Beers Criteria for Potentially Inappropriate Medication Use in Older Adults Society.2012. Available:
  52. 52. Swinkels H, Pottie K, Tugwell P, Rashid M, Narasiah L; Canadian Collaboration for Immigrant and Refugee Health. Development of guidelines for recently arrived immigrants and refugees to Canada: Delphi consensus on selecting preventable and treatable conditions. CMAJ. 2011;183: e928–32. pmid:20547714
  53. 53. Canadian Institute for Health Information. The Use of Selected Psychotropic Drugs Among Seniors on Public Drug Programs in Canada, 2001 to 2010. Canadian Institute for Health Information. 2012. Available:
  54. 54. Sithamparanathan K, Sadera A, Leung L. Adverse effects of benzodiazepine use in elderly people: a meta-analysis. Asian J Gerontol Geriatr. 2012;7: 107–11.
  55. 55. Gould RL, Coulson MC, Patel N, Highton-Williamson E, Howard RJ. Interventions for reducing benzodiazepine use in older people: meta-analysis of randomised controlled trials. Br J Psychiatry. 2014;204: 98–107. pmid:24493654
  56. 56. Declercq T, Petrovic M, Azermai M, Vander Stichele R, De Sutter AI, van Driel ML, et al. Withdrawal versus continuation of chronic antipsychotic drugs for behavioural and psychological symptoms in older people with dementia. Cochrane Database Syst Rev. 2013;3:CD007726. pmid:23543555
  57. 57. Chokshi NP, Messerli FH, Sutin D, Supariwala AA, Shah NR. Appropriateness of Statins in Patients Aged ≥80 Years and Comparison to Other Age Groups. Am J Cardiol. 2012;110: 1477–81. pmid:22901970
  58. 58. Byatt K. Overenthusiastic stroke risk factor modification in the over-80s: Are we being disingenuous to ourselves, and to our oldest patients? Evid Based Med 2014;19: 121–2. pmid:24574366
  59. 59. Mottram PG, Wilson K, Stobl J. Antidepressants for depressed elderly. Cochrane Database Syst Rev. 2006;(1): CD003491 pmid:16437456
  60. 60. Heidelbaugh JJ, Goldberg KL, Inadomi JM.Magnitude and economic effect of overuse of antisecretory therapy in the ambulatory care setting. Am J Manag Care. 2010;16: e228–34 pmid:21250399
  61. 61. Heidelbaugh JJ, Goldberg KL, Inadomi JM. Overutilization of proton pump inhibitors: a review of cost-effectiveness and risk [corrected]. Am J Gastroenterol. 2009;104 Suppl 2: S27–32. pmid:19262544
  62. 62. Spijker-Huiges A, Winters JC, Meyboom-De Jong B. Patients’ views on dyspepsia and acid suppressant drug therapy in general practice. Eur J Gen Pract. 2006;12: 10–4. pmid:16945866
  63. 63. Ott SM. What is the optimal duration of bisphosphonate therapy? Cleve Clin J Med. 2011;78: 619–30. pmid:21885695
  64. 64. Sykes L, Wood E, Kwan J. Antiepileptic drugs for the primary and secondary prevention of seizures after stroke. Cochrane Database Syst Rev. 2014;1:CD005398. pmid:24464793