Figures
Abstract
Quality improvement approaches are increasingly being used to address the problem of healthcare’s climate and ecological impact. While sustainability is increasingly recognized as a domain of quality, consensus is lacking on the most appropriate measures and metrics for those looking to reduce ecological impacts through quality improvement initiatives. We propose a scoping review to summarize approaches for selecting and quantifying ecological impacts in the published quality improvement literature. We will search multiple electronic databases (MEDLINE, EMBASE, CINAHL, and Scopus) from 2000 onwards, to identify published quality improvement initiatives in the human healthcare setting intended to address ecological impact with at least one quantitative measure of ecological impact, such as kilograms of carbon dioxide equivalent greenhouse gas. Two independent reviewers working in parallel will screen studies for inclusion and abstract study data, including publication, study, and ecological impact characteristics. Charted data will be synthesized narratively as well as with descriptive tables, figures, and summary statistics. In doing so, we will map areas of relative focus as well as gaps in the measurement of ecological impact across quality improvement initiatives. This map can in turn be used to raise awareness of ecological impacts requiring broader consideration, encouraging holistic and clinically relevant approaches to measuring ecological impact in future quality improvement work.
Citation: Sue-Chue-Lam C, Yanikomeroglu S, Hamad D, Wong B, Born K (2024) Metrics used in quality improvement publications addressing environmental sustainability in healthcare: A scoping review protocol. PLoS ONE 19(8): e0309417. https://doi.org/10.1371/journal.pone.0309417
Editor: Abel Afework, Addis Ababa University, ETHIOPIA
Received: January 18, 2024; Accepted: August 13, 2024; Published: August 28, 2024
Copyright: © 2024 Sue-Chue-Lam et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: No datasets were generated or analysed during the current study. Please note that this is a protocol submission. We confirm that we will abide by the open data policy.
Funding: This study was funded by a University of Toronto Dalla Lana School of Public Health Interdisciplinary Research Cluster Implementation Science Seed Grant of $10,000 from March 15 2023 to August 15 2024.
Competing interests: No
Introduction
Rationale
The healthcare sector ought to promote human health and wellbeing. Yet, healthcare has a significant global ecological impact with harmful downstream effects on health.
[1–4] Greenhouse gas emissions (GHG) from the US health care system climbed to 8.5% of total US GHG in 2018. Pollution from the US health care sector including GHG, PM2.5, and ozone exacted a toll of 388,000 disability-adjusted life-years in 2018 alone [3]. Global health care sector pollution was associated with the loss of 4 million DALYs in 2020 [5]. These serious health harms are preventable and pose an opportunity for the health sector to demonstrate leadership in the sustainability transformation.
Healthcare providers and organizations are increasingly turning to quality improvement (QI) as the science of systematic and continuous improvement to healthcare processes in attempts to mitigate the ecological impacts of healthcare [6, 7]. Existing efforts, while still early, focus mostly on climate impacts [8]. However, well-intentioned interventions to mitigate climate change may trade off against negative impacts on other earth system processes [9]. Intravenous anesthetics can sometimes be substituted for inhaled anesthetics with high global warming potential, but the common intravenous anesthetic propofol is often improperly disposed of, having toxic effects on aquatic life that cannot be ignored [10]. In this way, the planetary boundaries literature makes clear that a truly sustainable healthcare sector must attend to its relationship with an array of earth system processes [9].
Unfortunately, we know little at present about how QI initiatives have identified and measured the full range of ecological impacts–to the climate and beyond [11]. Indirect evidence from the healthcare life cycle analysis literature suggests that non-climate ecological impacts may be neglected in QI initiatives. The HealthcareLCA living database has catalogued studies of environmental impact of healthcare, noting that 99% (151/152) of studies catalogued climate impacts but only 55% (83/152) of studies evaluated any other impact category (such as acidification potential, particulate matter formation, and freshwater ecotoxicity potential, among others) [12]. While suggestive of a relative neglect in QI initiatives, the evidence from the LCA literature falls short of supporting any strong claim about prevailing approaches to measuring ecological impact in the sustainable QI literature.
Given that robust and meaningful measures are a cornerstone of QI, and furthermore that unrecognized tradeoffs may stymie efforts to build sustainable health systems, we must better understand how existing QI efforts to address environmental sustainability in healthcare have attempted to identify and measure ecological impacts. The primary aim of the proposed scoping review is thus to investigate this question and determine the gaps and areas of emphasis across this emerging body of literature. By mapping existing approaches to measuring ecological impact in the sustainable QI literature, we can suggest ways to leverage strengths, address weaknesses and inform future clinical and scholarly work.
Methods
This protocol was prepared using guidance for the development of scoping review protocols [13]. We will use the scoping review extension for the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) to guide reporting of the completed review [14]. Any amendments to the study protocol will be described in the methods section of the final publication.
We have chosen a scoping review approach over a systematic review approach because it suits our research aims, which relate to mapping methodological approaches and gaps in a new, diverse body of literature rather than arriving at an unbiased and precise effect estimate [15, 16].
Eligibility criteria
Clinically-led quality improvement (QI) or clinical innovation efforts taking place in all human healthcare delivery settings (acute care, post-acute care, ambulatory care) will be eligible for inclusion. We define clinical innovation efforts as ideas, services, or treatments used in a clinical setting that display benefits over current practices [17, 18]. Interventional studies will be included. The concept of interest is the exploration of metrics used to measure environmental impact in QI and clinical innovation efforts in the healthcare setting. Studies attempting to address environmental sustainability and that provide a quantitative measurement of ecological impact will be included. Measurement of ecological impact may be done directly or indirectly. We define direct metrics of environmental impact to include metrics such as kilograms of carbon dioxide equivalent greenhouse gas or water utilization. We define indirect metrics of ecological impact as clinical metrics with environmental impacts, such as the number of medication vials avoided, or the weight of plastics captured for recycling. We expect to find a broad range of metrics, beyond those identified in key papers retrieved from our initial search.
Modelling studies, reviews, case reports, editorials, letters, commentaries, and other publications that do not report any primary data or present new analyses of existing data will be excluded. Studies describing QI or clinical innovation efforts taking place outside of the clinical activity in the healthcare setting (i.e., physical plant, exclusively operations or engineering) will be excluded. Studies that are not peer-reviewed or published in languages other than English will also be excluded.
Search strategy
We have designed a comprehensive search strategy in collaboration with experienced information specialists and a quality improvement research synthesis expert. An initial search was completed on MEDLINE to retrieve relevant articles. Subject headings and keywords used in titles and abstracts of the articles of interest were used to create a full search strategy. The terms capturing QI and clinical innovation efforts included variations of the terms “quality improvement” and “clinical innovation”. The terms capturing ecological impact included “carbon”, “waste”, “overuse”, “environment”, “sustainability” and variations of these terms related to both direct and indirect ecological impacts. The healthcare setting was captured using variations of the term “healthcare”. The strategy was validated through the retrieval of several key studies, determined a priori to meet inclusion criteria. The full MEDLINE search strategy is detailed in Appendix 1 (“S1 File”). The full search strategy will be translated into all included databases.
Included search results were limited to those published in English and on or after the year 2000.
We limited results to those published on or after the year 2000 because this was the year the influential To Err is Human report was published and QI emerged internationally as a field of study [19]. Furthermore, the environmental impacts of healthcare have not been widely published until the last two decades [6, 20, 21].
Information sources
MEDLINE, EMBASE, CINAHL, and Scopus will be searched during August 2023 with database-specific search strategies for peer-reviewed published literature. The MESH terms selected for the search in MEDLINE were adapted to corresponding headings in each database.
Grey literature
Patient Safety Network (PSNet), Healthcare Without Harm, Cascades, UK Sustainability in Quality Improvement (SusQI), Choosing Wisely Canada National Meeting Abstract Books, and Institute for Healthcare Improvement (IHI) will be searched using keyword combinations derived from our main literature search. These organizations and websites were selected based on group discussion and input from subject matter experts that they are subject domain leaders in quality improvement and sustainability.
Data management
Covidence will be used to manage duplicates and screen titles, abstracts, and full-texts. Piloted Microsoft Excel spreadsheets will be used to chart the extracted data.
Selection process
Two independent reviewers will conduct two-stage screening in duplicate using piloted screening forms at each stage of screening. The first stage is abstract and title review, with eligibility confirmed by two independent reviewers. Any disagreements will be resolved through discussion and consensus, involving a third reviewer if consensus cannot be achieved. The second screening stage will be conducted on full text articles, again in duplicate with disagreements resolved through discussion, consensus, and similarly involving a third reviewer if consensus cannot be achieved.
Data collection process
Data will be extracted in duplicate by two independent reviewers using a pilot-tested data abstraction form. The pilot-tested abstraction form will be run for a random sample of ~30 articles by reviewers to calibrate internal consistency among reviewers. Resulting changes will be made before continuing extraction for the remaining articles. Any disagreements will be resolved through discussion and consensus, involving a third reviewer if necessary. As the two reviewers proceed, the data charting form will be revised iteratively as needed.
Data items
Data items are described in Table 1. We expect that many studies will include multiple outcomes. In these cases, we will extract data for all reported outcomes.
Items planned for abstraction from the fulltext results.
Data synthesis
We will present data narratively. We will also present a measurement framework to organize the data items described in Table 1, a figure to illustrate publications over time, and a diagram to illustrate the overlap between potential metrics of environmental impact and the metrics of environmental impact utilized in our dataset. Potential metrics of ecological impact will be identified from key references in life cycle assessment literature [8, 18].
Limitations
While our results will represent a comprehensive review of sustainable QI and clinical innovation initiatives, not all QI initiatives are published [22]. While published QI initiatives are more likely to be successful than unpublished QI initiatives, our aim is not to establish effectiveness, thereby minimizing the impact of this particular limitation of our sample. Nonetheless, to mitigate this limitation we have designed a comprehensive grey literature search strategy to capture initiatives outside the peer-reviewed literature.
All human activities have ecological impacts. We have thus limited our inclusion to studies with an explicit intent to address environmental sustainability. QI initiatives and clinical innovations not intending to address environmental sustainability will nonetheless have ecological consequences or co-benefits, and our study would not capture these. As a result of this exclusion, our study will be best positioned to provide insights for clinicians, policymakers, and scholars interested in understanding the state of the developing field of sustainable QI and clinical innovation science.
We have limited our search to studies published in English, leaving our results best positioned to describe the landscape of sustainable QI initiatives and clinical innovations in countries where English is dominant, or where researchers are able to publish their work in English.
Conclusions
Healthcare providers and systems serve to protect, promote and preserve human health. As such, they have a direct role and responsibility to curb climate impact, reduce ecologic harms and promote sustainability. However, measuring these changes can be challenging. The results of the proposed scoping review will address this critical knowledge gap by providing a systematic overview of how QI and clinical innovations targeted at environmental sustainability have operationalized this broad aim.
Our work will raise awareness of healthcare’s broad ecological footprint ‐ inclusive of but not limited to its effects on climate change ‐ among clinicians, QI researchers, and organizations. For clinicians, we will identify prior QI activities that might be used as a guide to future on-the-ground sustainability-focused QI efforts and encourage them to take a broad view on what constitutes an ecological impact. For QI scholars and researchers, our results will characterize the scale of existing sustainable QI efforts, identifying which settings and clinical domains have seen greatest activity and QI priority-setting. For organizations interested in embedding sustainability into QI plans and priorities, this work will offer an approach to measuring impact and outcomes. The ultimate impact of this work will be to support guidance and recommendations to those undertaking the urgent task of advancing sustainability in healthcare.
Supporting information
S1 Checklist. PRISMA-P (Preferred Reporting Items for Systematic review and Meta-Analysis Protocols) 2015 checklist: Recommended items to address in a systematic review protocol*.
https://doi.org/10.1371/journal.pone.0309417.s002
(DOC)
References
- 1. Karliner J, Slotterback S, Boyd R, Ashby B, Steele K. Health Care’s Climate Footprint. Health Care Without Harm [Internet]. 2019;(September):1–48. Available from: https://noharm-global.org/sites/default/files/documents-files/5961/HealthCaresClimateFootprint_092319.pdf
- 2. Eckelman MJ, Sherman JD, MacNeill AJ. Life cycle environmental emissions and health damages from the Canadian healthcare system: An economic-environmental-epidemiological analysis. PLoS Med [Internet]. 2018 [cited 2020 Jan 6];15(7). Available from: https://doi.org/10.1371/journal.pmed.1002623 pmid:30063712
- 3. Eckelman MJ, Huang K, Lagasse R, Senay E, Dubrow R, Sherman JD. Health care pollution and public health damage in the united states: An update. Health Aff. 2020;39(12):2071–9. pmid:33284703
- 4. Sherman JD, MacNeill A, Thiel C. Reducing pollution from the health care industry. JAMA ‐ Journal of the American Medical Association. 2019;322(11):1043–4. pmid:31373600
- 5. Romanello M, Napoli C di, Green C, Kennard H, Lampard P, Scamman D, et al. The 2023 report of the Lancet Countdown on health and climate change: the imperative for a health-centred response in a world facing irreversible harms. The Lancet. 2023;6736(23).
- 6. Mortimer F, Isherwood J, Wilkinson A, Vaux E. Sustainability in quality improvement: redefining value. Future Healthc J. 2018 Jun;5(2):88–93. pmid:31098540
- 7. Sherman JD, McGain F, Lem M, Mortimer F, Jonas WB, Macneill AJ. Net zero healthcare: A call for clinician action. The BMJ. 2021;374:1–6.
- 8. Pickles K, Haas R, Guppy M, O’Connor DA, Pathirana T, Barratt A, et al. Clinician and health service interventions to reduce the greenhouse gas emissions generated by healthcare: a systematic review. BMJ Evid Based Med. 2024;0(0):1–13. pmid:38782560
- 9. Rockström J, Gupta J, Qin D, Lade SJ, Abrams JF, Andersen LS, et al. Safe and just Earth system boundaries. Nature [Internet]. 2023 Jul 6;619(7968):102–11. Available from: https://www.nature.com/articles/s41586-023-06083-8 pmid:37258676
- 10. Jeswani HK, Azapagic A. Life cycle environmental impacts of inhalers. J Clean Prod [Internet]. 2019;237:117733. Available from: https://doi.org/10.1016/j.jclepro.2019.117733
- 11. Steenmeijer MA, Rodrigues JFD, Zijp MC, Waaijers-van der Loop SL. The environmental impact of the Dutch health-care sector beyond climate change: an input–output analysis. Lancet Planet Health [Internet]. 2022 Dec;6(12):e949–57. Available from: https://linkinghub.elsevier.com/retrieve/pii/S2542519622002443 pmid:36495889
- 12. Drew J, Christie SD, Rainham D, Rizan C. HealthcareLCA: an open-access living database of health-care environmental impact assessments. Lancet Planet Health [Internet]. 2022;6(12):e1000–12. Available from: pmid:36495883
- 13. Peters MDJ, Godfrey C, McInerney P, Khalil H, Larsen P, Marnie C, et al. Best practice guidance and reporting items for the development of scoping review protocols. JBI Evid Synth. 2022;20(4):953–68. pmid:35102103
- 14. Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): Checklist and explanation. Ann Intern Med. 2018;169(7):467–73. pmid:30178033
- 15. Munn Z, Peters M, Stern C, Tufanaru C, McArthur A, Aromataris E. Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol. 2018;18(143):1–7.
- 16. Arksey H, O’Malley L. Scoping studies: Towards a methodological framework. International Journal of Social Research Methodology: Theory and Practice [Internet]. 2005 [cited 2019 Aug 5];8(1):19–32. Available from: https://www.tandfonline.com/action/journalInformation?journalCode=tsrm20
- 17. Kelly CJ, Young AJ. Promoting innovation in healthcare. Future Healthc J. 2017;4(2):121–5. pmid:31098448
- 18. Nassir SN, Goodwin FK. The ethics of clinical innovation in psychopharmacology: Challenging traditional bioethics. Philosophy, Ethics, and Humanities in Medicine. 2007;2(1):1–8.
- 19.
Kohn L, Corrigan J, Donaldson M, editors. Institute of Medicine (US) Committee on Quality of Health Care in America. To Err is Human: Building a Safer Health System [Internet]. Washington, DC: National Academies Press (US); 2000. Available from: http://www.ncbi.nlm.nih.gov/books/NBK225182/
- 20. Booth A. Carbon footprint modelling of national health systems: Opportunities, challenges and recommendations. International Journal of Health Planning and Management. 2022;37(4):1885–93. pmid:35212060
- 21. Lenzen M, Malik A, Li M, Fry J, M Chaves LS, Weisz H, et al. The environmental footprint of health care: a global assessment. Lancet Planet Health [Internet]. 2020 [cited 2020 Jul 16];4:e271–9. Available from: www.thelancet.com/ pmid:32681898
- 22. Ogrinc G, Davies L, Goodman D, Batalden P, Davidoff F, Stevens D. SQUIRE 2.0 (Standards for QUality Improvement Reporting Excellence): Revised publication guidelines from a detailed consensus process. BMJ Qual Saf. 2016;25(12):986–92. pmid:26369893