Figures
Abstract
Objectives
Eliminating unnecessary laboratory tests is a good way to reduce costs while maintain patient safety. The aim of this study was to define and process strategies to rationalize laboratory use in Ankara Numune Training and Research Hospital (ANH) and calculate potential savings in costs.
Methods
A collaborative plan was defined by hospital managers; joint meetings with ANHTA and laboratory professors were set; the joint committee invited relevant staff for input, and a laboratory efficiency committee was created. Literature was reviewed systematically to identify strategies used to improve laboratory efficiency. Strategies that would be applicable in local settings were identified for implementation, processed, and the impact on clinical use and costs assessed for 12 months.
Results
Laboratory use in ANH differed enormously among clinics. Major use was identified in internal medicine. The mean number of tests per patient was 15.8. Unnecessary testing for chloride, folic acid, free prostate specific antigen, hepatitis and HIV testing were observed. Test panel use was pinpointed as the main cause of overuse of the laboratory and the Hospital Information System test ordering page was reorganized. A significant decrease (between 12.6–85.0%) was observed for the tests that were taken to an alternative page on the computer screen. The one year study saving was equivalent to 371,183 US dollars.
Citation: Yılmaz FM, Kahveci R, Aksoy A, Özer Kucuk E, Akın T, Mathew JL, et al. (2016) Impact of Laboratory Test Use Strategies in a Turkish Hospital. PLoS ONE 11(4): e0153693. https://doi.org/10.1371/journal.pone.0153693
Editor: Gianni Virgili, University of Florence, ITALY
Received: June 1, 2015; Accepted: April 3, 2016; Published: April 14, 2016
Copyright: © 2016 Yılmaz et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper.
Funding: These authors have no support or funding to report.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Reducing healthcare costs, with the maintainance of patient safety and improved quality, is one of the main targets in most healthcare reform efforts. It is often difficult to decide how to achieve this goal. Eliminating unnecessary laboratory tests and procedures is one good place to start. It has been reported that approximately $6.8 billion of medical care in the United States has involved unnecessary testing and procedures that do not improve care and may even harm the patient [1]. The American Society for Clinical Pathology dedicated their April 2012 edition of Critical Values to the issue of appropriate laboratory testing, and pointed out the aim as ‘‘right test, right patient, right time, at the right cost” [2].
It is important to prioritise hospital-based strategies to reduce healthcare costs. ANHTA is the first hospital based Health Technology Assessment (HTA) Unit in Turkey. The unit aims to support hospital managers in evidence-based investment or disinvestment decisions regarding health technology use in the hospital. Hospital based committees, including laboratory professionals and clinicians, can define hospital based problems, which can lead to standardized approaches. Hospital based HTA units have a crucial role in working with the related professionals to facilitate an evidence-based approach in the process, which would further lead to improved quality with reduced costs.
In this study, our aim was to define and process strategies to rationalize laboratory use in Ankara Numune Training and Research Hospital (ANH) and calculate impact and potential savings in health-care costs.
Methods
A collaborative action plan was defined by the hospital managers. Joint meetings with ANHTA and laboratory chairs were set; the joint committee invited relevant staff for input, and hospital laboratory efficiency committee was created, including clinicians from internal medicine, general surgery, family medicine, emergency department and the laboratory directors of biochemistry and microbiology departments. Literature was reviewed in order to identify strategies used to improve laboratory efficiency. Strategies that would be applicable in local setting were identified for implementation, processed and impact on clinical use and costs was assessed for 12 months.
Implementations were decided and processed as detailed below:
Taking a picture about the current status and increasing the awareness
- A hospital meeting was conducted in order to create an awareness and the doctors from various departments were informed about the appropriate use of laboratory tests. The examples of the overused tests were shared and discussed during the meetings. The impact of the laboratory costs, the potential harms of ordering an unnecessary test for a patient, the importance of increasing the clinician-laboratory interaction was emphasized.
- A follow up procedure was planned and a laboratory use report, including mean number of ordered tests per patient and total laboratory cost of every department was prepared. Laboratory use reports were sent to the departments every month.
- A review was performed to understand how various laboratory tests were used and whether the use was appropriate according to the guidelines or evidence provided in the literature.
Literature search about evidence based laboratory practices and identification of strategies that would be applicable in local setting
- 4. Literature was reviewed in order to identify strategies used to improve laboratory efficiency and the implementations reported in the literature were listed. Although a formal systematic review was not undertaken as this was outside the scope of this study, our primary objective was to identify any relevant information related to the objective of our study. We looked for systematic reviews and health technology assessment reports as well as any trials that would provide additional information about techniques to improve laboratory use. We searched PubMed and the Cochrane Library, using “(laboratory test) AND (misuse OR overuse)” as search terms. The databases of health technology assessment agencies were manually searched for relevant references. We also searched for relevant citations from the articles we initially selected, to locate any additional studies of interest. The inclusion criteria were systematic reviews/reviews/randomized controlled trials/HTA reports (Study Design) of interventions/strategies (Intervention) to reduce the misuse or abuse of laboratory tests (Outcome) ordered by physicians in hospital settings (Population/Problem). Two researchers reviewed all relevant papers to identify different techniques and interventions to affect laboratory use and summarized their findings.
- 5. After the review of techniques, the barriers which can block the process during implementation and possible solutions were discussed by the committee.
Monitoring of the effects and evaluation of the economic impact
- 6. The number of ordered tests and total laboratory costs of the hospital were followed for one year by monitoring the laboratory test amount, between March 2013-March 2014. Numbers of the ordered tests were compared with the previous year numbers for every month. The amount of this decrease was calculated as the Reduction% (R% = [(Sum of the tests between March 2012-March 2013)- (Sum of the tests in March 2013-March 2014)/(Sum of the tests between March 2012-March 2013)]*100). The total impact was calculated at the end of the one-year-follow up period.
Results
This study was run in ANH, which is in service in Ankara, Turkey since 1881. ANH is a reference hospital with great experience in research and training. It has 1200 bed capacity and service is provided by over 5000 staff. Health care services run in 38 different specialties; and residency trainings are given in 31 specialties. It had 218.866.322 TL budget in 2013 and 235.398.498 in 2014 (over 80 million euros per year in average). Outpatient admissions were 962.589 patients in 2013 and 1.013.300 patients in 2014. Highest number of admissions were to internal medicine and emergency departments. Overall mortality rate in the hospital during the year preceding the intervention was 0.028 and was unchanged the following year. Similarly, the mean (SD) length of hospitalization was 6.2 (0.3) days during the first year and 6.3 (0.2) during the second year of the study.
Search Results
The literature review through PubMed identified 251 potentially relevant articles. A filter for systematic reviews revealed 8 and a filter for reviews revealed 27 hits. 12 randomized controlled trials were also identified. A review of the Cochrane Library revealed 20 trials. No HTA report was identified through this search. The manual search of databases of HTA agencies revealed three related reports. There were 12 overlaps, which left us 58 papers. 42 papers were excluded through a first overview of titles, ending up with 2 HTA reports, 4 systematic reviews, 4 reviews, 8 randomised controlled trials and 3 non-randomised trials. Exclusion of non-relevant papers based on full reading of the papers finally left us 2 HTA reports, 2 systematic reviews, 4 reviews and 3 trials. Flow diagram and list of the included studies are given in Fig 1 and Table 1.
The findings were later discussed by the committee to identify which techniques would be implemented in the local setting.
Techniques use review results.
The CADTH reports [3,4] highlighted the utilization of computerized decision support systems observing that use of such technology improved physician prescribing behavior. One trial comparing watchful waiting rather than direct ordering of tests concluded that this was a practical approach to optimize laboratory use. Audit feedback was also presented as an appropriate strategy for limiting the use of laboratory tests. The INESSS report [5] suggested the use of Information technology (IT) for decision support algorithms, development of guidelines, modification of prescriber behaviors, and appropriate legislation. Similar use of IT was suggested by Levick et al, whereby computerized alerts (red flags) could warn the clinicians and the laboratory specialists when certain tests were ordered excessively [6]. Ferraro recommended close collaboration between the physicians ordering tests and the laboratory personnel providing the services [7]. Organizational strategies including a focus on Total Quality Management have also been presented as a method to optimize use of laboratory services. In one study, the investigators highlighted the role of administrative modifications such as limiting the availability of certain laboratory services based on their frequency, education of hospital staff, and feedback to streamline the process [8].
Test use review results.
All of the laboratory orders for a three month period were investigated in order to understand the tendencies of the clinicians which might be quite different for every hospital. Overused (ordered more commonly than expected e.g folic acid, LDH, chloride orders which have little clinical impact on clinical decision except specific patients) or misused tests (e.g. HBeAg test order for a HBsAb positive patient, TORCH (toxoplasmosis, rubella, cytomegalovirus, herpes) IgG and IgM testing for every pregnant women, preoperative hepatitis and HIV testing, free PSA testing independent from total PSA levels) were reviewed. During this review, Na-K-Chloride tests were ordered together in %98.5 of the patients, GGT-ALP-LDH tests were ordered together in 86% of the patients, total PSA and free PSA were ordered at the same time in 98% of the patients. The results of the test use review at ANH showed that major use was in internal medicine. The mean number of tests per patient was 15.8. Laboratory use differed enormously among clinics (5–28 tests per patient). The budget impact of all tests per year was 4 433 902 $. Overuse of chloride, lactate dehydrogenase, free PSA (prostate specific antigen), folic acid, hepatitis and HIV tests, and considerable variation from guideline recommendations for preoperative routine testing were observed. For example chloride was observed to be ordered as a part of Na-K-Cl electrolyte panel and was ordered for every patient who had an electrolyte testing. Free PSA was ordered independently from the total PSA level although it is known to be valuable for only the patients whose total PSA levels are within the gray zone (2–10 ng/mL). Folic acid was ordered for the majority of patients who had been tested for Vitamin B12 levels. The reason for the overuse of these tests was thought as the tendency of the clinicians to order specific tests attached to another (e.g. ordering chloride with sodium and potassium or folic acid with Vitamin B12). Clinicians were observed to use test panels which they constitute for quick pick up of the laboratory tests and these panels have thought to be a major cause of unnecessary testing for ANH.
Strategies decided to be implemented based on consensus of the committee members
- Education of the clinicians about evidence based practices [9,10]. This strategy was implemented through hospital internal meetings.
- Informing clinicians about the laboratory costs [11,12]. A laboratory use report including mean number of ordered tests per patient and total laboratory cost of every department was sent to each department every month.
- The rearrangement of the computerized test ordering page [13]. This rearrangement was performed for the tests which were detected as overused tests during the use review. Test ordering page was divided into two separate pages which were in different screens on the computer and the tests which give less information, ordered more than expected or observed to be mis-used were taken to the second page.
- Using test panels during the test order was determined as a major problem causing overuse. Therefore, the use of the test panels was forbidden, after informing the clinicians.
- The integration of prompting notes to the computerized test ordering page [14]. We implemented a prompting note to give information when the same test had been ordered within the previous week.
Monitoring and impact evaluation
We started to implement the defined strategies by February 2013. The first strategy of the above was implemented in February while the rest of the strategies were implemented by March 2013. We did not follow the the impact of the strategies separately in order not to extend the following time. We aimed to obtain a maximum impact with the combination of the five strategies. The impact on laboratory use and costs were monitored with the follow up of the test numbers and impact was evaluated for the following 12 months after March 2013. There was a significant decrease in the number of the tests after the decided interventions.
All of the panels involving electrolyte testing included Na-K-Chloride tests independent from the diagnosis, although chloride test is recommended to be used in specific conditions [15]. After prohibition of the panels, the chloride test was moved to the second test ordering page, which inhibited the quick-pick of the test and a reduction of 51.3% was observed. The same strategy provided a 44.2% reduction for free PSA and 67.7% reduction for folic acid. The reason for overuse of these tests just seemed to be an ordering habit without a significant scientific reason, and separation of Cl from Na-K, folic acid from vitamin B12 and free PSA from total PSA was thought to decrease this kind of use.
A significant overuse in ordering of TORCH (IgG antibodies measured by ELISA against toxoplasmosis, rubella, cytomegalovirus, herpes) testing has been observed during the use review. Moving these tests to the second page resulted in reduction of 78.9%, 85.0% and 79.8%, respectively for IgG antibodies to cytomegalovirus, toxoplasmosis and rubella. The reason for the overuse of ELISA tests was thought to be related to insufficient medical knowledge to order and interpret the ELISA tests and further training of residents has been planned.
The total test numbers of the parameters which were moved to the second page in comparison with the previous year’s numbers are given in Table 2. Use of all of the tests which were moved to the second page decreased significantly (between 12.6–85.0%). The comparison of the sum of these tests with the previous year is demonstrated in Fig 2. The most significant decrease was observed in toxoplasmosis IgG at 85,0%. The one year impact of the study was calculated as a saving of $371 183.
(%R = Percentage of reduction in test numbers).
Discussion
This study reflects the first results from an ongoing HTA program on appropriate test use in ANH. Our one year experience showed that a collaborative plan might have significant effects in reducing laboratory costs. Although we neither documented and quantified misuse nor formally used benchmarks, our baseline data provided clear signals of overuse of basic laboratory tests based on the literature search, also supported by variation across hospital units, giving support to our cost-containment action.
More than half of the clinical decisions have known to be influenced by laboratory results [16]. Importantly, research reporting a wide variation in laboratory testing behaviour of clinicians for similar syndromes has shown no improvement in clinical outcomes with increasing numbers of tests [17–20].
A variety of studies have been performed with the aim of appropriate use, however most of them have focused on reducing the use of a limited number of laboratory tests [21–24]. The results of a similar organizational use management programme have been published recently and reported that a reduction of 26% in inpatient tests per discharge was managed during a 10-year period [13]. Our results in this study confirmed that hospital committees or organizations may provide a higher impact than focusing on a limited number of specific tests.
Hospital-specific test use review is an important step to define strategies and decide on routes. It has been reported that test use behaviour and practice of medical care and tests might be different according to region and geography [25]. Our initial results showed that creating a hospital committee and performing a test use review provides important information about hospital priorities in appropriate test use and these priorities might differ in different institutions.
Our priority has been identified as prohibition of the clinician test panels because there was a wide variety between panels which can lead to overuse of the tests.
It is important to emphasize that none of the implementations included a prohibition of the laboratory test orders for the clinicians. The clinicians were free to order any of the laboratory tests. However, throughout the course of the study, we welcomed inputs from clinicians caring for patients, about their perceptions regarding the changes in the preordering format. None of them reported any difficulties with the modified system. This indirectly reiterates that many of the tests ordered were perhaps not essential in the first place. Ideally, we would have liked to assess the clinical impact of the modified system in terms of clinical outcomes such as mortality rate, morbidity rates, length of hospitalizations, requirement for enhanced monitoring etc; in order to confirm that patient care was not compromised. However, this was outside the scope of this study. It can be argued that the time of clinicians caring for patients may be increased by having to order lab tests sequentially rather than together. This could theoretically increase costs based on clinician time. However, we have not calculated costs based on this. Informal discussions with physicians suggest that they may not consider this as a limitation to reduce the number of tests ordered initially and proceeding sequentially based on individual patient requirement and test results.
In conclusion, our initial results showed that hospital-based committees including laboratory professionals and clinicians can define hospital based problems and can lead to a standardized approach to test use that can help clinicians considerably reduce laboratory costs through appropriate use of the laboratory tests. In addition, hospital based health technology assessment unit provides a structured ground for such collaborative work.
Acknowledgments
The authors thank to the academic personnel who have been consulted at different stages of determination and implementation of strategies and the staff of statistics department of Ankara Numune Training and Research Hospital.
Author Contributions
Conceived and designed the experiments: FMY RK TA AA NZ. Performed the experiments: FMY RK TA AA EOK. Analyzed the data: FMY RK AA EOK. Contributed reagents/materials/analysis tools: FMY RK AA EOK TA. Wrote the paper: FMY RK AA EOK TA JLM CM NZ. Ran systematic review: FMY RK CM JLM.
References
- 1. The Good Stewardship Working Group. The “top 5’lists in primary care: meeting the responsibility of professionalism. Arch Intern Med. 2011;171(15):1385–1390. pmid:21606090
- 2. Holladay EB. Test Right. Critical Values 2012; 5: 3.
- 3.
Canadian Agency for Drugs and Technologies in Health Rapid Response Report:. Techniques to improve the use of diagnostic laboratory test ordering: Clinical Evidence. 12 March 2013.
- 4.
Canadian Agency for Drugs and Technologies in Health. Health Technology Inquiry Service HTA Report: Diagnostic Test Ordering: Techniques to improve use. 13 May 2010.
- 5.
Institut national d’excellence en santé et en services (INESSS). Portrait of strategies implemented to optimize the appropriateness of laboratory test ordering: Canadian and international experiences. October 2013
- 6. Levick DL, Stern G, Meyerhoefer CD, Levick A, Pucklavage D. "Reducing unnecessary testing in a CPOE system through implementation of a targeted CDS intervention". BMC Med Inform DecisMak. 2013; 13:43
- 7. Ferraro MJ. Effect of diagnosis-related groups on diagnostic methodology in the hospital laboratory. Diagn Microbiol Infect Dis. 1986;4:135S–142S. pmid:3084161
- 8. Calderon-Margalit R, Mor-Yosef S, Mayer M, Adler B, Shapira SC. An administrative intervention to improve the utilization of laboratory tests within a university hospital International journal for quality in health care, 2005; 17(3): 243
- 9. Dowling PT, Alfonsi G, Brown MI, Culpepper L. An education program to reduce unnecessary laboratory tests by residents. Acad Med. 1989 Jul;64(7):410–2. pmid:2742708
- 10. Astion ML. Overutilization of the laboratory: Part1 Googling our way into overutilization and misinterpretation. Lab Errors Patient Safety. 2005;2(3):5–6.
- 11. Billi JE, Hejna GF, Wolf FM, Shapiro LR, Stross JK. The effects of a cost-education program on hospital charges. J Gen Intern Med. 1987 Sep-Oct;2(5):306–11. pmid:3655956
- 12. Solomon DH, Hashimoto H, Daltroy L, Liang MH. Techniques to improve physicians' use of diagnostic tests: a new conceptual framework. JAMA. 1998 Dec 16;280(23):2020–7. pmid:9863854
- 13. Kim JY, Dzik WH, Dighe AS, Lewandrowski KB. Utilization management in a large urban academic medical center: A 10-year experience. Am J Clin Pathol. 2011;135:108–118. pmid:21173132
- 14. Neilson EG, Johnson KB; Rosenbloom ST, Dupont WD, Talbert D, Giuse DA, et al. The impact of peer management on test-ordering behavior. Ann Intern Med. 2004;141:196–204. pmid:15289216
- 15.
DuBose TD Jr. Disorders of acid-base balance. In: Brenner BM, ed. Brenner and Rector's The Kidney. 8th ed. Philadelphia, Pa: Saunders Elsevier;2008:chap 14.
- 16. Becich MJ. Information management: moving from test results to clinical information. Clin Leadersh Manag Rev. 2000;14: 296–300. pmid:11210218
- 17. Daniels M, Schroeder S. Variation among physicians in use of laboratory tests, II: relation to clinical productivity and outcomes of care. Med Care. 1977;15:482–487. pmid:875494
- 18. Powell EC, Hampers LC. Physician variation in test ordering in the management of gastroenteritis in children. Arch Pediatr Adolesc Med. 2003;157:978–983. pmid:14557158
- 19. Martin AR, Wolf MA, Thibodeau LA, Dzau V, Braunwald E. A trial of two strategies to modify the test-ordering behavior of medical residents. N Engl J Med. 1980;303:1330–1336. pmid:7432374
- 20. Smith AD, Shenkin A, Dryburgh FJ, Morgan HG. Emergency biochemistry services: are they abused? Ann Clin Biochem. 1982;19:325–328. pmid:7137865
- 21. Robinson A. Rationale for cost-effective laboratory medicine. Clin Microbiol Rev. 1994;7:185–199. pmid:8055467
- 22. Benson ES. Initiatives toward effective decision making and laboratory use. Hum Pathol. 1980;11:440–448. pmid:7000664
- 23. Kumwilaisak K, Noto A, Schmidt UH, Beck CI, Crimi C, Lewandrowski K, et al. Effect of laboratory testing guidelines on the utilization of tests and order entries in a surgical intensive care unit. Crit Care Med. 2008;36:2993–2999. pmid:18824907
- 24. Lee-Lewandrowski E, Laposata M, Eschenbach K, Camooso C, Nathan DM, Godine JE, et al. Utilization and cost analysis of bedside capillary glucose testing in a large teaching hospital: implications for managing point of care testing. Am J Med. 1994;97:222–230 pmid:8092170
- 25. Ashton CM, Petersen NJ, Souchek J, Menke TJ, Yu HJ, Pietz K, et al. Geographic variations in utilization rates in Veterans Affairs hospitals and clinics. N Engl J Med. 1999;340:32–39. pmid:9878643