Figures
Abstract
Background/objective
Despite initiatives to reduce waste and spending, there is a gap in physician knowledge regarding the cost of commonly ordered items. We examined the relationship between pediatric hospitalists’ knowledge of national medical waste reduction initiatives, self-reported level of cost-consciousness (the degree in which cost affects practice), and cost accuracy (how close an estimate is to its hospital cost) at a national level.
Methods
This cross-sectional study used a national, online survey sent to hospitalists at 49 children’s hospitals to assess their knowledge of national medical waste reduction initiatives, self-reported cost consciousness, and cost estimates for commonly ordered laboratory studies, medications, and imaging studies. Actual unit costs for each hospital were obtained from the Pediatric Health Information System (PHIS). Cost accuracy was calculated as the percent difference between each respondent’s estimate and unit costs, using cost-charge ratios (CCR).
Results
The hospitalist response rate was 17.7% (327/1850), representing 40 hospitals. Overall, 33.1% of respondents had no knowledge of national medical waste reduction initiatives and 24.3% had no knowledge of local hospital costs. There was no significant relationship between cost accuracy and knowledge of national medical waste reduction initiatives or high self-reported cost consciousness. Hospitalists with the highest self-reported cost consciousness were the least accurate in estimating costs for commonly ordered laboratory studies, medications, or imaging studies. Respondents overestimated the cost of all items with the largest percent difference with medications. Hospitalists practicing over 15 years had the highest cost accuracy.
Conclusions
A large proportion of pediatric hospitalists lack knowledge on national waste reduction initiatives. Improving the cost-accuracy of pediatric hospitalists may not reduce health care costs as they overestimated many hospital costs. Median unit cost lists could be a resource for educating medical students and residents about health care costs.
Citation: Lee BC, Hall M, Agharokh L, Yu AG, Parikh K, Shah SS (2023) National cross-sectional study on cost consciousness, cost accuracy, and national medical waste reduction initiative knowledge among pediatric hospitalists in the United States. PLoS ONE 18(4): e0284912. https://doi.org/10.1371/journal.pone.0284912
Editor: Sorana D. Bolboacă, Iuliu Hațieganu University of Medicine and Pharmacy: Universitatea de Medicina si Farmacie Iuliu Hatieganu, ROMANIA
Received: August 9, 2022; Accepted: April 12, 2023; Published: April 24, 2023
Copyright: © 2023 Lee et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Data is held in a public repository which can be accessed via this link: https://github.com/matthallstats/PHM-Cost-Consciousness.git.
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Health care spending accounts for 19.7% of United States gross domestic product [1], with hospital expenditures accounting for $1.3 trillion, or nearly one-third of all health care expenditures. The Institute of Medicine estimated that 30% of health spending was wasteful and they advocated for better care at lower costs [2]. Pediatric health care spending has dramatically increased from $150 billion in 1996 to $235 billion in 2013 [3, 4]. National medical waste reduction initiatives such as the American Board of Internal Medicine Foundation’s Choosing Wisely® campaign and the Pediatric Respiratory Illness Measurement System (PRIMES) aim to reduce unnecessary medical tests, treatments, and procedures through consensus recommendations [5, 6]. The Accreditation Council for Graduate Medical Education stresses the importance of “incorporating considerations of value, cost awareness, delivery and payment, and risk-benefit analysis”” and “understanding health care finances” during resident training [7]. Physicians believe that they have a major responsibility to address health care costs [8] and that containing costs is the responsibility of every physician [9]. Despite these charges, a majority of residents, fellows, and attendings (physicians who have completed medical training) do not know the cost of commonly ordered items [10–13].
Current pediatric studies examining cost consciousness or cost accuracy are at single institutions or at a few sites and involve specialties outside of hospital medicine [10, 11, 14, 15]. Studies have explored barriers to implementing Choosing Wisely® recommendations [16], as well as initiatives incorporating them into training programs [17]. In high-value care, medical benefits outweigh the cost of interventions. We hypothesized that knowing the cost of commonly ordered laboratory studies, medications, and imaging studies may help physicians improve high-value care. We also sought to determine whether pediatric hospitalists’ knowledge of national medical waste reduction initiatives and self-reported level of cost-consciousness (the degree in which cost affects practice) were associated with knowledge of costs and cost accuracy (how close an estimate was to its hospital cost) for commonly ordered items at a national level.
Methods
This is a cross-sectional study utilizing an online survey and the Pediatric Health Information System (PHIS; Children’s Hospital Association, Lenexa, KS).
Survey
A 31-question survey was created using Research Electronic Data Capture (REDCap; Vanderbilt University, 2021). Survey topics were determined from national medical waste reduction initiatives [6, 18], previous literature on cost consciousness [11], and author consensus. Common laboratory studies, medications, and imaging studies were selected from a list of the top 100 ordered items for each category, according to PHIS data, and focused on those linked to national medical waste reduction initiatives such as Choosing Wisely® or Pediatric Respiratory Illness Measurement System (PRIMES). The survey was piloted by several co-authors and revisions were made to the survey wording and number of selections.
Since there was not an all-inclusive contact list for pediatric hospitalists (attendings who spend a majority of their time caring for hospitalized patients), an email invitation with a general survey link was sent to pediatric inpatient (Hospital Medicine or General Pediatrics) division directors or division research leaders at all 49 hospitals that contribute data to PHIS. A reminder was sent every 2 weeks (3 total reminders) and the survey duration was 8 weeks, from April 2021 to May 2021. Division directors were identified via hospital or medical school websites, calling division offices, or previous relationships with authors. The directors were asked to forward the survey link to pediatric hospitalists. The UT Southwestern Human Research Protection Program (HRPP) determined that the study does not meet the definition of research under 45 CFR46.102, and therefore did not require IRB approval or oversight. Participants were not required to provide informed consent, but completion of the survey acknowledged participation in the study. Responses were anonymously analyzed. There were no financial incentives for respondents. The response rates were calculated using American Association of Public Opinion Research response rate definitions 5 and 6 [19].
Demographic information was collected about each participant’s gender, years in practice, current year of training, and primary location of clinical duties. Participants reported their familiarity with national medical waste reduction initiatives and how frequently cost consciousness affected their ordering of common laboratory studies, medications, and imaging studies in a typical week, using a Likert-type scale (S1 File). Lastly, participants assigned a numerical dollar estimate to the cost of common laboratory studies, medications, and imaging studies at their hospital.
PHIS data
PHIS is a comparative administrative database which includes clinical and resource utilization data for inpatient, ambulatory surgery, emergency medicine, and observation unit patient encounters for 49 United States children’s hospitals [20]. Median hospital unit costs for each resource were calculated from hospitalized patients encounters in 2020 by multiplying charges at a specific hospital by the hospital’s department specific cost-to-charge ratio (CCR). Hospitals use the CCR method to compare costs between each other because comprehensive cost accounting is not available. Medication doses were expressed as one standard dose and not an entire treatment course.
Responses were summarized with frequencies and percentages and compared across categories using chi-square tests. The percent difference in estimated and CCR costs were calculated for each respondent and corresponding hospital. These were summarized using medians with inter-quartile ranges (IQR) and compared across groups using Wilcoxon Rank-Sum tests or Kruskal-Wallis tests as appropriate. All statistical analyses were performed in SAS v.9.4 (SAS Institute, Cart, NC) and p-values <0.05 were considered statistically significant.
Results
Forty surveys completed by individuals who were not attendings, such as fellows, residents, and nurse practitioners, were excluded. Of the 49 hospitals, 40 (81.6%) had at least one response (range 1 to 41) with wide geographic representation. The total number of pediatric hospitalists at the 49 hospitals (1850) was determined by identifying pediatric hospitalist attendings listed on hospital or university websites. Of the 1850 attendings, 327 (17.7%) responses were received, including 270 (14.6%) complete responses. Most respondents identified as female and were 6–15 years into practice (Table 1).
Self-reported cost consciousness
Most respondents considered cost into overall decision-making “somewhat often” (47.7%), which was also seen in each sub-category: laboratory studies (41.3%), medications (44.0%), and imaging studies (41.9%) (Table 2). Males self-reported higher degrees of cost consciousness than females (Table 1).
Self-reported knowledge of national medical waste reduction initiatives and hospital costs
While 66.9% of respondents had gained knowledge of national medical waste reduction initiatives through various avenues (including advanced degree coursework, lectures, and self-directed learning), 33.1% had no specific knowledge of those initiatives. Nearly all respondents (98.5%) felt that these initiatives should be introduced in either medical school (68.5%) or residency (30%). Those reporting that cost consciousness”Always” or “Very Often” influenced their practice were more likely to receive knowledge from self-directed learning compared to other groups (p = 0.02). Similarly, 24.3% of respondents reported having no specific knowledge of hospital costs with 96.5% supporting education about hospital costs during medical school (54%) or residency (42.5%) (Table 3).
Cost estimates of commonly ordered laboratory studies, medications, and imaging studies
For each ordered item, the unit cost was determined by multiplying charges at a specific hospital by the hospital’s specific CCR, from which a median and IQR was calculated (Table 4).
Respondents’ cost estimates were compared to hospital-specific costs and displayed as median and IQR percent difference from the actual cost (Table 4). Medications were lower cost and had the largest median percent difference compared to laboratory and imaging studies, which had higher costs and smaller percent differences (Fig 1). The median percent difference was above 0% (range 1.4–1644.1%), meaning an overestimation of cost for all resources. The item with the greatest percent difference was intravenous ceftriaxone, which was estimated at 16 times higher than the CCR cost (Table 4). Attendings with high levels of self-reported cost-consciousness (considering cost “Always” or “Very Often” in their decision-making) tended to overestimate costs with a median percent difference of 234.1% vs. 124.1% for laboratory studies (p = <0.01), 1094.7% vs. 735.2% for medications (p = 0.01), and 131.9% vs. 79.4% for imaging studies (p = 0.04; Table 5) when compared to the “Somewhat Often”, “Never”, and “Rarely” groups. Compared to respondents with <16 years of practice, those with 16+ years in practice had more accurate cost estimations for medications (457.9% vs 908.6%, p<0.01) and imaging studies (76.5% vs. 102.5%, p<0.01), but no difference for laboratory studies (Table 6).
Median hospital-specific cost (1a-1c) and percent [interquartile] difference of respondent estimates from hospital cost of commonly ordered items (1d-1f). CRP = C-reactive protein, BMP = Basic metabolic profile, CBC = Complete blood count, ESR = Erythrocyte sedimentation rate, BC = Blood culture, PO = Oral, IV = Intravenous, mg = milligram, ml = milliliter, CT = Computer tomography, MRI = Magnetic resonance imaging.
Discussion
In this national survey of pediatric hospitalists, one-third of respondents had no specific knowledge of national medical waste reduction initiatives and nearly one-quarter were unaware of hospital specific costs. Respondents overestimated the cost of every item and those who self-reported high cost-consciousness were generally the least cost accurate (largest difference between estimate and hospital CCR cost). Respondents with 16+ years of practice were the most cost accurate (smallest difference between estimate and hospital CCR cost). These findings suggest that knowledge of national initiatives may not be adequate to inform physicians about the costs of health care and that attending physician cost accuracy may not equate to lower health care costs.
National medical waste reduction initiatives and hospital-specific costs
National medical waste reduction initiatives were implemented to help reduce health care costs in the United States by reducing overutilization. In our study, those who self-reported knowledge of initiatives tended to be more cost-conscious, and those who self-reported no knowledge of initiatives tended to be less cost-conscious, however, high self-reported cost-consciousness did not lead to higher cost accuracy. National medical waste reduction initiatives focus on eliminating unnecessary interventions without specifically mentioning the cost of those interventions. Thus, one can consider abstract cost reduction during medical practice without knowledge of hospital-specific costs. Previous literature suggests that passive awareness of national medical waste reduction initiatives alone does not lead to durable change in physicians’ ordering behavior [21]. Other targeted interventions such as clinical pathways [22], best practice alerts [23], or cost display [24] in the electronic health record could reduce health care cost better rather than solely focusing on improving cost accuracy.
The lack of cost transparency may be a contributing factor to the 24.3% of respondents who continue to be unaware of local hospital-specific costs of commonly ordered laboratory studies, medications, and imaging studies. Although hospital chargemaster sheets are available, the true cost of an item is a fraction of the charge and varies from hospital to hospital, thus we used CCR cost for interhospital comparisons. A recent Presidential Executive Order, which would require health plans to provide the negotiated rates and out-of-pocket costs to consumers in 2023, may aid in cost transparency and physician awareness of costs [25]. Prior cost transparency studies that focused on pilot programs aimed at reducing overutilization of specific items, reported conflicting outcomes [26–28]. Though some showed no changes or only short-term changes in behavior, programs with longer-term behavior change continued to stress the intervention over longer periods of time. Future studies could investigate the ability to change ordering behavior across multiple fields rather than one specific area.
Nearly all respondents support early introduction of hospital-specific costs and education on national medical waste reduction Initiatives during medical school or residency, a finding that supports previous calls to introduce these topics earlier in training [15, 24, 29]. Previous studies have shown an association between higher cost consciousness and longer clinical work experience [14], but studies have not looked at cost accuracy in relation to clinical work experience. Late career respondents (16+ years of practice) were statistically more accurate in the medications and imaging studies categories compared to those with less than 16 years of practice (Table 6).
Cost-consciousness versus cost-accuracy
Physicians, regardless of specialty, are not accurate with their estimations of costs for commonly ordered items [10–13]. These studies were primarily at single institutions with only one focused on general pediatricians [10]. Our study is unique as it is the first national survey of pediatric hospitalists that examines the relationships between demographic data, cost-consciousness, and cost accuracy. Respondents reporting that cost consciousness “Always” of “Very Often” influenced their practice were more likely to have gained knowledge of national medical waste reduction initiatives from self-directed learning, outside of caring for a specific patient compared to other groups (p = 0.02, Table 3). In the overall group, over half (51.5%) obtained their knowledge outside an advanced degree or formal course, suggesting that most pediatric hospitalists learn about hospital costs on their own. This suggests that formal degrees or structured lectures may not be the most effective way to increase awareness of hospital-specific costs.
As a group, pediatric hospitalists overestimated the cost of every item in the survey, as shown by the median unit costs and percent differences (Table 4). This finding may explain why cost displays alone may not be effective [27]. When seeing that the cost display is lower than the pediatric hospitalist’s cost estimation, it may negatively affect the physician’s behavior since that item may be viewed as “less expensive” than originally thought and thus increase utilization. Further study would be needed to determine causation.
Medications had the lowest median unit cost compared to laboratory or imaging studies. The selected medications were low-cost items and inaccurate cost assignments to them led to larger percent differences (Table 4). Respondents with high levels of self-reported cost consciousness were not the most accurate, and in many instances, they had the highest percent difference (estimated cost from hospital-specific unit cost) compared to less cost-conscious groups (Table 5). Respondents with the lowest self-reported cost consciousness were statistically the most accurate regarding the cost of a complete blood count, basic metabolic panel, erythrocyte sedimentation rate and C-reactive protein. This suggests that self-perception of cost-consciousness does not translate to accurate cost estimations. Lastly, if hospital specific costs are unavailable to physicians, having national median unit costs (Table 4) may provide anchoring points for cost education, particularly for trainees and early career physicians.
Limitations
Several limitations were noted. First, survey responses were limited. Tactics were used to improve the survey response rate: clear subject line, sent from someone the respondent knows (division directors), direct link to survey, and reminder every 2 weeks [30]. We relied on division directors to distribute the survey to the appropriate individuals, which may explain why some hospitals had no responses. There is no universal contact sheet, including organizational listservs, of pediatric hospitalists. While hospital and university websites might not be current, the listed faculty were counted and led to the denominator of 1850. Our response rate might not allow findings to be generalized to all pediatric hospitals or even within some individual hospitals. Second, the general link was not user specific, thus a respondent could have completed multiple surveys. Third, not every survey was complete and survey takers may have confused cost with charge or assigned a cost for a total course of medication rather than single dose, despite survey instructions. Fourth, cost consciousness was not explicitly defined in the survey, which opens it to respondent interpretation, but that question was grouped with other questions reflecting on cost when ordering specific items. Fifth, we selected commonly ordered laboratory studies, medications, and imaging studies, so our findings may not be generalizable to other items in those categories, particularly very high-cost items. Lastly, clinical outcomes and appropriateness of ordered items were not examined.
Conclusions and future areas of research
We found no significant relationship between knowledge of national medical waste reduction initiatives and cost accuracy, which is not necessarily unexpected as national medical waste reduction initiatives are not based on knowing costs since any reduction of unnecessary interventions would reduce health care spending. Surprisingly, pediatric hospitalists overestimated cost across all domains which may lead to increased health care spending if the intervention was viewed as less expensive than originally thought. This finding may divert future studies away from cost accuracy of individual items as a way to reduce health care spending and instead focus on best practice guidelines or relative cost between similar items such as antibiotics. National median unit cost lists can be used in lieu of hospital specific cost sheets, in order to provide pediatric hospitalists the data needed to train residents and medical students about hospital costs. There remains a discordance between self-reported cost consciousness and cost accuracy; high cost-conscious respondents were the least accurate in estimating costs, which speaks to a general notion of cost rather than specific costs. Additional studies could explore other associations that translate to lasting, quantifiable reductions in health care costs and positive clinical outcomes, particularly in hospitalized pediatric patients.
Supporting information
S1 File. Cost conscioussness survey.
PDF of the on-line survey.
https://doi.org/10.1371/journal.pone.0284912.s001
(PDF)
References
- 1. Centers for Medicare & Medicaid Services. National Health Expenditure Data Historical [Internet]. 2020 [cited 2022 Nov 10]. Available from: https://www.cms.gov/Research-Statistics-Data-and-Systems/Statistics-Trends-and-Reports/NationalHealthExpendData/NationalHealthAccountsHistorical
- 2.
Committee on the Learning Health Care System in America, Institute of Medicine. Best Care at Lower Cost: The Path to Continuously Learning Health Care in America [Internet]. Smith M, Saunders R, Stuckhardt L, McGinnis JM, editors. Washington (DC): National Academies Press (US); 2013 [cited 2022 Nov 10]. Available from: http://www.ncbi.nlm.nih.gov/books/NBK207225/
- 3. Bui AL, Dieleman JL, Hamavid H, Birger M, Chapin A, Duber HC, et al. Spending on Children’s Personal Health Care in the United States, 1996–2013. JAMA Pediatr. 2017 Feb 1;171(2):181–9. pmid:28027344
- 4. Chua KP, Conti RM, Freed GL. Appropriately Framing Child Health Care Spending: A Prerequisite for Value Improvement. JAMA. 2018 Mar 20;319(11):1087–8. pmid:29482195
- 5.
American Board of Internal Medicine Foundation. Choosing Wisely [Internet]. 2014 [cited 2022 Nov 12]. Available from: https://www.choosingwisely.org/
- 6. Mangione-Smith R, Roth CP, Britto MT, Chen AY, McGalliard J, Boat TF, et al. Development and Testing of the Pediatric Respiratory Illness Measurement System (PRIMES) Quality Indicators. Hosp Pediatr. 2017 Mar;7(3):125–33. pmid:28223319
- 7. ACGME Program Requirements for Graduate Medical Education in Pediatrics [Internet]. ACGME Program Requirements for Graduate Medical Education in Pediatrics. 2022 [cited 2022 Nov 10]. Available from: https://www.acgme.org/globalassets/PFAssets/ProgramRequirements/320_Pediatrics_2020.pdf?ver=2020-06-29-162726-647&ver=2020-06-29-162726-647ducation in Pediatric
- 8. Warsame R, Riordan L, Jenkins S, Lackore K, Pacyna J, Antiel R, et al. Responsibilities, Strategies, and Practice Factors in Clinical Cost Conversations: a US Physician Survey. J Gen Intern Med. 2020 Jul 1;35(7):1971–8. pmid:32399911
- 9. Long T, Silvestri MT, Dashevsky M, Halim A, Fogerty RL. Exit Survey of Senior Residents: Cost Conscious but Uninformed. J Grad Med Educ. 2016 May;8(2):248–51. pmid:27168897
- 10. Rock TA, Xiao R, Fieldston E. General Pediatric Attending Physicians’ and Residents’ Knowledge of Inpatient Hospital Finances. Pediatrics. 2013 Jun 1;131(6):1072–80. pmid:23713110
- 11. Wei D, Osman C, Dukhovny D, Romley J, Hall M, Chin S, et al. Cost consciousness among physicians in the neonatal intensive care unit. J Perinatol. 2016 Nov;36(11):1014–20. pmid:27467561
- 12. Hakimoglu S, Hancı V, Karcıoglu M, Tuzcu K, Davarcı I, Kiraz HA, et al. Cost-Conscious of Anesthesia Physicians: An awareness survey. Pak J Med Sci. 2015 Oct;31(5):1089–94. pmid:26648992
- 13. Okike K, O’Toole RV, Pollak AN, Bishop JA, McAndrew CM, Mehta S, et al. Survey Finds Few Orthopedic Surgeons Know The Costs Of The Devices They Implant. Health Aff (Millwood). 2014 Jan;33(1):103–9. pmid:24395941
- 14. Schmitz H, Martakis K, Roth B, Pfaff H, Scholten N. Differences in cost consciousness between physicians and nurses in German neonatal intensive care units. Acta Paediatr. 2019;108(2):245–52. pmid:29953663
- 15. Lee JA, Chernick L, Sawaya R, Roskind CG, Pusic M. Evaluating Cost Awareness Education in US Pediatric Emergency Medicine Fellowships. Pediatr Emerg Care. 2012 Jul;28(7):655–75. pmid:22743747
- 16. Zikmund-Fisher BJ, Kullgren JT, Fagerlin A, Klamerus ML, Bernstein SJ, Kerr EA. Perceived Barriers to Implementing Individual Choosing Wisely® Recommendations in Two National Surveys of Primary Care Providers. J Gen Intern Med. 2017 Feb 1;32(2):210–7.
- 17. Rodrigues Mendonça D, Aguiar CVN, Lins-Kusterer L, de Oliveira RI, Menezes MS. Choosing Wisely in Pediatric Internship. Glob Pediatr Health [Internet]. 2019 Jan 1 [cited 2022 Nov 10];6. Available from: pmid:31205983
- 18. American Academy of Pediatrics. American Academy of Pediatrics | Choosing Wisely [Internet]. 2018 [cited 2022 Nov 10]. Available from: https://www.choosingwisely.org/societies/american-academy-of-pediatrics/
- 19. American Association of Public Opinion Research. Standard Definitions: Final Dispositions of Case Codes and Outcome Rates for Surveys. [Internet]. 2016 [cited 2022 Nov 10]. Available from: https://www.aapor.org/AAPOR_Main/media/publications/Standard-Definitions20169theditionfinal.pdf
- 20. Children’s Hospital Association. Leverage Clinical and Resource Utilization Data [Internet]. [cited 2022 Nov 10]. Available from: https://www.childrenshospitals.org/content/analytics/product-program/pediatric-health-information-system
- 21. Baird GS. The Choosing Wisely initiative and laboratory test stewardship. Diagnosis. 2019 Mar 1;6(1):15–23. pmid:30205639
- 22. O’Hara K, Tanverdi M, Reich J, Scudamore DD, Tyler A, Bakel LA. Qualitative Study to Understand Pediatric Hospitalists and Emergency Medicine Physicians’ Perspectives of Clinical Pathways. Pediatr Qual Saf. 2020 Apr;5(2):e270. pmid:32426636
- 23. Bejjanki H, Mramba LK, Beal SG, Radhakrishnan N, Bishnoi R, Shah C, et al. The role of a best practice alert in the electronic medical record in reducing repetitive lab tests. Clin Outcomes Res CEOR. 2018;10:611–8.
- 24. Long T, Bongiovanni T, Dashevsky M, Halim A, Ross JS, Fogerty RL, et al. Impact of laboratory cost display on resident attitudes and knowledge about costs. Postgrad Med J. 2016 Oct;92(1092):592–6. pmid:27033861
- 25.
Centers for Medicare & Medicaid Services. CMS Completes Historic Price Transparency Initiative [Internet]. 2020 [cited 2022 Nov 10]. Available from: https://www.cms.gov/newsroom/press-releases/cms-completes-historic-price-transparency-initiative
- 26. Monsen CB, Liao JM, Gaster B, Flynn KJ, Payne TH. The effect of medication cost transparency alerts on prescriber behavior. J Am Med Inform Assoc JAMIA. 2019 Apr 11;26(10):920–7. pmid:31321427
- 27. Langley T, Lacey J, Johnson A, Newman C, Subramanian D, Khare M, et al. An evaluation of a price transparency intervention for two commonly prescribed medications on total institutional expenditure: a prospective study. Future Healthc J. 2018 Oct;5(3):198–202. pmid:31098566
- 28. Kozak PM, Trumbo SP, Christensen BW, Leverenz DL, Shotwell MS, Kingeter AJ. Addition of price transparency to an education and feedback intervention reduces utilization of inpatient echocardiography by resident physicians. Int J Cardiovasc Imaging. 2019 Jul;35(7):1259–63. pmid:30850907
- 29. Leon-Carlyle M, McQuillan R, Baiu I, Sullivan A, Dukhovny D, Shah N. Assessing Student Attitudes Regarding Cost-Consciousness in Medical Education. MedEdPublish. 2019 Jan 11;8:12.
- 30. Phillips AW, Reddy S, Durning SJ. Improving response rates and evaluating nonresponse bias in surveys: AMEE Guide No. 102. Med Teach. 2016;38(3):217–28. pmid:26648511