Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Evaluation of an automated reader for disc diffusion antimicrobial susceptibility testing in a routine microbiology laboratory

  • Patricia Orlandi Barth ,

    Roles Data curation, Formal analysis, Investigation, Methodology, Writing – original draft

    patybarth@hotmail.com

    Affiliation Laboratório de Pesquisa em Resistência Antimicrobiana (LABRESIS) - Hospital de Clínicas de Porto Alegre, RS, Brasil

  • Xander Cortez Pinzas,

    Roles Investigation, Methodology, Software

    Affiliation Serviço de Pesquisa e Desenvolvimento em Engenharia Biomédica - Hospital de Clínicas de Porto Alegre, RS, Brasil

  • Vitória Torrescasana Teixeira,

    Roles Data curation, Methodology, Software

    Affiliation Serviço de Pesquisa e Desenvolvimento em Engenharia Biomédica - Hospital de Clínicas de Porto Alegre, RS, Brasil

  • Larissa Lutz,

    Roles Data curation, Formal analysis, Methodology

    Affiliation Serviço de Diagnóstico Laboratorial - Unidade de Microbiologia - Hospital de Clínicas de Porto Alegre, RS, Brasil

  • Caroline Collioni Constante,

    Roles Data curation, Formal analysis, Methodology

    Affiliation Serviço de Diagnóstico Laboratorial - Unidade de Microbiologia - Hospital de Clínicas de Porto Alegre, RS, Brasil

  • Bruno Rodriguez Tondin,

    Roles Data curation, Methodology, Software

    Affiliation Serviço de Pesquisa e Desenvolvimento em Engenharia Biomédica - Hospital de Clínicas de Porto Alegre, RS, Brasil

  • André Frotta Müller,

    Roles Data curation, Investigation, Software

    Affiliation Serviço de Pesquisa e Desenvolvimento em Engenharia Biomédica - Hospital de Clínicas de Porto Alegre, RS, Brasil

  • Danton Pereira da Silva Junior,

    Roles Data curation, Software, Supervision

    Affiliation Serviço de Pesquisa e Desenvolvimento em Engenharia Biomédica - Hospital de Clínicas de Porto Alegre, RS, Brasil

  • Paulo Roberto Stefani Sanches,

    Roles Data curation, Project administration, Software, Supervision, Writing – review & editing

    Affiliation Serviço de Pesquisa e Desenvolvimento em Engenharia Biomédica - Hospital de Clínicas de Porto Alegre, RS, Brasil

  • Afonso Luís Barth

    Roles Conceptualization, Funding acquisition, Project administration, Resources, Supervision, Writing – review & editing

    Affiliation Laboratório de Pesquisa em Resistência Antimicrobiana (LABRESIS) - Hospital de Clínicas de Porto Alegre, RS, Brasil

Abstract

Antimicrobial susceptibility testing (AST) is essential for determining the in vitro activity of antimicrobial agents against specific microorganisms. Reliable data from AST is needed for the detection of resistance mechanisms which are crucial to ensure appropriate treatment of patients in healthcare settings or in the community. Automated AST readers of the inhibition zone provide valuable tools for standardizing the testing process in microbiology laboratories, enabling faster and more reliable interpretation of results. The aim of this study was to evaluate AntibiHórus, an in-house developed automated disc diffusion AST reader, by comparing its performance against manual reading of the inhibition zones using a ruler. A total of 500 ASTs, including both Gram-negative and Gram-positive bacteria, were evaluated using 22 different antimicrobial discs, resulting in 4,709 inhibition zone measurements. Manual readings with a ruler were compared with the automated readings from AntibiHórus. The overall categorical agreement (CA) between AntibiHórus and manual reading was 96.86%, with minimal error rates, 2.08% for Very Major Errors (VME), 0.30% for Major Errors (ME), and 0.76% for Minor Errors (MiE). Statistical analysis showed a strong correlation between methods (Pearson correlation coefficient R ≥ .95). The findings demonstrate that AntibiHórus is a reliable tool for routine microbiology laboratory work, enhancing the efficiency, standardization, and accuracy of AST analysis by automating inhibition zone measurement and interpretation.

1. Introduction

Antimicrobial susceptibility testing (AST) is a technique used to assess the in vitro activity of an antibiotic against a known bacterium. Data from AST is very useful to avoid clinical failure and ensure the correct therapy is administered to patients [1]. There are several methods for performing AST, which can be categorized into quantitative techniques (such as broth microdilution, agar dilution, and agar gradient diffusion strips) that provide numerical results, and qualitative methods (such as disc-diffusion), which categorize bacteria into susceptible, susceptible dose-dependent (intermediate) or resistant categories based on interpretive criteria [13].

Disc diffusion, originally developed by William Kirby and Alfred Bauer (Kirby–Bauer method) remains one of the most widely used methods due to its simplicity, ease of execution, reproducibility, and cost-effectiveness. Additionally, this method enables simultaneous testing of multiple antimicrobial agents and is often the first choice for validating new antimicrobials in clinical practice [4,5]. The procedure is straightforward: a standardized inoculum of the bacteria (typically 0.5 McFarland) is applied onto a Mueller-Hinton agar plate, followed by placement of antimicrobial-impregnated discs on the agar surface. The plates are then incubated for 16–18 hours at 35ºC ± 2ºC. After incubation, inhibition zones are measured with a caliper or ruler and compared to established breakpoints approved by guidelines, allowing the determination of whether the tested antimicrobial is capable of inhibiting the bacteria in vitro, with the potential for in vivo efficacy [3,6].

Despite the advantages of this technique, it requires approximately 16–18 hours to generate results, which can delay the administration of antibiotics. Delays are particularly concerning when dealing with resistant microorganisms, as they are associated with poorer outcomes, including prolonged hospital stays, increased healthcare costs, and higher mortality rates [7]. To address this challenge, automated AST systems can generate reliable results which would help the use of effective antimicrobial therapy, potentially improving patient outcomes [8]. Several commercial systems (e.g., SIRscan, ADAGIO, and WASPLab® Radian) have been evaluated in recent studies, showing high categorical agreement compared to manual reading and the potential for integration into automated laboratory workflows. However, these systems are often associated with high acquisition and maintenance costs, reliance on proprietary software, and limited accessibility in resource-constrained settings [912].

In response to this need, we have developed “AntibiHórus”, an automated disc-diffusion AST reader designed for routine use in microbiology laboratories. This system is capable of measuring and interpreting antimicrobial inhibition zones in a more standardized manner, minimizing human error, and accelerating AST interpretation and report release to clinicians. The primary objective of this study was to evaluate the performance of AntibiHórus by comparing its measurements and interpretations with conventional manual readings.

2. Materials and methods

2.1. AntibiHórus device

AntibiHórus was equipped with a Basler puA2500-14um camera (Ahrensburg, Germany) designed for industrial vision applications, featuring a high-resolution 5-megapixel sensor (2592 x 1944 pixels). The camera was positioned inside a light-controlled chamber (Fig 1a) to ensure consistent imaging conditions. For optimal illumination, a concentric white LED strip was installed surrounding the Petri dish position (Fig 1b), providing uniform lighting essential for accurate inhibition zone measurement. To ensure precise positioning of culture plates during analysis, we implemented a drawer system that maintained the Petri dish in a fixed position relative to the camera (Fig 1c). This component also housed the USB connection interface linking the device to the computer workstation. The entire device architecture was first developed as a three-dimensional digital model, which was subsequently fabricated using additive manufacturing technology (3D printing) to create the functional prototype shown in Fig 1d.

thumbnail
Fig 1. a) Visualization of the camera on the device, b) LED strip holders, c) Assembled device overview, d) Three dimensional model.

https://doi.org/10.1371/journal.pone.0347932.g001

The AntibiHórus software captures high-resolution images of the agar plates, processes them using a specialized algorithm to identify disc positions and inhibition zone boundaries, precisely measures zone diameters, and automatically interprets results based on established breakpoints for each antimicrobial agent (Fig 2). In order to determine the halo diameter, the antibiotic disc positions were first accurately located within the image using the Hough Transform [13]. This provided a crucial spatial reference for the subsequent measurement phase. To overcome complexities such as variable halo shapes and lighting conditions, the image was then segmented. We employed the MiniBatchKMeans algorithm [14] to cluster the image pixels into three distinct classes: bacteria, the antibiotic disc, and the inhibition halo. Finally, the halo diameter for each antibiotic was estimated by applying the Radial Profile Analysis Algorithm (RPAA) [15] to the segmented regions centered on the discs.

thumbnail
Fig 2. Measurement of halos (diameters) of inhibition and interpretation of results by the AntibiHórus software.

S = Susceptible standard dosing, I = Susceptible increased exposure and R = Resistant. Values in the third column indicate the antibiotic concentration per disc (µg), while values in the fourth column represent the inhibition zone diameter measured in millimeters (mm).

https://doi.org/10.1371/journal.pone.0347932.g002

2.2. Selection of Isolates

The study was conducted at the Microbiology Laboratory of Hospital de Clínicas de Porto Alegre (HCPA), an 860-bed tertiary care hospital in southern Brazil. Bacterial isolates subjected to AST with at least eight antibiotic discs (Mueller–Hinton agar, 180 mm) between May 2023 and March 2024 were conveniently selected for comparison between methods. All isolates were identified using Matrix Assisted Laser Desorption Ionization Time of Flight (MALDI-TOF, Biomerieux®). Additional information regarding the isolates and their susceptibility profiles is provided in Supplementary Materials 1–5.

2.3. Comparison of Antibihórus versus manual reading

The ASTs followed the procedures outlined by the European Committee on Antimicrobial Susceptibility Testing (EUCAST) standard guidelines [3]. Agar Mueller-Hinton plates (180 mm) containing between 8 and 12 antibiotic discs (Oxoid®) were analyzed. A total of 500 isolates, including both Gram-negative and Gram-positive bacteria, were tested with 22 antibiotics.

The ASTs were divided into five templates routinely used by the laboratory (Table 1). These templates are designated by internal codes (TU, B, C + , NF, TH), which do not represent acronyms but are internal codes adopted by the laboratory to select the antibiotics which are routinely applied to specific groups of microorganisms and clinical specimens. The templates are defined as follows:

thumbnail
Table 1. 500 AST’s evaluated into five templates. AMC = amoxicillin/clavulanate; GEN = gentamicin, PTZ = piperacillin/tazobactam; NIT = nitrofurantoin; NOR=norfloxacin; SAM = ampicillin/sulbactam; STX = trimethoprim/sulfamethoxazole; AK = Amikacin; MER = Meropenem; CXM = Cefuroxime; CAZ = Ceftazidime; CEF = Cefepime; CIP = Ciprofloxacin; AMP = Ampicillin; CLI = clindamycin; ERY = Erythromycin; DOX = Doxycycline; RIF = Rifampicin; FOX = Cefoxitin; LEV = Levofloxacin; AZT = Aztreonam; TOB = Tobramycin.

https://doi.org/10.1371/journal.pone.0347932.t001

  • TU: Isolates of Enterobacterales obtained from urinary tract infections with 12 antibiotics.
  • B: Isolates of Enterobacterales from other clinical samples with 12 antibiotics.
  • C + : Isolates of Staphylococcus species from a variety of clinical samples with 8 antibiotics.
  • NF: Isolates of Gram-negative rods Non-fermenters from a variety of clinical samples with 11 antibiotics.
  • TH: Isolates of Enterobacterales from bloodstream infections with 9 antibiotics.

The agar plates were read manually using a ruler (reference method) and also automatically using AntibiHórus, at the same time, both after 16–18 hours of incubation. Although the system allows manual adjustment of inhibition zone measurements, we maintained all original automated readings unmodified throughout the study in order to evaluate the performance of the system without human intervention. The interpretation of AST results was performed according to EUCAST guidelines [3].

2.4. Data analysis

Comparison of results were classified according to the International Organization for Standardization as Categorical Agreement (CA) which indicates the number of isolates grouped in the same susceptibility category (susceptible or resistant) in both methods. Results of non agreement were classified as Very Major Errors (VME) when isolates were considered susceptible by the AntibiHórus and resistant by the manual reading, and as Major Errors (ME) when isolates were categorized as resistant by the AntibiHórus and susceptible in manual reading. Isolates categorized as resistant or susceptible by AntibiHórus and intermediate by manual reading were categorized as Minor Errors (MiE) [16]. Also, the means of Pearson correlation were calculated for each template.

The ethical approval was given by Porto Alegre Clinics Hospital Ethics Committee under the number CAAE 79471617000005327, and it was exempted from the consent form by the ethics committee as the study did not involve human beings, only bacterial isolates.

3. Results

A total of 500 ASTs of 39 bacterial species were submitted to both methods and 4,709 halos (diameters) of inhibition were analyzed. The overall CA was 96.86%, with 2.08% of VME, 0.30% of ME and 0.76% of MiE (Table 2). The overall comparison between the manual readings (reference) with the readings by AntibiHorus yielded a Pearson correlation coefficient between R = 0.95 and R = 0.98 (Fig 3). The comparison between the methods for each isolate is submitted in Supplementary Material.

thumbnail
Table 2. Errors of concordance between manual and automated (AntibiHórus) readings of the AST. VME: Very Major Error; ME: Major Error; MiE: Minor Error.

https://doi.org/10.1371/journal.pone.0347932.t002

thumbnail
Fig 3. Pearson correlation between manual readings (reference method) and AntibiHórus measurements of the AST by the disc diffusion for each template.

https://doi.org/10.1371/journal.pone.0347932.g003

4. Discussion

AST by the disc diffusion technique is a simple and reliable method that presents low-cost. This technique is the most common method to determine the susceptibility of antibiotics in vitro used worldwide, and it is considered the gold standard for detecting several resistance mechanisms [4,17]. However, the reading of the inhibition zones can be affected by the inherent visual error of the reader, emphasizing the need for standardization of the method. To address this, several automated systems have been developed and evaluated over the past decades to streamline and enhance the speed and reliability of AST interpretation [1821]. Similarly, our institution developed an in-house automated disc diffusion reader named AntibiHórus, capable of reading and interpreting the inhibition zone diameters of the AST using a built-in camera and a user-friendly interface. AntibiHórus was projected with low-cost and widely available components, which facilitates implementation in resource-limited laboratories; an adaptable software pipeline that can be rapidly updated according to EUCAST breakpoint changes; and a compact and straightforward design that allows incorporation into routine workflows without the need for complex infrastructure.

In this study, we evaluated the ability of AntibiHórus to read inhibition zones by the disc diffusion methodology and interpret AST results. Thirty-nine bacterial species, including both Gram-negative and Gram-positive bacteria, were tested with 22 different antibiotics, resulting in 4,709 isolate-antibiotic combinations. The performance of AntibiHórus yielded excellent results, with only 0.76%, 0.30%, and 2.08% of MiE, ME, and VME, respectively. It is important to note that when excluding results in which the difference between the automated reading and the manual ruler measurement was 1 mm – an intrinsic variability of the disk diffusion method that also affects human interpretation – the VME rate would decrease to 1.5%, thereby meeting ISO performance criteria [16]. It is also worth emphasizing that the instrument allows manual adjustment of inhibition zone diameters. However, in the present study, we deliberately chose to evaluate the system’s performance without human intervention in order to more accurately assess its intrinsic analytical capability.

Noteworthy, the AntibiHórus software was designed to interpret halos according to EUCAST guidelines, and the breakpoints can be updated whenever necessary. Additionally, the system is designed to identify intrinsic resistance, which aids the operator in reviewing the results and contributes to more reliable and faster outcomes compared to conventional manual reading. Furthermore, the data generated by AntibiHórus can be saved for future reference and comparison purposes.

Based on the experimental results shown in this study, we conclude that the AntibiHórus system stands out for its excellent evaluation metrics and reliable performance. By streamlining and automating the analysis of inhibition zones, the software has demonstrated high accuracy, as evidenced by the strong correlation coefficient achieved compared to the conventional method. Its intuitive interface and adaptability to various antibiotic discs and microorganism species further enhance its usability, offering fast and accurate results. AntibiHórus proved to be a valuable tool for healthcare professionals and laboratories, assisting in clinical decision-making and contributing to the fight against antimicrobial resistance. This study was designed to evaluate the performance of an in-house automated disk-diffusion reader that has been implemented in our routine diagnostic laboratory. While the device was not initially conceived for broad distribution, we are available to collaborate with laboratories interested in developing or adapting similar equipment for local use. Such collaborations may foster independent validation and contribute to the dissemination of affordable automated AST solutions.

Supporting information

S1 File. Comparison between manual reading versus AntibiHórus – Template B.

https://doi.org/10.1371/journal.pone.0347932.s001

(XLSX)

S2 File. Comparison between manual reading versus AntibiHórus – Template TU1.

https://doi.org/10.1371/journal.pone.0347932.s002

(XLSX)

S3 File. Comparison between manual reading versus AntibiHórus – Template C

+.

https://doi.org/10.1371/journal.pone.0347932.s003

(XLSX)

S4 File. Comparison between manual reading versus AntibiHórus – Template NF.

https://doi.org/10.1371/journal.pone.0347932.s004

(XLSX)

S5 File. Comparison between manual reading versus AntibiHórus – Template TH.

https://doi.org/10.1371/journal.pone.0347932.s005

(XLSX)

References

  1. 1. Kuper KM, Boles DM, Mohr JF, Wanger A. Antimicrobial susceptibility testing: a primer for clinicians. Pharmacotherapy. 2009;29(11):1326–43. pmid:19857149
  2. 2. Wenzler E, Maximos M, Asempa TE, Biehle L, Schuetz AN, Hirsch EB. Antimicrobial susceptibility testing: An updated primer for clinicians in the era of antimicrobial resistance: Insights from the Society of Infectious Diseases Pharmacists. Pharmacotherapy. 2023;43(4):264–78. pmid:36825480
  3. 3. European Committee on Antimicrobial Susceptibility Testing EUCAST. Breakpoint tables for interpretation of MICs and zone diameters. 2024. https://www.eucast.org
  4. 4. Bauer AW, Kirby WM, Sherris JC, Turck M. Antibiotic susceptibility testing by a standardized single disk method. Am J Clin Pathol. 1966;45(4):493–6. pmid:5325707
  5. 5. Jorgensen JH, Ferraro MJ. Antimicrobial susceptibility testing: general principles and contemporary practices. Clin Infect Dis. 1998;26(4):973–80. pmid:9564485
  6. 6. Matuschek E, Brown DFJ, Kahlmeter G. Development of the EUCAST disk diffusion antimicrobial susceptibility testing method and its implementation in routine microbiology laboratories. Clin Microbiol Infect. 2014;20(4):O255-66. pmid:24131428
  7. 7. Bonine NG, Berger A, Altincatal A, Wang R, Bhagnani T, Gillard P, et al. Impact of Delayed Appropriate Antibiotic Therapy on Patient Outcomes by Antibiotic Resistance Status From Serious Gram-negative Bacterial Infections. Am J Med Sci. 2019;357(2):103–10. pmid:30665490
  8. 8. Buehler SS, Madison B, Snyder SR, Derzon JH, Cornish NE, Saubolle MA, et al. Effectiveness of Practices To Increase Timeliness of Providing Targeted Therapy for Inpatients with Bloodstream Infections: a Laboratory Medicine Best Practices Systematic Review and Meta-analysis. Clin Microbiol Rev. 2016;29(1):59–103. pmid:26598385
  9. 9. Callebaut K, Stoefs A, Emmerechts K, Vandoorslaer K, Wybo I, De Geyter D, et al. Evaluation of Automated Disk Diffusion Antimicrobial Susceptibility Testing Using Radian® In-Line Carousel. Curr Microbiol. 2024, 30;81(7):196.
  10. 10. Payen M, Gaudart A, Legueult K, Kasprzak J, Emery A, Mutambayi G, et al. Evaluation of an Antibiotic Susceptibility Testing Method on Enterobacterales-Positive Blood Cultures in Less Than 8 h Using the Rapid Mueller-Hinton Diffusion Method in Conjunction with the SIRscan 2000 Automatic Reading Device. Microorganisms. 2022;10(7):1377. pmid:35889096
  11. 11. Hombach M, Jetter M, Blöchliger N, Kolesnik-Goldmann N, Böttger EC. Fully automated disc diffusion for rapid antibiotic susceptibility test results: a proof-of-principle study. J Antimicrob Chemother. 2017;72(6):1659–68. pmid:28333189
  12. 12. Humphries RM, Kircher S, Ferrell A, Krause KM, Malherbe R, Hsiung A, et al. The Continued Value of Disk Diffusion for Assessing Antimicrobial Susceptibility in Clinical Laboratories: Report from the Clinical and Laboratory Standards Institute Methods Development and Standardization Working Group. J Clin Microbiol. 2018;56(8):e00437-18. pmid:29743302
  13. 13. Duda RO, Hart PE. Use of the Hough transformation to detect lines and curves in pictures. Commun ACM. 1972;15(1):11–5.
  14. 14. Culley D. Web-scale k-means clustering. In: Proceedings of the 19th international conference on Worldwide web. 2010. 1177–8.
  15. 15. Hejblum G, Jarlier V, Grosset J, Aurengo A. Automated interpretation of disk diffusion antibiotic susceptibility tests with the radial profile analysis algorithm. J Clin Microbiol. 1993;31(9):2396–401. pmid:8408562
  16. 16. International Organization for Standardization. ISO 20776-1: Clinical laboratory testing and in vitro diagnostic test systems – susceptibility testing of infectious agents and evaluation of performance of antimicrobial susceptibility test devices – part 1: Reference method for testing the in vitro activity of antimicrobial agents against rapidly growing aerobic bacteria involved in infectious diseases. Geneva: ISO. 2006.
  17. 17. Garrec H, Drieux-Rouzet L, Golmard J-L, Jarlier V, Robert J. Comparison of nine phenotypic methods for detection of extended-spectrum beta-lactamase production by Enterobacteriaceae. J Clin Microbiol. 2011;49(3):1048–57. pmid:21248086
  18. 18. Strauss M, Zoabi K, Sagas D, Reznik-Gitlitz B, Colodner R. Evaluation of Bio-Rad® discs for antimicrobial susceptibility testing by disc diffusion and the ADAGIO™ system for the automatic reading and interpretation of results. Eur J Clin Microbiol Infect Dis. 2020;39(2):375–84. pmid:31720945
  19. 19. Idelevich EA, Becker K, Schmitz J, Knaack D, Peters G, Köck R. Evaluation of an Automated System for Reading and Interpreting Disk Diffusion Antimicrobial Susceptibility Testing of Fastidious Bacteria. PLoS One. 2016;11(7):e0159183. pmid:27391898
  20. 20. Medeiros AA, Crellin J. Evaluation of the Sirscan automated zone reader in a clinical microbiology laboratory. J Clin Microbiol. 2000;38(4):1688–93. pmid:10747172
  21. 21. Kolbert M, Chegrani F, Shah PM. Evaluation of the OSIRIS video reader as an automated measurement system for the agar disk diffusion technique. Clin Microbiol Infect. 2004;10(5):416–20. pmid:15113318