Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Retrospective and prospective evaluation of the Carbapenem inactivation method for the detection of carbapenemase-producing Enterobacteriaceae

  • Lauraine Gauthier,

    Affiliation Bactériologie-Hygiene unit, APHP, Bicêtre Hospital, EA7361 “Structure, dynamic, function and expression of broad spectrum β-lactamases”, Paris-Sud University, LabEx Lermit, Faculty of Medecine, French National Reference Center for Antibiotic Resistance: Carbapenemase producing Enterobacteriaceae, Le Kremlin-Bicêtre, France

  • Remy A. Bonnin,

    Affiliation Bactériologie-Hygiene unit, APHP, Bicêtre Hospital, EA7361 “Structure, dynamic, function and expression of broad spectrum β-lactamases”, Paris-Sud University, LabEx Lermit, Faculty of Medecine, French National Reference Center for Antibiotic Resistance: Carbapenemase producing Enterobacteriaceae, Le Kremlin-Bicêtre, France

  • Laurent Dortet,

    Affiliation Bactériologie-Hygiene unit, APHP, Bicêtre Hospital, EA7361 “Structure, dynamic, function and expression of broad spectrum β-lactamases”, Paris-Sud University, LabEx Lermit, Faculty of Medecine, French National Reference Center for Antibiotic Resistance: Carbapenemase producing Enterobacteriaceae, Le Kremlin-Bicêtre, France

  • Thierry Naas

    thierry.naas@aphp.fr

    Affiliation Bactériologie-Hygiene unit, APHP, Bicêtre Hospital, EA7361 “Structure, dynamic, function and expression of broad spectrum β-lactamases”, Paris-Sud University, LabEx Lermit, Faculty of Medecine, French National Reference Center for Antibiotic Resistance: Carbapenemase producing Enterobacteriaceae, Le Kremlin-Bicêtre, France

Abstract

Background

There is an urgent need for accurate and rapid diagnostic tests to identify carbapenemase producing enterobacteria (CPE). Here, we have evaluated the Carbapenem Inactivation Method (CIM) test to detect CPEs from cultured colonies.

Methods

A total of 256 enterobacterial isolates were used to evaluate the performance of the CIM in comparison to Carba NP test and molecular detection used a reference method. Ninety three well-characterized isolates (including 29 non-CPE and 63 CPEs of worldwide origin) with decreased susceptibility to at least one carbapenem were used to (i) evaluate the efficacy of CIM test and (ii) to compare it to the Carba NP test. We also tested different carbapenems to determine the best substrate for this test. Finally, the CIM test was then evaluated prospectively against 164 isolates referred to the French National Reference Center (NRC) for Antimicrobial Resistance from may 2016 to july 2016.

Results

Based on the results of this retrospective study, sensitivity and specificity of the CIM and the Carba NP test were 92.1% and 100%, respectively. We demonstrated that the meropenem was the best substrate to perform the CIM test since sensitivity and specificity were 81.1% and 100% using ertapenem disk, and 100% and 65,6% using imipenem disk, and respectively. Taking in account the results of retrospective and prospective studies, CIM and Carba NP tests have similar sensitivity, specificity, positive predictive value and negative predictive values being 96.3%, 98.9%, 99.0% and 98.4% for the CIM test versus 96.9%, 100%, 100% and 100% for the Carba NP test.

Conclusions

Our results confirm that the CIM test may be a useful tool for the reliable confirmation of carbapenemase-activity in enterobacterial isolates, especially in clinical microbiological laboratories with limited resources, no trained personnel, and no specialized equipment.

Introduction

Carbapenemase producers are increasingly reported worldwide in Enterobacteriaceae [1]. They are most often resistant to many classes of antimicrobial molecules, and thus represent a major public health concern. Their identification is of primary importance for the choice of appropriate therapeutic schemes and the implementation of proper infection control measures [1,2]. Identification based solely on antibiotic susceptibility testing is not easy and a recently described algorithm, showed that at least 66% of Enterobacteriaceae with a reduced susceptibility at least one carbapenem required confirmatory testing [3]. Thus, reliable and simple confirmatory tests are required.

Many phenotypic or advanced molecular-based methods have been proposed for the detection of carbapenemase production. The phenotypic confirmation tests for detecting carbapenemases include inhibition tests of carbapenemase activity [4], detection of carbapenem hydrolysis using MALDI-TOF MS [5], biochemical tests (e.g. Carba NP Test and derivatives) [68] or electrochemical measurement (BYG test; [9]). These tests are able to detect the presence of a carbapenemase activity and sometimes to discriminate between Ambler class A and Ambler class B carbapenemases (e.g inhibition tests and Carba NP test II; [10]). A new immunochromatographic assay, called OXA-48 K-SeT and OXA-48/KPC K-SeT, aiming to detect OXA-48-like carbapenemase producing enterobacteria (CPE) or OXA-48 and KPC variants, respectively from solid cultures has also been shown to be very useful especially in settings with high OXA-48 prevalence [11,12]. However, the gold standard remains molecular methods for the detection of CPE-producers [2,1315].

The recently described Carbapenem Inactivation Method (CIM) has been developed as a phenotypic technique for detecting carbapenemase activity from bacterial culture [16]. It was reported to be 100% sensitive and specific for CPE detection. In addition, it does not require trained personnel or specific equipment, and is cost-effective. We compared the performances of the CIM test for detection of CPE with those of the Carba NP test used as reference (systematically tested on isolates referred to the NRC) against various Enterobacteriaceae, including combinations of bacterial/resistance mechanisms that were not previously evaluated.

Materials and methods

Bacterial isolates

A total of 256 enterobacterial isolates were used to evaluate the performance of the CIM test [16] in comparison with a home-made technique of the Carba NP test [6]. 92 strains had previously been characterized for their β-lactamase content at the molecular level. This collection included 29 non-carbapenemase producers with decreased susceptibility to at least one carbapenem molecule (imipenem, meropenem, or ertapenem) and 63 were CPEs originating from our strain collection (Tables 1 and 2). These CPEs included 25 OXA-48 producers, 5 KPC producers, 12 NDM producers, 7 VIM producers, 5 IMP producers, 3 IMI producers, 2 SME producers, 1 GES-5 producer, 1 GIM-1 producer, 1 FRI-1 producer and 1 NMC-A producer. The CIM test was then evaluated prospectively against 164 Carbapenem Resistant Enterobacterial isolates (CREs) (decreased susceptibility to at least one carbapenem molecule) referred to the French National Reference Center for Antimicrobial Resistance from 15 March 2016 to 15 April 2016 (Table 3).

thumbnail
Table 1. Carbapenemase-producing Enterobacteriaceae subjected to the CIM method, compared to the Carba NP test.

https://doi.org/10.1371/journal.pone.0170769.t001

thumbnail
Table 2. Non–carbapenemase-producing enterobacteriaceae subjected to the CIM method, compared to the CarbaNP test.

https://doi.org/10.1371/journal.pone.0170769.t002

thumbnail
Table 3. Enterobacteriaceae isolates prospectively subjected to the CIM method, compared to the CarbaNP test.

https://doi.org/10.1371/journal.pone.0170769.t003

Antimicrobial susceptibility testing

Antimicrobial susceptibility testing using disc diffusion method and minimal inhibitory concentrations (MICs) using the E-test technique (bioMérieux, Marcy L’Etoile, France) were determined on Mueller-Hinton (MH) agar (Bio-Rad, Marnes-La-Coquette, France), and interpreted according to EUCAST guidelines, as updated in 2016 (http://www.eucast.org). Clinical carbapenem breakpoints for susceptibility/resistance were ≤ 2/>8 mg/l for imipenem and meropenem and ≤0,5/>1 mg/l for ertapenem.

Carbapenemase activity testing

The updated version of the Carba NP test was used and interpreted as previously described [6]. The test was performed on bacterial colonies recovered from UriSelect® 4 medium (Biorad, Marne La Coquette, France). Reading was performed after 2 h as recommended [3].

The CIM was performed using meropenem disks (Oxoid, Dardilly, France) as decribed [16], with overnight solid cultures. Briefly, the CIM is based on in vitro inactivation of the meropenem contained in a 10μg charged disk by carbapenemase-producing strains. This disk is placed in 400 μl bacterial suspension for 2h and susequently placed on a plate inoculated with a bacterial suspension of E. coli ATCC 29522, a carbapenem-susceptible strain. If the tested isolate produces a carbapenemase, the susceptible strain may grow contact to the disk. On the opposite, if the tested bacteria had decreased susceptibility to carbapenems without carbapenemase activity, an inhibition zone around the disk can be evidenced. In order-to determine the best carbapenem to use in this assay, we have also tested imipenem and ertapenem disks using the same protocol on the 92 well-characterized isolates. When false-negative or false-positive results were obtained either with the CIM or the Carba NP test, the two phenotypic methods were repeated in triplicate. If discrepancy was still observed, false positive isolates underwent whole genome sequencing, in order-to rule out the possibility of a carbapenemase that is not detect using our in-house PCR approach.

Molecular identification of the carbapenemase gene

The CIM and the Carba NP test results were compared with those obtained using an in-house PCR-sequencing that was used as the gold standard [17]. The targeted carbapenemase genes were blaOXA-48-like, blaKPC-like, blaNDM-like, blaIMP-like and blaVIM-like, blaIMI-like and blaGES-like. Total DNA was extracted from colonies using the Ultraclean Microbial DNA Isolation Kit (MO BIO Laboratories, Ozyme, Saint-Quentin, France) following the manufacturer’s instructions. Specific primers were used to detect the most common carbapenemase genes [17]. both strands of the PCR products were sequenced with an automated Applied Biosystems sequencer (ABI PRISM 3100, Applied Biosystems, Les Ulis, France). The nucleotide and the deduced protein sequences were analysed using software available on the β-lactamase database (BLDB; http://www.bldb.eu).

Results

Retrospective evaluation on the strain collection

The CIM test was first evaluated on 92 characterized strains (Tables 1 and 2). We have deliberately included strains producing OXA-48-like enzymes for which the Carba NP test gave a false negative result, as it is a common criticism [1820], and some CPE with low carbapenemase activity. Based on the results of this retrospective study, sensitivity and specificity of the CIM and the Carba NP test were 92.1% [confidence interval 95% (CI95) = 82.7%-96.6%] and 100% [CI95 = 88.7%-100%], respectively.

All non-carbapenemase producers (n = 29) were negative using both phenotypic methods (Table 2), even though they had high MICs for carbapenems. The only discrepancy was a K. oxytoca with overexpressed OXY-2-3 initially CIM-positive, but the analysis was repeated and CIM was negative the second and the third time.

All class A (IMI-1/2, KPC-2/3, GES-5, NMC-A, SME-1/2 and FRI-1) and OXA-48-like carbapenemases were detected by the CIM test. Of note 5 OXA-48 like enzymes (3 OXA-244 and 2 OXA-181), which gave uncertain or false-negative results with the Carba NP test were positive for the CIM. On the other hand, the CIM did not detect 3 NDM-1-producing Enterobacteriaceae (1 K. pneumoniae, 1 P. stuartii and 1 P. rettgeri), which were repeatedly negative for the CIM, while the Carba NP test was positive. Similarly, a VIM-1-producing P. mirabilis isolate was also repeatedly negative for the CIM and positive for the Carba NP test. Finally, a VIM-2-producing E. cloacae isolate with very low carbapenemase activity, with MICs for Imipenem and Meropenem remaining in the susceptibility range, was negative by both methods.

Evaluation of the best substrate for the CIM test

In order-to evaluate whether higher sensitivity and specificity may be obtained changing the carbapenem substrate, we have tested ertapenem and imipenem disks (Tables 1 and 2). Based on the results of this retrospective study, sensitivity and specificity were 81.1% [CI95 = 70.0%-88.8%] and 100% [CI95 = 88.7%-100%] using ertapenem disk, and 100% [CI95 = 94.3%-100%] and 65.6% [CI95 = 47.3%-80%] using imipenem disk, and respectively.

Although, the sensitivity reached 100%, an increase of the false-negative results was observed using the ertapenem disk compared to the meropenem. Additive false negative results were obtained for 4 VIM producers and 5 OXA-48-like producers.

Use of imipenem increased the sensitivity to 100% (vs 92.1% with the meropenem disk) but the specificity decreased to 65.6% (vs 100% with either meropenem or ertapenem disks). In addition, in some CIM-negative isolates, microcolonies were detected in the inhibitory diameter (5/19 isolates), making interpretation difficult (Fig 1C). False positive results were especially observed with AmpC over-producers (4/7), as already reported [16].

thumbnail
Fig 1.

A: OXA-48 producing E. coli, CIM positive; B: CTX-M15 producing K. pneumoniae, CIM negative; C: Overexpressed cephalosporinase + CTX-M-15 producing E. cloacae, CIM negative, presence of microcolonies in the inhibitory diameter of imipenem disk. ETP: Ertapenem; IPM: Imipenem; MEM: Meropenem

https://doi.org/10.1371/journal.pone.0170769.g001

In the light of these results, meropenem disk and absence / presence of an inhibition zone remains the best interpretation criteria.

Prospective analysis

Among the 164 consecutive Enterobacteriaceae isolates tested prospectively, 100 were CPE (59 OXA-48-like, 6 KPC, 20 NDM, 2 OXA-48-like + NDM, 5 VIM, 2 GES-5, 4 IMI and 2 IMP) while 64 were confirmed as non-carbapenemase producers using Carba NP test, and subsequent PCR, used as reference method (Table 3). One false negative and one false positive results were obtained with CIM, a NDM-1-producing K. pneumoniae and a C. freundii overexpressing its naturally-occurring cephalosporinase, respectively. On this prospective collection the Carba NP was 100% specific and 100% sensitive. Isolates with false positive results as compared to PCR results, were sequenced entirely. It allowed us to rule out the presence of a carbapenemase that was not detected using our PCR assay (data not shown).

According to this prospective study, CIM has a sensitivity value of 99.0% [CI95 = 94.6%-99.8%], a specificity value of 98.4% [CI95 = 91.7%-99.7%], a positive predictive value (PPV) value of 99.0% [CI95 = 94.6%-99.8%] and a nagative predictive value (NPV) value of 98.4% [CI95 = 91.7%-99.7%], compared to the Carba NP test which has 100% sensitivity, specificity, PPV and NPV.

Taking into account the results of the retrospective and the prospective study CIM test and Carba NP test have quite similar performances. Sensitivity was 96.3% [CI95 = 92.2%-98.3%] for the CIM test versus 96.9% [CI95 = 93.0%-98.7%] for the Carba NP test, and the specificity was 98.9% specificity [CI95 = 94.2%-99.8%] for the CIM test versus 100% [CI95 = 96.1%-100%] for the Carba NP test. Since NPV and PPV can be calculated only with the prospective results, the Carba NP test performed slightly better than the CIM test with 100% PPV and NPV compare to 99.0% and 98.4% for the CIM test.

Discussion

Overall, our results indicate that the CIM has high sensitivity and specificity for CPE detection, as already reported [6,7]. It has significant advantages shared by the CarbaNP test being low cost and simplicity of implementation. In addition, it is very easy to interpret, the indicator E. coli strain grows directly contact to the meropenem disk (inhibitory diameter = 6 mm) with isolates having a carbapenemase activity, while a clear inhibition zone (most often > 20 mm) is obtained with non-carbapenemase producers. This ease of interpretation is a major advantage over the CarbaNP test, for which the colour change may be difficult to appreciate for non-experienced personal [1820]. In addition, the CIM was positive for OXA-48 like producing isolates, which gave false-negative results with the Carba NP test. This is a particularly interesting point since these OXA-type carbapenemases may be phenotypically difficult to detect when no other β-lactamases are associated.

However, we did not find a 100% sensitivity as claimed by van der Zwaluw et al. [16]. Particularly, false-negative results were obtained with NDM-1 producing strains. Another study from Turkey also found a 100% sensitivity [21], but only one NDM-1-producing strain was included. The prevalence of NDM-1 is increasing in many European countries [22,23], and especially in France, where 15% of the CPE at the French NRC are NDM-like producers (in contrast to 4% in 2012) (T. Naas, personal comm.).

The main disadvantage of the CIM test resides in the need for two-hours incubation and a subsequent overnight culture. Although, it was reported that CIM was able to detect carbapenemase activity within eight hours [16], we found that the test was not interpretable within this time frame (data not shown). Accordingly, the CIM test is not a rapid detection assay of CPE, since results are not obtained the same day. In comparison, the CarbaNP test provides results within two hours, but in many cases (e.g. KPC, MBLs) positivity can be obtained after less than 15 minutes. Furthermore, the CIM test needs the handling of highly concentrated bacterial suspensions, and manipulation of contaminated antibiotic disks with iron tweezers. This implies thorough decontamination of the material to avoid cross-contamination.

In conclusion, we have confirmed that the CIM test might be a cheap and useful tool for the reliable confirmation of carbapenemase-producing Enterobacteriaceae, especially in clinical microbiological laboratories with limited resources, no trained personnel, and no specialized equipment to detect carbapenemase activity. Zwaluw et al also reported high performance of the CIM on non-fermenters (98,8% sensitivity), which has not been yet confirmed by other studies but might be of interest in the light of results on Enterobacteriaceae.

This test is really inexpensive since 5X50 meropenem disks cost c.a. $12 and only one is necessary to test a bacteria and one MH TSA plate, thus a single test cost about 0.048 $ + 0.43 $ thus c.a. 0.45 USD. Moreover, no additional reagents are required for this test.The in-house method of the CarbaNP test is cheap as well but requires more equipment/reagent (PH meter, Red Phenol, buffers, imipenem powder, etc..) and its cost was estimated about???. Most often, microbiological laboratories use the commercially available CarbaNP test test, which is more expensive (RAPIDEC (®) CARBA NP (bioMérieux) costs c.a. 7$ tests). The limitation of the CIM in term of clinical performance is the delay in obtaining the result after isolation of a bacterial colony, which is not compatible with rapid implementation of proper infection control measures, such as reinforced contact precautions, or cohorting of colonized/infected patients. Nevertheless, this test could be performed in parallel to a classical antibiogram on any bacteria growing on CPE screening selective media. Thus, the CIM test result would be available at the same time as the antibiogram. This test has the potential to be used a confirmatory test in many settings were novel, and expensive commercially detection tests are not available. Finally, molecular confirmatory tests are necessary to identify the carbapenemase-producing genes, and to validate the CIM-positive results.

Author Contributions

  1. Conceptualization: LG RAB LD TN.
  2. Funding acquisition: TN.
  3. Investigation: LG.
  4. Methodology: LG RAB LD TN.
  5. Project administration: TN.
  6. Resources: TN.
  7. Supervision: RAB TN.
  8. Validation: LG RAB TN.
  9. Visualization: LG.
  10. Writing – original draft: LG RAB LD TN.
  11. Writing – review & editing: LG RAB LD TN.

References

  1. 1. Nordmann P, Naas T, Poirel L. Global spread of Carbapenemase-producing Enterobacteriaceae. Emerg Infect Dis. 2011;17: 1791–1798. pmid:22000347
  2. 2. Hrabák J, Chudáčková E, Papagiannitsis CC. Detection of carbapenemases in Enterobacteriaceae: a challenge for diagnostic microbiological laboratories. Clin Microbiol Infect Off Publ Eur Soc Clin Microbiol Infect Dis. 2014;20: 839–853.
  3. 3. Dortet L, Cuzon G, Plésiat P, Naas T. Prospective evaluation of an algorithm for the phenotypic screening of carbapenemase-producing Enterobacteriaceae. J Antimicrob Chemother. 2016;71: 135–140. pmid:26462984
  4. 4. Tsakris A, Poulou A, Bogaerts P, Dimitroulia E, Pournaras S, Glupczynski Y. Evaluation of a new phenotypic OXA-48 disk test for differentiation of OXA-48 carbapenemase-producing Enterobacteriaceae clinical isolates. J Clin Microbiol. 2015;53: 1245–1251. pmid:25653401
  5. 5. Lasserre C, De Saint Martin L, Cuzon G, Bogaerts P, Lamar E, Glupczynski Y, et al. Efficient Detection of Carbapenemase Activity in Enterobacteriaceae by Matrix-Assisted Laser Desorption Ionization-Time of Flight Mass Spectrometry in Less Than 30 Minutes. J Clin Microbiol. 2015;53: 2163–2171. pmid:25926485
  6. 6. Dortet L, Agathine A, Naas T, Cuzon G, Poirel L, Nordmann P. Evaluation of the RAPIDEC® CARBA NP, the Rapid CARB Screen® and the Carba NP test for biochemical detection of carbapenemase-producing Enterobacteriaceae. J Antimicrob Chemother. 2015;70: 3014–3022. pmid:26260131
  7. 7. Kabir MH, Meunier D, Hopkins KL, Giske CG, Woodford N. A two-centre evaluation of RAPIDEC® CARBA NP for carbapenemase detection in Enterobacteriaceae, Pseudomonas aeruginosa and Acinetobacter spp. J Antimicrob Chemother. 2016;71: 1213–1216. pmid:26769895
  8. 8. Osterblad M, Hakanen AJ, Jalava J. Evaluation of the Carba NP test for carbapenemase detection. Antimicrob Agents Chemother. 2014;58: 7553–7556. pmid:25246404
  9. 9. Bogaerts P, Yunus S, Massart M, Huang T-D, Glupczynski Y. Evaluation of the BYG Carba Test, a New Electrochemical Assay for Rapid Laboratory Detection of Carbapenemase-Producing Enterobacteriaceae. J Clin Microbiol. 2016;54: 349–358. pmid:26637378
  10. 10. Dortet L, Poirel L, Nordmann P. Rapid identification of carbapenemase types in Enterobacteriaceae and Pseudomonas spp. by using a biochemical test. Antimicrob Agents Chemother. 2012;56: 6437–6440. pmid:23070158
  11. 11. Dortet L, Jousset A, Sainte-Rose V, Cuzon G, Naas T. Prospective evaluation of the OXA-48 K-SeT assay, an immunochromatographic test for the rapid detection of OXA-48-type carbapenemases. J Antimicrob Chemother. 2016;71: 1834–1840. pmid:26968882
  12. 12. Glupczynski Y, Evrard S, Ote I, Mertens P, Huang T-D, Leclipteux T, et al. Evaluation of two new commercial immunochromatographic assays for the rapid detection of OXA-48 and KPC carbapenemases from cultured bacteria. J Antimicrob Chemother. 2016;71: 1217–1222. pmid:26825120
  13. 13. Hemarajata P, Yang S, Hindler JA, Humphries RM. Development of a novel real-time PCR assay with high-resolution melt analysis to detect and differentiate OXA-48-Like β-lactamases in carbapenem-resistant Enterobacteriaceae. Antimicrob Agents Chemother. 2015;59: 5574–5580. pmid:26124164
  14. 14. Cuzon G, Naas T, Bogaerts P, Glupczynski Y, Nordmann P. Probe ligation and real-time detection of KPC, OXA-48, VIM, IMP, and NDM carbapenemase genes. Diagn Microbiol Infect Dis. 2013;76: 502–505. pmid:23791387
  15. 15. Dortet L, Fusaro M, Naas T. Improvement of the Xpert Carba-R Kit for the Detection of Carbapenemase-Producing Enterobacteriaceae. Antimicrob Agents Chemother. 2016;60: 3832–3837. pmid:27021332
  16. 16. van der Zwaluw K, de Haan A, Pluister GN, Bootsma HJ, de Neeling AJ, Schouls LM. The carbapenem inactivation method (CIM), a simple and low-cost alternative for the Carba NP test to assess phenotypic carbapenemase activity in gram-negative rods. PloS One. 2015;10: e0123690. pmid:25798828
  17. 17. Dortet L, Flonta M, Boudehen Y-M, Creton E, Bernabeu S, Vogel A, et al. Dissemination of carbapenemase-producing Enterobacteriaceae and Pseudomonas aeruginosa in Romania. Antimicrob Agents Chemother. 2015;59: 7100–7103. pmid:26303798
  18. 18. Tijet N, Boyd D, Patel SN, Mulvey MR, Melano RG. Evaluation of the Carba NP test for rapid detection of carbapenemase-producing Enterobacteriaceae and Pseudomonas aeruginosa. Antimicrob Agents Chemother. 2013;57: 4578–4580. pmid:23817380
  19. 19. Yamada K, Kashiwa M, Arai K, Nagano N, Saito R. Comparison of the Modified-Hodge test, Carba NP test, and carbapenem inactivation method as screening methods for carbapenemase-producing Enterobacteriaceae. J Microbiol Methods. 2016;128: 48–51. pmid:27329263
  20. 20. Tijet N, Patel SN, Melano RG. Detection of carbapenemase activity in Enterobacteriaceae: comparison of the carbapenem inactivation method versus the Carba NP test. J Antimicrob Chemother. 2016;71: 274–276. pmid:26374613
  21. 21. Bayramoğlu G, Uluçam G, Gençoğlu Özgür Ç. [Evaluation of carbapenem inactivation method for the identification of carbapenemase-producing Enterobacteriaceae strains]. Mikrobiyoloji Bül. 2016;50: 505–507.
  22. 22. Cantón R, Akóva M, Carmeli Y, Giske CG, Glupczynski Y, Gniadkowski M, et al. Rapid evolution and spread of carbapenemases among Enterobacteriaceae in Europe. Clin Microbiol Infect Off Publ Eur Soc Clin Microbiol Infect Dis. 2012;18: 413–431.
  23. 23. Glasner C, Albiger B, Buist G, Tambić Andrasević A, Canton R, Carmeli Y, et al. Carbapenemase-producing Enterobacteriaceae in Europe: a survey among national experts from 39 countries, February 2013. Euro Surveill. 2013;18.