Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Adhering to a national surgical care bundle reduces the risk of surgical site infections

  • Mayke B. G. Koek ,

    Roles Conceptualization, Formal analysis, Methodology, Writing – original draft, Writing – review & editing

    mayke.koek@rivm.nl

    Affiliation Department of Epidemiology and Surveillance, Centre for Infectious Disease Control (CIb), National Institute for Public Health and the Environment (RIVM), Bilthoven, the Netherlands

  • Titia E. M. Hopmans,

    Roles Conceptualization, Writing – review & editing

    Affiliation Department of Epidemiology and Surveillance, Centre for Infectious Disease Control (CIb), National Institute for Public Health and the Environment (RIVM), Bilthoven, the Netherlands

  • Loes C. Soetens,

    Roles Conceptualization, Formal analysis, Writing – original draft, Writing – review & editing

    Affiliations Department of Epidemiology and Surveillance, Centre for Infectious Disease Control (CIb), National Institute for Public Health and the Environment (RIVM), Bilthoven, the Netherlands, Department of Medical Statistics, Leiden University Medical Centre, Leiden, the Netherlands

  • Jan C. Wille,

    Roles Conceptualization, Writing – review & editing

    Affiliation Department of Epidemiology and Surveillance, Centre for Infectious Disease Control (CIb), National Institute for Public Health and the Environment (RIVM), Bilthoven, the Netherlands

  • Suzanne E. Geerlings,

    Roles Conceptualization, Writing – review & editing

    Affiliation Department of Infectious Diseases, Academic Medical Center, Amsterdam, the Netherlands

  • Margreet C. Vos,

    Roles Conceptualization, Writing – review & editing

    Affiliation Department of Medical Microbiology and Infectious Diseases, Erasmus MC, Rotterdam, the Netherlands

  • Birgit H. B. van Benthem,

    Roles Conceptualization, Supervision, Writing – review & editing

    Affiliation Department of Epidemiology and Surveillance, Centre for Infectious Disease Control (CIb), National Institute for Public Health and the Environment (RIVM), Bilthoven, the Netherlands

  • Sabine C. de Greeff

    Roles Conceptualization, Supervision, Writing – review & editing

    Affiliation Department of Epidemiology and Surveillance, Centre for Infectious Disease Control (CIb), National Institute for Public Health and the Environment (RIVM), Bilthoven, the Netherlands

Abstract

Background

In 2008, a bundle of care to prevent Surgical Site Infections (SSIs) was introduced in the Netherlands. The bundle consisted of four elements: antibiotic prophylaxis according to local guidelines, no hair removal, normothermia and ‘hygiene discipline’ in the operating room (i.e. number of door movements). Dutch hospitals were advised to implement the bundle and to measure the outcome. This study’s goal was to assess how effective the bundle was in reducing SSI risk.

Methods

Hospitals assessed whether their staff complied with each of the bundle elements and voluntary reported compliance data to the national SSI surveillance network (PREZIES). From PREZIES data, we selected data from 2009 to 2014 relating to 13 types of surgical procedures. We excluded surgeries with missing (non)compliance data, and calculated for each remaining surgery with reported (non)compliance data the level of compliance with the bundle (that is, being compliant with 0, 1, 2, 3, or 4 of the elements). Subsequently, we used this level of compliance to assess the effect of bundle compliance on the SSI risk, using multilevel logistic regression techniques.

Results

217 489 surgeries were included, of which 62 486 surgeries (29%) had complete bundle reporting. Within this group, the SSI risk was significantly lower for surgeries with complete bundle compliance compared to surgeries with lower compliance levels. Odds ratios ranged from 0.63 to 0.86 (risk reduction of 14% to 37%), while a 13% risk reduction was demonstrated for each point increase in compliance-level. Sensitivity analysis indicated that due to analysing reported bundles only, we probably underestimated the total effect of implementing the bundle.

Conclusions

This study demonstrated that adhering to a surgical care bundle significantly reduced the risk of SSIs. Reporting of and compliance with the bundle compliance can, however, still be improved. Therefore an even greater effect might be achieved.

Introduction

In the last decade, much more attention has been paid internationally to Patient Safety and Infection Prevention. This was reflected in the Netherlands, where in 2007 a nationwide study was performed to quantify the amount of preventable complications and mortalities occurring in hospitals. This resulted in the formulation of a list of ten highly preventable complications, one of which was Surgical Site Infections (SSIs) [1]. SSIs are serious complications of surgical procedures and are associated with prolonged hospitalisation, re-interventions, morbidity or even death [2]. The risk of contracting an SSI can be reduced by performing care according to infection prevention guidelines, but literature shows that adherence to these guidelines is repeatedly low [36].

In 2008, following the results of the nationwide study, the Dutch Hospital Patient Safety Program (DHPSP) was set up to support Dutch hospitals by developing specific preventive programs, such as bundles of care. A bundle of care is a structured way of improving care and patient outcomes: a small set of three to five evidence-based practices which, when they are performed collectively and reliably, have been proven to improve patient outcomes [7, 8]. To develop an SSI bundle of care, the DHPSP appointed a multidisciplinary team of experts (incl. surgeons, anaesthesiologists, medical microbiologists and infection control practitioners) [9]. The experts selected four practices (elements) to be included in the SSI bundle of care (see Table 1): the appropriate administration of antibiotic prophylaxis (if indicated) according to local guidelines, no preoperative surgical site hair removal, perioperative normothermia, and exercising ‘hygiene discipline’ in the operating room. The first three elements were evidence-based, measurable and derived from the National Guidelines for the Prevention of SSIs [1012]. Exercising hygiene discipline in the operating room was not evidence based, but nevertheless the expert team considered it ‘good practice’ and important to include in the bundle of care. However, as hygiene discipline by itself is difficult to measure, a maximum number of door openings during the surgery was designated as a surrogate marker for hygiene discipline. The allowed maximum number of door movements (‘agreed limit’) was not imposed by the DHPSP, but was to be determined by the hospitals.

Dutch hospitals across the country were advised to implement the bundle when performing all types of surgeries and to measure the outcome in so called index surgeries (Table 2). The thirteen selected index surgeries were chosen by the DHPSP based on how often they are performed Dutch hospitals, and on their room for improvement in patient outcome. The DHPSP aimed to achieve a reduction in the incidence of SSIs and a 90% compliance with the total SSI prevention bundle [9].

thumbnail
Table 2. Index surgeries: Thirteen surgical procedures selected by the DHPSP.

https://doi.org/10.1371/journal.pone.0184200.t002

Compliance with the bundle is considered to contribute to a decreased SSI incidence, but it is also believed that the process of reporting and giving feedback, in itself, increases awareness among health care professionals of the significance of their role in patient safety and the importance of the prevention of SSIs [13]. In this paper, we retrospectively assess how effective implementing the DHPSP surgical care bundle was in reducing the risk of SSIs, by assessing the effect of bundle compliance on SSI risk. Additionally, we describe the reporting of (non-)compliance, and compliance with the bundle itself.

Methods

Design, definitions and data selection

A retrospective cohort study was performed using data available from the Dutch National Nosocomial Surveillance Network (PREZIES) [14]. Nearly all the hospitals in the Netherlands participate in this voluntarily surveillance and select one or several types of surgical procedures for surveillance on an annual basis. Briefly, PREZIES collects data about the patient, the surgery, a limited number of possible risk factors and the presence of an SSI. SSIs reported in the surveillance meet the criteria of the (European) Centre of Disease prevention and Control (CDC and ECDC) [1518] and are confirmed by trained hospital personnel. Retrospective on-site validation was performed by the PREZIES-team. PREZIES distinguishes superficial SSIs from the deep SSIs, which include deep incisional SSIs and organ-space SSIs. SSIs in this study occurred, by definition, within 30 days after surgery (superficial and deep SSIs), or within one year after implant surgery (deep SSIs only) [1518]. Detailed information on the national PREZIES surveillance has been described previously [14].

Within the SSI surveillance, from 2009 onwards PREZIES has been facilitating the (voluntary) reporting of (non-)compliance with the four SSI bundle elements, using the ‘Yes’ (compliant) or ‘No’ (non-compliant) answering possibilities as defined by the DHPSP [9]. Measuring and reporting of the bundle elements could be manual or (semi-)automated, and varied per element and per hospital. As reporting bundle data to PREZIES is not mandatory, data of hospitals implementing the bundle but choosing not to report the bundle to PREZIES were not available. From PREZIES data available mid-2015, we selected data from 2009 to 2014. Additionally, we only included the index surgeries, i.e. the surgical procedures especially selected by the DHPSP to measure compliance with the bundle and impact of bundle compliance on SSI incidence (Table 2) [9].

According to Dutch legislation, written consent from each individual patient was not required because the data from the PREZIES network is anonymized and was gathered as a legal task of the National Institute for Public Health and the Environment.

Statistical analyses

We used surveillance data collected from medical files (surgeries on patient level) and analysed the four bundle elements, both separately and combined as a bundle, investigating (i) reporting, (ii) compliance, and (iii) the effect of compliance on the SSI risk. By definition, reporting refers to marking the variable in the PREZIES database with either a ‘yes’ (compliant) or a ‘no’ (non-compliant). Compliance is defined as answering ‘yes’. Complete bundle compliance was defined as compliance with all four elements within one patient (i.e. four times ‘yes’).

  1. To investigate bundle reporting, all data included was used. We calculated the reported numbers and percentages for each of the four elements separately and for the entire bundle; by year, by specialty and in total.
  2. To calculate compliance with separate bundle elements, we selected patient surgeries with reported bundle data (without missing values), i.e. with a known status of (non-)compliance. We calculated compliance with each element as a percentage of the surgeries for which the element was reported.
  3. We calculated the percentage compliance with the whole bundle using a selection of surgeries for which the entire bundle was reported. Both compliance with the four elements separately and with the bundle were plotted over time.
  4. After that, we assessed the effect of bundle compliance on the risk of an SSI while selecting surgeries for which the entire bundle was reported. We used multivariate multilevel logistic regression techniques, creating Odds Ratios (ORs), to create five models; four for bundle compliance (Fig 1) and one for compliance with the separate bundle elements. To estimate the effect of bundle compliance, we calculated the level of compliance with the bundle as a number ranging from 0 to 4 for each individual with 0 referring to complete non-compliance (compliant with none of the four elements, 0/4) and 4 referring to full compliance (compliant with all 4 elements, 4/4). We then first (Model 1) compared the effect of full bundle compliance (4/4) with the effect of combined other levels of compliance (compliance levels 0 to 3, grouped) on the risk of an SSI. Secondly, we compared full compliance (4/4) with the other levels of compliance separately (3, 2, 1, or 0 out of 4). This analysis produced four estimates comparing each lower level of compliance with full compliance (compliance analysed as a categorical variable, Model 2) and one estimate signifying the relative risk caused by a single point increase in compliance level (compliance analysed as a continuous variable, Model 3). After that, we repeated Model 1 but this time with a partial bundle made up of the three evidence-based elements only (referred to as ‘partial bundle’ from this point onwards), not incorporating the expert-opinion based element of hygiene discipline (minimising door movements, Model 4). In this analysis we compared the effect of full compliance with the partial bundle (3/3) with all other levels of compliance combined (<3/3). Finally, to estimate the effect of compliance with individual bundle elements, we modelled the four bundle elements separately (Model 5).
  5. Finally, as part of a sensitivity analysis we used the same statistical techniques to compare the SSI risk of surgeries with full bundle compliance (among bundles entirely reported) to the SSI risk of surgeries having no bundle reporting or having bundles not entirely reported in the PREZIES database.
thumbnail
Fig 1. Statistical analysis: Four analyses comparing the influence of bundle-compliance on the SSI-risk.

Comparisons made in Models 1 to 4 schematically represented. A stack of four boxes represents the entire bundle, a stack of three boxes represents the partial bundle. Compliance with a single bundle element is presented as a blue box with a Y (= Yes). Non-compliance with a bundle element is presented in a white box with an N (= No). Only bundles being completely reported were included (N = 62 486 for entire bundle, N = 99 371 for the partial bundle). Bundles with missing data concerning compliance were excluded. Key: * Model 4: The partial bundle does not include the bundle element hygiene discipline (‘minimising operating room door movements’), but is only composed of the bundle elements PAP-LG, hair removal and normothermia. † Model 2: Level of compliance entered as a categorical variable produces 4 Odds Ratios (ORs), comparing full compliance with the four other levels of compliance separately. ‡ Model 3: Level of compliance entered as a continuous variable produces 1 Odds ratio (OR), signifying the reduced risk for each single point increase in compliance-level.

https://doi.org/10.1371/journal.pone.0184200.g001

All regression analyses were performed for all the medical specialties combined, while taking into account different baseline-risks between medical specialties (fixed effect) and differences between medical partnerships, between hospitals, and slopes (random effects). To correct for possible confounding by duration of participation to the surveillance (‘surveillance effect’) we checked year of surgery and duration of participation to the DHPSP at the time of surgery for their impact on the relationship between compliance and risk of infection. Furthermore, from the other variables available from the surveillance data, we considered the NNIS risk index, duration of surgery, ASA-score, wound class, having a prior surgery, multiple operations and having subsequent surgery to be potential confounders. We used forward selection, adding variables to the model if they changed the OR by 10% or more. For the individual bundle elements, we corrected for compliance with each of the other three bundle elements (making a model combining the four elements).

To validate interpretation of the ORs, we compared crude ORs with crude RRs (Risk Ratios) calculated using generalised linear models. All analyses were performed using the SAS 9.3 statistical package.

Results

Study inclusion and descriptives

Data on 232 274 surgeries performed from 2009 to 2014 were available for the 13 index surgeries of the DHPSP. However, because of the mandatory follow-up period of one year, the data from 2014 were incomplete at the time of analysis. We excluded cardiovascular surgeries (CAR, n = 13 736) because for this specialty it was impossible to meet the primary outcome (bundle compliance) as the bundle element hygiene discipline was not implemented for this specialty. We also excluded surgeries which were performed in the only hospital not participating in the DHPSP (n = 1 033), and 16 surgeries on patients who were younger than a year. A total number of 217 489 surgical procedures remained to be included. Distribution over the six remaining specialties and other baseline descriptives are presented in Table 3, which also includes the cumulative incidences per specialty.

thumbnail
Table 3. Baseline characteristics of surgeries with bundles not reported, partially reported, entirely reported but not fully compliant, and entirely reported with full compliance.

https://doi.org/10.1371/journal.pone.0184200.t003

Reporting

In the PREZIES database, 62 486 (29%) of the surgical procedures had complete reporting of the entire bundle (i.e. all four elements reported compliant/non-compliant, no missing values). Of the remaining 155 003 (71%) surgeries, 87 103 (40%) had partial reporting of the bundle and for 67 900 (31%) surgeries the bundle was not reported in the PREZIES database. Complete reporting of the partial bundle excluding hygiene discipline was 46% (n = 99 371). Reporting of (non-)compliance with the bundle elements varied between the elements. It increased over time for each element, but was lowest for hygiene discipline (Table 4). Reporting of the entire bundle logically also increased over time, but was still below 50% in 2013 and 2014.

thumbnail
Table 4. Reporting of and compliance with the bundle and its elements.

https://doi.org/10.1371/journal.pone.0184200.t004

Compliance

Bundle compliance was calculated within the group of surgeries with complete bundle reporting (n = 62 486). Compliance with a bundle element was calculated using surgeries for which the element was reported (varying from n = 72 457 for hygiene discipline to n = 139 089 for PAP-LG, Table 4). Compliance with each of the bundle elements and with the bundle increased and stabilised over time (Table 4, Fig 2). Compliance with the elements ranged from 39% to 72% in 2009 but, by 2014, had reached 82% to 96%. Bundle compliance increased over time from less than 20% to 64%.

thumbnail
Fig 2. Compliance over time.

Compliance with the bundle elements and with the bundle over time. Compliance with each bundle element was calculated using surgeries for which the element was reported, i.e. not missing (n = 72 457 for hygiene discipline, n = 112 215 for normothermia, n = 130 622 for hair removal, and n = 139 089 for PAP-LG). Bundle compliance was calculated within the group of surgeries for which (non-)compliance was reported for the entire bundle (n = 62 486). * Data from 2014 are incomplete because of the mandatory delay in follow-up of one year, which caused a delay in reporting the data. PAP-LG = Peri-operative Antibiotic Prophylaxis according to Local Guidelines.

https://doi.org/10.1371/journal.pone.0184200.g002

Effect of bundle compliance on SSI risk

The results in Table 5A and 5B (models 1, 2 and 4) show that the risk of an SSI was lower for surgeries with full compliance compared to surgeries with lower compliance levels. Crude ORs were all statistically significant below 1 (range 0.73–0.87) despite relatively broad 95% CIs. The final multilevel ORs either remained similar or slightly decreased (range 0.63–0.86, indicating a risk reduction of 14% to 37%), keeping significance. The OR of 0.87 (95%CI 0.81 to 0.94) for a single point increase in compliance level (model 3) indicates that one point increase of the compliance level reduced the risk of an SSI by 13%.

thumbnail
Table 5. Bundle compliance and compliance with individual bundle elements: Odds ratios (ORs) for the risk of an SSI.

https://doi.org/10.1371/journal.pone.0184200.t005

Multilevel ORs for compliance with the individual elements were statistically significant below 1 for hair removal, normothermia and hygiene discipline (0.68, 0.83 and 0.74 respectively, Table 5C, model 5). The OR for PAP-LG (following local guidelines for PAP), however, was not significantly reduced (0.96). After correcting for confounding by the other elements, all ORs increased but remained significantly reduced for hair removal and hygiene discipline. Not enough data was available to reliably analyse the individual elements for each medical specialty separately. However, a limited number of additional analyses could be performed which indicated that compliance with the element of hair removal significantly reduced the risk of an SSI for breast surgeries (OR 0.52, 95%CI 0.28 to 0.98), while hygiene discipline was associated with a reduced OR for gastro-intestinal surgery (OR = 0.71, 95%CI 0.55 to 0.91). No other associations were found (results not presented).

Comparing the group with complete reporting (29%, n = 62 486) to the remaining surgeries without (complete) bundle reporting (71%, n = 155 003), the results in Table 3 suggest that the SSI incidences were mostly higher for this latter group. Sensitivity analyses comparing surgeries with full bundle compliance (n = 30 853) to surgeries with partial bundle reporting (n = 87 103) or with no bundle reporting to PREZIES (n = 67 900), confirmed this. While the risk reduction of full compliance compared to incomplete compliance was 24% (model 1), it was 34% when compared to partially reported bundle data (multilevel OR 0.66, 95%CI 0.56 to 0.79) and 25% when compared to surgeries without bundle data reported to PREZIES (multilevel OR 0.75, 95%CI 0.71 to 0.92, corrected for NNIS risk index). Note that the latter group is a heterogeneous group consisting of hospitals implementing the bundle but not reporting on national level, as well as hospitals not implementing the bundle at all.

For all the analyses performed, the crude ORs were similar to crude RRs (differences all <0.01, results not presented), implying that the ORs may be interpreted as RRs.

Discussion

Key findings

We observed that compliance with the entire bundle of care, but also compliance with a part of the bundle, significantly reduced the risk of an SSI. Full compliance compared to other compliance-levels resulted in a risk reduction varying from 14% to 37%, depending on the group that was used as a comparison. Thus, it is possible to reduce the cumulative incidence of SSIs by defining and adhering to best practices.

Main results

It took considerable time for the hospitals to implement the bundle, and hospital personnel considered the workload of reporting the bundle and handling feedback to be high. This is in line with our findings that for more than 70% of the included surgeries, the bundle was not, or was not completely, reported in the PREZIES database. PAP-LG was most frequently reported by the hospitals, but the other three bundle elements had considerably lower reporting levels. Nevertheless, it is the bundle approach, and not compliance with separate interventions that is claimed to be successful, as the bundle approach is considered to ensure the consistent application of all measures [9, 13]. Our findings of a stepwise increase in the protective effect of full bundle compliance (from 18% (0.82) to 37% (0.63)) when the level of compliance to which it was compared decreased (from 3 to 0), and a 13% risk reduction additionally demonstrated for each point increase in compliance, support this claim. As compliance increased over time, the protective effect of compliance could theoretically have been biased by the effect of duration of participation to the surveillance (‘surveillance effect’), but both year of surgery and duration of participation in the DHPSP (as proxy for duration of participation to the surveillance) proved to be no confounders.

Many professionals’ doubts about the validity of using operating room door movements as a surrogate for hygiene discipline may have contributed to the lower reporting of this element. Nevertheless, we detected a greater risk reduction when the complete bundle (24%) was adhered to, compared to the partial bundle (14%), suggesting that paying attention to door movements as an approximation for hygiene discipline further reduced the risk of an SSI. The SSI risk of 0.79 for compliance with the element hygiene discipline, confirmed this. As this result was most evident in gastro-intestinal surgery (i.e. contaminated area), it is likely that minimising the number of door movements improved the degree of attention given to all tasks in the operating rooms and thus created a more attentive and accurate work environment [19], thereby reducing spill of contaminated material.

Compliance with ‘no unnecessary hair removal’ was also associated with a risk reduction in our study. This protective effect was highest for breast surgeries, where surgical incisions often involve the armpit. Compliance with normothermia and with following local guidelines for antibiotic prophylaxes (PAP-LG), however, did not significantly reduce the SSI risk. The lack of effect of normothermia is probably due to a lack of power, but the lack of effect of PAP-LG may be explained by the definition of PAP-LG. First, PAP-LG was defined as a multi-part question, which is difficult by nature to report. Secondly, not exactly following the local guidelines for PAP did not necessarily mean that no PAP was given at all. If local guidelines were different from the national guidelines, providing PAP according to national guidelines resulted in being non-compliant with the local guidelines. Also, small deviations in PAP administration (for instance timing) might have led to it being considered non-compliant. The actual effect of such deviations on the risk of an SSI might have been low, and thus results found for PAP-LG in this study do not imply that administration of PAP itself (which is advocated by several SSI prevention guidelines and the WHO) [11, 20, 21] is not useful.

Comparison with literature

To the best of our knowledge, this is the first European study analysing the effect of adherence to an SSI prevention bundle using case-based data from a national database which includes several types of surgery.

Previous European and non-European studies evaluated the effect of a surgical care bundle on SSI incidences [13, 2240]. The bundles studied were different, but most included elements such as appropriate dose of PAP, appropriate timing of PAP, discontinuation of PAP, or hair removal [13]. Most studies, however, focused on only one type of surgery [23, 2532, 34, 35, 3840], or investigated the effect of a bundle using a before-after design (without measuring compliance, or without directly incorporating compliance into the analyses) [23, 25, 2735, 37, 39, 40]. A study similar to ours was performed in the USA in 2011 and included over 60 000 surgeries among 5 medical specialties [22]. The researchers did not find a significant effect of bundle compliance but may have underestimated the effect of compliance as they adjusted for all variables known to predict SSIs (which probably are not all confounders). By doing this, they predicted the overall odds of an SSI rather than estimating the odds of an SSI for bundle compliance [41]. Also, with similar numbers to analyse, we noticed that adjusting for many variables caused our models to become unstable and unreliable because of the low numbers in subgroups.

Summarised, most previous studies found that implementing a bundle coincided with decreased SSI incidence [23, 25, 2731, 33, 34, 3739], or found no significant effect [24, 32, 35, 37] probably due to lack of power [13]. Therefore, in 2015, Tanner et al published a meta-analysis of the effect of surgical care bundles on the risk of an SSI for colorectal surgery [13] and included 8 515 surgeries from 13 of the studies mentioned above. Comparing SSI-incidences before and after the introduction of a bundle, they found that the use of a bundle reduced the risk of an SSI by 45% (Risk Ratio 0.55). They did not, however, publish any information about compliance rates.

Strengths and limitations

This study is a valuable addition to the studies mentioned above, because it included almost 30 000 gastro-intestinal tract surgeries of which 10 622 had complete reporting of compliance data for the entire bundle, and 16 922 for the partial bundle. In addition, this study enables more generalisations to be made, because we included several types of surgery, and presented and used compliance data. Measuring and aiming to minimize door movements in order to achieve hygiene discipline is unique to our study and has been subject to debate due to the lack of evidence for its effectiveness. However, the additional risk reduction of 10–21% found in our study should add to the current body of evidence supporting the importance of raising awareness in the operating room. The conclusions regarding PAP-LG on the other hand are, due to the unusual definition of this bundle element, not generalisable to differently formulated PAP bundle elements and probably also not to other countries. Numbers included in our study were relatively high, but retaining robust models was still challenging.

As only surgeries with a known status of bundle-compliance could be used to compare the SSI risk of full compliance with that of not being fully compliant, only surgeries with complete bundle reporting were selected for this comparison. Of all included surgeries, only 29% (62 486) had complete bundle reporting. Although this percentage seems low, in this setting without mandatory reporting it is in line with the expectations, and is even higher than the percentage reporting found in a recent Dutch randomised trial investigating the use of antibiotic checklists [42]. In fact, another 40% of the surgeries (n = 87 103) had partial bundle reporting, and part of the group without bundle reporting to PREZIES (31%, n = 67 900) consisted of surgeries from hospitals that did implement the bundle but choose to report (non-)compliance only to their own staff (internal reporting). As such, the latter group is a heterogeneous group consisting of hospitals implementing the bundle but not reporting on national level, as well as hospitals not implementing the bundle at all. Therefore, the estimated 25% risk reduction for this group probably underestimates the effect to be expected when surgeries with reported full compliance had been compared to surgeries from hospitals were no effort was taken to implement the bundle. These results indicate that putting effort in full bundle reporting by itself may already reduce SSI incidence, and hence the results found in this study (i.e. impact of compliance among bundles reported) are most probably an underestimation of the actual effect of introducing and using a bundle of care.

Because of the small numbers of SSIs per medical specialty, the study was underpowered to stratify by medical specialty. However, adding medical specialty to the model as a confounder yielded robust and reliable estimates. Using models 1 and 4, other potential confounders were adequately tested for their influence on the SSI risk. These covariates, however, did not confound the relationship between bundle compliance and SSI risk. They were therefore not added and were for this reason also not considered for the other models. Finally, log binomial regression analyses to calculate RRs did not produce results, forcing us to calculate ORs using logistic regression techniques. However, comparison of crude ORs and RRs revealed that, in this study, the ORs can be interpreted as RRs.

Implications and conclusion

The elements included in our bundle are slightly different from those used in other studies, but in general it is the bundle approach that is believed to create awareness and to improve infection prevention [9, 13]. The results of our study confirm that bundle compliance reduces the risk of an SSI. In fact, as reporting of, and compliance with, the bundle can still be improved, an even greater effect might be achieved. It costs, however, a lot of effort to continuously report bundles and to handle feedback, especially if bundle reporting is not fully automated. Whether, and for how long any positive effect of reporting bundle compliance endures after successful implementation is also unknown at this point. An investigation should be made into whether the periodic measurement of bundle compliance, with adequate feedback, could also maintain awareness, as this would substantially reduce the workload.

Acknowledgments

We would like to thank all the hospitals for their contribution to the data collection and express gratitude to the experts at the DHPSP for designing the program.

References

  1. 1. de Bruijne MC, Zegers M, Hoonhout LHF, Wagner C. [Patient safety in Dutch hospitals: case study of hospital admissions in 2004.] Onbedoelde schade in Nederlandse ziekenhuizen: dossieronderzoek van ziekenhuisopnames in 2004. Amsterdam/Utrecht: EMGO Instituut en NIVEL, 2007. http://www.nivel.nl/sites/default/files/bestanden/onbedoelde-schade-in-nederlandse-ziekenhuizen-2007.pdf
  2. 2. de Lissovoy G, Fraeman K, Hutchins V, Murphy D, Song D, Vaughn BB. Surgical site infection: incidence and impact on hospital utilization and treatment costs. Am J Infect Control. 2009;37(5):387–97. pmid:19398246
  3. 3. Leaper DJ, Tanner J, Kiernan M, Assadian O, Edmiston CE Jr. Surgical site infection: poor compliance with guidelines and care bundles. Int Wound J. 2015;12(3):357–62. pmid:24612792
  4. 4. Meeks DW, Lally KP, Carrick MM, Lew DF, Thomas EJ, Doyle PD, et al. Compliance with guidelines to prevent surgical site infections: As simple as 1-2-3? Am J Surg. 2011;201(1):76–83. pmid:20573335
  5. 5. Gagliardi AR, Eskicioglu C, McKenzie M, Fenech D, Nathens A, McLeod R. Identifying opportunities for quality improvement in surgical site infection prevention. Am J Infect Control. 2009;37(5):398–402. pmid:19201509
  6. 6. Young B, Ng TM, Teng C, Ang B, Tai HY, Lye DC. Nonconcordance with surgical site infection prevention guidelines and rates of surgical site infections for general surgical, neurological, and orthopedic procedures. Antimicrob Agents Chemother. 2011;55(10):4659–63. pmid:21825293
  7. 7. Haraden C. Improvement Stories: What Is a Bundle? Institute for Healthcare Improvement (IHI); [Accessed July 7, 2017]. http://www.ihi.org/resources/Pages/ImprovementStories/WhatIsaBundle.aspx.
  8. 8. Resar R, Pronovost P, Haraden C, Simmonds T, Rainey T, Nolan T. Using a bundle approach to improve ventilator care processes and reduce ventilator-associated pneumonia. Jt Comm J Qual Patient Saf. 2005;31(5):243–8. pmid:15960014
  9. 9. VMS Safety Program. [Dutch Hospital Patient Safety Program (DHPSP)—Prevention of surgical site infections (SSIs)]. VMS Veiligheidsagenda—Voorkomen van wondinfecties na een operatie (POWI)]. [Accessed March 24, 2017]. http://www.vmszorg.nl/themas/powi/.
  10. 10. Workinggroup Infection Prevention (WIP). [Guideline: Prevention of Surgical Site Infections in hospitals.] Richtlijn: Preventie van postoperatieve wondinfecties. Guideline. May 2011. [Accessed March 24th, 2017]. http://www.rivm.nl/dsresource?objectid=10f552c6-413b-4195-9614-810c5a5fea8e&type=org&disposition=inline.
  11. 11. SWAB (Stichting Werkgroep Antibioticabeleid). [National book on antibiotics—Surgical profylaxis]. Nationale Antibioticaboekje—Chirurgische profylaxe. [Accessed December 20th, 2016]. http://swabid.nl/profylaxe/chirurgische-profylaxe.
  12. 12. van Kasteren ME, Gyssens IC, Kullberg BJ, Bruining HA, Stobberingh EE, Goris RJ. [Optimizing antibiotics policy in the Netherlands. V. SWAB guidelines for perioperative antibiotic prophylaxis. Foundation Antibiotics Policy Team]. Ned Tijdschr Geneeskd. 2000;144(43):2049–55. pmid:11072507
  13. 13. Tanner J, Padley W, Assadian O, Leaper D, Kiernan M, Edmiston C. Do surgical care bundles reduce the risk of surgical site infections in patients undergoing colorectal surgery? A systematic review and cohort meta-analysis of 8,515 patients. Surgery. 2015;158(1):66–77. pmid:25920911
  14. 14. Koek MB, Wille JC, Isken MR, Voss A, van Benthem BH. Post-discharge surveillance (PDS) for surgical site infections: a good method is more important than a long duration. Euro Surveill. 2015;20(8).
  15. 15. Mangram AJ, Horan TC, Pearson ML, Silver LC, Jarvis WR. Guideline for Prevention of Surgical Site Infection, 1999. Centers for Disease Control and Prevention (CDC) Hospital Infection Control Practices Advisory Committee. Am J Infect Control. 1999;27(2):97–132; quiz 3–4; discussion 96. pmid:10196487
  16. 16. Horan TC, Gaynes RP. Surveillance of nosocomial infections. 3 ed. Mayhall C, editor. Philadelphia: Lippincott Williams and Wilkins; 2004. Pages 1659–702.
  17. 17. Horan TC, Andrus M, Dudeck MA. CDC/NHSN surveillance definition of health care-associated infection and criteria for specific types of infections in the acute care setting. Am J Infect Control. 2008;36(5):309–32. pmid:18538699
  18. 18. Garner JS, Jarvis WR, Emori TG, Horan TC, Hughes JM. CDC definitions for nosocomial infections, 1988. Am J Infect Control. 1988;16(3):128–40. pmid:2841893
  19. 19. Kurmann A, Peter M, Tschan F, Muhlemann K, Candinas D, Beldi G. Adverse effect of noise in the operating theatre on surgical-site infection. Br J Surg. 2011;98(7):1021–5. pmid:21618484
  20. 20. Berrios-Torres SI, Umscheid CA, Bratzler DW, Leas B, Stone EC, Kelz RR, et al. Centers for Disease Control and Prevention Guideline for the Prevention of Surgical Site Infection, 2017. JAMA Surg. 2017; May 3. pmid:28467526
  21. 21. WHO. Global guidelines for the prevention of surgical site infection. 2016. [Accessed December 20th, 2016]. http://apps.who.int/iris/bitstream/10665/250680/1/9789241549882-eng.pdf?ua=1.
  22. 22. Hawn MT, Vick CC, Richman J, Holman W, Deierhoi RJ, Graham LA, et al. Surgical site infection prevention: time to move beyond the surgical care improvement program. Ann Surg. 2011;254(3):494–9; discussion 9–501. pmid:21817889
  23. 23. Crolla RM, van der Laan L, Veen EJ, Hendriks Y, van Schendel C, Kluytmans J. Reduction of surgical site infections after implementation of a bundle of care. PloS one. 2012;7(9):e44599. pmid:22962619
  24. 24. Prakken FJ, Lelieveld-Vroom GM, Milinovic G, Jacobi CE, Visser MJ, Steenvoorde P. [A measurable connection between preventative interventions and the incidence of postoperative wound infection]. Ned Tijdschr Geneeskd. 2011;155(33):A3269. pmid:21854658
  25. 25. Itani KM. Care Bundles and Prevention of Surgical Site Infection in Colorectal Surgery. JAMA. 2015;314(3):289–90. pmid:26197189
  26. 26. Anthony T, Murray BW, Sum-Ping JT, Lenkovsky F, Vornik VD, Parker BJ, et al. Evaluating an evidence-based bundle for preventing surgical site infection: a randomized trial. Arch Surg. 2011;146(3):263–9. pmid:21079110
  27. 27. Berenguer CM, Ochsner MG Jr., Lord SA, Senkowski CK. Improving surgical site infections: using National Surgical Quality Improvement Program data to institute Surgical Care Improvement Project protocols in improving surgical outcomes. J Am Coll Surg. 2010;210(5):737–41, 41–3. pmid:20421041
  28. 28. Bull A, Wilson J, Worth LJ, Stuart RL, Gillespie E, Waxman B, et al. A bundle of care to reduce colorectal surgical infections: an Australian experience. J Hosp Infect. 2011;78(4):297–301. pmid:21664720
  29. 29. Cima R, Dankbar E, Lovely J, Pendlimari R, Aronhalt K, Nehring S, et al. Colorectal surgery surgical site infection reduction program: a national surgical quality improvement program—driven multidisciplinary single-institution experience. J Am Coll Surg. 2013;216(1):23–33. pmid:23127793
  30. 30. Hedrick TL, Heckman JA, Smith RL, Sawyer RG, Friel CM, Foley EF. Efficacy of protocol implementation on incidence of wound infection in colorectal operations. J Am Coll Surg. 2007;205(3):432–8. pmid:17765159
  31. 31. Keenan JE, Speicher PJ, Thacker JK, Walter M, Kuchibhatla M, Mantyh CR. The preventive surgical site infection bundle in colorectal surgery: an effective approach to surgical site infection reduction and health care cost savings. JAMA Surg. 2014;149(10):1045–52. pmid:25163027
  32. 32. Larochelle M, Hyman N, Gruppi L, Osler T. Diminishing surgical site infections after colorectal surgery with surgical care improvement project: is it time to move on? Dis Colon Rectum. 2011;54(4):394–400. pmid:21383558
  33. 33. Liau KH, Aung KT, Chua N, Ho CK, Chan CY, Kow A, et al. Outcome of a strategy to reduce surgical site infection in a tertiary-care hospital. Surg Infect (Larchmt). 2010;11(2):151–9.
  34. 34. Lutfiyya W, Parsons D, Breen J. A colorectal "care bundle" to reduce surgical site infections in colorectal surgeries: a single-center experience. Perm J. 2012;16(3):10–6. pmid:23012593
  35. 35. Pastor C, Artinyan A, Varma MG, Kim E, Gibbs L, Garcia-Aguilar J. An increase in compliance with the Surgical Care Improvement Project measures does not prevent surgical site infection in colorectal surgery. Dis Colon Rectum. 2010;53(1):24–30. pmid:20010346
  36. 36. van der Slegt J, van der Laan L, Veen EJ, Hendriks Y, Romme J, Kluytmans J. Implementation of a bundle of care to reduce surgical site infections in patients undergoing vascular surgery. PloS one. 2013;8(8):e71566. pmid:23967222
  37. 37. Tillman M, Wehbe-Janek H, Hodges B, Smythe WR, Papaconstantinou HT. Surgical care improvement project and surgical site infections: can integration in the surgical safety checklist improve quality performance and clinical outcomes? J Surg Res. 2013;184(1):150–6. pmid:23582762
  38. 38. Waits SA, Fritze D, Banerjee M, Zhang W, Kubus J, Englesbe MJ, et al. Developing an argument for bundled interventions to reduce surgical site infection in colorectal surgery. Surgery. 2014;155(4):602–6. pmid:24468041
  39. 39. Wick EC, Hobson DB, Bennett JL, Demski R, Maragakis L, Gearhart SL, et al. Implementation of a surgical comprehensive unit-based safety program to reduce surgical site infections. J Am Coll Surg. 2012;215(2):193–200. pmid:22632912
  40. 40. Wick EC, Gibbs L, Indorf LA, Varma MG, Garcia-Aguilar J. Implementation of quality measures to reduce surgical site infection in colorectal patients. Dis Colon Rectum. 2008;51(7):1004–9. pmid:18415649
  41. 41. Sainani KL. Explanatory versus predictive modeling. PM R. 2014;6(9):841–4. pmid:25150778
  42. 42. van Daalen FV, Geerlings SE, Prins JM, Hulscher ME. A survey to identify barriers of implementing an antibiotic checklist. Eur J Clin Microbiol Infect Dis. 2016;35(4):545–53. pmid:26810059