Figures
Abstract
Background
To curb increasing resistance rates, responsible antimicrobial use (AMU) is needed, both in human and veterinary medicine. In human healthcare, antimicrobial stewardship programmes (ASPs) have been implemented worldwide to improve appropriate AMU. No ASPs have been developed for and implemented in companion animal clinics yet.
Objectives
The objective of the present study was to implement and evaluate the effectiveness of an ASP in 44 Dutch companion animal clinics. The objectives of the ASP were to increase awareness on AMU, to decrease total AMU whenever possible and to shift AMU towards 1st choice antimicrobials, according to Dutch guidelines on veterinary AMU.
Methods
The study was designed as a prospective, stepped-wedge, intervention study, which was performed from March 2016 until March 2018. The multifaceted intervention was developed using previous qualitative and quantitative research on current prescribing behaviour in Dutch companion animal clinics. The number of Defined Daily Doses for Animal (DDDAs) per clinic (total, 1st, 2nd and 3rd choice AMU) was used to quantify systemic AMU. Monthly AMU data were described using a mixed effect time series model with auto-regression. The effect of the ASP was modelled using a step function and a change in the (linear) time trend.
Results
A statistically significant decrease of 15% (7%-22%) in total AMU, 15% (5%-24%) in 1st choice AMU and 26% (17%-34%) in 2nd choice AMU was attributed to participation in the ASP, on top of the already ongoing time trends. Use of 3rd choice AMs did not significantly decrease by participation in the ASP. The change in total AMU became more prominent over time, with a 16% (4%-26%) decrease in (linear) time trend per year.
Citation: Hopman NEM, Portengen L, Hulscher MEJL, Heederik DJJ, Verheij TJM, Wagenaar JA, et al. (2019) Implementation and evaluation of an antimicrobial stewardship programme in companion animal clinics: A stepped-wedge design intervention study. PLoS ONE 14(11): e0225124. https://doi.org/10.1371/journal.pone.0225124
Editor: Simon Russell Clegg, University of Lincoln, UNITED KINGDOM
Received: July 15, 2019; Accepted: October 29, 2019; Published: November 18, 2019
Copyright: © 2019 Hopman et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data underlying this study are owned by private companion animal clinics, who have restricted their public sharing because the data contain confidential information (i.e. patient and owner information). Data was shared with the researchers using a data user agreement stating that the data would be used anonymous by the authors for scientific purposes only. The anonymized dataset used for the modelling is available from the Utrecht University YODA Data management system (https://dgk.yoda.uu.nl/; contact via corresponding author or yoda@uu.nl) for researchers who meet the criteria for access to confidential data.
Funding: This work was supported by ZonMw (Netherlands Organisation for Health Research and Development, The Hague, the Netherlands), project number 205300003. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The increase of antimicrobial resistance (AMR) is recognised as a threat for modern medicine and public health [1]. To help control AMR, responsible use of antimicrobials (AMs) is warranted and a decrease in inappropriate use of AMs is necessary, both in human and veterinary medicine [1–3].
In human medicine, the term antimicrobial stewardship programme (ASP) generally refers to specific programmes or series of interventions to monitor and direct antimicrobial use (AMU) at the hospital or primary care level [4–7]. In veterinary medicine, it usually encompasses numerous elements of improved AMU (e.g., increasing awareness of (inter)national practice guidelines, use of diagnostic microbiology and use of alternatives to AMs) and it is often associated with country-wide surveillance of AMU and development of (inter)national guidelines on AMU [8].
In Dutch food producing animals, a combination of compulsory and voluntary actions resulted in a 64% reduction in AMU (between 2008 and 2017). A decrease in resistance rates was observed as well [9–12]. Just since the end of 2011 onwards, more attention is being paid to AMU in companion animals. Legislation (2013) on mandatory susceptibility testing for veterinary use of 3rd choice AMs also holds for companion animals [13]. The Royal Dutch Veterinary Association promotes the use of guidelines on AMU as well.
A survey on prescription data of 68 companion animal clinics in the Netherlands (during 2009–2011) showed that the use of 3rd generation cephalosporins and fluoroquinolones (i.e. highest priority critically important antimicrobials for human medicine according to the World Health Organisation (WHO)) accounted for 18% of total AMU, based upon the number of Defined Daily Doses for Animals [14,15]. During the past years, AMU in Dutch companion animal clinics has been decreasing (with 19% when comparing 2012 to 2014) [16]. However, especially with regard to the (sub)classes of AMs used, there is still room left for improvement. According to Dutch classification of veterinary AMU, 2nd choice AMs (i.e. mainly aminopenicillins and 1st and 2nd generation cephalosporins) still accounted for 43% of total AMU and 3rd choice AMs (i.e. 3rd generation cephalosporins and fluoroquinolones) for 8% of total AMU in 2014 [16].
Antimicrobial prescribing behaviour can only be improved if interventions are attuned to the specific situation and the target group, and factors influencing antimicrobial prescribing are taken into account [17,18]. Qualitative research in Dutch companion animal clinics indicated that antimicrobial prescribing behaviour is influenced by four main categories of factors: veterinarian-related factors, patient-related factors, treatment-related factors and contextual factors [19]. These categories of factors were taken into account when the intervention elements of the present study were developed. The aim of this study was to implement and evaluate the effectiveness of such a customised ASP, aiming to improve antimicrobial prescribing, in 44 Dutch companion animal clinics.
Materials and methods
Study design
The Antimicrobial Stewardship and Pets-study (ASAP) was designed as a prospective, stepped-wedge intervention study aiming to optimise antimicrobial prescribing in Dutch companion animal clinics by implementing an antimicrobial stewardship programme. The intervention study was performed from March 2016 until March 2018.
Time schedule
Clinics, divided into four clusters, were offered all separate intervention elements of the ASP. The period considered as the actual “intervention period” comprised 12 months: from start of implementation of the ASP (i.e. filling in patient evaluation forms) up to 4–5 months after the feedback meeting (i.e. when clinics started filling in patient evaluation forms for the second time). Time schedule of the applied stepped-wedge design is shown in Fig 1. The first cluster of clinics was contacted in December 2015, their intervention period started in March 2016. The intervention period of the last cluster started in January 2017. The clinics were grouped into four clusters based on their geographic location.
The time schedule indicates the start and the duration of the period considered as the “intervention period” for the four separate clusters of participating clinics.
Participating clinics
Sample size.
The study aimed at including at least 40 clinics. This number was based on a power calculation which indicated that with 40 clinics a minimal change of 8% in mean total AMU could be detected with a power of 0.80 (= beta) and a significance of 0.05 (= alpha) over a one-year period. Calculations were based on AMU data at clinic level from a previous study conducted in 68 Dutch companion animal clinics [15].
Clinic selection.
Companion animal clinics were approached for participation using the database of the Royal Dutch Veterinary Association (KNMvD) containing all Dutch veterinary clinics. The clinics were sampled based upon previous shown interest to participate in a study on optimisation of AMU in companion animal clinics and on geographic location.
Clinics were invited by e-mail, followed a week later by a phone call to answer questions and to arrange a visit. Ultimately, clinics were only included when the Practice Management System (PMS) appeared to be able to provide information on antimicrobial prescription data specified for companion animals on a monthly basis. Clinics treating companion animals only and mixed clinics (i.e. clinics treating companion animals and non-companion animals, but with separated companion and non-companion animal prescription data) were included.
Clinics were offered a financial compensation, which was based upon estimated time investment per clinic and a standard hourly tariff for veterinarians. Educational training included in the ASP was accredited as professional continuing education for participating veterinarians.
The study was exempt from ethical approval as no animal experiments were involved. Participating veterinarians remained fully autonomous in their daily practice. Before enrolment, all clinics received written and oral information on the purpose of the study. Every clinic signed an informed consent to confirm their commitment to participate and to give permission for the use of their patient data for research purposes after anonymisation.
Applied intervention approach
A stewardship programme to optimise AMU was developed based upon previous qualitative research [19] and field experiences from co-authors involved in human medicine. The objectives of the ASP were to increase awareness on AMU, to decrease total AMU whenever possible and to shift AMU towards 1st choice agents, which is according to current guidelines on AMU. Cues from the RESET Model to change human behaviour were used; Rules & regulations, Education & information, Social pressure, Economics, and Tools [20,21]. A Support-Team (S-Team) was assembled, in the analogy of the human Antibiotic Stewardship-Teams (A-team) [22,23]. The S-team included a veterinary microbiologist, a veterinary specialist in internal medicine of companion animals, a veterinary pharmacologist, a hospital pharmacist and the project leader. The S-Team members were involved in the different elements of the ASP (Table 1).
The Dutch classification [26] of veterinary AMU (Table 2), current Dutch guidelines (on otitis externa, urinary tract infections and skin infections) and formulary on veterinary AMU, and legislation on mandatory susceptibility testing for veterinary use of 3rd choice AMs were used as treatment standards during the ASP [13,24–26].
Data collection and management
Participating clinics supplied clinic population data and monthly antimicrobial veterinary medicinal product (AVMP) prescription data. Information on the composition of the clinic’s animal population (represented by the number of dogs, cats and rabbits attending the clinic at least once in a specified 3-year period) and monthly AM prescription data were retrieved retrospectively from the PMS, once before participation in the ASP and once after participation in the ASP.
Outcome measures
The primary outcome measure was total AMU. AMU was further classified into 1st, 2nd and 3rd choice AMU (Table 2).
Systemic AMU was quantified as described and discussed in detail in previous study [16] and is comparable with the Defined Daily Dose Animal (DDDAVET), a measure suggested by the European Surveillance of Veterinary Antimicrobial Consumption group (ESVAC) [27,28]. In summary, a DDDACLINIC of 0.25 per month means that the average dog, cat and rabbit in the clinic was treated with antimicrobials for a 0.25 day per month. Per clinic, total DDDACLINIC was calculated per month and specified with 1st, 2nd and 3rd choice AMU. In the present study, only systemic (i.e. oral or parenteral) AMU was described. AMs applied topically were excluded from analyses.
Mean absolute AMU numbers are presented for 12–24 months and 0–12 months prior to the start of the intervention period and for a period of 12 months considered as the actual intervention period, taking one month transition time into account.
Statistical analysis
A mixed effect time series model was used to describe monthly AMU from 12 months before until 12 months after the introduction of the ASP, that allowed for a linear trend over time, while seasonal patterns were modelled using Fourier (sine- and cosine-) terms. AMU appeared to follow an approximate log-normal distribution and therefore log-transformed AMU-data were used as the dependent variable. As a result, presented models estimate geometric mean (GM) AMU. Geometric mean ratios (GMRs; the ratio of two GMs) are used to quantify effects (e.g., the ratio of the GM during the intervention period to that before the intervention period).
The effect of the intervention was modelled using a step function and by modelling a change in the (linear) time trend. For each clinic, a dummy variable was included to indicate the month the ASP was introduced, because AMU in that month could not be unambiguously assigned to either the pre- or post-intervention period (transition period).
Heterogeneity in baseline AMU, time trends, seasonal patterns, and intervention effects across different clinics were modeled using (correlated) random effects. Short-term time series dynamics were accounted for by an auto-regressive (AR1) structure and the residual variance was allowed to be different for each clinic.
The estimated average intervention effects (i.e. the stepwise change and change in time trend) across clinics are reported. The model was used to evaluate the overall effect of the ASP for total, 1st, 2nd, and 3rd choice AMU separately. Effects are expressed as GMRs and (alternatively) as proportional decreases in use. PWALD values are used to indicate whether the separate coefficients are significantly different from 0, PF values are used to indicate the significance of the overall intervention effect.
SAS (SAS 9.4, SAS Institute, Inc. Cary, NC, USA) was used to organise the data and the nlme package (version 3.1) in R (version 3.5) was used to perform the statistical analyses.
Results
Participating clinics
In total, 54 clinics were contacted to participate. Six of these clinics were not willing to participate and four clinics were excluded, because their PMS appeared not suitable to provide monthly prescription data. Finally, 44 clinics were included in the study.
Table 3 provides a summary of characteristics of participating clinics. All clinics provided AMU data prior to the introduction of the stewardship programme for a minimum of 25 months, except for one clinic, that provided data for only 13 months prior to the introduction of the ASP.
Data of 41 clinics were included in the data analysis. Three clinics were excluded from data analysis. One of these clinics was lost to follow-up (i.e. no response was received when (repeatedly) trying to retrieve the AM prescription data from the PMS after participation in the ASP) and two clinics had substantial changes in their clinic’s animal composition (i.e. one clinic closed and one clinic opened an extra location with the same PMS making AMU calculations unreliable).
Outcomes
Mean, absolute AMU (total, 1st, 2nd and 3rd choice AMU).
Mean total AMU was 0.134 and 0.132 DDDA/month, respectively, in the two years prior to implementation of the ASP and decreased to 0.114 DDDA/month during the period considered as the intervention period (Table 4). Similar decreasing trends were seen for 3rd choice AMU (i.e. fluoroquinolones and 3rd generation cephalosporins) and 2nd choice AMU (i.e. mainly aminopenicillins, with and without clavulanic acid). AMU shifted towards more 1st choice AMU.
Intervention effect.
As a result of participation in the ASP, a stepwise decrease was estimated for total, 1st and 2nd choice AMU of 15% (95% CI: 7%-22%; p<0.01), 15% (95% CI: 5%-24%; p<0.01) and 26% (95% CI: 17%-34%; p<0.01) respectively. No statistically significant effect was estimated for 3rd choice AMU. The change in (linear) time trend was statistically significant for total AMU only with an additional 16% decrease over the year (95% CI: 4%-26%; p = 0.01) (Table 5).
As absolute figures for 1st choice AMU were increasing (not visible from Fig 2A–2D, because the trend before the ASP was set at 100%), the net effect of the stepwise decrease in 1st choice AMU is a smaller increase in use than was expected based upon the pre-intervention time trend for 1st choice AMU.
Combined effect of participation in the ASP (stepwise change & change in time trend) are shown for the average effect (black) and for each individual clinic (grey) after standardisation to the estimated AMU before the intervention period (as 100%).
Although AMU decreased in most clinics, there were considerable differences in estimated intervention effects between clinics (Fig 2A–2D).
Discussion
A strong and statistically significant decrease in total, 1st and 2nd choice AMU was observed in a sample of Dutch companion animal clinics, with a shift towards use of 1st choice antimicrobials, that was attributed to participation in an antimicrobial stewardship programme (ASP). The change in total AMU became more prominent over time after introduction of the ASP.
The results of the statistical model indicate that 1st choice AMU decreased. However, absolute 1st choice AMU increased during the intervention period. Therefore, after introduction of the ASP, the net effect was a less pronounced increase in use of 1st choice AMs than was expected. The statistical model used to estimate the intervention effect, assumed a linear, random time trend per clinic and a stepwise reduction in AMU after adjustment for seasonal effects. The stepwise effect was observed in most clinics. No statistically significant effect on 3rd choice AMU could be attributed to participation in the ASP. This is likely explained by the fact that 3rd choice AMU was already reduced to a low level (0.009 DDDA/month, 0–12 months before implementation of the ASP) in the years preceding the ASP. Therefore, a further decrease as result of the ASP is difficult to demonstrate.
The goal of the ASP was to increase awareness on AMU, to decrease total AMU whenever possible and to shift AMU towards 1st choice AMs, according to Dutch guidelines on veterinary AMU [24,26]. The observed changes in the clinics participating in the ASP are in line with the goal of the ASP and the Dutch guidelines on veterinary AMU, and are therefore considered relevant.
A strength of the design of the present study is that repeated monthly measurements per clinic were involved, which allowed to control intervention effects for baseline levels and ongoing time trends. By starting the ASP at different timepoints for the four different clusters of clinics, the probability that the overall effect was influenced by external events was minimised (e.g., increased attention on responsible AMU in general) [6].
In general, measures to evaluate the effect of an ASP can be divided into four main categories: patient outcomes, unintended consequences of AMU (e.g., adverse effects and emergence of AMR), AMU and costs, and process measures [29]. As a possible limitation of present study, it could be argued that overall AMU is a non-specific measure without information on appropriateness of AM therapy or patient outcomes, as is the case for looking at 1st, 2nd and 3rd choice AMU [6,29–31]. Moreover and more important, an increase in quality of AMU can be reached without a reduction in AMU (or even with an increase in AMU), e.g., by using more 1st choice AMs instead of 2nd or 3rd choice AMs, or by using better dosing [6,32,33]. On the other hand, as any use of AMs selects for AMR, any reduction of AMU that can be achieved by improving adherence to current guidelines (by definition appropriate AMU) is an advantage, as is the case for using 1st instead of 2nd or 3rd choice AMs. The persistence of the effect during the follow-up period of 12 months (especially of total AMU with a significant change in linear time trend) suggests sustainability of the changes in AMU. However, repeated AMU-measurements in the nearby future are needed to evaluate the sustainability over a longer period of time.
A second limitation is the fact that participating clinics were contacted approximately 2–3 months before actual start of the ASP. This could have led to a change in AM prescribing behaviour already, because clinics knew their AM prescribing behaviour would be monitored. These 2–3 months are part of the baseline measurement period. As a result, the intervention/ASP effect could have been slightly diminished [6,34]. Another potential weakness of the stepped-wedge design is contamination of the interventions [6]. Information, insights or effects from clinics already having started the ASP could have influenced clinics still in the baseline period. Because participating clinics were clustered based on their geographic location, this effect was expected to be minimal, but could not be excluded.
The representativeness of the participating clinics for the whole country might be questioned. These 44 clinics were not randomly selected, but selection was based upon willingness to participate. It is possible that participating clinics already had a more responsible attitude towards AMU and had more motivation to change their AM prescribing behaviour compared to other not-participating clinics. On the other hand, results of the present study might also be regarded as a proof of principle. If even in clinics that already had an interest in responsible AMU, optimisation of AMU could be attained, clinics with less interest in responsible AMU might be able to change even more. However, and irrefutably, it will be harder to change behaviour of veterinarians who do not believe that responsible AMU is a desirable or necessary behaviour [19,20,35].
Antimicrobial prescribing behaviour is influenced by many factors. Multifaced interventions, attuned to the specific setting and influencing factors of AMU are advised to optimise AM prescribing behaviour [7,8,18,19,36–38]. The present ASP was based upon a previous qualitative study and the RESET model, containing the most important cues to change human behaviour [19,20]. Only ‘Economics’, covering profits and costs, bonuses and penalties, as a factor influencing prescribing behaviour was not addressed directly in the ASP. However, the importance of economics was discussed (e.g., the difference between earning money because of prescribing AMs versus performing further diagnostics). Besides, clinics were aware of possible inspections by the Dutch Food and Consumer Product Safety Authority (NVWA) of the Dutch Government, possibly leading to financial penalties in case of prescribing 3rd choice AMs without culture and susceptibility testing.
The present study showed that the developed ASP was effective in reducing and refining AMU in the participating clinics. An evaluation survey among participants and a stakeholders consultation will elucidate which intervention elements are the most promising elements for future implementation in other clinics or countries [39].
Conclusions
Participation in a multifaceted antimicrobial stewardship programme to optimise AMU in companion clinics, showed a positive effect on AMU in Dutch companion animal clinics. For future and feasible, large scale implementation, the most effective and efficient parts of the ASP need to be selected.
Acknowledgments
We are very grateful to all 44 participating veterinary clinics for providing their AMU data and for investing their time during participation in the ASAP-project. We thank R.J. Wessels for his help during the post educational trainings and we thank A.W. van der Velden for her help in developing the patient evaluation forms. We also thank the remaining members of the ASAP-project group, L.J. Hellebrekers and M.F.M. Langelaar, for their highly-appreciated input.
References
- 1.
World Health Organisation (WHO). Global action plan on antimicrobial resistance; https://www.who.int/antimicrobial-resistance/publications/global-action-plan/en/ 2015. Last accessed: 1 July 2019.
- 2. Collignon PC, Conly JM, Andremont A, McEwen SA, Aidara-Kane A, World Health Organization Advisory Group, Bogota Meeting on Integrated Surveillance of Antimicrobial Resistance (WHO-AGISAR), et al. World Health Organisation Ranking of Antimicrobials According to Their Importance in Human Medicine: A Critical Step for Developing Risk Management Strategies to Control Antimicrobial Resistance From Food Animal Production. Clin Infect Dis. 2016;63: 1087–1093. pmid:27439526
- 3. AVMA Task Force for Antimicrobial Stewardship in Companion Animal Practice. Antimicrobial stewardship in companion animal practice. J Am Vet Med Assoc. 2015;246: 287–288. pmid:25587725
- 4. Schuts EC, Hulscher MEJL, Mouton JW, Verduin CM, Stuart JWTC, Overdiek HWPM, et al. Current evidence on hospital antimicrobial stewardship objectives: a systematic review and meta-analysis. The Lancet Infectious Diseases. 2016;16: 847–856. pmid:26947617
- 5. Dyar OJ, Huttner B, Schouten J, Pulcini C, ESGAP (ESCMID Study Group for Antimicrobial stewardship). What is antimicrobial stewardship? Clin Microbiol Infect. 2017;23: 793–798. pmid:28882725
- 6. Sikkens JJ, van Agtmael MA, Peters EJG, Lettinga KD, van der Kuip M, Vandenbroucke-Grauls CMJE, et al. Behavioral Approach to Appropriate Antimicrobial Prescribing in Hospitals: The Dutch Unique Method for Antimicrobial Stewardship (DUMAS) Participatory Intervention Study. JAMA Intern Med. 2017;177: 1130–1138. pmid:28459929
- 7. Kallen MC, Ten Oever J, Prins JM, Kullberg BJ, Schouten JA, Hulscher MEJL. A survey on antimicrobial stewardship prerequisites, objectives and improvement strategies: systematic development and nationwide assessment in Dutch acute care hospitals. J Antimicrob Chemother. 2018;73: 3496–3504. pmid:30252063
- 8. Guardabassi L, Prescott JF. Antimicrobial stewardship in small animal veterinary practice: from theory to practice. Vet Clin North Am Small Anim Pract. 2015;45: 361–76, vii. pmid:25721619
- 9.
NethMap/MARAN. NethMap: Consumption of antimicrobial agents and antimicrobial resistance among medically important bacteria in the Netherlands/MARAN: Monitoring of antimicrobial resistance and antibiotic usage in animals in the Netherlands in 2017. 2018.
- 10. Speksnijder DC, Mevius DJ, Bruschke CJ, Wagenaar JA. Reduction of veterinary antimicrobial use in the Netherlands. The Dutch success model. Zoonoses Public Health. 2015;62 Suppl 1: 79–87. pmid:25421382
- 11. Dorado-Garcia A, Mevius DJ, Jacobs JJ, Van Geijlswijk IM, Mouton JW, Wagenaar JA, et al. Quantitative assessment of antimicrobial resistance in livestock during the course of a nationwide antimicrobial use reduction in the Netherlands. J Antimicrob Chemother. 2016;71: 3607–3619. dkw308. pmid:27585970
- 12. Hesp A, Veldman K, van der Goot J, Mevius D, van Schaik G. Monitoring antimicrobial resistance trends in commensal Escherichia coli from livestock, the Netherlands, 1998 to 2016. Euro Surveill. 2019;24: pmid:31241037
- 13.
Staatscourant. Regeling van de Staatssecretaris van Economische Zaken van 14 januari 2013, nr. WJZ / 13002270, houdende wijziging van de Regeling diergeneesmiddelen in verband met het uitvoeren van een gevoeligheidsbepaling bij toepassing of aflevering van bepaalde diergeneesmiddelen (Regulation of the State Secretary of Economic Affairs, 4 January 2013, nr WJZ / 13002270, considering amendement of the Regulation on veterinary medicines, with reference to performance of sensitivity testing when applying or delivering certain veterinary medicines). 2013. https://zoek.officielebekendmakingen.nl/stcrt-2013-947.html. Last accessed: 26 August 2019.
- 14.
WHO. Critically important antimicrobials for human medicine. 2019; 6th revision. https://www.who.int/foodsafety/publications/antimicrobials-sixth/en. Last accessed: 1 July 2019.
- 15. Van Geijlswijk I, Alsters S, Schipper L. Prescription of antimicrobial agents in companion animal practices. Tijdschr Diergeneeskd. 2013;138: 26–29.
- 16. Hopman NEM, van Dijk MAM, Broens EM, Wagenaar JA, Heederik DJJ, van Geijlswijk IM. Quantifying Antimicrobial Use in Dutch Companion Animals. Front Vet Sci. 2019;6: 158. pmid:31192236
- 17. Hulscher ME, Grol RP, van der Meer JW. Antibiotic prescribing in hospitals: a social and behavioural scientific approach. The Lancet infectious diseases. 2010;10: 167–75. pmid:20185095
- 18. Hulscher ME, van der Meer JW, Grol RP. Antibiotic use: how to improve it? Int J Med Microbiol. 2010;300: 351–356. pmid:20434950
- 19. Hopman NEM, Hulscher MEJL, Graveland H, Speksnijder DC, Wagenaar JA, Broens EM. Factors influencing antimicrobial prescribing by Dutch companion animal veterinarians: A qualitative study. Prev Vet Med. 2018;158: 106–113. pmid:30220383
- 20. Lam TJGM, Jansen J, Wessels RJ. The RESET Mindset Model applied on decreasing antibiotic usage in dairy cattle in the Netherlands. Ir Vet J. 2017;70: 5-017-0085-x. eCollection 2017. pmid:28250915
- 21.
Wessels RJ, Lam TJGM, Jansen J. Communication in Practice. The vet's manual on clienthusiasm: CIP: ISBN 978-90-822321-0-3; 2014.
- 22.
SWAB. A-teams (Antibiotic Team): www.ateams.nl. Last accessed: 1 July 2019.
- 23.
SWAB. Stichting Werkgroep Antibioticabeleid (Dutch Working Party on Antibiotic Policy), www.swab.nl. Last accessed: 1 July 2019.
- 24.
WVAB (Dutch Working Party on Veterinary Antibiotic Policy). Formularium: Formulary companion animals: dog, cat and rabbit. 2018. https://www.wvab.nl. Last accessed: 1 July 2019.
- 25.
KNMvD (Royal Dutch Veterinary Association). Richtijnen (guidelines): https://www.knmvd.nl/dossier/kwaliteit/richtlijnen. Last accessed: 1 July 2019.
- 26.
WVAB (Dutch Working Party on Veterinary Antibiotic Policy). WVAB-richtlijn classificatie van veterinaire antimicrobiële middelen: www.wvab.nl/richtlijnen/. Last accessed 1 July 2019.
- 27.
European Medicines Agency (EMA). Principles on assignment of defined daily dose for animals (DDDvet) and defined course dose for animals (DCDvet). 2015;EMA/710019/2014.
- 28.
EMA. Defined daily doses for animals (DDDvet) and defined course doses for animals (DCDvet). European Surveillance of Veterinary Antimicrobial Consumption (ESVAC). 2016;EMA/224954/2016.
- 29. Dodds Ashley ES, Kaye KS, DePestel DD, Hermsen ED. Antimicrobial stewardship: philosophy versus practice. Clin Infect Dis. 2014;59 Suppl 3: S112–21. pmid:25261538
- 30. Schouten JA, Berrevoets MAH, Hulscher ME. Quality Indicators to Measure Appropriate Antibiotic Use: Some Thoughts on the Black Box. Clin Infect Dis. 2017;64: 1295. pmid:28329185
- 31. Spivak ES, Cosgrove SE, Srinivasan A. Measuring Appropriate Antimicrobial Use: Attempts at Opening the Black Box. Clin Infect Dis. 2016;63: 1639–1644. ciw658. pmid:27682070
- 32. Van den Bosch CM, Geerlings SE, Natsch S, Prins JM, Hulscher ME. Quality indicators to measure appropriate antibiotic use in hospitalized adults. Clin Infect Dis. 2015;60: 281–291. pmid:25266285
- 33. Kallen MC, Roos-Blom MJ, Dongelmans DA, Schouten JA, Gude WT, de Jonge E, et al. Development of actionable quality indicators and an action implementation toolbox for appropriate antibiotic use at intensive care units: A modified-RAND Delphi study. PLoS One. 2018;13: e0207991. pmid:30496227
- 34. McCarney R, Warner J, Iliffe S, van Haselen R, Griffin M, Fisher P. The Hawthorne Effect: a randomised, controlled trial. BMC Med Res Methodol. 2007;7: 30-2288-7-30. 1471-2288-7-30.
- 35. Ajzen I. The theory of planned behavior. Organizational Behavior and Human Decision Processes. 1991;50: 179–211. https://doi.org/10.1016/0749-5978(91)90020-T.
- 36. King C, Smith M, Currie K, Dickson A, Smith F, Davis M, et al. Exploring the behavioural drivers of veterinary surgeon antibiotic prescribing: a qualitative study of companion animal veterinary surgeons in the UK. BMC Vet Res. 2018;14: 332-018-1646-2. pmid:30404649
- 37. Smith M, King C, Davis M, Dickson A, Park J, Smith F, et al. Pet owner and vet interactions: exploring the drivers of AMR. Antimicrob Resist Infect Control. 2018;7: 46-018-0341-1. eCollection 2018. pmid:29619213
- 38. Mateus AL, Brodbelt DC, Barber N, Stark KD. Qualitative study of factors associated with antimicrobial usage in seven small animal veterinary practices in the UK. Prev Vet Med. 2014;117: 68–78. pmid:25091861
- 39.
Hulscher M, Laurant M, Grol R. Process evaluation of implementation strategies. In: Grol R, Wensing M, Eccles M, Davis D, editors. Improving patient care: the implementation of change in health care. Chichester, West Sussex: Wiley-Blackwell/BMJ Books; 2013. pp. 333–349. https://doi.org/10.1002/9781118525975.ch22.