Antimicrobial Resistance is a global crisis that veterinarians contribute to through their use of antimicrobials in animals. Antimicrobial stewardship has been shown to be an effective means to reduce antimicrobial resistance in hospital environments. Effective monitoring of antimicrobial usage patterns is an essential part of antimicrobial stewardship and is critical in reducing the development of antimicrobial resistance. The aim of this study is to describe how frequently antimicrobials were used in veterinary consultations and identify the most frequently used antimicrobials. Using VetCompass Australia, Natural Language Processing techniques, and the Australian Strategic Technical Advisory Group’s (ASTAG) Rating system to classify the importance of antimicrobials, descriptive analysis was performed on the antimicrobials prescribed in consultations from 137 companion animal veterinary clinics in Australia between 2013 and 2017 (inclusive). Of the 4,400,519 consultations downloaded there were 595,089 consultations where antimicrobials were prescribed to dogs or cats. Antimicrobials were dispensed in 145 of every 1000 canine consultations; and 38 per 1000 consultations involved high importance rated antimicrobials. Similarly with cats, 108 per 1000 consultations had antimicrobials dispensed, and in 47 per 1000 consultations an antimicrobial of high importance rating was administered. The most common antimicrobials given to cats and dogs were cefovecin and amoxycillin clavulanate, respectively. The most common topical antimicrobial and high-rated topical antimicrobial given to dogs and cats was polymyxin B. This study provides a descriptive analysis of the antimicrobial usage patterns in Australia using methods that can be automated to inform antimicrobial use surveillance programs and promote antimicrobial stewardship.
Citation: Hur BA, Hardefeldt LY, Verspoor KM, Baldwin T, Gilkerson JR (2020) Describing the antimicrobial usage patterns of companion animal veterinary practices; free text analysis of more than 4.4 million consultation records. PLoS ONE 15(3): e0230049. https://doi.org/10.1371/journal.pone.0230049
Editor: Simon Russell Clegg, University of Lincoln, UNITED KINGDOM
Received: July 13, 2019; Accepted: February 20, 2020; Published: March 13, 2020
Copyright: © 2020 Hur et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Code used for performing the antimicrobial extraction is open access and freely available at: https://www.github.com/havocy28/vetrxmapper. Tables with the summary of the data reported is open access and freely available at: https://havocy28.github.io/am_usage. As the underlying data being reported is clinical data, VetCompass Australia only permits active members of the research consortium direct access to the data. To apply to become an active member of the research consortium, contact email@example.com.
Funding: BAH was a recipient of a Research Training Program Scholarship.
Competing interests: The authors have declared that no competing interests exist.
Infections due to microorganisms such as bacteria, fungi, parasites and viruses were a major cause of death until the discovery of antimicrobials . While antimicrobials save countless lives , resistance to these drugs has been detected in clinical specimens soon after their introduction to clinical practice . Antimicrobial resistance (AMR) in bacteria has shown a dramatic increase over the last decade and is currently considered an emergent global phenomenon and a major public health problem . Companion animals are able to acquire and exchange multidrug resistant pathogens with humans, and may serve as a reservoir of antimicrobial resistance for in-contact people [5–8]. In addition, AMR is causing poor animal health and welfare outcomes associated with treatment failures in veterinary medicine [9,10]. Knowledge of antimicrobial usage patterns is critical in the implementation and monitoring of antimicrobial stewardship programs. Antimicrobial stewardship (AMS) has been shown to be one of the most effective ways to reduce AMR in a hospital environment [11–14].
VetCompass is a software application that harvests clinical records from veterinary practices into a central repository , and is a collaboration between the Royal Veterinary College (RVC) and a consortium of veterinary schools in Australia, focused on improving animal health . This centralized repository of clinical records gives a unique opportunity to examine records that are otherwise held in individual clinics. VetCompass Australia currently has 181 participating practices representing 5.6% of 3,222 of the Australian veterinary clinics [17,18] There have been several studies from VetCompass UK covering antimicrobial usage patterns, disease prevalence, and causes of mortality [19–24]. Similarly, the Small Animal Veterinary Surveillance Network (SAVSNET) is another centralized repository of veterinary records that has also reported on antimicrobial usage patterns [25,26]. The studies from VetCompass UK have used methods which involve the annotation of inventory items of interest by an expert which is a time-consuming and expensive task. Studies from SAVSNET have used methods involving string searching and checking a subset of records. These methods limit the amount of data that can be used, and in doing so, reduce the ability to perform fine-grained post hoc analysis of specific cases.
Natural Language Processing (NLP) and automatic text analysis can overcome the challenges of manual labelling of such data, enabling large-scale extraction of key antimicrobial usage information in a structured format, to allow subsequent analysis . NLP is a field of study that sits at the intersection of artificial intelligence and linguistics . The goal of NLP is to automate language analysis, enabling people to communicate more naturally with machines, improving the way humans communicate with each other, or extracting actionable data from text . In this study, NLP was used for text mining, which is the discovery of non-trivial knowledge from unstructured text .
The aim of this study was to identify how frequently antimicrobials were prescribed in companion animal practice in Australia, and which antimicrobials were prescribed. This work builds upon our previous work and used previously developed NLP methods  to extract antimicrobial usage information in a structured format so we could perform descriptive analysis of the antimicrobial usage patterns of the practices contributing data to VetCompass Australia.
Materials and methods
De-identified data was sourced from VetCompass Australia (Version 0.3) (2013–2017 inclusive) . Clinical data from 93 practices was required in order to be 95% confident that the estimated rate of antimicrobial usage (AMU) in the 3,222 veterinary clinics of Australia was within 10% of the actual rate of AMU, based on Cochran’s formula for the representativeness of proportions . Antimicrobials were rated according to the antimicrobial importance rating from the Australian Strategic and Technical Advisory Group on Antimicrobial Resistance (ASTAG) which classifies the antimicrobials as low, medium or high importance . Inventory items, which map to all prescriptions and consultation texts, were extracted from the records. Inventory items consist of any item recorded anywhere in the electronic patient record during a visit. Consultation texts include all clinical notes entered in the record in a free text field. Annotations from a subset of data from the state of Victoria were expertly annotated by two veterinarians, for use as the gold standard in assessing the accuracy of the algorithms. A high level of agreement was confirmed between the expert annotators (Fleiss Kappa score of 0.868) . Algorithms were developed and tested on this sample and the most accurate methods for extracting the antimicrobials used in each consult were selected. The created algorithm utilized rule-based logic and a modified version of Levenshtein distance (edit distance, allowing fuzzy string matching) to measure the similarities between individual words [31,34] in order to identify antimicrobial agents in clinical records. The algorithm was determined to have a 96.7% accuracy and an F1 score of 0.85 in extracting the antimicrobial from each consult based on the gold standard annotations . The code developed can be found at: https://www.github.com/havocy28/vetrxmapper. Records were labeled with this algorithm and the distinct items were mapped to their ingredients and ASTAG importance ratings. Inventory items identified as antimicrobial agents were then annotated separately, and reconciled between two veterinarians, as being either topical or systemic medications, along with their World Health Organization (WHO) ratings. Inventory items were imported into a SQL server database and joined to the VetCompass records that had matching item names. As many consultation records were blank with no inventory items associated with them, the consultation table was inner joined to the table with the inventory items associated with them. At least one inventory item and one clinical note combined for a single consultation was required for inclusion in the study. Each inventory item and antimicrobial agent prescribed during a consult is linked to the consultation number and counted as a single consult to the individual patient, regardless of how many items are present in the consult. The postal code of the clinic where each consult took place was mapped to regional descriptions of urban, regional, or suburban using the Australian Bureau of Statistics (ABS) mapping of postal codes .
Due to changes in electronic medical record systems, the import of medical records from some practice management software applications did not capture all of the prescription record data, and imported the dispensed medications with descriptions such as “miscellaneous” or “miscellaneous drugs” with no associated prescription labels. Where more than 35% of items were dispensed contained the string ‘misc’ within a given month, these months were excluded from the analysis of that clinic’s records. This included 677 (10%) of the 6,779 months analyzed. Antiprotozoal and antifungal agents were also excluded, as were records where these agents were the only items mapped to the examination note.
Age was reported by subtracting the reported year of birth from the date of the consult, and categorized into yearly increments. Practice usage was reported where there were at least 1,000 consults present. Data was loaded into Microsoft SQL Server 2017 on Linux . All code was written in Python with scikit-learn libraries to perform the machine learning and statistical tests on the algorithms. All descriptive statistics, computations, and visualizations were performed using Tableau 2019.1  with maps of Australia from OpenStreetMap contributors . Significance between values were tested using Pearson’s Chi-squared test.
A total of 17,797,377 inventory items were identified from the 137 clinics from which sufficient data was available during the study period. These items were mapped to 4,400,519 consultation records. Of the consultation records analyzed, 1,132,986 (26%) records were from 199,358 cats and 3,263,615 (74%) records were from 513,964 dogs. Occasionally, a dog and cat were recorded within the same consultation. There were 595,089 (14%) consultations recorded where antimicrobials were dispensed and 176,243 (4%) consultations where an antimicrobial with high-importance rating was administered or dispensed.
Cat consultations had antimicrobials dispensed in 108 per 1000 consultations, and high-importance rated antimicrobials dispensed in 47 per 1000 consultations. Dogs had higher usage than cats (P < 0.0001) with 145 antimicrobials dispensed per 1000 consultations, but were administered high importance rated antimicrobials in 38 per 1000 consultations, which was less frequently than cats (P < 0.0001).
Dogs less than 1 year in age received significantly fewer antimicrobials overall (95 per 1000 consultations) (Fig 1A), and fewer antimicrobials with high importance rating (23 per 1000 consultations) compared to dogs older than 1 year (P < 0.0001) (Fig 1B). Cats were also prescribed a significantly lower rate of antimicrobials (92 per 1000 consultations) (Fig 2A), and high importance rated antimicrobials (26 per 1000 consultations), during the first year of their lives compared to cats greater than 1 year (P < 0.0001) (Fig 2B).
(A) rate of antimicrobial prescription per 1000 consultations. (B) rate of high-importance antimicrobial prescription per 1000 consultations. (C) number of unique consultations. Years with fewer than 2000 consultations excluded.
(A) rate of antimicrobial prescription per 1000 consultations. (B) rate of high-importance antimicrobial prescription per 1000 consultations. (C) number of unique consultations. Years with fewer than 2000 consultations excluded.
The range of antimicrobials being administered varied significantly (P < 0.0001) between states from 124 to 141 (median 140) consultations with antimicrobial prescriptions per 1000 consultations (Fig 3). The rate of consultations where antimicrobials with high-importance rating were prescribed varied significantly (P < 0.0001) between states from 39 to 49 (median 40) per 1000 consultations (Fig 4). Antimicrobial use in major cities, inner, and outer regional areas of Australia were different (P < 0.0001) at 136, 138, and 123 consultations with antimicrobial prescriptions per 1000 consultations, respectively. Consultations where high-importance rated antimicrobials were given in inner regional areas, major cities, and outer regional areas of Australia was also different (P < 0.0001), at 41, 35, and 35 per 1000 consultations respectively.
At the level of individual clinics, 127 clinics matched the selection criteria. The proportion of consultations when at least one antimicrobial was prescribed varied significantly (P < 0.0001), and ranged from 57 times per 1000 consultations to 314 per 1000 consultations (median 131) (Fig 5). Dispensing of antimicrobials with high-importance rating was also different (P < 0.0001) between clinics, ranging from 15 to 85 (median 39) times per 1000 consultations (Fig 5). Emergency and referral centers dispensed antimicrobials 250 times per 1000 consultations and high-importance rated antimicrobials 40 per 1000 consultations. This was higher than general practice clinics (P < 0.0001), which dispensed antimicrobials 132 times per 1000 consultations and high-importance rated antimicrobials 40 times per 1000 consultations.
(A) rate of antimicrobial prescription per 1000 consultations. (B) rate of high-importance antimicrobial prescription per 1000 consultations with inter-quartile range is shown in grey. Each dot represents an individual clinic. Clinics with fewer than 1000 consultations excluded.
The most common antimicrobial, and the most common high-importance rated antimicrobial, given to cats was Cefovecin (32% of consultations where antimicrobials were dispensed) (Table 1). The most common topical and high-importance rated topical antimicrobial given to cats was polymyxin B (7.1% of consultations where antimicrobials were dispensed). The most common antimicrobial given to dogs was amoxycillin clavulanate (34% of consultations where antimicrobials were dispensed) (Table 2). The most common high-importance rated antimicrobial dispensed systemically to dogs was enrofloxacin (3.2% of consultations where antimicrobials were dispensed) (Table 2). The most common topical and high rated antimicrobial dispensed to dogs, was polymyxin B (16.9% of consultations where antimicrobials were dispensed). A table with the results of the analysis can be downloaded for further comparisons at: https://havocy28.github.io/am_usage/.
Agents with less than 0.01% of the total were omitted. Consults containing both systemic and topical events were counted as one.
This study is the largest evaluation of antimicrobial prescribing patterns in companion animals to date and gives insight into variation between practices and practice types. Use of Natural Language Processing, and large datasets, allows for the evaluation of antimicrobial prescribing patterns by enabling detailed analysis at the individual consultation level on a per clinic basis. The results demonstrate that while a higher number of antimicrobials are prescribed to dogs, as compared to cats, in cats there is a higher rate of antimicrobials with high-importance rating being dispensed. This is due primarily to the prescribing of cefovecin to cats, a long-acting 3rd generation cephalosporin, consistent with previous research in Australia . However, the previous study of insured pets showed that cats had 47% lower exposure to antimicrobials compared to dogs in any one year, whereas in the current study the difference was only 7.5%. This may be explained by differences in insured and predominately non-insured populations. Higher antimicrobials prescribing in dogs may be due to increased routine preventative health exams performed for cats versus dogs, as reported previously . Further research is needed to investigate these differences. The lower rate of antimicrobial prescribing in younger animals could also be explained by frequent routine appointments for younger pets (vaccination, neutering) that generally do not involve antimicrobial therapy. Further research is required to confirm this.
Difference between states in both the proportion of antimicrobials (12.3% to 14.9%) and high rated antimicrobials (4.0% to 4.9%) may be explained by differences between the types of consultations seen at individual clinics. Variation between clinics and practice types may be due to a higher number of consultations for vaccinations, annual exams, or other routine activities in general practice, which are generally not seen in referral or emergency practices. This variation between practice types is similar in human medicine where emergency practices and some specialties, such as dermatology, have a higher rate of antibiotic prescriptions . Further research is required to investigate these variations.
Considering only consultations where a systemic antimicrobial was dispensed, 47% had amoxicillin clavulanate dispensed, which was very similar to the UK where 45% of patients received amoxicillin clavulanate . This data from VetCompass UK reported antimicrobial events per patient over a period of time compared to individual consultation events reported in our study. This means that patients receiving having multiple consults with antimicrobials during separate consults would only be counted as one event in this UK study, which could account for some of the variation. However, the rate of overall antimicrobial usage for dogs (14%) and cats (11%) varied considerably from a different UK population based on SAVSNET which reported on consultation events, where the figures were 35% for dogs and 49% for cats. However, this study only examined patients presenting with a disease  which would reasonably be more likely to require antimicrobials. Polymyxin B was given at a relatively high rate in both dogs (16.9%) and cats (7.1%) topically. Veterinary usage of polymyxin B has previously come under scrutiny for its oral administration in food animals [42,43]. Further research is required to better understand the significance, if any, of polymyxin B usage in companion animals and its contribution to antimicrobial resistance more broadly.
Of the antimicrobials with high-importance rating, cefovecin was the most frequently administered (16% of all antimicrobials). This was primarily due to the high usage in cats (32%) as it was used ten times less frequently in dogs (3.1%). Only 3 other agents of high-importance rating administered systemically had greater than 0.1% rate of administration: the fluoroquinolones enrofloxacin, marbofloxacin, and ofloxacin. Of these fluoroquinolones, enrofloxacin was used the most frequently, but still only represented 3.3% of all the antimicrobials being dispensed (3.5% for dogs). Importantly there were no glycopeptides, such as vancomycin, or carbapenems, such as imipenem, found in the dataset, which are generally thought of as the last line of antibiotics in human medicine .
The methods used in this study enhance the ability to use large-scale data and overcome some of the limitations previously encountered due to a lack of standards in fields, where data was entered into the electronic records . NLP methods for extraction of prescription information have been well documented in various studies in human medicine , however relevant clinical practice data is difficult to access from the medical sector at a large scale due to privacy considerations. Central data repositories such as VetCompass and SAVSNET help overcome this issue in veterinary medicine, allowing for an approach using NLP that benefits both human and veterinary medicine by demonstrating their applicability to address important questions about real-world practice patterns. The implementation of these algorithms to extract antimicrobials out of prescriptions is the largest study at the time of this paper. By using algorithms to match antimicrobials, and verifying the accuracy of these algorithms through expert annotation of the original records, we have been able to perform data analysis on the antimicrobial usage patterns on a very large number of clinical records.
Data analysis performed in this study was limited to version 0.3 of VetCompass-Australia. There are also some records that are linked to the wrong patients, caused by duplicate IDs within the database; this was estimated to effect < 0.01% of the records. Our data was obtained at the consult level, meaning that describing the number of antimicrobials received at the individual patient level was not possible, as some patients may attend other veterinary clinics not recorded in VetCompass. The reason that a patient was prescribed antimicrobials was not analyzed for this study as this required analysis of the free text of the medical record, which was not labeled, and was therefore outside the scope of this study. Further methods are being developed currently to undertake analysis of the clinical records to determine the reason for the consults and appropriateness of antimicrobial use. Additionally, the size of the sample in this study results in very small differences becoming “statistically significant”. This is a common issue with big data [46–48]. In this scenario, the clinical significance of results becomes much more important and should be considered in the interpretation of results .
Utilizing Natural Language Processing and VetCompass Australia, we have created a detailed analysis of antimicrobial usage on a per clinic basis. Overall, approximately 14% of consultations had antimicrobials dispensed, and in 3.9% of consultations antimicrobial of high-importance rating were administered or dispensed. The most common antimicrobial dispensed to dogs was amoxycillin clavulanate (34%), while cefovecin (32%) was the antimicrobial agent most frequently administered to cats. The most common antimicrobial of high-importance rating administered to cats and dogs was cefovecin and enrofloxacin, respectively. These results provide a description of the usage over a 5-year period that can be used to inform changes in practice prospectively, and can support the continued surveillance of antimicrobial usage in companion animal veterinary practices in Australia.
This research was undertaken with the assistance of information and other resources from the VetCompass Australia consortium under the project "VetCompass Australia: Big Data and Real-time Surveillance for Veterinary Science*", which is supported by the Australian Government through the Australian Research Council LIEF scheme (LE160100026).
- 1. WHO | World Health Organization. In: WHO [Internet]. [cited 15 Feb 2019]. Available: http://www.who.int/antimicrobial-resistance/Microbes_and_Antimicrobials/en/
- 2. Aminov RI. A Brief History of the Antibiotic Era: Lessons Learned and Challenges for the Future. Front Microbiol. 2010;1. pmid:21687722
- 3. Rollo IM, Williamson J, Plackett RL. Acquired Resistance To Penicillin And To Neoarsphenamine In Spirochaeta Recurrentis. British Journal of Pharmacology and Chemotherapy. 1952;7: 33–41. pmid:14904900
- 4. Roca I, Akova M, Baquero F, Carlet J, Cavaleri M, Coenen S, et al. The global threat of antimicrobial resistance: science for intervention. New Microbes and New Infections. 2015;6: 22–29. pmid:26029375
- 5. Lloyd DH. Reservoirs of antimicrobial resistance in pet animals. Clin Infect Dis. 2007;45 Suppl 2: S148–152. pmid:17683019
- 6. Guardabassi L, Schwarz S, Lloyd DH. Pet animals as reservoirs of antimicrobial-resistant bacteriaReview. J Antimicrob Chemother. 2004;54: 321–332. pmid:15254022
- 7. Allen HK, Donato J, Wang HH, Cloud-Hansen KA, Davies J, Handelsman J. Call of the wild: antibiotic resistance genes in natural environments. Nature Reviews Microbiology. 2010;8: 251–259. pmid:20190823
- 8. Graveland H, Wagenaar JA, Heesterbeek H, Mevius D, Duijkeren E van, Heederik D. Methicillin Resistant Staphylococcus aureus ST398 in Veal Calf Farming: Human MRSA Carriage Related with Animal Antimicrobial Usage and Farm Hygiene. PLOS ONE. 2010;5: e10990. pmid:20544020
- 9. Duff A, Keane S, Hardefeldt LY. Descriptive study of antimicrobial susceptibilty patterns from equine septic synovial structures. Proceedings of the 39th Bain Fallon Memorial Lectures. Equine Veterinarians Australia;
- 10. Johnston G, Lumsden J. Antimicrobial susceptiblity of bacterial isolates from 27 thoroughbreds with arytenoid chondropathy. Proceedings of the 39th Bain Fallon Memorial Lectures. Equine Veterinarians Australia;
- 11. Arda B, Sipahi OR, Yamazhan T, Tasbakan M, Pullukcu H, Tunger A, et al. Short-term effect of antibiotic control policy on the usage patterns and cost of antimicrobials, mortality, nosocomial infection rates and antibacterial resistance. Journal of Infection. 2007;55: 41–48. pmid:17512598
- 12. Pulcini C, Botelho-Nevers E, Dyar OJ, Harbarth S. The impact of infectious disease specialists on antibiotic prescribing in hospitals. Clinical Microbiology and Infection. 2014;20: 963–972. pmid:25039787
- 13. Baur D, Gladstone BP, Burkert F, Carrara E, Foschi F, Döbele S, et al. Effect of antibiotic stewardship on the incidence of infection and colonisation with antibiotic-resistant bacteria and Clostridium difficile infection: a systematic review and meta-analysis. The Lancet Infectious Diseases. 2017;17: 990–1001. pmid:28629876
- 14. Cisneros JM, Neth O, Gil-Navarro MV, Lepe JA, Jiménez-Parrilla F, Cordero E, et al. Global impact of an educational antimicrobial stewardship programme on prescribing practice in a tertiary hospital centre. Clinical Microbiology and Infection. 2014;20: 82–88. pmid:23517432
- 15. VetCompass Australia. [cited 5 Feb 2019]. Available: http://www.vetcompass.com.au/about-us/
- 16. VetCompass—Royal Veterinary College, RVC. [cited 5 Feb 2019]. Available: https://www.rvc.ac.uk/vetcompass/about
- 17. Veterinary Services–Australia Industry Research Reports | IBISWorld. [cited 12 Jul 2019]. Available: https://www.ibisworld.com.au/industry-trends/market-research-reports/professional-scientific-technical-services/veterinary-services.html
- 18. McGreevy P, Thomson P, Dhand NK, Raubenheimer D, Masters S, Mansfield CS, et al. VetCompass Australia: A National Big Data Collection System for Veterinary Science. 2017; 15.
- 19. O’Neill DG, Church DB, McGreevy PD, Thomson PC, Brodbelt DC. Longevity and mortality of cats attending primary care veterinary practices in England. Journal of Feline Medicine and Surgery. 2015;17: 125–133. pmid:24925771
- 20. Stephens MJ, Neill DGO, Church DB, McGreevy PD, Thomson PC, Brodbelt DC. Feline hyperthyroidism reported in primary-care veterinary practices in England: prevalence, associated factors and spatial distribution. Veterinary Record. 2014;175: 458–458. pmid:25028466
- 21. O′Neill DG, Church DB, McGreevy PD, Thomson PC, Brodbelt DC. Prevalence of Disorders Recorded in Dogs Attending Primary-Care Veterinary Practices in England. PLOS ONE. 2014;9: e90501. pmid:24594665
- 22. O’Neill DG, Church DB, McGreevy PD, Thomson PC, Brodbelt DC. Prevalence of disorders recorded in cats attending primary-care veterinary practices in England. The Veterinary Journal. 2014;202: 286–291. pmid:25178688
- 23. Chipangura JK, Eagar H, Kgoete M, Abernethy D, Naidoo V. An investigation of antimicrobial usage patterns by small animal veterinarians in South Africa. Preventive Veterinary Medicine. 2017;136: 29–38. pmid:28010905
- 24. Mattin MJ, Boswood A, Church DB, López‐Alvarez J, McGreevy PD, O’Neill DG, et al. Prevalence of and Risk Factors for Degenerative Mitral Valve Disease in Dogs Attending Primary-care Veterinary Practices in England. Journal of Veterinary Internal Medicine. 2015;29: 847–854. pmid:25857638
- 25. Radford AD, Noble PJ, Coyne KP, Gaskell RM, Jones PH, Bryan JGE, et al. Antibacterial prescribing patterns in small animal veterinary practice identified via SAVSNET: the small animal veterinary surveillance network. Veterinary Record. 2011;169: 310–310. pmid:21911433
- 26. Singleton DA, Sánchez-Vizcaíno F, Dawson S, Jones PH, Noble PJM, Pinchbeck GL, et al. Patterns of antimicrobial agent prescription in a sentinel population of canine and feline veterinary practices in the United Kingdom. The Veterinary Journal. 2017;224: 18–24. pmid:28697871
- 27. Tao C, Filannino M, Uzuner Ö. Prescription extraction using CRFs and word embeddings. Journal of Biomedical Informatics. 2017;72: 60–66. pmid:28684255
- 28. Nadkarni PM, Ohno-Machado L, Chapman WW. Natural language processing: an introduction. J Am Med Inform Assoc. 2011;18: 544–551. pmid:21846786
- 29. Speech and Language Processing. [cited 7 Feb 2019]. Available: https://web.stanford.edu/~jurafsky/slp3/
- 30. Kao A, Poteet SR. Natural Language Processing and Text Mining. Springer Science & Business Media; 2007.
- 31. Hur B, Hardefeldt LY, Verspoor K, Baldwin T, Gilkerson JR. Using natural language processing and VetCompass to understand antimicrobial usage patterns in Australia. Australian Veterinary Journal. 2019;97: 298–300. pmid:31209869
- 32. Cochran WG. The distribution of quadratic forms in a normal system, with applications to the analysis of covariance. Mathematical Proceedings of the Cambridge Philosophical Society. 1934;30: 178–191.
- 33. Importance Ratings and Summary of Antibacterial Uses in Humans in Australia. In: Antimicrobial resistance [Internet]. 10 Nov 2017 [cited 3 Sep 2018]. Available: https://www.amr.gov.au/resources/importance-ratings-and-summary-antibacterial-uses-humans-australia
- 34. Levenshtein Distance. [cited 5 Sep 2018]. Available: https://people.cs.pitt.edu/~kirk/cs1501/Pruhs/Spring2006/assignments/editdistance/Levenshtein%20Distance.htm
- 35. Australian Bureau of Statistics. [cited 31 Oct 2019]. Available: https://www.abs.gov.au/about
- 36. SQL Server 2017 on Windows and Linux | Microsoft. In: Microsoft SQL Server—AU (English) [Internet]. [cited 13 Jul 2019]. Available: https://www.microsoft.com/en-au/sql-server/sql-server-2017
- 37. Wesley R, Eldridge M, Terlecki PT. An Analytic Data Engine for Visualization in Tableau. Proceedings of the 2011 ACM SIGMOD International Conference on Management of Data. New York, NY, USA: ACM; 2011. pp. 1185–1194. https://doi.org/10.1145/1989323.1989449
- 38. OpenStreetMap. In: OpenStreetMap [Internet]. [cited 31 Oct 2019]. Available: https://www.openstreetmap.org/copyright
- 39. Hardefeldt LY, Selinger J, Stevenson MA, Gilkerson JR, Crabb H, Billman-Jacobe H, et al. Population wide assessment of antimicrobial use in dogs and cats using a novel data source–A cohort study using pet insurance data. Veterinary Microbiology. 2018;225: 34–39. pmid:30322530
- 40. Centers for Disease Control and Prevention. Outpatient antibiotic prescriptions—United States, 2017. [cited 4 Oct 2019]. Available: https://www.cdc.gov/antibiotic-use/community/pdfs/Annual-Report-2017-H.pdf
- 41. Buckland EL, O’Neill D, Summers J, Mateus A, Church D, Redmond L, et al. Characterisation of antimicrobial usage in cats and dogs attending UK primary care companion animal veterinary practices. Veterinary Record. 2016;179: 489–489. pmid:27543064
- 42. Poirel L, Jayol A, Nordmann P. Polymyxins: Antibacterial Activity, Susceptibility Testing, and Resistance Mechanisms Encoded by Plasmids or Chromosomes. Clinical Microbiology Reviews. 2017;30: 557–596. pmid:28275006
- 43. Catry B, Cavaleri M, Baptiste K, Grave K, Grein K, Holm A, et al. Use of colistin-containing products within the European Union and European Economic Area (EU/EEA): development of resistance in animals and possible impact on human and animal health. International Journal of Antimicrobial Agents. 2015;46: 297–306. pmid:26215780
- 44. Jovetic S, Zhu Y, Marcone GL, Marinelli F, Tramper J. β-Lactam and glycopeptide antibiotics: first and last line of defense? Trends in Biotechnology. 2010;28: 596–604. pmid:20970210
- 45. Patrick J, Li M. High accuracy information extraction of medication information from clinical notes: 2009 i2b2 medication extraction challenge. J Am Med Inform Assoc. 2010;17: 524–527. pmid:20819856
- 46. Abbasi A, Sarker S, Chiang RHL. Big Data Research in Information Systems: Toward an Inclusive Research Agenda. J AIS. 2016;17: 3.
- 47. Lin M, Lucas HC, Shmueli G. Research Commentary—Too Big to Fail: Large Samples and the p-Value Problem. Information Systems Research. 2013;24: 906–917.
- 48. Kaplan RM, Chambers DA, Glasgow RE. Big Data and Large Sample Size: A Cautionary Note on the Potential for Bias. Clin Transl Sci. 2014;7: 342–346. pmid:25043853