Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Bovine pain scale: A novel tool for pain assessment in cattle undergoing surgery in the hospital setting

  • Rubia Mitalli Tomacheuski ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Validation, Visualization, Writing – original draft, Writing – review & editing

    rubiamitalli11@gmail.com

    Affiliations Department of Anaesthesiology, Medical School (FMB) of São Paulo State University (UNESP), Botucatu, São Paulo, Brazil, Translational Research in Pain, Department of Clinical Sciences, College of Veterinary Medicine, North Carolina State University (NCSU), Raleigh, North Carolina, United States of America

  • Cassandra Klostermann,

    Roles Investigation

    Affiliation Department of Clinical Sciences, Faculty of Veterinary Medicine, Université de Montréal, Saint-Hyacinthe, Québec, Canada

  • Diane Frank,

    Roles Investigation

    Affiliation Department of Clinical Sciences, Faculty of Veterinary Medicine, Université de Montréal, Saint-Hyacinthe, Québec, Canada

  • Marilda Onghero Taffarel,

    Roles Investigation

    Affiliation Department of Veterinary Medicine, Maringa State University (UEM), Umuarama, Paraná, Brazil

  • Renata Haddad Pinho,

    Roles Investigation

    Affiliations Department of Veterinary Medicine, Maringa State University (UEM), Umuarama, Paraná, Brazil, Faculty of Veterinary Medicine, University of Calgary, Calgary, Alberta, Canada

  • Beatriz Paglerani Monteiro,

    Roles Formal analysis, Investigation, Validation, Visualization, Writing – original draft

    Affiliation Department of Clinical Sciences, Faculty of Veterinary Medicine, Université de Montréal, Saint-Hyacinthe, Québec, Canada

  • Pedro Henrique Esteves Trindade,

    Roles Validation, Writing – review & editing

    Affiliations Department of Anaesthesiology, Medical School (FMB) of São Paulo State University (UNESP), Botucatu, São Paulo, Brazil, Department of Large Animal Clinical Sciences, College of Veterinary Medicine, Michigan State University (MSU), East Lansing, Michigan, United States of America

  • André Desrochers,

    Roles Investigation

    Affiliation Department of Clinical Sciences, Faculty of Veterinary Medicine, Université de Montréal, Saint-Hyacinthe, Québec, Canada

  • Sylvain Nichols,

    Roles Investigation

    Affiliation Department of Clinical Sciences, Faculty of Veterinary Medicine, Université de Montréal, Saint-Hyacinthe, Québec, Canada

  • Karina Gleerup,

    Roles Investigation

    Affiliation Department of Clinical Sciences, University of Copenhagen, Taastrup, Denmark

  • Stelio Pacca Loureiro Luna,

    Roles Conceptualization, Formal analysis, Funding acquisition, Resources, Supervision, Validation, Visualization, Writing – review & editing

    Affiliations Department of Anaesthesiology, Medical School (FMB) of São Paulo State University (UNESP), Botucatu, São Paulo, Brazil, Department of Veterinary Surgery and Animal Reproduction, School of Veterinary Medicine and Animal Science, São Paulo State University (UNESP), Botucatu, São Paulo, Brazil

  • Paulo Vinicius Steagall

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Resources, Supervision, Validation, Visualization, Writing – review & editing

    Affiliations Department of Anaesthesiology, Medical School (FMB) of São Paulo State University (UNESP), Botucatu, São Paulo, Brazil, Department of Clinical Sciences, Faculty of Veterinary Medicine, Université de Montréal, Saint-Hyacinthe, Québec, Canada, Department of Veterinary Clinical Sciences, Jockey Club College of Veterinary Medicine and Life Sciences, City University of Hong Kong, Hong Kong S.A.R., China, Centre for Companion Animal Health and Welfare, City University of Hong Kong, Hong Kong S.A.R., China

Abstract

Pain negatively impacts animal welfare and it is still neglected in ruminants. This original study aimed to develop and validate the Bovine Pain Scale (BPS) for acute pain assessment in hospitalized cattle undergoing surgery. This was a blinded, randomized, prospective clinical study. Thirty-six animals were included in the study. The Pain Group (n = 25) included patients admitted to a veterinary teaching hospital requiring any type of soft tissue or orthopedic surgery. Videos were recorded before, 2–6 hours after surgery, 1 hour after the administration of analgesia and 24 hours after surgery. The Control Group (n = 11) included healthy animals that were video recorded twice within a 24-48h interval. The BPS was developed using content validity. A total of 118 videos of 6 minutes were randomized and analyzed by four raters who were unaware of groups, time-points and procedures in two phases with a five-week interval. Statistical analysis was performed using R software. Intra and inter-rater reliability (intra-class correlation coefficient) was very good (0.83–0.94) and ranged from good to very good, respectively (0.65–0.81). The correlation between the BPS and the Visual Analog Scale (VAS) was strong (rho = 0.77, p < 0.0001) confirming criterion validity. Item-total correlation was acceptable for 3 of 9 items (0.33–0.43) and internal consistency was below the acceptable value (0.6). The scale was responsive to pain but not the administration of analgesia. It was specific for five items, but no items showed sensitivity. The area under the curve of 0.90 demonstrated high discriminatory capacity. According to the receiver operating characteristic curve, the cut-off point for rescue analgesia was ≥ 5 of 18. The BPS is reliable and reproducible, showed content and criterion validity, and may be used in veterinary hospitals for assessing post-operative pain in cattle to guide decision-making towards rescue analgesia. Future studies should refine the instrument to guarantee construct validity and sensitivity.

Introduction

Animal welfare is a social and ethical concern [1,2], and it has become a priority to improve husbandry practices [3,4]. Pain negatively impacts animal welfare; it causes fear and suffering, and decreases productivity (e.g., weight gain, milk production, reproductivity) [57]. Veterinarians have a responsibility to alleviate pain in animals. Yet, farm animals are less frequently administered analgesics when compared with companion animals [8]. A study with Canadian beef cattle producers showed that in 90% of castration, 85% of dehorning procedures and 46% of cases of dystocia, animals did not receive any analgesia [9]. Historically, beef cattle receive less analgesics than dairy cattle [10]. Although there has been an increase in the use of analgesics and pain recognition by veterinarians working with cattle [11,12], pain management is still neglected in this species [7].

Pain scales are used for pain assessment. They need to undergo rigorous validation to ensure they are measuring what they are supposed to measure (e.g., pain) and consequently, can be used in clinical practice [13]. Ideally, a pain scale should be applicable to animals with different painful conditions (i.e., medical or surgical pain) as well as in different environments (i.e., hospitals, farms). Previous work includes the Cow Pain Scale (CPS) [14], which was developed in dairy cattle with clinical pain and the UNESP-Botucatu cattle pain scale (UCAPS) [15] that was developed in beef cattle undergoing orchiectomy in extensive farm production. Although the UCAPS has been validated in the hospital setting, animals underwent a single procedure (orchiectomy) and were assessed in groups and in paddocks [16]. Nevertheless, both scales are limited to the populations and scenarios in which they were validated and cannot be generalized to a large population of animals with different types of pain. Currently, the literature is lacking a pain assessment instrument that can be used in a variety of surgical procedures using different anesthetic and analgesic dosage regimens in hospitalized cattle.

Objective & hypothesis

This study aimed to develop and validate the Bovine Pain Scale (BPS) for pain assessment after surgery in cattle in the hospital setting. The hypothesis was that the BPS is a reliable and valid instrument, that discriminates painful and non-painful individuals and responsive to the administration of analgesia.

Materials and methods

The development and validation of the BPS was based on a clinical prospective and observational study performed at the Farm Animal Hospital of the Centre Hospitalier Universitaire Vétérinaire (CHUV) of the Faculté de médecine vétérinaire (FMV), Université de Montréal, a referral hospital that receives over 1000 farm animals every year. Its modern hospital is the clinical center of reference of Quebec, Canada, offering cutting-edge diagnosis and treatment of farm animals with advanced equipment and surgery as well as training programs. The study was approved by the institutional animal care and use committee of the Université de Montréal (protocol 20-Rech-2065) and followed the recommendations of the COSMIN [17,18].

Animals

Forty-three animals of any sex or breed and older than 6 months were included in the study (recruitment period from July 21st 2020 to January 28th 2021). The Pain Group consisted of patients admitted to the CHUV requiring any type of soft tissue or orthopaedic surgery. Exclusion criteria included systemic disease (e.g., septicaemia or animals considered critically ill requiring intensive or immediate treatment) or severe lameness. Animals that were administered analgesics and/or sedatives up to 24h before admission or those with medical pain were not included. The anaesthetic and analgesic protocols and treatment plan for each animal were determined by the attending clinician on a case-by-case basis (Supplementary material Table S1). Upon arrival and admission, each animal was assessed for eligibility. A signed written informed consent form was obtained from the owner or farm manager before inclusion. The Control Group consisted of animals from the teaching colony of the FMV that were deemed healthy based on history, physical examination and regular blood work.

Bovine pain scale

The preliminary version of the BPS consisted of 65 behaviours divided into 9 items in English and developed by investigators RMT, BPM, SPLL and PVS using their personal experience, and the pain-related behaviours described in the UCAPS [15] and the Cow Pain Scale [14]. Each item has scores 0 – normal and pain free behavior; scores 1 and 2 pain related behaviors. Content validity was assessed by eight veterinarians with experience in bovine practice (DA, CK, MOT and five collaborators). Additionally, pain assessment was performed in seven animals by RMT to test the feasibility of the BPS. After the calculation of content validity index (Supplementary Material), the definitive version of the Bovine Pain Scale used in this study is presented in Table 1.

thumbnail
Table 1. The Bovine Pain Scale consists of nine items with inclusion of three descriptive levels. Score 0 means normal behaviours (pain free), score 1 and 2 behaviours related to pain.

https://doi.org/10.1371/journal.pone.0323710.t001

Real-time pain assessment and video recording

Real-time pain assessment by one female veterinarian (RMT) included four and two different time-points in the Pain and Control Group, respectively, while animals were in their single stalls. Time-points were as follows: P1, preoperatively, immediately prior to administration of sedatives; P2, 2–6 hours after the end of surgery; P3, 1 hour after the administration of analgesic intervention if required; P4, 24 hours after surgery in the Pain Group. In the Control group, time-points involved C1 (according to the availability of the animal when not involved in teaching) and C2 (24–48 hours after C1). At P3, rescue analgesia was administered if pain scores were ≥ 5 of 10 according to the UCAPS with the agreement of the attending clinician. Rescue analgesia generally involved the administration of an opioid (e.g., butorphanol) and/or a non-steroidal anti-inflammatory drug (NSAID).

Video recordings were performed simultaneously to real-time pain assessment using two cameras. One camera (GoPro Hero 5, GoPro, San Mateo, CA, USA) was placed at a higher location to capture a top view of the animal while the other (Canon PowerShot G16, 5x optical zoom lens 6.1–30.5mm, Oita, Japan) was placed in front of the stall for a frontal view of the animal. The duration of video recordings was six minutes and the cameras were set up 15 minutes before the first evaluation time-point. For the subsequent time-points, a 5-minute acclimation was performed. The observer was always present during acclimation and video recording. Animals were left undisturbed for the first 3 minutes of recordings. Thereafter, the observer approached, clapped her hands three times and then offered food (hay, silage, or dried feed) while recordings continued until the 6-minute mark. Pain scoring was then completed using the UCAPS [15], the visual analog scale (VAS; 0–100 mm, where 0 = no pain and 100 = the worst pain imaginable) and the BPS proposed herein.

Pain assessment using video recordings

Video recordings were randomized for pain assessment via video analysis by five experienced veterinarians who were not aware of the group, time-point, procedure nor involved with recordings. However, surgical wounds may have been seen in some of these videos. A Training Manual (Supplementary Material) of the BPS was provided to raters prior to video assessment. It included a written description of each score for each behaviour/item and their respective link of a video-example (Google Drive). Videos were made available using a virtual platform (SurveyMonkey). Each video included the two simultaneous recordings from each camera and were presented as one video per page. The video-analysis was divided into Phase 1 and Phase 2 (Fig 1).

thumbnail
Fig 1. Timeline of video analysis for the validation of the Bovine Pain Scale.

https://doi.org/10.1371/journal.pone.0323710.g001

Phase 1

This phase consisted of 10 videos (5–6 min/video = approximately 1h total) from seven animals that were not included in Phase 2. These videos were presented twice, 2 weeks apart, in a different randomized order (Part 1 and Part 2). The five raters (experienced veterinarians) received a questionnaire with the BPS including 12 randomized questions per video (Supplementary material). Nine questions were related to the BPS, one question presented the VAS for pain assessment as previously described and one question on whether they believed rescue analgesia was needed. They were asked to watch each video with sound and then answer each question. Videos could be watched as many times as needed. If any item of the BPS was not visible, raters could mark “not possible to score”. Inter and intra-rater reliability analysis was carried out for Parts 1 and 2 using the intraclass correlation coefficient (ICC). Raters with ICC ≥ 0.80 for intra-reliability were invited to participate in Phase 2.

Phase 2

A total of 118 videos (6 min/video = 11.8h in total), from 36 animals (Pain Group - 25 animals; Control Group - 11 animals), were presented twice, 5 weeks apart, in a different randomization order (Phase 2; Part 1 and Part 2). Four raters (experienced veterinarians) were included and received a link every week with 20 videos for analysis during five weeks and 18 videos during the last week. Video assessment was performed as described for Phase 1. Raters were asked to not perform more than 1-hour of video assessment per day to avoid fatigue.

Statistical analyses

Statistical analyses were performed by PHET using R software in the RStudio integrated development environment (RstudioTeam, 2016), using data from video analysis of Phases 1 (five raters; to test the reliability of raters to qualify for the next phase) and 2 (four raters; all time-points individually and grouped, and for both Pain and Control Groups). A p < 0.05 was considered for statistical significance. The Shapiro-Wilk test and the Gaussian distribution according to the quantile-quantile and histograms plots confirmed that data did not present normal distribution. Hence, nonparametric tests were carried out for analysis. Table 2 provides a detailed description of statistical analysis. A minimum sample size of 11 subjects, with 0.80 of power and an alpha of 0.05 was calculated, based on Spearman correlation of rho = 0.764 between the UCAPS and Cow Pain Scale (http://biomath.info/power/) [16].

thumbnail
Table 2. Statistical methods used for validation of the Bovine Pain Scale (BPS) in cattle.

https://doi.org/10.1371/journal.pone.0323710.t002

Results

Data collection was performed from July 2020 to January 2021. A total of 36 animals were included with 25 from the Pain Group (Table 3) and 11 from the Control Group. Seven animals were excluded from Phase 2 of study because their videos were used in Phase 1.

thumbnail
Table 3. Demographics and summarized history of animals included in the Pain Group.

https://doi.org/10.1371/journal.pone.0323710.t003

Intra and inter-rater reliability

Intra-rater reliability was very good for all raters (> 0.80) for the BPS total score and VAS. It varied from very good to moderate for the BPS items (Table 4). Inter-rater reliability varied from good to very good for the BPS total score (≥ 0.65) and from good to moderate for VAS (Table 5). The items ‘appetite’ and ‘posture when lying down’ showed the best reproducibility (0.69–0.99). Other items varied from reasonable to good (0.22–0.83) (Table 5).

thumbnail
Table 4. Intra-rater reliability of the Bovine Pain Scale, unidimensional scales and indication for rescue analgesia in the perioperative period of cattle undergoing surgery (n = 25; Pain Group) and in healthy cows (n = 11; Control Group).

https://doi.org/10.1371/journal.pone.0323710.t004

thumbnail
Table 5. Inter-rater reliability of the Bovine Pain Scale, unidimensional scales, and indication of rescue analgesia in the perioperative period of cattle undergoing surgery (n = 25; Pain Group) and in healthy cows (n = 11; Control Group).

https://doi.org/10.1371/journal.pone.0323710.t005

Exploratory factor analysis

The exploratory factor analyses determined that the BPS is bidimensional (Table 6) [24]. All items, except the two miscellaneous behaviours, were representative in one of the dimensions.

thumbnail
Table 6. Loading values and eigenvalues of the Bovine Pain Scale items based on exploratory factor analysis.

https://doi.org/10.1371/journal.pone.0323710.t006

Criterion validity

The correlation between the BPS and VAS was strong with rho = 0.77 (p < 0.0001) (Fig 2), confirming concurrent criterion validity.

thumbnail
Fig 2. Plot correlating the scores of the Bovine Pain Scale (BPS) and the Visual Analog Scale (VAS) of perioperative period of cattle undergoing surgery (n 

= 25; Pain Group) and in healthy cows (n = 11; Control Group).

https://doi.org/10.1371/journal.pone.0323710.g002

Specificity and sensitivity

The BPS items ‘appetite’, ‘posture when standing’ and ‘when lying down’, ‘miscellaneous behaviours 1’, ‘interactive behaviour and ‘response to approach’ were specific (Control group data). For the total score, specificity was close to 70%. Otherwise only ‘miscellaneous behaviours’ showed sensitivity because all other values, including the total score were lower than 70% (Table 7).

thumbnail
Table 7. Specificity and sensitivity of the Bovine Pain Scale.

https://doi.org/10.1371/journal.pone.0323710.t007

Construct validity

Item-total correlation & Internal consistency.

‘Appetite’, ‘interactive behaviour with the environment’ and ‘activity and locomotion’ were accepted according to the interpretation of correlation r with values between 0.3–0.7 (Table 8). The McDonald’s omega coefficient for the calculation of internal consistency was not acceptable for any item as all values were lower than 0.65 (Table 8). However, the fact that internal consistency of the items: ‘appetite’, ‘posture when lying down’, ‘interactive behaviour’ and ‘activity and locomotion’ reduced after their exclusion means that they somewhat contribute to the full scale.

thumbnail
Table 8. Item-total correlation and internal consistency of the Bovine Pain Scale for all time-points.

https://doi.org/10.1371/journal.pone.0323710.t008

Responsiveness

The total score of the BPS was significantly higher in P2 than in P1 and P4, confirming responsiveness; however, responsiveness was not observed after the administration of analgesia (Table 9 and Fig 3). There was no responsiveness for VAS (Table 9).

thumbnail
Table 9. Responsiveness of the Bovine Pain Scale (BPS), Visual Analog Scale (VAS) and rescue analgesia, between the four perioperative time-points, showed as median (first – third quartile) (n = 25).

https://doi.org/10.1371/journal.pone.0323710.t009

thumbnail
Fig 3. Box-plot of Bovine Pain Scale (BPS) total score over time-points of perioperative period of cattle undergoing surgery (n 

= 25; Pain Group) and healthy cows (n = 11; Control Group) for all raters. Time-points: P1, preoperatively, immediately prior to administration of sedatives; P2, 2 to 6 hours after the end of surgery; P3, 1 hour after the administration of analgesic intervention if required; P4, 24 hours after surgery; were assessed. C1, first video and assessment of animals of the control group; C2, the second video of same animal of the control group, recorded 24-48 hours after C1. The lower and upper bounds of the box respectively represent the first and third quartile of data; the horizontal line plus space inside the box indicates the median; the black diamond indicates the average of each time-point data separately; black circles indicate outlier. Different lowercase letters indicate statistical difference over the time-points (a > b); multiple comparisons were conducted by linear mixed model with post-test corrected by Bonferroni procedure (p < 0.05).

https://doi.org/10.1371/journal.pone.0323710.g003

The phase of the study (1 or 2) did not have any significant effect on the BPS total score or VAS (Table 9 and Supplementary Material Fig S1), whereas ‘raters’ and the number of times videos were watched affected both scales (Table 9 and Supplementary Material Fig S2). There were significant differences between time-points for some BPS items, except for the item ‘posture when standing’, ‘miscellaneous behaviour 2’, ‘response to approach’ and ‘activity and locomotion’.

Optimum cut-off point for rescue analgesia

The receiver operating characteristic (ROC) curve showed that scores of ≥ 5 of 18 discriminated painful vs non-painful individuals. The resampling confidence interval > 0.90 for the Youden index was between 4.5 and 5.5, therefore score 5 is within the diagnostic uncertainty zone, scores ≤ 4 are true negatives and ≥ 6 are true positives. The area under the curve (AUC) was 0.90 indicating a high discriminatory capacity (Fig 4).

thumbnail
Fig 4. ROC curve with the diagnostic uncertainty zone for the Bovine Pain Scale (BPS).

Two-graph ROC curve, CI of 1,001 replications was used to estimate the diagnostic uncertainty zone of the cut-off point of all raters, according to the Youden index [31,32]. The diagnostic uncertainty zone was 5; ≤ 4 indicates pain-free animals (true negatives) and ≥ 6 indicates animals suffering pain (true positives). The Youden index ≥ 5 represents the cut-off point for the indication of rescue analgesia.

https://doi.org/10.1371/journal.pone.0323710.g004

Discussion

The BPS is a reliable instrument to be used for pain assessment in cattle undergoing surgery in a hospital setting. The scale incorporated five behaviours of CPS, all behaviours from UCAPS and included five new behaviours. To the authors’ knowledge, the scale is the first to be developed in a clinical environment in cattle submitted to different surgical procedures, where the animal is alone and inside a stall. Specificity was attained, the scale showed criterion validity and a cut-off score to guide the administration of analgesia was identified as reported by UCAPS [15]. Because sensitivity was not adequate and some attributes of construct validity were suboptimal, the instrument requires further refinement. This highlights how challenging pain assessment is in cattle, especially when they are kept in individual stalls (box or tie) during the perioperative period influenced by the hospital environment, where fear and anxiety may confound pain assessment. Furthermore, their preoperative pain condition, diversity of surgical procedures and anaesthetic protocols may have influenced postoperative pain assessment and our results. Additionally, pain-induced behaviours after soft tissue and orthopaedic surgery may be expressed in different forms and intensity. For example, a single teat amputation may produce mild inflammation and can be treated with a non-steroidal anti-inflammatory drug alone. Caesarean section, rumenotomy and enucleation may require the administration of NSAIDs, local anaesthetics and opioids. As much as pain-induced behaviours may be presented differently and can vary with intensity and duration, the authors aimed to develop and validate a pain scoring instrument with wide applicability after surgery in hospitalized cattle. Future studies may target one type of procedure, or one source of pain and results may be more appropriate using, for example, either soft tissue or orthopaedic pain after surgery, like performed previously in beef [15] and dairy cattle [14].

The role of environment including the use of box or tie stalls with animals surrounded by unfamiliar sounds and smells is another challenge to validate a perioperative pain assessment tool in cattle. Additionally, the transportation and handling of an animal experiencing pain increases physiological stress [35]. The natural prey behaviour of cattle may add to the potential bias and challenge as pain may be masked and not recognized by veterinarians. All these challenges make pain assessment a difficult subject of study in this species.

The repeatability of BPS was very good and similar or superior to other pain scales developed for cattle [14,16,36,37]. The BPS assessment was well reproducible as inter-rater reliability for total scores was good or very good [21] and similar to UCAPS [15]. This might be a result of training for using the BPS before the study had begun. Reproducibility was better than VAS similarly to reported in sheep [30], showing the possible advantage of using a pain scale that includes several components of pain [38].

The exploratory factor analysis showed that the BPS is a bidimensional scale. This is the first bidimensional pain scale other than the Unesp-Botucatu multidimensional feline pain assessment scale [23]. All other pain behaviour scales developed and validated for cattle and other species were mathematically unidimensional [14,15]. This is an important measurement property of health instruments [39,40] as it identifies the number of domains of a scoring instrument [34,41]. The BPS includes various expressions of pain including physiological (appetite), sensory or motor (posture, limb movement/condition, activity) and emotional (interactive behaviour with the environment, response to approach, activity and locomotion). Therefore, as reported for CPS [14] and UCAPS [15], BPS is biologically multidimensional.

The criterion validity was confirmed by the strong correlation between BPS and VAS like previous studies in cattle [14,15,42]. Criterion validity is based on assessing the correlation between the new instruments versus a ‘gold standard’ [21]. The CPS and UCAPS may be classified as ‘gold standards’ instruments because they fit the COSMIN criteria used for validation of health metric instruments. For this reason, they were not compared with BPS [25,28,39,41], because the latter incorporated a combination of 100% of UCAPS and 37.5% of the behaviours of CPS. Comparisons with these items would lead to the overinflation of results.

The construct validity is the ability of a scale to measure what is supposed to be measured; pain in this case [21]. Sensitivity was inadequate; only three items presented adequate item-total correlation and internal consistency was below acceptable showing that the correlation between items and their interrelation was not appropriate. Although UCAPS had a better internal consistency and item-total correlation [14,15], it was tested only after orchiectomy using a standard analgesic and anaesthetic protocol. The current study was performed in a clinical setting including animals with different levels of pain and undergoing several types of surgeries, treatments and anaesthetic protocols resulting in heterogeneous behaviours, which may have affected internal consistency. Future studies should test the BPS in a homogenous population (animals, treatments, surgical procedures and anesthetic protocols) in an attempt to improve the internal consistency. The results of the specificity of BPS were suboptimal and inferior to the UCAPS and CPS [14,15], unless only the first time point of the Control group was considered. This is surprising as animals in the Control Group were considered healthy and used for teaching. The most intriguing point was that pain scores increased at the second assessment performed 24–48 hours after the first one with no apparent reason that could influence pain scores. This was the reason the authors calculated specificity based on the first time point of the Control group. Specificity and sensitivity may be improved if the BPS is tested using a more controlled study design involving animals undergoing similar surgical procedures and standardized anesthetic and analgesic regimens. A recent study using a forest algorithm refined a pain scale and found the best pain behaviors set [43] this methodology should be used in the future to refine the Bovine Pain Scale.

The BPS detected changes in scores over time but not analgesia. We hypothesized that responsiveness after treatment was not detected due to inappropriate analgesic treatment or dosage regimens for the type and degree of pain. Pain management is challenging in cattle as approved analgesic drugs are limited due to regulatory framework related to food safety. For example, the administration of intravenous butorphanol at 0.025–0.05 mg/kg may not produce satisfactory analgesia after orthopaedic procedures and there is a concern that other opioid analgesics may produce ileus and colic in cattle, particularly when animals are to be discharged from the hospital [4446]. Additionally, dosage regimens of analgesic drugs have not been determined in cattle. Indeed, response to rescue analgesia was not observed either for UCAPS or CPS in Bos taurus (Nelore) and Bos indicus (Angus) bulls submitted to thermal warming and orchiectomy [16], even after administration of morphine. On the other hand, the UCAPS showed responsiveness to the administration of ketoprofen and morphine in cattle undergoing orchiectomy [15].

In contrast to the inadequate results of specificity and sensitivity of BPS, its AUC of 0.90 represents a high discriminatory ability to differentiate painful and non-painful individuals. The optimum cut-off point, according to the ROC curve analysis [47], guides clinical decisions for administering analgesia in hospitalized cattle undergoing surgery. The use of cut-off scores may help when pain is unrecognized or neglected, and analgesia is required.

This study has limitations. As discussed before, the patient population was heterogeneous in intensity and type of pain, leading to poor sensitivity, item-total correlation, and internal consistency of the BPS. However, by merging two previously validated pain scales, the study offers a promising pain scoring system for cattle undergoing surgery with appropriate reliability and discriminatory ability that can be refined in the future. Previous pain assessment instruments did not address this gap of knowledge as none of them were applied to animals that had already preoperative painful conditions [1416,36,37]. Surgical wounds may have been observed during video assessment. Future studies should perform wound bandage/cover/dressing of a similar nature in controls or sham animals in an attempt to blind observers during pain assessment. In addition, time of the day was not recorded during the assessments and video recordings, future studies should address this issue, and test if circadian rhythm can affect pain scores. This study only employed female raters during video assessment. Female veterinarians provide higher pain scores than male individuals most likely demonstrating a higher level of empathy in some studies [48]. Although female veterinarians assumed that small animals face more intense postoperative pain [49] and their pain scores are higher than male veterinarians [5052], these results are conflicting, as higher scores were observed with male than female individuals in a study in cats [53] or when gender did not affect pain scores [54]. Finally, the majority of animals were female and of dairy breeds, hence future studies should test the BPS in males and beef cattle breeds. Future studies using artificial intelligence could be used to to rank the importance of BPS behaviors like performed for UCAPS [55].

Conclusions

The BPS is an instrument with potential to be used for acute pain assessment in the perioperative setting in hospitalized cattle. It showed repeatability, reproducibility, high discriminatory ability and may guide the administration of analgesia. Future studies may address some limitations of the present methodology, by including a greater number of cattle of a more homogenous population with similar types of pain (soft tissue or orthopaedic procedures) and using both male and female raters. Animal welfare is a concern in farm animals and the BPS may contribute to better means of pain management in cattle undergoing surgery.

Supporting information

S1 Fig. Box-plot of the total sum of the Bovine Pain Scale (BPS) for ‘phases’ of perioperative period of cattle undergoing surgery (n = 25; Pain Group) and healthy cows (n = 11; Control Group).

https://doi.org/10.1371/journal.pone.0323710.s001

(TIF)

S2 Fig. Smooth line of total sum of the Bovine Pain Scale (BPS) for ‘raters’ of perioperative period of cattle undergoing surgery (n = 25; Pain Group).

Time-points: P1, preoperatively, immediately prior to administration of sedatives; P2, 2–6 hours after the end of surgery; P3, 1 hour after the administration of analgesic intervention if required; P4, 24 hours after surgery; were assessed.

https://doi.org/10.1371/journal.pone.0323710.s002

(TIF)

S1 Table. Anaesthetic protocols of animals included in the Pain Group (n = 25).

https://doi.org/10.1371/journal.pone.0323710.s003

(DOCX)

S1 Supplementary material. Data of Bovine Pain Scale of cattle undergoing surgery (n = 25; Pain Group) and healthy cows (n = 11; Control Group).

https://doi.org/10.1371/journal.pone.0323710.s004

(XLSX)

S2 Supplementary material. Content Validity Index of Bovine Pain Scale.

https://doi.org/10.1371/journal.pone.0323710.s005

(XLSX)

S4 Supplementary material. Survey Monkey Questionnaire of Bovine Pain Scale.

https://doi.org/10.1371/journal.pone.0323710.s007

(PDF)

Acknowledgments

To Dr. Alice de Oliveira, Dr. Flavia Augusta de Oliveira, Dr. Giorgia Della Rocca, Dr. Jose Ricardo Barboza Silva, and Dr. Marianne Villettaz Robichad for participating in the content validity index.

References

  1. 1. Orihuela A. Review: Management of livestock behavior to improve welfare and production. Animal. 2021;15 Suppl 1:100290. pmid:34238724
  2. 2. Morgan L, Itin-Shwartz B, Koren L, Meyer JS, Matas D, Younis A, et al. Physiological and economic benefits of abandoning invasive surgical procedures and enhancing animal welfare in swine production. Sci Rep. 2019;9(1):16093. pmid:31695123
  3. 3. Rioja-Lang FC, Connor M, Bacon HJ, Lawrence AB, Dwyer CM. Prioritization of Farm Animal Welfare Issues Using Expert Consensus. Front Vet Sci. 2020;6:495. pmid:31998770
  4. 4. Bauman CA, Barkema HW, Dubuc J, Keefe GP, Kelton DF. Identifying management and disease priorities of Canadian dairy industry stakeholders. J Dairy Sci. 2016;99(12):10194–203. pmid:27720160
  5. 5. Anil L, Anil SS, Deen J. Pain detection and amelioration in animals on the farm: issues and options. J Appl Anim Welf Sci. 2005;8(4):261–78. pmid:16436030
  6. 6. Green LE, Hedges VJ, Schukken YH, Blowey RW, Packington AJ. The impact of clinical lameness on the milk yield of dairy cows. J Dairy Sci. 2002;85(9):2250–6. pmid:12362457
  7. 7. Steagall PV, Bustamante H, Johnson CB, Turner PV. Pain Management in Farm Animals: Focus on Cattle, Sheep and Pigs. Animals (Basel). 2021;11(6):1483. pmid:34063847
  8. 8. Remnant JG, Tremlett A, Huxley JN, Hudson CD. Clinician attitudes to pain and use of analgesia in cattle: where are we 10 years on?. Vet Rec. 2017;181(15):400. pmid:28814534
  9. 9. Moggy MA, Pajor EA, Thurston WE, Parker S, Greter AM, Schwartzkopf-Genswein KS, et al. Management practices associated with pain in cattle on western Canadian cow-calf operations: A mixed methods study. J Anim Sci. 2017;95(2):958–69. pmid:28380614
  10. 10. Hewson CJ, Dohoo IR, Lemke KA, Barkema HW. Canadian veterinarians’ use of analgesics in cattle, pigs, and horses in 2004 and 2005. Can Vet J. 2007;48(2):155–64. pmid:17334029
  11. 11. Watts SA, Clarke KW. A survey of bovine practitioners attitudes to pain and analgesia in cattle. Cattle Pract. 2000;8:361–2.
  12. 12. Lorena SERS, Luna SPL, Lascelles BDX, Corrente JE. Attitude of Brazilian veterinarians in the recognition and treatment of pain in horses and cattle. Vet Anaesth Analg. 2013;40(4):410–8. pmid:23461405
  13. 13. Tomacheuski RM, Monteiro BP, Evangelista MC, Luna SPL, Steagall PV. Measurement properties of pain scoring instruments in farm animals: A systematic review using the COSMIN checklist. PLoS One. 2023;18(1):e0280830. pmid:36662813
  14. 14. Gleerup KB, Andersen PH, Munksgaard L, Forkman B. Pain evaluation in dairy cattle. Appl Ani Behav Sci. 2015;171:25–32.
  15. 15. de Oliveira FA, Luna SPL, do Amaral JB, Rodrigues KA, Sant’Anna AC, Daolio M, et al. Validation of the UNESP-Botucatu unidimensional composite pain scale for assessing postoperative pain in cattle. BMC Vet Res. 2014;10:200. pmid:25192598
  16. 16. Tomacheuski RM, Oliveira AR, Trindade PHE, Oliveira FA, Candido CP, Teixeira Neto FJ, et al. Reliability and Validity of UNESP-Botucatu Cattle Pain Scale and Cow Pain Scale in Bos taurus and Bos indicus Bulls to Assess Postoperative Pain of Surgical Orchiectomy. Animals (Basel). 2023;13(3):364. pmid:36766253
  17. 17. Gagnier JJ, Lai J, Mokkink LB, Terwee CB. COSMIN reporting guideline for studies on measurement properties of patient-reported outcome measures. Qual Life Res. 2021;30(8):2197–218. pmid:33818733
  18. 18. Mokkink LB, de Vet HCW, Prinsen CAC, Patrick DL, Alonso J, Bouter LM, et al. COSMIN Risk of Bias checklist for systematic reviews of Patient-Reported Outcome Measures. Qual Life Res. 2018;27(5):1171–9. pmid:29260445
  19. 19. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539–49. pmid:20169472
  20. 20. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737–45. pmid:20494804
  21. 21. Streiner DL, Norman GR, Cairney J. Health Measurement Scales: a practical guide to their development and use. 5 ed. New York: Oxford University Press Inc. Oxford, UK: Oxford University Press; 2015. doi:https://doi.org/10.1093/acprof:oso/9780199231881.003.0006
  22. 22. Ashby D. Practical statistics for medical research. Douglas G. Altman, Chapman and Hall, London, 1991. No. of pages: 611. Price: £32.00. Statistics in Medicine. 1991;10(10):1635–6.
  23. 23. Brondani JT, Mama KR, Luna SPL, Wright BD, Niyom S, Ambrosio J, et al. Validation of the English version of the UNESP-Botucatu multidimensional composite pain scale for assessing postoperative pain in cats. BMC Vet Res. 2013;9:143. pmid:23867090
  24. 24. Hayton JC, Allen DG, Scarpello V. Factor Retention Decisions in Exploratory Factor Analysis: a Tutorial on Parallel Analysis. Organizational Research Methods. 2004;7(2):191–205.
  25. 25. Papageorgiou SN. On correlation coefficients and their interpretation. J Orthod. 2022;49(3):359–61. pmid:36017900
  26. 26. Bussières G, Jacques C, Lainay O, Beauchamp G, Leblond A, Cadoré J-L, et al. Development of a composite orthopaedic pain scale in horses. Res Vet Sci. 2008;85(2):294–306. pmid:18061637
  27. 27. Kalkbrenner MT. Alpha, Omega, and H Internal Consistency Reliability Estimates: Reviewing These Options and When to Use Them. Counseling Outcome Research and Evaluation. 2021;14(1):77–88.
  28. 28. Evangelista MC, Monteiro BP, Steagall PV. Measurement properties of grimace scales for pain assessment in nonhuman mammals: a systematic review. Pain. 2022;163(6):e697–714. pmid:34510132
  29. 29. Haddad Pinho R, Luna SPL, Esteves Trindade PH, Augusto Justo A, Santilli Cima D, Werneck Fonseca M, et al. Validation of the rabbit pain behaviour scale (RPBS) to assess acute postoperative pain in rabbits (Oryctolagus cuniculus). PLoS One. 2022;17(5):e0268973. pmid:35617348
  30. 30. Silva NEOF, Trindade PHE, Oliveira AR, Taffarel MO, Moreira MAP, Denadai R, et al. Validation of the Unesp-Botucatu composite scale to assess acute postoperative abdominal pain in sheep (USAPS). PLoS ONE. 2020;15(10):e0239622.
  31. 31. Celeita-Rodríguez N, Teixeira-Neto FJ, Garofalo NA, Dalmagro TL, Girotto CH, Oliveira GCV, et al. Comparison of the diagnostic accuracy of dynamic and static preload indexes to predict fluid responsiveness in mechanically ventilated, isoflurane anesthetized dogs. Vet Anaesth Analg. 2019;46(3):276–88. pmid:30979542
  32. 32. Cannesson M, Le Manach Y, Hofer CK, Goarin JP, Lehot J-J, Vallet B, et al. Assessing the diagnostic accuracy of pulse pressure variations for the prediction of fluid responsiveness: a “gray zone” approach. Anesthesiology. 2011;115(2):231–41. pmid:21705869
  33. 33. Brondani JT, Luna SPL, Minto BW, Santos BPR, Beier SL, Matsubara LM, et al. Confiabilidade e pontuação mínima relacionada à intervenção analgésica de uma escala multidimensional para avaliação de dor pós-operatória em gatos. Arq Bras Med Vet Zootec. 2013;65(1):153–62.
  34. 34. Preacher KJ, MacCallum RC. Repairing Tom Swift’s Electric Factor Analysis Machine. Understanding Statistics. 2003;2(1):13–43.
  35. 35. Grandin T. Assessment of stress during handling and transport. J Anim Sci. 1997;75(1):249–57. pmid:9027573
  36. 36. O’Callaghan KA, Cripps PJ, Downham DY, Murray RD. Subjective and Objective Assessment of Pain and Discomfort Due to Lameness in Dairy Cattle. Anim welf. 2003;12(4):605–10.
  37. 37. Bertagnon HG, Batista CF, Bellinazzi JB, Coneglian MM, Mendes AF, Libera AMMPD. Identificação de dor após orquiectomia em garrotes: desenvolvimento de escala análogo visual em comparação a parâmetros fisiológicos, padrões comportamentais e expressão facial. Pesq Vet Bras. 2018;38(3):436–43.
  38. 38. Roughan JV, Flecknell PA. Evaluation of a short duration behaviour-based post-operative pain scoring system in rats. Eur J Pain. 2003;7(5):397–406. pmid:12935791
  39. 39. Prinsen CAC, Mokkink LB, Bouter LM, Alonso J, Patrick DL, de Vet HCW, et al. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1147–57. pmid:29435801
  40. 40. Gracely RH. Evaluation of multi-dimensional pain scales. Pain. 1992;48(3):297–300. pmid:1594252
  41. 41. DeVon HA, Block ME, Moyle-Wright P, Ernst DM, Hayden SJ, Lazzara DJ, et al. A psychometric toolbox for testing validity and reliability. J Nurs Scholarsh. 2007;39(2):155–64. pmid:17535316
  42. 42. Della Rocca G, Brondani JT, de Oliveira FA, Crociati M, Sylla L, Elad Ngonput A, et al. Validation of the Italian version of the UNESP-Botucatu unidimensional composite pain scale for the assessment of postoperative pain in cattle. Vet Anaesth Analg. 2017;44(5):1253–61. pmid:28986129
  43. 43. Pivato GM, da Silva GV, Peres BG, Luna SPL, Pairis-Garcia MD, Trindade PHE. Proposing a short version of the Unesp-Botucatu pig acute pain scale using a novel application of machine learning technique. Sci Rep. 2025;15(1):7161. pmid:40021814
  44. 44. Anderson DE, Edmondson MA. Prevention and management of surgical pain in cattle. Vet Clin North Am Food Anim Pract. 2013;29(1):157–84. pmid:23438404
  45. 45. Luna SPL, Carregaro A. Anestesia e analgesia: em equídeos, ruminantes e suínos. São Paulo: MedVet; 2019.
  46. 46. Desrochers A, Anderson DE. Intestinal Surgery. Vet Clin North Am Food Anim Pract. 2016;32(3):645–71. pmid:27614777
  47. 47. Streiner DL, Cairney J. What’s under the ROC? An introduction to receiver operating characteristics curves. Can J Psychiatry. 2007;52(2):121–8. pmid:17375868
  48. 48. Christov-Moore L, Simpson EA, Coudé G, Grigaityte K, Iacoboni M, Ferrari PF. Empathy: gender effects in brain and behavior. Neurosci Biobehav Rev. 2014;46 Pt 4(Pt 4):604–27. pmid:25236781
  49. 49. Beswick A, Dewey C, Johnson R, Dowsett-Cooper J, Niel L. Survey of Ontario veterinarians’ knowledge and attitudes on pain in dogs and cats in 2012. Can Vet J. 2016;57(12):1274–80. pmid:27928175
  50. 50. Williams VM, Lascelles BDX, Robson MC. Current attitudes to, and use of, peri-operative analgesia in dogs and cats by veterinarians in New Zealand. N Z Vet J. 2005;53(3):193–202. pmid:16012589
  51. 51. Catanzaro A, Di Salvo A, Steagall PV, Zampini D, Polisca A, Della Rocca G. Preliminary study on attitudes, opinions and knowledge of Italian veterinarians with regard to abdominal visceral pain in dogs. Vet Anaesth Analg. 2016;43(4):361–70. pmid:26662657
  52. 52. Evangelista MC, Steagall PV. Agreement and reliability of the Feline Grimace Scale among cat owners, veterinarians, veterinary students and nurses. Sci Rep. 2021;11(1):5262. pmid:33664387
  53. 53. Moody CM, Niel L, Pang DJ. Is training necessary for efficacious use of the Glasgow Feline Composite Measure Pain Scale?. Can Vet J. 2022;63(6):609–16. pmid:35656525
  54. 54. Oliveira MC de, de Lima MT, Trindade PHE, Luna SPL. The impact of using pain scales by untrained students on the decision to provide analgesia to multiple species. Vet Anaesth Analg. 2024;51(5):548–57. pmid:39054198
  55. 55. Trindade PHE, da Silva GV, de Oliveira FA, Luna SPL. Ranking bovine pain-related behaviors using a logistic regression algorithm. Appl Anim Behav Sci. 2024;271:106163.