Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Diagnostic accuracy of the Enferplex Bovine TB antibody test using individual milk samples from cattle

  • Amanda O’Brien ,

    Contributed equally to this work with: Amanda O’Brien, Alastair Hayton, Neil Watt, Gordon D. Harkiss

    Roles Data curation, Methodology, Project administration, Software, Supervision, Validation, Writing – review & editing

    Affiliation Enfer Scientific, Naas, County Kildare, Ireland

  • Alastair Hayton ,

    Contributed equally to this work with: Amanda O’Brien, Alastair Hayton, Neil Watt, Gordon D. Harkiss

    Roles Conceptualization, Investigation, Resources, Validation, Writing – review & editing

    Affiliation Synergy Farm Health, Maiden Newton, Dorset, United Kingdom

  • Keith Cutler ,

    Roles Investigation, Resources, Writing – review & editing

    ‡ KC, AA, DJS and JC also contributed equally to this work.

    Affiliation Synergy Farm Health, Maiden Newton, Dorset, United Kingdom

  • Andy Adler ,

    Roles Investigation, Resources, Writing – review & editing

    Current address: Aidos Advisory Ltd, Frampton, Dorset, United Kingdom

    ‡ KC, AA, DJS and JC also contributed equally to this work.

    Affiliation Synergy Farm Health, Maiden Newton, Dorset, United Kingdom

  • Darren J. Shaw ,

    Roles Formal analysis, Writing – review & editing

    ‡ KC, AA, DJS and JC also contributed equally to this work.

    Affiliation Royal (Dick) School of Veterinary Studies & The Roslin Institute, University of Edinburgh, Edinburgh, United Kingdom

  • John Clarke ,

    Roles Methodology, Project administration, Software

    ‡ KC, AA, DJS and JC also contributed equally to this work.

    Affiliation Enfer Scientific, Naas, County Kildare, Ireland

  • Neil Watt ,

    Contributed equally to this work with: Amanda O’Brien, Alastair Hayton, Neil Watt, Gordon D. Harkiss

    Roles Conceptualization, Resources, Writing – review & editing

    Affiliation MV Diagnostics Ltd, Roslin Innovation Centre, University of Edinburgh, Edinburgh, United Kingdom

  • Gordon D. Harkiss

    Contributed equally to this work with: Amanda O’Brien, Alastair Hayton, Neil Watt, Gordon D. Harkiss

    Roles Conceptualization, Formal analysis, Methodology, Validation, Writing – original draft, Writing – review & editing

    info@mvdiagnostics.co.uk

    Affiliation MV Diagnostics Ltd, Roslin Innovation Centre, University of Edinburgh, Edinburgh, United Kingdom

Abstract

Bovine tuberculosis is usually diagnosed using tuberculin skin tests or at post-mortem. Recently, we have developed a serological test for bovine tuberculosis in cattle which shows a high degree of accuracy using serum samples. Here, we have assessed the performance of the test using individual bovine milk samples. The diagnostic specificity estimate using the high sensitivity setting of the test was 99.7% (95% CI: 99.2–99.9). This estimate was not altered significantly by tuberculin boosting. The relative sensitivity estimates of the test using the high sensitivity setting in milk samples from comparative skin test positive animals was 90.8% (95% CI: 87.1–93.6) with boosting. In animals with lesions, the relative sensitivity was 96.0% (95% CI: 89.6–98.7). Analysis of paired serum and milk samples from skin test positive animals showed correlation coefficients ranging from 0.756–0.955 for individual antigens used in the test. Kappa analysis indicated almost perfect agreement between serum and milk results, while McNemar marginal homogeneity analysis showed no statistically significant differences between the two media. The positive and negative likelihood ratio were 347.8 (95% CI: 112.3–1077.5) and 0.092 (95% CI: 0.07–0.13) respectively for boosted samples from skin test positive animals. The results show that the test has high sensitivity and specificity in individual milk samples and thus milk samples could be used for the diagnosis of bovine tuberculosis.

1. Introduction

Bovine tuberculosis (bTB) is a contagious disease caused mainly by Mycobacterium bovis (M. bovis) which affects cattle and other animals worldwide [1]. It causes major economic losses due to poor production performance and mandatory restrictions in trade and culling, with its associated losses, due to statutory control measures. Besides its economic effects, it is a major zoonosis in many countries owing to its tenacious nature and presence of resistance genes affecting different antitubercular medications [2]. The disease is difficult to control due in part to the presence of infected wildlife vectors and poor sensitivity of diagnostic tests, but also to lack of resources, and the unacceptability and affordability of test and cull control measures in many developing countries. The main diagnostic test used is the tuberculin test (TT), in which tuberculin is injected intradermally to cause a delayed-type hypersensitivity reaction in infected animals which can be detected and measured. Three different TTs are used: comparative cervical test (CCT) that measures the difference in increased skin thickness between purified protein derivatives from M. bovis (PPD-B) and Mycobacterium avium (PPD-A); single intradermal test (SIT) using PPD-B alone, either as the single cervical test (SCT) or the caudal (tail) fold test (CFT) [3]. The CCT diagnostic sensitivity (Dse) varies from 50% - 85%, while the diagnostic specificity (Dsp) ranges from 99.5% and 99.98% [46]. This variation has been ascribed to inherent poor sensitivity of the CCT and to performance errors during the application of the test resulting in reduced reliability [7]. The interferon gamma (IFNγ) test provides an increase in Dse (67% - 85.5%) though the Dsp is lower (range 85.0%– 99.6%) [4, 5], precluding its use as a screening test. The IFNγ test thus tends to be used in TT negative animals in bTB breakdown herds to detect infected animals missed by the TT.

However, despite the use of more stringent TT and IFNγ testing in control and eradication programmes, bTB still represents a major problem in many countries including the United Kingdom (UK) and Republic of Ireland (IE). The development of diagnostic tests based on other approaches could provide a way to detect M. bovis infected animals not detected by cell-mediated tests. Serology tests are used widely in veterinary infectious disease diagnosis and have potential in bTB diagnosis. Arguments against the use of antibody tests in bTB diagnosis include lack of sensitivity, variability and appearance of antibody only in the late stages of disease when animals become ‘anergic’ in the CCT and IFNγ test. However, this view is based on work published over 30 years ago using crude antigens and non-optimised tests [8, 9]. In the intervening years several antibody tests have been developed using recombinant antigens which show that antibody responses can be detected as early as 4 weeks after infection [1013] and not just in the later stages. In addition, injection of tuberculin boosts antibody levels in samples taken 1–4 weeks post skin test [10, 14] thus increasing further the sensitivity of detection.

Recent work in humans, non-human primates and cattle has shown that use of multiple antigens increases the sensitivity of antibody tests further [1519]. To take advantage of this information, we developed a multiplex serological test utilising 11 M. bovis antigens (Enferplex Bovine TB antibody test) which shows high sensitivity and specificity and detects infected cattle that are missed by TT and IFNγ tests [20]. In this study, we found serum antibodies in over 94% of CCT test positive animals which were clearly not ‘anergic’. In an early version of the Enferplex test, we detected serum antibodies from 5 weeks post experimental infection with M. bovis [21]. A recent study showed that the current WOAH validated version of the Enferplex test detected serum antibodies in 6/ 8 infected animals as early as 4 weeks post-infection [22]. In this experiment, 6/8 of these infected animals were positive in the IFNγ test at 4 weeks post-infection. The Enferplex bTB antibody test thus detects infection at all stages of the disease and not just in the late stages.

While obtaining serum for testing is straightforward in developed countries, the lack of trained veterinary personnel in many countries limits the use of serological tests. Milk samples, however, are much easier to obtain and could provide a medium that has more utility in resource poor settings. Many in vitro diagnostic tests for diseases in cattle and other livestock have been developed using milk as the test medium [23, 24]. For example, individual milk assays are available for pathogens such as Bovine viral diarrhoea virus (BVDV) [25], Brucella abortus (BA) [26], Infectious bovine rhinotracheitis virus (IBRV) [27], Fasciola hepatica (FH) [28, 29], Neospora caninum (NC) [30], and Mycobacterium avium subsp. paratuberculosis (Map) [31] in cattle.

In this report, we present data on the use of the Enferplex bTB antibody test using individual bovine milk as the test medium. The aims of the present study were to estimate the sensitivity and specificity of the Enferplex bTB antibody test using milk samples, and to perform a comparability study between individual milk and serum responses in cattle with and without bTB.

2. Materials and methods

2.1. Study design

The study aimed to determine comparability between serum and milk samples from cattle for serodiagnosis of bTB using the Enferplex Bovine TB Antibody test, and to estimate the relative sensitivity (Rse) and Dsp of the test using milk samples (Fig 1). For this purpose, defined positive and negative reference individual milk samples from animals known to be infected with M. bovis or known to be from herds free of bTB respectively were tested. Test specificity was assessed further using samples from animals infected with Map and other common non-tuberculosis pathogens of cattle. The positive reference milk samples were obtained from bTB infected animals defined by results obtained in the routine statutory CCT carried out by the Animal and Plant Health Agency (APHA), UK. Milk and serum samples taken 5–30 days post CCT were regarded as being ‘boosted’ for antibody, while those taken outside this anamnestic window were regarded as being ‘non-boosted’ [20]. The negative reference milk samples were obtained from herds that were negative in the CCT in the low-risk area of England or from Scotland which holds Officially Tuberculosis Free (OTF) status and had no recent history of bTB and/or contact with animals likely to have been exposed to M. bovis. To determine the correlation between serum and milk, samples were obtained from CCT reactors during the anamnestic period. The positive and negative milk samples obtained encompassed wide variations in geographical location, cattle breed, age, husbandry, farm practices, and farm management within the UK.

thumbnail
Fig 1. Project flow chart.

Bovine milk sample were obtained from CCT positive bTB breakdown herds to obtain relative sensitivity estimates. Anamnestic and non-anamnestic milk samples were obtained from bTB free herds to determine diagnostic and analytical specificity estimates.

https://doi.org/10.1371/journal.pone.0301609.g001

2.2. Ethical statement

No formal ethical review was conducted as positive reference samples were obtained from CCT reactor animals at the slaughterhouse after culling as part of the UK bTB control programme, while negative samples tested were remnants of samples taken under the Veterinary Surgeons Act UK for routine diagnostic purposes and formal permission to test for bTB was sought and obtained from the farmer and APHA. All methods were performed in accordance with relevant national and international guidelines and regulations and complied with ARRIVE guidelines.

2.3. Reference samples

Reference samples were taken for routine diagnostic purposes either at a time unrelated to bTB skin testing when anamnestic antibody responses would be minimal or absent (non-boosted), or approximately 5–30 days post tuberculin injection for the CCT when anamnestic antibody responses were likely to be developing or optimal (boosted).

Negative non-boosted milk samples (n = 1149) were obtained from 34 herds comprising a range of dairy breeds (British Friesian, Holstein, Holstein Friesian, Brown Swiss cross) from the low-risk areas of the UK (Cumbria, Lancashire, North and West Yorkshire, West Sussex) which had been free of bTB for at least 8 years, and no herds within 10 km had recorded bTB in the previous 12 months (Table 1). Boosted milk samples were available from 353 CCT negative animals from 8 herds. Negative milk samples were tested by ELISA for the presence of antibodies to the following pathogens: Map, BVDV, IBRV, FH, BCV, and BRSV.

thumbnail
Table 1. Source and characteristics of individual milk reference samples used in the study.

https://doi.org/10.1371/journal.pone.0301609.t001

Positive serum and milk reference samples were obtained from CCT reactor animals at the abattoir (Table 1). Animals showing two consecutive inconclusive reactions in the CCT (2 x IR) were included as a source of positive reference samples (APHA Official Veterinarian instructions available from: http://apha.defra.gov.uk/External_OV_Instructions/TB_Instructions/Skin_Test/Skin_Test_Day_Two.html). The serum and individual milk samples were aliquoted and stored at -20°C until tested. The presence of visible lesions (VL) of tuberculosis at post-mortem was recorded by APHA and the results were made available for the study.

Paired anamnestic serum and milk samples were available from 199 CCT positive animals in the UK (Cornwall, Devon, Somerset, Dorset, Wiltshire). The animals were from 22 herds comprising 11 breeds and 11 crossbreeds.

2.4. Enferplex Bovine TB antibody test

The antigens used in the multiplex test were Rv2875 synthetic peptide p6 [32]; PPD-B; recombinant Rv2873; recombinant Rv2875; Bovine TB cocktail; recombinant Rv2031c-Rv1886c fusion protein; recombinant Rv3875-Rv3874 fusion protein; recombinant Rv3874-Rv3875 fusion protein; recombinant Rv2626c; recombinant Rv0251c; recombinant Rv2031c [20]. The multiplex test was performed as described previously for serum samples [20, 21] but modified as follows for milk samples. Milk samples (2 ml) were centrifuged at room temperature for 10 min at 20000g to allow the fat component to separate from the milk supernatant. A pipette was carefully inserted down the inside of the tube to remove the fat-free milk fluid. Defatted milk samples were either tested immediately or after refrigeration for up to 24 hours at 2–8°C, or after freezing -20°C.

Individual milk samples were diluted 1:5 in diluent (Buffer B, Enfer Scientific) and paired serum samples were diluted 1:200 in Buffer B. The results were defined using the Enferplex Bovine TB Macro, based on individual antigen thresholds after subtracting the RLU value obtained from a blank spot. The individual antigen thresholds were set using known positive and negative milk samples during test development. Antibody levels for individual antigens were determined by calculating the signal/cut-off (S/CO) ratio for each antigen. Two threshold settings were established during test development: high sensitivity setting (Hse) with a target specificity of 98.0% and a high specificity setting (Hsp) with a target specificity of 99.5%. The threshold for overall assay positivity was set based on a two—antigen rule, whereby the blanked RLU signals from two or more antigens need to be above their individual antigen thresholds for the sample to be registered as “positive” [20].

2.5. Analytical specificity assays

The following commercial ELISA kits were used to measure antibodies to other pathogens in negative reference milk samples from bTB-free herds: Map—ID Screen® Paratuberculosis Indirect ELISA (ID.vet); BVDV–BVDV Total Ab Test (IDEXX); ID Screen® IBR gE Competition (ID.vet); FH (SVANOVIR® F. hepatica-Ab (Svanova Diagnostics).); BCV–SVANOVIR® BCV-Ab (Svanova Diagnostics); BRSV–SVANOVIR® BRSV-Ab (Svanova Diagnostics).

2.6. Repeatability and reproducibility trials

To determine the within-run and between-run, variation, three categories of individual milk samples were used: one milk sample that was negative against all 11 antigens; one milk sample giving strong positivity against multiple antigens; one milk sample dilution for each antigen giving weak positivity against multiple antigens. The samples were run in quadruplicate over 20 runs, split between two days and two operators.

For reproducibility studies, an evaluation panel of samples comprising negative, weak positive and strong positive milk samples were blinded and sent to three independent laboratories for reproducibility testing. Seven negative samples, 7 weak positive samples, and 7 strong positive samples (based on the two-antigen rule) were tested in duplicate using two plates from two different kit batches and one technician in each of the three independent laboratories: Laboratory 1. Department of Agriculture, Food & the Marine (DFAM) (ISO17025:2005), Backweston Laboratory Complex, Youngs Cross, Ballymadeer, Celbridge, Co. Kildare, W23 X3PH. Laboratory 2. TINE Norwegian Dairies Mastitis Laboratory (ISO17025 accredited), Post box 2038, 6402 Molde, Norway. Laboratory 3. ALT/Merieux NutriSciences, Biological Testing Laboratory (ISO17025 accredited), Unit 4, Newbridge Industrial Estate, Newbridge, Co, Kildare, Ireland. The results from the three laboratories were sent to Enfer Scientific for un-blinding and statistical analysis.

2.7. Statistical analyses

Data were expressed as mean, SD, and 95% confidence interval using Graphpad Prism v9 statistical package. Differences in proportions were assessed using Fisher’s Exact test. The degree of agreement between Enferplex test and positive and negative reference comparators was assessed using Cohen’s Kappa analysis. Marginal homogeneity analysis of results obtained with paired serum and milk was assessed using the McNemar test. Likelihood Ratio analysis was performed on data from CCT positive boosted animals and from CCT positive boosted animals with lesions using Medcalc statistical package. Positive (LR+) and negative (LR-) likelihood values, and diagnostic odds ratio (DOR) with 95% confidence interval (95% CI) were calculated. Spearman rank correlation analysis between paired serum and milk samples from CCT positive animals for the 11 antigens was also carried out.

For the repeatability and reproducibility analyses, a series of linear mixed-effect models were run with operator, day, microtitre plate and sample being entered as random effects. Similar models were run for reproducibility variation due to batch, laboratory, microtitre plate and sample assessed through calculation of intra-class correlation coefficients (ICCs). The results included calculation of the coefficient of variation (CV) defined as the ratio of the SD to the mean expressed as a percentage (%CV). These latter ICC analyses were carried out in R (v3.51, (C) 2018 The R Foundation for Statistical Computing), using the lme4 (v1.1–18.1), and sjPlot (v2.6.0) packages.

3. Results

3.1 Diagnostic specificity of the Enferplex Bovine TB Antibody test in individual milk samples

Dsp estimates were made using milk samples from bTB-free animals (Table 2 and S1 Table). The Dsp of the test was 99.7% at the Hse setting and 99.8% at the Hsp setting. Boosted samples from bTB free herds gave a Dsp of 98.6% and 99.2% at the Hse and Hsp settings of the test respectively. Analytical specificity was assessed using 1149 bTB-free milk samples tested for the presence of antibodies to Map, BVDV, IBRVge, FH, BCV or BRSV. The Enferplex bTB antibody test Dsp remained high when tested in samples positive for antibodies to these pathogens.

thumbnail
Table 2. Diagnostic specificity of the Enferplex Bovine TB antibody test using individual milk samples from UK cattle.

https://doi.org/10.1371/journal.pone.0301609.t002

3.2. Relative diagnostic sensitivity of the Enferplex Bovine TB Antibody test in individual milk samples

The relative sensitivity (Rse) and diagnostic sensitivity (Dse) estimates of the Enferplex test using individual milk samples from CCT positive animals were estimated using samples from bTB breakdown herds (Table 3 and S1 Table). The results show that the Rse of the Enferplex Bovine TB antibody in boosted samples (n = 305) was 90.8% and 87.2% at the Hse and Hsp settings of the test respectively. The equivalent figures for 18 non-boosted samples were 83.3% and 77.8% respectively. In boosted samples from animals with lesions, the Rse was 96.3% at the Hse setting and 91.3% at the Hsp setting. All 16 samples from M. bovis culture positive animals were positive (100%) at both settings of the test.

thumbnail
Table 3. Relative or diagnostic sensitivity of the Enferplex Bovine TB antibody test using individual milk samples from UK cattle.

https://doi.org/10.1371/journal.pone.0301609.t003

Agreement analysis of boosted CCT positive samples and bTB-free samples using the Hse setting gave a Kappa value of 0.934 (95% CI: 0.911–0.957) indicating almost perfect agreement. Similarly, a Kappa value of 0.957 (95% CI: 0.923–0.991) was found using boosted CCT positive lesioned animals and bTB-free samples at the Hse setting, indicating almost perfect agreement.

The results of marginal homogeneity analysis of 199 paired samples (Table 4) show that the differences in proportions between serum and milk were not statistically significant at either the high sensitivity setting (χ2df = 1 = 1.500, P = 0.227) or the high specificity setting of the test (χ21 = 0.444, P = 0.505).

thumbnail
Table 4. Comparison of proportions obtained between boosted paired serum and milk samples from CCT positive cattle using the Enferplex Bovine TB antibody test.

https://doi.org/10.1371/journal.pone.0301609.t004

Likelihood ratio analysis gave values LR+ and LR- values of 347.8 and 0.09 respectively for boosted samples from CCT positive animals (Table 5). The diagnostic odds ratio (DOR) was 3779. The LR+ and LR- were 367.7 and 0.048 respectively for boosted samples from SICCT positive animals with lesions. The DOR was 9168. Test outputs with an LR+ > 10 or LR- < 0.1 are considered good diagnostic evidence of the infection being either present or absent respectively [32]. The results show that the LR+ was > 10 and the LR- was 0.1 or less, indicating that the Enferplex Bovine TB antibody test results provide good diagnostic evidence of the infection being either present or absent respectively. The DOR provides an overall assessment measure of the test and indicates a good test performance showing values well above 100, a cut-off obtained by dividing an LR+ value = 10 with an LR- value of 0.1.

thumbnail
Table 5. Likelihood ratio (LR) for positive (LR+) and negative (LR-) individual milk samples.

https://doi.org/10.1371/journal.pone.0301609.t005

3.3. Correlation between paired milk and serum samples

A correlation analysis was performed between the 199 paired serum and milk samples from CCT positive animals (S1 Fig) and for illustration purposes the results for PPDb antigen are shown in Fig 2 with RLU values x 10−3 for serum on X axis and for milk on Y axis. Statistically significant positive correlation coefficients obtained in paired serum and milk samples for each antigen which ranged between 0.779–0.955 across the 11 antigens (Table 6). The results show that there was a strong positive correlation between the serum and milk results, with only a few outliers found for individual antigens.

thumbnail
Fig 2. Correlation between paired serum and milk in SICCT positive animals for test antigen PPDb using the Enferplex Bovine TB antibody test.

The relative light unit (RLU) obtained with the blank spot was subtracted from the RLU value obtained from antigen spots to obtain a blanked RLU value for each serum and milk sample. Results obtained from serum are shown on the X axis and from the milk samples are shown on the Y axis. Spearman’s rank correlation coefficient r was 0.909, P < 0.0001.

https://doi.org/10.1371/journal.pone.0301609.g002

thumbnail
Table 6. Spearman’s rank correlation coefficient (ρ), 95% confidence intervals, and associated p-values between serum and milk obtained in the Enferplex Bovine TB antibody test using boosted samples.

https://doi.org/10.1371/journal.pone.0301609.t006

The number of antigens recognised by antibody in the Enferplex Bovine TB antibody test was scored for each paired serum and milk sample and compared (Fig 3). Analysis of samples from CCT positive animals gave a correlation coefficient of 0.945 (95% CI: 0.927–0.960) and 0.948 (95% CI: 0.932–0.962) using the Hse and Hsp setting respectively. When serum and milk from a subset of animals that had VL at post-mortem were compared using the Hse and Hsp settings of the test, correlation coefficients of 0.975 (95% CI: 0.959–0.985) and 0.976 (95% CI: 0.960–0.986) were obtained respectively. P values were P < 0.0001 for all four comparisons. The results show that milk maintains the same rank order of number of antigens recognised by antibody as serum.

thumbnail
Fig 3. Correlation analysis of the number of test antigens recognised by antibody in paired serum and milk from 199 CCT test positive animals.

A—CCT test positive, Hse setting; B—CCT test positive, Hsp setting; C—CCT test positive with VL, Hse setting; D—CCT test positive with VL, Hsp setting. p—Spearman’s Rank Correlation Coefficient. In all 4 comparisons, P values were < 0.0001.

https://doi.org/10.1371/journal.pone.0301609.g003

3.4. Repeatability of the Enferplex Bovine TB antibody test using individual milk samples

The variation in S/CO ratios within-run and between-run were determined. The within-run %CVs for the 11 antigens ranged between 2.0 and 3.9% for the strong positive sample, and between 3.8–9.8 for the weak positive sample. Similarly, the between-run CVs ranged between 1.4 and 3.3% for the strong positive sample, and between 3.2–11.1% for the weak positive sample. The %CV ranges observed between two operators for the strong and weak positive samples were 1.4–3.5% and 3.4–10.6% respectively. The %CVs for the negative sample were not determined due to the S/CO ratios being around or below zero, rendering %CVs meaningless. Analysis of the variation observed across 20 runs of the test showed 654/660 (99.1%) data points were less than 2 SDs above or below the mean values across the 11 antigen spots. The ICC analysis showed that < 1% of the variation observed was due to the test plate, day, or operator.

3.5. Reproducibility of the Enferplex Bovine TB antibody test using individual milk samples

To assess the reproducibility of the Enferplex bTB antibody test, 7 negative, 7 weak positive and 7 strong positive milk samples were tested in duplicate using two kit batches in three independent laboratories.

3.5.1 Analytical reproducibility.

The mean S/CO ratio values obtained for the negative samples were all close to zero (S2 Fig). Most S/CO ratio responses (208/231) obtained with weak positive samples had CVs less than 10%. There were 23 exceptions where %CVs were > 10%. Of these, 17/23 samples were associated with responses that were below the threshold for the individual antigens and would be deemed to be negative responses for those antigens. The remaining 6/23 samples had %CVs ranging from 10.4%– 12.6%.

Most S/CO ratio responses (224/231) obtained with strong positive samples had %CVs less than 10%. There were 8 exceptions where %CVs were > 10%. Of these, 5/8 samples were associated with responses that were below the threshold for the individual antigens and would be deemed to be negative responses for those antigens. The remaining 3/8 samples had %CVs ranging from 12.1%– 15.9%. The ICC analyses showed that >99% of the variation observed was due to the sample and 1% due to the kit batch or laboratory.

3.5.2. Diagnostic reproducibility.

Diagnostic reproducibility was assessed in three independent laboratories using 7 negative, 7 weak positive and 7 strong positive milk samples tested in duplicate. The results showed complete concordance between the 3 laboratories, with all categories of sample.

4. Discussion

We have shown previously that multiplexing M. bovis antigens allowed the development of a serological assay for bTB that is not only highly sensitive and specific but shows good repeatability and reproducibility [20]. The test is based on a microarray of 11 bTB antigen spots and a chemiluminescent endpoint for each spot. The combination of multiple antigens and chemiluminescence provides an efficient means to attaining high sensitivity. To achieve high specificity, a two-antigen rule was used to classify results whereby two or more antigen spots must give signals above their individual thresholds before the samples was deemed to be ‘positive’ [21].

The use of serum as medium allows high throughput analysis for surveillance and eradication purposes. However, collection of serum samples is not always feasible due to cost, lack of resources and other logistic constraints, and many veterinary serological diagnostic assays have been adapted for use in milk samples which are easier and cheaper to collect and are often taken routinely for monitoring quality and disease control purposes.

While individual milk assays are available for many pathogens, very few studies have been performed to assess the potential use of milk in bTB diagnosis [33, 34]. In this report, we have adapted the Enferplex Bovine TB antibody test for use in bovine milk and assessed the diagnostic accuracy of the test using individual samples. We have used the CCT as the main reference standard due to its high specificity [5] and its use as the main disclosure test for bTB in UK, IE and other countries to determine infected herds. Anamnestic milk samples were used in the study since it is well established in the literature that serum antibody levels are elevated following boosting with tuberculin [10, 13, 14, 35, 36], and it was likely that a similar boosting effect would be manifest using milk samples.

The Dsp of the Enferplex bTB milk test was observed to be 99.7% using the Hse setting of the test in UK dairy herds using non-anamnestic samples, and 98.5% using anamnestic samples. When samples from bTB-free cattle with evidence of infection with non-tuberculous pathogens such as Map, IBRV, BVDV, FH, BCV and BRSV were analysed, the Dsp remained high, showing that these infections did not influence the accuracy of the Enferplex bTB antibody test in bTB-free animals. These results are thus consistent with those found using serum at the Hse setting [20].

The Rse of the test was found to be 90.8% in boosted samples using the Hse setting and 96.3% in animals showing VL at post-mortem. A positive correlation between serum antibody and lesions in tuberculin positive animals is well documented in the literature [20, 35, 37, 38] and this result using milk is consistent with those studies. These results compare well with a Rse (87.8%) and Dsp (97.7%) found in milk from Korean cattle using by ELISA [33]. In contrast, the Enferplex test results show a higher performance compared to the Rse (50%) and Dsp (97.5%) reported using a commercially available bTB antibody test in bovine milk from M. bovis culture positive animals [34].

When the Enferplex test results obtained using paired serum and milk were compared, good positive correlations were observed for all 11 antigen spots. The Spearman rank correlation coefficients ranged from 0.78–0.96 across all antigens. These results are comparable to a correlation coefficient of 0.83 for a bTB antibody ELISA between milk and serum, and antibody tests in cattle for BVDV or NC infections where correlation coefficients of 0.925 and 0.702 were reported respectively [30, 33, 39].

The high positive correlation values found for individual antigens in the Enferplex milk test was reflected in the high correlation coefficients observed when the number of antigens recognised by antibody was compared in serum and milk samples. Consistent with this, agreement analysis gave high Kappa values at the two sensitivity settings of the test and application of the McNemar discriminant test indicated no statistically significant differences between serum and milk results. The agreement test result obtained overall using the Enferplex Bovine TB antibody test (Kappa = 0.934) is consistent with those in the literature for BVDV (Kappa = 0.865) but is considerably higher than for those observed in Map infection (Kappa = 0.500) [25, 31].

The reasons why the correlation is so poor in Johne’s disease compared to BVDV and Enferplex Bovine TB antibody tests are unknown. Poor Map test sensitivity may play a role as IgG concentrations are much lower in milk than serum [40]. It is known that normal bovine serum contains both IgG1 and IgG2 subclasses at similar concentrations, while in milk the IgG1 subclass dominates [4043]. IgG1 fixes complement, but IgG2 is associated with opsonisation for removal and destruction of bacteria by macrophages [43]. IFNγ is also known to upregulate IgG2 responses [43], suggesting that TH1 responses in animals with Johnes may influence the IgG1/IgG2 balance in blood leading to discrepancies with milk responses. However, IgG1 responses to PPDa have been shown to increase in the clinical stage of Johnes compared to asymptomatic stage, while IgG1 and IgG2 responses to other antigens such as Hsp70, Hsp65 and LAM were decreased in the clinical versus asymptomatic stages [44]. This suggests that discrepancies between IgG1 and IgG2 antibody responses in Johne’s disease may be dependent on antibody responses to particular Map antigens.

In bTB, IgG1 anti-MPB70 antibody levels in animals with bTB are higher in animals that show VL at post-mortem and are M. bovis culture positive [45]. In the latter study, no individual MPB70 epitopes were exclusively recognised by IgG1 or IgG2 antibodies. However, IgG1 and IgG2 serum antibody responses in M. bovis experimentally infected animals have been shown to be similar in some animals but to have higher IgG1 antibody levels in others [37]. It is possible that fluctuations in IFNγ responses may have resulted in the different IgG subclass responses observed in the latter study. Despite these variations in IgG isotype responses, we found that the Rse of the Enferplex antibody test in boosted milk samples from CCT positive animals was comparable to that previously observed in serum using Hse setting [20]. It is possible that the dominance of IgG1 responses masked contributions from IgG2 antibodies such that little difference between serum and milk responses is observed. Alternatively, boosting with tuberculin may increase some antibody responses over others which could mask isotype differences. Analysis of IgG subclass levels in paired serum and milk samples would be required to determine if any of these possibilities are correct or not.

We performed likelihood ratio analysis to assess the likelihood of the Enferplex milk test results being true versus false across both infected and non-infected individuals. Positive LR values that are above 10 and negative LR values that are below 0.1 are deemed to provide good diagnostic evidence for infection being present or absent respectively [32]. The likelihood ratio analysis showed that the positive and negative LR values for the Enferplex Bovine TB antibody test were well above and below these limits respectively, indicating the fitness-for-purpose of the Enferplex milk test for ruling in and ruling out bTB in cattle.

Collectively, these results show excellent comparability between milk and serum results and indicate that individual milk samples could substitute for serum while retaining high sensitivity and specificity for detecting bTB. It should be noted, however, that various non-disease factors have been shown to affect diagnostic test results when milk is used as the medium. These include milk yield, protein concentrations, presence of inhibitors, parity, and stage of lactation [4650], though a recent analysis of results from Map infected cattle found that these variables explained only 5.1% of the variation observed in antibody levels [51]. Another study found that there were no production losses associated with any of these variables [52]. We have not determined whether such factors affect the Enferplex bTB antibody test in this report, but it will be important to assess these potential effects in further studies.

5. Conclusions

This report shows that the Rse and Dsp of the Enferplex bovine TB antibody test are both high using individual milk as the sample specimen and demonstrates good agreement between milk antibody results and CCT status. Strong positive correlations were observed between serum and milk antibody responses to each of the 11 antigens in the test, and with the number of antigens recognised by antibody. The LR+ and LR- values obtained using milk provide good diagnostic evidence of the infection being either present or absent respectively. The test also exhibits good repeatability and reproducibility. The results show that individual milk samples can be used in the Enferplex Bovine TB antibody test instead of serum for the diagnosis of bTB.

Supporting information

S1 Table. Raw data used to estimate relative sensitivity and diagnostic specificity.

The status of the CCT and presence of VL are indicated.

https://doi.org/10.1371/journal.pone.0301609.s001

(PDF)

S1 Fig. Correlation between serum and milk results for each antigen used in the test.

The relative light unit (RLU) obtained with the blank spot was subtracted from the RLU value obtained from antigen spots to obtain a blanked RLU value for each serum and milk sample. Results obtained from serum are shown on the Y axis and from the milk samples are shown on the X axis. Spearman’s rank correlation coefficient ρ obtained with paired serum and milk samples for each antigen ranged between 0.779–0.955 across the 11 antigens (P <0.0001 for all antigens).

https://doi.org/10.1371/journal.pone.0301609.s002

(PDF)

S2 Fig. Reproducibility plots of test results obtained by three independent laboratories.

An evaluation panel of samples comprising negative, weak positive and strong positive milk samples were blinded and sent to three independent laboratories for reproducibility testing. Seven negative samples, 7 weak positive samples, and 7 strong positive samples (based on the two-antigen rule) were tested in duplicate using two plates from two different kit batches and one technician in each of the three independent laboratories. The results obtained for raw and signal/cut-off data are shown in the plots.

https://doi.org/10.1371/journal.pone.0301609.s003

(PDF)

Acknowledgments

We would like to thank the Department of Food, Agriculture and Rural Affairs for giving permission for us to test samples for bTB. We would also like to thank James O’Brien (Enfer Scientific) for excellent technical support, and farmers and local veterinarians for permission to test samples used in the study.

References

  1. 1. Borham M, Oreiby A, El-Gedawy A, Hegazy Y, Khalifa HO, Al-Gaabary M, et al. Review on Bovine Tuberculosis: An Emerging Disease Associated with Multidrug-Resistant Mycobacterium Species. Pathogens 2022; 11: 715.
  2. 2. Borham M, Oreiby A, El‐Gedawy A, Hegazy Y, Hemedan A, Al‐Gaabary M. (2022). Abattoir survey of bovine tuberculosis in tanta, centre of the Nile delta, with in silico analysis of gene mutations and protein–protein interactions of the involved mycobacteria. Transbound Emerg Dis. 2022; 69(2): 434–450.
  3. 3. World Organisation for Animal Health. Chapter 3. 1. 1 3. 2023. Mammalian tuberculosis (infection with Mycobacterium tuberculosis complex). 2023. https://www.woah.org/fileadmin/Home/eng/Health_standards/tahm/3.01.13_Mammalian_tuberculosis.pdf.
  4. 4. de la Rua-Domenech R, Goodchild AT, Vordermeier AT, Hewinson RG, Christiansen KH, Clifton-Hadley RS. Ante mortem diagnosis of tuberculosis in cattle: A review of the tuberculin tests, γ-interferon assay and other ancillary diagnostic techniques. Res Vet Sci. 2006; 81:190–192.
  5. 5. Nunez-Garcia J, Downs SH, Parry JE, Abernethy DA, Broughan JM, Cameron AR, et al. Meta-analyses of the sensitivity and specificity of ante-mortem and post-mortem diagnostic tests for bovine tuberculosis in the UK and Ireland. Prev Vet Med 2018; 153: 94–107. pmid:28347519
  6. 6. Goodchild AV, Downs SH, Upton P, Wood JLN, de la Rua-Domenech R. Specificity of the comparative skin test for bovine tuberculosis in Great Britain. Vet Rec. 2015; 177(10):258–266. pmid:26338518
  7. 7. Borham M, Oreiby A, El-Gedawy A, Hegazy Y, Al-Gaabary M. Tuberculin test errors and its effect on detection of bovine tuberculosis. J Hellenic Vet Med Soc. 2021; 72(4): 3263–3270.
  8. 8. Plackett P, Ripper J, Corner LA, Small K, de Witte K, Melville L, et al. An ELISA for the detection of anergic tuberculous cattle. Austr Vet J. 1989; 66(1): 15–19. pmid:2649053
  9. 9. Ritacco V, Lopez B, de Kantor IN, Barrera I, Errico F. Reciprocal cellular and humoral immune responses in bovine tuberculosis. Res Vet Sci. 1991; 50:365–367. pmid:1909047
  10. 10. Lyashchenko K, Whelan AO, Greenwald R, Pollock JM, Andersen P, Hewinson RG, et al. Association of tuberculin-boosted antibody responses with pathology and cell-mediated immunity in cattle vaccinated with Mycobacterium bovis BCG and infected with M. bovis. Infect Immun. 2004; 72(5):2462–2467.
  11. 11. Koo HC, Park YH, Ahn J, Waters RW, Palmer MV, Hamilton MJ, et al. Use of rMPB70 protein and ESAT-6 peptide as antigens for comparison of the enzyme-linked immunosorbent, immunochromatographic, and latex bead agglutination assays for serodiagnosis of bovine tuberculosis. J Clin Microbiol. 2005; 43(9):4498–4506. pmid:16145098
  12. 12. Green LR, Jones CC, Sherwood AL, Garkavi IV, Cangelosi GA, Thacker TC, et al. Single-Antigen Serological Testing for Bovine Tuberculosis. Clin Vaccine Immunol. 2009; 16(9):1309–1313. pmid:19605596
  13. 13. Waters WR, Buddle BM, Vordermeier HM, Gormley E, Palmer MV, Thacker TC, et al. Development and evaluation of an enzyme-linked immunosorbent assay for use in the detection of bovine tuberculosis in cattle. Clin Vaccine Immunol. 2011; 18:1882–1888. pmid:21918115
  14. 14. Waters WR, Palmer MV, Stafne MR, Bass KE, Mayara F. Maggioli MF, et al. Effects of serial skin testing with purified protein derivative on the level and quality of antibodies to complex and defined antigens in Mycobacterium bovis-infected cattle. Clin. Vaccine Immunol. 2015; 22:641–649.
  15. 15. Kunnath-Velayudhan S, Hugh Salamon H, Hui-Yun Wanga H-Y, Davidow AL, Molina DM, et al. Dynamic antibody responses to the Mycobacterium tuberculosis proteome. Proc Natl Acad Sci USA. 2010; 107:14703–14708.
  16. 16. Kunnath-Velayudhan S, Davidow AL, Wang H-Y, Molina DM, Huynh VT, Salamon H, et al. Proteome-Scale antibody responses and outcome of mycobacterium tuberculosis infection in nonhuman primates and in tuberculosis patients. J Infect Dis. 2012; 206:697–705.
  17. 17. Khurshid S, Afzal M, Khalid R, Akhtar MW, Qazi MH. Potential of multi component antigens for tuberculosis diagnosis. Biologicals. 2017; 48:109–113. pmid:28522247
  18. 18. Zhou F, Xu X, Wu S, Cui X, Pan W. ORFeome-based identification of biomarkers for serodiagnosis of Mycobacterium tuberculosis latent infection. BMC Infect Dis. 2017; 17:793. pmid:29281987
  19. 19. Waters WR, Vordermeier HM, Rhodes S, Khatri B, Palmer MV, Maggioli MF, et al. Potential for rapid antibody detection to identify tuberculous cattle with non-reactive tuberculin skin test results. BMC Vet Res 2017; 13:164. pmid:28592322
  20. 20. O’Brien A, Clarke J, Hayton A, Adler A, Cutler K, Shaw DJ, et al. Diagnostic accuracy of the Enferplex Bovine Tuberculosis antibody test in cattle. Sci Rep. 2023; 13:1875–1881.
  21. 21. Whelan C, Shuralev E, O’Keeffe G, Hyland P, Kwok HF, Snoddy P, et al. Multiplex immunoassay for serological diagnosis of Mycobacterium bovis infection in cattle. Clin Vaccine Immunol, 2008; 15(12): 1834–1838.
  22. 22. Holder T, Srinivasan S, McGoldrick A, Williams GA, Palmer S, Clarke J, et al. Temporal dynamics of the early immune response following Mycobacterium bovis infection of cattle. Sci Rep. 2024;14(1):2600. pmid:38297023
  23. 23. Oreiby A F, Hegazy Y M. Diagnosis of ovine caseous lymphadenitis by blood and milk gamma interferon assays. Small Rum Res, 2016;144: 109–112.
  24. 24. Brito B, Hick P. Milk as a diagnostic fluid to monitor viral diseases in dairy cattle. Aust Vet J. 2024;102(1–2):11–18. pmid:37814548
  25. 25. Lanyon SR, McCoy R, Bergman E, Reichel MP. Milk as a diagnostic sample for a commercially available ELISA to identify bovine viral diarrhoea (BVD) antibodies in dairy herds. Austr Vet J. 2014; 92(7):269–273. pmid:24964837
  26. 26. Romero C, Pardo M, Grillo MJ, Diat R, Blasco JM, Goni L. Evaluation of PCR and indirect enzyme linked immunosorbent assay on milk samples for diagnosis of brucellosis in dairy cattle. J Clin Microbiol. 1995; 33:3198–3200. pmid:8586702
  27. 27. Wellenberg GJ, Verstraten ERAM, Mars M H, Van Oirschot JT. Detection of bovine herpesvirus 1 glycoprotein E antibodies in individual milk samples by enzyme-linked immunosorbent assays. J Clin Microbiol. 1998; 36(2):409–413. pmid:9466750
  28. 28. Reichel MP, Vanhoff K, Baxter B. Performance characteristics of an enzyme-linked immunosorbent assay performed in milk for the detection of liver fluke (Fasciola hepatica) infection in cattle. Vet Parasitol. 2005; 129:61–66.
  29. 29. Mezo M, González-Warleta M, Castro-Hermida JA, Carro C, Ubeira FM. Kinetics of anti-Fasciola IgG antibodies in serum and milk from dairy cows during lactation, and in serum from calves after feeding colostrum from infected dams. Vet Parasitol. 2010; 168(1–2):36–44. pmid:19897308
  30. 30. Hall CA, Reichel P, Ellis JT. Prevalence of Neospora caninum infection in Australian (NSW) dairy cattle estimated by a newly validated ELISA for milk. Vet Parasitol. 2006; 142:173–178.
  31. 31. Lombard JE, Byrem TM, Wagner BA, McCluskey BJ. Comparison of milk and serum enzyme-linked immunosorbent assays for diagnosis of Mycobacterium avium subspecies paratuberculosis infection in dairy cattle. J Vet Diagn Invest. 2006; 18:448–458.
  32. 32. Caraguel CGB, Colling A. Diagnostic likelihood ratio–the next generation of diagnostic test accuracy measurement. Rev Sci Tech Off Int Epiz. 2021; 40(1):299–309. pmid:34140723
  33. 33. Jeon B-Y, Kim S-C, Je S, Kwak J, Cho J-E, Woo J-T. Evaluation of enzyme-linked immunosorbent assay using milk samples as a potential screening test of bovine tuberculosis of dairy cows in Korea. Res Vet Sci. 2010; 88:390–393. pmid:20060551
  34. 34. Buddle BM, Wilson T, Luo D, Voges H, Linscott R, Martel E, et al. Evaluation of a commercial enzyme linked immunosorbent assay for the diagnosis of bovine tuberculosis from milk samples from dairy cows. Clin. Vaccine Immunol. 2013; 20(12):1812–1816. pmid:24132605
  35. 35. Casal C, Dıez-Guerrier A, Alvarez J, Rodriguez-Campos S, Mateos A, Linscott R, et al. Strategic use of serology for the diagnosis of bovine tuberculosis after intradermal skin testing. Vet Microbiol. 2014; 170:342–351. pmid:24679958
  36. 36. Villarreal-Ramos B, Reed S, McAulay M, Prentice H, Coffey T, Charleston BC, et al. Influence of the nature of the antigen on the boosting of responses to mycobacteria in M. bovis-BCG vaccinated cattle. Vaccine. 2006; 24:6850–6858.
  37. 37. Welsh MD, Cunningham RT, Corbett DM, Girvin RM, McNair J, Skuce RA, et al. Influence of pathological progression on the balance between cellular and humoral immune responses in bovine tuberculosis. Immunol. 2005; 114:101–111. pmid:15606800
  38. 38. Lightbody KA, Skuce RA, Neill SD, Pollock JM. Mycobacterial antigen-specific antibody responses in bovine tuberculosis: an ELISA with potential to confirm disease status. Vet Rec. 1998; 142:295–300. pmid:9569495
  39. 39. Schares G, Bärwald A, Staubach C, Wurm R, Rauser M, Conraths FJ, et al. Adaptation of a commercial ELISA for the detection of antibodies against Neospora caninum in bovine milk. Vet Parasitol 2004; 120 (1–2):55–63.
  40. 40. Butler JE. Bovine Immunoglobulins: A Review. J Dairy Sci. 1969; 52 (12):1895–1909.
  41. 41. Mazengera KE, Kennedy BW, Burnside EB, Wilkie BN, Burton JH. Genetic parameters of bovine serum immunoglobulins. J Dairy Sc1985; 68:2309–2314. pmid:4067046
  42. 42. Guidry AJ, Miller RH. Immunoglobulin isotype concentrations in milk as affected by stage of lactation and parity. J Dairy Sci. 1986; 69:1799–1805. pmid:3745582
  43. 43. Estes DM, Closser NM, Allen GK. IFN-γ stimulates IgG2 production from bovine B cells costimulated with anti-μ and mitogen. Cell. Immunol. 1994; 154 (2): 287–295.
  44. 44. Koets AP, Rutten VPMG, de Boer M, Bakker D, Valentin-Weigand P, van Eden W. Differential changes in Heat Shock Protein-, Lipoarabinomannan-, and Purified Protein Derivative-Specific immunoglobulin G1 and G2 isotype responses during bovine Mycobacterium avium subsp. paratuberculosis infection. Infect. Immun. 2001; 69 (3):1492–1498.
  45. 45. Lightbody KA, McNair J, Neill SD, Pollock JM. IgG isotype antibody responses to epitopes of the Mycobacterium bovis protein MPB70 in immunised and in tuberculin skin test-reactor cattle. Vet Microbiol. 2000; 75:177–188.
  46. 46. Nielsen SS, Enevoldsen C, Grohn YT. The Mycobacterium avium subsp. paratuberculosis ELISA response by parity and stage of lactation. Prev Vet Med. 2002; 54:1–10.
  47. 47. Nielsen SS, Grohn YT, Enevoldsen C. Variation of the milk antibody response to paratuberculosis in naturally infected dairy cows. J Dairy Sci. 2002; 85:2795–2802. pmid:12487446
  48. 48. Nielsen SS, Krogh MA, Enevoldsen C. Time to the occurrence of a decline in milk production in cows with various paratuberculosis antibody profiles. J Dairy Sci. 2009; 92(1):149–155. pmid:19109273
  49. 49. Nielsen SS, Toft N. Effect of days in milk and milk yield on testing positive in milk antibody ELISA to Mycobacterium avium ssp. paratuberculosis in dairy cattle. Vet Immunol Immunopathol. 2012; 149:6–10.
  50. 50. Eisenberg SWF, Veldman E, Rutten VP, Koets AP. A longitudinal study of factors influencing the result of a Mycobacterium avium ssp. paratuberculosis antibody ELISA in milk of dairy cows. J Dairy Sci. 2015; 98:2345–2355.
  51. 51. McAloon CG, O’Grady L, Botaro B, More SJ, Doherty M, Whyte P, et al. Individual and herd-level milk ELISA test status for Johne’s disease in Ireland after correcting for non-disease-associated variables. J Dairy Sci. 2020; 103 (10):9345–9354. pmid:32747098
  52. 52. Kennedy AE, Byrne N, Garcia AB, O’Mahony J, Sayers RG. Analysis of Johne’s disease ELISA status and associated performance parameters in Irish dairy cows. Res Vet Sci. 2016; 81: 190–210. pmid:26935209