Hostname: page-component-8448b6f56d-tj2md Total loading time: 0 Render date: 2024-04-24T14:49:55.672Z Has data issue: false hasContentIssue false

Diagnostic accuracy of enzyme-linked immunosorbent assay (ELISA) and immunoblot (IB) for the detection of antibodies against Neospora caninum in milk from dairy cows

Published online by Cambridge University Press:  22 December 2017

I. P. Chatziprodromidou*
Affiliation:
Department of Public Health, Medical School, University of Patras, Patras, Greece
T. Apostolou
Affiliation:
School of Health Professionals, Alexander Technological Educational Institute of Thessaloniki, Thessaloniki, Greece
*
Author for correspondence: I. P. Chatziprodromidou, E-mail: ioannachatzi@med.upatras.gr
Rights & Permissions [Opens in a new window]

Abstract

The aim of the study was to estimate the sensitivity and specificity of enzyme-linked immunosorbent assay (ELISA) and immunoblot (IB) for detecting antibodies of Neospora caninum in dairy cows, in the absence of a gold standard. The study complies with STRADAS-paratuberculosis guidelines for reporting the accuracy of the test. We tried to apply Bayesian models that do not require conditional independence of the tests under evaluation, but as convergence problems appeared, we used Bayesian methodology, that does not assume conditional dependence of the tests. Informative prior probability distributions were constructed, based on scientific inputs regarding sensitivity and specificity of the IB test and the prevalence of disease in the studied populations. IB sensitivity and specificity were estimated to be 98.8% and 91.3%, respectively, while the respective estimates for ELISA were 60% and 96.7%. A sensitivity analysis, where modified prior probability distributions concerning IB diagnostic accuracy applied, showed a limited effect in posterior assessments. We concluded that ELISA can be used to screen the bulk milk and secondly, IB can be used whenever needed.

Type
Original Paper
Copyright
Copyright © Cambridge University Press 2017 

Introduction

Neospora caninum is an obligatory intracellular parasite with the indirect biological cycle. Dogs and coyotes [Reference Gondim, McAllister, Pitt and Zemlicka1] have been identified as the definitive hosts of the parasite, while other domestic and wild animals, such as cattle, small ruminants, water buffalos [Reference Rodrigues, Gennari, Aguiar, Sreekumar, Hill, Miska, Vianna and Dubey2] and white-tailed deers can be intermediate hosts [Reference Gondim, McAllister, Mateus Pinilla, Pitt, Mech and Nelson3]. N. caninum infected cattle usually remain carriers of the parasite and as a result a ‘store’ reservoir of it. N. caninum can be transmitted vertically or horizontally: (a) vertical/endogenous transmission, refers to the transmission from an infected mother to the embryo, leading to abortion or birth of clinically or sub clinically infected calves and (b) horizontal/exogenous transmission, alludes to the infection of the cow by consumption of faeces of infected dogs, which are considered to be definitive hosts [Reference McAllister, Dubey, Lindsay, Jolley, Wills and McGuire4]. The majority of cases reported in the literature were attributed to vertical/endogenous transmission [Reference Davison, Otter and Trees5]. The presence of domestic dogs on the farm is considered as a risk factor for infection of farm cattle [Reference Paré, Fecteau, Fortin and Marsolais6]. Risk factors related to the management of the farm, stray dogs and climatic agents could also affect the extent of the problem [Reference Conraths and Gottstein7].

N. caninum can create severe reproductive problems leading to extensive economic loss [Reference Dubey and Lindsay8].

Studies conducted in Europe (the UK, Switzerland) established that neosporosis is the leading cause of abortions [Reference Davison, Otter and Trees5]. Epidemiological studies showed that neosporosis is a major problem in cattle all over the world [Reference Wouda, Bartels and Dijkstra9]. Moreover, Wouda et al. showed that high prevalence of neosporosis in cattle and the presence of N. caninum seropositive dogs on the farm are highly correlated [Reference Wouda, Dijkstra, Kramer, Van Maanen and Brinkhof10].

Diagnostic tests detecting antibodies against N. caninum either in serum or in milk are useful tools for the diagnosis, surveillance and control of neosporosis, as they can be applied easily and promptly for the screening of the farms. Milk samples collection is easier and faster and is regarded as less invasive for animals in comparison with serum samples [Reference Ortega, Torres and Mena11]. The most widely used serologic tests include indirect fluorescent antibody test, enzyme-linked immunosorbent assay (ELISA), immunoblot (ΙΒ) and sero-agglutination. Particularly, ELISA has been widely established for neosporosis diagnosis, as it is easy to apply and enables rapid determination of antibody levels in fluids like milk and serum [Reference Björkman, Holmdahl and Uggla12, Reference Atkinson, Harper, Reichel and Ellis13]. The IB, on the other hand, is mostly used as an adjunct to other diagnostic tests already in use, rather than as a routine diagnostic screening method [Reference Atkinson, Harper, Reichel and Ellis13]. IB is regarded as more time-consuming and complicated in application and result interpretation (IB is of great importance in identifying immunodominant antigens against N. caninum) [Reference Soendgen, Peters, Baerwald, Wurm, Holling and Conraths14].

In case of absence of a gold standard, as in neosporosis case, latent class models were first introduced by Hui and Walter [Reference Hui and Walter15]. Hui and Walter's model assessed the diagnostic accuracy of two conditionally independent tests in two populations (of different prevalence) and this was further extended to take into account potential conditional dependence of diagnostic tests. Non-identifiable issues in all those models were addressed effectively by Bayesian modeling, namely by incorporating of prior knowledge of test performances [Reference Johnson, Gastwirth and Pearson16]. From an epidemiological point of view, Bayesian models have seldom been applied to evaluate the diagnostic accuracy of ELISA against IB to detect antibodies against N. caninum. Furthermore, a diagnostic test's accuracy may vary between species, age, type of samples and medium tested, sample quality and other factors [Reference Nielsen, Gronbak, Agger and Houe17].

In this study, we used a latent class approach in a Bayesian framework to investigate and compare sensitivity (Se) and specificity (Sp) of ELISA and IB tests in milk samples for N. caninum antibodies’ detection at herd level, in order to demonstrate freedom and eradicate the parasite infection, confirm the diagnosis of cases, minimise abortion rates and therefore maximise profit. Furthermore, this study attempts to evaluate the use of milk as a sample type for the serological diagnosis of neosporosis in dairy cattle. The study followed STRADAS-paratuberculosis guidelines [Reference Gardner, Nielsen, Whittington, Collins, Bakker and Harris18].

Methods

Dairy milk samples and study design

The target and source populations of this study were previously published by Sotiraki et al. [Reference Sotiraki, Brozos, Samartzi, Schares, Kiossis and Conraths19]. Concisely, the study was carried out in 10 dairy farms, in four of the main dairy-farming regions of Greece (Epirus, Thessaly, Macedonia and Thrace) that represented more than 80–85% of the country's dairy population. Ten dairy-cow herds were randomly selected to be included in the study from all described areas. All herds comprised Holstein cattle. The total number of cattle bred in the 10 randomly selected herds was 1538, from which 1038 were cows and 535 heifers. Only 777 samples (49.4%) were obtained exclusively from cattle that were lactating at the day of sampling. No exclusion criteria (i.e. history of abortion) were set. All milk samples of 10–15 ml were obtained before the mechanical milking procedure and were preserved with 0.1 g sodium azide medium for transportation purpose. Upon receipt at the laboratory, samples were aliquoted and placed at −20 °C. Questionnaires were also collected, recording information about the number of abortions during the last 3 years, the occurrence of epidemic outbreak, the origin of the animals (imported, born in the field), the preventive measures taken in each farm against neosporosis, the type and use of the stable holdings, the type of insemination (artificial or natural), the availability of water, the general hygienic conditions and the presence of dogs or other animals on the farms [Reference Sotiraki, Brozos, Samartzi, Schares, Kiossis and Conraths19].

The whole data collection process was prospective, as samples were collected and the tests under evaluation (TUE) were assessed after the initiation of the study and for the purpose of ELISA and IB evaluation.

Diagnostic tests for detecting antibodies

ELISA was selected to be evaluated because it is not a common practice concerning dairy cattle [Reference Varcasia, Capelli, Ruiu, Ladu, Scala and Bjorkman20]. Since Sotiraki's et al. study [Reference Sotiraki, Brozos, Samartzi, Schares, Kiossis and Conraths19], IB has been previously used as (i) gold standard for evaluation of ELISA assay results [Reference Schares, Rauser, Zimmer, Peters, Wurm and Dubey21], (ii) reference standard of other tests’ results [Reference Osawa, Wastling, Acosta, Ortellado, Ibarra and Innes22] and (iii) only once in neosporosis investigation in milk samples [Reference Ortega, Torres and Mena11]. IB though time-consuming and more complicated to apply was considered as a high sensitivity and specificity assay.

Milk samples examined using, an indirect-house ELISA (p38-milk-ELISA), were considered to be positive for N. caninum antibodies if the OD was above 0.15, using purified NSRS2 [Reference Schares, Pantchev, Barutzki, Heydorn, Bauer and Conraths23]. The IB test was prepared using NC-1 tachyzoites that were cultivated for 1 day under serum-free conditions, while the reactivities between tachyzoites and sera were recorded for Mr 17,29, 30, 33 and 37 kDa, as previously published in the literature [Reference Schares, Peters, Wurm, Bärwald and Conraths24]. For IB, the samples that gave two or more immunodominant bands were considered positive for antibodies, while where only one immunodominant band was present the samples were considered ‘inconclusive’ [Reference Sotiraki, Brozos, Samartzi, Schares, Kiossis and Conraths19]. Those latter samples were regarded as negative for our study.

The tests (ELISA and IB) used and underwent diagnostic evaluation were both in-house produced by Federal Research Institute for Animal Health (Institute of Epidemiology, Friedrich-Loeffer-Institut, Seestrasse 55, D-16868 Wusterhausen, Germany), which is a reference laboratory for N. caninum diagnosis (personal contact with Dr Smaro Sotiraki). Laboratory personnel and readers of IB (gold standard) test were masked to ELISA's results, as commonly applied in case of reference laboratories’ practice.

All milk samples were both tested with ELISA and IB by Sotiraki et al. and are summarised in Table 1. A total of 118 milk samples were tested positive for antibodies against N.caninum using ELISA, while there were 216 IB-positive samples. As there is no gold standard, it is not possible to determine unequivocally which samples had, indeed, antibodies against N. caninum. The discrepancy in the results of the two diagnostic tests can be attributed either to low ELISA Se or/and low IB Sp. Analysing the data in detail, we concluded that all, except for two, the samples which were proved to be positive with ELISA, were also positive with IB. Furthermore, there were samples proved to be negative with ELISA, but marginally positive or negative with IB.

Table 1. Results of ELISA and ΙΒ for the detection of antibodies against N. caninum, performed in individual milk samples of 10 Greek dairy farms (according to Sotiraki et al. [Reference Sotiraki, Brozos, Samartzi, Schares, Kiossis and Conraths19])

Statistical analysis

We applied latent-class models firstly introduced by Hui and Walter [Reference Hui and Walter15] in a Bayesian framework [Reference Branscum, Gardner and Johnson25] to make inferences about diagnostic sensitivity and specificity of ELISA and IB, for detecting antibodies against N. caninum in the milk samples. Bayesian methodology allowed the combination of prior scientific knowledge about the parameters of interest with the data from the study, in order to produce posterior inferences [Reference Branscum, Gardner and Johnson25]. Estimations of Se and Sp of the ELISA and the IB were based on their cross-classified results. In order for the Hui and Walter model to be valid, three assumptions need to be met: (i) the diagnostic tests should be conditionally independent, (ii) the source data population should have the ability to be divided in two or more subpopulations with different prevalence and (iii) diagnostic Se and Sp recorded in those subpopulation with different prevalence should be consistent [Reference Hui and Walter15].

As both ELISA and IB are designed to detect the same biological phenomenon, namely the presence of antibodies against N. caninum in milk, the conditional independence assumption required by Hui and Walter paradigm was not warranted. For this reason, in this study, we used Bayesian modeling, namely both methodology proposed by Johnson et al. [Reference Johnson, Gastwirth and Pearson16] for conditionally independent tests and Branscum et al. [Reference Branscum, Gardner and Johnson25], which does not require the conditional independence assumption.

To validate the assumption of difference in prevalence between the two subpopulations, test results from individual farms were pooled into two sets of samples: (a) one set of samples (named population 1) included those obtained from farms (farms 1,4,6,7 and 10) in which domestic dogs were present, as dogs are the definitive hosts of the parasite and therefore the animals of the farms that coexisted with dogs had greater possibilities to be infected by N. caninum, than others that did not reside with dogs, (b) the other set of samples (named population 2) originated from farms without dogs (farms 2,3,5,8 and 9), where animals did not come in contact neither with domestic nor with stray dogs (namely with N. caninum oocysts shed in canine faeces) and therefore had less possibilities to be infected by the parasite. The reasoning behind this categorisation was that the presence of dogs on a farm is a risk factor for the presence of neosporosis [Reference Schares, Bärwald, Staubach, Ziller, Klöss and Schröder26].

To confirm the consistency of Se and Sp across the two subpopulations, we repeated models’ running three times and every time Se and Sp were found to be similar for all subpopulations.

Based on scientific (personal contact with experts and literature) inputs for Se, Sp of ELISA and IB and the prevalence of the studied populations, specific Beta prior distributions were obtained using the Beta Buster software (http://cadms.ucdavis.edu/diagnostictests). In each case, experts expressed their best estimation concerning tests’ parameters. Beta probability distributions were used to model the assessments of the experts and the related uncertainty. When constructing beta prior distributions, the most probable value for each parameter was used as the mode of the distribution, while the lowest (or highest) possible value was considered as the 5th (or 95th) percentile of the distribution.

Statistical analysis was conducted using WINBUGS (https://www.mrc-bsu.cam.ac.uk/software/bugs/). We used appropriate WINBUGS code authored by Branscum et al. [Reference Branscum, Gardner and Johnson25], which is available at http://cadms.ucdavis.edu/diagnostictests/2indt2p.html.

For calculating both tests’ repeatability and reproducibility, a sensitivity analysis was conducted.

Results

Nine out of ten herds had abortions recorded in the past 3 years, from which one herd had epidemic abortions, while the rest eight had sporadic ones. Concerning the management practices, pregnant heifers were regularly used for replacement purposes, while dogs which are regarded as risk factors had free access in five out of ten premises and the overall hygienic status was good in six and poor in four of the herds included in this study. The time interval between the collections of milk samples for both TUE was not recorded in the primary data collected by Sotiraki et al. However, no interventions were mentioned between samples’ collection [Reference Sotiraki, Brozos, Samartzi, Schares, Kiossis and Conraths19].

Bayesian models requiring conditional independence

We applied TAGS [Reference Pouillot, Gerbier and Gardner27] software and the Bayesian models proposed by Johnson et al. [Reference Johnson, Gastwirth and Pearson16] and Enøe et al. [Reference Enøe, Georgiadis and Johnson28] that require conditional independence of the evaluated tests. Analysing the data conducted and although more than 10 iterations with specific burning were applied, convergence problems occurred, obviously because of the violation of the conditional independence assumption, which is a prerequisite for this methodology application.

Bayesian models not requiring conditional independence

We tried Bayesian methodology for the estimation of test parameters and the prevalence of the populations, using models that do not assume conditional independence of the tests, as proposed by Georgiadis et al. [Reference Georgiadis, Johnson, Gardner, Singh, Johnson and Gardner29] and Branscum et al. [Reference Branscum, Gardner and Johnson25]. From those two, we applied the model proposed by Branscum et al., who recreated the analysis of Georgiadis et al. [Reference Branscum, Gardner and Johnson25, Reference Georgiadis, Johnson, Gardner, Singh, Johnson and Gardner29].

A difficulty in the construction of the prior probability distributions for the prevalence of the populations arouse, as no reliable data for the prevalence in the farms were available. Furthermore, the two study ‘populations’ were created artificially by mixing test results from several farms. Therefore, there were no actual defined populations corresponding to population 1 and population 2, for which prevalence assessments could be made. However, this seems of no importance to our study, since in our case the prevalence parameters were not of particular interest. Therefore, realistic but very diffuse prior distributions were constructed for the two prevalence parameters, in order to express our uncertainty about these parameters prior to the study. Considering the experts’ opinions, the use of two different prior distributions for prevalence was decided, depending on whether the animals of the population coexisted with dogs or not. Prior distributions were also constructed concerning the four parameters of dependence (λ D, $\lambda _{\rm D}^{{\rm not}} $, γ D, $\gamma _{\rm D}^{{\rm not}} $), which are included in the model proposed by Branscum et al. [Reference Branscum, Gardner and Johnson25]. The parameters (a, b) of the beta prior distributions that were used for this study and the prior assessments on which their construction was based on are shown in Table 2.

Table 2. Prior probability distributions upon respective parameters (mode and percentile) set for ELISA and IB diagnostic accuracy and populations’ (1 and 2) prevalence, based on experts’ opinions

The Beta prior distributions generated for IB Se and Sp and for population 1 and population 2 prevalence assessments are presented in Figure 1. According to Branscum et al. [Reference Branscum, Gardner and Johnson25], no prior probabilities are set for sensitivity and specificity of the second diagnostic test (ELISA). In this case, we prepared diffused prior probability distributions for all four dependent parameters (λ D, $\lambda _{\rm D}^{{\rm not}} $, γ D, $\gamma _{\rm D}^{{\rm not}} $), whose most possible value is the most possible prior value of the respective characteristics of the second diagnostic test. Thus, the prior probability distribution for λ D and γ D was B (2.15, 1.38), with mode 0.75 and 5th percentile 0.20, while prior probability distribution for $\lambda _{\rm D}^{{\rm not}} $ and $\gamma _{\rm D}^{{\rm not}} $ was B (2.07, 1.27), with mode 0.80 and 5th percentile 0.20.

Fig. 1. Prior distributions for parameters required in the two-population and two-test problem for the Bayesian analysis proposed by Branscum et al. data, Y-axes show probability density from 0 to 1 and X-axes as per plot label (clockwise) ‘sensitivity of IB’, ‘specificity of IB’, ‘prevalence of population 2’ and ‘prevalence of population 1’.

Cross-classified results of ELISA and IB of populations 1 and 2 are summarised in Table 3, with 95% probability intervals. In this table, ρ D is defined as the conditional correlation of the two diagnostic tests for an infected animal and the ρ D− as the conditional correlation of the two diagnostic tests for an uninfected animal. The 95% Bayesian Probability intervals for conditional correlation between the two tests among animals without antibodies for N. caninum- (ρ D−) did not include 0 [ρ D− = 0.518 (0.117–0.729)]. Therefore, we concluded that the two diagnostic tests were conditionally dependent and decided to base our final inferences on the Branscum model, which does not require the conditional independence assumption [Reference Branscum, Gardner and Johnson25].

Table 3. Mean and 95% posterior Bayesian probability intervals for Sensitivity (Se) and Specificity (Sp) of ELISA and IB, prevalence of populations (1 and 2) and conditional correlation of ELISA and IB in infected (ρ D) and uninfected D−) animals

No adverse events from performing both ELISA and IB are reported in the literature.

In order to determine the effect of the prior distributions on the posterior estimates and their repeatability [Reference Georgiadis, Johnson, Gardner, Singh, Johnson and Gardner29], we proceeded with a sensitivity analysis, in which we modified some of the prior distributions and assessed the effect on posterior inference, modifying the mode of the prior probability distributions. Two additional analyses were carried out: a) in the first more concentrated prior probability distributions for sensitivity were used, whereas b) in the second analyses specificity of IB was used. The estimates of IB and ELISA Se and IB and ELISA Sp, with B (36.70, 2.88) (most possible mode 0.95 and 95th percentile 0.85) and B (92.85, 10.08), respectively are presented in Tables 4 and 5. All changes had limited effect on the posteriors assessments, as the tests’ parameters were similar to the ones estimated previously (Table 3).

Table 4. Mean and 95% Bayesian probability intervals for Sensitivity (Se) and Specificity (Sp) of ELISA and IB, using models that do not require conditional independence of the tests, in case of B (36.70, 2.88) (sensitivity analysis)

Table 5. Mean and 95% Bayesian probability intervals for Sensitivity (Se) and Specificity (Sp) of ELISA and IB, using models that do not require conditional independence of the tests, in case of B (92.85, 10.08) (sensitivity analysis)

Discussion

Neosporosis can affect the performance and the profitability of a dairy farm, that is why prevention and control efforts should be ongoing. The validity of the diagnostic tests (under the specific conditions of the farm) used in these efforts, should be known, although this is sometimes difficult.

The aim of our study was to evaluate sensitivity and specificity of an ELISA and an IB test for the detection of antibodies against N. caninum in the milk of Greek dairy farms. To our knowledge, this is the first study to evaluate sensitivity and specificity of the diagnostic tests ELISA and IB for the detection of antibodies against N. caninum in milk from cows in dairy farms.

In a study conducted in Greece, Papadopoulos et al. concluded that the prevalence of neosporosis in Greece was 18.2% in bovine, after testing blood samples with ELISA [Reference Papadopoulos, Diakou and Fthenakis30]. Sotiraki et al. carried out a study in Greek dairy farms, intending to investigate neosporosis and the data collected were used in our study [Reference Sotiraki, Brozos, Samartzi, Schares, Kiossis and Conraths19].

In this study, sensitivity and specificity of ELISA were estimated to be 60% and 96.7%, respectively, whilst the corresponding estimates for IB were 98.8% and 91.3%. Some of these estimates differ from those derived by Staubli et al. [Reference Staubli, Nunez, Sager, Schares and Gottstein31] and Schares et al. [Reference Schares, Conraths and Reichel32]. Past studies have demonstrated mixed superior and inferior estimates for all the rest parameters.

Staubli et al. found that sensitivity and specificity of IB were 98% and 100%, respectively, while the corresponding parameters for ELISA were both 87% [Reference Staubli, Nunez, Sager, Schares and Gottstein31]. That study used blood samples from experimentally infected animals, while the infection was confirmed by polymerase chain reaction. The researchers concluded that IB could be the most suitable accessory diagnostic tool of ELISA, as far as the serological diagnosis of neosporosis is concerned. Schares et al. estimated sensitivity and specificity of IB at 94.2%, after testing blood samples of experimentally infected bovine [Reference Schares, Rauser, Zimmer, Peters, Wurm and Dubey21]. Frössling et al. calculated Se and Sp of ELISA 33.3% and 97.7% (in case of OD = 0.100) and 65.1% and 99.7% (in case of OD = 0.200), using logistic regression models [Reference Frössling, Lindberg and Björkman33]. Schares et al. concluded, after linear regression application, that Se and Sp of ELISA was about 93% [Reference Schares, Bärwald and Conraths34]. Paré et al. estimated that Se and Sp of ELISA were 88.6% and 96.5%, respectively, using cut-off point 0.45 [Reference Paré, Hietala and Thurmond35]. Björkman et al. concluded that ELISA Se and Sp was 100% and 96%, respectively, compared with Western blot analysis, while using both serum and milk samples, the agreement between those two types of samples was 95% [Reference Björkman, Holmdahl and Uggla12].

One of the most probable reasons for the difference in estimates of the characteristics of the diagnostic tests in our study is that the data were derived from a study carried out under field conditions, with samples from naturally infected animals, whereas previous studies [Reference Staubli, Nunez, Sager, Schares and Gottstein31, Reference Schares, Conraths and Reichel32] used experimentally infected animals. Test parameter assessments, which use data from experimental animals, are typically overestimated [Reference Greiner and Gardner36]. For instance, in an experimental study, the time of infection is known and the validation of the diagnostic test is performed when the concentration of antibodies is high. In contrast, in a natural field study, it is not known whether the animals were infected or not. Differences noticed with our results may, also, be attributed to the threshold (OD of ELISA) set. In some of the studies mentioned above, the diagnostic test set as comparison test was other than IB or/and ELISA. It is very probable that a serological test might have lower sensitivity in detecting antibodies at lower compared with higher titres. Additionally, the low sensitivity of ELISA in our study might be attributed to the fact that some animals could have been infected in the past and had a low concentration of antibodies that could be detected by IB, but not by ELISA. Differences may, also, be attributed to the use of different biologic materials (milk versus blood serum) and even more to individual test performance, which varies from herd test performance [Reference Christensen and Gardner37]. The age of animals, the lactation stage, the gestation stage and the time after birth are some of the factors that can affect the concentration of antibodies [Reference Quintanilla-Gozalo, Pereira-Bueno, Seijas-Carballedo, Costas and Ortega-Mora38]. For example, infected calves 7–12 months old often provide false negative results, as the concentration of antibodies decreases after birth [Reference Hietala and Thurmond39].

This hypothesis agrees with the existent, albeit limited, literature, presenting IB as a useful diagnostic tool for the serological diagnosis of neosporosis that can track even low concentrations of antibodies, where other serological methods cannot [Reference Staubli, Nunez, Sager, Schares and Gottstein31]. In the present study, it is concluded that IB has greater sensitivity, compared with ELISA, although, it is not a gold standard. In spite of the fact that some researchers refer to IB, considering it as a gold standard [Reference Schares, Rauser, Zimmer, Peters, Wurm and Dubey21], our estimates for the test-parameters’ were lower than 1 which means that the test might give false results. Despite apparent advantages of IB or ELISA values, there are also other factors when considering the ideal test for a given herd situation and diagnostic laboratory. For example, although IB has greater sensitivity, it would be more suited in a large unknown status herd to initiate screening by use of ELISA, with follow-up confirmation of negative results by use of IB, rather than to initiate testing with a relatively expensive alternative.

The Bayesian methodology used in this work requires the use of prior information for the parameters of interest, in the form of prior probability distributions. In this case, prior information on sensitivity and specificity of the diagnostic tests was limited. For this reason, a combination of information from peer-reviewed papers and from experts’ opinions was used. The prior distributions that were applied for the analysis expressed the increased uncertainty associated with these prior assessments. Τhe two populations used for our study derived from a pooling of samples of animals from different farms and do not represent any existing natural population of animals. Technically, it was important that the two populations would have different prevalence. This is the reason why the pooling was based on a strong risk factor for the infection, the co-existence of the tested animals with dogs. This difference in prevalence was, probably, achieved as can be seen from the fact that there were no technical (i.e. convergence) problems observed during the application of the statistical methods and from the discrepancy in the posterior estimates of the two prevalence assessments. On the other hand, this study's prevalence estimates do not apply to any actual population. This does not create any problem for our study, as long as an interpretation of the prevalence is not sought. In any case, the aim of this study was to validate the diagnostic tests and not to estimate the prevalence of presence of N. caninum antibodies in the tested populations.

Finally, an assumption of the statistical methodology used is that each test would have the same sensitivity and specificity in animals from the two tested populations. If this assumption is not valid, bias affects the estimates regarding the population of highest prevalence [Reference Toft, Jørgensen and Højsgaard40].

Conclusions

A precise appraisal of diagnostic test accuracy is of major important for a better assessment of neosporosis surveillance and control programs. Our study shows that milk samples may also be used for neosporosis diagnosis via serological methods and this is of great importance in field conditions. We demonstrated that conditional independence assumption for ELISA and IB was not supported, as expected because both diagnostic tests were of the same biological background. While accounting conditional dependence of the two tests, more precise estimates arose. IB demonstrated greater sensitivity compared with ELISA and thus, IB can detect even lower concentrations of antibodies. However, ELISA demonstrated slightly higher specificity than IB and thus, fewer probabilities to give false negative results. These findings advocate for further research and studies needed to assess the consequences of these estimated diagnostic test’ accuracy.

Acknowledgements

We thank Dr Sotiraki Smaragda from National Agricultural Research Foundation-Veterinary Research Institute (NAGREF-VRI) for her support in providing material for primary data and counseling on this study.

Declaration of Interest

None.

References

1.Gondim, LFP, McAllister, MM, Pitt, WC and Zemlicka, DE (2004) Coyotes (Canis latrans) are definitive hosts of Neospora caninum. International Journal for Parasitology 34, 159161. doi: 10.1016/j.ijpara.2004.01.001.Google Scholar
2.Rodrigues, AAR, Gennari, SM, Aguiar, DM, Sreekumar, C, Hill, DE, Miska, KB, Vianna, MCB and Dubey, JP (2004) Shedding of Neospora caninum oocysts by dogs fed tissues from naturally infected water buffaloes (Bubalus bubalis) from Brazil. Veterinary Parasitology 124, 139150. doi: 10.1016/j.vetpar.2004.07.007.Google Scholar
3.Gondim, LFP, McAllister, MM, Mateus Pinilla, NE, Pitt, WC, Mech, LD and Nelson, ME (2004) Transmission of Neospora caninum between wild and domestic animals. Journal of Parasitology 90, 13611365. doi: 10.1645/GE-341R.Google Scholar
4.McAllister, MM, Dubey, J, Lindsay, DS, Jolley, WR, Wills, RA and McGuire, AM (1998) Rapid communication. International Journal for Parasitology 28, 14731479. doi: 10.1016/S0020-7519(98)00138-6.Google Scholar
5.Davison, HC, Otter, A and Trees, AJ (1999) Estimation of vertical and horizontal transmission parameters of Neospora caninum infections in dairy cattle. International Journal for Parasitology 29, 16831689. doi: 10.1016/S0020-7519(99)00129-0.Google Scholar
6.Paré, J, Fecteau, G, Fortin, M and Marsolais, G (1998) Seroepidemiologic study of Neospora caninum in dairy herds. Journal of the American Veterinary Medical Association 213, 15951598.Google Scholar
7.Conraths, J and Gottstein, B (2007) Neosporosis: General Considerations. Protozoal Abort. Farm Ruminants. Wallingford, England: CAB Intern, pp. 4245.Google Scholar
8.Dubey, JP and Lindsay, DS (1996) A review of Neospora caninum and neosporosis. Veterinary Parasitology 67, 159. doi: 10.1016/S0304-4017(96)01035-7.Google Scholar
9.Wouda, W, Bartels, CJM and Dijkstra, T (2000) Epidemiology of bovine neosporosis with emphasis on risk factors. International Journal for Parasitology 30, 884886.Google Scholar
10.Wouda, W, Dijkstra, T, Kramer, AMH, Van Maanen, C and Brinkhof, JMA (1999) Seroepidemiological evidence for a relationship between Neospora caninum infections in dogs and cattle. International Journal for Parasitology 29, 16771682. doi: 10.1016/S0020-7519(99)00105-8.Google Scholar
11.Ortega, YR, Torres, MP and Mena, KD (2007) Presence of Neospora caninum specific antibodies in three dairy farms in Georgia and two in Texas. Veterinary Parasitology 144, 353355. doi: 10.1016/j.vetpar.2006.09.040.Google Scholar
12.Björkman, C, Holmdahl, OJM and Uggla, A (1997) An indirect enzyme-linked immunoassay (ELISA) for demonstration of antibodies to Neospora caninum in serum and milk of cattle. Veterinary Parasitology 68, 251260. doi: 10.1016/S0304-4017(96)01076-X.Google Scholar
13.Atkinson, R, Harper, PAW, Reichel, MP and Ellis, JT (2000) Progress in the serodiagnosis of Neospora caninum infections of cattle. Parasitology Today 16, 110114. doi: 10.1016/S0169-4758(99)01604-X.Google Scholar
14.Soendgen, P, Peters, M, Baerwald, A, Wurm, R, Holling, F, Conraths, FJ, et al. (2001) Bovine neosporosis: Immunoblot improves foetal serology. Veterinary Parasitology 102, 279290. doi: 10.1016/S0304-4017(01)00543-X.Google Scholar
15.Hui, ASL and Walter, SD (1980) Estimating the error rates of diagnostic tests. Biometrics 36, 167171.Google Scholar
16.Johnson, WO, Gastwirth, JL and Pearson, LM (2001) Screening without a gold-standard: the Hui–Walter paradigm revisited. American Journal of Epidemiology 153(9), 921924.Google Scholar
17.Nielsen, SS, Gronbak, C, Agger, JF and Houe, H (2002) Maximum-likelihood estimation of sensitivity and specificity of ELIAs and faecal culture for diagnosis of paratuberculosis. Preventive Veterinary Medicine 53, 191204. doi: 10.1016/S0167-5877(01)00280-X.Google Scholar
18.Gardner, IA, Nielsen, SS, Whittington, RJ, Collins, MT, Bakker, D, Harris, B, et al. (2011) Consensus-based reporting standards for diagnostic test accuracy studies for paratuberculosis in ruminants. Preventive Veterinary Medicine 101, 1834. doi: 10.1016/j.prevetmed.2011.04.002.Google Scholar
19.Sotiraki, S, Brozos, C, Samartzi, F, Schares, G, Kiossis, E and Conraths, FJ (2008) Neospora caninum infection in Greek dairy cattle herds detected by two antibody assays in individual milk samples. Veterinary Parasitology 152, 7984. doi: 10.1016/j.vetpar.2007.11.016.Google Scholar
20.Varcasia, A, Capelli, G, Ruiu, A, Ladu, M, Scala, A and Bjorkman, C (2006) Prevalence of Neospora caninum infection in Sardinian dairy farms (Italy) detected by iscom ELISA on tank bulk milk. Parasitology Research 98, 264267. doi: 10.1007/s00436-005-0044-4.Google Scholar
21.Schares, G, Rauser, M, Zimmer, K, Peters, M, Wurm, R, Dubey, JP, et al. (1999) Serological differences in Neospora caninum-associated epidemic and endemic abortions. The Journal of Parasitology, 688694.Google Scholar
22.Osawa, T, Wastling, J, Acosta, L, Ortellado, C, Ibarra, J, Innes, EA (2002) Seroprevalence of Neospora caninum infection in dairy and beef cattle in Paraguay. Veterinary Parasitology 110, 1723.10.1016/S0304-4017(02)00309-6Google Scholar
23.Schares, G, Pantchev, N, Barutzki, D, Heydorn, AO, Bauer, C and Conraths, FJ (2005) Oocysts of Neospora caninum, Hammondia heydorni, Toxoplasma gondii and Hammondia hammondi in faeces collected from dogs in Germany. International Journal for Parasitology 35, 15251537. doi: 10.1016/j.ijpara.2005.08.008.Google Scholar
24.Schares, G, Peters, M, Wurm, R, Bärwald, AJ and Conraths, F (1998) The efficiency of vertical transmission of Neospora caninum in dairy cattle analysed by serological techniques. Veterinary Parasitology 80, 8798. doi: 10.1016/S0304-4017(98)00195-2.Google Scholar
25.Branscum, AJ, Gardner, IA and Johnson, WO (2005) Estimation of diagnostic-test sensitivity and specificity through Bayesian modeling. Preventive Veterinary Medicine 68, 145163. doi: 10.1016/j.prevetmed.2004.12.005.Google Scholar
26.Schares, G, Bärwald, A, Staubach, C, Ziller, M, Klöss, D, Schröder, R, et al. (2004) Potential risk factors for bovine Neospora caninum infection in Germany are not under the control of the farmers. Parasitology 129, 301309. doi: 10.1017/S0031182004005700.Google Scholar
27.Pouillot, R, Gerbier, G and Gardner, IA (2002) ‘TAGS’, a program for the evaluation of test accuracy in the absence of a gold standard. Preventive Veterinary Medicine 53, 6781. doi: 10.1016/S0167-5877(01)00272-0.Google Scholar
28.Enøe, C, Georgiadis, MP and Johnson, WO (2000) Estimation of sensitivity and specificity of diagnostic tests and disease prevalence when the true disease state is unknown. Preventive Veterinary Medicine 45, 6181. doi: 10.1016/S0167-5877(00)00117-3.Google Scholar
29.Georgiadis, MP, Johnson, WO, Gardner, IA, Singh, R, Johnson, W and Gardner, A (2003) Correlation-adjusted estimation of sensitivity and specificity of two diagnostic tests. Applied Statististics 52, 6376.Google Scholar
30.Papadopoulos, E, Diakou, A, Fthenakis, GC (2002) E. I. First report of seroprevalence of neosporosis in Greece. COST 854 Final Annu. Conf., Liege, Belgium.Google Scholar
31.Staubli, D, Nunez, S, Sager, H, Schares, G and Gottstein, B (2006) Neospora caninum immunoblotting improves serodiagnosis of bovine neosporosis. Parasitology Research 99, 648658. doi: 10.1007/s00436-006-0207-y.Google Scholar
32.Schares, G, Conraths, FJ and Reichel, MP (1999) Bovine neosporosis: comparison of serological methods using outbreak sera from a dairy herd in New Zealand. International Journal for Parasitology 29, 16591667. doi: 10.1016/S0020-7519(99)00104-6.Google Scholar
33.Frössling, J, Lindberg, A and Björkman, C (2006) Evaluation of an iscom ELISA used for detection of antibodies to Neospora caninum in bulk milk. Preventive Veterinary Medicine 74, 120129. doi: 10.1016/j.prevetmed.2005.11.012.Google Scholar
34.Schares, G, Bärwald, A and Conraths, FJ (2005) Adaptation of a surface antigen-based ELISA for the detection of antibodies against Neospora caninum in bovine milk. Journal of Veterinary Medicine Series B: Infectious Diseases and Veterinary Public Health 52, 4548. doi: 10.1111/j.1439-0450.2004.00819.x.Google Scholar
35.Paré, J, Hietala, SK and Thurmond, MC (1995) An enzyme-linked immunosorbent assay (ELISA) for serological diagnosis of Neospora sp. infection in cattle. Journal of Veterinary Diagnostic Investigation: Official Publication of the American Association of Veterinary Laboratory Diagnosticians, Inc 7, 352359. doi: 10.1177/104063879500700310.Google Scholar
36.Greiner, M and Gardner, IA (2000) Application of diagnostic tests in veterinary epidemiologic studies. Preventive Veterinary Medicine 45, 4359. doi: 10.1016/S0167-5877(00)00116-1.Google Scholar
37.Christensen, J and Gardner, IA (2000) Herd-level interpretation of test results for epidemiologic studies of animal diseases. Preventive Veterinary Medicine 45, 83106. doi: 10.1016/S0167-5877(00)00118-5.Google Scholar
38.Quintanilla-Gozalo, A, Pereira-Bueno, J, Seijas-Carballedo, A, Costas, E and Ortega-Mora, LM (2000) Observational studies in Neospora caninum infected dairy cattle: relationship infection-abortion and gestational antibody fluctuations. International Journal for Parasitology 30, 900906.Google Scholar
39.Hietala, SK and Thurmond, MC (1999) Postnatal Neospora caninum transmission and transient serologic responses in two dairies. International Journal for Parasitology 29, 16691676. doi: 10.1016/S0020-7519(99)00102-2.Google Scholar
40.Toft, N, Jørgensen, E and Højsgaard, S (2005) Diagnosing diagnostic tests: evaluating the assumptions underlying the estimation of sensitivity and specificity in the absence of a gold standard. Preventive Veterinary Medicine 68, 1933. doi: 10.1016/j.prevetmed.2005.01.006.Google Scholar
Figure 0

Table 1. Results of ELISA and ΙΒ for the detection of antibodies against N. caninum, performed in individual milk samples of 10 Greek dairy farms (according to Sotiraki et al. [19])

Figure 1

Table 2. Prior probability distributions upon respective parameters (mode and percentile) set for ELISA and IB diagnostic accuracy and populations’ (1 and 2) prevalence, based on experts’ opinions

Figure 2

Fig. 1. Prior distributions for parameters required in the two-population and two-test problem for the Bayesian analysis proposed by Branscum et al. data, Y-axes show probability density from 0 to 1 and X-axes as per plot label (clockwise) ‘sensitivity of IB’, ‘specificity of IB’, ‘prevalence of population 2’ and ‘prevalence of population 1’.

Figure 3

Table 3. Mean and 95% posterior Bayesian probability intervals for Sensitivity (Se) and Specificity (Sp) of ELISA and IB, prevalence of populations (1 and 2) and conditional correlation of ELISA and IB in infected (ρD) and uninfected D−) animals

Figure 4

Table 4. Mean and 95% Bayesian probability intervals for Sensitivity (Se) and Specificity (Sp) of ELISA and IB, using models that do not require conditional independence of the tests, in case of B (36.70, 2.88) (sensitivity analysis)

Figure 5

Table 5. Mean and 95% Bayesian probability intervals for Sensitivity (Se) and Specificity (Sp) of ELISA and IB, using models that do not require conditional independence of the tests, in case of B (92.85, 10.08) (sensitivity analysis)