Skip to main content
    • Aa
    • Aa
  • Get access
    Check if you have access via personal or institutional login
  • Cited by 29
  • Cited by
    This article has been cited by the following publications. This list is generated based on data provided by CrossRef.

    Stärk, K.D.C. and Drewe, J.A. 2014. Encyclopedia of Meat Sciences.

    Mayer, Jonathan D. and Paige, Sarah 2013. Viral Infections and Global Change.

    Tambo, Ernest and Xiao-Nong, Zhou 2014. Acquired immunity and asymptomatic reservoir impact on frontline and airport ebola outbreak syndromic surveillance and response. Infectious Diseases of Poverty, Vol. 3, Issue. 1, p. 41.

    Fitch, J. Patrick 2015. Engineering a Global Response to Infectious Diseases. Proceedings of the IEEE, Vol. 103, Issue. 2, p. 263.

    Wendt, A. Kreienbrock, L. and Campe, A. 2014. Zoonotic Disease Surveillance - Inventory of Systems Integrating Human and Animal Disease Information. Zoonoses and Public Health, p. n/a.

    Ahmadi, B. Vosough 2014. Does animal health surveillance give value for money?. Veterinary Record, Vol. 174, Issue. 1, p. 14.

    Robinson, P. A. and Epperson, W. B. 2013. Farm animal practitioners' views on their use and expectations of veterinary diagnostic laboratories. Veterinary Record, Vol. 172, Issue. 19, p. 503.

    Halliday, Lesley E. Peek, Michael J. Ellwood, David A. Homer, Caroline Knight, Marion Mclintock, Claire Jackson-Pulver, Lisa and Sullivan, Elizabeth A. 2013. The Australasian Maternity Outcomes Surveillance System: An evaluation of stakeholder engagement, usefulness, simplicity, acceptability, data quality and stability. Australian and New Zealand Journal of Obstetrics and Gynaecology, Vol. 53, Issue. 2, p. 152.

    Russo, Philip L Chen, Gang Cheng, Allen C Richards, Michael Graves, Nicholas Ratcliffe, Julie and Hall, Lisa 2016. Novel application of a discrete choice experiment to identify preferences for a national healthcare-associated infection surveillance programme: a cross-sectional study. BMJ Open, Vol. 6, Issue. 5, p. e011397.

    Velasova, M. Drewe, J. A. Gibbons, J. Green, M. and Guitian, J. 2015. Evaluation of the usefulness at national level of the dairy cattle health and production recording systems in Great Britain. Veterinary Record, Vol. 177, Issue. 12, p. 304.

    Grosbois, Vladimir Häsler, Barbara Peyre, Marisa Hiep, Dao Thi and Vergne, Timothée 2015. A rationale to unify measurements of effectiveness for animal health surveillance. Preventive Veterinary Medicine, Vol. 120, Issue. 1, p. 70.

    Muellner, P. Stärk, K. D. C. Dufour, S. and Zadoks, R. N. 2016. ‘Next-Generation’ Surveillance: An Epidemiologists’ Perspective on the Use of Molecular Information in Food Safety and Animal Health Decision-Making. Zoonoses and Public Health, Vol. 63, Issue. 5, p. 351.

    Bronner, Anne Gay, Emilie Fortané, Nicolas Palussière, Mathilde Hendrikx, Pascal Hénaux, Viviane and Calavas, Didier 2015. Quantitative and qualitative assessment of the bovine abortion surveillance system in France. Preventive Veterinary Medicine, Vol. 120, Issue. 1, p. 62.

    Herida, Magid Dervaux, Benoit and Desenclos, Jean-Claude 2016. Economic Evaluations of Public Health Surveillance Systems: a Systematic Review. The European Journal of Public Health, Vol. 26, Issue. 4, p. 674.

    El Allaki, Farouk Bigras-Poulin, Michel and Ravel, André 2013. Conceptual evaluation of population health surveillance programs: Method and example. Preventive Veterinary Medicine, Vol. 108, Issue. 4, p. 241.

    Sundufu, Abu James Ansumana, Rashid Bockarie, Alfred Swarray Bangura, Umaru Lamin, Joseph Morrison Jacobsen, Kathryn H. and Stenger, David Andrew 2015. Syndromic surveillance of peste des petits ruminants and other animal diseases in Koinadugu district, Sierra Leone, 2011–2012. Tropical Animal Health and Production, Vol. 47, Issue. 2, p. 473.

    Herida, M. and Desenclos, J.-C. 2015. Évaluation de différents systèmes de surveillance (en maladies infectieuses) à partir d’un protocole générique. Revue d'Épidémiologie et de Santé Publique, Vol. 63, Issue. 1, p. 35.

    Stahnke, N. Liebscher, V. Staubach, C. and Ziller, M. 2013. An approach to model monitoring and surveillance data of wildlife diseases—Exemplified by Classical Swine Fever in wild boar. Preventive Veterinary Medicine, Vol. 112, Issue. 3-4, p. 355.

    Mariner, Jeffrey C. Jones, Bryony A. Hendrickx, Saskia El Masry, Ihab Jobre, Yilma and Jost, Christine C. 2014. Experiences in Participatory Surveillance and Community-based Reporting Systems for H5N1 Highly Pathogenic Avian Influenza: A Case Study Approach. EcoHealth, Vol. 11, Issue. 1, p. 22.

    Guo, X. Claassen, G. D. H. Oude Lansink, A. G. J. M. Loeffen, W. and Saatkamp, H. W. 2016. Economic Analysis of Classical Swine Fever Surveillance in the Netherlands. Transboundary and Emerging Diseases, Vol. 63, Issue. 3, p. 296.


Evaluation of animal and public health surveillance systems: a systematic review

  • J. A. DREWE (a1), L. J. HOINVILLE (a2), A. J. C. COOK (a3), T. FLOYD (a2) and K. D. C. STÄRK (a1)
  • DOI:
  • Published online: 11 November 2011

Disease surveillance programmes ought to be evaluated regularly to ensure they provide valuable information in an efficient manner. Evaluation of human and animal health surveillance programmes around the world is currently not standardized and therefore inconsistent. The aim of this systematic review was to review surveillance system attributes and the methods used for their assessment, together with the strengths and weaknesses of existing frameworks for evaluating surveillance in animal health, public health and allied disciplines. Information from 99 articles describing the evaluation of 101 surveillance systems was examined. A wide range of approaches for assessing 23 different system attributes was identified although most evaluations addressed only one or two attributes and comprehensive evaluations were uncommon. Surveillance objectives were often not stated in the articles reviewed and so the reasons for choosing certain attributes for assessment were not always apparent. This has the potential to introduce misleading results in surveillance evaluation. Due to the wide range of system attributes that may be assessed, methods should be explored which collapse these down into a small number of grouped characteristics by focusing on the relationships between attributes and their links to the objectives of the surveillance system and the evaluation. A generic and comprehensive evaluation framework could then be developed consisting of a limited number of common attributes together with several sets of secondary attributes which could be selected depending on the disease or range of diseases under surveillance and the purpose of the surveillance. Economic evaluation should be an integral part of the surveillance evaluation process. This would provide a significant benefit to decision-makers who often need to make choices based on limited or diminishing resources.

Corresponding author
*Author for correspondence: Dr J. A. Drewe, Centre for Emerging, Endemic and Exotic Diseases, Royal Veterinary College, Hawkshead Lane, North Mymms, Herts, AL9 7TA, UK. (Email:
Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

2.KDC Stärk , Concepts for risk-based surveillance in the field of veterinary medicine and veterinary public health: Review of current approaches. BMC Health Services Research 2006; 6: 18.

5.DM Bravata , Systematic review: surveillance systems for early detection of bioterrorism-related diseases. Annals of Internal Medicine 2004; 140: 910922.

7.JB Meynard , Proposal of a framework for evaluating military surveillance systems for early detection of outbreaks on duty areas. BMC Public Health 2008; 8: 146.

8.TJD Knight-Jones , Evaluation of effectiveness and efficiency of wild bird surveillance for avian influenza. Veterinary Research 2010; 41: 50.

12.CPD Birch , Spatial distribution of the active surveillance of sheep scrapie in Great Britain: an exploratory analysis. BMC Veterinary Research 2009; 5: 23.

13.TE Carpenter . Evaluation and extension of the cusum technique with an application to Salmonella surveillance. Journal of Veterinary Diagnostic Investigation 2002; 14: 211218.

15.D Moran , A Fofana . An economic evaluation of the control of three notifiable fish diseases in the United Kingdom. Preventive Veterinary Medicine 2007; 80: 193208.

21.P Aavitsland , O Nilsen , A Lystad . Anonymous reporting of HIV infection: an evaluation of the HIV/AIDS surveillance system in Norway 1983–2000. European Journal of Epidemiology 2001; 17: 479489.

23.HJ Andersen , Evaluation of the surveillance program of Streptococcus agalactiae in Danish dairy herds. Journal of Dairy Science 2003; 86: 12331239.

27.JA Ansari , Evaluation of the existing bacterial meningitis surveillance system in Islamabad, Pakistan. International Journal of Infectious Diseases 2008; 12: E192.

28.S Arscott-Mills , Y Holder , G Gordon . Comparative evaluation of different modes of a national accident and emergency department-based injury surveillance system: Jamaican experience. International Journal of Injury Control and Safety Promotion 2002; 9: 235239.

31.JA Betancourt , Evaluation of ICD-9 codes for syndromic surveillance in the electronic surveillance system for the early notification of community-based epidemics. Military Medicine 2007; 172: 346352.

32.AF Betanzos-Reyes , Comparative analysis of two alternative models for epidemiological surveillance in the Mexican Malaria Control Program. Health Policy 2007; 80: 465482.

34.HJ Bowen , Community exposures to chemical incidents: development and evaluation of the first environmental public health surveillance system in Europe. Journal of Epidemiology and Community Health 2000; 54: 870873.

35.S Brooker , The use of schools for malaria surveillance and programme evaluation in Africa. Malaria Journal 2009; 8: 231.

36.JS Brownstein , CC Freifeld . Evaluation of internet-based informal surveillance for global infectious disease intelligence. International Journal of Infectious Diseases 2008; 12: E193E194.

38.TE Carpenter , M Chriel , M Greiner . An analysis of an early-warning system to reduce abortions in dairy cattle in Denmark incorporating both financial and epidemiologic aspects. Preventive Veterinary Medicine 2007; 78: 111.

39.MP Carrieri , Evaluation of the SIMI system, an experimental computerised network for the surveillance of communicable diseases in Italy. European Journal of Epidemiology 2000; 16: 941947.

41.M Chriel , MD Salman , BA Wagner . Evaluation of surveillance and sample collection methods to document freedom from infectious bovine rhinotracheitis in cattle populations. American Journal of Veterinary Research 2005; 66: 21492153.

43.M Cretikos , B Telfer , J McAnulty . Evaluation of the system of surveillance for enteric disease outbreaks, New South Wales, Australia, 2000 to 2005. NSW Public Health Bulletin 2008; 19: 8–14.

44.ST David , A bird's eye view: using geographic analysis to evaluate the representativeness of corvid indicators for West Nile virus surveillance. International Journal of Health Geographics 2007; 6: 3.

45.F de Chabalier , A Hassane , JP Chippaux . Evaluation of surveillance thresholds for prediction of meningitis epidemics using ongoing surveillance data at the district level, in Niger. Transactions of the Royal Society of Tropical Medicine and Hygiene 2000; 94: 251252.

50.M Gazarian , Evaluation of a national surveillance unit. Archives of Disease in Childhood 1999; 80: 2127.

53.DC Hadorn , KDC Stark . Evaluation and optimization of surveillance systems for rare and emerging infectious diseases. Veterinary Research 2008; 39: 57.

54.HI Hall , ED Mokotoff , G Advisory . Setting standards and an evaluation framework for human immunodeficiency virus/acquired immunodeficiency syndrome surveillance. Journal of Public Health Management and Practice 2007; 13: 519523.

55.R Harpaz , MJ Papania . Can a minimum rate of investigation of measleslike illnesses serve as a standard for evaluating measles surveillance? Journal of Infectious Diseases 2004; 189: S204S209.

56.R Harpaz , Lessons learned from establishing and evaluating indicators of the quality of measles surveillance in the United States, 1996–1998. Journal of Infectious Diseases 2004; 189: S196S203.

57.SW He , YA Zurynski , EJ Elliott . Evaluation of a national resource to identify and study rare diseases: The Australian Paediatric Surveillance Unit. Journal of Paediatrics and Child Health 2009; 45: 498504.

58.P Hendrikx , Development of performance indicators for the bovine clinical salmonellosis surveillance network in France. Journal of Veterinary Medicine, Series B: Infectious Diseases and Veterinary Public Health 2005; 52: 465475.

60.MA Huaman , Impact of two interventions on timeliness and data quality of an electronic disease surveillance system in a resource limited setting (Peru): a prospective evaluation. BMC Medical Informatics and Decision Making 2009; 9: 16.

64.CB Irvin , PP Nouhan , K Rice . Syndromic analysis of computerized emergency department patients' chief complaints: an opportunity for bioterrorism and influenza surveillance. Annals of Emergency Medicine 2003; 41: 447452.

66.H Jefferson , Evaluation of a syndromic surveillance for the early detection of outbreaks among military personnel in a tropical country. Journal of Public Health 2008; 30: 375–83.

72.L Lesher , Evaluation of surveillance methods for staphylococcal toxic shock syndrome. Emerging Infectious Diseases 2009; 15: 770773.

73.T Lynn , An evaluation of scrapie surveillance in the United States. Preventive Veterinary Medicine 2007; 81: 7079.

74.C Macarthur , IB Pless . Evaluation of the quality of an injury surveillance system. American Journal of Epidemiology 1999; 149: 586592.

75.JC Mariner , Rinderpest surveillance performance monitoring using quantifiable indicators. Revue Scientifique et Technique de l'Office International des Epizooties 2003; 22: 837847.

79.SJN McNabb , Applying a new conceptual framework to evaluate tuberculosis a surveillance and action performance and measure the costs, Hillsborough county, Florida 2002. Annals of Epidemiology 2004; 14: 640645.

81.S Morris , The costs and effectiveness of surveillance of communicable disease: a case study of HIV and AIDS in England and Wales. Journal of Public Health Medicine 1996; 18: 415422.

83.A Odoi , Application of an automated surveillance-data-analysis system in a laboratory-based early-warning system for detection of an abortion outbreak in mares. American Journal of Veterinary Research 2009; 70: 247256.

85.L Perron , P De Wals , F Milord . Evaluation of the rubella surveillance system in Quebec. Canadian Journal of Infectious Diseases 2000; 11: 313316.

86.VL Phillips , Evaluation of program performance and expenditures in a report of performance measures (RPM) via a case study of two Florida county tuberculosis programs. Evaluation and Program Planning 2010; 33: 373378.

88.JL Richard , B Vidondo , M Mausezahl . A 5-year comparison of performance of sentinel and mandatory notification surveillance systems for measles in Switzerland. European Journal of Epidemiology 2008; 23: 5565.

93.RM Safdar , SA Khan , RJ Asghar . Evaluation of hepatitis surveillance systems in Pakistan. International Journal of Infectious Diseases 2008; 12: E192.

94.M Sandberg , An evaluation of the Norwegian Salmonella surveillance and control program in live pig and pork. International Journal of Food Microbiology 2002; 72: 111.

95.JP Sekhobo , CM Druschel . An evaluation of congenital malformations surveillance in New York State: An application of Centers for Disease Control and Prevention (CDC) guidelines for evaluating surveillance systems. Public Health Reports 2001; 116: 296305.

97.HF Tan , Evaluation of the national notifiable disease surveillance system in Taiwan: An example of varicella reporting. Vaccine 2007; 25: 26302633.

99.N Walker , Epidemiological analysis of the quality of HIV sero-surveillance in the world: how well do we track the epidemic? AIDS 2001; 15: 15451554.

100.RE Watkins , An evaluation of the sensitivity of acute flaccid paralysis surveillance for poliovirus infection in Australia. BMC Infectious Diseases 2009; 9: 162.

102.K Wilson , JS Brownstein . Early detection of disease outbreaks using the Internet. Canadian Medical Association Journal 2009; 180: 829831.

104.RA Jajosky , SL Groseclose . Evaluation of reporting timeliness of public health surveillance systems for infectious diseases. BMC Public Health 2004; 4: 29.

107.KC Malecki , B Resnick , TA Burke . Effective environmental public health surveillance programs: a framework for identifying and evaluating data resources and indicators. Journal of Public Health Management and Practice 2008; 14: 543551.

108.RJ Mitchell , AM Williamson , R O'Connor . The development of an evaluation framework for injury surveillance systems. BMC Public Health 2009; 9: 260.

110.VJ Del Rio Vilas , DU Pfeiffer . The evaluation of bias in scrapie surveillance: a review. Veterinary Journal 2010; 185: 259264.

112.KP Kleinman , AM Abrams . Assessing the utility of public health surveillance using specificity, sensitivity, and lives saved. Statistics in Medicine 2008; 27: 40574068.

113.R Magnani , Review of sampling hard-to-reach and hidden populations for HIV surveillance. AIDS 2005; 19 (Suppl. 2): S67S72.

114.GM Jolly . Explicit estimates from capture-recapture data with both death and immigration-stochastic model. Biometrika 1965; 52: 225247.

115.VJ Del Rio Vilas , A case study of capture-recapture methodology using scrapie surveillance data in Great Britain. Preventive Veterinary Medicine 2005; 67: 303317.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Epidemiology & Infection
  • ISSN: 0950-2688
  • EISSN: 1469-4409
  • URL: /core/journals/epidemiology-and-infection
Please enter your name
Please enter a valid email address
Who would you like to send this to? *