Skip to main content

Appropriateness of administrative data for vaccine impact evaluation: the case of pneumonia hospitalizations and pneumococcal vaccine in Brazil

  • S. SGAMBATTI (a1), R. MINAMISAVA (a2), E. T. AFONSO (a1) (a3), C. M. TOSCANO (a4), A. L. BIERRENBACH (a4) and A. L. ANDRADE (a4)...

Ten-valent pneumococcal conjugate vaccine (PCV10) was recently introduced into the Brazilian Immunization Programme. Secondary data are used as a measurement of community-acquired pneumonia (CAP) burden, but their completeness and reliability need to be ascertained. We performed probabilistic linkage between hospital primary data from active prospective population-based surveillance (APS) and hospital secondary data from the Hospital Information System administrative database of the National Unified Health System (SIH-SUS). Children aged 2–23 months hospitalized during January–December 2012 were identified. Incidence rates of hospitalized CAP were estimated. Agreement of case identification was measured by kappa index. A total of 1639 (26%) CAP cases were identified in APS and 1714 (35%) in SIH-SUS. Of these 3353 records, 1127 CAP cases were present in both databases. Kappa on CAP case identification was 0·72 (95% confidence interval 0·69–0·75). CAP hospitalization incidence using administrative (5285/100 000) and hospital (5054/100 000) primary data were similar (P = 0·184). Our findings suggest that administrative databases of hospitalizations are reliable sources to assess PCV10 impact in time-series analyses.

Corresponding author
* Author for correspondence: Dr S. Sgambatti, Department of Medicine, Pontifical Catholic University of Goiás, Goiânia, Goiás, Brazil. Av. Universitária 1.440, Setor Universitário, Goiânia, Goiás, CEP 74605-010, Brasil. (Email:
Hide All
1. Scott, JA. The preventable burden of pneumococcal disease in the developing world. Vaccine 2007; 25: 23982405.
2. Nair, H, et al. Global and regional burden of hospital admissions for severe acute lower respiratory infections in young children in 2010: a systematic analysis. Lancet 2013; 381: 13801390.
3. Rudan, I, et al. Global estimate of the incidence of clinical pneumonia among children under five years of age. Bulletin of the World Health Organization 2004; 82: 895903.
4. Mulholland, K. Magnitude of the problem of childhood pneumonia. Lancet 1999; 354: 590592.
5. Andrade, AL, et al. Bacteriology of community-acquired invasive disease found in a multicountry prospective, population-based, epidemiologic surveillance for Pneumococcus in children in Latin America. Pediatric Infectious Disease Journal 2012; 31: 13121314.
6. Ministry of Health (Brazil). DATASUS. Health Information. Epidemiological and Morbidity, 2013 ( Accessed 23 October 2013.
7. Andrade, AL, et al. Population-based surveillance for invasive pneumococcal disease and pneumonia in infants and young children in Goiania, Brazil. Vaccine 2012; 30: 19011909.
8. Ministry of Health (Brazil). Secretariat of Health Surveillance, Department of Epidemiological Surveillance, General Coordination of the National Immunization Program. Proposal for introduction of 10-valent pneumococcal vaccine into the National Immunization Program: March 2010, 2010 ( Accessed 20 July 2013.
9. Zhou, F, et al. Health care utilization for pneumonia in young children after routine pneumococcal conjugate vaccine use in the United States. Archives of Pediatrics & Adolescent Medicine 2007; 161: 11621168.
10. Griffin, MR, et al. U.S. hospitalizations for pneumonia after a decade of pneumococcal vaccination. New England Journal of Medicine 2013; 369: 155163.
11. Ministry of Health (Brazil). DATASUS. Health Information. Demographic and Socioeconomic; 2012 ( Accessed 23 October 2013.
12. Ministry of Health (Brazil). DATASUS. Health Information. Vital Statistics, 2011 ( Accessed 23 July 2013.
13. World Health Organization. International Statistical Classification of Diseases and Related Health Problems, 10th Revision; 2010 ( Accessed 15 February 2013.
14. Bittencourt, SA, Camacho, LA, Leal Mdo, C. Hospital information systems and their application in public health. Cadernos de Saude Publica 2006; 22: 1930.
15. Paim, J, et al. The Brazilian health system: history, advances, and challenges. Lancet 2011; 377: 17781797.
16. Ministry of Health (Brazil), Pan American Health Organization, Oswaldo Cruz Foundation. The Brazilian experience in health information systems. Talking about health information systems in Brazil. Brasília, DF: The Ministry of Health's Publisher, 2009, Report No. 2.
17. Ministry of Health (Brazil), Pan American Health Organization, Oswaldo Cruz Foundation. The Brazilian experience in health information systems. Production and propagation of health information in Brazil. Brasília, DF: The Ministry of Health's Publisher, 2009, Report No. 1.
18. Centers for Disease Control and Prevention. Link Plus v. 2. Atlanta: CDC, 2007.
19. Friedl, JEF. Mastering Regular Expressions, 3rd edn. Sebastopol, CA: O'Reilly Media, 2006.
20. Instituto Brasileiro de Geografia e Estatística. Population census, 2010 ( Accessed 23 October 2013.
21. do Carmo, GM, et al. Decline in diarrhea mortality and admissions after routine childhood rotavirus immunization in Brazil: a time-series analysis. PLoS Medicine 2011; 8: e1001024.
22. Afonso, ET, et al. Effect of 10-valent pneumococcal vaccine on pneumonia among children, Brazil. Emerging Infectious Diseases 2013; 19: 589597.
23. Grijalva, CG, et al. Decline in pneumonia admissions after routine childhood immunisation with pneumococcal conjugate vaccine in the USA: a time-series analysis. Lancet 2007; 369: 11791186.
24. De, Wals P, et al. Pneumonia after implementation of the pneumococcal conjugate vaccine program in the province of Quebec, Canada. Pediatric Infectious Disease Journal 2008; 27: 963968.
25. Yu, O, et al. Classification algorithms to improve the accuracy of identifying patients hospitalized with community-acquired pneumonia using administrative data. Epidemiology and Infection 2011; 139: 12961306.
26. Veras, CM, Martins, MS. Reliability of data from authorization forms for hospital admittance, Rio de Janeiro, Brazil. Cadernos de Saude Publica 1994; 10: 339555.
27. Mathias, TA, Soboll, ML. Reliability of diagnoses on authorization forms for hospital admission. Revista de Saude Publica 1998; 32: 526532.
28. Escosteguy, CC, et al. Hospital admissions forms versus medical records to assess risk of in-hospital death from acute myocardial infarction in Rio de Janeiro, Brazil. Cadernos de Saude Publica 2005; 21: 10651076.
29. Simborg, DW. DRG creep: a new hospital-acquired disease. New England Journal of Medicine 1981; 304: 16021604.
30. Berezin, EN, et al. Pneumonia hospitalization in Brazil from 2003 to 2007. International Journal of Infectious Diseases 2012; 16: e583590.
31. Noronha, MF, et al. The development of diagnosis-related groups – DRGs. Methodology for classifying hospital patients. Revista de Saude Publica 1991; 25: 198208.
32. Hsia, DC, et al. Accuracy of diagnostic coding for Medicare patients under the prospective-payment system. New England Journal of Medicine 1988; 318: 352355.
33. Ministry of Health (Brazil). Management System of Procedures, Medicines and OPM of SUS – SIGTAP, 2013 ( Accessed 8 October 2013.
34. Carvalho, CN, Dourado, I, Bierrenbach, AL. Underreporting of the tuberculosis and AIDS comorbidity: an application of the linkage method. Revista de Saude Publica 2011; 45: 548555.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Epidemiology & Infection
  • ISSN: 0950-2688
  • EISSN: 1469-4409
  • URL: /core/journals/epidemiology-and-infection
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Type Description Title
Supplementary materials

Sgambatti Supplementary Material
Supplementary Material

 Word (47 KB)
47 KB


Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed