Skip to main content
    • Aa
    • Aa

Use of the self-controlled case-series method in vaccine safety studies: review and recommendations for best practice

  • Y. G. WELDESELASSIE (a1), H. J. WHITAKER (a1) and C. P. FARRINGTON (a1)

The self-controlled case-series method was originally developed to investigate potential associations between vaccines and adverse events, and is now commonly used for this purpose. This study reviews applications of the method to vaccine safety investigations in the period 1995–2010. In total, 40 studies were reviewed. The application of the self-controlled case-series method in these studies is critically examined, with particular reference to the definition of observation and risk periods, control of confounders, assumptions and potential biases, methodological and presentation issues, power and sample size, and software. Comparisons with other study designs undertaken in the papers reviewed are also highlighted. Some recommendations are presented, with the emphasis on promoting good practice.

Corresponding author
*Author for correspondence: Professor C. P. Farrington, Department of Mathematics and Statistics, MCT Faculty, The Open University, Walton Hall, Milton Keynes MK7 6AA, UK. (Email:
Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

1.CP Farrington . Control without separate controls: evaluation of vaccine safety using case-only methods. Vaccine 2004; 22: 20642070.

2.CP Farrington , J Nash , E Miller . Case series analysis of adverse reactions to vaccines: A comparative evaluation. American Journal of Epidemiology 1996; 143: 11651173.

3.CP Farrington . Relative incidence estimation from case series for vaccine safety evaluation. Biometrics 1995; 51: 228235.

4.CP Farrington , HJ Whitaker . Semiparametric analysis of case series data (with Discussion). Journal of the Royal Statistical Society Series C 2006; 55: 553594.

5.HJ Whitaker , Tutorial in biostatistics: the self-controlled case series method. Statistics in Medicine 2006; 25: 17681797.

6.HJ Whitaker , MN Hocine , CP Farrington . The methodology of self-controlled case series studies. Statistical Methods in Medical Research 2009; 18: 726.

7.NJ Andrews . Statistical assessment of the association between vaccination and rare adverse events post-licensure. Vaccine 2002; 20: S49S53.

8.P Musonda , CP Farrington , HJ Whitaker . Sample sizes for self-controlled case series studies. Statistics in Medicine 2006; 25: 26182631.

9.M Ali , The use of a computerized database to monitor vaccine safety in Viet Nam. Bulletin of the World Health Organization 2005; 83: 604610.

10.N Andrews , Does oral polio vaccine cause intussusception in infants? Evidence from a sequence of three self-controlled cases series studies in the United Kingdom. European Journal of Epidemiology 2001; 17: 701706.

11.N Andrews , Recall bias, MMR, and autism. Archives of Disease in Childhood 2002; 87: 493494.

12.N Andrews , Post-licensure safety of the meningococcal group C conjugate vaccine. Human Vaccines 2007; 3: 5963.

13.N Andrews , Post-licensure comparison of the safety profile of diphtheria/tetanus/whole cell pertussis/haemophilus influenza type b vaccine and a 5-in-1 diphtheria/tetanus/acellular pertussis/haemophilus influenza type b/polio vaccine in the United Kingdom. Vaccine; 28: 72157220.

14.DR Burwen , Evaluating adverse events after vaccination in the Medicare population. Pharmacoepidemiology and Drug Safety 2007; 16: 753761.

15.JC Cameron , Oral polio vaccine and intussusception: A data linkage study using records for vaccination and hospitalization. American Journal of Epidemiology 2006; 163: 528533.

16.I Dourado , Outbreak of aseptic meningitis associated with mass vaccination with a Urabe-containing measles-mumps-rubella vaccine – Implications for immunization programs. American Journal of Epidemiology 2000; 151: 524530.

17.P Farrington , A new method for active surveillance of adverse events from diphtheria-tetanus-pertussis and measles-mumps-rubella vaccines. Lancet 1995; 345: 567569.

18.CP Farrington , E Miller , B Taylor . MMR and autism: further evidence against a causal association. Vaccine 2001; 19: 3632–365.

19.EK France , Risk of immune thrombocytopenic purpura after measles-mumps-rubella immunization in children. Pediatrics 2008; 121: e687e692.

20.M Gold , Use of the Australian Childhood Immunisation Register for vaccine safety data linkage. Vaccine 2010; 28: 43084311.

21.SM Gwini , CAC Coupland , AN Siriwardena . The effect of influenza vaccination on risk of acute myocardial infarction: self-controlled case-series study. Vaccine 2011; 29: 11451149.

22.SJ Hambidge , Safety of trivalent inactivated influenza vaccine in children 6 to 23 months old. Journal of the American Medical Association 2006; 296: 19901997.

23.MN Hocine , Hepatitis B vaccination and first central nervous system demyelinating events: Reanalysis of a case-control study using the self-controlled case series method. Vaccine 2007; 25: 59385943.

24.WT Huang , Lack of association between acellular pertussis vaccine and seizures in early childhood. Pediatrics 2010; 126: E263E269.

25.RA Hughes , No association between immunization and Guillain-Barré syndrome in the United Kingdom, 1992 to 2000. Archives of Internal Medicine 2006; 166: 13011304.

26.DN Juurlink , Guillain-Barré syndrome after influenza vaccination in adults – a population-based study. Archives of Internal Medicine 2006; 166: 22172221.

27.P Kramarz , Does influenza vaccination exacerbate asthma? Analysis of a large cohort of children with asthma. Archives of Family Medicine 2000; 9: 617623.

28.P Kramarz , Does influenza vaccination prevent asthma exacerbations in children? Journal of Pediatrics 2001; 138: 306310.

29.E Miller , Bacterial infections, immune overload, and MMR vaccine. Archives of Disease in Childhood 2003; 88: 222223.

30.E Miller , No evidence of an association between MMR vaccine and gait disturbance. Archives of Disease in Childhood 2005; 90: 292296.

31.E Miller , Risks of convulsion and aseptic meningitis following measles-mumps-rubella vaccination in the United Kingdom. American Journal of Epidemiology 2007; 165: 704709.

32.E Miller , Idiopathic thrombocytopenic purpura and MMR vaccine. Archives of Disease in Childhood 2001; 84: 227229.

33.JP Mullooly , Wheezing lower respiratory disease and vaccination of full-term infants. Pharmacoepidemiology and Drug Safety 2002; 11: 2130.

34.TV Murphy , Intussusception among infants given an oral rotavirus vaccine. New England Journal of Medicine 2001; 344: 564572.

35.M Mutsch , Use of the inactivated intranasal influenza vaccine and the risk of Bell's palsy in Switzerland. New England Journal of Medicine 2004; 350: 896903.

36.AL Naleway , Risk of immune hemolytic anemia in children following immunization. Vaccine 2009; 27: 73947397.

37.DC Payne , Concurrent vaccinations and US military hospitalizations. Annals of Epidemiology 2007; 17: 697703.

38.MAG Sardinas , Lack of association between intussusception and oral polio vaccine in Cuban children. European Journal of Epidemiology 2001; 17: 783787.

39.L Smeeth , Risk of myocardial infarction and stroke after acute infection or vaccination. New England Journal of Medicine 2004; 351: 26112618.

40.J Stowe , Idiopathic thrombocytopenic purpura and the second dose of MMR. Archives of Disease in Childhood 2001; 93: 182183.

41.J Stowe , Bell's palsy and parenteral inactivated influenza vaccine. Human Vaccines 2006; 2: 110112.

42.J Stowe , Investigation of the temporal association of Guillain-Barré syndrome with influenza vaccine and influenz-alike illness using the United Kingdom General Practice Research Database. American Journal of Epidemiology 2008; 169: 382388.

43.J Stowe , No evidence of an increase of bacterial and viral infections following Measles, Mumps and Rubella vaccine. Vaccine 2009; 27: 14221425.

44.LJ Tata , Does influenza vaccination increase consultations, corticosteroid prescriptions, or exacerbations in subjects with asthma or chronic obstructive pulmonary disease? Thorax 2003; 58: 835839.

45.B Taylor , Autism and measles, mumps, and rubella vaccine: no epidemiological evidence for a causal association. Lancet 1999; 353: 20262029.

46.B Taylor , No increased risk of relapse after meningococcal C conjugate vaccine in nephrotic syndrome. Archives of Disease in Childhood 2007; 92: 887889.

47.KN Ward , Risk of serious neurologic disease after immunization of young children in Britain and Ireland. Pediatrics 2007; 120: 314321.

48.L Zinman , Safety of influenza vaccination in patients with myasthenia gravis: A population-based study. Muscle and Nerve 2009; 40: 947951.

49.NAT van der Maas , Acute cerebellar ataxia in the Netherlands: A study on the association with vaccinations and varicella zoster infection. Vaccine 2009; 27: 19701973.

50.EK France , Safety of the trivalent inactivated influenza vaccine among children. Archives of Pediatric and Adolescent Medicine 2004; 158: 10311036.

51.NP Klein , Measles-mumps-rubella-varicella combination vaccine and the risk of febrile seizures. Pediatrics 2010; 126: e1e8.

52.CP Farrington , MN Hocine . Within-individual dependence in self-controlled case series models for recurrent events. Journal of the Royal Statistical Society Series C 2010; 59: 457475.

53.CP Farrington , Self-controlled case series analysis with event-dependent observation periods. Journal of the American Statistical Association 2011; 106: 417426.

54.CP Farrington , HJ Whitaker , MN Hocine . Case series analysis for censored, perturbed, or curtailed post-event exposures. Biostatistics 2009; 10: 316.

55.R Kuhnert , A modified self-controlled case series method to examine association between multidose vaccinations and death. Statistics in Medicine 2011; 30: 666677.

56.JA Delaney , S Suissa . The case-crossover study design in pharmacoepidemiology. Statistical Methods in Medical Research 2009; 18: 5365.

57.S Suissa . Immortal time bias in pharmacoepidemiology. American Journal of Epidemiology 2007; 167: 492499.

58.P Musonda , Self-controlled case series analyses: small-sample performance. Computational Statistics and Data Analysis 2008; 52: 19421957.

59.W Navidi . Bidirectional case-crossover designs for exposures with time trends. Biometrics 1998; 54: 596605.

60.T Lumley , D Levy . Bias in the case-crossover design: implications for studies of air pollution. Environmetrics 2000; 11: 689704.

61.SK Vines , CP Farrington . Within-subject exposure dependency in case-crossover studies. Statistics in Medicine 2001; 20: 30393049.

62.HJ Whitaker , MN Hocine , CP Farrington . On case-crossover methods for environmental time series data. Environmentrics 2007; 18: 157171.

63.NG Becker , Z Li , CW Kelman . The effect of transient exposures on the risk of an acute illness with low hazard rate. Biostatistics 2004; 5: 239248.

64.JM Glanz , Four different study designs to evaluate vaccine safety were equally validated with contrasting limitations. Journal of Clinical Epidemiology 2006; 59: 808818.

65.P Musonda , Monitoring vaccine safety using case series cumulative sum charts. Vaccine 2008; 26: 53585367.

66.MN Hocine , Sequential case series analysis for pharmacovigilance. Journal of the Royal Statistical Society. Series A 2009; 172: 213236.

67.M Hocine , Testing independence between two Poisson-generated multinomial variables in case-series and cohort studies. Statistics in Medicine 2005; 24: 40354044.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Epidemiology & Infection
  • ISSN: 0950-2688
  • EISSN: 1469-4409
  • URL: /core/journals/epidemiology-and-infection
Please enter your name
Please enter a valid email address
Who would you like to send this to? *