Skip to main content
    • Aa
    • Aa
  • Get access
    Check if you have access via personal or institutional login
  • Cited by 195
  • Cited by
    This article has been cited by the following publications. This list is generated based on data provided by CrossRef.

    Andersson Hagiwara, Magnus Andersson Gäre, Boel and Elg, Mattias 2016. Interrupted Time Series Versus Statistical Process Control in Quality Improvement Projects. Journal of Nursing Care Quality, Vol. 31, Issue. 1, p. E1.

    Byber, Katarzyna Flatz, Aline Norbäck, Dan Hitzke, Christine Imo, David Schwenkglenks, Matthias Puhan, Milo A Dressel, Holger Mutsch, Margot and Mutsch, Margot 2016. Cochrane Database of Systematic Reviews.

    Choe, Sooyoung Yun, Sungmin and Leite, Fernanda 2016. Analysis of the effectiveness of the OSHA steel erection standard in the construction industry. Safety Science, Vol. 89, p. 190.

    Gavaldà, Laura Soriano, Ana M. Cámara, Jordi Gasull, Rosa Arch, Olga Ferrer, Montserrat Shaw, Evelyn Granada, Rosa M. Dominguez, M. Angeles and Pujol, Miquel 2016. Control of endemic extensively drug-resistant Acinetobacter baumannii with a cohorting policy and cleaning procedures based on the 1 room, 1 wipe approach. American Journal of Infection Control, Vol. 44, Issue. 5, p. 520.

    Gulliford, Martin C Charlton, Judith Booth, Helen P Fildes, Alison Khan, Omar Reddy, Marcus Ashworth, Mark Littlejohns, Peter Prevost, A Toby and Rudisill, Caroline 2016. Costs and outcomes of increasing access to bariatric surgery for obesity: cohort study and cost-effectiveness analysis using electronic health records. Health Services and Delivery Research, Vol. 4, Issue. 17, p. 1.

    Jones, Eleanor Taylor, Beck MacArthur, Christine Pritchett, Ruth and Cummins, Carole 2016. The effect of early postnatal discharge from hospital for women and infants: a systematic review protocol. Systematic Reviews, Vol. 5, Issue. 1,

    Linden, Ariel and Yarnold, Paul R. 2016. Using machine learning to identify structural breaks in single-group interrupted time series designs. Journal of Evaluation in Clinical Practice,

    Lopez-Vargas, Pamela A. Tong, Allison Howell, Martin and Craig, Jonathan C. 2016. Educational Interventions for Patients With CKD: A Systematic Review. American Journal of Kidney Diseases,

    McIntosh, Emma J. McKinnon, Madeleine C. Pressey, Robert L. and Grenyer, Richard 2016. What is the extent and distribution of evidence on effectiveness of systematic conservation planning around the globe? A systematic map protocol. Environmental Evidence, Vol. 5, Issue. 1,

    Merriel, Abi van der Nelson, Helen A Lenguerrand, Erik Chung, Yealin Soar, Jasmeet Ficquet, Jo Grey, Steph Winter, Cathy Draycott, Tim Siassakos, Dimitrios and Merriel, Abi 2016. Cochrane Database of Systematic Reviews.

    Opiyo, Newton Yamey, Gavin Garner, Paul and Opiyo, Newton 2016. Cochrane Database of Systematic Reviews.

    Robinson, Paula D. Dupuis, Lee L. Tomlinson, George Phillips, Bob Greenberg, Mark and Sung, Lillian 2016. Strategies facilitating practice change in pediatric cancer: a systematic review. International Journal for Quality in Health Care,

    Schaafsma, Frederieke G Mahmud, Norashikin Reneman, Michiel F Fassier, Jean-Baptiste Jungbauer, Franciscus HW and Schaafsma, Frederieke G 2016. Cochrane Database of Systematic Reviews.

    Thai, L. P. Moss, J. R. Godman, B. and Vitry, A. I. 2016. Cost driver analysis of statin expenditure on Australia’s Pharmaceutical Benefits Scheme. Expert Review of Pharmacoeconomics & Outcomes Research, Vol. 16, Issue. 3, p. 419.

    Tung, Yu-Chi and Chang, Guann-Ming 2016. The Relationships Among Regionalization, Processes, and Outcomes for Stroke Care. Medicine, Vol. 95, Issue. 15, p. e3327.

    Walker, Heather Patton, Andrea Bayne, Gwen Marwick, Charis Sneddon, Jacqueline Davey, Peter Nathwani, Dilip and Bell, Samira 2016. Reduction in post-operative acute kidney injury following a change in antibiotic prophylaxis policy for orthopaedic surgery: an observational study. Journal of Antimicrobial Chemotherapy, p. dkw166.

    Abdullahi, Leila H Kagina, Benjamin MN Wiysonge, Charles S Hussey, Gregory D and Abdullahi, Leila H 2015. Cochrane Database of Systematic Reviews.

    Albert, Alex Hallowell, Matthew R. Lingard, Helen and Kleiner, Brian M. 2015. Multiple Baseline Testing: Experimental Method for Drawing Causal Inferences in Construction Engineering and Management Research. Journal of Construction Engineering and Management, Vol. 141, Issue. 7, p. 04015012.

    Algie, Catherine M Mahar, Robert K Wasiak, Jason Batty, Lachlan Gruen, Russell L Mahar, Patrick D and Wasiak, Jason 2015. Cochrane Database of Systematic Reviews.

    Archambault, Patrick M Turgeon, Alexis F Witteman, Holly O Lauzier, François Moore, Lynne Lamontagne, François Horsley, Tanya Gagnon, Marie-Pierre Droit, Arnaud Weiss, Matthew Tremblay, Sébastien Lachaine, Jean Le Sage, Natalie Émond, Marcel Berthelot, Simon Plaisance, Ariane Lapointe, Jean Razek, Tarek van de Belt, Tom H Brand, Kevin Bérubé, Mélanie Clément, Julien Grajales III, Francisco Jose Eysenbach, Gunther Kuziemsky, Craig Friedman, Debbie Lang, Eddy Muscedere, John Rizoli, Sandro Roberts, Derek J Scales, Damon C Sinuff, Tasnim Stelfox, Henry T Gagnon, Isabelle Chabot, Christian Grenier, Richard and Légaré, France 2015. Implementation and Evaluation of a Wiki Involving Multiple Stakeholders Including Patients in the Promotion of Best Practices in Trauma Care: The WikiTrauma Interrupted Time Series Protocol. JMIR Research Protocols, Vol. 4, Issue. 1, p. e21.

  • International Journal of Technology Assessment in Health Care, Volume 19, Issue 4
  • December 2003, pp. 613-623


  • Craig R. Ramsay (a1), Lloyd Matowe (a2), Roberto Grilli (a3), Jeremy M. Grimshaw (a4) and Ruth E. Thomas (a1)
  • DOI:
  • Published online: 01 December 2003

Objectives: In an interrupted time series (ITS) design, data are collected at multiple instances over time before and after an intervention to detect whether the intervention has an effect significantly greater than the underlying secular trend. We critically reviewed the methodological quality of ITS designs using studies included in two systematic reviews (a review of mass media interventions and a review of guideline dissemination and implementation strategies).

Methods: Quality criteria were developed, and data were abstracted from each study. If the primary study analyzed the ITS design inappropriately, we reanalyzed the results by using time series regression.

Results: Twenty mass media studies and thirty-eight guideline studies were included. A total of 66% of ITS studies did not rule out the threat that another event could have occurred at the point of intervention. Thirty-three studies were reanalyzed, of which eight had significant preintervention trends. All of the studies were considered “effective” in the original report, but approximately half of the reanalyzed studies showed no statistically significant differences.

Conclusions: We demonstrated that ITS designs are often analyzed inappropriately, underpowered, and poorly reported in implementation research. We have illustrated a framework for appraising ITS designs, and more widespread adoption of this framework would strengthen reviews that use ITS designs.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

International Journal of Technology Assessment in Health Care
  • ISSN: 0266-4623
  • EISSN: 1471-6348
  • URL: /core/journals/international-journal-of-technology-assessment-in-health-care
Please enter your name
Please enter a valid email address
Who would you like to send this to? *