Hostname: page-component-848d4c4894-mwx4w Total loading time: 0 Render date: 2024-06-15T19:50:12.310Z Has data issue: false hasContentIssue false

Scientific and methodological issues in quality assurance

Published online by Cambridge University Press:  05 December 2011

Ian Russell
Affiliation:
Health Services Research Unit, University of Aberdeen
Jeremy Grimshaw
Affiliation:
Department of General Practice, University of Aberdeen
Brenda Wilson
Affiliation:
Department of Public Health, University of Aberdeen
Get access

Synopsis

The framework for this chapter stems from the proposal that the basic steps of the quality cycle should be combined with the practical stages of the scientific method to form an extended quality cycle comprising nine steps. The scientific and methodological implications of each step are considered in turn. The discussion of the three steps relating to the development, dissemination and implementation of clinical standards is based on a recent review of rigorous evaluations of clinical guidelines. The discussion of the three steps relating to the comparison of clinical performance with agreed standards is based on the existing principles of medical research. The final step is concerned with the management of change. The chapter ends by applying the steps of the extended quality cycle to the topic of thrombolytic therapy after acute myocardial infarction. The resulting hypothetical quality assurance exercise appears simple and potentially very effective. We conclude that, if quality assurance is pursued with a combination of scientific rigour, imagination and persistence, it has the potential to bring substantial benefits to patients and health professionals.

Type
Research Article
Copyright
Copyright © Royal Society of Edinburgh 1993

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Allen, R. E., (Ed). 1990. The concise Oxford dictionary of current english, 8th edn. Oxford: Oxford University Press.Google Scholar
Altman, D. G. 1982. Statistics and ethics in medical research. In Statistics in practice. London: British Medical Association.Google Scholar
Ambulatory Care Programme. 1991. Medical audit tools. Newcastle upon Tyne: Centre for Health Services Research.Google Scholar
Armitage, P., & Berry, G. 1987. Statistical methods in medical research, 2nd edn. Oxford: Blackwell.Google Scholar
Audet, A. M., Greenfield, S., & Field, M. 1990. Medical practice guidelines: current activities and future directions. Annals of Internal Medicine 113, 709–14.CrossRefGoogle ScholarPubMed
Baker, R. 1988. Practice assessment and quality of care. London: Royal College of General Practitioners. (Occasional paper 39.)Google ScholarPubMed
Barnett, G. O., Winickoff, R., Dorsey, J. L., Morgan, M., & Lurie, R. S. 1978. Quality assurance through automated monitoring and concurrent feedback using a computer-based medical information system. Medical Care 16, 962–70.CrossRefGoogle ScholarPubMed
Barnett, G. O., Winickoff, R. N., Morgan, M. M., & Zielstorff, R. D. 1983. A computer-based monitoring system for follow-up of elevated blood pressure. Medical Care 21, 400–9.CrossRefGoogle ScholarPubMed
Beckhard, R., & Harris, R. J. 1977. Organisational transitions: managing complex change. London: Addison-Wesley.Google Scholar
Black, N. 1990. Quality assurance of medical care. Journal of Public Health Medicine 12, 97104.CrossRefGoogle ScholarPubMed
Bland, J. M. 1987. An introduction to medical statistics. Oxford: Oxford University Press.Google Scholar
Brook, R. H., & Avery, A. D. 1976. Quality assurance mechanisms in the US: from there to where? In McLachlan, G., (Ed.) A question of quality? Ch. 12, pp. 219–52. London: Nuffield Provincial Hospitals Trust.Google Scholar
Brook, R. H. 1989. Practice guidelines and practising medicine: are they compatible? Journal of the American Medical Association 262, 3027–30.CrossRefGoogle Scholar
Chalmers, I. 1989. Evaluating the effects of care during pregnancy and childbirth. In Chalmers, I., Enkin, M., & Keirse, M. J. N. C., (Eds) Effective care in pregnancy and childbirth. Vol. 1, Ch. 1, pp. 338. Oxford: Oxford University Press.Google Scholar
Clarke, J. A., & Adams, J. E. 1990. The application of clinical guidelines for skull radiography in the accident and emergency department: theory and practice. Clinical Radiology 41, 152–5.CrossRefGoogle ScholarPubMed
Cobbe, S. M. 1992. ISIS-3: the last word on thrombolysis? British Medical Journal 304, 1454–5.CrossRefGoogle ScholarPubMed
Cochrane, A. L. 1972. Effectiveness and efficiency: random reflections on health services. London: Nuffield Provincial Hospitals Trust.Google Scholar
Cohen, D. I., Littenberg, B., Wetzel, C., & Neuhauser, D. B. 1982. Improving physician compliance with preventive medicine guidelines. Medical Care 20, 1040–5.CrossRefGoogle ScholarPubMed
Cohen, S. J. 1983. Potential barriers to diabetes care. Diabetes Care 6, 499500.CrossRefGoogle ScholarPubMed
Cohen, S. J., Weinberger, M., Hui, S. L., Tierney, W. M., & McDonald, C. J. 1985. The impact of reading on physicians nonadherence to recommended standards of medical care. Social Science and Medicine 21, 909–14.CrossRefGoogle ScholarPubMed
Davidson, R. A., Fletcher, S. W., Retchie, S., & Duh, S. 1984. A nurse-initiated reminder system for the periodic health examination: implementation and evaluation. Archives of Internal Medicine 144, 2167–70.CrossRefGoogle ScholarPubMed
De Vos Meiring, P., & Wells, I. P. 1990. The effect of radiology guidelines for general practitioners. Radiology 42, 327–9.Google ScholarPubMed
De Wood, M. A., Spores, J., Notske, R. et al. , 1980. Prevalence of total coronary occlusion during the early hours of transmural myocardial infarction. New England Journal of Medicine 303, 877902.Google ScholarPubMed
Department of Health. 1989. Medical audit. London: HMSO. (Working for patients: working paper 6.)Google Scholar
Evans, S. J. W., Mills, P., & Dawson, J. 1988. The end of the p value? British Heart Journal, 60, 177–80.CrossRefGoogle ScholarPubMed
Field, M., & Lohr, E., (Eds). 1990. Clinical practice guidelines: directions for a new program. Washington: National Academic Press.CrossRefGoogle Scholar
Fink, A., Kosecoff, J., Chassin, M., & Brook, R. 1984. Consensus methods: characteristics and guidelines for use. American Journal of Public Health 74, 979–83.CrossRefGoogle ScholarPubMed
Fowkes, F. G. R., Davies, E. R., Evans, K. T. et al. , 1986. Multicentre trial of four strategies to reduce use of a radiological test. Lancet i, 367–70.CrossRefGoogle Scholar
Gabbay, J., & Francis, L. 1988. How much day surgery? Delphic predictions. British Medical Journal 297, 1249–52.CrossRefGoogle ScholarPubMed
Gardner, M. J., & Altman, D. G. 1989. Statistics with confidence. London: BMJ.Google Scholar
Grimshaw, J. M., & Russell, I. T. 1993. Do explicit clinical guidelines change medical practice? Aberdeen: Health Services Research Unit. (Occasional paper 13.)Google Scholar
Grol, R. 1990a. National standard setting for quality of care in general practice: attitudes of general practitioners and response to a set of standards. British Journal of General Practice 40, 361–4.Google ScholarPubMed
Grol, R. 1990b. Quality assurance: approaches to standard setting, assessment and change. Atencion Primaral, 737–41.Google Scholar
Grol, R. 1992. Implementing guidelines in general practice care. Quality in Health Care 1, 1891.Google ScholarPubMed
Gruppo Italiano per lo Studio della Streptochinasi nelFInfarto Miocardio (GISSI). 1986. Effectiveness of intravenous thrombolytic treatment in acute myocardial infarction. Lancet i, 397402.Google Scholar
Gruppo Italiano per lo Studio della Sopravivenza nell'Infarto Miocardio (GISSI-2). 1990. A factorial randomised trial of alteplase versus streptokinase and heparin versus no heparin among 12,490 patients with acute myocardial infarction. Lancet 336, 6570.Google Scholar
Harvey, K. J., Stewart, R., Hemming, M., Naismith, N., & Molds, R. F. W. 1986. Educational antibiotic advertising. Medical Journal of Australia 145, 2832.CrossRefGoogle ScholarPubMed
Haynes, R. B., Roms, D. A., McKibbon, A., & Tugwell, P. 1984. A critical appraisal of the efficacy of continuing medical education. Journal of the American Medical Association 251, 61–4.CrossRefGoogle ScholarPubMed
Hopkins, J. A., Shoemaker, W. C., Greenfield, S. et al. , 1980. Treatment of surgical emergencies with and without an algorithm. Archives of Surgery 115, 745–50.CrossRefGoogle ScholarPubMed
Hughes, J., & Humphrey, C. 1990. Medical audit in general practice: a practical guide to the literature. London: Kings Fund Centre. (Medical Audit Series 3.)Google Scholar
Hulka, B. S., Romm, F. J., Parkerson, G. R., Russell, I. T., Clapp, N. E., & Johnson, F. S. 1979. Peer review in ambulatory care: use of explicit criteria and implicit judgements. Medical Care 17(3), supplement, p. 26.Google Scholar
Hill, A. B. 1971. Principles of medical statistics, 9th edn. London: The Lancet.Google Scholar
Hutchinson, A., & Fowler, P. 1992. Outcome measures for primary health care: what are the research priorities? British Journal of General Practice 42, 227–31.Google ScholarPubMed
International Study of Infarct Survival Collaborative Group. 1988. Randomised trial of intravenous streptokinase, oral aspirin, both or neither, among 17,187 cases of suspected acute myocardial infarct: ISIS-2. Lancet ii, 349–60.Google Scholar
International Study of Infarct Survival Collaborative Group. 1992. ISIS-3: a randomised comparison of streptokinase vs tissue plasminogen activator vs anistreplase and of aspirin plus heparin vs aspirin alone among 41,299 cases of suspected acute myocardial infarction. Lancet 339, 753–70.CrossRefGoogle Scholar
Irvine, D. H. 1990. Managing for quality in general practice. London: Kings Fund Centre. (Medical Audit Series 2.)Google ScholarPubMed
Irvine, D. H., & Irvine, S., (Eds). 1991. Making sense of audit. Oxford: Radcliffe Medical.Google Scholar
Irvine, D. H., Russell, I. T., Hutchinson, A. et al. , 1986. Performance review in general practice: educational development and evaluative research in the Northern Region. In Pendleton, D. A., Schofield, T. P. C., & Marinker, M. L., (Eds) In pursuit of quality, Ch. 13, pp. 146–65. London: Royal College of General Practitioners.Google Scholar
Jacoby, I., & Clark, S. M. 1986. Direct mailing as a means of disseminating NIH consensus statements: a comparison with current techniques. Journal of the American Medical Association 255, 1328–30.CrossRefGoogle ScholarPubMed
Kahan, J. P., Kanouse, D. E., & Winkler, J. D. 1988. Stylistic variations in National Institutes of Health consensus statements, 1979–1983. International Journal of Technology Assessment in Health Care 4, 289304.CrossRefGoogle ScholarPubMed
Kings Fund Forum 1988. Treatment of stroke. British Medical Journal 297, 126–28.CrossRefGoogle Scholar
Kleinbaum, D. G., Kupper, L. L., & Morganstern, H. 1982. Epidemiologic research: principles and quantitative methods. Belmont, California: Wadsworth.Google Scholar
Kleinbaum, D. G., Kupper, L. L., & Muller, K. E. 1988. Applied regression analysis and other multivariable methods, 2nd edn. Boston, Massachusetts: Wadsworth.Google Scholar
Komaroff, A. L. 1985. Quality assurance in 1984. Medical Care 23, 723–33.CrossRefGoogle ScholarPubMed
Kosecoff, J., Kanouse, D. E., Rogers, W. H. et al. , 1987. Effects of the National Institutes of Health consensus development program on physician practice. Journal of the American Medical Association 258, 2708–13.CrossRefGoogle ScholarPubMed
Landgren, F. T., Harvey, K. J., Mashford, L. et al. , 1988. Changing antibiotic prescribing by educational marketing. Medical Journal of Australia 149, 595–9.CrossRefGoogle ScholarPubMed
Langman, M. J. S. 1986. Towards estimation and confidence intervals. British Medical Journal 292, 716.CrossRefGoogle ScholarPubMed
Linn, B. S. 1980. Continuing medical education: impact on emergency room burn care. Journal of the American Medical Association 244, 565–70.CrossRefGoogle ScholarPubMed
Lohr, K. N., & Brook, R. H. 1980. Quality of care in episodes of respiratory illness among Medicaid patients in New Mexico. Annals of Internal Medicine 92, 99106.CrossRefGoogle ScholarPubMed
Lomas, J., & Haynes, R. B. 1988. A taxonomy and critical review of tested strategies for the application of clinical practice recommendations: from ‘official’ to ‘individual’ clinical policy. American Journal of Preventive Medicine 4, 7795.Google ScholarPubMed
Lomas, J., Anderson, G. M., Dominick-Pierre, K. et al. , 1989. Do practice guidelines guide practice? The effect of a consensus statement on the practice of physicians. New England Journal of Medicine 321, 1306–11.CrossRefGoogle ScholarPubMed
Lomas, J., Enkin, M., Anderson, G. N. et al. , 1991. Opinion leaders vs audit and feedback to implement practice guidelines: delivery after previous Caesarian section. Journal of the American Medical Association 265, 2202–7.CrossRefGoogle Scholar
Mann, J. I., & Marmott, M. G. 1983. Epidemiology of ischaemic heart disease. In Weatherall, D. J., Ledingham, J. F. F., & Warrel, D. A., (Eds) Oxford textbook of medicine. Oxford: Oxford University Press.Google Scholar
McDonald, C. J. 1976. Protocol-based computer reminders, the quality of care and the non-perfectability of man. New England Journal of Medicine 295, 1351–5.CrossRefGoogle ScholarPubMed
McGlynn, E. A., Kosecoff, J., & Brook, R. 1990. Format and conduct of consensus development conferences: multination comparison. International Journal of Technology Assessment in Health Care 6, 450–69.CrossRefGoogle ScholarPubMed
Moser, C. A., & Kalton, G. 1971. Survey methods in social investigation, 2nd edn. Aldershot: Gower.Google Scholar
Mugford, M., Banfield, P., & O'Hanlon, M. 1991. Effects of feedback of information on clinical practice: a review. British Medical Journal 303, 398402.CrossRefGoogle ScholarPubMed
Mullan, F., & Jacoby, I. 1985. The town meeting for technology: the maturation of consensus conferences. Journal of the American Medical Association 254, 1068–72.CrossRefGoogle ScholarPubMed
Newton, J. C., Hutchinson, A., Steen, I. N., Russell, I. T., & Haimes, E. V. 1992. Educational potential of medical audit: observations from a study of small groups setting standards. Quality in Health Care 1, 256–9.CrossRefGoogle ScholarPubMed
North of England Study of Standards and Performance in General Practice. 1991. Overview of the study. Newcastle upon Tyne: Centre for Health Services Research. (Report 50.)Google Scholar
North of England Study of Standards and Performance in General Practice. 1992. Medical audit in general practice: effects on doctors' clinical behaviour and the health of patients with common childhood conditions. British Medical Journal 304, 1480–8.CrossRefGoogle Scholar
O'Dowd, T. C., & Wilson, A. D. 1992. Set menus and clinical freedom. British Medical Journal 303, 450–2.CrossRefGoogle Scholar
Palmer, R. H., Thomas, A. L., Lee-Nan, H. et al. , 1985. A randomised controlled trial of quality assurance in sixteen ambulatory care practices. Medical Care 23, 751–70.CrossRefGoogle ScholarPubMed
Park, R. E., Fink, A., Brook, R. H. et al. , 1986. Physician ratings of appropriate indications for six medical and surgical procedures. American Journal of Public Health 76, 766–72.CrossRefGoogle ScholarPubMed
Perry, S. 1988. Consensus development: an historical note. International Journal of Technology Assessment in Health Care 4, 481–4.CrossRefGoogle ScholarPubMed
Peters, D. A. 1992. Implementation of research findings. Health Bulletin 50, 6870.Google ScholarPubMed
Pringle, M., Bilkbu, J., Dornan, M., & Head, S. 1991. Managing change in primary care. Oxford: Radcliffe Medical.Google Scholar
Putnam, R. W., & Curry, L. 1985. Impact of patient care appraisal on physician behaviour in the office setting. Canadian Medical Association Journal 132, 1025–9.Google ScholarPubMed
Reimer, K. A., Lower, J. E., Rasmussen, M. M., & Jenning, R. B. 1977. The wavefront phenomenon of ischaemic cell death. I: myocardial infarct size versus duration after coronary occlusion in dogs. Circulation 56, 786–94.CrossRefGoogle Scholar
Rodney, W. M., Quan, M. A., Johnson, R. A., & Beaber, R. J. 1982. Impact of flexible sigmoidoscopy on physician compliance with colorectal cancer screening protocol. Journal of Family Practice 15, 885–9.Google ScholarPubMed
Rodney, W. M., Chopivsky, P., & Quan, M. A. 1983. Adult immunization: the medical record design as a factor for physician compliance. Journal of Medical Education 58, 576–80.Google Scholar
Royal College of Physicians of Edinburgh. 1993. Leucocyte depletion of blood and blood components. Edinburgh: Royal College of Physicians.Google Scholar
Royal College of Radiologists Working Party. 1992. Influence of the Royal College of Radiologists' guidelines on hospital practice: a multicentre study. British Medical Journal 304, 740–3.CrossRefGoogle Scholar
Russell, I. T. 1983. The evaluation of computerised tomography: a review of research methods. In Culyer, A. J., & Horisberger, B., (Eds) Economic and medical evaluation of health care technologies Ch. 27, pp. 298316. Berlin: Springer-Verlag.CrossRefGoogle Scholar
Russell, I. T., & Grimshaw, J. M. 1992. The effectiveness of referral guidelines: a review of the methods and findings of published evaluations. In Roland, M., & Coulter, A., (Eds) Hospital referrals, Ch. 13, pp. 179211. Oxford: Oxford University Press. (Oxford General Practice Series 22.)Google Scholar
Russell, I. T., & Russell, D. 1990. Statistical issues in medical audit. In Marinker, M. L., (Ed.) Medical Audit and general practice, Ch. 9, pp. 168–84. London: BMJ.Google Scholar
Russell, I. T., & Wilson, B. J. 1992. Audit: the third clinical science? Quality in Health Care 1, 51–5.CrossRefGoogle ScholarPubMed
Sackett, D. L. 1979. Bias in analytic research. Journal of Chronic Diseases 32, 5163.CrossRefGoogle ScholarPubMed
Sanazaro, P. J. 1974. Medical audit: experience in the USA. British Medical Journal 1, 271–4.CrossRefGoogle Scholar
Sanazaro, P. J., & Worth, R. M. 1978. Concurrent quality assurance in hospital care. New England Journal of Medicine 304, 740–3.Google Scholar
Schoenbaum, S. C., & Gottlieb, L. K. 1990. Algorithm based improvement of clinical quality. British Medical Journal 301, 1374–6.CrossRefGoogle ScholarPubMed
Scott, M. G. B., & Marinker, M. L. 1990. Small group work. In Marinker, M. L., (Ed.) Medicine audit and general practice, Ch. 10, pp. 185–95. London: British Medical Journal.Google Scholar
Scottish Clinical Resource and Audit Group. 1991. Thrombolytic therapy in the early treatment of acute myocardial infarction: consensus statement. Edinburgh: HMSO.Google Scholar
Scottish Clinical Resource and Audit Group. 1993. Clinical guidelines: a report of a working group. Edinburgh: Scottish Office Home and Health Department (now published).Google Scholar
Scottish Home and Health Department. 1989. Medical audit. Edinburgh: HMSO. (Working for patients: Scottish working paper 2.)Google Scholar
Secretaries of State for Health, Wales, Northern Ireland, and Scotland. 1989. Working for patients. London: HMSO. (Cmnd 555.)Google Scholar
Shaw, C. D. 1989. Medical audit: a hospital handbook. London: Kings Fund Centre. (Medical Audit Series 1.)Google Scholar
Shaw, C. D., & Costain, D. W. 1989. Guidelines for medical audit: seven principles. British Medical Journal 299, 498–9.CrossRefGoogle ScholarPubMed
Sheldon, M. G. 1982. Medical audit in general practice. London: Royal College of General Practitioners. (Occasional Paper 20.)Google ScholarPubMed
Sommers, L. S., Scholtz, R., Shepherd, R. M., & Starkweather, D. B. 1984. Physician involvement in quality assurance. Medical Care 22, 1115–38.CrossRefGoogle ScholarPubMed
Spiegal, N., Murphy, E., Kinmonth, A. L., Ross, F., Bain, J., & Coates, R. 1992. Managing change in general practice: a step by step guide. British Medical Journal 304, 231–4.CrossRefGoogle ScholarPubMed
Stocking, B. 1992. Promoting change in clinical care. Quality in Health Care 1, 5660.CrossRefGoogle ScholarPubMed
Stocking, B. 1985. Initiative and inertia. London: Nuffield Provincial Hospitals Trust.Google Scholar
Stocking, B., Jennett, B., & Spiby, J. 1991. Criteria for change: the history and impact of consensus development conferences in the UK. London: Kings Fund Centre.Google Scholar
Streiner, D. L., & Norman, D. R. 1987. Health measurement scales; a practical guide to their development and use. Oxford: Oxford University Press.Google Scholar
Tierney, W. M., Hui, S. L., & McDonald, C. J. 1986. Delayed feedback of physician performance versus immediate reminders to perform preventive care. Medical Care 24, 659–66.CrossRefGoogle ScholarPubMed
Tunstall-Pedoe, H. 1992. Epidemiology of acute myocardial infarction. Health Bulletin 1, 136.Google Scholar
Wilcox, A. J., & Russell, I. T. 1983. Perinatal mortality: standardising for birthweight is biased. American Journal of Epidemiology 118, 857–64.CrossRefGoogle ScholarPubMed
Wilcox, A. J., & Russell, I. T. 1986. Birthweight and perinatal mortality: III – toward a new method of analysis. International Journal of Epidemiology 15, 188–96.CrossRefGoogle Scholar
Wilcox, A. J., & Russell, I. T. 1990. Why small black infants have a lower mortality rate than small white infants: the case for population-specific standards for birth weight. Journal of Paediatrics 116, 710.CrossRefGoogle ScholarPubMed
Wilcox, R. G., von den Lippe, G., Olsson, C. G., Jensen, G., Skene, A. M., & Hampton, J. R. 1988. Trial of tissue plasminogen activator for mortality reduction in acute myocardial infarction. Anglo-Scandinavian Study of Early Thrombolysis (ASSET). Lancet ii, 525–9.CrossRefGoogle Scholar
Wilkin, D., & Dornan, C. 1990. General practitioner referrals to hospital: a review of research and its implications for policy and practice. Manchester: Centre for Primary Care Research.Google Scholar
Williamson, J. A. 1978. Formulating priorities for quality assurance activity: description of a method and its application. Journal of the American Medical Association 239, 631–7.CrossRefGoogle ScholarPubMed
Wirtschafter, D. D., Summers, J., Jackson, J. R., Brooks, C. M., & Turner, M. 1986. Continuing medical education using clinical algorithms: a controlled trial assessment of effect on neonatal care. American Journal of Diseases of Childhood 140, 791–7.CrossRefGoogle ScholarPubMed