Skip to main content Accessibility help
×
Hostname: page-component-848d4c4894-5nwft Total loading time: 0 Render date: 2024-06-08T21:59:18.006Z Has data issue: false hasContentIssue false

12 - Integrating Experimental and Observational Methods to Improve Criminology and Criminal Justice Policy

Published online by Cambridge University Press:  05 June 2014

Anthony A. Braga
Affiliation:
Harvard University
Brandon C. Welsh
Affiliation:
Netherlands Institute for the Study of Crime and Law Enforcement
Gerben J. N. Bruinsma
Affiliation:
VU University Amsterdam
Brandon C. Welsh
Affiliation:
Northeastern University
Anthony A. Braga
Affiliation:
Rutgers University, New Jersey
Gerben J. N. Bruinsma
Affiliation:
Netherlands Institute for the Study of Crime and Law Enforcement
Get access

Summary

INTRODUCTION

Experimental criminology is a part of a larger and increasingly expanding evidence-based movement in social policy. The evidence-based movement first began in medicine and has, more recently, been embraced by the social sciences. Evidence-based social policy advocates – in areas such as education, poverty reduction, and crime prevention – are dedicated to increasing the use of scientific evidence in the implementation of government programs so critical social problems can be addressed without wasting scarce taxpayer funds. Experimental criminologists, and organizations such as the Academy of Experimental Criminology and the Campbell Collaboration’s Crime and Justice Group, have been leading advocates for the advancement of evidence-based crime control policy in general and the use of randomized experiments in crime and justice research in particular.

Experimental criminology has, for the most part, moved past the first wave of criticism that questioned the use of randomized controlled trials (RCTs) in crime and justice evaluations. Two key concerns were that (1) it was not ethical to randomize treatments, interventions, or programs in crime and justice; and (2) randomized experiments could not be implemented in the real world (Clarke and Cornish 1972; Esbensen 1991; Erez 1986; Geis 1967). As Weisburd (2010) recently argued, the growth of criminological experiments in a broad range of real-world settings that have been carried out in an ethical manner demonstrates that these concerns are, in most cases, based in folklore rather than facts. However, as the influence of randomized experiments in crime and justice has grown in recent years, a second wave of criticism has been increasingly articulated by criminologists concerned by the field’s experimental turn. These critiques share a common concern that experimental criminology blindly advocates the superiority of RCTs over quasi-experiments and observational studies.

Type
Chapter
Information
Experimental Criminology
Prospects for Advancing Science and Public Policy
, pp. 277 - 298
Publisher: Cambridge University Press
Print publication year: 2013

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Berk, Richard. 2005. “Randomized Experiments as the Bronze Standard.” Journal of Experimental Criminology 1: 417–33.CrossRefGoogle Scholar
Berk, Richard, Barnes, Geoffrey, Ahlman, Lindsay, and Kurtz, Ellen. 2010. “When Second Best is Good Enough: A Comparison between a True Experiment and a Regression Discontinuity Quasi-Experiment”. Journal of Experimental Criminology 6: 159–90.CrossRefGoogle Scholar
Braga, Anthony A. 2010. “Setting a Higher Standard for the Evaluation of Problem-Oriented Policing Initiatives.” Criminology & Public Policy 9: 173–82.CrossRefGoogle Scholar
Braga, Anthony A., and Bond, Brenda J.. 2008. “Policing Crime and Disorder Hot Spots: A Randomized Controlled Trial.” Criminology 46: 577–608.CrossRefGoogle Scholar
Campbell, Donald, and Stanley, Julian. 1966. Experimental and Quasi-Experimental Designs for Research. Chicago: Rand McNally.Google Scholar
Cartwright, Nancy. 2007. “Are RCTs the Gold Standard?Biosocieties 2: 11–20.CrossRefGoogle Scholar
Clarke, Ronald V., and Cornish, Derek. 1972. The Controlled Trial in Institutional Research. London: H. M. Stationary Office.Google Scholar
Clear, Todd R. 2010. “Policy and Evidence: The Challenge to the American Society of Criminology: 2009 Presidential Address to the American Society of Criminology.” Criminology 48: 1–25.CrossRefGoogle Scholar
Cook, Thomas, and Campbell, Donald. 1979. Quasi-Experimentation: Design and Analysis Issues for Field Settings. Boston: Houghton Mifflin.Google Scholar
Erez, Edna. 1986. “Randomized Experiments in Correctional Context: Legal, Ethical, and Practical Concerns.” Journal of Criminal Justice 14: 389–400.CrossRefGoogle ScholarPubMed
Esbensen, Finn Aage. 1991. “Ethical Considerations in Criminal Justice Research.” American Journal of Police 10: 87–104.Google Scholar
Farrington, David P. 2003. “A Short History of Randomized Experiments in Criminology: A Meager Feast.” Evaluation Review 17: 218–27.CrossRefGoogle Scholar
Farrington, David P., Gottfredson, Denise, Sherman, Lawrence W., and Welsh, Brandon C.. 2006. “The Maryland Scientific Methods Scale.” In Evidence-Based Crime Prevention (rev. ed.), edited by Sherman, Lawrence W., Farrington, David P., Welsh, Brandon C., and MacKenzie, Doris L., pp. 12–21. New York: Routledge.Google Scholar
Farrington, David P., and Petrosino, Anthony. 2001. “The Campbell Collaboration Crime and Justice Group.” Annals of the American Academy of Political and Social Science 578: 35–49.CrossRefGoogle Scholar
Farrington, David P., and Welsh, Brandon C.. 2006. “A Half Century of Randomized Experiments on Crime and Justice.” Crime and Justice 34: 55–132.CrossRefGoogle Scholar
Geis, Gilbert. 1967. “Ethical and Legal Issues in Experimentation with Offender Populations.” In Research in Correctional Rehabilitation, edited by McNickle, Roma K., pp. 34–41. Washington, DC: Joint Commission on Correctional Manpower and Training.Google Scholar
Goldstein, Herman. 1990. Problem-Oriented Policing. Philadelphia: Temple University Press.Google Scholar
Heckman, James J. 2001. “Accounting for Heterogeneity, Diversity and General Equilibrium in Evaluating Social Programs.” Economics Journal 111: 654–99.CrossRefGoogle Scholar
Hough, Michael. 2010. “Gold Standard or Fool’s Gold: The Pursuit of Certainty in Experimental Criminology.” Criminology & Criminal Justice 10: 11–32.CrossRefGoogle Scholar
Imai, Kosuke, King, Gary, and Stuart, Elizabeth. 2008. “Misunderstandings Between Experimentalists and Observationalists about Causal Inference.” Journal of the Royal Statistical Society A 171: 481–502.CrossRef
Laycock, Gloria. 2005. “Defining Crime Science.” In Crime Science: New Approaches to Preventing and Detecting Crime, edited by Martha Smith and Nick Tilley, pp. 3–24. Devon, U.K.: Willan Publishing.Google Scholar
Laycock, Gloria 2012. “Editorial – Happy Birthday?Policing 6: 101–7.CrossRefGoogle Scholar
Manzi, James. 2012. Uncontrolled: The Surprising Payoff of Trial-and-Error for Business, Politics, and Society. New York: Basic Books.Google Scholar
McCord, Joan. 2003. “Cures that Harm: Unanticipated Outcomes of Crime Prevention Programs.” Annals of the American Academy of Political and Social Science 587: 16–30.CrossRefGoogle Scholar
Moore, Mark H. 2006. “Improving Police through Expertise, Experience, and Experiments.” In Police Innovation: Contrasting Perspectives, edited by Weisburd, David L. and Braga, Anthony A., pp. 322–38. New York: Cambridge University Press.Google Scholar
Pawson, Ray, and Tilley, Nick. 1997. Realistic Evaluation. London: SAGE.Google Scholar
Sampson, Robert. 2010. “Gold Standard Myths: Observations on the Experimental Turn in Criminology.” Journal of Quantitative Criminology 26: 489–500.CrossRefGoogle Scholar
Shadish, William, Cook, Thomas, and Campbell, Donald. 2002. Experimental and Quasi- Experimental Designs for General Causal Inference. Boston: Houghton-Mifflin.Google Scholar
Sherman, Lawrence W. 1992. Policing Domestic Violence: Experiments and Dilemmas. New York: The Free Press.Google Scholar
Sherman, Lawrence W. 1998. Evidence-Based Policing. Washington, DC: Police Foundation.Google Scholar
Sherman, Lawrence W. 2009. “Evidence and Liberty: The Promise of Experimental Criminology.” Criminology & Criminal Justice 9: 5–28.CrossRefGoogle Scholar
Sherman, Lawrence W. 2010. “An Introduction to Experimental Criminology.” In Handbook of Quantitative Criminology, edited by Piquero, Alex R. and Weisburd, David, pp. 399–436. New York: Springer.Google Scholar
Sherman, Lawrence W., and Berk, Richard. 1984. “The Specific Deterrent Effects of Arrest for Domestic Assault.” American Sociological Review 49: 261–72.CrossRefGoogle ScholarPubMed
Sherman, Lawrence W., Farrington, David P., Welsh, Brandon C., and MacKenzie, Doris Layton (eds.). 2006. Evidence-Based Crime Prevention (rev. ed.). New York: Routledge.Google Scholar
Sherman, Lawrence W., Gottfredson, Denise C., MacKenzie, Doris Layton, Eck, John E., Reuter, Peter, and Bushway, Shawn D.. 1997. Preventing Crime: What Works, What Doesn’t, What’s Promising. Washington, DC: National Institute of Justice, U.S. Department of Justice.Google Scholar
Smith, Martha, and Tilley, Nick (eds.). 2005. Crime Science: New Approaches to Preventing and Detecting Crime. Devon: Willan Publishing.Google Scholar
Sparrow, Malcolm. 2011. “Governing Science.” New Perspectives in Policing. Washington, DC: U.S. Departmental of Justice, National Institute of Justice.Google Scholar
Tilley, Nick. 2009. “Sherman vs. Sherman: Realism vs. Rhetoric.” Criminology & Criminal Justice 9:135–44.CrossRefGoogle Scholar
Weisburd, David L. 2003. “Ethical Practice and Evaluation of Interventions in Crime and Justice: The Moral Imperative for Randomized Trials.” Evaluation Review 27: 336–54.CrossRefGoogle ScholarPubMed
Weisburd, David L. 2010. “Justifying the Use of Non-Experimental Methods and Disqualifying the Use of Randomized Controlled Trials: Challenging Folklore in Evaluation Research in Crime and Justice.” Journal of Experimental Criminology 6: 209–27.CrossRefGoogle Scholar
Weisburd, David L., Lum, Cynthia, and Petrosino, Anthony. 2001. “Does Research Design Affect Study Outcomes in Criminal Justice?Annals of the American Academy of Political and Social Science 578: 50–70.CrossRefGoogle Scholar
Weisburd, David L., Mazerolle, Lorraine, and Petrosino, Anthony. 2010. “The Academy of Experimental Criminology: Advancing Randomized Trials in Crime and Justice.” Unpublished paper. Alexandria, VA: Department of Criminology, Law, and Society, George Mason University.
Weisburd, David L., and Piquero, Alex. 2008. “How Well Do Criminologists Explain Crime? Statistical Modeling in Published Studies.” Crime and Justice 37: 453–502.CrossRefGoogle Scholar
Weisburd, David L., Telep, Cody W., Hinkle, Joshua C., and Eck, John E.. 2010. “Is Problem-Oriented Policing Effective in Reducing Crime and Disorder? Findings from a Campbell Systematic Review.” Criminology & Public Policy 9: 139–72.CrossRefGoogle Scholar
Welsh, Brandon C., and Farrington, David P.. 2009. Making Public Places Safer: Surveillance and Crime Prevention. New York: Oxford University Press.CrossRefGoogle Scholar
Welsh, Brandon C., Peel, Meghan E., Farrington, David P., Elffers, Henk, and Braga, Anthony A.. 2011. “Research Design Influence on Study Outcomes in Crime and Justice: A Partial Replication with Public Area Surveillance.” Journal of Experimental Criminology 7: 183–98.CrossRefGoogle Scholar
Wintemute, Garen J., and Braga, Anthony A.. 2011. “Opportunities for State-Level Action to Reduce Firearm Violence: Proceeding from the Evidence.” American Journal of Public Health 101: e1–e3.CrossRefGoogle ScholarPubMed

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×