Book contents
- Experiments in Public Management Research
- Experiments in Public Management Research
- Copyright page
- Contents
- Figures
- Tables
- Contributors
- Preface and Acknowledgements
- Part I Context
- Part II Methods
- Part III Substantive Contributions
- Part IV Issues and Implications
- Appendix Recommended Reporting Guidelines for Experiments in Public Management, a Checklist1
- Index
- References
Part IV - Issues and Implications
Published online by Cambridge University Press: 27 July 2017
Book contents
- Experiments in Public Management Research
- Experiments in Public Management Research
- Copyright page
- Contents
- Figures
- Tables
- Contributors
- Preface and Acknowledgements
- Part I Context
- Part II Methods
- Part III Substantive Contributions
- Part IV Issues and Implications
- Appendix Recommended Reporting Guidelines for Experiments in Public Management, a Checklist1
- Index
- References
Summary
A summary is not available for this content so a preview has been provided. Please use the Get access link above for information on how to access this content.
- Type
- Chapter
- Information
- Experiments in Public Management ResearchChallenges and Contributions, pp. 437 - 508Publisher: Cambridge University PressPrint publication year: 2017
References
References
Berman, E. M., Moon, M. J., and Choi, H. S., ed. 2010. Public Administration in East Asia: Mainland China, Japan, South Korea, Taiwan. Boca Raton, FL: CRC Press.Google Scholar
Bozeman, B. 1993. ‘A theory of government “red tape”’, Journal of Public Administration Research and Theory 3(3): 273–304.Google Scholar
Bozeman, B. 2012. ‘Multidimensional red tape: a theory coda’, International Public Management Journal 15(3): 245–65.CrossRefGoogle Scholar
Cartwright, N. and Hardie, J. 2012. Evidence-Based Policy: A Practical Guide to Doing It Better. Oxford: Oxford University Press.CrossRefGoogle Scholar
Christensen, T., Dong, Lisheng, P., M., and Walker, R. M. 2012. ‘Imitating the West? Evidence on administrative reform from the upper echelons of Chinese provincial government’, Public Administration Review 72(6): 798–806.CrossRefGoogle Scholar
Deci, E. L., Koestner, R., and Ryan, R. M. 1999. ‘A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation’, Psychological Bulletin 125(6): 627.CrossRefGoogle ScholarPubMed
Francis, G. 2012. ‘The psychology of replication and the replication of psychology’, Perspectives on Psychological Sciences 7(6): 585–94.CrossRefGoogle Scholar
Freese, J. 2007. ‘Replication standards for quantitative social sciences. Why not sociology?’, Sociological Methods & Research 36(2): 153–72.CrossRefGoogle Scholar
Frey, B. S. Reto, J. and Jengen, R. 2001. ‘Motivation crowding theory’, Journal of Economic Surveys 15(5): 589–611.CrossRefGoogle Scholar
Ioannidis, J. P. A. 2005. ‘Why most published research findings are false’, PLoS Medicine 2(8): e124.CrossRefGoogle ScholarPubMed
James, O. 2011. ‘Performance measures and democracy: Information effects on citizens in field and laboratory experiments.’ Journal of Public Administration Research and Theory, 21(3): 399–418.CrossRefGoogle Scholar
Jilke, S., Van Ryzin, G. G., and Van de Walle, S., 2015. ‘Responses to decline in marketized public services: an experimental evaluation of choice overload’, Journal of Public Administration Research and Theory doi: 10.1093/jopart/muv021.CrossRefGoogle Scholar
Jilke, S., Van Ryzin, G. G., and Van de Walle, S. 2016. ‘Responses to decline in marketized public services: An experimental evaluation of choice overload.’, Journal of Public Administration Research and Theory 26(3): 421–432.CrossRefGoogle Scholar
Kaufmann, W. and Feeney, M. K. 2014. ‘Beyond the rules: the effect of outcome favourability on red tape perceptions’, Public Administration 92(1): 178–91.CrossRefGoogle Scholar
Lewin, K. 1943. ‘Defining the “field at a given time”’, Psychological Review 50(2): 292–310.CrossRefGoogle Scholar
Morrell, K. and Lucas, J. W. 2012. ‘The replication problem and its implications for policy studies’, Critical Policy Studies 6(2): 182–200.CrossRefGoogle Scholar
Morton, R. B. and Williams, K. C. 2010. Experimental Political Science and the Study of Causality: From Nature to the Lab. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
Nosek, B. A. and Lakens, D. 2014. ‘Registered reports: a method to increase the credibility of published results’, Social Psychology 45(3): 137–41.CrossRefGoogle Scholar
Posner, B. Z. and Schmidt, W. H. 1994. ‘An updated look at the values and expectations of federal-government executives’, Public Administration Review 54(1): 20–4.CrossRefGoogle Scholar
Rosenthal, R. 1991. ‘Replication in behavioral research’. In Neuliep, J. W. (Ed.), Replication Research in the Social Sciences, 1–30. Newbury Park, CA: Sage.Google Scholar
Sargent, C. L. 1981. ‘The repeatability of significance and the significance of repeatability’, European Journal of Parapsychology 3(4): 423–43.Google Scholar
Schmidt, S. 2009. ‘Shall we really do it again? The powerful concept of replication is neglected in the social sciences’, Review of General Psychology 13(2): 90–100.CrossRefGoogle Scholar
Shangraw, R. F. Jr. and Crow, M. M. 1989. ‘Public administration as a design science’, Public Administration Review 49: 153–8.CrossRefGoogle Scholar
Tsang, E. W. K. and Kwan, K.-M. 1999. ‘Replication and theory development in organizational science: a critical realist perspective’, Academy of Management Review 24(4): 759–80.CrossRefGoogle Scholar
Van der Wal, Z. and Yang, L. 2015. ‘Confucius meets Weber or “managerialism takes all”? Comparing civil servants’ values in China and the Netherlands’, International Public Management Journal 18(3): 411–36.CrossRefGoogle Scholar
Van Ryzin, G. G. 2006. ‘Testing the expectancy disconfirmation model of citizen satisfaction with local government’, Journal of Public Administration Research and Theory 16: 599–611.CrossRefGoogle Scholar
Van Witteloostuijn, A. 2015. What Happened to Popperian Falsification? A Manifesto to Create a Healthier Business and Management Scholarship – Towards a Scientific Wikipedia. The Netherlands: Tilburg University.Google Scholar
Vandenabeele, W., Brewer, G. A., and Ritz, A. 2014. ‘Past, present, and future of public service motivation research’, Public Administration 92(4): 779–89.CrossRefGoogle Scholar
References
Banerjee, A. V. and Duflo, E. 2012. Poor Economics. Barefoot Hedge-Fund Managers, DIY Doctors and the Surprising Truth about Life on Less than $1 a Day. London: Penguin Books.Google Scholar
Coser, L. A. 1975. ‘Presidential address: two methods in search of a substance’, American Sociological Review 40(6): 691–700.CrossRefGoogle Scholar
Deaton, A. 2010. ‘Instruments, randomization, and learning about development’, Journal of Economic Literature 48(2): 424–55.CrossRefGoogle Scholar
Dickson, E. S. 2011. ‘Economics vs. psychology experiments: stylization, incentives, and deception’, in Druckman, J. N., Green, D. P., Kuklinski, J. H., and Lupia, A. (eds.). Cambridge Handbook of Experimental Political Science. Cambridge: Cambridge University Press, pp. 58–70.CrossRefGoogle Scholar
Gadellaa, S., Curry, D., and Van de Walle, S. 2015. ‘Hoe bestuurskundig is de bestuurskunde? Nederlandse bestuurskundigen vergeleken met hun Europese vakgenoten’, Bestuurskunde 25(3): 67–79.Google Scholar
Gerring, J. 2012. ‘Mere description’, British Journal of Political Science 42(4): 721–46.CrossRefGoogle Scholar
James, O. 2011. ‘Performance measures and democracy: information effects on citizens in field and laboratory experiments’, Journal of Public Administration Research and Theory 21(3): 399–418.CrossRefGoogle Scholar
James, O., Jilke, S., Petersen, C., and Van de Walle, S. 2016. ‘Citizens’ blame of politicians for public service failure: experimental evidence about blame reduction through delegation and contracting’, Public Administration Review 76(1): 83–95.CrossRefGoogle Scholar
Jilke, S., Van Ryzin, G., and Van de Walle, S. 2016. ‘Responses to decline in marketized public services: an experimental evaluation of choice-overload’, Journal of Public Administration Research and Theory 26(3): 421–32.CrossRefGoogle Scholar
Kaplan, A. (1964) 1998. The Conduct of Inquiry: Methodology for Behavioural Science. New Brunswick, NJ: Transaction Publishers.Google Scholar
Kaufman, H. 1960. The Forest Ranger: A Study in Administrative Behavior. Baltimore, MD: Johns Hopkins University Press.Google Scholar
Kinder, D. R. 2011. ‘Campbell’s ghost’, in Druckman, J. N., Green, D. P., Kuklinski, J. H., and Lupia, A. (eds.). Cambridge Handbook of Experimental Political Science. Cambridge: Cambridge University Press, pp. 525–30.Google Scholar
Kinder, D. R. and Palfrey, T. R. 1993. Experimental Foundations of Political Science. Ann Arbor: University of Michigan Press.CrossRefGoogle Scholar
Lijphart, A. 1971. ‘Comparative politics and the comparative method’, American Political Science Review 65(3): 682–93.CrossRefGoogle Scholar
Lum, C. and Yang, S. M. 2005. ‘Why do evaluation researchers in crime and justice choose non-experimental methods?’ Journal of Experimental Criminology 1(2): 191–213.CrossRefGoogle Scholar
Marvel, J. and Girth, A. 2016. ‘Citizen attributions of blame in third-party governance’, Public Administration Review 76(1): 96–108.CrossRefGoogle Scholar
McDermott, R. (2005). ‘Experimental methods in political science’, Annual Review of Political Science 5: 31–61.CrossRefGoogle Scholar
Peters, J., Langbein, J., and Roberts, G. 2015. ‘Policy evaluation, randomize controlled trials, and external validity: a systematic review’, Ruhr Economic Papers no. 589. Bochum: Ruhr-Universität Bochum, Department of Economics.Google Scholar
Sunstein, C. R. 2001. Foreword: ‘On academic fads and fashions’, Michigan Law Review 99(6): 1251–64.CrossRefGoogle Scholar
Thomassen, J.-P., Leliveld, M., Ahaus, K., and Van de Walle, S. 2015. Prosocial Compensation after Service Guarantee Violation in For-Profit and Public Settings. Mimeo.Google Scholar
Willis, D. 2014. ‘Professors’ research project stirs political outrage in Montana’, New York Times, retrieved from www.nytimes.com/2014/10/29/upshot/professors-research-project-stirs-political-outrage-in-montana.html.Google Scholar
References
Angrist, J., Bettinger, E., Bloom, E., King, E. and Kremer, M., 2002. ‘Vouchers for private schooling in Colombia: Evidence from a randomized natural experiment’, The American Economic Review 92(5): 1535–58.CrossRefGoogle Scholar
Berk, R. A., Boruch, R. F., Chambers, D. L., Rossi, P. H., and Witte, A. D. 1985. ‘Social policy experimentation: a position paper’, Evaluation Review 9: 385–429.CrossRefGoogle Scholar
Bloom, H. S., Orr, L. L., Bell, S. H., Cave, G., Doolittle, F., Lin, W., and Bos, J. M. 1997. ‘The benefits and costs of JTPA Title II-A programs: key findings from the National Job Training Partnership Act study’, Journal of Human Resources 32: 549–76.Google Scholar
Bloom, H. S., Orr, L., Cave, G., Bell, S., and Doolittle, F. 1993. The National JTPA Study: Title II-A Impacts on Earnings and Employment at 18 Months. Bethesda, MD: Abt Associates, Inc.Google Scholar
Brewer, G. A. and Brewer, G. A. Jr. 2011. ‘Parsing public/private differences in work motivation and performance: an experimental study’, Journal of Public Administration Research and Theory 21: 347–62.CrossRefGoogle Scholar
Butler, D. and Brockman, D. 2011. ‘Do politicians racially discriminate against constituents? A field experiment on state legislators’, American Journal of Political Science 553: 463–77.Google Scholar
Cabinet Office 2012. Applying Behavioural Insights to Reduce Fraud, Error and Debt. London: Cabinet Office.Google Scholar
Campbell, D. T. 1957. ‘Factors relevant to the validity of experiments in social settings’, Psychological Bulletin 4: 297–312.CrossRefGoogle Scholar
Campbell, D. T. 1969. ‘Reforms as experiments’, American Psychologist 24: 409–29.CrossRefGoogle Scholar
Campbell, D. T., and Stanley, J. C. 1963. Experimental and Quasi-Experimental Designs for Research. Chicago, IL: Rand McNally.Google Scholar
Christiansen, J. and Bunt, L. 2012. Innovation in Policy: Allowing for Creativity, Social Complexity and Uncertainty in Public Governance. London: Nesta.Google Scholar
Dolan, P., Hallsworth, M., Halpern, D., King, D., and Vlaev, I. 2010. MINDSPACE: Influencing Behaviour Through Public Policy. London: Cabinet Office and Institute for Government.Google Scholar
Duflo, E., Glennerster, R., and Kremer, M. 2007. ‘Using randomization in development economics research: a toolkit’, Handbook of Development Economics 4: 3895–962.CrossRefGoogle Scholar
Dunleavy, P., Margetts, H., Bastow, S., and Tinkler, J. 2006. Digital Era Governance: IT Corporations, the State and E-Government. Oxford: Oxford University Press.CrossRefGoogle Scholar
Dunlop, C. A. 2013. ‘Narrating experiments in public policy: explaining impact through boundary work’, paper to the Policy and Politics Annual Conference, Bristol.Google Scholar
Dunning, T. 2012. Natural Experiments in the Social Science: A Design-Based Approach. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
Eldersveld, S. T. 1956. ‘Experimental propaganda techniques and voting behaviour’, The American Political Science Review 50: 154–65.CrossRefGoogle Scholar
Gerber, A. S., and Green, D. P. 2012. Field Experiments Design, Analysis and Interpretation. New York: William Norton.Google Scholar
Gosnell, H. F. 1926. ‘An experiment in the stimulation of voting’, The American Political Science Review 20: 869–74.CrossRefGoogle Scholar
Gosnell, H. F. 1927. Getting-Out-the-Vote: An Experiment in the Stimulation of Voting. Chicago, IL: Chicago University Press.Google Scholar
Green, D. P. and Gerber, A. S. 2003. ‘The underprovision of experiments in political science’, The Annals of the American Academy of Political and Social Science 589: 94–112.CrossRefGoogle Scholar
Green, D. P., and Gerber, A. S. 2008. Get Out the Vote: How to Increase Voter Turnout. 2nd ed. Washington, DC: Brookings Institution Press.Google Scholar
Greenberg, D., Linksz, D., and Mandell, M. 2003. Social Experimentation and Public Policymaking. Washington, DC: Urban Institute Press.Google Scholar
Greenberg, D. and Shroder, M. 2004. Digest of Social Experiments. Washington, DC: Urban Institute Press.Google Scholar
Hallsworth, M., List, J. A., and Vlaev, I. 2014. ‘The Behavioralist as Tax Collector: Using Natural Field Experiments to Enhance Tax Compliance’, unpublished paper, http://econpapers.repec.org/paper/nbrnberwo/20007.htm.CrossRefGoogle Scholar
Halpern, D., Bates, C., Mulgan, G., and Aldridge, S., with Beales, G. and Heathfield, A. 2004. Personal Responsibility and Changing Behaviour: The State of Its Knowledge and Its Implications for Public Policy. London: Cabinet Office.Google Scholar
Haynes, L. C., Green, D. P., Gallagher, R., John, P., and Torgerson, D. J. 2013. ‘Collection of delinquent fines: an adaptive randomized trial to assess the effectiveness of alternative text messages’, Journal of Policy Analysis and Management 32: 718–30.CrossRefGoogle Scholar
Haynes, L., Service, O., Goldacre, B., and Torgerson, D. 2012. Test, Learn, Adapt: Developing Public Policy with Randomised Controlled Trials. London: Cabinet Office.Google Scholar
Henegan, C. 2010. ‘How many randomized trials are published each year?’, http://blogs.trusttheevidence.net/carl-heneghan/how-many-randomized-trials-are-published-each-year.Google Scholar
Treasury, HM 2003. The Magenta Book: Guidance Notes for Policy Evaluation and Analysis. London: HM Treasury.Google Scholar
Humphreys, M., de la Sierra, R. Sanchez, and van der Wind, P. 2012. Social and Economic Impacts of Tuungane. Final Report on the Effects of a Community Driven Reconstruction Program in Eastern Democratic Republic of Congo. University of Columbia.Google Scholar
Humphreys, M. and Weinstein, J. M. 2009. ‘Field experiments and the political economy of development’, Annual Review of Political Science 12: 367–78.CrossRefGoogle Scholar
John, P. 2013. ‘Policy entrepreneurship in UK central government: the Behavioural Insights Team and the use of randomized trials’, Public Policy and Administration 29: 257–67.Google Scholar
John, P. and Richardson, L. 2012, Nudging Citizens Toward Localism. London: British Academy.Google Scholar
Jones, R., Pykett, J., and Whitefield, M. 2013. Changing Behaviours: The Rise of the Psychological State. Brighton: Edward Elgar.CrossRefGoogle Scholar
Kahneman, D., Slovic, P., and Tversky, A. 1982. Judgment Under Uncertainty: Heuristics and Biases. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
Kanter, R. M. 1983. The Change Masters: Innovations for Productivity in the American Corporation. New York: Simon and Schuster.Google Scholar
Kanter, R. M. 1989. ‘Swimming in newstreams: mastering innovation dilemmas’, California Management Review 414: 45–69.CrossRefGoogle Scholar
Kelman, S. 2005. Unleashing Change: A Study of Organizational Renewal in Government. Washington, DC: Brookings Institution Press.Google Scholar
Margetts, H. and Dunleavy, P. 2013. ‘The second wave of digital-era governance: a quasi-paradigm for government on the Web’, Philosophical Transactions of the Royal Society A 28: 1–17.Google Scholar
McDougall, C., Perry, A., Clarbour, J., Bowles, R., and Worthy, G. 2009. Evaluation of HM Prison Service Enhanced Thinking Skills Programme. London: Ministry of Justice Research Series 3/09 www.justice.gov.uk/publications.Google Scholar
Miles, I. 2013. ‘Public service innovation: what messages from the collision of innovation studies and services research?’ In Osborne, S. and Brown, L. (eds.), Handbook of Innovation in Public Services. Brighton: Edward Elgar.Google Scholar
Munnell, A. H. (ed.) 1987. Lessons from the Income Maintenance Experiments. Federal Reserve Bank of Boston Conference Series 30. Boston: Federal Reserve Bank of Boston.Google Scholar
Murphy, S., Moore, G. F., Lynch, K. T. R., Clarke, R., Raisanen, L., Desousa, C., and Moore, L.. 2010. ‘Free healthy breakfasts in primary schools: a cluster randomised controlled trial of a policy intervention in Wales, UK’, Public Health Nutrition 142: 219–26.Google Scholar
Nooteboom, B. 2000. Learning and Innovation in Organizations and Economies. Oxford: Oxford University Press.Google Scholar
Olken, B. 2005. ‘Monitoring corruption: evidence from a field experiment in Indonesia’, National Bureau of Economic Research Working Paper Series p. 11753.CrossRefGoogle Scholar
Olken, B., Onishi, J., and Wong, S. 2012 ‘Should aid reward performance?’ www.nber.org/papers/w17892.Google Scholar
Orr, L. 1999. Social Experiments Evaluating Public Programs with Experimental Methods. Thousand Oaks, CA: Sage.Google Scholar
Petrosino, A., Petrosino, C. Turpin, and Colophon, J. Buehler 2002. ‘Scared Straight’ and Other Juvenile Awareness Programs for Preventing Juvenile Delinquency. Campbell Systematic Reviews.CrossRefGoogle ScholarPubMed
Riccio, J. A. and Bloom, H. 2001. New Directions in Evaluations of American Welfare-to-Work and Employment Initiatives. New York: Manpower Demonstration Research Corporation.Google Scholar
Richardson, L. and John, P. 2012. ‘Who listens to the grassroots? A field experiment on informational lobbying in the UK’, British Journal of Politics and International Relations 144: 595–612.CrossRefGoogle Scholar
Roberts, N. C. and King, P. J. 1991, ‘Policy entrepreneurs: their activity structure and function in the policy process’, Journal of Public Administration Research and Theory 1: 147–75.Google Scholar
Robins, P. K. and Spiegelman, R. G. 2001. Reemployment Bonuses in the Unemployment Insurance System. Michigan: W. E. Upjohn Institute for Employment Research.Google Scholar
Sherman, L. W., Rogan, D. P., Edwards, T., Whipple, R., Shreve, D., Witcher, D., Trimble, W., The Street Narcotics Unit, Velke, R., Blumberg, M., Beatty, A., and Bridgeforth, C. A. 1995. ‘Deterrent effects of police raids on crack houses: a randomized, controlled experiment’, Justice Quarterly 12: 755–81.Google Scholar
Sherman, L. W. and Weisburd, D. 1995. ‘General deterrent effects of police patrol in crime hot spots: a randomized, controlled trial’, Justice Quarterly 12: 635–48.Google Scholar
Thaler, R. H. and Sunstein, C. R. 2008. Nudge: Improving Decisions about Health, Wealth, and Happiness. New Haven, CT: Yale University Press.Google Scholar
Torfing, J. B., Peters, G., Pierre, J., and Sørensen, E. 2012. Interactive Governance: Advancing the Paradigm. Oxford: Oxford University Press.CrossRefGoogle Scholar
Torgerson, D. J. and Torgerson, C. 2008. Designing Randomised Trials in Health, Education and the Social Sciences: An Introduction. Basingstoke: Palgrave Macmillan.CrossRefGoogle Scholar
Weisburd, D. and Green, L. 1995. ‘Policing drug hot spots: the Jersey City drug market analysis experiment’, Justice Quarterly 124: 711–35.Google Scholar
Weiss, C. 1997. ‘How can theory-based evaluation make greater headway?’ Evaluation Review 214: 501–24.Google Scholar
Weiss, C. 1998. ‘Have we learned anything new about the use of evaluation?’ American Journal of Evaluation 191: 21–33.CrossRefGoogle Scholar
Word, E., Johnston, J., Bain, H. P., Boyd-Zaharias, J., Lintz, N., Achiles, C. M., Folger, J., and Breda, C. 1989. Student/Teacher Achievement Ratio (STAR) Tennessee’s K-3 Class Size Study. Final Summary Report 1985–1990. Retrieved from http://eric.ed.gov/?id=ED320692.Google Scholar
References
Angrist, J. D. and Pischke, J. S. 2015. Mastering ‘Metrics: The Path from Cause to Effect. Princeton, NJ: Princeton University Press.Google Scholar
Boutron, I., John, P., and Torgerson, D. J. 2010. ‘Reporting methodological items in randomized experiments in political science’, The Annals of the American Academy of Political and Social Science, 628(1), pp. 112–31.CrossRefGoogle Scholar
Gerber, A., Arceneaux, K., Boudreau, C., Dowling, C., Hillygus, S., Palfrey, T., Biggers, S., and Hendry, D. 2014. ‘Reporting guidelines for experimental research: a report from the Experimental Research Section Standards Committee’, Journal of Experimental Political Science, 1(1), pp. 81–98.CrossRefGoogle Scholar
Guala, F. and Mittone, L. 2005. ‘Experiments in economics: external validity and the robustness of phenomena’, Journal of Economic Methodology, 12(4), pp. 495–515.CrossRefGoogle Scholar
Hood, C. 2011. The Blame Game: Spin, Bureaucracy, and Self-Preservation in government. Princeton, NJ: Princeton University Press.Google Scholar
Pollitt, C. and Bouckaert, G. 2011. Public Management Reform: A Comparative Analysis – New Public Management, Governance and the Neo-Weberian State. Oxford: Oxford University Press.Google Scholar
Schulz, K., Altman, D., and Moher, D. 2010. ‘CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials’, The British Medical Journal, 340:c332.CrossRefGoogle Scholar