Skip to main content
×
×
Home

Uncertainty in the Cost-Effectiveness of Federal Air Quality Regulations

  • Kerry Krutilla (a1), David H. Good (a2) and John D. Graham (a3)
Abstract

In this study, we conduct a cost-effectiveness analysis of nine air quality regulations recently issued by the U.S. Environmental Protection Agency (EPA). Taking emission reductions in the Regulatory Impact Analyses (RIAs) for these regulations as given, we independently assess uncertainty about the compliance costs of the regulations and the lives the regulations are estimated to save. The latter evaluation is based on a formal uncertainty analysis that integrates expert judgments about the effects of fine particle exposures on mortality risks. These expert judgments were given in an EPA-sponsored elicitation study conducted in 2006. The integrated judgments are used to generate probability distributions for several types of cost-effectiveness ratios, including the gross and net cost per life saved, net cost per life year saved, and net cost per quality-adjusted life year (QALY) gained. The results show that the cost-effectiveness ratios exhibit considerable uncertainty individually and also vary widely across regulations. Within a simulated 90% confidence interval for the gross cost per life saved, for example, there is both the possibility that benefits from lifesavings alone are sufficient to cover the rules’ costs and the possibility that no lives will be saved and cost-effectiveness ratios will be infinite. The wide ranges for the confidence intervals suggest the need for better information about the effects of fine particle exposures on mortality risks.

  • View HTML
    • Send article to Kindle

      To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      Uncertainty in the Cost-Effectiveness of Federal Air Quality Regulations
      Available formats
      ×
      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

      Uncertainty in the Cost-Effectiveness of Federal Air Quality Regulations
      Available formats
      ×
      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

      Uncertainty in the Cost-Effectiveness of Federal Air Quality Regulations
      Available formats
      ×
Copyright
Corresponding author
*e-mail: krutilla@indiana.edu
References
Hide All
Abbey, D. E., Hwang, B. L., Burchette, R. J., Vancuren, T. & Mills, P. K. (1995). Estimated Long-Term Ambient Concentrations of PM10 and Development of Respiratory Symptoms in a Nonsmoking Population. Archives of Environmental Health: An International Journal, 50(2), 139152.
Burtraw, D., Palmer, K., Paul, A. & Woerman, M. (2012). Secular Trends, Environmental Regulations, and Electricity Markets. The Electricity Journal, 25(6), 3547.
Chicanowicz, J.(2011). Factors Affecting the Timeline for Retrofit of Environmental Control Technologies to Coal-fired Power Stations: Testimony before the Subcommittee on Energy and Environment (Committee on Science, Space and Technology), United States House of Representatives, 113th Cong.
Cohen, J. T., Hammitt, J. K. & Levy, J. I. (2003). Fuels for Urban Transit Buses: A Cost-Effectiveness Analysis. Environmental Science & Technology, 37(8), 14771484.
Cooke, R. M. (1991). Experts in Uncertainty: Opinion and Subjective Probability in Science. New York: Oxford University Press.
Cooke, R., Wilson, A., Tuomisto, J., Morales, O., Tainio, M. & Evans, J. (2007). A Probabilistic Characterization of the Relationship between Fine Particulate Matter and Mortality: Elicitation of European Experts. Environmental Science & Technology, 41(18), 65986605.
Cox, L. (2012). Miscommunicating Risk, Uncertainty, and Causation: Fine Particulate Air Pollution and Mortality Risk as an Example. Risk Analysis, 32(5), 765767.
Cropper, M. L. & Krupnick, A. J.(1990). The Social Costs of Chronic Heart and Lung Disease. Resources for the Future. Washington, DC. Discussion Paper QE-89-16-REV.
Dockery, D. W., Pope, C. A., Xu, X., Spengler, J. D., Ware, J. H., Fay, M. E., Ferris, B. G. & Speizer, F. E. (1993). An Association Between Air Pollution and Mortality in Six US Cities. New England Journal of Medicine, 329(24), 17531759.
Drummond, M. F., O’Brien, B., Stoddart, G. L. & Torrance, G. W. (2005). Methods for Economic Evaluation of Health Care Programmes. (3rd ed.). New York: Oxford Medical Publications, Oxford University Press.
Fann, N., Gilmore, E. & Walker, K.(2013). Characterizing the Long-term PM2.5 Concentration Response Function: Comparing Strengths and Weaknesses of Research Synthesis Approaches. Working Paper prepared for: Methods for Research Synthesis; A Cross-Disciplinary Workshop, Harvard Center for Risk Analysis.
Fann, N., Lamson, A. D., Anenberg, S. C. & Hubbell, B. J. (2013). Letter in Response to Fraas & Lutter Article: Uncertain Benefits Estimates for Reductions in Fine Particle Concentrations. Risk Analysis, 33(5), 755756.
Fann, N., Lamson, A. D., Anenberg, S. C., Wesson, K., Risley, D. & Hubbell, B. J. (2012a). Estimating the National Public Health Burden Associated with Exposure to Ambient PM2.5 and Ozone. Risk Analysis, 32(1), 8195.
Fann, N., Lamson, A. D., Anenberg, S. C., Wesson, K., Risley, D. & Hubbell, B. J. (2012b). Response to Cox Letter: “Miscommunicating Risk, Uncertainty, and Causation: Fine Particulate Air Pollution and Mortality Risk as an Example”. Risk Analysis, 32(5), 768.
Fann, N., Lamson, A., Luben, T. & Hubbell, B. (2015). Response To: “Enhancing the Characterization of Epistemic Uncertainties in PM2.5 Risk Analyses”. Risk Analysis. Advance online publication. doi:10.1111/risa.12301.
Fraas, A. & Lutter, R. (2011). Do Some NO x Emissions Have Negative Environmental Damages? Evidence and Implications for Policy. Environmental Science & Technology, 45(18), 76137614.
Fraas, A. & Lutter, R. (2012). Efficient Pollution Regulation: Getting the Prices Right: Comment. American Economic Review, 102(1), 602607.
Fraas, A. & Lutter, R. (2013a). Uncertain Benefits Estimates for Reductions in Fine Particle Concentrations. Risk Analysis, 33(3), 434449.
Fraas, A. & Lutter, R. (2013b). Reply to Letter by Fann, Lamson, Anenberg, and Hubbell, Regarding Fraas & Lutter Article: Uncertain Benefits Estimates for Reductions in Fine Particle Concentrations. Risk Analysis, 33(5), 757759.
Gayer, T. & Viscusi, W. K.(2014). Determining the Proper Scope of Climate Change Benefits. Vanderbilt Law and Economics Research Paper, (14–20). Retrieved from Brookings Institute website: http://www.brookings.edu/research/papers/2014/06/04-determining-proper-scope-climate-change-benefits-gayer.
Gillingham, K. & Palmer, K. (2014). Bridging the Energy Efficiency Gap: Policy Insights from Economic Theory and Empirical Evidence. Review of Environmental Economics and Policy, 8(1), 1838.
Graham, J. D. (2008). Saving Lives Through Administrative Law and Economics. University of Pennsylvania Law Review, 157(2), 395540.
Grosse, S. D. (2008). Assessing Cost-Effectiveness in Healthcare: History of the $50,000 per QALY Threshold. Expert Review of Pharmacoeconomics & Outcomes Research, 8(2), 165178.
Hall, M., DeFrances, C., Williams, S., Golosinskiy, A. & Schwartzman, A.(2010). National Hospital Discharge Survey: 2007 Summary, in National Health Statistics Reports. October 29, 2010.
Hammitt, J. K. (2013). Admissible Utility Functions for Health, Longevity, and Wealth: Integrating Monetary and Life-Year Measures. Journal of Risk and Uncertainty, 47(3), 311325.
Haninger, K. & Hammitt, J. K. (2011). Diminishing Willingness to Pay Per Quality-Adjusted Life Year: Valuing Acute Foodborne Illness. Risk Analysis, 31(9), 13631380.
Harrington, W., Morgenstern, R. D. & Nelson, P. (2000). On the Accuracy of Regulatory Cost Estimates. Journal of Policy Analysis and Management, 19(2), 297322.
Hazilla, M. & Kopp, R. J. (1990). Social Cost of Environmental Quality Regulations: A General Equilibrium Analysis. Journal of Political Economy, 853873.
Heinzerling, L. & Ackerman, F. (2002). The Humbugs of the Anti-Regulatory Movement. Cornell Law Review, 87, 648670.
Hubbell, B. J. (2006). Implementing QALYs in the Analysis of Air Pollution Regulations. Environmental & Resource Economics, 34(3), 365384.
Industrial Economics, Inc. (2006). Expanded Expert Judgment Assessment of the Concentration-Response Relationship Between PM 2.5 Exposure and Mortality. Prepared for the Office of Air Quality Planning and Standards, U.S. Environmental Protection Agency.
Institute of Medicine (2006). Valuing Health for Regulatory Cost-Effectiveness Analysis. Washington, DC: Institute of Medicine of the National Academies.
Kopits, E. (2014). A Retrospective Assessment of the Costs of EPA’s 1998 Locomotive Emission Standards. Journal of Benefit-Cost Analysis, 5(2), 285314.
Kopits, E., McGartland, A., Morgan, C., Pasurka, C., Shadbegian, R., Simon, N. B. & Wolverton, A. (2014). Retrospective Cost Analyses of EPA Regulations: A Case Study Approach. Journal of Benefit-Cost Analysis, 5(2), 173193.
Krewski, D., Jerrett, M., Burnett, R. T., Ma, R., Hughes, E. & Shi, Y. et al. (2009). Extended Follow-Up and Spatial Analysis of the American Cancer Society Study Linking Particulate Air Pollution and Mortality. Health Effects Institute (HEI) Research Report, (140).
Krupnick, A., Morgenstern, R., Batz, M., Nelson, P., Burtraw, D., Shih, J. S. & McWilliams, M. (2006). Not a Sure Thing: Making Regulatory Choices Under Uncertainty. Washington, DC: Resources for the Future.
Krutilla, K. & Alexeev, A. (2012). The Normative Implications of Political Decision-Making for Benefit-Cost Analysis. Journal of Benefit-Cost Analysis, 3(2), Article 2.
Krutilla, K. & Alexeev, A. (2014). The Political Transaction Costs and Uncertainties of Establishing Environmental Rights. Ecological Economics, 107, 299309.
Krutilla, K. & Krause, R. (2011). Transaction Costs and Environmental Policy: An Assessment Framework and Literature Review. International Review of Environmental and Resource Economics, 4(3–4), 261354.
Laden, F., Schwartz, J., Speizer, F. E. & Dockery, D. W. (2006). Reduction in Fine Particulate Air Pollution and Mortality. American Journal of Respiratory and Critical Care Medicine, 173(6), 667672.
Lepeule, J., Laden, F., Dockery, D. & Schwartz, J. (2012). Chronic Exposure to Fine Particles and Mortality: An Extended Follow-Up of the Harvard Six Cities Study from 1974 to 2009. Environmental Health Perspectives, 120(7), 965970.
Lutter, R., Morrall, J. & Viscusi, W. K. (1999). The Cost-Per-Life-Saved Cutoff for Safety-Enhancing Regulations. Economic Inquiry, 37(4), 599608.
Martin, R., Muuls, M, de Preux, L. B. & Wagner, U. J.(2010). Anatomy of a Paradox: Management Practices, Organizational Structure and Energy Efficiency. Center for Economic Performance, Working Paper 1039.
McCarthy, J.(2012). EPA’s Boiler MACT: Controlling Emissions of Hazardous Pollutants. Congressional Research Service Report, (R41459).
McCarthy, J. & Copeland, C.(2011). EPA’s Regulation of Coal-fired Power: Is a “Train Wreck” Coming? Congressional Research Service Report, (R41914).
McGarity, T. O. & Ruttenberg, R. (2001). Counting the Cost of Health, Safety, and Environmental Regulation. Tex. L. Rev., 80, 1997.
Morgan, C., Pasurka, C. & Shadbegian, R. (2014). Ex Ante and Ex Post Cost Estimates of the Cluster Rule and MACT II Rule. Journal of Benefit-Cost Analysis, 5(2), 195224.
Morrall, J. F. III (2003). Saving Lives: A Review of the Record. Journal of Risk and Uncertainty, 27(3), 221237.
National Research Council(2002). Estimating the Public Health Benefits of Proposed Air Pollution Regulations. Washington, DC: National Academies Press.
Neumann, P. J., Cohen, J. T. & Weinstein, M. C. (2014). Updating Cost-Effectiveness – the Curious Resilience of the $50,000-Per-QALY Threshold. New England Journal of Medicine, 371(9), 796797.
Office of Management and Budget (2003). Circular A-4: Regulatory Analysis. Washington, DC: Office of Management and Budget.
Office of Management and Budget (2012). Draft Report to Congress on the Benefits and Costs of Federal Regulations and Agency Compliance with the Unfunded Mandates Reform Act. Washington, DC: Office of Management and Budget. Retrieved from http://www.whitehouse.gov/sites/default/files/omb/inforeg/2012_cb/2012_cost_benefit_report.pdf.
Office of Management and Budget(2014). Draft Report to Congress on the Benefits and Costs of Federal Regulations and Agency Compliance with the Unfunded Mandates Reform Act. Washington, DC: Office of Management and Budget. Retrieved from http://www.whitehouse.gov/sites/default/files/omb/inforeg/2013_cb/draft_2013_cost_benefit_report.pdf.
Peters, A., Dockery, D. W., Muller, J. E. & Mittleman, M. A. (2001). Increased Particulate Air Pollution and the Triggering of Myocardial Infarction. Circulation, 103, 28102815.
Pope, C. A. III, Thun, M. J., Namboodiri, M. M., Dockery, D. W., Evans, J. S., Speizer, F. E. & Heath, C. W. Jr. (1995). Particulate Air Pollution as A Predictor of Mortality in A Prospective Study of US Adults. American Journal of Respiratory and Critical Care Medicine, 151(3_pt_1), 669674.
Pope, C. A. III, Burnett, R. T., Thun, M. J., Calle, E. E., Krewski, D., Ito, K. & Thurston, G. D. (2002). Lung Cancer, Cardiopulmonary Mortality, and Long-Term Exposure to Fine Particulate Air Pollution. Journal of the American Medical Association, 287(9), 11321141.
Revesz, R. & Livermore, M. (2008). Retaking Rationality: How Cost Benefit Analysis Can Better Protect the Environment and Our Health. New York: Oxford University Press.
Robinson, L. A. & Hammitt, J. (2013). Skills of the Trade: Valuing Health Risk Reductions in Benefit-Cost Analysis. Journal of Benefit-Cost Analysis, 4(1), 107130.
Robinson, L. A., Black, R., Cropper, M., Burnett, R., Hammitt, J., Krupnick, A. & Williams, S. (2005). Alternative Approaches for Estimating Health Related Quality of Life Impacts: Nonroad Engine Air Emissions Regulation Case Study. In Health, and Safety Regulation. Institute of Medicine.
Roman, H. A., Walker, K. D., Walsh, T. L., Conner, L., Richmond, H. M., Hubbell, B. J. & Kinney, P. L. (2008). Expert Judgment Assessment of the Mortality Impact of Changes in Ambient Fine Particulate Matter in the US. Environmental Science & Technology, 42(7), 22682274.
Ryan, S. P. (2012). The Costs of Environmental Regulation in a Concentrated Industry. Econometrica, 80(3), 10191061.
Smith, A. E. & Gans, W.(2014). Enhancing the characterization of epistemic uncertainties in PM2.5 risk analyses. Risk Analysis. Advance online publication. doi:10.1111/risa.12236.
Sullivan, P. W. & Ghushchyan, V. (2006). Preference-Based EQ-5D Index Scores for Chronic Conditions in the United States. Medical Decision Making, 26(4), 410420.
Tengs, T. O., Adams, M. E., Pliskin, J. S., Safran, D. G., Siegel, J. E., Weinstein, M. C. & Graham, J. D. (1995). Five-Hundred Life-Saving Interventions and their Cost-Effectiveness. Risk Analysis, 15(3), 369390.
Tengs, T. O. & Graham, J. D. (1996). The Opportunity Costs of Haphazard Social Investments in Life-Saving. In Risks, Costs, and Lives Saved: Getting Better Results from Regulation (Vol. 167, p. 172). Oxford University Press.
Thorat, T., Cangelosi, M. & Neumann, P. J. (2012). Skills of the Trade: The Tufts Cost-Effectiveness Analysis Registry. Journal of Benefit-Cost Analysis, 3(01), 19.
Tilling, M. C., Kro, M., Tsuchiya, A., Brazier, J., van Exel, J. & Brouwer, W. (2012). Does The EQ-5D Reflect Lost Earnings? Pharmaco Economics, 30(1), 4761.
Tuomisto, J. T., Wilson, A., Evans, J. S. & Tainio, M. (2007). Uncertainty in Mortality Response to Airborne Fine Particulate Matter: Combining European Air Pollution Experts. Reliability Engineering & System Safety, 93(5), 732744.
U.S. Department of Health and Human Services Summary health statistics for U.S. adults: National Health Interview Survey, (2012), National Center for Health Statistics. Vital and Health Statistics 10 (260). February 2014.
U.S. EPA (2002). EPA Air Pollution Control Cost Manual (6th ed.). EPA/452/B-02-001.
U.S. EPA (2006). U.S. Environmental Protection Agency. Appendix G: Health-Based Cost-Effectiveness of Reductions in Ambient PM2.5 Associated with Illustrative PM NAAQS Attainment Strategies. 2006 National Ambient Air Quality Standards for Particle Pollution. Washington, DC: U.S. EPA. Retrieved from http://www.epa.gov/ttnecas1/regdata/RIAs/Appendix%20G–Health%20Based%20Cost%20Effectiveness%20Analysis.pdf.
U.S. EPA (2009). Integrated Science Assessment for Particulate Matter (Final Report). U.S. Environmental Protection Agency, Washington, DC, EPA/600/R-08/139F.
U.S. EPA (2012). Regulatory Impact Analysis for the Final Revisions to the National Ambient Air Quality Standards for Particulate Matter, December 2012. Retrieved fromhttp://www.epa.gov/ttnecas1/regdata/RIAs/finalria.pdf.
U.S. EPA (2014). Guidelines for Preparing Economic Analyses. Washington, DC: U.S. EPA Office of Policy. (Original work published 2010.) Retrieved from http://yosemite.epa.gov/ee/epa/eerm.nsf/vwAN/EE-0568-50.pdf/$file/EE-0568-50.pdf.
Viscusi, W. K. (2005-2006). Monetizing the Benefits of Risk and Environmental Regulation. Fordham Urban Law Journal, 33(4), 101143.
Viscusi, W. K., Magat, W. A. & Huber, J. (1991). Pricing Environmental Health Risks: Survey Assessments of Risk-Risk and Risk-Dollar Trade-Offs for Chronic Bronchitis. Journal of Environmental Economics and Management, 21(1), 3251.
Wittels, E. H., Hay, J. W. & Gotto, A. M. Jr. (1990). Medical Costs of Coronary Artery Disease in the United States. American Journal of Cardiology, 65(7), 432440.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Journal of Benefit-Cost Analysis
  • ISSN: 2194-5888
  • EISSN: 2152-2812
  • URL: /core/journals/journal-of-benefit-cost-analysis
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Keywords:

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 2
Total number of PDF views: 65 *
Loading metrics...

Abstract views

Total abstract views: 466 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 12th June 2018. This data will be updated every 24 hours.