Skip to main content


  • Yongyang Cai (a1), Kenneth L. Judd (a2), Thomas S. Lontzek (a3), Valentina Michelangeli (a4) and Che-Lin Su (a5)...

A nonlinear programming formulation is introduced to solve infinite-horizon dynamic programming problems. This extends the linear approach to dynamic programming by using ideas from approximation theory to approximate value functions. Our numerical results show that this nonlinear programming is efficient and accurate, and avoids inefficient discretization.

Corresponding author
Address correspondence to: Yongyang Cai, Hoover Institution, Stanford, CA 94305, USA; e-mail:
Hide All
Cai, Judd, Lontzek, and Michelangeli note with great sadness the passing of Che-Lin Su this past July. We thank him for his contributions. We are grateful to the editors and anonymous reviewers for their insightful comments and suggestions. We particularly thank Philipp Renner for his many helpful comments. Cai and Judd gratefully acknowledge NSF support (SES-0951576). The views expressed herein are those of the authors and do not necessarily reflect the views of the Bank of Italy.
Hide All
Bellman, R. (1957) Dynamic Programming. Princeton, NJ: Princeton University Press.
Blackwell, D. (1965) Discounted dynamic programming. Annals of Mathematical Statistics 36 (1), 226235.
Bojanic, R. and Cheng, F. (1989) Rate of convergence of Bernstein polynomials for functions with derivatives of bounded variation. Journal of Mathematical Analysis and Applications 141, 136151.
Cai, Y. (2010) Dynamic Programming and Its Application in Economics and Finance. Ph.D. thesis, Stanford University.
Cai, Y. and Judd, K.L. (2010) Stable and efficient computational methods for dynamic programming. Journal of the European Economic Association 8 (2–3), 626634.
Cai, Y. and Judd, K.L. (2012) Dynamic programming with shape-preserving rational spline Hermite interpolation. Economics Letters 117 (1), 161164.
Cai, Y. and Judd, K.L. (2013) Shape-preserving dynamic programming. Mathematical Methods of Operations Research 77 (3), 407421.
Cai, Y. and Judd, K.L. (2014) Advances in numerical dynamic programming and new applications. In Schmedders, Karl and Judd, Kenneth L. (eds.), Handbook of Computational Economics, Vol. 3, Chap. 8. Elsevier.
Cai, Y. and Judd, K.L. (2015) Dynamic programming with Hermite approximation. Mathematical Methods of Operations Research 81, 245267.
Carnicer, J.M. and Pena, J.M. (1993) Shape preserving representations and optimality of the Bernstein basis. Advances in Computational Mathematics 1 173196.
De Farias, D.P. and Van Roy, B. (2003) The linear programming approach to approximate dynamic programming. Operations Research 51 (6), 850865.
Den Haan, W.J., Judd, K.L., and Juillard, M. (2011) Computational suite of models with heterogeneous agents: II. Multi-country real business cycle models. Journal of Economic Dynamics and Control 35, 175177.
Farouki, R.T. (2012) The Bernstein polynomial basis: A centennial retrospective. Computer Aided Geometric Design 29, 379419.
Goodman, T.N.T. (1989) Shape preserving representations. In Lyche, T. and Schumaker, L.L. (eds.), Mathematical Methods in Computer Aided Geometric Design, pp. 333351. Boston: Academic Press.
Judd, K.L. (1998) Numerical Methods in Economics. Cambridge, MA: MIT Press.
Juillard, M. and Villemot, S. (2011) Multi-country real business cycle models: Accuracy tests and test bench. Journal of Economic Dynamics and Control 35, 178185.
Maliar, L. and Maliar, S. (2004) Endogenous growth and endogenous business cycles. Macroeconomic Dynamics 8 (5), 559581.
McCarl, B., Meeraus, A., van der Eijk, P., Bussieck, M., Dirkse, S., Steacy, P., and Nelissen, F. (2015) McCarl GAMS User Guide. GAMS Development Corporation.
Michelangeli, V. (2009) Economics of the Life-Cycle: Reverse Mortgage, Mortgage and Marriage. Ph.D. thesis, Boston University.
Polak, E. (1997) Optimization: Algorithms and Consistent Approximations. New York: Springer.
Rust, J. (1996) Numerical dynamic programming in economics. In Amman, H., Kendrick, D., and Rust, J. (eds.), Handbook of Computational Economics, Vol. 1, Chap. 14. Elsevier North Holland.
Rust, J. (2008) Dynamic programming. In Durlauf, S.N. and Blume, L.E. (eds.), New Palgrave Dictionary of Economics, 2nd ed. Palgrave Macmillan.
Su, C.H. and Judd, K.L. (2012) Constrained optimization approaches to estimation of structural models. Econometrica 80 (5), 22132230.
Trick, M.A. and Zin, S.E. (1997) Spline approximations to value functions—Linear programming approach. Macroeconomic Dynamics 1, 255277.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Macroeconomic Dynamics
  • ISSN: 1365-1005
  • EISSN: 1469-8056
  • URL: /core/journals/macroeconomic-dynamics
Please enter your name
Please enter a valid email address
Who would you like to send this to? *



Full text views

Total number of HTML views: 0
Total number of PDF views: 93 *
Loading metrics...

Abstract views

Total abstract views: 446 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 20th March 2018. This data will be updated every 24 hours.