Skip to main content
×
Home
    • Aa
    • Aa

A deterministic affine-quadratic optimal control problem

  • Yuanchang Wang (a1) (a2) and Jiongmin Yong (a2)
Abstract

A deterministic affine-quadratic optimal control problem is considered. Due to the nature of the problem, optimal controls exist under some very mild conditions. Further, it is shown that under some assumptions, the optimal control is unique which leads to the differentiability of the value function. Therefore, the value function satisfies the corresponding Hamilton–Jacobi–Bellman equation in the classical sense, and the optimal control admits a state feedback representation. Under some additional conditions, it is shown that the value function is actually twice differentiable and the so-called quasi-Riccati equation is derived, whose solution can be used to construct the state feedback representation for the optimal control.

A deterministic affine-quadratic optimal control problem is considered. Due to the nature of the problem, optimal controls exist under some very mild conditions. Further, it is shown that under some assumptions, the optimal control is unique which leads to the differentiability of the value function. Therefore, the value function satisfies the corresponding Hamilton–Jacobi–Bellman equation in the classical sense, and the optimal control admits a state feedback representation. Under some additional conditions, it is shown that the value function is actually twice differentiable and the so-called quasi-Riccati equation is derived, whose solution can be used to construct the state feedback representation for the optimal control.

Copyright
Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

H.T. Banks , B.M. Lewis and H.T. Tran , Nonlinear feedback controllers and compensators: a state-dependent Riccati equation approach. Comput. Optim. Appl. 37 (2007) 177218.

M. Bardi and F. DaLio , On the Bellman equation for some unbounded control problems. Nonlinear Differ. Eqs. Appl. 4 (1997) 491510.

L.M. Benveniste and J.A. Scheinkman , On the differentiability of the value function in dynamic models of economics. Econometrica 47 (1979) 727732.

P. Cannarsa and H. Frankowska , Some characterizatins of optimal trajecotries in control theory. SIAM J. Control Optim. 29 (1991) 13221347.

T. Hildebrandt and L. Graves , Implicit functions and their differentials in general analysis. Trans. Amer. Math. Soc. 29 (1927) 127153.

Y. Hu and S. Peng , Solution of forward-backward stochastic differential equations. Probab. Theory Rel. Fields 103 (1995) 273283.

H. Qiu and J. Yong , Hamilton-Jacobi equations and two-person zero-sum differential games with unbounded controls. ESAIM: COCV 19 (2013) 404437.

J.P. Rincón-Zapatero and M.S. Santos , Differentiability of the value function in continuous-time economic models. J. Math. Anal. Appl. 394 (2012) 305323.

J. Yong , Finding adapted solutions of forward-backward stochastic differential equations – method of continuation, Probab. Theory Rel. Fields 107 (1997) 537572.

J. Yong , Forward backward stochastic differential equations with mixed initial and terminal conditions. Trans. AMS 362 (2010) 10471096.

Y. You , Synthesis of time-variant optimal control with nonquadratic criteria. J. Math. Anal. Appl. 209 (1997) 662682.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

ESAIM: Control, Optimisation and Calculus of Variations
  • ISSN: 1292-8119
  • EISSN: 1262-3377
  • URL: /core/journals/esaim-control-optimisation-and-calculus-of-variations
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Keywords:

Metrics

Abstract views

Total abstract views: 26 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 22nd September 2017. This data will be updated every 24 hours.