Hostname: page-component-848d4c4894-75dct Total loading time: 0 Render date: 2024-05-01T07:47:57.244Z Has data issue: false hasContentIssue false
  • English
  • Français

Stationary control of Brownian motion in several dimensions

Published online by Cambridge University Press:  01 July 2016

R. Mitchell Cox  and
Ioannis Karatzas
R. Mitchell Cox*
Affiliation:
Columbia University
Ioannis Karatzas*
Affiliation:
Columbia University
*
∗Postal address: Department of Mathematical Statistics, Columbia University, New York, NY 10027, USA.
∗Postal address: Department of Mathematical Statistics, Columbia University, New York, NY 10027, USA.
Get access Rights & Permissions [Opens in a new window]

Abstract

We address the question of controlling the Brownian path in several dimensions (d≧2) by continually choosing its drift from among vectors of the unit ball in ℝd. The past and present of the path are supposed to be completely observable, while no anticipation of the future is allowed. Imposing a suitable cost on distance from the origin, as well as a cost of effort proportional to the length of the drift vector, ‘reasonable’ procedures turn out to be of the following type: to apply drift of maximal length along the ray towards the origin if the current position is outside a sphere centred at the origin, and to choose zero drift otherwise. It is shown just how to compute the radius of such a sphere in terms of the data of the problem, so that the resulting procedure is optimal.

Keywords

STOCHASTIC CONTROLERGODIC PROPERTY OF DIFFUSIONSBESSEL PROCESS WITH DRIFTBELLMAN EQUATIONMAXIMUM PRINCIPLECOMPARISON THEOREMS
Type
Research Article
Information
Advances in Applied Probability , Volume 17 , Issue 3 , September 1985 , pp. 531 - 561
Copyright
Copyright © Applied Probability Trust 1985 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

Research supported in part by the National Science Foundation under grant NSF MCS-81-03435-A01.

Paper presented at the 3rd Bad Honnef Workshop on Stochastic Differential Systems, University of Bonn, FRG, 3–7 June 1985.

References

1. Bather, J. A. (1966) A continuous-time inventory model. J. Appl. Prob. 3, 538–549.CrossRefGoogle Scholar
2. Bather, J. A. (1968) A diffusion model for the control of a dam. J. Appl. Prob. 5, 57–71.CrossRefGoogle Scholar
3. Benes, V. E. (1975) Composition and invariance methods for solving some stochastic control problems. Adv. Appl. Prob. 7, 299–329.CrossRefGoogle Scholar
4. Benes, V. E. (1971) Existence of optimal stochastic control laws. SIAM J. Control 9, 446–472.CrossRefGoogle Scholar
5. Benes, V. E. and Karatzas, I. (1981) Optimal stationary linear control of the Wiener process. J. Optim. Theory Appl. 35, 611–633.CrossRefGoogle Scholar
6. Bhattacharya, R. N. (1978) Criteria for recurrence and existence of invariant measures for multidimensional diffusions. Ann. Prob. 6, 541–553.CrossRefGoogle Scholar
7. Bhattacharya, R. N. and Ramasubramanian, S. (1982) Recurrence and ergodicity of diffusions. J. Multivariate Anal. 12, 95–122.CrossRefGoogle Scholar
8. Chernoff, H. and Petkau, A. J. (1978) Optimal control of a Brownian motion. SIAM J. Appl. Math. 34, 717–731.CrossRefGoogle Scholar
9. Fleming, W. H. and Rishel, R. W. (1975) Deterministic and Stochastic Optimal Control. Springer-Verlag, Berlin.CrossRefGoogle Scholar
10. Friedman, A. (1964) Partial Differential Equations of Parabolic Type. Prentice Hall, Englewood Cliffs, NJ.Google Scholar
11. Girsanov, I. V. (1960) On transforming a certain class of stochastic processes by absolutely continuous substitution of measures. Theory Prob. Appl. 5, 285–301.CrossRefGoogle Scholar
12. Ikeda, N. and Watanabe, S. (1977) A comparison theorem for solutions of stochastic differential equations and its applications. Osaka J. Math. 14, 619–633.Google Scholar
13. Karlin, S. and Taylor, H. M. (1975) A First Course in Stochastic Processes. Academic Press, New York.Google Scholar
14. Khas’Minskii, R. Z. (1960) Ergodic properties of recurrent diffusion processes and stabilization of the solution to the Cauchy problem for parabolic equations. Theory Prob. Appl. 5, 179–196.CrossRefGoogle Scholar
15. Ladyženskaja, O. A., Solonnikov, A. V. and Ural’Ceva, N. N. (1968) Linear and Quasilinear Equations of Parabolic Type. Translations of Mathematical Monographs 23, American Mathematical Society, Providence, R.I. CrossRefGoogle Scholar
16. Maruyama, G. and Tanaka, H. (1957) Some properties of one-dimensional diffusion processes. Mem. Fac. Science, Kyushu Univ. A 11, 117–141.Google Scholar
17. Mckean, H. P. Jr. (1969) Stochastic Integrals. Academic Press, New York.Google Scholar
18. Tanaka, H. (1957) On limiting distributions for one-dimensional diffusion processes. Bull. Math, Statist., Kyushu Univ. 7, 84–91.CrossRefGoogle Scholar
19. Veretennikov, A. Y. (1981) On strong solutions and explicit formulas for solutions of stochastic differential equations. Math. USSR (Sbornik) 39, 387–403.CrossRefGoogle Scholar
20. Wonham, W. M. (1967) Optimal stationary control of a linear system with statedependent noise. SIAM J. Control 3, 486–500.CrossRefGoogle Scholar