Volume 25, 2019
|Number of page(s)||30|
|Published online||09 August 2019|
Backward SDEs and infinite horizon stochastic optimal control★
Politecnico di Milano, Dipartimento di Matematica,
via Bonardi 9,
2 Università di Bologna, Dipartimento di Matematica, piazza di Porta S. Donato 5, 40126 Bologna, Italy
3 Università di Milano, Dipartimento di Matematica, via Saldini 50, 20133 Milano, Italy
** Corresponding author: firstname.lastname@example.org
Accepted: 21 March 2018
We study an optimal control problem on infinite horizon for a controlled stochastic differential equation driven by Brownian motion, with a discounted reward functional. The equation may have memory or delay effects in the coefficients, both with respect to state and control, and the noise can be degenerate. We prove that the value, i.e. the supremum of the reward functional over all admissible controls, can be represented by the solution of an associated backward stochastic differential equation (BSDE) driven by the Brownian motion and an auxiliary independent Poisson process and having a sign constraint on jumps.
In the Markovian case when the coefficients depend only on the present values of the state and the control, we prove that the BSDE can be used to construct the solution, in the sense of viscosity theory, to the corresponding Hamilton-Jacobi-Bellman partial differential equation of elliptic type on the whole space, so that it provides us with a Feynman-Kac representation in this fully nonlinear context.
The method of proof consists in showing that the value of the original problem is the same as the value of an auxiliary optimal control problem (called randomized), where the control process is replaced by a fixed pure jump process and maximization is taken over a class of absolutely continuous changes of measures which affect the stochastic intensity of the jump process but leave the law of the driving Brownian motion unchanged.
Mathematics Subject Classification: 60H10 / 93E20
Key words: Stochastic optimal control / backward SDEs / randomization of controls
© EDP Sciences, SMAI 2019
Current usage metrics show cumulative count of Article Views (full-text article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.
Data correspond to usage on the plateform after 2015. The current usage metrics is available 48-96 hours after online publication and is updated daily on week days.
Initial download of the metrics may take a while.