We introduce a suitable backward stochastic differential equation (BSDE) to represent the value of an optimal control problem with partial observation for a controlled stochastic equation driven by Brownian motion. Our model is general enough to include cases with latent factors in mathematical finance. By a standard reformulation based on the reference probability method, it also includes the classical model where the observation process is affected by a Brownian motion (even in presence of a correlated noise), a case where a BSDE representation of the value was not available so far. This approach based on BSDEs allows for greater generality beyond the Markovian case, in particular our model may include path-dependence in the coefficients (both with respect to the state and the control), and does not require any nondegeneracy condition on the controlled equation. We use a randomization method, previously adopted only for cases of full observation, and consisting in a first step, in replacing the control by an exogenous process independent of the driving noise and in formulating an auxiliary (“randomized”) control problem where optimization is performed over changes of equivalent probability measures affecting the characteristics of the exogenous process. Our first main result is to prove the equivalence between the original partially observed control problem and the randomized problem. In a second step, we prove that the latter can be associated by duality to a BSDE, which then characterizes the value of the original problem as well.

Bandini, E., Cosso, A., Fuhrman, M., Pham, H. (2018). Backward sdes for optimal control of partially observed path-dependent stochastic systems: A control randomization approach. THE ANNALS OF APPLIED PROBABILITY, 28(3), 1634-1678 [10.1214/17-AAP1340].

Backward sdes for optimal control of partially observed path-dependent stochastic systems: A control randomization approach

Bandini, E;
2018

Abstract

We introduce a suitable backward stochastic differential equation (BSDE) to represent the value of an optimal control problem with partial observation for a controlled stochastic equation driven by Brownian motion. Our model is general enough to include cases with latent factors in mathematical finance. By a standard reformulation based on the reference probability method, it also includes the classical model where the observation process is affected by a Brownian motion (even in presence of a correlated noise), a case where a BSDE representation of the value was not available so far. This approach based on BSDEs allows for greater generality beyond the Markovian case, in particular our model may include path-dependence in the coefficients (both with respect to the state and the control), and does not require any nondegeneracy condition on the controlled equation. We use a randomization method, previously adopted only for cases of full observation, and consisting in a first step, in replacing the control by an exogenous process independent of the driving noise and in formulating an auxiliary (“randomized”) control problem where optimization is performed over changes of equivalent probability measures affecting the characteristics of the exogenous process. Our first main result is to prove the equivalence between the original partially observed control problem and the randomized problem. In a second step, we prove that the latter can be associated by duality to a BSDE, which then characterizes the value of the original problem as well.
Articolo in rivista - Articolo scientifico
Stochastic optimal control with partial observation, backward SDEs, randomization of controls, path-dependent controlled SDEs
English
15-nov-2017
2018
28
3
1634
1678
reserved
Bandini, E., Cosso, A., Fuhrman, M., Pham, H. (2018). Backward sdes for optimal control of partially observed path-dependent stochastic systems: A control randomization approach. THE ANNALS OF APPLIED PROBABILITY, 28(3), 1634-1678 [10.1214/17-AAP1340].
File in questo prodotto:
File Dimensione Formato  
B--COSSO-FUHRMAN_PHAM_AAP.pdf

Solo gestori archivio

Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Dimensione 413.97 kB
Formato Adobe PDF
413.97 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
2018 B.-Cosso-Fuhrman_Pham_AAP.pdf

Solo gestori archivio

Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Dimensione 413.97 kB
Formato Adobe PDF
413.97 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/179967
Citazioni
  • Scopus 19
  • ???jsp.display-item.citation.isi??? 17
Social impact