We consider an optimal control problem for piecewise deterministic Markov processes (PDMPs) on a bounded state space. A pair of controls acts continuously on the deterministic fow and on the two transition measures (in the interior and from the boundary of the domain) describing the jump dynamics of the process. For this class of control problems, the value function can be characterized as the unique viscosity solution to the corresponding fully nonlinear Hamilton-Jacobi-Bellman equation with a nonlocal type boundary condition. By means of the recent control randomization method, we are able to provide a probabilistic representation for the value function in terms of a constrained backward stochastic diferential equation (BSDE), known as the nonlinear Feynman-Kac formula. This result considerably extends the existing literature, where only the case with no jumps from the boundary is considered. The additional boundary jump mechanism is described in terms of a non-quasi-left-continuous random measure and induces predictable jumps in the PDMP's dynamics. The existence and uniqueness results for BSDEs driven by such a random measure are nontrivial, even in the unconstrained case, as emphasized in the recent work [E. Bandini, Electron. Commun. Probab., 20 (2015), pp. 1-13].

Bandini, E. (2019). Constrained BSDEs driven by a non-quasi-left-continuous random measure and optimal control of PDMPs on bounded domains. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 57(6), 3767-3798 [10.1137/18M1171205].

Constrained BSDEs driven by a non-quasi-left-continuous random measure and optimal control of PDMPs on bounded domains

Bandini, E
2019

Abstract

We consider an optimal control problem for piecewise deterministic Markov processes (PDMPs) on a bounded state space. A pair of controls acts continuously on the deterministic fow and on the two transition measures (in the interior and from the boundary of the domain) describing the jump dynamics of the process. For this class of control problems, the value function can be characterized as the unique viscosity solution to the corresponding fully nonlinear Hamilton-Jacobi-Bellman equation with a nonlocal type boundary condition. By means of the recent control randomization method, we are able to provide a probabilistic representation for the value function in terms of a constrained backward stochastic diferential equation (BSDE), known as the nonlinear Feynman-Kac formula. This result considerably extends the existing literature, where only the case with no jumps from the boundary is considered. The additional boundary jump mechanism is described in terms of a non-quasi-left-continuous random measure and induces predictable jumps in the PDMP's dynamics. The existence and uniqueness results for BSDEs driven by such a random measure are nontrivial, even in the unconstrained case, as emphasized in the recent work [E. Bandini, Electron. Commun. Probab., 20 (2015), pp. 1-13].
Articolo in rivista - Articolo scientifico
Backward stochastic diferential equations; Non-quasi-left-continuous random measure; Optimal control problems; Piecewise deterministic Markov processes; Randomization of controls;
Mathematics - Optimization and Control; Mathematics - Optimization and Control
English
19-nov-2019
2019
57
6
3767
3798
partially_open
Bandini, E. (2019). Constrained BSDEs driven by a non-quasi-left-continuous random measure and optimal control of PDMPs on bounded domains. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 57(6), 3767-3798 [10.1137/18M1171205].
File in questo prodotto:
File Dimensione Formato  
PDMPSICON_accepted.pdf

accesso aperto

Tipologia di allegato: Submitted Version (Pre-print)
Dimensione 508.62 kB
Formato Adobe PDF
508.62 kB Adobe PDF Visualizza/Apri
2019 B.-SICON.pdf

Solo gestori archivio

Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Dimensione 636.96 kB
Formato Adobe PDF
636.96 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/180315
Citazioni
  • Scopus 5
  • ???jsp.display-item.citation.isi??? 2
Social impact