An optimal Markovian quantization algorithm for multidimensional stochastic control problems

TitleAn optimal Markovian quantization algorithm for multidimensional stochastic control problems
Publication TypeJournal Article
Year of Publication2004
AuthorsGilles Pagès, Huyên Pham, and Jacques Printems
JournalStochastics and Dynamics
Volume4(4)
Pagination501-545
KeywordsEuler scheme, Markov chain, mean-variance hedging, Stochastic control, stochastic gradient descent, vector quantization
Abstract

We propose a probabilistic numerical method based on optimal quantization to solve some multi-dimensional stochastic control problems that arise, for example, in mathematical finance for portfolio optimization. We then consider some controlled diffusions with most components control free. The Euler scheme of the uncontrolled diffusion part is approximated by a discrete time process obtained by a nearest neighbor projection on some grids optimally fitted to its dynamics. The resulting process is also designed to preserve the Markov property with respect to the filtration of the Euler scheme. This Markovian quantization approach leads to an approximate control problem that can be solved numerically by the dynamic programming formula. This approach seems promising in higher dimension. A priori Lp-error bounds are stated and we show that the spatial discretization error term is minimal at some specific grids. A simple recursive algorithm is devised to compute these optimal grids by induction based on a Monte Carlo simulation. Some numerical illustrations are processed for solving a mean-variance hedging problem.