Title | An optimal Markovian quantization algorithm for multidimensional stochastic control problems |
Publication Type | Journal Article |
Year of Publication | 2004 |
Authors | Gilles Pagès, Huyên Pham, and Jacques Printems |
Journal | Stochastics and Dynamics |
Volume | 4(4) |
Pagination | 501-545 |
Keywords | Euler scheme, Markov chain, mean-variance hedging, Stochastic control, stochastic gradient descent, vector quantization |
Abstract | We propose a probabilistic numerical method based on optimal quantization to solve some multi-dimensional stochastic control problems that arise, for example, in mathematical finance for portfolio optimization. We then consider some controlled diffusions with most components control free. The Euler scheme of the uncontrolled diffusion part is approximated by a discrete time process obtained by a nearest neighbor projection on some grids optimally fitted to its dynamics. The resulting process is also designed to preserve the Markov property with respect to the filtration of the Euler scheme. This Markovian quantization approach leads to an approximate control problem that can be solved numerically by the dynamic programming formula. This approach seems promising in higher dimension. A priori Lp-error bounds are stated and we show that the spatial discretization error term is minimal at some specific grids. A simple recursive algorithm is devised to compute these optimal grids by induction based on a Monte Carlo simulation. Some numerical illustrations are processed for solving a mean-variance hedging problem. |