Abstract
Our goal is to solve certain dynamic programming equations associated to a given Markov chain X, using a regression-based Monte Carlo algorithm. More specifically, we assume that the model for X is not known in full detail and only a root sample X1, . . ., XM of such process is available. By a stratification of the space and a suitable choice of a probability measure ν, we design a new resampling scheme that allows us to compute local regressions (on basis functions) in each stratum. The combination of the stratification and the resampling allows us to compute the solution to the dynamic programming equation (possibly in large dimensions) using only a relatively small set of root paths. To assess the accuracy of the algorithm, we establish nonasymptotic error estimates in L2(ν). Our numerical experiments illustrate the good performance, even with M = 20 − 40 root paths.
Original language | British English |
---|---|
Pages (from-to) | 50-77 |
Number of pages | 28 |
Journal | SIAM Journal on Numerical Analysis |
Volume | 56 |
Issue number | 1 |
DOIs | |
State | Published - 2018 |
Keywords
- Discrete dynamic programming equations
- Empirical regression scheme
- Resampling methods
- Small-size sample