The previous article in this issue dealt with the general principles of Dynamic Programming. In this article Professor Lindley shows how Dynamic Programming links up with certain decision problems in ...

In this paper we develop a discretized version of the dynamic programming algorithm and study its convergence and stability properties. We show that the computed value function converges quadratically ...