Adaptive control of stochastic systems with unknown noise distribution--Discounted reward criterion

We consider discrete-time stochastic control systems in which the disturbance process is a sequence of i.i.d. random elements with unknown distribution. We introduce three asymptotically optimal adaptive policies and for each of them we obtain almost surely uniform approximations.