Institute of Information Theory and Automation

You are here

Bibliography

Journal Article

Identification of Optimal Policies in Markov Decision Processes

Sladký Karel

: Kybernetika, 3 (2010), p. 558-570

: International Conference on Mathematical Methods in Economy and Industry, (České Budějovice, CZ, 15.06.2009-18.06.2009)

: CEZ:AV0Z10750506

: GA402/08/0107, GA ČR, GA402/07/1113, GA ČR

: finite state Markov decision processes, discounted and average costs, elimination of suboptimal policies

: http://library.utia.cas.cz/separaty/2010/E/sladky-identification of optimal policies in markov decision processes.pdf

(eng): In this note we focus attention on identifying optimal policies and on elimination suboptimal policies minimizing optimality criteria in discrete-time Markov decision processes with finite state space and compact action set. We present unified approach to value iteration algorithms that enables to generate lower and upper bounds on optimal values, as well as on the current policy. Using the modified value iterations it is possible to eliminate suboptimal actions and to identify an optimal policy or nearly optimal policies in a finite number of steps without knowing precise values of the performance function.

: BB

2019-01-07 08:39