Institute of Information Theory and Automation

You are here

Bibliography

Conference Paper (international conference)

Calculating the variance in Markov reward chains with a small interest rate

Sitař Milan, Sladký Karel

: Quantitative Methods in Economics. (Multiple Criteria Decision Making 11), p. 230-236 , Eds: Magáthová V.

: Slovak Agricultural University, (Nitra 2002)

: Quantitative Methods in Economics /11./, (Nitra, SK, 05.12.2002-06.12.2002)

: CEZ:AV0Z1075907

: GA402/02/1015, GA ČR, GA402/01/0539, GA ČR

: Markov reward processes, reward variance, small interest rate

(eng): We consider a discrete time Markov reward process with finite state space and assume that the rewards associated with the transitions are random variables with known probability distributions. Formulas for expected value and variance of the cumulative (random) reward are obtained for finite horizon case and infinite horizon models with discounting. Employing the Laurent expansion techniques we obtain explicit formulas for the variance of the long run discounted reward in the terms of undiscounted models.

: 12B

: BB

2019-01-07 08:39