Institute of Information Theory and Automation

You are here

Bibliography

Conference Paper (international conference)

Minimum Expected Relative Entropy Principle

Kárný Miroslav

: Proceedings of the 18th European Control Conference (ECC), p. 35-40

: The European Control Conference (ECC 2020), (Saint Petersburg, RU, 20200512)

: LTC18075, GA MŠk, CA16228, The European Cooperation in Science and Technology (COST)

: minimum relative entropy principle, uncertain prior probability, forgetting, fully probabilistic design, abrupt parameter changes

: 10.23919/ECC51009.2020.9143856

: http://library.utia.cas.cz/separaty/2020/AS/karny-0525233.pdf

(eng): Stochastic filtering estimates a timevarying (multivariate) parameter (a hidden variable) from noisy observations. It needs both observation and parameter evolution models. The latter is often missing or makes the estimation too complex. Then, the axiomatic minimum relative entropy (MRE) principle completes the posterior probability density (pd) of the parameter. The MRE principle recommends to modify a prior guess of the constructed pd to the smallest extent enforced by new observations. The MRE principle does not deal with a generic uncertain prior guess. Such uncertainty arises, for instance, when the MRE principle is used recursively. The paper fills this gap. The proposed minimum expected relative entropy (MeRE) principle: (a) makes Bayesian estimation less sensitive to the choice of the prior pd. (b) provides a stabilised parameter tracking with a data-dependent forgetting that copes with abrupt parameter changes. (c) applies in all cases exploiting MRE, for instance, in stochastic modelling.

: BC

: 10201

2019-01-07 08:39