Institute of Information Theory and Automation

You are here

Bibliography

Conference Paper (international conference)

Urns and entropies revisited

Matúš František

: Proceedings of the ISIT 2017 - 2017 IEEE International Symposium on Information Theory, p. 1451-1454

: IEEE International Symposium on Information Theory 2017 (ISIT 2017), (Aachen, DE, 20170625)

: GA16-12010S, GA ČR

: urn, entropy, bounds

: 10.1109/ISIT.2017.8006769

: http://library.utia.cas.cz/separaty/2017/MTR/matus-0475977.pdf

(eng): An urn containing colored balls is sampled sequentially without replacement. New lower and upper bounds on the conditional and unconditional mutual information, and multi information are presented. They estimate dependence between drawings in terms of the colored ball configuration. Asymptotics are worked out when the number of balls increases and the proportion of the balls of each color stabilizes. Inequalities by Stam and by Diaconis and Freedman are compared and improved. Distances between the sampling with and without replacement, and between the multinomial and multivariate hypergeometric distributions are discussed.

: BA

: 10101

2019-01-07 08:39