- #1
Zoe-b
- 98
- 0
Homework Statement
Let X1, . . . ,Xn be a message from a memoryless source, where Xi are in A. Show
that, as n →∞, the proportion of messages in the typical set converges to zero,
unless Xi is uniform on A.
Homework Equations
The Attempt at a Solution
Confused, possibly because I'm reading the question wrong.
Let B be a 'typical set' (proper subset of A), with P(Xi in B) = p
Then as far as I can tell, if Yn is the number of messages in B up to Xn, Yn has a Binomial (n,p) distribution and so the proportion of messages in B tends to p not to zero! But I'm not using how the actual 'letters' are distributed at all here, or the respective sizes of the sets A, B. Any hints?