Weak Law of Large Numbers The Weak Law of Large Numbers states that the distribution of sample means approaches the distribution of population means in the l...
The Weak Law of Large Numbers states that the distribution of sample means approaches the distribution of population means in the long run, regardless of the underlying probability distribution.
Intuitively: Imagine flipping a coin many times. On average, the number of heads and tails will be equal, but the distribution of these numbers can be skewed. Even though the sample mean (average number of heads or tails) will fluctuate around the population mean, its distribution will converge to the same shape as the population distribution in the long run.
Formally: The Weak Law of Large Numbers can be expressed mathematically as:
lim_{n->ā} P(|E(X) - E(Y)| \le \epsilon) = 1,
where:
E(X) and E(Y) are the population means.
n is the size of the sample.
epsilon is an arbitrary positive number.
Interpretation:
The left-hand side of the equation represents the probability that the difference between the sample mean and the population mean is less than epsilon.
The right-hand side approaches 1 as n increases, meaning the probability of observing such a large difference goes to 0 as n grows infinitely large.
This means that the distribution of sample means approaches the distribution of population means regardless of the underlying probability distribution.
Examples:
Suppose you flip a coin 100 times and observe the number of heads. The expected number of heads would be 50, but the distribution of the number of heads can be skewed.
Suppose you have a coin that is slightly biased, meaning it always lands on heads. If you flip this coin 100 times and calculate the sample mean, it is likely to be closer to 50 than if you flipped it 1000 times.
Imagine rolling a die 1000 times. The expected number of dots on the face would be 3.5, but the distribution of the number of dots can be skewed, with some rolls having many dots and others having very few.
The Weak Law of Large Numbers has important implications in probability and statistics. It suggests that, even if the underlying probability distribution is unknown, we can still make accurate inferences about population parameters by taking large samples. This is the foundation of the Central Limit Theorem (CLT), which provides a more powerful and accurate approximation than the Weak Law of Large Numbers