Basic Statistical Concepts

One of the first things taught in introductory statistics textbooks is that correlation is not causation. It is also one of the first things forgotten.

Thomas Sowell

The thing about statistical concepts is that beyond a point of learning where you have learned and codified all knowledge with understanding, there is a need to maintain a compendium. Thereby, it’s a good way to remember all the tools available and not just the hammers (read Deep Learning). The source code is in the Title itself.

Central Limit Theorem

The central limit theorem states that if you sample a sufficient number of samples from a distribution, albeit any kind of distribution and take their means. This process when repeated over multiple iterations, the mean value will follow a normal distribution.

The below histogram shows means from a normal distribution

Histogram of Sample Mean

The below histogram shows the mean values generated from a Poisson Distribution with the same mean as an above-normal distribution. A Poisson Distribution has the same standard deviation as the mean value.

Statistics Poisson Distribution

The question then becomes, what’s the significance of knowing the Central Limit Theorem?

Different Movements

  • Kurtosis
  • Skewness
  • Mean

And so on

To be continued …

Classical Machine Learning