Understanding Z-Scores & Standard Normal Distribution
A Z-score (standard score) measures exactly how many standard deviations an individual observation ($x$) lies above or below the population mean ($\mu$).
1. The Fundamental Z-Score Formula
Z = (x - μ) / σ
- Positive Z-score: The observation is above the average.
- Z = 0: The observation equals the population mean.
- Negative Z-score: The observation is below the average.
2. The 68-95-99.7 Empirical Rule
In any bell-shaped normal distribution curve:
- 68.27% of data points fall within 1 standard deviation ($|Z| \le 1$).
- 95.45% of data points fall within 2 standard deviations ($|Z| \le 2$).
- 99.73% of data points fall within 3 standard deviations ($|Z| \le 3$).
- Observations with $|Z| > 3$ are typically categorized as statistically significant outliers.