Probability & Statistics · Normal distribution

Normal distribution

A normal distribution N(μ, σ²) has the bell-shaped density f(x) = exp(−(x − μ)²/(2σ²))/(σ√(2π)), centered at the mean μ, with standard deviation σ. Every normal curve is the standard curve N(0, 1) read on a different ruler: z = (x − μ)/σ turns a value into standard units, and the area between two values depends only on their z-scores.

The normal distribution in this visualization

A random variable XX with the normal distribution N(μ,σ2)N(\mu, \sigma^2) has a bell-shaped density: the mean μ\mu is at the peak and the standard deviation σ\sigma sets the width. The probability that XX falls between two values is the area under the curve between them. Here the curve stands over two rulers, xx for values and zz for standard units; you can move μ\mu and σ\sigma, cut the line at aa and bb, and choose which ruler stays fixed on the screen.

The density, and the standard units that turn every normal curve into one
f(x)=1σ2π e−(x−μ)2/(2σ2),z=x−μσf(x) = \frac{1}{\sigma\sqrt{2\pi}}\, e^{-(x-\mu)^2/(2\sigma^2)}, \qquad z = \frac{x-\mu}{\sigma}

Why is every normal curve the same curve? Fix the zz ruler and change μ\mu or σ\sigma: the curve on the screen stays still. Instead the xx ruler slides and stretches underneath it, and the numbers on the density scale change. The cuts are values of xx, so they ride along with that ruler, and the shaded area changes only when their places on the zz ruler change. Every normal distribution is the standard normal N(0,1)N(0, 1) read on another ruler, so P(a≤X≤b)=Φ(zb)−Φ(za)P(a \le X \le b) = \Phi(z_b) - \Phi(z_a), where Φ(z)\Phi(z) is the area to the left of zz under the standard curve.

Where is σ\sigma on the curve? At the bend points. On the ordinary scale the curve bends downward between μ−σ\mu - \sigma and μ+σ\mu + \sigma and upward outside them. At these two inflection points the tangent crosses the curve. Because the shape never changes, the area within kk standard deviations of the mean does not depend on μ\mu or σ\sigma: about 68.27% within one, 95.45% within two and 99.73% within three.

Why is a narrower curve taller? The whole area is always 1. Build it shows the two steps from the standard curve: moved to μ\mu and stretched sideways by σ\sigma, the curve encloses an area of σ\sigma; divided in height by σ\sigma, it encloses 1 again. So the peak is 1/(σ2π)1/(\sigma\sqrt{2\pi}), and halving σ\sigma doubles it. The height is a density, probability per unit of xx; only areas are probabilities.

How thin are the tails? On the ordinary scale the curve seems to meet the axis by about 3σ3\sigma, yet it never reaches zero. On the log scale log⁡f\log f is a quadratic in xx, so the curve becomes a downward parabola and the tails fall ever faster: beyond 3σ3\sigma on either side lies about 0.270% of the probability, beyond 4σ4\sigma about 1 in 15,800, beyond 6σ6\sigma about 1 in 507 million. On a log scale the area under the curve is no longer the probability, so the region is marked only on the xx ruler.

Things to notice

  • If the scores of two exams are both modeled as normal, turn on the second ruler to compare one score from each. Each score sits at its own zz, and the one further right stands higher within its own group.
  • The 68–95–99.7 rule belongs to the normal distribution. Other distributions can put quite different shares within kk standard deviations.

Controls

  • With the zz ruler fixed, drag the xx ruler itself to change μ\mu, or its σ\sigma tab to stretch it. Pulling the tab outward spreads the ruler out, which makes σ\sigma smaller.
  • Every draggable handle also moves with the arrow keys. A typed cut may lie outside the view, which then moves to show it.

Related