Curvingo · Made in India

Glossary

Select one of the keywords on the left…

StatisticsIntroduction

Reading time: ~15 min

"Statistics may be rightly called the science of averages and their estimates." — A.L. Bowley and A.L. Boddington

The inter-school final is on Saturday and Coach Mehra has one batting place left. Two batsmen want it, and on paper they are tied: over their last ten matches, both averaged exactly 53 runs.

The coach does not trust a single number. Before he decides, he wants to see all twenty scores.

Play the season. Each tap plays one match and drops both scores onto the number lines — batsman A on the top line, batsman B on the bottom one. The purple marks show each batsman's mean so far.

Fig. 13.1 (top) and Fig. 13.2 (bottom) — the runs scored by batsmen A and B in their last ten matches.

Both purple marks finish at 53, so the means really are equal. But the blue dots tell two very different stories.

The final needs a steady 50 from the number 3 batsman. Whom should the coach pick?

Batsman A
Batsman B

Batsman B. All ten of his scores lie between 46 and 60, so about 50 runs is what he delivers almost every time. Batsman A swings from a duck to 117. Same average, very different players — and the average on its own could not tell them apart.

Here are the twenty scores as numbers.

Batsman A: 30, 91, 0, 64, 42, 80, 30, 5, 117, 71

Batsman B: 53, 46, 48, 50, 53, 53, 58, 60, 57, 52

Recall that the mean \bar{x} of n observations is their sum divided by n:

\bar{x} = \dfrac{1}{n}\sum_{i=1}^{n} x_i

Batsman A's ten scores add up to 530, so his mean is runs. Batsman B's scores also add up to 530.

For the median, first arrange the observations in ascending (or descending) order. If the number of observations n is odd, the median is the \left(\dfrac{n+1}{2}\right)^{\text{th}} observation. If n is even, it is the mean of the \left(\dfrac{n}{2}\right)^{\text{th}} and the \left(\dfrac{n}{2} + 1\right)^{\text{th}} observations.

Here n = 10 is even, so the median is the mean of the observations. In order, batsman A's scores are 0, 5, 30, 30, 42, 64, 71, 80, 91, 117, so his median is \dfrac{42 + 64}{2} = . Batsman B's are 46, 48, 50, 52, 53, 53, 53, 57, 58, 60, and his median is \dfrac{53 + 53}{2} = 53.

So both measures of central tendency agree completely:

Batsman ABatsman B
Mean5353
Median5353

Yet the two performances are clearly not the same. Batsman A's scores vary from 0 (the minimum) to 117 (the maximum); batsman B's stay between 46 and 60. In Fig. 13.1 the dots are scattered right across the line, while in Fig. 13.2 they cluster tightly around 53.

A measure of central tendency tells us roughly where the data is centred. It says nothing about how the data is scattered around that centre — and that variability matters just as much. Like the mean or the median, we would like a single number for it. Such a number is called a measure of dispersion. In this chapter you will learn the important measures of dispersion and how to calculate them for ungrouped and grouped data.

Spread is everywhere once you look for it. A factory keeps the spread of its bolt sizes tiny so that every bolt fits its nut; two classes with the same average marks can still have very different weakest and strongest students. Whenever someone asks how reliable or how consistent something is, they are asking about dispersion.

Older Than You Think

The word statistics comes from the Latin status, a political state: for most of history, statistics meant the numbers a ruler kept about the people and the land. Perhaps the first census was held in Egypt around 3050 B.C. In India, about 2000 years ago, the empire of Chandragupta Maurya (324–300 B.C.) ran an efficient system of administrative records, and Kautilya's Arthashastra (around 300 B.C.) describes the recording of births and deaths. Much later, Abul Fazl's Ain-i-Akbari gave a detailed account of the surveys carried out under Akbar.

The mathematics came later. Captain John Graunt of London (1620–1674) studied the records of births and deaths so carefully that he is called the father of vital statistics. Jacob Bernoulli (1654–1705) stated the Law of Large Numbers in Ars Conjectandi, published in 1713, and the theory of games and chance — probability — grew alongside. Francis Galton used statistical methods in biometry; Karl Pearson (1857–1936) introduced the chi-square test and founded a statistical laboratory in England in 1911; and Sir Ronald A. Fisher (1890–1962), the father of modern statistics, applied it to genetics, biometry, education and agriculture.

Drag these milestones into the order in which they happened, earliest at the top.

John Graunt studies the records of births and deaths in London
Perhaps the first census is held in Egypt
Karl Pearson founds a statistical laboratory in England
Abul Fazl's Ain-i-Akbari describes the surveys of Akbar's empire
Jacob Bernoulli's Law of Large Numbers is published
Kautilya's Arthashastra describes the recording of births and deaths

Five thousand years of counting people, and the coach's question is still the one that matters: not just what is typical, but how far things stray from it.

Sina