11.1.3. Important Moments

1st Mean 𝜇 = 𝐸[𝑋] Measures the central tendency

The first moment, also known as the mean, is calculated as the expected value of a random variable X. This means that the mean gives us a single representative value that summarizes the central location of a probability distribution. In essence, it tells us where the 'center' of the data lies. If we have a set of values, the mean helps us understand what an average value would be.

Imagine you are trying to find the average score of students in a class on a test. If one student scores 70, another 80, and another 90, the average or mean score helps you find a single representative number that describes the general performance of the class. In this case, the mean would be (70 + 80 + 90) / 3 = 80. This gives you a quick understanding of how the students performed overall.

2nd Variance 𝜎² = 𝐸[(𝑋− 𝜇)²] Measures spread or dispersion

The second moment, known as the variance, quantifies the spread or dispersion of a random variable around its mean. It is calculated as the expected value of the squared deviations from the mean (𝜇). Essentially, variance gives us an idea of how much the values in a dataset deviate from the average. A higher variance indicates that the values are spread out more widely, while a lower variance indicates they are closer to the mean.

Consider again the students' test scores from earlier. If one student scored 70, another 80, and another 90, the variance would be relatively low because the scores are close together. However, if one student scored 50, one scored 80, and another scored 90, the variance would be higher because the scores are more dispersed. Variance helps teachers understand how consistent or varied the students' performances are.

3rd Skewness 𝜎³ Measures asymmetry of distribution

The third moment, known as skewness, measures the asymmetry of a probability distribution. A distribution can be symmetrical, positively skewed, or negatively skewed. If skewness is zero, the distribution is symmetrical. If skewness is positive, it indicates that there is a longer tail on the right side, while negative skewness indicates a longer tail on the left side. Understanding skewness helps us identify potential biases in the data.

Imagine a class where most students score very high, but a few students score very low. This situation creates a distribution that is positively skewed—most of the data is on one side, with a tail stretching out in the opposite direction. Conversely, if most students score low with a few very high scores, the distribution is negatively skewed. Understanding these tendencies is useful in interpreting results.

4th Kurtosis Measures peakedness or flatness

The fourth moment, known as kurtosis, measures the 'tailedness' or peak of the distribution. High kurtosis indicates that the distribution has heavy tails and a sharp peak compared to a normal distribution, while low kurtosis indicates light tails and a flatter peak. Essentially, kurtosis tells us about the probability of extreme values (outliers) occurring in the dataset.

Think of kurtosis as comparing different types of mountains. A mountain with a sharp peak and steep sides represents a distribution with high kurtosis, indicating that most of the data is concentrated at the mean but there are significant outliers (very high or very low values). In contrast, a broad, flat hill represents low kurtosis, suggesting that the data is more evenly spread with few extreme values. This analogy helps visualize how the shape of a distribution can impact our understanding of data.

--