Cauchy–Schwarz Inequality for Random Variables¶
Theorem¶
For random variables and with and (which also makes integrable),
If either second moment is zero, equality holds trivially.
For centred variables, the second moments are their Variance and Standard Deviation quantities: applying the inequality to and gives .
Interpretation¶
The average product of two variables with finite second moments can never exceed the product of their root-mean-square sizes and . Applied to centred variables, this bounds covariance and keeps correlation between and .
The figure draws and as arrows of lengths and , with in the role of the inner product. When , the shadow of on has length , and a shadow is never longer than the arrow itself; squaring gives the inequality. When both second moments are positive, the inequality also makes a number in , so that is a genuine angle. Under this condition, equality means the arrows lie on one line, the Key Result almost surely. If either second moment is zero, equality holds trivially and the angle is undefined.
This is the Cauchy–Schwarz inequality from Math II in a new setting. If the sample space has equally likely outcomes, is times the dot product of the vectors of values of and , so the two statements coincide. Taking and gives , and when equality holds only for an exact linear relation almost surely.
A tempting but false version is . For it would say , which fails for every with positive variance; the correct bound uses second moments on the right.
Key Results¶
- .
- If both second moments are positive, equality holds exactly when almost surely for some real .
Examples¶
- If and , then .
- Taking gives ; for a fair die this is .
Prerequisites¶
Related Concepts¶
Sources¶
- Nicky van Foreest · Probability Distributions · Week 7
Symbols: infinity, sigma, square root, theta
Last updated: 27 October 2026 11:52
Cauchy–Schwarz Inequality for Random VariablesVariance and Standard DeviationCovarianceCorrelationCauchy-Schwarz Inequality