What is Pearson's Correlation Coefficient?

S7-SA3-0151

Grade Level:

Class 12

AI/ML, Physics, Biotechnology, FinTech, EVs, Space Technology, Climate Science, Blockchain, Medicine, Engineering, Law, Economics

Definition

What is it?

Pearson's Correlation Coefficient, often written as 'r', is a number that tells us how strongly two things are related and in what direction. It measures the linear relationship between two sets of data, meaning how well they tend to change together in a straight line.

Simple Example

Quick Example

Imagine you record the number of hours students study for a test and their scores on that test. If students who study more generally get higher scores, and those who study less get lower scores, there's a positive correlation. Pearson's 'r' would give you a number to measure how strong this study-score link is.

Worked Example

Step-by-Step

Let's find the Pearson's 'r' for a small dataset. Suppose we have data for 'Hours Studied (X)' and 'Test Scores (Y)' for 3 students.
Student 1: X=2, Y=60
Student 2: X=4, Y=80
Student 3: X=6, Y=90

Step 1: Calculate the mean (average) for X and Y.
Mean X (x_bar) = (2+4+6)/3 = 12/3 = 4
Mean Y (y_bar) = (60+80+90)/3 = 230/3 = 76.67

---Step 2: Calculate (X - x_bar) and (Y - y_bar) for each student.
Student 1: (2-4)=-2, (60-76.67)=-16.67
Student 2: (4-4)=0, (80-76.67)=3.33
Student 3: (6-4)=2, (90-76.67)=13.33

---Step 3: Calculate (X - x_bar) * (Y - y_bar).
Student 1: (-2) * (-16.67) = 33.34
Student 2: (0) * (3.33) = 0
Student 3: (2) * (13.33) = 26.66
Sum of (X - x_bar)(Y - y_bar) = 33.34 + 0 + 26.66 = 60

---Step 4: Calculate (X - x_bar)^2 and (Y - y_bar)^2.
(X - x_bar)^2: (-2)^2=4, (0)^2=0, (2)^2=4. Sum = 4+0+4=8
(Y - y_bar)^2: (-16.67)^2=277.89, (3.33)^2=11.09, (13.33)^2=177.69. Sum = 277.89+11.09+177.69 = 466.67

---Step 5: Use the formula for Pearson's r:
r = Sum[(X - x_bar)(Y - y_bar)] / sqrt[ Sum[(X - x_bar)^2] * Sum[(Y - y_bar)^2] ]
r = 60 / sqrt[ 8 * 466.67 ]
r = 60 / sqrt[ 3733.36 ]
r = 60 / 61.10

---Step 6: Calculate r.
r approx 0.98

Answer: Pearson's Correlation Coefficient (r) is approximately 0.98.

Why It Matters

Understanding correlation helps scientists and engineers see how different factors influence each other. In Medicine, it helps link lifestyle choices to health outcomes, or in AI/ML, it helps build smarter models by finding relationships in data. It's crucial for careers in data science, research, and financial analysis.

Common Mistakes

MISTAKE: Thinking that a high correlation means one thing *causes* the other. | CORRECTION: Correlation only shows a relationship, not cause-and-effect. For example, ice cream sales and drowning incidents might both increase in summer (correlated), but ice cream doesn't *cause* drowning.

MISTAKE: Assuming a correlation of 0 means there's absolutely no relationship between the variables. | CORRECTION: A correlation of 0 only means there's no *linear* relationship. There could still be a strong non-linear relationship (e.g., U-shaped or inverted U-shaped) that Pearson's 'r' won't capture.

MISTAKE: Misinterpreting the sign of 'r' (positive vs. negative). | CORRECTION: A positive 'r' means as one variable increases, the other tends to increase. A negative 'r' means as one variable increases, the other tends to decrease. The sign tells you the direction of the relationship.

Practice Questions

Try It Yourself

QUESTION: If the Pearson's correlation coefficient between two variables is -0.9, what does this tell us about their relationship? | ANSWER: It indicates a strong negative linear relationship. As one variable increases, the other strongly tends to decrease.

QUESTION: Which value of 'r' shows a stronger linear relationship: -0.75 or 0.60? Explain why. | ANSWER: -0.75 shows a stronger linear relationship. The strength of the relationship is determined by the absolute value of 'r' (how far it is from 0). |-0.75| = 0.75, which is greater than |0.60| = 0.60.

QUESTION: A researcher finds that the number of hours spent playing video games and the average math test scores for students has an 'r' value of -0.2. What can be concluded from this? Is it a strong relationship? | ANSWER: This indicates a weak negative linear relationship. As hours spent playing video games increase, math test scores slightly tend to decrease. It is not a strong relationship because -0.2 is close to 0.

MCQ

Quick Quiz

What does a Pearson's correlation coefficient of +1 mean?

No relationship between the variables.

A perfect negative linear relationship.

A perfect positive linear relationship.

A weak positive linear relationship.

The Correct Answer Is:

A value of +1 indicates that as one variable increases, the other variable also increases proportionally along a perfect straight line. Options A, B, and D describe other types of relationships.

Real World Connection

In the Real World

Pearson's Correlation Coefficient is used extensively in finance to see how different stocks move together. For example, a financial analyst might use it to see if the price of a certain tech stock (like TCS) moves in a similar way to the overall Nifty 50 index. This helps them make smart investment decisions. It's also used by meteorologists to see if rainfall correlates with crop yield.

Key Vocabulary

Key Terms

Correlation: A statistical measure that indicates the extent to which two or more variables fluctuate together. | Linear Relationship: A relationship between two variables that, when plotted on a graph, forms a straight line. | Positive Correlation: When two variables move in the same direction (both increase or both decrease). | Negative Correlation: When two variables move in opposite directions (one increases, the other decreases). | Coefficient: A numerical or constant quantity placed before and multiplying the variable in an algebraic expression.

What's Next

What to Learn Next

Next, you can explore Spearman's Rank Correlation Coefficient. While Pearson's 'r' measures linear relationships, Spearman's 'rho' can measure monotonic relationships (where variables move together but not necessarily in a straight line), which is useful for different types of data.