What is F1 Score?

S3-SA3-0457

Grade Level:

Class 9

AI/ML, Data Science, Physics, Economics, Cryptography, Computer Science, Engineering

Definition

What is it?

The F1 Score is a measure that combines two important ideas: Precision and Recall. It helps us understand how well a model or system performs, especially when one type of mistake is more common than another. Think of it as a balanced average that tells you if your predictions are both accurate and complete.

Simple Example

Quick Example

Imagine you have a filter that identifies spam messages in your phone. If it catches most spam (good Recall) but also flags many normal messages as spam (bad Precision), it's not very helpful. The F1 Score gives a single number to tell you if your spam filter is doing well on both fronts – catching spam AND not blocking important messages.

Worked Example

Step-by-Step

Let's say a security camera identifies 10 suspicious people correctly (True Positives), but misses 2 suspicious people (False Negatives). It also wrongly flags 3 innocent people as suspicious (False Positives). We want to calculate its F1 Score.

1. First, calculate Precision: Precision = True Positives / (True Positives + False Positives)
Precision = 10 / (10 + 3) = 10 / 13 = 0.769
---2. Next, calculate Recall: Recall = True Positives / (True Positives + False Negatives)
Recall = 10 / (10 + 2) = 10 / 12 = 0.833
---3. Now, use the F1 Score formula: F1 Score = 2 * (Precision * Recall) / (Precision + Recall)
---4. Plug in the values: F1 Score = 2 * (0.769 * 0.833) / (0.769 + 0.833)
---5. Calculate the product in the numerator: 0.769 * 0.833 = 0.640577
---6. Calculate the sum in the denominator: 0.769 + 0.833 = 1.602
---7. Complete the calculation: F1 Score = 2 * 0.640577 / 1.602 = 1.281154 / 1.602 = 0.7997
---The F1 Score for this camera system is approximately 0.80.

Why It Matters

The F1 Score is super important in AI and Machine Learning to evaluate how good a model is at making predictions. Engineers use it to build better fraud detection systems in banking or disease diagnosis tools in healthcare. Data Scientists rely on it to fine-tune algorithms for everything from weather forecasting to recommending your next favourite song.

Common Mistakes

MISTAKE: Confusing F1 Score with simple accuracy. | CORRECTION: Accuracy tells you overall correct predictions, but F1 Score specifically balances Precision (avoiding false alarms) and Recall (not missing important things), which is crucial when one type of error is more costly.

MISTAKE: Thinking a high Precision automatically means a good model. | CORRECTION: High Precision alone is not enough. A model could have high Precision by predicting very few things, but it might miss many important cases. F1 Score ensures both Precision and Recall are considered.

MISTAKE: Forgetting the '2 *' in the F1 Score formula. | CORRECTION: The F1 Score is a harmonic mean, not a simple arithmetic mean. The formula is 2 * (Precision * Recall) / (Precision + Recall), and the '2 *' is essential for the correct calculation.

Practice Questions

Try It Yourself

QUESTION: A model has a Precision of 0.8 and a Recall of 0.7. Calculate its F1 Score. | ANSWER: F1 Score = 2 * (0.8 * 0.7) / (0.8 + 0.7) = 2 * 0.56 / 1.5 = 1.12 / 1.5 = 0.747

QUESTION: If a system correctly identifies 9 out of 10 positive cases (True Positives = 9, False Negatives = 1) and wrongly identifies 2 negative cases as positive (False Positives = 2), what is its F1 Score? | ANSWER: Precision = 9 / (9+2) = 9/11 = 0.818. Recall = 9 / (9+1) = 9/10 = 0.9. F1 Score = 2 * (0.818 * 0.9) / (0.818 + 0.9) = 2 * 0.7362 / 1.718 = 1.4724 / 1.718 = 0.857

QUESTION: A medical test has a Recall of 0.95, meaning it catches 95% of actual disease cases. However, its Precision is 0.70, meaning 30% of its positive results are false alarms. Explain why a high F1 Score is important here and calculate it. | ANSWER: A high F1 Score is crucial because missing a disease (low Recall) can be dangerous, and too many false alarms (low Precision) can cause unnecessary stress and further tests. F1 Score = 2 * (0.70 * 0.95) / (0.70 + 0.95) = 2 * 0.665 / 1.65 = 1.33 / 1.65 = 0.806

MCQ

Quick Quiz

Which of the following best describes what the F1 Score balances?

True Positives and True Negatives

Precision and Accuracy

Precision and Recall

False Positives and False Negatives

The Correct Answer Is:

The F1 Score is specifically designed to be the harmonic mean of Precision and Recall, providing a single metric that considers both the accuracy of positive predictions and the ability to find all positive samples.

Real World Connection

In the Real World

In online shopping, companies like Flipkart or Amazon use F1 Score to evaluate their recommendation systems. If the system recommends many items you like (high Recall) and the items it recommends are actually good for you (high Precision), it will have a high F1 Score. This helps them improve their suggestions, making your shopping experience better and boosting their sales.

Key Vocabulary

Key Terms

PRECISION: The proportion of positive identifications that were actually correct. | RECALL: The proportion of actual positive cases that were correctly identified. | TRUE POSITIVE: Correctly identifying a positive case. | FALSE POSITIVE: Incorrectly identifying a negative case as positive (a 'false alarm'). | FALSE NEGATIVE: Incorrectly identifying a positive case as negative (a 'miss').

What's Next

What to Learn Next

Now that you understand F1 Score, explore how different types of errors (False Positives vs. False Negatives) impact real-world decisions. You can then learn about other evaluation metrics like ROC AUC, which give an even deeper insight into model performance.