Inaugurated by IN-SPACe
ISRO Registered Space Tutor
S7-SA3-0408
What are Markov Chains (Introductory)?
Grade Level:
Class 12
AI/ML, Physics, Biotechnology, FinTech, EVs, Space Technology, Climate Science, Blockchain, Medicine, Engineering, Law, Economics
Definition
What is it?
Markov Chains are mathematical models that describe a sequence of events where the probability of the next event depends only on the current event, not on any events that happened before it. Think of it as predicting the future based only on the present situation.
Simple Example
Quick Example
Imagine a cricket match. If the batsman just hit a six, the chances of him hitting another six or getting out might depend only on his current confidence and the bowler's current strategy, not on what happened in the first over. A Markov Chain would model these probabilities from one ball to the next.
Worked Example
Step-by-Step
Let's say a student's mood can be 'Happy' or 'Sad'.
1. If they are 'Happy' today, there's an 80% chance they'll be 'Happy' tomorrow and a 20% chance they'll be 'Sad' tomorrow.
---2. If they are 'Sad' today, there's a 40% chance they'll be 'Happy' tomorrow and a 60% chance they'll be 'Sad' tomorrow.
---3. Let's represent this with a table (Transition Matrix):
| Current Mood | Next Mood: Happy | Next Mood: Sad |
|--------------|------------------|----------------|
| Happy | 0.8 | 0.2 |
| Sad | 0.4 | 0.6 |
---4. If the student is 'Happy' today, what is the probability they are 'Happy' after 2 days?
---5. Day 1 (Today): Happy. Day 2 probabilities: Happy (0.8), Sad (0.2).
---6. Day 3 probabilities (if Day 2 was Happy): Happy (0.8 * 0.8) = 0.64. Sad (0.8 * 0.2) = 0.16.
---7. Day 3 probabilities (if Day 2 was Sad): Happy (0.2 * 0.4) = 0.08. Sad (0.2 * 0.6) = 0.12.
---8. Total probability of being 'Happy' on Day 3 = 0.64 + 0.08 = 0.72.
Answer: If the student is 'Happy' today, there is a 72% chance they will be 'Happy' after 2 days.
Why It Matters
Markov Chains are super important for predicting future trends in many fields like AI/ML, finance, and even weather forecasting. Engineers use them to design better systems, and data scientists use them to understand customer behavior or predict stock prices, opening doors to exciting careers.
Common Mistakes
MISTAKE: Thinking the next event depends on ALL past events. | CORRECTION: Remember, the 'Markov Property' means the next state only depends on the *current* state, not the entire history.
MISTAKE: Confusing probabilities with certainties. | CORRECTION: Markov Chains give probabilities (chances), not guaranteed outcomes. An 80% chance means it's likely, but not 100% sure.
MISTAKE: Not understanding what a 'state' is. | CORRECTION: A 'state' is simply the condition or situation at a particular point in time, like 'raining', 'sunny', 'happy', 'sad', 'bought product A', 'bought product B'.
Practice Questions
Try It Yourself
QUESTION: A small shop can be 'Busy' or 'Quiet'. If 'Busy' today, 70% chance 'Busy' tomorrow. If 'Quiet' today, 50% chance 'Busy' tomorrow. If the shop is 'Quiet' today, what is the probability it will be 'Busy' tomorrow? | ANSWER: 50% or 0.5
QUESTION: Using the shop example from Q1, if the shop is 'Busy' today, what is the probability it will be 'Quiet' after 2 days? | ANSWER: 0.3 (Day 1 Busy -> Day 2 Busy (0.7), Day 2 Quiet (0.3). If Day 2 Busy, Day 3 Quiet = 0.7 * 0.3 = 0.21. If Day 2 Quiet, Day 3 Quiet = 0.3 * 0.5 = 0.15. Total = 0.21 + 0.15 = 0.36. Wait, let's recheck. If Busy today: P(Busy tomorrow) = 0.7, P(Quiet tomorrow) = 0.3. If Quiet tomorrow: P(Quiet day after) = 0.5. If Busy tomorrow: P(Quiet day after) = 0.3. So, P(Quiet Day 3) = P(Busy Day 2) * P(Quiet | Busy) + P(Quiet Day 2) * P(Quiet | Quiet) = (0.7 * 0.3) + (0.3 * 0.5) = 0.21 + 0.15 = 0.36. ANSWER: 0.36
QUESTION: A traffic light can be 'Red', 'Yellow', or 'Green'. The probability of changing from Red to Green is 0.8, from Red to Yellow is 0.2. From Green to Yellow is 0.9, from Green to Red is 0.1. From Yellow to Red is 1.0. If the light is 'Red' now, what is the probability it will be 'Yellow' after 2 cycles? | ANSWER: P(Red -> Green -> Yellow) = 0.8 * 0.9 = 0.72. P(Red -> Yellow -> Red) = 0.2 * 1.0 = 0.2. So, probability of being Yellow after 2 cycles is 0.72. ANSWER: 0.72
MCQ
Quick Quiz
Which of the following is a key characteristic of a Markov Chain?
The next state depends on all previous states.
The next state is completely random and unpredictable.
The next state depends only on the current state.
The probabilities of changing states change over time.
The Correct Answer Is:
C
Option C correctly describes the 'Markov Property', which is the defining feature of a Markov Chain. Options A, B, and D contradict this fundamental principle.
Real World Connection
In the Real World
Your favorite music streaming app, like Spotify or JioSaavn, uses ideas similar to Markov Chains! They predict what song you might want to hear next based on the song you are currently listening to, not on your entire listening history from last year. This helps them create awesome playlists for you.
Key Vocabulary
Key Terms
STATE: A specific condition or situation at a point in time (e.g., 'sunny', 'raining'). | TRANSITION: The change from one state to another. | PROBABILITY: The chance or likelihood of an event happening. | MARKOV PROPERTY: The rule that the next state depends only on the current state.
What's Next
What to Learn Next
Now that you understand the basics of Markov Chains, you can explore 'Transition Matrices' in more detail. These matrices are a powerful way to represent and calculate probabilities for Markov Chains, helping you solve more complex problems.
