10 - Bayes’ Theorem

Alex John Quijano

11/01/2021

Previously on Conditional Probability…

Independence vs Dependence

Let \(A\) and \(B\) be events.

Independence

\[P(A \cap B) = P(A)P(B)\] \[P(A|B) = P(A)\] \[P(B|A) = P(B)\]

Dependence

\[P(A|B) = \frac{P(A \cap B)}{P(B)} \text{, where} P(B) \ne 0\] \[P(B|A) = \frac{P(A \cap B)}{P(A)} \text{, where} P(A) \ne 0\]

10.10-Minute Activity (1/3)

10:10

10.10-Minute Activity (2/3)

10.10-Minute Activity (3/3)

Bayes’ Theorem (1/2)

Let \(A\) and \(B\) be events.

\[P(A|B) = \frac{P(B|A)P(A)}{P(B)}\]

where \(P(B) \ne 0\).

Using the law of total probability, we can write Bayes’ theorem as \[P(A|B) = \frac{P(B|A)P(A)}{P(B)} = \frac{P(B|A)P(A)}{\sum_{i=1}^{n} P(B \cap A_i)} = \frac{P(B|A)P(A)}{\sum_{i=1}^{n} P(B|A_i)P(A_i)}.\]

Bayes’ Theorem (2/2)

Image Source: ["Bayes’ rule with a simple and practical example" by Tirthajyoti Sarkar](https://towardsdatascience.com/bayes-rule-with-a-simple-and-practical-example-2bce3d0f4ad0){target=_blank}

Image Source: “Bayes’ rule with a simple and practical example” by Tirthajyoti Sarkar

10.10-Minute Activity (1/2)

10:10

10.10-Minute Activity (2/2)

Summary

Today, we discussed the following:

Next, we will discuss: