User:IssaRice/Additivity of small risks: Difference between revisions

From Machinelearning
No edit summary
No edit summary
 
(2 intermediate revisions by the same user not shown)
Line 1: Line 1:
Suppose you want to engage in some risky activities such as driving on the highway or swimming in the river, which have some small probability of resulting in death. It turns out that when the probabilities involved are independent and small, one can simply add the probabilities together instead of doing the more complicated correct calculation.
Suppose you want to engage in some risky activities such as driving on the highway or swimming in the river, which have some small probability of resulting in death. It turns out that when the probabilities involved are independent and small, one can simply add the probabilities together instead of doing the more complicated correct calculation.


Let <math>p_1, \dots, p_n</math> be the probabilities of the risk of dying from each of activities <math>1, \dots, n</math>, where each <math>0\leq p_i \ll 1</math>. Then the probability of dying from doing all activities is <math>\Pr(\mathrm{death}) = 1 - \prod_i (1-p_i)</math>. This happens because for independent probabilities we know how to take conjunctions (AND) but not disjunctions (OR) so we must first invert and use de Morgan's laws then invert again.
Let <math>p_1, \dots, p_n</math> be the probabilities of the risk of dying from each of activities <math>1, \dots, n</math>, where each <math>0\leq p_i \ll 1</math>. Then the probability of dying from doing all activities is <math>\Pr(\mathrm{death}) = 1 - \prod_i (1-p_i)</math>. This happens because for independent probabilities we know how to take conjunctions (AND) by multiplying but not disjunctions (OR) so we must first invert and use de Morgan's laws then invert again.


But now let <math>m_i := -\log(1 - p_i)</math>. Then we have <math>\Pr(\mathrm{death}) = 1 - \exp(-\sum_i m_i)</math>.
But now let <math>m_i := -\log(1 - p_i)</math>. Then we have <math>\Pr(\mathrm{death}) = 1 - \exp(-\sum_i m_i)</math>. When each <math>p_i</math> is small, we have <math>m_i \approx p_i</math>. Thus <math>\sum_i m_i</math> is also small. For small positive values of <math>x</math> we have <math>1 - \exp(-x) \approx x</math>. Thus we have <math>\Pr(\mathrm{death}) = 1 - \exp(-\sum_i m_i) \approx \sum_i m_i \approx \sum_i p_i</math>.
 
If <math>y = -\log(1-x)</math> then <math>x = 1-\exp(-y)</math> which means that the two functions are inverses of each other. So it makes sense that when either quantity is small, the other is also small.

Latest revision as of 20:39, 14 November 2020

Suppose you want to engage in some risky activities such as driving on the highway or swimming in the river, which have some small probability of resulting in death. It turns out that when the probabilities involved are independent and small, one can simply add the probabilities together instead of doing the more complicated correct calculation.

Let p1,,pn be the probabilities of the risk of dying from each of activities 1,,n, where each 0pi1. Then the probability of dying from doing all activities is Pr(death)=1i(1pi). This happens because for independent probabilities we know how to take conjunctions (AND) by multiplying but not disjunctions (OR) so we must first invert and use de Morgan's laws then invert again.

But now let mi:=log(1pi). Then we have Pr(death)=1exp(imi). When each pi is small, we have mipi. Thus imi is also small. For small positive values of x we have 1exp(x)x. Thus we have Pr(death)=1exp(imi)imiipi.

If y=log(1x) then x=1exp(y) which means that the two functions are inverses of each other. So it makes sense that when either quantity is small, the other is also small.