User:IssaRice/Additivity of small risks: Difference between revisions

From Machinelearning
No edit summary
No edit summary
Line 1: Line 1:
Suppose you want to engage in some risky activities such as driving on the highway or swimming in the river, which have some small probability of resulting in death. It turns out that when the probabilities involved are independent and small, one can simply add the probabilities together instead of doing the more complicated correct calculation.
Suppose you want to engage in some risky activities such as driving on the highway or swimming in the river, which have some small probability of resulting in death. It turns out that when the probabilities involved are independent and small, one can simply add the probabilities together instead of doing the more complicated correct calculation.


Let <math>p_1, \dots, p_n</math> be the probabilities of the risk of dying from each of activities <math>1, \dots, n</math>, where each <math>0\leq p_i \ll 1</math>. Then the probability of dying from doing all activities is <math>\Pr(\mathrm{death}) = 1 - \prod_i (1-p_i)</math>. This happens because for independent probabilities we know how to take conjunctions (AND) but not disjunctions (OR) so we must first invert and use de Morgan's laws then invert again.
Let <math>p_1, \dots, p_n</math> be the probabilities of the risk of dying from each of activities <math>1, \dots, n</math>, where each <math>0\leq p_i \ll 1</math>. Then the probability of dying from doing all activities is <math>\Pr(\mathrm{death}) = 1 - \prod_i (1-p_i)</math>. This happens because for independent probabilities we know how to take conjunctions (AND) by multiplying but not disjunctions (OR) so we must first invert and use de Morgan's laws then invert again.


But now let <math>m_i := -\log(1 - p_i)</math>. Then we have <math>\Pr(\mathrm{death}) = 1 - \exp(-\sum_i m_i)</math>. When each <math>p_i</math> is small, we have <math>m_i \approx p_i</math>. Thus <math>\sum_i m_i</math> is also small. For small positive values of <math>x</math> we have <math>1 - \exp(-x) \approx x</math>. Thus we have <math>\Pr(\mathrm{death}) = 1 - \exp(-\sum_i m_i) \approx \sum_i m_i \approx \sum_i p_i</math>.
But now let <math>m_i := -\log(1 - p_i)</math>. Then we have <math>\Pr(\mathrm{death}) = 1 - \exp(-\sum_i m_i)</math>. When each <math>p_i</math> is small, we have <math>m_i \approx p_i</math>. Thus <math>\sum_i m_i</math> is also small. For small positive values of <math>x</math> we have <math>1 - \exp(-x) \approx x</math>. Thus we have <math>\Pr(\mathrm{death}) = 1 - \exp(-\sum_i m_i) \approx \sum_i m_i \approx \sum_i p_i</math>.

Revision as of 22:43, 13 November 2020

Suppose you want to engage in some risky activities such as driving on the highway or swimming in the river, which have some small probability of resulting in death. It turns out that when the probabilities involved are independent and small, one can simply add the probabilities together instead of doing the more complicated correct calculation.

Let p1,,pn be the probabilities of the risk of dying from each of activities 1,,n, where each 0pi1. Then the probability of dying from doing all activities is Pr(death)=1i(1pi). This happens because for independent probabilities we know how to take conjunctions (AND) by multiplying but not disjunctions (OR) so we must first invert and use de Morgan's laws then invert again.

But now let mi:=log(1pi). Then we have Pr(death)=1exp(imi). When each pi is small, we have mipi. Thus imi is also small. For small positive values of x we have 1exp(x)x. Thus we have Pr(death)=1exp(imi)imiipi.