Summary table of probability terms

From Machinelearning

This page is a summary table of probability terms.

Table

Term Symbol Type Definition
Reals R
Borel subsets of the reals B
Sample space Ω
Outcome ω Ω
Events or measurable sets F
Probability measure P or Pr or PF F→[0,1]
Probability triple or probability space (Ω,F,P)
Distribution μ or D or D or PB or L(X) or PX−1 B→[0,1] B↦P(X∈B)
Induced probability space (R,B,μ)
Cumulative distribution function or CDF FX R→[0,1]
Probability density function or PDF fX R→[0,∞)
Random variable X Ω→R
Indicator of A 1A Ω→{0,1}
Expectation E or E (Ω→R)→R

Dependencies

Let (Ω,F,P) be a probability space.

  • Given a random variable X, we can compute its distribution μ. How? Just let μ(B)=PF(X∈B)
  • Given a random variable, we can compute the probability density function. How?
  • Given a random variable, we can compute the cumulative distribution function. How?
  • Given a distribution, we can retrieve a random variable. But this random variable is not unique? This is why we can say stuff like "let X∼D".
  • Given a distribution μ, we can compute its density function. How? Just find the derivative of μ((−∞,x]). (?)
  • Given a cumulative distribution function, we can compute the random variable. (Right?)
  • Given a probability density function, can we get everything else? Don't we just have to integrate to get the cdf, which gets us the random variable and the distribution?
  • Given a cumulative distribution function, how do we get the distribution? We have FX(x)=PF(X≤x)=PB((−∞,x]), which gets us some of what the distribution PB maps to, but B is bigger than this. What do we do about the other value we need to map?

See also

External links