Infinitely often and almost always

From Machinelearning
Revision as of 22:37, 31 July 2019 by IssaRice (talk | contribs) (→‎Analogy with sequences of real numbers)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Let A1,A2,A3, be a sequence of events in some sample space Ω. Let ωΩ be an outcome.

In the following table, all statements in the "infinitely often" column are logically equivalent. Similarly, all statements in the "almost always" column are logically equivalent.

perspective infinitely often almost always
unions and intersections ωN=1n=NAn ωN=1n=NAn
first-order quantifiers N1nN:ωAn N1nN:ωAn
verbal expression ωAn for infinitely many n1 ωAn for almost all n1, i.e. ωAn for all but finitely many n1, i.e. ωAn for finitely many n1
lim sup/lim inf ωlim supnAn ωlim infnAn
limit of sup/inf ωlimNn=NAn ωlimNn=NAn

Analogy with sequences of real numbers

Let (an)n=1 be a sequence of real numbers, let ϵ>0 be a real number, and let x be a real number.

We say (an)n=1 is eventually ϵ-close to x iff there exists some N1 such that for all nN we have |anx|ϵ.

We say that (an)n=1 is continually ϵ-adherent iff for every N1 there exists some nN such that |anx|ϵ.

I think we can even define An:={xR:|anx|ϵ}.

lim supn|anx|=infN1supnN|anx|ϵ

lim infn|anx|=supN1infnN|anx|ϵ -- I think this one is equivalent to infinitely often, which is confusing since now the quantifier order has seemingly switched.

but this makes sense in terms of strength of "infinitely often" vs "almost always". We have lim infn|anx|lim supn|anx|, so if lim supn|anx|ϵ (i.e. an is ϵ-close to x almost always) then lim infn|anx|ϵ (i.e. an is ϵ-close to x infinitely often).

perspective infinitely often almost always
Tao's terminology (see his Analysis) (an)n=1 is continually ϵ-adherent (an)n=1 is eventually ϵ-close to x
first-order quantifier for every N1 there exists some nN such that |anx|ϵ there exists some N1 such that for all nN we have |anx|ϵ
|anx|ϵ for infinitely many n |anx|ϵ for all but finitely many n
lim infn|anx|ϵ lim supn|anx|ϵ
xlim supnAn xlim infnAn