User:IssaRice/Little o notation

From Machinelearning
Revision as of 02:29, 27 November 2018 by IssaRice (talk | contribs)

Definition

Definition (little o near a point). Let f:R→R and g:R→R be two functions, and let a∈R. We say that f is little o of g near a iff for every ϵ>0 there exists δ>0 such that |x−a|<δ implies |f(x)|<ϵ|g(x)|.

Definition (little o at infinity). Let f:R→R and g:R→R be two functions. We say that f is little o of g at infinity iff for every ϵ>0 there exists M such that for all x, x>M implies |f(x)|<ϵ|g(x)|.

Can we write just f∈o(g) or f=o(g) or f(x)∈o(g(x)) or f(x)=o(g(x))? In general we can't because for this notation to make sense, we also need to know where the argument x is going. In algorithms, we have x→∞, but in analysis (e.g. in some definitions of differentiability) we have x→0