User:IssaRice/Little o notation: Difference between revisions

From Machinelearning
Line 34: Line 34:
'''Proposition'''. transitivity
'''Proposition'''. transitivity


'''Proposition'''. we can replace the <math>\lt</math> in the definition with <math>\leq</math>, right?
'''Proposition'''. we can replace the <math><</math> in the definition with <math>\leq</math>, right?


==References==
==References==

Revision as of 03:08, 27 November 2018

Definition

Definition (little o near a point). Let and be two functions, and let . We say that is little o of near iff for every there exists such that implies . Some equivalent ways to say the same thing are:

Notation Comments
is little o of near
as In this notation, we think of as a set.
as
near
near

Definition (little o at infinity). Let and be two functions. We say that is little o of at infinity iff for every there exists such that for all , implies .

Can we write just or or or ?

Expand to see solution:

In general we can't because for this notation to make sense, we also need to know where the argument is going. In algorithms, we have , but in analysis (e.g. in some definitions of differentiability) we have .

If we are being a little pedantic, what is wrong with saying " as "?

Expand to see solution:

We are saying , but we haven't clarified what is. Instead, we are relying on the reader to assume that is an argument to and .

Properties

Proposition. Let and be two functions, and suppose for all . Then f is little o of g near a if and only if .

Proposition. transitivity

Proposition. we can replace the in the definition with , right?

References

[1]

[2]