User:IssaRice/Linear algebra/Outline of linear algebra: Difference between revisions

From Machinelearning
Line 33: Line 33:
* Norm
* Norm
* Eigen stuff
* Eigen stuff
* Determinants?
* Determinants? Trace?
* Spectral theorem
* Spectral theorem
* Singular value decomposition
* Singular value decomposition

Revision as of 22:50, 26 December 2018

Two approaches to linear algebra

  • Coordinate-based approach: looks at concrete matrices, more emphasis on computation, works a lot in the standard basis. If linear algebra was analysis, this would be called "calculus"
  • Coordinate-free approach: Abstract vector spaces, more emphasis on linear maps. If linear algebra was analysis, this would be called "real analysis".

First half of linear algebra

The point of the first half is to consider general linear transformations (i.e. does not restrict to operators) and classify them into injective/surjective/bijective. See this table.

Topics include:

  • Elementary row operations, elementary matrices
  • Row equivalence
  • Echelon form, reduced row echelon form, pivots
  • Linear independence, span, basis
  • Column space
  • Row space
  • Rank, column rank, row rank
  • Linear systems of equations
  • Matrix multiplication
  • Null space = solution set of homogeneous linear system
  • Finding a basis for range, null space, range of transpose, null space of transpose
  • Fundamental theorem of linear maps: rank + nullity = dimension of domain
  • Equivalent properties of injective, surjective, bijective

Second half of linear algebra

The second half focuses on operators (linear maps that map from a vector space to the same vector space) and does inner product stuff. Maybe this is called "spectral theory".

Topics:

  • Inner product
  • Norm
  • Eigen stuff
  • Determinants? Trace?
  • Spectral theorem
  • Singular value decomposition
  • Diagonalization
  • Orthogonality
  • Orthonormal bases
  • Orthogonal projection