User:IssaRice/Linear algebra/Classification of operators

From Machinelearning

Let be a finite-dimensional inner product space, and let be a linear transformation. Then in the table below, the statements within the same row are equivalent. Below, we consider only complex operators, or the complexification of a real operator.

Operator kind Description in terms of eigenvectors Description in terms of diagonalizability Geometric interpretation Algebraic property Notes Examples
is diagonalizable There exists a basis of consisting of eigenvectors of is diagonalizable (there exists a basis of with respect to which is a diagonal matrix) This basis is not unique because we can reorder the vectors and also scale eigenvectors by a non-zero number to obtain an eigenvector. But there are at most distinct eigenvalues so the diagonal matrix should be unique up to order? This result holds even if is merely a vector space with any field of scalars. If is the identity map, then every non-zero vector is an eigenvector of with eigenvalue because . Thus every basis diagonalizes . The matrix of with respect to is the identity matrix.
is normal There exists an orthonormal basis of consisting of eigenvectors of is diagonalizable using an orthonormal basis A normal operator has the additional property that it can be written as , where is a self-adjoint operator and is an anti-self-adjoint operator, and where and are simultaneously diagonalizable using a single orthonormal basis
self-adjoint (aka Hermitian) There exists an orthonormal basis of consisting of eigenvectors of with real eigenvalues is diagonalizable using an orthonormal basis and the diagonal entries are all real
is anti-self-adjoint (aka skew-Hermitian or anti-Hermitian) There exists an orthonormal basis of consisting of eigenvectors of with pure imaginary eigenvalues is diagonalizable using an orthonormal basis and the diagonal entries are all pure imaginary 90-degree rotation of the plane?
is an isometry (aka unitary in a complex vector space, or orthogonal in a real vector space) There exists an orthonormal basis of consisting of eigenvectors of whose eigenvalues all have absolute value 1 is diagonalizable using an orthonormal basis and the diagonal entries all have absolute values 1 This only works when the field of scalars is the complex numbers
is positive (positive semidefinite) There exists an orthonormal basis of consisting of eigenvectors of with nonnegative real eigenvalues is diagonalizable using an orthonormal basis and the diagonal entries are all nonnegative real numbers Polar decomposition says an arbitrary linear operator can be written as a positive operator followed by a rotation (isometry). In polar decomposition, the positive operator step chooses orthogonal directions in which to stretch or shrink, so that we have a tilted ellipse, and the isometry rotates that ellipse. So a positive operator is simply one that does not require the second step. In other words, for a positive operator you can find some orthogonal "coordinate axes" along which to scale.

Acknowledgments: Thanks to Philip B. for feedback on this page.