Eigenvalues and Eigenvectors/The Characteristic Equation

Lesson 5.2733 words

The Characteristic Equation

The eigenvalues of a matrix are the roots of its characteristic polynomial det(A minus lambda I). This degree-n polynomial carries an algebraic multiplicity at each repeated root, a nonzero determinant is equivalent to zero not being an eigenvalue, and similar matrices share a characteristic polynomial and hence the same eigenvalues.

╌╌╌╌

For a matrix that is not triangular, the eigenvalues do not sit on the diagonal and must be found some other way. A scalar is an eigenvalue of exactly when is singular, and singularity is detected by the determinant. This turns the search for eigenvalues into a single polynomial equation in .

The determinant condition

A matrix fails to be invertible exactly when its determinant is zero, so the eigenvalues of are the scalars satisfying .

The determinant has converted the matrix equation , which carries two unknowns and , into a scalar equation in the single unknown .

The characteristic polynomial , plotted here as , crosses zero at each eigenvalue; the roots sit at and .

Determinant by row reduction

For matrices larger than , the determinant is computed by row reduction. Reduce to an echelon form using only row replacements and row interchanges (no scaling), and let be the number of interchanges. Then

The first property adds two more equivalent conditions to the Invertible Matrix Theorem.

Multiplicity

The characteristic polynomial of an matrix has degree , so counting multiplicities and allowing complex roots it has exactly roots. A root can repeat.

For the upper-triangular matrix

Part (d) of the determinant-properties theorem gives . The eigenvalue has multiplicity ; the eigenvalues and each have multiplicity . As another example, a matrix with characteristic polynomial

has eigenvalues (multiplicity ), , and , which can be listed with repetition as .

A simple root crosses the horizontal axis; a repeated root touches it without crossing, its multiplicity visible as tangency.

Similarity

The characteristic polynomial is a property of the transformation, not of the particular coordinates chosen to represent it. Similarity makes this precise.

A similarity transformation reads in the coordinate frame set by ; the change of frame does not disturb the eigenvalues.

Two warnings:

  • Equal eigenvalues do not imply similarity. The matrices and share the eigenvalue (twice) but are not similar; the second is , similar only to itself.
  • Similarity is not row equivalence. Row operations correspond to left-multiplication , not to , and they usually change the eigenvalues.

The similarity-invariance theorem is the foundation of the practical eigenvalue algorithms: they generate a sequence of matrices all similar to (hence sharing its eigenvalues) that drift toward triangular form, whose diagonal then displays the eigenvalues.

A dynamical system in closed form

Similarity and the characteristic equation combine to solve a difference equation in closed form.

ObjectRole
characteristic polynomial, degree
roots of the eigenvalues
multiplicity of a rootalgebraic multiplicity of that eigenvalue
eigenvectorsteady-state direction
eigenvaluestransient parts, decaying as

The decomposition works only when has a full set of independent eigenvectors. That condition, restated as a matrix factorization, is diagonalization.1

Footnotes

  1. Lay, Linear Algebra and Its Applications, 5th ed., §5.2 — The Characteristic Equation: , the characteristic polynomial and algebraic multiplicity, the determinant/eigenvalue additions to the Invertible Matrix Theorem, and Theorem 4 on similar matrices sharing a characteristic polynomial.

╌╌ END ╌╌