Vector Spaces/Vector Spaces and Subspaces

Lesson 4.11,234 words

Vector Spaces and Subspaces

A vector space is any set closed under addition and scalar multiplication that obeys ten algebraic axioms. The same axioms that govern arrows in the plane govern polynomials, functions, matrices, and infinite signals, so one theory covers them all.

╌╌╌╌

Every algebraic fact proved for in the earlier chapters rested on a short list of properties: addition is commutative and associative, scalar multiplication distributes over sums, there is a zero vector, and so on. Those properties are not special to columns of numbers. Polynomials add and scale the same way. So do real-valued functions, matrices of a fixed size, and infinite sequences of measurements. A vector space is the abstraction that isolates exactly those properties, so a theorem proved once from the axioms holds simultaneously in all of these settings.1

The axioms

The scalars here are real numbers, so is a real vector space; the same theory holds verbatim with complex scalars, which becomes relevant once complex eigenvalues appear. The two closure axioms, 1 and 6, are the ones that fail most often when a candidate set turns out not to be a vector space, and they are the first thing to check.

From the axioms alone, three facts follow that are used constantly. For every in and every scalar ,

The first two are statements about the scalar zero and the vector zero; the third identifies the additive inverse promised by Axiom 5 with the scalar multiple , so subtraction never needs a separate definition.

Examples across five settings

The following sets are all vector spaces under their natural operations, and none is a column of numbers except the first.

  • Euclidean space . The standard example. Geometric intuition built in and carries over to every space below.
  • The space of signals. Doubly infinite sequences , added and scaled term by term. A signal is a function defined on the integers, produced whenever a process is sampled at discrete times. These reappear in difference equations.
  • Polynomials of degree at most . All expressions with real coefficients. Sums and scalar multiples of such polynomials are again polynomials of degree at most , and the zero polynomial is the zero vector.
  • Real-valued functions on a set . With and , the set of all functions is a vector space. The zero vector is the function identically zero.
  • Matrices . All real matrices, under entry-wise addition and scalar multiplication.
The abstract axioms hold identically in each of these sets, so one theory of vectors covers arrows, sequences, polynomials, functions, and matrices at once.

Once a set is known to be a vector space, every calculation done in transfers to it unchanged. A function is then a single point in the space of functions, not a graph.

Subspaces

Most vector spaces met in practice arise as a subset of a larger space — the solutions of a system, the polynomials vanishing at a point, the symmetric matrices. A subset that is itself a vector space under the inherited operations is a subspace, and checking it requires only three of the ten axioms rather than all ten.

Properties (a), (b), (c) are Axioms 4, 1, and 6. The remaining axioms — 2, 3, and 7 through 10 — are automatic, because they are identities that already hold for every element of , including those that happen to lie in . Axiom 5 follows from (c) with , since . So the three conditions guarantee that is a vector space. Every subspace is a vector space, and every vector space is a subspace of itself; the word subspace signals that a smaller space is being viewed inside a larger one.

A subspace is closed: adding two of its vectors or scaling one never produces a vector outside , so all arrows stay in the shaded region.

Two small subspaces exist inside every vector space : the zero subspace, containing only the zero vector, and itself. For polynomials, is a subspace of , the space of all polynomials, which in turn is a subspace of the space of all functions on .

When closure fails

A subset can contain the zero vector and still fail to be a subspace, because closure is a condition about all sums or all scalar multiples. A single counterexample settles the matter.

  • A line not through the origin in misses outright, so it is not a subspace. The same holds for any plane in that avoids the origin.
  • is not a subspace of . Its vectors have two entries, not three, so it is not even a subset of . The set of with real is a genuine subspace that behaves like but is logically distinct from it.
  • The first quadrant contains and is closed under addition, but scaling by sends the vector to , which leaves the quadrant. Closure under scalar multiplication fails.
The first quadrant contains and survives addition, but scaling a vector by a negative number escapes it, so closure under scalar multiplication fails and the quadrant is not a subspace.

Spans are subspaces

The most common way to describe a subspace is as the set of all linear combinations of a fixed collection of vectors. Recall that is the set of every vector . This set is always a subspace.

The proof checks the three conditions. The zero vector equals , so it lies in the span. If and are two linear combinations, then

is again a linear combination, and for any scalar ,

is one as well. All three conditions hold. The subspace is called the subspace spanned (or generated) by the set, and a set whose span is is a spanning set for .

Membership of a specific vector in a span is a consistency question.

One nonzero vector spans a line through the origin; two vectors that are not multiples span a plane through the origin. In , these and and itself are the only subspaces.

Every nonzero subspace of other than itself is either a line through the origin, for a nonzero , or a plane through the origin, for two vectors that are not multiples. This classification, proved once dimension is available, is worth keeping in mind even for abstract spaces.

Reading a subspace as a span

A subset written with free parameters is recognized as a span by pulling the parameters out as coefficients.

Reading the free parameters off as coefficients and collecting their vectors is the same procedure that produces a spanning set for the null space of a matrix.

The subspace test also applies where no coordinates are available, directly on the defining property.

Footnotes

  1. Lay, Linear Algebra and Its Applications, §4.1 — Vector Spaces and Subspaces: the ten axioms, the subspace test, Theorem 1 on spans, and the examples , , , function spaces, and .

╌╌ END ╌╌