next up previous index
Next: Translation Up: Linear Combinations in Vector Previous: Basis for a Subspace

Orthogonal Basis for a Subspace

If a basis tex2html_wrap_inline6292 for a subspace of tex2html_wrap_inline4684 is also an tex2html_wrap_inline6548 set it is called an tex2html_wrap_inline6550 . An orthogonal basis can always be made into an orthonormal basis by normalizing each of the vectors.

Examples

  1. The standard basis for tex2html_wrap_inline4684 , tex2html_wrap_inline4654 is an orthogonal basis since
    tex2html_wrap_inline6558 and is orthonormal since tex2html_wrap_inline6560 .
  2. Consider tex2html_wrap_inline6562 V is orthogonal, since

    displaymath6536

    but not orthonormal since the length of each vector is 3. V spans tex2html_wrap_inline5786 , by Prop. gif, since

    displaymath6537

    Thus V is an orthogonal basis for tex2html_wrap_inline5786 .

It is possible to transform any given basis tex2html_wrap_inline6576 for a subspace S of tex2html_wrap_inline4684 into an orthogonal basis for S by repeated application of Equation gif. A procedure which systematically accomplishes this is the celebrated Gram-Schmidt Orthogonalization Process , which actually produces an orthonormal basis tex2html_wrap_inline6584 for S from V.

displaymath6538

In part a of Steps 1-m the next orthogonal vector in produced. In part b of Steps 1-m the orthogonal vector just produced is normalized. If normalized vectors are not required, part b of Steps 1-m could be omitted at the cost of additional complexity in the formulas for part a of Steps 2-m (see Equation gif).

Example

displaymath6539

  theorem2004

Proof Let basis tex2html_wrap_inline6576 for subspace S of tex2html_wrap_inline4684 be given and the Gram-Schmidt process be applied to V yielding W . For each i such that tex2html_wrap_inline6618 , tex2html_wrap_inline6620 is the normalization of tex2html_wrap_inline6622 , providing tex2html_wrap_inline6624 . In Step 1, tex2html_wrap_inline6626 tex2html_wrap_inline4972 tex2html_wrap_inline6630 is an orthogonal set by Prop. gif. Also tex2html_wrap_inline6632 , since otherwise V is dependent. By Prop. gif, tex2html_wrap_inline6636 and by Prop. gif, tex2html_wrap_inline6638 tex2html_wrap_inline4972 tex2html_wrap_inline6642 is an orthonormal set. From the equations of Steps 1 and 2, we see that tex2html_wrap_inline6644 . In Step 2, tex2html_wrap_inline6646 , since otherwise V is dependent. As in Step 1, we find that tex2html_wrap_inline6650 , tex2html_wrap_inline6652 , tex2html_wrap_inline6642 is an orthonormal set, and tex2html_wrap_inline6656 . Continuing through Step m, we conclude that W is an orthonormal basis for S. tex2html_wrap_inline4680

  theorem2032

Proof Let tex2html_wrap_inline6682 be a given orthonormal basis for subspace S of tex2html_wrap_inline4684 with m < n. By Prop. gif we can find n-m additional vectors tex2html_wrap_inline6692 from tex2html_wrap_inline4684 such that tex2html_wrap_inline6696 is a basis for tex2html_wrap_inline4684 . Apply the Gram-Schmidt process to V, noting that there will be no change to the first m vectors, since they are already orthonormal. The basis tex2html_wrap_inline6704 produced will be an orthonormal basis for tex2html_wrap_inline4684 . Let p be an arbitrary element of tex2html_wrap_inline6710 . Then tex2html_wrap_inline6712 . Since tex2html_wrap_inline6714 and tex2html_wrap_inline6716 , tex2html_wrap_inline6718 tex2html_wrap_inline4972 tex2html_wrap_inline6722 by Prop. gif tex2html_wrap_inline4972 tex2html_wrap_inline6726 . tex2html_wrap_inline4972 an arbitrary element of tex2html_wrap_inline6710 is in tex2html_wrap_inline6732 , where tex2html_wrap_inline6734 . Now tex2html_wrap_inline6736 is also an orthonormal set and is independent by Prop. gif tex2html_wrap_inline4972 T is a basis for tex2html_wrap_inline6710 . tex2html_wrap_inline4680

  theorem2055

Proof Left as an exercise.

  theorem2060

Proof This follows immediately from Prop. gif. tex2html_wrap_inline4680

  theorem2067

Proof Assume S be a subspace of tex2html_wrap_inline4684 of dimension k, where tex2html_wrap_inline6790 . Then tex2html_wrap_inline6710 has an orthonormal basis of dimension n-k. Let tex2html_wrap_inline6796 be an orthonormal basis for tex2html_wrap_inline6710 . Now tex2html_wrap_inline6800 tex2html_wrap_inline6802 tex2html_wrap_inline6804 tex2html_wrap_inline6802 tex2html_wrap_inline6808 tex2html_wrap_inline4972 tex2html_wrap_inline6812 tex2html_wrap_inline4972 tex2html_wrap_inline6816 tex2html_wrap_inline4972 S is polyhedral. tex2html_wrap_inline4680

  theorem2098

Proof Let S and tex2html_wrap_inline6710 be given nontrivial complementary subspaces for which tex2html_wrap_inline6842 and let b be an arbitrary element of tex2html_wrap_inline4684 . By Prop. gif, S has a basis from which an orthonormal basis tex2html_wrap_inline6682 can be produced by the Gram-Schmidt process (according to Prop. gif) and by Prop. gif U can be extended to an orthonormal basis tex2html_wrap_inline6704 for tex2html_wrap_inline4684 with tex2html_wrap_inline6734 an orthonormal basis for tex2html_wrap_inline6710 . Thus we can write tex2html_wrap_inline6862 = p + q, where tex2html_wrap_inline6866 and tex2html_wrap_inline6868 . The uniqueness of this representation of b follows from Prop. gif tex2html_wrap_inline4680

Because of the unique representation property in Prop. gif, tex2html_wrap_inline4684 is said to be the direct sum  of any pair of nontrivial complementary subspaces.

  theorem2120

Proof Let tex2html_wrap_inline6104 be given.
tex2html_wrap_inline5452 Assume S is a subspace of dimension 1 tex2html_wrap_inline4972 S has a basis which is a singleton set, say tex2html_wrap_inline5374 , where tex2html_wrap_inline5368 . Since S is a subspace and tex2html_wrap_inline6902 , every vector of the form tex2html_wrap_inline6904 tex2html_wrap_inline4972 tex2html_wrap_inline6908 . Let b be an arbitrary point of S tex2html_wrap_inline4972 tex2html_wrap_inline6916 for some tex2html_wrap_inline6918 (since tex2html_wrap_inline5374 is a basis for S) tex2html_wrap_inline4972 tex2html_wrap_inline6926 tex2html_wrap_inline4972 tex2html_wrap_inline6930 tex2html_wrap_inline4972 tex2html_wrap_inline6934 . Now tex2html_wrap_inline6936 and tex2html_wrap_inline6934 tex2html_wrap_inline4972 tex2html_wrap_inline6942 , a line through the origin.
tex2html_wrap_inline5490 Let S be a line through the origin tex2html_wrap_inline4972 tex2html_wrap_inline6950 for some tex2html_wrap_inline6952
(according to Prop. gif). Now tex2html_wrap_inline6954 is a subspace of tex2html_wrap_inline4684 (according to Prop. gif), tex2html_wrap_inline6958 is linearly independent (according to Prop. gif), and tex2html_wrap_inline6958 spans tex2html_wrap_inline6954 tex2html_wrap_inline4972 tex2html_wrap_inline6958 is a basis for subspace tex2html_wrap_inline6954 tex2html_wrap_inline4972 tex2html_wrap_inline6972 is a subspace of dimension 1. tex2html_wrap_inline4680

  theorem2149

Proof Let tex2html_wrap_inline6104 be given.
tex2html_wrap_inline5452 Assume S is a subspace of dimension n-1 tex2html_wrap_inline4972 tex2html_wrap_inline6710 has dimension 1 (according to Prop. gif). tex2html_wrap_inline4972 tex2html_wrap_inline6710 has a basis tex2html_wrap_inline5374 for some tex2html_wrap_inline5366 tex2html_wrap_inline4972 tex2html_wrap_inline7010 (according to Prop. gif) tex2html_wrap_inline4972 tex2html_wrap_inline7014 tex2html_wrap_inline4972 tex2html_wrap_inline7018 (according to Prop. gif). Now tex2html_wrap_inline7020 (according to Prop. gif) tex2html_wrap_inline4972 tex2html_wrap_inline7024 .
tex2html_wrap_inline5490 Assume S is a hyperplane through the origin tex2html_wrap_inline4972 tex2html_wrap_inline7032 for some tex2html_wrap_inline7034 tex2html_wrap_inline4972 tex2html_wrap_inline7038 . Since tex2html_wrap_inline7040 is a subspace of dimension 1 (according to Prop. gif), the dimension of tex2html_wrap_inline7044 is n-1 (according to Prop. gif). tex2html_wrap_inline4680


next up previous index
Next: Translation Up: Linear Combinations in Vector Previous: Basis for a Subspace

Richard V. Helgason
Wed Sep 19 10:07:14 CDT 2001