Zum Inhalt springen

Sum of subspaces

Aus Wikibooks

In this article, we define the sum of two subspaces. This sum will again be a subspace, containing the two initial subspaces. We can think of the sum as a structure-preserving union.

What is the sum of subspaces?

[Bearbeiten]

Consider two subspaces U and W of a vector space V. Now we want to combine these subspaces into a larger subspace that contains U and W. A first approach could be to consider UW. However, we have already seen in the article union and intersection of vector spaces that the union is generally not a subvector space.

Why is that the case? For uU and wW, the vector u+w is not always in UW, as you can see from this example.

Union of two lines in two-dimensional space
Union of two lines in two-dimensional space

In order to solve the problem, we add all sums of the form u+w with uU and wW to the union of the two subspaces U and W. That means, we consider UW{u+wuU,wW}. This expression still seems very complicated, but we can simplify it to {u+wuU,wW}.

Question: Why is UW{u+wuU,wW}={u+wuU,wW}?

Since U and W are subspace, the vector 0 is contained in both subspaces. Therefore, the following applies to allwW :

w=w+0{u+wuU,wW}

Therefore, W{u+wuU,wW}. Analogously, we get U{u+wuU,wW}.

We call this set the sum of U and W because it consists of the sums of vectors from U and W. Later we will show that this is a subspace.

Definition

[Bearbeiten]

Definition (Sum of two subspaces)

Let U and W be two subspaces of a vector space V. Then we define the sum of U and W as

U+W:={u+wVuU,wW}.

The sum is a subspace

[Bearbeiten]

We still have to prove that U+W is a subspace.

Theorem (The sum is a subspace)

The sum
U+W:={u+wVuU,wW}
is a subspace of V.

How to get to the proof? (The sum is a subspace)

We need to check the subspace criterion. To do so, we utilise the fact that all vectors vU+W can be written as v=u+w with uU and wW. We can then trace the conditions of the subspace criterion back to the respective properties of U and W.

Proof (The sum is a subspace)

Proof step: 0U+W

Since U and W are subspaces, we have 0U and 0W. Thus, 0=0+0U+W.

Proof step: U+W is closed with respect to addition

Let x,yU+W. We must show that x+yU+W. According to the definition of U+W, there exist u1,u2U and w1,w2W, such that x=u1+w1 and y=u2+w2. We know that U and W are subspaces and therefore closed with respect to addition. Hence,

x+y=(u1+w1)+(u2+w2)=(u1+u2)U+(w1+w2)WU+W.

Proof step: U+W is closed with respect to scalar multiplication

Let vU+W and λK. We must show that λvU+W. According to the definition of U+W, there exist uU and wW, such that v=u+w. Since U and W are closed with respect to scalar multiplication, we have

λv=λ(u+w)=λuU+λwWU+W.

Examples

[Bearbeiten]

Sum of two lines in ℝ²

[Bearbeiten]
The lines U and W

We consider the following two lines in 2:

U:={(x0)x} und W:={(xx)x}

So U is the x-axis and W is the line that runs through the origin and the point (1,1). What is the sum U+W?

Using the definition U+W={u+wuU,wW} we can calculate a convenient set description for U+W:

U+W={(x0)x}+{(xx)x}={(x0)x}+{(yy)y}={(x0)+(yy)x,y}={(x+yy)x,y}

We can write each vector in 2 as (x+y,y)T with matching x,y. Specifically, for each vector (a,b)T2 we can find scalars x and y such that (a,b)=(x+y,y), namely x:=ab and y:=b. Therefore, U+W=2 holds.

Intuitively, you can immediately see that U+W=2. This is because U+W is a subspace of 2, which contains the straight lines U and W. The only subspaces of 2 are the null space, lines that run through the origin and 2. As the straight lines U and W do not coincide but are different, U+W cannot be a line. Therefore, we must have U+W=2.

Sum of two lines in ℝ³

[Bearbeiten]
The lines U and W

Consider the following lines in 3:

U:={(xx2x)x} and W:={(3x05x)x}

Here U is the line in 3 that runs through the origin and the point (1,1,2) and W is the line that runs through the origin and (3,0,5). We want to determine the sum U+W={u+wuU,wW}.

U+W={(xx2x)x}+{(3y05y)y}={(xx2x)+(3y05y)x,y}={x(112)+y(305)x,y}

So U+W is the plane that is spanned by the vectors (1,1,2)T and (3,0,5)T.

Sum of two planes in ℝ³

[Bearbeiten]
The planes U1 and W

Consider the following two planes:

U1={(2xxy)x,y} and W={(02xy)x,y}

The planes are not equal. We can see this, for example, from the fact that the vector (2,1,0)T lies in U1, but not in W. Therefore, the two planes should intuitively span the entire space 3. So we can initially assume that U1+W=3.

We now try to prove this assumption. To do so, we have to show that each vector (a,b,c)T3 lies in the sum U1+W={u+wuU1,wW}. We must therefore find vectors (a,b,c)T for uU1 and wW such that (a,b,c)T=u+w. Then (a,b,c)TU1+W applies. Here we can use the definitions of U1 and W: Each vector uU1 can be written as (2x1,x1,y1)T with x1,y1. Similarly, each vector wW can be written as (0,2x2,y2)T with x2,y2. So we want to find numbers x1,y1,x2,y2 for the vector (a,b,c)T3 satisfying

(abc)=(2x1x1y1)+(02x2y2).

We can re-write this as

(abc)=(2x1+0x1+2x2y1y2)=(2x1x1+2x2y1y2).

How can we choose x1,y1,x2,y2 such that the above equation is satisfied? For instance,

x1:=12ay1:=cx2:=12b14ay2:=0

will do this job.

To summarise, the following applies to any vector (a,b,c)T3:

(abc)=(2(12a)12ac)U1+(02(12b14a)0)WU1+W

Therefore, U1+W=3 indeed holds, i.e. the two planes together span the entire 3.

Absorption property of the sum

[Bearbeiten]
The line U2 and the plane W

We have already looked at a few examples of sums in the space 3. Now let's look at another example in 3. Let

U2={(0x2x)x}andW={(0yz)y,z}

Then U2 is the line that runs through the origin and through the point (0,1,2). The subspace W is the y,z-plane.

What is the sum of the subspaces U2+W? The line U2 lies in the y,z-plane, i.e. in W. The sum is intuitively the subspace consisting of U2 and W. Since U2 is already contained in W, the sum should simply be W, i.e. U2+W=W. This is indeed the case, as the exercise below shows.

Intuitively, this should also apply more generally: Let U and W be two subspaces of an arbitrary vector space V. If U lies in W, i.e. UW, then the sum U+W should simply result in W. This is called the absorption property, as U is absorbed by W when taking the sum. We prove it in the following exercise.

Exercise (Absorption property of the sum)

Let V be a K-verctor space, as well as U and W two subspaces of V. Whenever UW, then it follows that U+W=W.

Solution (Absorption property of the sum)

We assume that UW applies and prove that U+W=W. To show this equality, we prove the two inclusions WU+W and U+WW.

Proof step: WU+W

Let wW. Then,

w=0U+wWU+W.

Proof step: U+WW

Let vU+W. Then there are vectors uU and wW, such that v=u+w. Since UW we have uW. We know that W is a subspace and therefore closed under addition. Furthermore, u,wW. Thus we get v=u+wW.

Hint

From the absorption property, we conclude U+U=U for any subspace U. This is because every subspace is contained within itself, i.e., UU.

Alternative definitions

[Bearbeiten]

Using the intersection

[Bearbeiten]

We have constructed a subspace U+W of V, which contains the two subspaces U and W. Since we have included only "necessary" vectors in our construction of U+W, this sum U+W should be the smallest subspace that contains both U and W.

We can also describe the smallest subspace containing U and W differently: We first consider all subspaces that contain U and W and then take the intersection of these subspaces. This intersection still contains U and W and is also a subspace, since the intersection of any number of subspaces is again a subspace. Intuitively, there should be no smaller subspace with this property. Thus, we also obtain the smallest subspace that contains both U and W. According to these considerations, it should therefore be the case that U+W is equal to the intersection of all subspaces containing U and W. We now want to prove this:

Theorem (Definition of the sum over the intersection of subspaces)

Let V be a vector space, as well as U and W two subspaces of V. For S:=UWZZ subspaceZ gilt:

S=U+W

Proof (Definition of the sum over the intersection of subspaces)

We prove the two inclusions SU+W and SU+W.

Proof step:

It is sufficient to show that U+W is a subspace that contains UW. Then it follows from the definition of S that

S=UWZZ subspaceZU+W.

We first show that U is contained in U+W. Then, W being contained in U+W will follow analogously. So let uU. Since W is a subspace, 0W. Therefore, u=u+0U+W.

Proof step:

We must show that every subspace Z of V that contains both U and W must also contain U+W.

Let Z be such a subspace. Let vU+W. Then there exist uU and wW with v=u+w.

In particular, u,wZ applies. Since Z is a subspace, v=u+wZ holds.

We have thus shown: U+WZ.

This renders us the two alternative definitions:

Definition (Definition of the sum of subvspaces via the intersection)

Let V be a vector space, as well as U and W two subspaces of V. Then the sum of U and W is given by

U+W=UWZZ subspaceZ.

Using the span

[Bearbeiten]

We can describe the smallest subspace containing U and W or UW in yet a third way. In the article "span", we saw that for a given subset M of V, the span of M is the smallest subspace containing M. Therefore, span(UW) is the smallest subspace that contains U and W. So it must also be equal to the sum U+W.

Theorem (Definition via the span)

Let V be a vector space, as well as U and W two subspaces of V. Then,

U+W=span(UW)

Proof (Definition via the span)

We show the two inclusions U+Wspan(UW) and U+Wspan(UW).

Proof step:

Let vU+W. Then there exist uU and wW with v=u+w. Because the span of UW consists of linear combinations of vectors from U and W, we indeed have v=u+wspan(UW).

Proof step:

we have seen that span(UW) is the smallest subspace that contains UW. Since U+W is a subspace of V that contains UW, we finally obtain span(UW)U+W.

Dimension formula

[Bearbeiten]

Now that we know what the sum of two subspaces U and W of a vector space V is, we can ask ourselves how large the sum U+W is. The sum of subspaces is the vector space analogue of the union of sets. For two sets X and Y, the union XY has a maximum of |X|+|Y| elements. If X and Y share elements, i.e. have a non-empty intersection, then XY has fewer than |X|+|Y| elements, because we count the elements from XY twice. This gives us the formula

|XY|+|XY|=|X|+|Y|.

In order to transfer this formula to vector spaces, we need the correct concept of the size of a vector space, i.e. the analogue for the cardinality of a set for vector spaces. This is exactly the idea of the dimension of a vector space. Therefore, if an analogue formula holds for vector spaces, the following should be true:

dim(U+W)+dim(UW)=dim(U)+dim(W).

If dim(UW) is finite, we can convert this formula to a formula for dim(U+W), namely

dim(U+W)=dim(U)+dim(W)dim(UW).

Before we prove our assumption, we will test it with a few examples:

The lines U and W

Let us reconsider the two lines from the example above:

U:={(x0)x} and W:={(xx)x}

We have already calculated above that U+W=2. This fits our assumption: 2 is two-dimensional, U and W are one-dimensional and the intersection UW={0} is zero-dimensional.

The planes U1 and W

Let us look again at the example above with the two planes:

U1={(2xxy)x,y} and W={(02xy)x,y}

We have already calculated above that U1+W=3 and the figure shows that U1 and W intersect in a straight line. This means that the dimension of U1+W is three, the dimension of U1 and W are both two and the dimension of U1W is just one. So the dimension formula also holds in this case.

As a final example, we consider the subspace U=3 in V=3 and

W={(x0x);x}

The subspace W is a line through the origin, i.e. dim(W)=1 and we have dim(U)=dim(3==3. Because UW, the Absorption property of the sum tells us that U+W=U=3. For the same reason, we have UW=W. Thus,

dim(U+W)=3=3+11=dim(U)+dim(W)dim(UW).

So the dimension formula is also valid in this case.

Theorem (Dimension formula)

Let V be a finite-dimensional K-vector space, as well as U and W two subspaces of V. Then,

dim(U+W)=dim(U)+dim(W)dim(UW).

How to get to the proof? (Dimension formula)

The motivation for our formula comes from the world of finite sets. Therefore, we would also like to trace the proof back to the case of (finite) sets. The structure of a vector space can be reduced to its basis, which is indeed a finite set. The cardinality of a basis is exactly the dimension of the vector space, so we can trace the dimension formula back to a statement about the cardinality of (finite) basis sets. To do so, we have to choose suitable bases BU,BW,BUW of U, W and UW for which BUBW=BUW. In this case, we obtain from the number-of-elements-formula for sets that BUBW has the desired size. Then we just have to prove that BUBW is a basis of U+W. We do this by reducing everything to the fact that BU and BW are already bases of U and W.

To construct the desired bases BU,BW and BUW, we use the basis completion theorem. With this we can extend a basis of UW to one of U and one of W.

Proof (Dimension formula)

Let now n=dim(U),m=dim(W) and k=dim(UW). Then there is a basis {v1,,vk} of UW. We can extend it to a basis BU:={v1,,vk,uk+1,,un} of U, as well as to a basis BW:={v1,,vk,wk+1,,wm} of W.

We now show that B:={v1,,vk,uk+1,,un,wk+1,,wm} is a basis of U+W.

Proof step: B is a generating system

Since according to the previous theorem we have U+W=span(UW)=span(BUBW)=span(B) , we know that B is a generating system of U+W.

Proof step: B is linearly independent

Let αi,βj,γlK with i{1,k},j{k+1,,n} and l{k+1,,m} such that

i=1kαivi+j=k+1nβjuj+l=k+1mγlwl=0.

We can re-write this as

i=1kαivi+j=k+1nβjujU=l=k+1mγlwlWUW.

Since {v1,,vk} is a basis of UW, we can write the above element as a linear combination of these basis vectors:

i=1kαivi+j=k+1nβjuj=i=1kα'ivi

This is equivalent to

i=1k(αiα)ivi+j=k+1nβjuj=0

Since BU={v1,,vk,uk+1,,un} is a basis of U, it follows that βj=0 for all j=k+1,,n and thus we get αiα'i=0 for all i=1,,k.

Plugging βj=0 into our first equation, we then get

i=1kαivi+l=k+1mγlwl=0.

This is a linear combination of the basis vectors from BW, so αi=0 must also apply for all i=1,,k and γl=0 for all l=k+1,,m. Hence B is linearly independent.

Since B is a basis of U+W , we have

dim(U+W)=|B|=k+(nk)+(mk)=n+mk=|BU|+|BW||{v1,,vk}|=dim(U)+dim(W)dim(UW).

Warning

The formula from the above theorem cannot be used for infinite-dimensional vector spaces. The reason is that there is no unique, meaningful way to subtract infinity from infinity. To illustrate this problem, consider the sets U={0,1,2,} and W={1,2,}. Then UW=W and thus |U|+|W||UW|=+, which makes mathematically no sense. The same can happen with vector spaces: For example, we can consider U=k[X] and W={fk[X]degf1} in V=k[X]. Again, UW=W and we have dim(U)+dim(W)dim(UW)=+.

However, if we move the term with the intersection to the other side of the equation, then the formula makes sense also for infinite-dimensional vector spaces. This means that for any subspaces U and W of a vector space V, we have

dim(U+W)+dim(UW)=dim(U)+dim(W).

For this formula to also make sense in infinite dimensions, we require +=, which is a mathematically meaningful and true statement.