Linear map – Serlo

Aus Wikibooks

Linear maps are special maps between vector spaces that are compatible with the vector space structure. They are one of the most important concepts of linear algebra and have numerous applications in science and technology.

Motivation[Bearbeiten]

What makes linear maps special[Bearbeiten]

We have learned about the structure of vector spaces and studied various properties of them. Now we want to consider not only isolated vector spaces, but also maps between them. Some of these maps fit well with the underlying vector space structure and are therefore called linear maps or vector space homomorphisms. They are a generalization of linear functions through the origin in one dimension, whose graphs are lines (hence the name).

It is a typical approach in algebra to study maps that preserve the structure of an algebraic object, such as a vector space. For many algebraic objects such as groups, rings or fields, one often studies the corresponding structure-preserving maps between the respective algebraic structures - group homomorphisms, ring homomorphisms and field homomorphisms. For vector spaces, the structure-preserving maps are the linear maps (= vector space homomorphisms).

So let and be two vector spaces. When is a map structure-preserving or well compatible with the underlying vector space structures in and ? For this, let's repeat what the vector space structure is all about: They basically allow for two operations:

  • Addition of vectors: two vectors can be added, in a similar way to how numbers are added.
  • Scalar multiplication: vectors with a scaling factor (which is an element of the field) can be scaled. That means: compressed, stretched or mirrored.

Compatibility with addition[Bearbeiten]

Let's start with of addition of vectors: when is a function compatible with the additions and on the respective vector spaces and ? The most natural definition is the following:

A map is compatible with the addition if a sum is preserved by the map. Meaning, if is a sum within the vector space , then the images of , and , which are situated in vector space , also form a corresponding sum:

Thus, a map compatible with addition satisfies for all the implication:

This implication can be summarized in one equation by substituting the premise into the second equation. It thus suffices to require for all that:

This equation describes the first characteristic property of the linear map, namely "being compatible with vector addition". We can visualize it well for maps . A map is compatible with addition if and only if the triangle given by the vectors , and is preserved under applying the map. That means, also the three vectors , and hive to form a triangle:

maps are compatible with addition, if triangles are preserved by them
maps are compatible with addition, if triangles are preserved by them

If is not compatible with addition, there are vectors and with . The triangle generated by , and is then not preserved, because the triangle side of the initial triangle is not mapped to the triangle side in the target space:

If maps are not compatible with addition, at least one triangle is not preserved by the map.
If maps are not compatible with addition, at least one triangle is not preserved by the map.

Compatibility with scalar multiplication[Bearbeiten]

Analogously, we can naturally define that a map is compatible with scalar multiplication if and only if it is preserved by the map. So it should hold for all and for all scalars that

Note that is a scalar and not a vector and thus is not changed by the map under consideration. In other words, it can be "pulled out of the bracket". This move is only allowed if both vector spaces have the same underlying field. Both the domain of definition and the range of values must be vector spaces over the same .

Linear maps thus preserve scalings. From one may conclude . For the case where , straight lines of the form are mapped to the straight line . The above implication can be summarized in an equation. For all and , we require that:

For maps this means that a scaled vector is mapped to the correspondingly scaled version of the image vector:

Linear maps preserve scalings.
Linear maps preserve scalings.

If a map is not compatible with scalar multiplication, there is a vector and a scaling factor such that :

A map where scaling is not preserved. This is an example of a non-linear map.
A map where scaling is not preserved. This is an example of a non-linear map.

Recap[Bearbeiten]

A linear map is a special map between vector spaces that is compatible with the structure of the underlying vector spaces. In particular, this means that a linear map has the following two characteristic properties:

  • compatibility with addition: .
  • compatibility with scalar multiplication:

The compatibility with addition is called additivity and the compatibility with scalar multiplication is called homogeneity.

Definition[Bearbeiten]

Definition (Linear map)

Let and vector spaces over the same field . Let and be the respective inner operations. Further, let and be the scalar multiplications.

Now let be a map between these vector spaces. We call a linear map from to if the following two properties are satisfied:


  1. additivity: For all we have that
  2. homogeneity: For all and we have that

Hint

If it's clear from the context, in the future we'll also just write "" instead of and . Similarly, "" is often used instead of and are used. Sometimes the dot for scalar multiplication is completely omitted.

Hint

In the literature, the term vector space homomorphism or homomorphism for short is also used as a synonym for the term linear map. The ancient Greek word homós stands for equal, morphé stands for shape. Literally translated, a vector space homomorphism is a map between vector spaces, which leaves the "shape" of the vector spaces invariant.

Explanation of the definition[Bearbeiten]

The characteristic equations of the linear map are and . What do these two properties intuitively mean? According to the additivity property, it doesn't matter whether you first add and and then map them, or whether you first map both vectors and then add them. Both ways lead to the same result:

What does the homogeneity property mean? Regardless of whether you first scale by and then map it or first map the vector and then scale it by , the result is the same:

The characteristic properties of linear maps mean that the orders of function mapping and vector space operations do not matter.

Charakterization: linear combinations are mapped to linear combinations[Bearbeiten]

Besides the defining property that linear maps get along well with the underlying vector space structure, linear maps can also be characterized by the following property:

Linear maps are precisely those maps that map linear combinations to linear combinations

.

This is an important property because linear combinations are used to define important structures on vector spaces such as the linear independence or having generators. Also the definition of the basis relies on the notion of linear combination. The connection to linear combinations can be seen by looking at the two characteristic equations of linear maps:

We can apply the two formulas above step-by-step to a linear combination like for vectors and from . This allows us to "get the linear combination out of the bracket":

The linear combination is mapped by to and thus keeps its structure. The situation is similar for other linear combinations. For by the property sums "can be pulled out of the bracket" and by the property scalar multiplications "can be pulled out of the bracket". We thus obtain the following alternative characterization of the linear map: linear combinations are mapped to linear combinations.

Examples[Bearbeiten]

Stretch in -direction[Bearbeiten]

Our first example is a stretch by the factor in -direction in the plane . Here, every vector is mapped to . The following figure shows this map for . The -coordinate remains the same and the -coordinate is doubled:

stretching a vector
stretching a vector

Now let's see if this map is compatible with addition. So let's take two vectors and , sum them and then stretch them in -direction. The result is the same as if we first stretch both vectors in -direction and then add them:

stretching the sum of two vectors
stretching the sum of two vectors

This can also be shown mathematically. Our map is the function . We can now check the property :

Now let's check the compatibility with scalar multiplication. The following figure shows that it doesn't matter if the vector is first scaled by a factor of and then stretched in -direction or first stretched in -direction and then scaled by :

stretching and scaling a vector
stretching and scaling a vector

This can also be shown formally: For and we have that

So our is a linear map.

Rotations[Bearbeiten]

In the following, we consider a rotation of the plane by the angle (measured counter-clockwise) with the origin as center of rotation. Thus, it is a map that assigns to every vector the vector rotated by the angle :

Rotating a vector by the angle

Let us now convince ourselves that is indeed a linear map. To do this, we need to show that:

  1. is additive: for all , we have .
  2. is homogeneous: For all and we have .

First, we check additivity, that is, the equation . If we add two vectors and then rotate their sum by the angle , the same vector should come out, as if we first rotate the vectors by the angle and then add the rotated vectors and . This can be visualized by the following two videos:


Now we come to homogeneity: . If we first stretch a vector by a factor and then rotate the result by the angle , we should get the same vector as if we first rotate the by an angle and then scale the result by the factor . This is again visualized by two videos:

Thus, rotations in are indeed linear maps.

Linear maps between vector spaces of different dimension[Bearbeiten]

An example of a linear map between two vector spaces with different dimensions is the following projection of the space onto the plane :

We now check whether the vector addition is preserved. That means, for vectors we need that

This can be verified directly:

Now we check homogeneity. For all and we need:

We have that

So the projection is a linear map.

A non-linear map[Bearbeiten]

Next, we investigate some examples for non-linear maps. It is easy to come up with such maps: basically any function on whose graph is not a line is a non-linear map. So "most maps are non-linear".

Of course, there are also examples for non-linear maps on . For instance, consider the norm mapping on the plane which assigns the length to every vector:

This map is not a linear map, because it does not preserve either vector addition or scalar multiplication. We show this by a counterexample:

Consider the two vectors and . If we add the vectors first and map them (determine their length) afterwards, we get

Now we determine the lengths of the vectors first and then add the results:

Thus we have that

This shows that the norm mapping is not additive. Finding a contradiction to one property (either additivity or homogeneity) already proves that the normal mapping is not linear.

Alternatively, we could have shown that the norm mapping is not homogeneous:

Applied examples[Bearbeiten]

Linear maps are used in almost all technological fields. Here is just a very tiny collection of some examples:

  1. In order to make predictions or control machines, complicated functions are often approximated by linear ones (regression). Mainly because linear maps are easy to handle.
  2. The best known case where linear maps make our lives easier are computer graphics. Any scaling of a photo or graphic is a linear map. Even different screen resolutions ended up being linear maps.
  3. Search engines use page ranks of a website to sort their search results. our "Serlo-page", also gets a ranking this way. To determine the page rank, a so-called Markov chain is used, which is a somewhat more sophisticated linear map.

Linear maps preserve structure[Bearbeiten]

Main article: Properties of linear maps

A linear map, also called vector space homomorphism, preserves the structure of the vector space. This is shown in the following properties of a linear mapping :

  • The zero vector is mapped to the zero vector: .
  • Inverses are mapped to inverses: .
  • Linear combinations are mapped to linear combinations.
  • Compositions of linear maps are again linear
  • Images of subspaces are subspaces
  • The image of a span is the span of the individual image vectors: ( is supposed to be an arbitrary set)

Relation to linear functions and affine maps[Bearbeiten]

Linear functions in one dimension take the form with . They are only linear maps in some cases, namely for . As an example, for and :

Maps are in fact linear, if and only if , i.e., the map takes the form with . The functions of the form are called affine-linear maps or simply affine maps: They are the sum of a linear map and a constant translational term . Every linear map is affine-linear, but not the other way round!

However, affine maps still map straight lines to straight lines and preserve parallel lines and ratios of distances.

We can always decompose an affine map into a linear map and a translation . We have that also . Because the translations are easy to describe, the linear part is usually more interesting. In the theory we therefore only look at the linear part.

Exercises[Bearbeiten]

The identity is a linear map[Bearbeiten]

Exercise (The identity is a linear map)

Let be a -vector space. Prove that the identity with is a linear map.

Proof (The identity is a linear map)

The identity is additive: Let , then.

The identity is homogeneous: Let and , then

The map to zero is a linear map[Bearbeiten]

Exercise (The map to zero is a linear map)

Let be two -vector spaces. Show that the map to zero , which maps all vectors to the zero vector , is linear.

Proof (The map to zero is a linear map)

is additive: let be vectors in . Then

is homogeneous: Let and let . Then

Thus, the map to zero is linear

Linear maps on the real numbers[Bearbeiten]

Exercise (Linear maps on the real numbers)

Let with . Show that is a linear map, if and only if .

Solution (Linear maps on the real numbers)

Let first be a linear map. Since linear maps map the origin to the origin, must hold. Now and so must hold.

Let now . We show that is linear:

Proof step: additivity

Let and be any two real numbers. We have that

Proof step: homogeneity

Let and be two real numbers. We have that

So is a linear map, if and only if .