Quelltext der Seite Serlo: EN: Introduction: Matrices

{{#invoke:Mathe für Nicht-Freaks/Seite|oben}}
In this article, we introduce matrices as an efficient representation of linear maps. A matrix (of a linear map <math>f:K^n\to K^m</math>) is a rectangular arrangement of elements from <math>K</math> ("numbers") that specifies where the standard basis of <math>K^n</math> is mapped by <math>f</math>. 

== Derivation {{Anker|Herleitung}} ==
Let <math> K </math> be a field and <math> f: K^n \to K^m </math> a linear map. We want to describe this map in the most efficient way. Since we know from the article [[Serlo: EN: Vector space of a linear map#Anker:Dimension|"vector space of a linear map"]] that the space of linear maps from <math> K^n </math> to <math> K^m </math> has dimension <math> n \cdot m </math>, and that <math> f </math> is an element of this space. So we need <math> n \cdot m </math> numbers to describe our linear map. We are looking for a way to write down these numbers in an organized way.

Let <math> \{e_1, \dots, e_n\} </math> be the standard basis of <math>K^n</math>. Then, following the [[Serlo: EN: Linear continuation#Anchor:linear continuation|principle of linear continuation]], <math> f</math> is already completely determined by the vectors <math> f(e_1), \dots, f(e_n)\in K^m</math> : If <math> x \in K^n </math> is an arbitrary vector, we can write it as a linear combination <math> x = x_1e_1 + \dots + x_ne_n </math> of the basis elements, and because of linearity we know the value <math> f(x) = x_1f(e_1) + \dots + x_nf(e_n) </math>.

So we need the "data" <math>f(e_1), \dots, f(e_n)</math> to describe the linear map. These data are <math>n</math> vectors in <math>K^m</math>. So we can write them as
{{formel|<math>f(e_1) = \begin{pmatrix}a_{11}\\\vdots\\a_{m1}\end{pmatrix}, \dots, f(e_n) = \begin{pmatrix}a_{1n}\\\vdots\\a_{mn}\end{pmatrix}</math>}}
for certain "numbers" <math> a_{ij} \in K</math>. This is a notation for tracking all necessary data of the linear map. But we can still make it more efficient: We just omit the "<math>f(e_i) =</math>" and agree on the convention that the <math>i</math>-th column describes the image of the <math>i</math>-th basis vector: 
{{formel|<math>\begin{pmatrix}a_{11}\\\vdots\\a_{m1}\end{pmatrix}, \dots, \begin{pmatrix}a_{1n}\\\vdots\\a_{mn}\end{pmatrix}</math>}}
To save even more space, we can also combine the entries of these vectors into a single "table", still with the image of the <math>i</math>-th basis vector being in the <math>i</math>-th column:
{{formel|<math>\begin{pmatrix}
a_{11} & \dots & a_{1n}\\
\vdots & & \vdots\\
a_{m1} & \dots & a_{mn}\\
\end{pmatrix}</math>}}
We call this "table in parenthesis" a '''matrix'''. It is the matrix associated with the linear map <math> f </math>. 

The matrix completely determines <math> f </math> and it consists of <math> n \cdot m </math> numbers as entries, which is consistent with our considerations above.

== Definiton ==
{{:Mathe für Nicht-Freaks: Vorlage:Definition
 |titel=Matrix
 |definition=
Let <math>K</math> be a field and <math>n, m \in \N</math>. Let <math>a_{ij} \in K</math> for all <math>1\le i \le m</math> and <math>1 \le j \le n</math>. Then we call
{{formel|<math>A :=
\begin{pmatrix}
a_{11} & \dots & a_{1n}\\
\vdots & & \vdots\\
a_{m1} & \dots & a_{mn}\\
\end{pmatrix}
= (a_{ij})_{1\le i \le m, 1 \le j\le n}</math>}}
an <math>m\times n</math>-matrix. We denote the set of all <math>m\times n</math> matrices by <math>K^{m\times n}</math>.
}}

{{:Mathe für Nicht-Freaks: Vorlage:Beispiel
 |titel=Linear map from <math>\R^3</math> to <math>\R^2</math>
 |beispiel=
We consider the linear map
{{Formel|<math>f:\R^3\to\R^2;f\begin{pmatrix}v_1\\v_2\\v_3\end{pmatrix}:=\begin{pmatrix}v_2-v_3\\3v_1+5v_3\end{pmatrix}.</math>}}

We can see that <math>f</math> is indeed linear in an [[Serlo: EN: Exercises Linear Maps#Aufgabe:Lineare_Abbildung_von_3D_nach_2D|exercise]].

In the derivation we have seen that we can describe <math> f </math> by a matrix. We want to compute this matrix here explicitly. To do so, we need to determine the images of the standard basis vectors 
{{Formel|<math> e_1=\begin{pmatrix}1\\0\\0\end{pmatrix}, e_2=\begin{pmatrix}0\\1\\0\end{pmatrix}, e_3=\begin{pmatrix}0\\0\\1\end{pmatrix}</math>}}
For these,
{{Formel|<math>\begin{align}
&f( e_1) = f\begin{pmatrix}1\\0\\0\end{pmatrix} = \begin{pmatrix}0\\3\end{pmatrix}\\[0.3em]
&\,f( e_2) = f\begin{pmatrix}0\\1\\0\end{pmatrix} = \begin{pmatrix}1\\0\end{pmatrix}\\[0.3em]
&\,f( e_3) = f\begin{pmatrix}0\\0\\1\end{pmatrix} = \begin{pmatrix}-1\\5\end{pmatrix}\end{align}</math>}}
Thus the three vectors 
{{Formel|<math> \begin{pmatrix}0\\3\end{pmatrix}, \begin{pmatrix}1\\0\end{pmatrix}, \begin{pmatrix}-1\\5\end{pmatrix}</math>}} 
contain all the information of the linear map <math>f</math>.  
If we write these side by side in a table, we get the matrix
{{Formel|<math>
\begin{pmatrix}0&1&-1\\3&0&5\end{pmatrix}</math>}}
which represents <math> f </math>.
}}

{{:Mathe für Nicht-Freaks: Vorlage:Beispiel
 |titel=Embedding <math>\R^2\to\R^3</math>
 |beispiel=
Let us now consider the standard embedding of <math> \R^2 </math> into <math>\R^3</math>, that is, the linear map 
{{formel|<math> \iota: \R^2 \to \R^3; \, \iota \begin{pmatrix} x\\ y \end{pmatrix} :=  \begin{pmatrix} x\\ y\\ 0 \end{pmatrix}. </math>}}
For the vectors of the standard basis, we have
{{formel|<math> \iota \begin{pmatrix} 1\\ 0 \end{pmatrix} :=  \begin{pmatrix} 1\\ 0\\ 0 \end{pmatrix}, \ \iota \begin{pmatrix} 0\\ 1 \end{pmatrix} :=  \begin{pmatrix} 0\\ 1\\ 0 \end{pmatrix}. </math>}}
So the embedding <math> \iota </math> is represented by the matrix
{{formel|<math> \begin{pmatrix} 1 & 0\\ 0 & 1\\ 0 & 0 \end{pmatrix}. </math>}}
}}

{{:Mathe für Nicht-Freaks: Vorlage:Beispiel
 |titel=Reflection of <math>\R^2</math> along an axis
 |beispiel=
Let's still examine the reflection of <math> \R^2 </math> along the x-axis. When we mirror a vector <math> \begin{pmatrix} x\\y \end{pmatrix} </math> along the x-axis, we keep its x-component fixed and change the sign of its y-component. The reflection is thus given by 
{{formel|<math> s: \R^2 \to \R^2; \, s \begin{pmatrix} x\\ y \end{pmatrix} :=  \begin{pmatrix} x\\ -y \end{pmatrix}</math>}}

The first basis vector lies on the x-axis and is therefore not affected by the reflection. Formally: {{formel|<math> s\begin{pmatrix} 1\\0 \end{pmatrix} = \begin{pmatrix} 1\\0 \end{pmatrix}. </math>}} 

The second basis vector is perpendicular to the x-axis and is therefore mapped to its negative. Formally: {{Formel|<math> s\begin{pmatrix} 0\\1 \end{pmatrix} = \begin{pmatrix} 0\\-1 \end{pmatrix}. </math>}}

As the matrix associated with this reflection, we thus obtain:
{{formel|<math> \begin{pmatrix} 1 & 0\\ 0 & -1\end{pmatrix}. </math>}}
}}

== Matrix-Vector Multiplication {{Anker|Matrix-Vektor-Multiplikation}} ==
=== Derivation ===
We have just seen how we can represent a linear map by a matrix. Suppose, we now do not a linear map, but only its associated matrix. What does the image of an arbitrary vector under this linear map look like?

First, for simplicity, let's consider the vector space <math> \R^2 </math> and any linear map <math>f:\R^2\rightarrow \R^2</math> be a linear map, of which we know that the associated matrix is
{{Formel|<math>A = \begin{pmatrix} a & b \\ c & d \end{pmatrix}\in \R^{2\times 2}</math>}}
That means, we have

{{Formel|<math>f\begin{pmatrix}1\\0\end{pmatrix} = \begin{pmatrix}a\\c\end{pmatrix}</math> and <math>f\begin{pmatrix}0\\1\end{pmatrix} = \begin{pmatrix}b\\d\end{pmatrix}.</math>}}

We want to calculate the image of an arbitrary vector <math>(x, y)^T\in\R^2</math> under the map <math>f</math>, using the entries of the matrix <math>A</math>.

To do so, we represent our vector as a linear combination of the standard basis vectors, i.e.
{{Formel|<math>\begin{pmatrix}x\\ y \end{pmatrix} = x\begin{pmatrix}1\\ 0 \end{pmatrix} + y\begin{pmatrix}0\\ 1 \end{pmatrix}.</math>}}
Now we can exploit the linearity of <math> f </math> and calculate:

{{Formel|<math>\begin{align} f\begin{pmatrix}x\\y\end{pmatrix}
=& f\left( x\begin{pmatrix}1\\0\end{pmatrix} + y \begin{pmatrix}0\\1\end{pmatrix} \right)\\
=& x \cdot f\begin{pmatrix}1\\0\end{pmatrix} + y \cdot f\begin{pmatrix}0\\1\end{pmatrix}\\
=& x \begin{pmatrix}a\\c\end{pmatrix} + y \begin{pmatrix}b\\d\end{pmatrix}\\
=& \begin{pmatrix}xa\\xc\end{pmatrix} + \begin{pmatrix}yb\\yd\end{pmatrix}\\
=& \begin{pmatrix}ax + by \\cx + dy\end{pmatrix}\end{align}</math>}}

By this calculation, we can describe the effect of applying a linear map <math>f</math> to a vector, only by using the matrix <math>A</math>. This calculation works for any vector and any <math>2\times 2</math>-matrix. To simplify the notation, let us define a "multiplication operation" for matrices and vectors:

{{Formel|<math>\begin{pmatrix}a&b\\c&d\end{pmatrix}\begin{pmatrix}x\\y\end{pmatrix} :=  \begin{pmatrix}ax + by \\cx + dy\end{pmatrix}</math>}}

We call this the "matrix-vector multiplication" and formally write it as a product.
The generalization from a <math>2\times 2</math> to an <math>n\times n</math>-matrix is given in the following exercise:

{{:Mathe für Nicht-Freaks: Vorlage:Aufgabe
|aufgabe=
Let <math>f \colon K^n \to K^m</math> be a linear map and <math>A</math> the associated matrix. Find a formula to calculate the value <math>f(v)</math> for a given vector <math>v\in K^n</math> by using  the entries of the matrix <math>A</math>.
|lösung= 
We write <math> v </math> as a linear combination of the standard basis vectors: let <math> v_1, \dots , v_n \in K</math> be the "coordinates", such that <math> v = v_1e_1 + \dots + v_ne_n </math> holds.
That <math> A </math> is the matrix associated with <math> f </math> means that <math> f(e_i) = (a_{1i}, \dots, a_{mi})^{T} </math> is satisfied for all <math> i = 1, \dots,n </math>. Thus, it follows for <math>v</math> that
{{Formel|<math>\begin{align}
f(v) &= v_1f(e_1) + \dots + v_nf(e_n)\\[0.3em]
&= v_1\begin{pmatrix}a_{11}\\ \vdots \\a_{m1} \end{pmatrix} + \dots + v_n\begin{pmatrix}a_{1n}\\ \vdots \\a_{mn} \end{pmatrix}\\[0.3em]
&= \begin{pmatrix}v_1a_{11} + \dots + v_na_{1n}\\ \vdots \\v_1a_{m1} + \dots + v_na_{mn} \end{pmatrix}
\end{align}</math>}}
Using the sum notation, we can write the result as
{{Formel|<math> f(v) = \begin{pmatrix}\sum_{j=1}^n v_ja_{1j}\\ \vdots \\ \sum_{j=1}^n v_ja_{mj} \end{pmatrix}</math>}}
}}
The solution of this exercise provides us with a formula to calculate the value of a vector under a mapping, using the associated matrix. We now define <math> Av </math> using the formula found in the solution.

=== Definition ===
{{:Mathe für Nicht-Freaks: Vorlage:Definition
|titel=Matrix-Vector Multiplication
|anker=Matrix-Vektor-Multiplikation
|definition= Let <math>K</math> be a field <math>A=(a_{ij})\in K^{m\times n}</math> and <math>x\in K^n</math>. Then we define
{{Formel|<math>A \cdot x = \begin{pmatrix} a_{11} & \dots & a_{1n} \\ \vdots & & \vdots\\ a_{m1} & \dots & a_{mn} \end{pmatrix} \cdot \begin{pmatrix} x_1\\ \vdots \\ x_n \end{pmatrix} = \begin{pmatrix} \sum_{j=1}^n a_{1j}x_j \\ \vdots \\ \sum_{j=1}^n a_{mj}x_j \end{pmatrix} = \left(\sum_{j=1}^n a_{ij}x_j\right)_{i}</math>}}
}}

From another point of view this means: If we consider the matrix <math> A</math> as a collection of column vectors
{{Formel|<math> A=\begin{pmatrix}|&&|\\ a_1&\cdots& a_n\\|&&|\end{pmatrix}</math>}}
then the product <math> A\cdot x</math> is a linear combination of the columns of <math> A</math> with the coefficients in <math> x</math>, namely <math> A\cdot x=x_1 a_1+\cdots x_n a_n</math>.

=== How can you best remember how applying a matrix to a vector works? ===

[[Datei:Matrix vector multiplication.svg|miniatur|To apply a matrix to a vector, you need to compute "row times column".]]
You may perform a matrix-vector multiplication by using the rule "row times column": The first entry of the result is the first row of the matrix times the column vector. The second entry is the second row of the matrix times the column vector, etc. for larger matrices. For each "row times column" product, you multiply the related entries (first times first, second times second, etc.) and add the results.

It is important that the type of the matrix and the type of the vector match. If you have set up everything correctly so far, this should always be the case, because a linear map <math>f\colon K^n\to K^m</math> includes an <math>m\times n</math> matrix. You can apply this matrix to vectors of <math>K^n</math>, since rows and columns have both length <math>n</math>.

== Reverse direction: The induced linear map{{Anker|induzierte Abbildung}} ==
We have seen that every linear map has an associated matrix. Given a linear map <math> f </math>, we constructed a matrix <math> A </math> such that <math> f(v) = Av </math>. That is, some matrices define a linear map. But do all matrices define a linear map? And if yes, what does the corresponding mapping look like?

If a matrix <math> A </math> is derived from a linear map <math> f </math>, then we can get <math> f </math> back from <math> A </math> by defining it as the map <math> v \mapsto Av </math>. More generally, we can apply this rule to any matrix <math> A </math> and obtain corresponding a linear map <math> f </math>.

So let <math> A </math> be an <math>m\times n</math> matrix. We consider <math>K^n \to K^n, \ v \mapsto Av</math>. This map is indeed linear:

{{formel|<math>\begin{align}
A \cdot (v + w) &= \begin{pmatrix} a_{11} & \dots & a_{1n} \\ \vdots & & \vdots\\ a_{m1} & \dots & a_{mn} \end{pmatrix} \cdot \left[ \begin{pmatrix} v_1\\ \vdots \\ v_n \end{pmatrix} + \begin{pmatrix} w_1\\ \vdots \\ w_n \end{pmatrix} \right]\\[0.3em]
&= \begin{pmatrix} \sum_{j=1}^n a_{1j}(v_j + w_j) \\ \vdots \\ \sum_{j=1}^n a_{mj}(v_j + w_j) \end{pmatrix}\\[0.3em]
&= \begin{pmatrix} \sum_{j=1}^n a_{1j}v_j \\ \vdots \\ \sum_{j=1}^n a_{mj}v_j \end{pmatrix} + \begin{pmatrix} \sum_{j=1}^n a_{1j}w_j \\ \vdots \\ \sum_{j=1}^n a_{mj}w_j \end{pmatrix}\\[0.3em]
&= A \cdot v + A \cdot w.
\end{align}</math>}}

That means, ''every matrix defines a linear map''.

{{:Mathe für Nicht-Freaks: Vorlage:Definition
 |titel=Induced linear map
 |definition=Let <math>A\in K^{m\times n}</math> be a matrix over the field <math>K</math>. Then the linear map

{{formel|<math>f_A:\, K^n \to K^m,\; f_A(v) := Av</math>}}

is called the ''linear map induced by the matrix <math>A</math>''.
}}

Thus, we now know that for each linear map there is an associated matrix, and for each matrix there is an associated linear map. For a linear map <math>f</math>, we call the associated matrix <math>M(f)</math>. Our construction of the induced mapping is built exactly such that <math>f = f_{M(f)}</math>. This is quite intuitive: the linear map induced by the matrix associated to a linear map <math> f </math> is just map <math> f </math> itself. We can now ask the "reverse question": If we consider the associated matrix of a linear map induced by some original matrix, is this the original matrix, again? So in mathematical terms: Is <math> A = M(f_A) </math>? The following theorem answers this question in the affirmative:

{{:Mathe für Nicht-Freaks: Vorlage:Satz
 |satz=
The mappings <math>\operatorname{Hom}(K^n, K^m) \to K^{m\times n}; f \mapsto M(f)</math> and <math>K^{m\times n} \to \operatorname{Hom}(K^n,K^m); A \mapsto f_A</math> are bijections and each other's inverse. In particular, <math>M(f_A) = A</math>.
 |beweis=
To show that the two mappings are inverse to each other, it suffices to show that applying them after each other (in any of the two orders) yields the identity. This would directly imply that both mappings are bijective. So it suffices to show that <math> f_{M(f)} = f </math> and that <math> M(f_A) = A </math>. We already know that the first equation holds. So it only remains to show the second. 
Let <math> A </math> be any <math> m \times n </math>-matrix. Let <math> A_{ij} </math> be the entry in the <math>i</math>-th row and <math>j</math>-th column of <math> A </math> and let <math> M_{ij} </math> be the corresponding entry of the matrix <math> M(f_A) </math>.

By definition of <math> f_A </math> we have
{{Formel|<math> f_A(e_j) = Ae_j = \begin{pmatrix} A_{1j} \\ \vdots \\ A_{mj} \end{pmatrix}.</math>}}
So the <math>i</math>-th entry of the vector <math>f_A(e_j)</math> is equal to <math> A_{ij} </math>. That is, <math> (f_A(e_j))_i = A_{ij} </math>.

By definition of the matrix <math> M(f_A) </math> associated with <math>f_A</math>, the <math>j</math>-th column of <math> M(f_A) </math> is equal to the image of <math> e_j </math> under <math> f_A </math>. Thus,
{{Formel|<math> f_A(e_j) = \begin{pmatrix} M_{1j} \\ \vdots \\ M_{mj} \end{pmatrix}.</math>}}
In particular, it follows for the <math>i</math>-th entry of <math> f_A(e_j), </math> that <math> (f_A(e_j))_i = M_{ij}. </math>

Overall, we get <math> A_{ij} = (f_A(e_j))_i = M_{ij}. </math> Since <math> i </math> and <math> j </math> were arbitrarily chosen, all entries of the two matrices are equal and indeed <math> A = M(f_A). </math>
}}
We have thus shown that matrices and linear maps are in a "one-to-one-correspondence". 
{{#invoke:Mathe für Nicht-Freaks/Seite|unten}}