index.md (4959B)
1 +++ 2 title = 'Introduction' 3 template = 'page-math.html' 4 +++ 5 6 # Introduction 7 ## Linear Equations 8 "the study of linear equations" 9 10 a linear equation in the variables $x_1, \dots, x_n$ has the form $a_1 x_1+\dots+a_n x_n = b$, with $a_1, \dots, a_n$ being the _coefficients_ 11 12 geometric interpretation: 13 14 $ 15 \begin{alignedat}{3} 16 &n=1\qquad &&a_1 x_1 = b \longrightarrow x_1 = \frac{b}{a_1}\qquad &&\text{(point on a line in $\Re$)}\\\\\\\\ 17 &n=2\qquad &&a_1 x_1 + a_2 x_2 = b \longrightarrow x_2 = \frac{b}{a_2} - \frac{a_1}{a_2}\qquad &&\text{(line in a plane in $\Re^2$)}\\\\\\\\ 18 &n=3\qquad &&a_1 x_1 + a_2 x_2 + a_3 x_3 = b\qquad &&\text{(planes in 3D space, in $\Re^3$)} 19 \end{alignedat} 20 $ 21 22 in general, $n-1$-dimensional planes in n-dimensional space 23 24 system of linear equations $x_1, \dots, x_n$ is a collection of linear equations in these variables. 25 26 $x_1 - 2x_2 = -1$ 27 28 $-x_1 + 3x_2 = 3$ 29 30 If you graph them, you get this: 31 32  33 34 the solution is the intersection. 35 36 a system of linear equations has: 37 1. no solutions (inconsistent) -- e.g. parallel lines 38 2. exactly 1 solution (consistent) 39 3. infinitely many solutions (consistent) - e.g. the same line twice 40 41 two linear systems are "equivalent" if they have the same solutions. 42 43 ## Matrix notation 44 <table> 45 <tr> 46 <td>Equation</td> 47 <td>(Augmented) coefficient matrix notation</td> 48 </tr> 49 <tr> 50 <td>$\begin{alignedat}{6} &x_1 &&-&&2x_2 &&+&&x_3 &&= 0\\\\ & && &&2x_2 &&-&&8x_3 &&= 8\\\\ &5x_1 && && &&-&&5x_3 &&= 10\end{alignedat}$</td> 51 <td>$\begin{bmatrix} 1 & -2 & 1 & 0\\\\ 0 & 2 & -8 & 8\\\\ 5 & 0 & -5 & 10 \end{bmatrix}$</td> 52 </tr> 53 </table> 54 55 the strategy to solve is to replace the system with an equivalent system that is easier to solve. 56 57 elementary row operations: 58 1. replacement: add rows 59 2. scaling: multiply by constant (non-zero scalar) 60 3. interchange: swap two rows 61 62 all of these are reversible & don't change the solution set. 63 64 Matrices A and B are equivalent ($A \sim B$) if there is a sequence of elementary operations to transform A to B. 65 66 If augmented matrices of two systems are row-equivalent, then the systems are equivalent. 67 68 Matrix A is in echelon form if: 69 a) zero rows are below non-zero rows 70 b) the leading entry of a row is contained in a column that is to the left of the leading entry of the row below it. 71 72 A is in reduced echelon form if: 73 a) A is in echelon form 74 b) all leading entries are 1 75 c) the leading entry is the only non-zero entry in that column 76 77 ## Reducing a matrix 78 The reduced echelon form of a matrix is unique. 79 80 every matrix is row-equivalent to a unique reduced echelon matrix. 81 82 the positions of the leading entries in an echelon matrix are unique 83 84 $\begin{bmatrix} \textbf{1} & * & * & *\\\\ 0 & 0 & \textbf{1} & *\\\\ 0 & 0 & 0 & 0\\\\ 0 & 0 & 0 & 0 \end{bmatrix}$ 85 86 the values in bold are pivot positions. the columns containing those values are pivot columns. 87 88 Row reduction algorithm: 89 1. Start with leftmost non-zero column (pivot column) 90 2. Select a non-zero entry as pivot and move it to the pivot position. 91 3. Create zeros below the pivot position. 92 4. Ignore the row containing the pivot position & repeat steps 1-3 until solved. The matrix will be in echelon form. 93 5. Make pivot positions equal to 1, create zeros in all pivot columns. Start with the rightmost column. The matrix will be in reduced echelon form. 94 95 Side note: a computer chooses as pivot the entry that's smallest in absolute value to minimize the round-off error. 96 97 Basic variables correspond to pivot columns. Free variables correspond to non-pivot columns. You solve the equation by expressing basic variables in terms of free variables. 98 99 The matrix can be written in parametric form, example with $x_3$ being a free variable: 100 101 $\binom{x_1}{x_2} = \big \\{ \binom{1}{4} + \binom{5}{-1} x_3 \\;\rvert\; x_3 \in \Re \\}$ 102 103 if there are any free variables, there are infinite solutions. 104 105 ## Vectors 106 A vector is a line. If you have a vector in the form $\begin{bmatrix} a\\\\b\end{bmatrix}$, you can draw it as an arrow from the origin ending at the point $(a,b)$. 107 108 To add vectors, add the individual cells together. 109 110 A vector equation $a_1 x_1 + a_2 x_2 + \dots + a_n x_n = b$ has the same solution set as $\begin{bmatrix} a_1 & a_2 & \dots & a_n & b \end{bmatrix}$. 111 112 When asked whether $b$ is in $\text{Span} \{v_1, \dots, v_p\}$, you have to check whether the augmented matrix $\begin{bmatrix} v_1 & \dots & v_p & b \end{bmatrix}$ has a solution. 113 114 $b$ is a linear combination of $A$ if $Ax = b$ has a solution. 115 116 The span is the set of all linear combinations of the vectors. 117 118 To calculate $Ax$, if the number of columns in A is the same as the number of rows in x, you can follow the definition: 119 120 $ 121 Ax = \begin{bmatrix} a_1 & a_2 & \dots & a_n \end{bmatrix} \begin{bmatrix} x_1 \\\\ \dots \\\\ x_n \end{bmatrix} = x_1 a_1 + x_2 a_2 + \dots + x_n a_n 122 $ 123 124 You also have the rules (matrix A, vectors u and v, scalar c): 125 * $A(u+v) = Au + Av$ 126 * $A(cu) = c(Au)$ 127 128