03 Pre-Class Assignment: Linear Equations
Contents
03 Pre-Class Assignment: Linear Equations#
Readings for this topic (Recommended in bold)#
Assignment Overview#
1. System of Linear Equations#
In this course we will spend a lot of time working with systems of linear equations. A linear equation is in the form:
Where \(a_1, a_2, a_3, \ldots a_n\) and \(b\) are known constants and \(x_1, x_2, x_3, \ldots x_n\) are unknown values. Typically we have systems of equations with different values of \(a\)s and \(b\)s but the unknowns are the same. For example, consider the example of linear equations in the following video.
✅ TODO: Watch the video and follow along in the notebook.
from IPython.display import YouTubeVideo
YouTubeVideo("CH68cc7sH4A",width=640,height=360, cc_load_policy=True)
Giselle works as a carpenter and as a blacksmith. She earns 20 dollars per hour as a carpenter and 25 dollars per hour as a blacksmith. Last week, Giselle worked both jobs for a total of 30 hours, and earned a total of 690 dollars. How long did Giselle work as a carpenter last week, and how long did she work as a blacksmith?
This problems gives us two equations and two unknowns:
How would we solve this in linear algebra?
First, we can multiply the first equation by -20 and add to the second equation. This is often called a “linear combination” of the two equations. The operation does not change the answer:
This is our new system of equations: $\( c + b = 30\)\( \)\( 0c + 5b = 90\)$
Now we can easily divide the second equation by 5 and get the value for \(b\):
If we substitute 18 for \(b\) into the first equation we get: $\( c + 18 = 30\)$
And solving for \(c\) gives us \(c = 30-18=12\). Let’s check to see if this works by substituting \(b=18\) and \(c=12\) into our original equations:
Let’s check the answer using Python:
b = 18
c = 12
c + b == 30
20*c + 25*b == 690
✅ QUESTION: The above video described three (3) elementary operationss that can be applied to a system of linear equations and not change their answer. What are these three operations?
Erase the contents of this cell and put your answer to the above question here
2. Visualizing the problem#
We can visualize the solution to a system of linear equations in a graph. If we make \(b\) the “\(y\)”-axis and \(c\) the “\(x\)”-axis. For each equation, we calculate the \(b\) value for each \(c\), and two equations give us two lines.
Note: This is sometimes called the “Row Picture.” Think about why it has this name and we will discuss this further in class.
from IPython.display import YouTubeVideo
YouTubeVideo("BSxWO6FGib0",width=640,height=360, cc_load_policy=True)
%matplotlib inline
import matplotlib.pylab as plt
import numpy as np
c = np.linspace(0,20)
c
b1 = 30-c
b2 = (690-20*c)/25
Row Picture#
plt.plot(c,b1)
plt.plot(c,b2)
plt.xlabel('c (hours worked as carpenter)')
plt.ylabel('b (hours worked as blacksmith)')
plt.scatter(12,18);
Now, consider the next set of equations which do not have a solution
x = np.linspace(-10,10)
y1 = 3+2*x
y2 = (2+4*x)/2
plt.plot(x,y1)
plt.plot(x,y2);
from IPython.display import YouTubeVideo
YouTubeVideo("Z9gkovHDpIQ",width=640,height=360, cc_load_policy=True)
Consider the next set of equations which have infinite many solutions
x = np.linspace(-10,10)
y1 = (4*x-6)/2
y2 = (6*x-9)/3
plt.plot(x,y1)
plt.plot(x,y2)
✅ DO THIS: Plot the following equations from -100 to 100
# Put your python code here
✅ QUESTION: Using the graph, what is a visual estimation of the solution to these two equations? Hint, you may want to change the \(x\) range to “zoom” in on the intersection.
Put your answer to the above question here.
Column Picture#
Now, consider the following system of equations.
I think a good programmer is a lazy person. Let’s avoid repeating all variables in each of the above equations by changing the system into a column vector format as follows.
Notice that this still represents the same system of equations. We just write the constants in front of a given unknown variable into column vectors and we only have to write the unknowns once (since they are the same for all equations).
Let’s plot this “column picture”, which shows how the above equation is a “linear combination” of the two column vectors.
One way to think about this is we can only move in straight lines in two directions. The first direction is (1,20) and the second is (1,5). The solution to the problem is how far in each direction we need to move to arrive at our final destination of (30,330).
The first column is a vector in the (1,20) direction. The variable \(c\) is how far in the (1,20) direction we want to go. Then \(b\) is how far in the (1,5) direction we want to go to arrive at the point (30,330).
We will use the matplotlib function arrow to plot the vectors. The arrow function takes a starting point \([x,y]\) and a direction \([dx,dy]\) as inputs and draws an arrow from the starting point in the direction specified.
First thing to do is plot the first column as a vector. From the origin (0,0) to \(c\left[ \begin{matrix} 1 \\ 20 \end{matrix} \right]\)
or \(x = c\) and \(y = 20c\) with \(c=12\)
c = 12
#hack to initialize bounds of plot (need this to get the arrows to work?)
plt.plot(0,0)
plt.plot(30,330)
# Plot the first arrow
plt.arrow(0, 0, c*1, c*20,head_width=2, head_length=10, fc='blue', ec='blue')
Next thing to do is plot the second column as a vector by adding it to the first. This arrow will start at the end of the previous vector and “add” the second column vector:
b = 18
#hack to initialize bounds of plot (need this to get the arrows to work?)
plt.plot(0,0)
plt.plot(30,330)
# Plot the first arrow
plt.arrow(0, 0, c*1, c*20,head_width=2, head_length=10, fc='blue', ec='blue')
#Plot the second arrow starting at the end of the first
plt.arrow(c, c*20, b*1, b*5, head_width=2, head_length=10, fc='red', ec='red')
The takeaway to this figure is that these two column vectors, when added together, end up at the point that represents the right hand side of the above equation (i.e. (30, 330)).
#hack to initialize bounds of plot (need this to get the arrows to work?)
plt.plot(0,0)
plt.plot(30,330)
# Plot the first arrow
plt.arrow(0, 0, c*1, c*20,head_width=2, head_length=10, fc='blue', ec='blue')
#Plot the second arrow starting at the end of the first
plt.arrow(c, c*20, b*1, b*5, head_width=2, head_length=10, fc='red', ec='red')
#Plot a righthand column vector as a point.
plt.arrow(0,0, 30, 330, head_width=2, head_length=10, fc='purple', ec='purple')
plt.xlabel('x');
plt.ylabel('y');
We say that the two column vectors \(u\) and \(v\) “span” the \(xy\)-plane, provided that any vector in the \(xy\)-plane can be represented as a linear combination of the two vectors, i.e., given any vector \(w\), there exist scalars \(a\) and \(b\), such that \(w=au+bv\). This notion can be generalized to higher dimensions.
✅ QUESTION: Give an example of two column vectors that do NOT span the \(xy-\)plane:
Put your answer to the above question here.
3. Multidimentional Spaces#
from IPython.display import YouTubeVideo
YouTubeVideo("A3fHytkJ010",width=640,height=320, cc_load_policy=True)
✅ QUESTION: Describe in words, what the graphs of the equations could look like for three equations with three unknowns and no solutions.
Erase the contents of this cell and put your answer to the above question here.
4. Matrix Notation#
Review Sections 6.1 - 6.3 of the Stephen Boyd and Lieven Vandenberghe Applied Linear algebra book which introduces the concept of Matrices. Some things to take away include:
Elements and Size of a Matrix, Notation
Transpose, Addition, and Norms
Zero and Identy matrices
from IPython.display import YouTubeVideo
YouTubeVideo("uC46qAjdE9w",height=360,width=640, cc_load_policy=True)
A matrix is a rectangular array of numbers typically written between rectangular brackets such as:
The \(3 \times 2\) subscript is not always included but is handy notation to remember the size of a matrix. The size of a matrix is always written \(m \times n\) where \(m\) is the number of rows and \(n\) is the number of columns. So in the above case Matrix \(A\) is a \(3 \times 2\) (read “three by two”) matrix.
✅ QUESTION: What is the size of the following matrix?
Erase the contents of this cell and put your answer to the above question here
Each element in a matrix can be referenced by it’s index location. Similar to the size of a matrix the location of an element is described by two numbers, it’s row followed by it’s column. Counting for the rows start at the top and the columns start on the left. For example, in Matrix \(B\) element \(b_{1,2}\) is the number in row 1 column 2 which is -1.
✅ QUESTION: What is the value of element (2,1) in matrix \(B\)?
Erase the contents of this cell and put your answer to the above question here
A linear system of equations can be written in matrix format. For example, the equations in the original example can be written as the following “Augmented matrix”
And the example which included silversmith can be written as follows: $\( \left[ \begin{matrix} 1 & 1 & 1 \\ 50 & 20 & 25 \\ 110 & 0 & 20 \end{matrix} \, \middle\vert \, \begin{matrix} 30 \\ 690 \\ 300 \end{matrix} \right] \)$ The above equations are represented as “augmented matrices” with the equal side represented as a vertical line.
The general matrix format for a system of linear equations can be written as follows:
where \(x_{ij}\) is a scalar element in the matrix.
Now consider the following system of linear equations:
Lets rewrite this equation as an augmented matrix:
Notice the submatrix on the left hand side is just the \(I_6\) identity matrix and the right hand side are the solutions.
###STARTFOOTER###
Congratulations, we’re done!#
Written by Dr. Dirk Colbry, Michigan State University
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.