Frequent Links
Linear algebra
Linear algebra is the branch of mathematics concerning vector spaces and linear mappings between such spaces. It includes the study of lines, planes, and subspaces, but is also concerned with properties common to all vector spaces.
The set of points with coordinates that satisfy a linear equation form a hyperplane in an ndimensional space. The conditions under which a set of n hyperplanes intersect in a single point is an important focus of study in linear algebra. Such an investigation is initially motivated by a system of linear equations containing several unknowns. Such equations are naturally represented using the formalism of matrices and vectors.^{[1]}^{[2]}
Linear algebra is central to both pure and applied mathematics. For instance, abstract algebra arises by relaxing the axioms of a vector space, leading to a number of generalizations. Functional analysis studies the infinitedimensional version of the theory of vector spaces. Combined with calculus, linear algebra facilitates the solution of linear systems of differential equations.
Techniques from linear algebra are also used in analytic geometry, engineering, physics, natural sciences, computer science, computer animation, and the social sciences (particularly in economics). Because linear algebra is such a welldeveloped theory, nonlinear mathematical models are sometimes approximated by linear models.
Contents
History
The study of linear algebra first emerged from the study of determinants, which were used to solve systems of linear equations. Determinants were used by Leibniz in 1693, and subsequently, Gabriel Cramer devised Cramer's Rule for solving linear systems in 1750. Later, Gauss further developed the theory of solving linear systems by using Gaussian elimination, which was initially listed as an advancement in geodesy.^{[3]}
The study of matrix algebra first emerged in England in the mid1800s. In 1844 Hermann Grassmann published his “Theory of Extension” which included foundational new topics of what is today called linear algebra. In 1848, James Joseph Sylvester introduced the term matrix, which is Latin for "womb". While studying compositions of linear transformations, Arthur Cayley was led to define matrix multiplication and inverses. Crucially, Cayley used a single letter to denote a matrix, thus treating a matrix as an aggregate object. He also realized the connection between matrices and determinants, and wrote "There would be many things to say about this theory of matrices which should, it seems to me, precede the theory of determinants".^{[3]}
In 1882, Hüseyin Tevfik Pasha wrote the book titled "Linear Algebra".^{[4]}^{[5]} The first modern and more precise definition of a vector space was introduced by Peano in 1888;^{[3]} by 1900, a theory of linear transformations of finitedimensional vector spaces had emerged. Linear algebra first took its modern form in the first half of the twentieth century, when many ideas and methods of previous centuries were generalized as abstract algebra. The use of matrices in quantum mechanics, special relativity, and statistics helped spread the subject of linear algebra beyond pure mathematics. The development of computers led to increased research in efficient algorithms for Gaussian elimination and matrix decompositions, and linear algebra became an essential tool for modelling and simulations.^{[3]}
The origin of many of these ideas is discussed in the articles on determinants and Gaussian elimination.
Educational history
Linear algebra first appeared in graduate textbooks in the 1940s and in undergraduate textbooks in the 1950s.^{[6]} Following work by the School Mathematics Study Group, U.S. high schools asked 12th grade students to do "matrix algebra, formerly reserved for college" in the 1960s.^{[7]} In France during the 1960s, educators attempted to teach linear algebra through affine dimensional vector spaces in the first year of secondary school. This was met with a backlash in the 1980s that removed linear algebra from the curriculum.^{[8]} In 1993, the U.S.based Linear Algebra Curriculum Study Group recommended that undergraduate linear algebra courses be given an applicationbased "matrix orientation" as opposed to a theoretical orientation.^{[9]}
Scope of study
Vector spaces
The main structures of linear algebra are vector spaces. A vector space over a field F is a set V together with two binary operations. Elements of V are called vectors and elements of F are called scalars. The first operation, vector addition, takes any two vectors v and w and outputs a third vector v + w. The second operation, scalar multiplication, takes any scalar a and any vector v and outputs a new vector av. The operations of addition and multiplication in a vector space must satisfy the following axioms.^{[10]} In the list below, let u, v and w be arbitrary vectors in V, and a and b scalars in F.
Axiom  Signification 
Associativity of addition  u + (v + w) = (u + v) + w 
Commutativity of addition  u + v = v + u 
Identity element of addition  There exists an element 0 ∈ V, called the zero vector, such that v + 0 = v for all v ∈ V. 
Inverse elements of addition  For every v ∈ V, there exists an element −v ∈ V, called the additive inverse of v, such that v + (−v) = 0 
Distributivity of scalar multiplication with respect to vector addition  a(u + v) = au + av 
Distributivity of scalar multiplication with respect to field addition  (a + b)v = av + bv 
Compatibility of scalar multiplication with field multiplication  a(bv) = (ab)v ^{[nb 1]} 
Identity element of scalar multiplication  1v = v, where 1 denotes the multiplicative identity in F. 
The first four axioms are those of V being an abelian group under vector addition. Vector spaces may be diverse in nature, for example, containing functions, polynomials or matrices. Linear algebra is concerned with properties common to all vector spaces.
Linear transformations
Similarly as in the theory of other algebraic structures, linear algebra studies mappings between vector spaces that preserve the vectorspace structure. Given two vector spaces V and W over a field F, a linear transformation (also called linear map, linear mapping or linear operator) is a map
 <math> T:V\to W </math>
that is compatible with addition and scalar multiplication:
 <math> T(u+v)=T(u)+T(v), \quad T(av)=aT(v) </math>
for any vectors u,v ∈ V and a scalar a ∈ F.
Additionally for any vectors u, v ∈ V and scalars a, b ∈ F:
 <math> \quad T(au+bv)=T(au)+T(bv)=aT(u)+bT(v) </math>
When a bijective linear mapping exists between two vector spaces (that is, every vector from the second space is associated with exactly one in the first), we say that the two spaces are isomorphic. Because an isomorphism preserves linear structure, two isomorphic vector spaces are "essentially the same" from the linear algebra point of view. One essential question in linear algebra is whether a mapping is an isomorphism or not, and this question can be answered by checking if the determinant is nonzero. If a mapping is not an isomorphism, linear algebra is interested in finding its range (or image) and the set of elements that get mapped to zero, called the kernel of the mapping.
Linear transformations have geometric significance. For example, 2 × 2 real matrices denote standard planar mappings that preserve the origin.
Subspaces, span, and basis
Again, in analogue with theories of other algebraic objects, linear algebra is interested in subsets of vector spaces that are themselves vector spaces; these subsets are called linear subspaces. For example, both the range and kernel of a linear mapping are subspaces, and are thus often called the range space and the nullspace; these are important examples of subspaces. Another important way of forming a subspace is to take a linear combination of a set of vectors v_{1}, v_{2}, …, v_{k}:
 <math> a_1 v_1 + a_2 v_2 + \cdots + a_k v_k,</math>
where a_{1}, a_{2}, …, a_{k} are scalars. The set of all linear combinations of vectors v_{1}, v_{2}, …, v_{k} is called their span, which forms a subspace.
A linear combination of any system of vectors with all zero coefficients is the zero vector of V. If this is the only way to express the zero vector as a linear combination of v_{1}, v_{2}, …, v_{k} then these vectors are linearly independent. Given a set of vectors that span a space, if any vector w is a linear combination of other vectors (and so the set is not linearly independent), then the span would remain the same if we remove w from the set. Thus, a set of linearly dependent vectors is redundant in the sense that there will be a linearly independent subset which will span the same subspace. Therefore, we are mostly interested in a linearly independent set of vectors that spans a vector space V, which we call a basis of V. Any set of vectors that spans V contains a basis, and any linearly independent set of vectors in V can be extended to a basis.^{[11]} It turns out that if we accept the axiom of choice, every vector space has a basis;^{[12]} nevertheless, this basis may be unnatural, and indeed, may not even be constructible. For instance, there exists a basis for the real numbers considered as a vector space over the rationals, but no explicit basis has been constructed.
Any two bases of a vector space V have the same cardinality, which is called the dimension of V. The dimension of a vector space is welldefined by the dimension theorem for vector spaces. If a basis of V has finite number of elements, V is called a finitedimensional vector space. If V is finitedimensional and U is a subspace of V, then dim U ≤ dim V. If U_{1} and U_{2} are subspaces of V, then
 <math>\dim(U_1 + U_2) = \dim U_1 + \dim U_2  \dim(U_1 \cap U_2)</math>.^{[13]}
One often restricts consideration to finitedimensional vector spaces. A fundamental theorem of linear algebra states that all vector spaces of the same dimension are isomorphic,^{[14]} giving an easy way of characterizing isomorphism.
Matrix theory
A particular basis {v_{1}, v_{2}, …, v_{n}} of V allows one to construct a coordinate system in V: the vector with coordinates (a_{1}, a_{2}, …, a_{n}) is the linear combination
 <math> a_1 v_1 + a_2 v_2 + \cdots + a_n v_n. \, </math>
The condition that v_{1}, v_{2}, …, v_{n} span V guarantees that each vector v can be assigned coordinates, whereas the linear independence of v_{1}, v_{2}, …, v_{n} assures that these coordinates are unique (i.e. there is only one linear combination of the basis vectors that is equal to v). In this way, once a basis of a vector space V over F has been chosen, V may be identified with the coordinate nspace F^{n}. Under this identification, addition and scalar multiplication of vectors in V correspond to addition and scalar multiplication of their coordinate vectors in F^{n}. Furthermore, if V and W are an ndimensional and mdimensional vector space over F, and a basis of V and a basis of W have been fixed, then any linear transformation T: V → W may be encoded by an m × n matrix A with entries in the field F, called the matrix of T with respect to these bases. Two matrices that encode the same linear transformation in different bases are called similar. Matrix theory replaces the study of linear transformations, which were defined axiomatically, by the study of matrices, which are concrete objects. This major technique distinguishes linear algebra from theories of other algebraic structures, which usually cannot be parameterized so concretely.
There is an important distinction between the coordinate nspace R^{n} and a general finitedimensional vector space V. While R^{n} has a standard basis {e_{1}, e_{2}, …, e_{n}}, a vector space V typically does not come equipped with such a basis and many different bases exist (although they all consist of the same number of elements equal to the dimension of V).
One major application of the matrix theory is calculation of determinants, a central concept in linear algebra. While determinants could be defined in a basisfree manner, they are usually introduced via a specific representation of the mapping; the value of the determinant does not depend on the specific basis. It turns out that a mapping has an inverse if and only if the determinant has an inverse (every nonzero real or complex number has an inverse^{[15]}). If the determinant is zero, then the nullspace is nontrivial. Determinants have other applications, including a systematic way of seeing if a set of vectors is linearly independent (we write the vectors as the columns of a matrix, and if the determinant of that matrix is zero, the vectors are linearly dependent). Determinants could also be used to solve systems of linear equations (see Cramer's rule), but in real applications, Gaussian elimination is a faster method.
Eigenvalues and eigenvectors
In general, the action of a linear transformation may be quite complex. Attention to lowdimensional examples gives an indication of the variety of their types. One strategy for a general ndimensional transformation T is to find "characteristic lines" that are invariant sets under T. If v is a nonzero vector such that Tv is a scalar multiple of v, then the line through 0 and v is an invariant set under T and v is called a characteristic vector or eigenvector. The scalar λ such that Tv = λv is called a characteristic value or eigenvalue of T.
To find an eigenvector or an eigenvalue, we note that
 <math>Tv\lambda v=(T\lambda \, \text{I})v=0,</math>
where I is the identity matrix. For there to be nontrivial solutions to that equation, det(T − λ I) = 0. The determinant is a polynomial, and so the eigenvalues are not guaranteed to exist if the field is R. Thus, we often work with an algebraically closed field such as the complex numbers when dealing with eigenvectors and eigenvalues so that an eigenvalue will always exist. It would be particularly nice if given a transformation T taking a vector space V into itself we can find a basis for V consisting of eigenvectors. If such a basis exists, we can easily compute the action of the transformation on any vector: if v_{1}, v_{2}, …, v_{n} are linearly independent eigenvectors of a mapping of ndimensional spaces T with (not necessarily distinct) eigenvalues λ_{1}, λ_{2}, …, λ_{n}, and if v = a_{1}v_{1} + ... + a_{n} v_{n}, then,
 <math>T(v)=T(a_1 v_1)+\cdots+T(a_n v_n)=a_1 T(v_1)+\cdots+a_n T(v_n)=a_1 \lambda_1 v_1 + \cdots +a_n \lambda_n v_n.</math>
Such a transformation is called a diagonalizable matrix since in the eigenbasis, the transformation is represented by a diagonal matrix. Because operations like matrix multiplication, matrix inversion, and determinant calculation are simple on diagonal matrices, computations involving matrices are much simpler if we can bring the matrix to a diagonal form. Not all matrices are diagonalizable (even over an algebraically closed field).
Innerproduct spaces
Besides these basic concepts, linear algebra also studies vector spaces with additional structure, such as an inner product. The inner product is an example of a bilinear form, and it gives the vector space a geometric structure by allowing for the definition of length and angles. Formally, an inner product is a map
 <math> \langle \cdot, \cdot \rangle : V \times V \rightarrow F </math>
that satisfies the following three axioms for all vectors u, v, w in V and all scalars a in F:^{[16]}^{[17]}
 Conjugate symmetry:
 <math>\langle u,v\rangle =\overline{\langle v,u\rangle}.</math>
Note that in R, it is symmetric.
 Linearity in the first argument:
 <math>\langle au,v\rangle= a \langle u,v\rangle.</math>
 <math>\langle u+v,w\rangle= \langle u,w\rangle+ \langle v,w\rangle.</math>
 <math>\langle v,v\rangle \geq 0</math> with equality only for v = 0.
We can define the length of a vector v in V by
 <math>\v\^2=\langle v,v\rangle,</math>
and we can prove the Cauchy–Schwarz inequality:
 <math>\langle u,v\rangle \leq \u\ \cdot \v\.</math>
In particular, the quantity
 <math>\frac{\langle u,v\rangle}{\u\ \cdot \v\} \leq 1,</math>
and so we can call this quantity the cosine of the angle between the two vectors.
Two vectors are orthogonal if <math>\langle u, v\rangle =0</math>. An orthonormal basis is a basis where all basis vectors have length 1 and are orthogonal to each other. Given any finitedimensional vector space, an orthonormal basis could be found by the Gram–Schmidt procedure. Orthonormal bases are particularly nice to deal with, since if v = a_{1} v_{1} + ... + a_{n} v_{n}, then <math>a_i = \langle v,v_i \rangle</math>.
The inner product facilitates the construction of many useful concepts. For instance, given a transform T, we can define its Hermitian conjugate T* as the linear transform satisfying
 <math> \langle T u, v \rangle = \langle u, T^* v\rangle.</math>
If T satisfies TT* = T*T, we call T normal. It turns out that normal matrices are precisely the matrices that have an orthonormal system of eigenvectors that span V.
Some main useful theorems
 A matrix is invertible, or nonsingular, if and only if the linear map represented by the matrix is an isomorphism.
 Any vector space over a field F of dimension n is isomorphic to F^{n} as a vector space over F.
 Corollary: Any two vector spaces over F of the same finite dimension are isomorphic to each other.
 A linear map is an isomorphism if and only if the determinant is nonzero.
Applications
Because of the ubiquity of vector spaces, linear algebra is used in many fields of mathematics, natural sciences, computer science, and social science. Below are just some examples of applications of linear algebra.
Solution of linear systems
Linear algebra provides the formal setting for the linear combination of equations used in the Gaussian method. Suppose the goal is to find and describe the solution(s), if any, of the following system of linear equations:
 <math>\begin{alignat}{7}
2x &&\; + \;&& y &&\;  \;&& z &&\; = \;&& 8 & \qquad (L_1) \\ 3x &&\;  \;&& y &&\; + \;&& 2z &&\; = \;&& 11 & \qquad (L_2) \\ 2x &&\; + \;&& y &&\; +\;&& 2z &&\; = \;&& 3 & \qquad (L_3) \end{alignat}</math>
The Gaussianelimination algorithm is as follows: eliminate x from all equations below L_{1}, and then eliminate y from all equations below L_{2}. This will put the system into triangular form. Then, using backsubstitution, each unknown can be solved for.
In the example, x is eliminated from L_{2} by adding (3/2)L_{1} to L_{2}. x is then eliminated from L_{3} by adding L_{1} to L_{3}. Formally:
 <math>L_2 + \tfrac{3}{2}L_1 \rightarrow L_2</math>
 <math>L_3 + L_1 \rightarrow L_3</math>
The result is:
 <math>\begin{alignat}{7}
2x &&\; + && y &&\;  &&\; z &&\; = \;&& 8 & \\ && && \frac{1}{2}y &&\; + &&\; \frac{1}{2}z &&\; = \;&& 1 & \\ && && 2y &&\; + &&\; z &&\; = \;&& 5 & \end{alignat}</math>
Now y is eliminated from L_{3} by adding −4L_{2} to L_{3}:
 <math>L_3 + 4L_2 \rightarrow L_3</math>
The result is:
 <math>\begin{alignat}{7}
2x &&\; + && y \;&&  &&\; z \;&& = \;&& 8 & \\ && && \frac{1}{2}y \;&& + &&\; \frac{1}{2}z \;&& = \;&& 1 & \\ && && && &&\; z \;&&\; = \;&& 1 & \end{alignat}</math>
This result is a system of linear equations in triangular form, and so the first part of the algorithm is complete.
The last part, backsubstitution, consists of solving for the known in reverse order. It can thus be seen that
 <math>z = 1 \quad (L_3)</math>
Then, z can be substituted into L_{2}, which can then be solved to obtain
 <math>y = 3 \quad (L_2)</math>
Next, z and y can be substituted into L_{1}, which can be solved to obtain
 <math>x = 2 \quad (L_1)</math>
The system is solved.
We can, in general, write any system of linear equations as a matrix equation:
 <math>Ax=b.</math>
The solution of this system is characterized as follows: first, we find a particular solution x_{0} of this equation using Gaussian elimination. Then, we compute the solutions of Ax = 0; that is, we find the null space N of A. The solution set of this equation is given by <math>x_0+N=\{x_0+n: n\in N \}</math>. If the number of variables is equal to the number of equations, then we can characterize when the system has a unique solution: since N is trivial if and only if det A ≠ 0, the equation has a unique solution if and only if det A ≠ 0.^{[18]}
Leastsquares best fit line
The least squares method is used to determine the best fit line for a set of data.^{[19]} This line will minimize the sum of the squares of the residuals.
Fourier series expansion
Fourier series are a representation of a function f: [−π, π] → R as a trigonometric series:
 <math>f(x)=\frac{a_0}{2} + \sum_{n=1}^\infty \, [a_n \cos(nx) + b_n \sin(nx)].</math>
This series expansion is extremely useful in solving partial differential equations. In this article, we will not be concerned with convergence issues; it is nice to note that all Lipschitzcontinuous functions have a converging Fourier series expansion, and nice enough discontinuous functions have a Fourier series that converges to the function value at most points.
The space of all functions that can be represented by a Fourier series form a vector space (technically speaking, we call functions that have the same Fourier series expansion the "same" function, since two different discontinuous functions might have the same Fourier series). Moreover, this space is also an inner product space with the inner product
 <math>\langle f,g \rangle= \frac{1}{\pi} \int_{\pi}^\pi f(x) g(x) \, dx.</math>
The functions g_{n}(x) = sin(nx) for n > 0 and h_{n}(x) = cos(nx) for n ≥ 0 are an orthonormal basis for the space of Fourierexpandable functions. We can thus use the tools of linear algebra to find the expansion of any function in this space in terms of these basis functions. For instance, to find the coefficient a_{k}, we take the inner product with h_{k}:
 <math>\langle f,h_k \rangle=\frac{a_0}{2}\langle h_0,h_k \rangle + \sum_{n=1}^\infty \, [a_n \langle h_n,h_k\rangle + b_n \langle\ g_n,h_k \rangle],</math>
and by orthonormality, <math> \langle f,h_k\rangle=a_k</math>; that is,
 <math> a_k = \frac{1}{\pi} \int_{\pi}^\pi f(x) \cos(kx) \, dx.</math>
Quantum mechanics
Quantum mechanics is highly inspired by notions in linear algebra. In quantum mechanics, the physical state of a particle is represented by a vector, and observables (such as momentum, energy, and angular momentum) are represented by linear operators on the underlying vector space. More concretely, the wave function of a particle describes its physical state and lies in the vector space L^{2} (the functions φ: R^{3} → C such that <math>\int_{\infty}^\infty \int_{\infty}^\infty \int_{\infty}^{\infty} \phi^2 dxdydz</math> is finite), and it evolves according to the Schrödinger equation. Energy is represented as the operator <math>H=\frac{\hbar^2}{2m} \nabla^2 + V(x,y,z)</math>, where V is the potential energy. H is also known as the Hamiltonian operator. The eigenvalues of H represents the possible energies that can be observed. Given a particle in some state φ, we can expand φ into a linear combination of eigenstates of H. The component of H in each eigenstate determines the probability of measuring the corresponding eigenvalue, and the measurement forces the particle to assume that eigenstate (wave function collapse).
Geometric introduction
Many of the principles and techniques of linear algebra can be seen in the geometry of lines in a real two dimensional plane E. When formulated using vectors and matrices the geometry of points and lines in the plane can be extended to the geometry of points and hyperplanes in highdimensional spaces.
Point coordinates in the plane E are ordered pairs of real numbers, (x,y), and a line is defined as the set of points (x,y) that satisfy the linear equation^{[20]}
 <math> \lambda: ax+by + c =0, </math>,
where a, b and c are not all zero. Then,
 <math> \lambda: \begin{bmatrix} a & b & c\end{bmatrix} \begin{Bmatrix} x\\ y \\1\end{Bmatrix} = 0, </math>
or
 <math> A\mathbf{x}=0,</math>
where x = (x, y, 1) is the 3 × 1 set of homogeneous coordinates associated with the point (x, y).^{[21]}
Homogeneous coordinates identify the plane E with the z = 1 plane in three dimensional space. The x−y coordinates in E are obtained from homogeneous coordinates y = (y_{1}, y_{2}, y_{3}) by dividing by the third component (if it is nonzero) to obtain y = (y_{1}/y_{3}, y_{2}/y_{3}, 1).
The linear equation, λ, has the important property, that if x_{1} and x_{2} are homogeneous coordinates of points on the line, then the point αx_{1} + βx_{2} is also on the line, for any real α and β.
Now consider the equations of the two lines λ_{1} and λ_{2},
 <math>\lambda_1: a_1 x+b_1 y + c_1 =0,\quad \lambda_2: a_2 x+b_2 y + c_2 =0, </math>
which forms a system of linear equations. The intersection of these two lines is defined by x = (x, y, 1) that satisfy the matrix equation,
 <math>\lambda_{1,2}: \begin{bmatrix} a_1 & b_1 & c_1\\ a_2 & b_2 & c_2 \end{bmatrix} \begin{Bmatrix} x\\ y \\1\end{Bmatrix} = \begin{Bmatrix}0\\0 \end{Bmatrix},</math>
or using homogeneous coordinates,
 <math> B\mathbf{x}=0.</math>
The point of intersection of these two lines is the unique nonzero solution of these equations. In homogeneous coordinates, the solutions are multiples of the following solution:^{[21]}
 <math> x_1 = \begin{vmatrix} b_1 & c_1\\ b_2 & c_2\end{vmatrix}, x_2 = \begin{vmatrix} a_1 & c_1\\ a_2 & c_2\end{vmatrix}, x_3 = \begin{vmatrix} a_1 & b_1\\ a_2 & b_2\end{vmatrix}</math>
if the rows of B are linearly independent (i.e., λ_{1} and λ_{2} represent distinct lines). Divide through by x_{3} to get Cramer's rule for the solution of a set of two linear equations in two unknowns.^{[22]} Notice that this yields a point in the z = 1 plane only when the 2 × 2 submatrix associated with x_{3} has a nonzero determinant.
It is interesting to consider the case of three lines, λ_{1}, λ_{2} and λ_{3}, which yield the matrix equation,
 <math>\lambda_{1,2,3}: \begin{bmatrix} a_1 & b_1 & c_1\\ a_2 & b_2 & c_2 \\ a_3 & b_3 & c_3\end{bmatrix} \begin{Bmatrix} x\\ y \\1\end{Bmatrix} = \begin{Bmatrix}0\\0 \\0\end{Bmatrix}.</math>
which in homogeneous form yields,
 <math> C\mathbf{x}=0.</math>
Clearly, this equation has the solution x = (0,0,0), which is not a point on the z = 1 plane E. For a solution to exist in the plane E, the coefficient matrix C must have rank 2, which means its determinant must be zero. Another way to say this is that the columns of the matrix must be linearly dependent.
Introduction to linear transformations
Another way to approach linear algebra is to consider linear functions on the two dimensional real plane E=R^{2}. Here R denotes the set of real numbers. Let x=(x, y) be an arbitrary vector in E and consider the linear function λ: E→R, given by
 <math> \lambda: \begin{bmatrix}a & b\end{bmatrix}\begin{Bmatrix} x\\y\end{Bmatrix} = c,</math>
or
 <math>A\mathbf{x}=c.</math>
This transformation has the important property that if Ay=d, then
 <math> A(\alpha\mathbf{x}+\beta \mathbf{y}) = \alpha A \mathbf{x} + \beta A\mathbf{y} = \alpha c + \beta d.</math>
This shows that the sum of vectors in E map to the sum of their images in R. This is the defining characteristic of a linear map, or linear transformation.^{[20]} For this case, where the image space is a real number the map is called a linear functional.^{[22]}
Consider the linear functional a little more carefully. Let i=(1,0) and j =(0,1) be the natural basis vectors on E, so that x=xi+yj. It is now possible to see that
 <math> A\mathbf{x} = A(x\mathbf{i}+y\mathbf{j})=x A\mathbf{i} + y A\mathbf{j} = \begin{bmatrix}A\mathbf{i} & A\mathbf{j}\end{bmatrix}\begin{Bmatrix} x\\y\end{Bmatrix} = \begin{bmatrix}a & b\end{bmatrix}\begin{Bmatrix} x\\y\end{Bmatrix} = c.</math>
Thus, the columns of the matrix A are the image of the basis vectors of E in R.
This is true for any pair of vectors used to define coordinates in E. Suppose we select a nonorthogonal nonunit vector basis v and w to define coordinates of vectors in E. This means a vector x has coordinates (α,β), such that x=αv+βw. Then, we have the linear functional
 <math> \lambda: A\mathbf{x} = \begin{bmatrix} A\mathbf{v} & A\mathbf{w} \end{bmatrix}\begin{Bmatrix} \alpha \\ \beta \end{Bmatrix} = \begin{bmatrix} d & e \end{bmatrix}\begin{Bmatrix} \alpha \\ \beta \end{Bmatrix} =c,</math>
where Av=d and Aw=e are the images of the basis vectors v and w. This is written in matrix form as
 <math> \begin{bmatrix}a & b\end{bmatrix} \begin{bmatrix} v_1 & w_1 \\ v_2 & w_2 \end{bmatrix} =\begin{bmatrix} d & e \end{bmatrix}.</math>
Coordinates relative to a basis
This leads to the question of how to determine the coordinates of a vector x relative to a general basis v and w in E. Assume that we know the coordinates of the vectors, x, v and w in the natural basis i=(1,0) and j =(0,1). Our goal is two find the real numbers α, β, so that x=αv+βw, that is
 <math> \begin{Bmatrix} x \\ y \end{Bmatrix} = \begin{bmatrix} v_1 & w_1 \\ v_2 & w_2 \end{bmatrix} \begin{Bmatrix} \alpha \\ \beta\end{Bmatrix}.</math>
To solve this equation for α, β, we compute the linear coordinate functionals σ and τ for the basis v, w, which are given by,^{[21]}
 <math> \sigma = \begin{bmatrix}\sigma_1 &\sigma_2\end{bmatrix}=\frac{1}{v_1 w_2 v_2w_1}\begin{bmatrix} w_2 &  w_1\end{bmatrix}, \tau = \begin{bmatrix}\tau_1 &\tau_2\end{bmatrix}=\frac{1}{v_1 w_2 v_2w_1}\begin{bmatrix} v_2 & v_1\end{bmatrix}, </math>
The functionals σ and τ compute the components of x along the basis vectors v and w, respectively, that is,
 <math>\sigma \mathbf{x}=\alpha, \tau\mathbf{x}=\beta,</math>
which can be written in matrix form as
 <math> \begin{bmatrix} \sigma_1 & \sigma_2 \\ \tau_1 &\tau_2 \end{bmatrix} \begin{Bmatrix} x \\ y \end{Bmatrix} =\begin{Bmatrix} \alpha \\ \beta\end{Bmatrix}.</math>
These coordinate functionals have the properties,
 <math> \sigma\mathbf{v}=1, \sigma\mathbf{w}=0, \tau\mathbf{w}=1, \tau\mathbf{v}=0.</math>
These equations can be assembled into the single matrix equation,
 <math> \begin{bmatrix} \sigma_1 & \sigma_2 \\ \tau_1 &\tau_2 \end{bmatrix} \begin{bmatrix} v_1 & w_1 \\ v_2 &w_2 \end{bmatrix} = \begin{bmatrix} 1& 0\\0 & 1\end{bmatrix}.</math>
Thus, the matrix formed by the coordinate linear functionals is the inverse of the matrix formed by the basis vectors.^{[20]}^{[22]}
Inverse image
The set of points in the plane E that map to the same image in R under the linear functional λ define a line in E. This line is the image of the inverse map, λ^{−1}: R→E. This inverse image is the set of the points x=(x, y) that solve the equation,
 <math> A\mathbf{x}=\begin{bmatrix}a & b\end{bmatrix}\begin{Bmatrix} x\\y\end{Bmatrix} = c.</math>
Notice that a linear functional operates on known values for x=(x, y) to compute a value c in R, while the inverse image seeks the values for x=(x, y) that yield a specific value c.
In order to solve the equation, we first recognize that only one of the two unknowns (x,y) can be determined, so we select y to be determined, and rearrange the equation
 <math> by = c  ax.</math>
Solve for y and obtain the inverse image as the set of points,
 <math> \mathbf{x}(t) = \begin{Bmatrix} 0\\ c/b\end{Bmatrix} + t\begin{Bmatrix} 1\\ a/b\end{Bmatrix}=\mathbf{p} + t\mathbf{h} .</math>
For convenience the free parameter x has been relabeled t.
The vector p defines the intersection of the line with the yaxis, known as the yintercept. The vector h satisfies the homogeneous equation,
 <math>A\mathbf{h}= \begin{bmatrix}a & b\end{bmatrix} \begin{Bmatrix} 1\\ a/b\end{Bmatrix}= 0.</math>
Notice that if h is a solution to this homogeneous equation, then t h is also a solution.
The set of points of a linear functional that map to zero define the kernel of the linear functional. The line can be considered to be the set of points h in the kernel translated by the vector p.^{[20]}^{[22]}
Since linear algebra is a successful theory, its methods have been developed and generalized in other parts of mathematics. In module theory, one replaces the field of scalars by a ring. The concepts of linear independence, span, basis, and dimension (which is called rank in module theory) still make sense. Nevertheless, many theorems from linear algebra become false in module theory. For instance, not all modules have a basis (those that do are called free modules), the rank of a free module is not necessarily unique, not every linearly independent subset of a module can be extended to form a basis, and not every subset of a module that spans the space contains a basis.
In multilinear algebra, one considers multivariable linear transformations, that is, mappings that are linear in each of a number of different variables. This line of inquiry naturally leads to the idea of the dual space, the vector space V^{∗} consisting of linear maps f: V → F where F is the field of scalars. Multilinear maps T: V^{n} → F can be described via tensor products of elements of V^{∗}.
If, in addition to vector addition and scalar multiplication, there is a bilinear vector product V × V → V, the vector space is called an algebra; for instance, associative algebras are algebras with an associate vector product (like the algebra of square matrices, or the algebra of polynomials).
Functional analysis mixes the methods of linear algebra with those of mathematical analysis and studies various function spaces, such as L^{p} spaces.
Representation theory studies the actions of algebraic objects on vector spaces by representing these objects as matrices. It is interested in all the ways that this is possible, and it does so by finding subspaces invariant under all transformations of the algebra. The concept of eigenvalues and eigenvectors is especially important.
Algebraic geometry considers the solutions of systems of polynomial equations.
There are several related topics in the field of Computer Programming that utilizes much of the techniques and theorems Linear Algebra encompasses and refers to.
See also
 Linear equation
 Linear equation over a ring
 System of linear equations
 Gaussian elimination
 Eigenvectors
 Fundamental matrix in computer vision
 Linear regression, a statistical estimation method
 List of linear algebra topics
 Numerical linear algebra
 Simplex method, a solution technique for linear programs
 Transformation matrix
Notes
 ^ Strang, Gilbert (July 19, 2005), Linear Algebra and Its Applications (4th ed.), Brooks Cole, ISBN 9780030105678
 ^ Weisstein, Eric. "Linear Algebra". From MathWorldA Wolfram Web Resource. Wolfram. Retrieved 16 April 2012.
 ^ ^{a} ^{b} ^{c} ^{d} Vitulli, Marie. "A Brief History of Linear Algebra and Matrix Theory". Department of Mathematics. University of Oregon. Archived from the original on 20120910. Retrieved 20140708.
 ^ http://www.journals.istanbul.edu.tr/tr/index.php/oba/article/download/9103/8452
 ^ http://archive.org/details/linearalgebra00tevfgoog
 ^ Tucker, Alan (1993). "The Growing Importance of Linear Algebra in Undergraduate Mathematics". College Mathematics Journal 24 (1): 3–9. doi:10.2307/2686426.
 ^ Goodlad, John I.; von stoephasius, Reneta; Klein, M. Frances (1966). "The changing school curriculum". U.S. Department of Health, Education, and Welfare: Office of Education. Retrieved 9 July 2014.
 ^ Dorier, JeanLuc; Robert, Aline; Robinet, Jacqueline; Rogalsiu, Marc (2000). Dorier, JeanLuc, ed. The Obstacle of Formalism in Linear Algebra. Springer. pp. 85–124. ISBN 9780792365396. Retrieved 9 July 2014.
 ^ Carlson, David; Johnson, Charles R.; Lay, David C.; Porter, A. Duane (1993). "The Linear Algebra Curriculum Study Group Recommendations for the First Course in Linear Algebra". The College Mathematics Journal 24 (1): 41–46. doi:10.2307/2686430.
 ^ Roman 2005, ch. 1, p. 27
 ^ Axler (2004), pp. 28–29
 ^ The existence of a basis is straightforward for countably generated vector spaces, and for wellordered vector spaces, but in full generality it is logically equivalent to the axiom of choice.
 ^ Axler (2204), p. 33
 ^ Axler (2004), p. 55
 ^ If we restrict to integers, then only 1 and 1 have an inverse. Consequently, the inverse of an integer matrix is an integer matrix if and only if the determinant is 1 or 1.
 ^ P. K. Jain, Khalil Ahmad (1995). "5.1 Definitions and basic properties of inner product spaces and Hilbert spaces". Functional analysis (2nd ed.). New Age International. p. 203. ISBN 812240801X.
 ^ Eduard Prugovec̆ki (1981). "Definition 2.1". Quantum mechanics in Hilbert space (2nd ed.). Academic Press. pp. 18 ff. ISBN 012566060X.
 ^ Gunawardena, Jeremy. "Matrix algebra for beginners, Part I" (PDF). Harvard Medical School. Retrieved 2 May 2012.
 ^ Miller, Steven. "The Method of Least Squares" (PDF). Brown University. Retrieved 1 May 2013.
 ^ ^{a} ^{b} ^{c} ^{d} Strang, Gilbert (July 19, 2005), Linear Algebra and Its Applications (4th ed.), Brooks Cole, ISBN 9780030105678,
 ^ ^{a} ^{b} ^{c} J. G. Semple and G. T. Kneebone, Algebraic Projective Geometry, Clarendon Press, London, 1952.
 ^ ^{a} ^{b} ^{c} ^{d} E. D. Nering, Linear Algebra and Matrix Theory, JohnWiley, New York, NY, 1963
 ^ This axiom is not asserting the associativity of an operation, since there are two operations in question, scalar multiplication: bv; and field multiplication: ab.
Further reading
History
 FearnleySander, Desmond, "Hermann Grassmann and the Creation of Linear Algebra" ([1]), American Mathematical Monthly 86 (1979), pp. 809–817.
 Grassmann, Hermann, Die lineale Ausdehnungslehre ein neuer Zweig der Mathematik: dargestellt und durch Anwendungen auf die übrigen Zweige der Mathematik, wie auch auf die Statik, Mechanik, die Lehre vom Magnetismus und die Krystallonomie erläutert, O. Wigand, Leipzig, 1844.
Introductory textbooks
 Strang, Gilbert (February 2009), Introduction to Linear Algebra (4th ed.), WellesleyCambridge Press, ISBN 9780980232714
 Murty, Katta G. (2014) Computational and Algorithmic Linear Algebra and nDimensional Geometry, World Scientific Publishing, ISBN 9789814366625. Chapter 1: Systems of Simultaneous Linear Equations
 Bretscher, Otto (June 28, 2004), Linear Algebra with Applications (3rd ed.), Prentice Hall, ISBN 9780131453340
 Farin, Gerald; Hansford, Dianne (December 15, 2004), Practical Linear Algebra: A Geometry Toolbox, AK Peters, ISBN 9781568812342
 Friedberg, Stephen H.; Insel, Arnold J.; Spence, Lawrence E. (November 11, 2002), Linear Algebra (4th ed.), Prentice Hall, ISBN 9780130084514
 Hefferon, Jim (2008), Linear Algebra
 Anton, Howard (2005), Elementary Linear Algebra (Applications Version) (9th ed.), Wiley International
 Lay, David C. (August 22, 2005), Linear Algebra and Its Applications (3rd ed.), Addison Wesley, ISBN 9780321287137
 Kolman, Bernard; Hill, David R. (May 3, 2007), Elementary Linear Algebra with Applications (9th ed.), Prentice Hall, ISBN 9780132296540
 Leon, Steven J. (2006), Linear Algebra With Applications (7th ed.), Pearson Prentice Hall, ISBN 9780131857858
 Poole, David (2010), Linear Algebra: A Modern Introduction (3rd ed.), Cengage – Brooks/Cole, ISBN 9780538735452
 Ricardo, Henry (2010), A Modern Introduction To Linear Algebra (1st ed.), CRC Press, ISBN 9781439800409
 Sadun, Lorenzo (2008), Applied Linear Algebra: the decoupling principle (2nd ed.), AMS, ISBN 9780821844410
Advanced textbooks
 Axler, Sheldon (February 26, 2004), Linear Algebra Done Right (2nd ed.), Springer, ISBN 9780387982588
 Bhatia, Rajendra (November 15, 1996), Matrix Analysis, Graduate Texts in Mathematics, Springer, ISBN 9780387948461
 Demmel, James W. (August 1, 1997), Applied Numerical Linear Algebra, SIAM, ISBN 9780898713893
 Dym, Harry (2007), Linear Algebra in Action, AMS, ISBN 9780821838136
 Gantmacher, F.R. (2005, 1959 edition), Applications of the Theory of Matrices, Dover Publications, ISBN 9780486445540 Check date values in:
date=
(help)  Gantmacher, Felix R. (1990), Matrix Theory Vol. 1 (2nd ed.), American Mathematical Society, ISBN 9780821813768
 Gantmacher, Felix R. (2000), Matrix Theory Vol. 2 (2nd ed.), American Mathematical Society, ISBN 9780821826645
 Gelfand, I. M. (1989), Lectures on Linear Algebra, Dover Publications, ISBN 9780486660820
 Glazman, I. M.; Ljubic, Ju. I. (2006), FiniteDimensional Linear Analysis, Dover Publications, ISBN 9780486453323
 Golan, Johnathan S. (January 2007), The Linear Algebra a Beginning Graduate Student Ought to Know (2nd ed.), Springer, ISBN 9781402054945
 Golan, Johnathan S. (August 1995), Foundations of Linear Algebra, Kluwer, ISBN 0792336143
 Golub, Gene H.; Van Loan, Charles F. (October 15, 1996), Matrix Computations, Johns Hopkins Studies in Mathematical Sciences (3rd ed.), The Johns Hopkins University Press, ISBN 9780801854149
 Greub, Werner H. (October 16, 1981), Linear Algebra, Graduate Texts in Mathematics (4th ed.), Springer, ISBN 9780801854149
 Hoffman, Kenneth; Kunze, Ray (1971), Linear algebra (2nd ed.), Englewood Cliffs, N.J.: PrenticeHall, Inc., MR 0276251
 Halmos, Paul R. (August 20, 1993), FiniteDimensional Vector Spaces, Undergraduate Texts in Mathematics, Springer, ISBN 9780387900933
 Horn, Roger A.; Johnson, Charles R. (February 23, 1990), Matrix Analysis, Cambridge University Press, ISBN 9780521386326
 Horn, Roger A.; Johnson, Charles R. (June 24, 1994), Topics in Matrix Analysis, Cambridge University Press, ISBN 9780521467131
 Lang, Serge (March 9, 2004), Linear Algebra, Undergraduate Texts in Mathematics (3rd ed.), Springer, ISBN 9780387964126
 Marcus, Marvin; Minc, Henryk (2010), A Survey of Matrix Theory and Matrix Inequalities, Dover Publications, ISBN 9780486671024
 Meyer, Carl D. (February 15, 2001), Matrix Analysis and Applied Linear Algebra, Society for Industrial and Applied Mathematics (SIAM), ISBN 9780898714548
 Mirsky, L. (1990), An Introduction to Linear Algebra, Dover Publications, ISBN 9780486664347
 Roman, Steven (March 22, 2005), Advanced Linear Algebra, Graduate Texts in Mathematics (2nd ed.), Springer, ISBN 9780387247663
 Shafarevich, I. R.; A. O. Remizov (2012), Linear Algebra and Geometry, Springer, ISBN 9783642309939
 Shilov, Georgi E. (June 1, 1977), Linear algebra, Dover Publications, ISBN 9780486635187
 Shores, Thomas S. (December 6, 2006), Applied Linear Algebra and Matrix Analysis, Undergraduate Texts in Mathematics, Springer, ISBN 9780387331942
 Smith, Larry (May 28, 1998), Linear Algebra, Undergraduate Texts in Mathematics, Springer, ISBN 9780387984551
 Trefethen, Lloyd N.; Bau, David (1997), Numerical Linear Algebra, SIAM, ISBN 9780898713619
Study guides and outlines
 Leduc, Steven A. (May 1, 1996), Linear Algebra (Cliffs Quick Review), Cliffs Notes, ISBN 9780822053316
 Lipschutz, Seymour; Lipson, Marc (December 6, 2000), Schaum's Outline of Linear Algebra (3rd ed.), McGrawHill, ISBN 9780071362009
 Lipschutz, Seymour (January 1, 1989), 3,000 Solved Problems in Linear Algebra, McGraw–Hill, ISBN 9780070380233
 McMahon, David (October 28, 2005), Linear Algebra Demystified, McGraw–Hill Professional, ISBN 9780071465793
 Zhang, Fuzhen (April 7, 2009), Linear Algebra: Challenging Problems for Students, The Johns Hopkins University Press, ISBN 9780801891250
External links
40x40px  Wikibooks has a book on the topic of: Linear Algebra 
 International Linear Algebra Society
 MIT Professor Gilbert Strang's Linear Algebra Course Homepage : MIT Course Website
 MIT Linear Algebra Lectures: free videos from MIT OpenCourseWare
 Linear Algebra  Foundations to Frontiers Free MOOC launched by edX
 Linear Algebra Toolkit.
 Hazewinkel, Michiel, ed. (2001), "Linear algebra", Encyclopedia of Mathematics, Springer, ISBN 9781556080104
 Linear Algebra on MathWorld.
 Linear Algebra tutorial with online interactive programs.
 Matrix and Linear Algebra Terms on Earliest Known Uses of Some of the Words of Mathematics
 Earliest Uses of Symbols for Matrices and Vectors on Earliest Uses of Various Mathematical Symbols
 Linear Algebra by Elmer G. Wiens. Interactive web pages for vectors, matrices, linear equations, etc.
 Linear Algebra Solved Problems: Interactive forums for discussion of linear algebra problems, from the lowest up to the hardest level (Putnam).
 Linear Algebra for Informatics. José FigueroaO'Farrill, University of Edinburgh
 Online Notes / Linear Algebra Paul Dawkins, Lamar University
 Elementary Linear Algebra textbook with solutions
 Linear Algebra Wiki
 Linear algebra (math 21b) homework and exercises
 Textbook and solutions manual, Saylor Foundation.
 An Intuitive Guide to Linear Algebra on BetterExplained
Online books
 Beezer, Rob, A First Course in Linear Algebra
 Connell, Edwin H., Elements of Abstract and Linear Algebra
 Hefferon, Jim, Linear Algebra
 Matthews, Keith, Elementary Linear Algebra
 Sharipov, Ruslan, Course of linear algebra and multidimensional geometry
 Treil, Sergei, Linear Algebra Done Wrong
