fbpx
Wikipedia

Linear independence

In the theory of vector spaces, a set of vectors is said to be linearly independent if there exists no nontrivial linear combination of the vectors that equals the zero vector. If such a linear combination exists, then the vectors are said to be linearly dependent. These concepts are central to the definition of dimension.[1]

Linearly independent vectors in
Linearly dependent vectors in a plane in

A vector space can be of finite dimension or infinite dimension depending on the maximum number of linearly independent vectors. The definition of linear dependence and the ability to determine whether a subset of vectors in a vector space is linearly dependent are central to determining the dimension of a vector space.

Definition edit

A sequence of vectors   from a vector space V is said to be linearly dependent, if there exist scalars   not all zero, such that

 

where   denotes the zero vector.

This implies that at least one of the scalars is nonzero, say  , and the above equation is able to be written as

 

if   and   if  

Thus, a set of vectors is linearly dependent if and only if one of them is zero or a linear combination of the others.

A sequence of vectors   is said to be linearly independent if it is not linearly dependent, that is, if the equation

 

can only be satisfied by   for   This implies that no vector in the sequence can be represented as a linear combination of the remaining vectors in the sequence. In other words, a sequence of vectors is linearly independent if the only representation of   as a linear combination of its vectors is the trivial representation in which all the scalars   are zero.[2] Even more concisely, a sequence of vectors is linearly independent if and only if   can be represented as a linear combination of its vectors in a unique way.

If a sequence of vectors contains the same vector twice, it is necessarily dependent. The linear dependency of a sequence of vectors does not depend of the order of the terms in the sequence. This allows defining linear independence for a finite set of vectors: A finite set of vectors is linearly independent if the sequence obtained by ordering them is linearly independent. In other words, one has the following result that is often useful.

A sequence of vectors is linearly independent if and only if it does not contain the same vector twice and the set of its vectors is linearly independent.

Infinite case edit

An infinite set of vectors is linearly independent if every nonempty finite subset is linearly independent. Conversely, an infinite set of vectors is linearly dependent if it contains a finite subset that is linearly dependent, or equivalently, if some vector in the set is a linear combination of other vectors in the set.

An indexed family of vectors is linearly independent if it does not contain the same vector twice, and if the set of its vectors is linearly independent. Otherwise, the family is said to be linearly dependent.

A set of vectors which is linearly independent and spans some vector space, forms a basis for that vector space. For example, the vector space of all polynomials in x over the reals has the (infinite) subset {1, x, x2, ...} as a basis.

Geometric examples edit

 
  •   and   are independent and define the plane P.
  •  ,   and   are dependent because all three are contained in the same plane.
  •   and   are dependent because they are parallel to each other.
  •   ,   and   are independent because   and   are independent of each other and   is not a linear combination of them or, equivalently, because they do not belong to a common plane. The three vectors define a three-dimensional space.
  • The vectors   (null vector, whose components are equal to zero) and   are dependent since  

Geographic location edit

A person describing the location of a certain place might say, "It is 3 miles north and 4 miles east of here." This is sufficient information to describe the location, because the geographic coordinate system may be considered as a 2-dimensional vector space (ignoring altitude and the curvature of the Earth's surface). The person might add, "The place is 5 miles northeast of here." This last statement is true, but it is not necessary to find the location.

In this example the "3 miles north" vector and the "4 miles east" vector are linearly independent. That is to say, the north vector cannot be described in terms of the east vector, and vice versa. The third "5 miles northeast" vector is a linear combination of the other two vectors, and it makes the set of vectors linearly dependent, that is, one of the three vectors is unnecessary to define a specific location on a plane.

Also note that if altitude is not ignored, it becomes necessary to add a third vector to the linearly independent set. In general, n linearly independent vectors are required to describe all locations in n-dimensional space.

Evaluating linear independence edit

The zero vector edit

If one or more vectors from a given sequence of vectors   is the zero vector   then the vector   are necessarily linearly dependent (and consequently, they are not linearly independent). To see why, suppose that   is an index (i.e. an element of  ) such that   Then let   (alternatively, letting   be equal any other non-zero scalar will also work) and then let all other scalars be   (explicitly, this means that for any index   other than   (i.e. for  ), let   so that consequently  ). Simplifying   gives:

 

Because not all scalars are zero (in particular,  ), this proves that the vectors   are linearly dependent.

As a consequence, the zero vector can not possibly belong to any collection of vectors that is linearly independent.

Now consider the special case where the sequence of   has length   (i.e. the case where  ). A collection of vectors that consists of exactly one vector is linearly dependent if and only if that vector is zero. Explicitly, if   is any vector then the sequence   (which is a sequence of length  ) is linearly dependent if and only if  ; alternatively, the collection   is linearly independent if and only if  

Linear dependence and independence of two vectors edit

This example considers the special case where there are exactly two vector   and   from some real or complex vector space. The vectors   and   are linearly dependent if and only if at least one of the following is true:

  1.   is a scalar multiple of   (explicitly, this means that there exists a scalar   such that  ) or
  2.   is a scalar multiple of   (explicitly, this means that there exists a scalar   such that  ).

If   then by setting   we have   (this equality holds no matter what the value of   is), which shows that (1) is true in this particular case. Similarly, if   then (2) is true because   If   (for instance, if they are both equal to the zero vector  ) then both (1) and (2) are true (by using   for both).

If   then   is only possible if   and  ; in this case, it is possible to multiply both sides by   to conclude   This shows that if   and   then (1) is true if and only if (2) is true; that is, in this particular case either both (1) and (2) are true (and the vectors are linearly dependent) or else both (1) and (2) are false (and the vectors are linearly independent). If   but instead   then at least one of   and   must be zero. Moreover, if exactly one of   and   is   (while the other is non-zero) then exactly one of (1) and (2) is true (with the other being false).

The vectors   and   are linearly independent if and only if   is not a scalar multiple of   and   is not a scalar multiple of  .

Vectors in R2 edit

Three vectors: Consider the set of vectors     and   then the condition for linear dependence seeks a set of non-zero scalars, such that

 

or

 

Row reduce this matrix equation by subtracting the first row from the second to obtain,

 

Continue the row reduction by (i) dividing the second row by 5, and then (ii) multiplying by 3 and adding to the first row, that is

 

Rearranging this equation allows us to obtain

 

which shows that non-zero ai exist such that   can be defined in terms of   and   Thus, the three vectors are linearly dependent.

Two vectors: Now consider the linear dependence of the two vectors   and   and check,

 

or

 

The same row reduction presented above yields,

 

This shows that   which means that the vectors   and   are linearly independent.

Vectors in R4 edit

In order to determine if the three vectors in  

 

are linearly dependent, form the matrix equation,

 

Row reduce this equation to obtain,

 

Rearrange to solve for v3 and obtain,

 

This equation is easily solved to define non-zero ai,

 

where   can be chosen arbitrarily. Thus, the vectors   and   are linearly dependent.

Alternative method using determinants edit

An alternative method relies on the fact that   vectors in   are linearly independent if and only if the determinant of the matrix formed by taking the vectors as its columns is non-zero.

In this case, the matrix formed by the vectors is

 

We may write a linear combination of the columns as

 

We are interested in whether AΛ = 0 for some nonzero vector Λ. This depends on the determinant of  , which is

 

Since the determinant is non-zero, the vectors   and   are linearly independent.

Otherwise, suppose we have   vectors of   coordinates, with   Then A is an n×m matrix and Λ is a column vector with   entries, and we are again interested in AΛ = 0. As we saw previously, this is equivalent to a list of   equations. Consider the first   rows of  , the first   equations; any solution of the full list of equations must also be true of the reduced list. In fact, if i1,...,im is any list of   rows, then the equation must be true for those rows.

 

Furthermore, the reverse is true. That is, we can test whether the   vectors are linearly dependent by testing whether

 

for all possible lists of   rows. (In case  , this requires only one determinant, as above. If  , then it is a theorem that the vectors must be linearly dependent.) This fact is valuable for theory; in practical calculations more efficient methods are available.

More vectors than dimensions edit

If there are more vectors than dimensions, the vectors are linearly dependent. This is illustrated in the example above of three vectors in  

Natural basis vectors edit

Let   and consider the following elements in  , known as the natural basis vectors:

 

Then   are linearly independent.

Proof

Suppose that   are real numbers such that

 

Since

 

then   for all  

Linear independence of functions edit

Let   be the vector space of all differentiable functions of a real variable  . Then the functions   and   in   are linearly independent.

Proof edit

Suppose   and   are two real numbers such that

 

Take the first derivative of the above equation:

 

for all values of   We need to show that   and   In order to do this, we subtract the first equation from the second, giving  . Since   is not zero for some  ,   It follows that   too. Therefore, according to the definition of linear independence,   and   are linearly independent.

Space of linear dependencies edit

A linear dependency or linear relation among vectors v1, ..., vn is a tuple (a1, ..., an) with n scalar components such that

 

If such a linear dependence exists with at least a nonzero component, then the n vectors are linearly dependent. Linear dependencies among v1, ..., vn form a vector space.

If the vectors are expressed by their coordinates, then the linear dependencies are the solutions of a homogeneous system of linear equations, with the coordinates of the vectors as coefficients. A basis of the vector space of linear dependencies can therefore be computed by Gaussian elimination.

Generalizations edit

Affine independence edit

A set of vectors is said to be affinely dependent if at least one of the vectors in the set can be defined as an affine combination of the others. Otherwise, the set is called affinely independent. Any affine combination is a linear combination; therefore every affinely dependent set is linearly dependent. Conversely, every linearly independent set is affinely independent.

Consider a set of   vectors   of size   each, and consider the set of   augmented vectors   of size   each. The original vectors are affinely independent if and only if the augmented vectors are linearly independent.[3]: 256 

Linearly independent vector subspaces edit

Two vector subspaces   and   of a vector space   are said to be linearly independent if  [4] More generally, a collection   of subspaces of   are said to be linearly independent if   for every index   where  [4] The vector space   is said to be a direct sum of   if these subspaces are linearly independent and  

See also edit

  • Matroid – Abstraction of linear independence of vectors

References edit

  1. ^ G. E. Shilov, Linear Algebra (Trans. R. A. Silverman), Dover Publications, New York, 1977.
  2. ^ Friedberg, Stephen; Insel, Arnold; Spence, Lawrence (2003). Linear Algebra. Pearson, 4th Edition. pp. 48–49. ISBN 0130084514.
  3. ^ Lovász, László; Plummer, M. D. (1986), Matching Theory, Annals of Discrete Mathematics, vol. 29, North-Holland, ISBN 0-444-87916-1, MR 0859549
  4. ^ a b Bachman, George; Narici, Lawrence (2000). Functional Analysis (Second ed.). Mineola, New York: Dover Publications. ISBN 978-0486402512. OCLC 829157984. pp. 3–7

External links edit

  • "Linear independence", Encyclopedia of Mathematics, EMS Press, 2001 [1994]
  • Linearly Dependent Functions at WolframMathWorld.
  • Tutorial and interactive program on Linear Independence.
  • Introduction to Linear Independence at KhanAcademy.

linear, independence, linear, dependence, random, variables, covariance, this, article, needs, additional, citations, verification, please, help, improve, this, article, adding, citations, reliable, sources, unsourced, material, challenged, removed, find, sour. For linear dependence of random variables see Covariance This article needs additional citations for verification Please help improve this article by adding citations to reliable sources Unsourced material may be challenged and removed Find sources Linear independence news newspapers books scholar JSTOR January 2019 Learn how and when to remove this template message In the theory of vector spaces a set of vectors is said to be linearly independent if there exists no nontrivial linear combination of the vectors that equals the zero vector If such a linear combination exists then the vectors are said to be linearly dependent These concepts are central to the definition of dimension 1 Linearly independent vectors in R3 displaystyle mathbb R 3 Linearly dependent vectors in a plane in R3 displaystyle mathbb R 3 A vector space can be of finite dimension or infinite dimension depending on the maximum number of linearly independent vectors The definition of linear dependence and the ability to determine whether a subset of vectors in a vector space is linearly dependent are central to determining the dimension of a vector space Contents 1 Definition 1 1 Infinite case 2 Geometric examples 2 1 Geographic location 3 Evaluating linear independence 3 1 The zero vector 3 2 Linear dependence and independence of two vectors 3 3 Vectors in R2 3 4 Vectors in R4 3 5 Alternative method using determinants 3 6 More vectors than dimensions 4 Natural basis vectors 5 Linear independence of functions 5 1 Proof 6 Space of linear dependencies 7 Generalizations 7 1 Affine independence 7 2 Linearly independent vector subspaces 8 See also 9 References 10 External linksDefinition editA sequence of vectors v1 v2 vk displaystyle mathbf v 1 mathbf v 2 dots mathbf v k nbsp from a vector space V is said to be linearly dependent if there exist scalars a1 a2 ak displaystyle a 1 a 2 dots a k nbsp not all zero such that a1v1 a2v2 akvk 0 displaystyle a 1 mathbf v 1 a 2 mathbf v 2 cdots a k mathbf v k mathbf 0 nbsp where 0 displaystyle mathbf 0 nbsp denotes the zero vector This implies that at least one of the scalars is nonzero say a1 0 displaystyle a 1 neq 0 nbsp and the above equation is able to be written as v1 a2a1v2 aka1vk displaystyle mathbf v 1 frac a 2 a 1 mathbf v 2 cdots frac a k a 1 mathbf v k nbsp if k gt 1 displaystyle k gt 1 nbsp and v1 0 displaystyle mathbf v 1 mathbf 0 nbsp if k 1 displaystyle k 1 nbsp Thus a set of vectors is linearly dependent if and only if one of them is zero or a linear combination of the others A sequence of vectors v1 v2 vn displaystyle mathbf v 1 mathbf v 2 dots mathbf v n nbsp is said to be linearly independent if it is not linearly dependent that is if the equation a1v1 a2v2 anvn 0 displaystyle a 1 mathbf v 1 a 2 mathbf v 2 cdots a n mathbf v n mathbf 0 nbsp can only be satisfied by ai 0 displaystyle a i 0 nbsp for i 1 n displaystyle i 1 dots n nbsp This implies that no vector in the sequence can be represented as a linear combination of the remaining vectors in the sequence In other words a sequence of vectors is linearly independent if the only representation of 0 displaystyle mathbf 0 nbsp as a linear combination of its vectors is the trivial representation in which all the scalars ai textstyle a i nbsp are zero 2 Even more concisely a sequence of vectors is linearly independent if and only if 0 displaystyle mathbf 0 nbsp can be represented as a linear combination of its vectors in a unique way If a sequence of vectors contains the same vector twice it is necessarily dependent The linear dependency of a sequence of vectors does not depend of the order of the terms in the sequence This allows defining linear independence for a finite set of vectors A finite set of vectors is linearly independent if the sequence obtained by ordering them is linearly independent In other words one has the following result that is often useful A sequence of vectors is linearly independent if and only if it does not contain the same vector twice and the set of its vectors is linearly independent Infinite case edit An infinite set of vectors is linearly independent if every nonempty finite subset is linearly independent Conversely an infinite set of vectors is linearly dependent if it contains a finite subset that is linearly dependent or equivalently if some vector in the set is a linear combination of other vectors in the set An indexed family of vectors is linearly independent if it does not contain the same vector twice and if the set of its vectors is linearly independent Otherwise the family is said to be linearly dependent A set of vectors which is linearly independent and spans some vector space forms a basis for that vector space For example the vector space of all polynomials in x over the reals has the infinite subset 1 x x2 as a basis Geometric examples edit nbsp u displaystyle vec u nbsp and v displaystyle vec v nbsp are independent and define the plane P u displaystyle vec u nbsp v displaystyle vec v nbsp and w displaystyle vec w nbsp are dependent because all three are contained in the same plane u displaystyle vec u nbsp and j displaystyle vec j nbsp are dependent because they are parallel to each other u displaystyle vec u nbsp v displaystyle vec v nbsp and k displaystyle vec k nbsp are independent because u displaystyle vec u nbsp and v displaystyle vec v nbsp are independent of each other and k displaystyle vec k nbsp is not a linear combination of them or equivalently because they do not belong to a common plane The three vectors define a three dimensional space The vectors o displaystyle vec o nbsp null vector whose components are equal to zero and k displaystyle vec k nbsp are dependent since o 0k displaystyle vec o 0 vec k nbsp Geographic location edit A person describing the location of a certain place might say It is 3 miles north and 4 miles east of here This is sufficient information to describe the location because the geographic coordinate system may be considered as a 2 dimensional vector space ignoring altitude and the curvature of the Earth s surface The person might add The place is 5 miles northeast of here This last statement is true but it is not necessary to find the location In this example the 3 miles north vector and the 4 miles east vector are linearly independent That is to say the north vector cannot be described in terms of the east vector and vice versa The third 5 miles northeast vector is a linear combination of the other two vectors and it makes the set of vectors linearly dependent that is one of the three vectors is unnecessary to define a specific location on a plane Also note that if altitude is not ignored it becomes necessary to add a third vector to the linearly independent set In general n linearly independent vectors are required to describe all locations in n dimensional space Evaluating linear independence editThe zero vector edit If one or more vectors from a given sequence of vectors v1 vk displaystyle mathbf v 1 dots mathbf v k nbsp is the zero vector 0 displaystyle mathbf 0 nbsp then the vector v1 vk displaystyle mathbf v 1 dots mathbf v k nbsp are necessarily linearly dependent and consequently they are not linearly independent To see why suppose that i displaystyle i nbsp is an index i e an element of 1 k displaystyle 1 ldots k nbsp such that vi 0 displaystyle mathbf v i mathbf 0 nbsp Then let ai 1 displaystyle a i 1 nbsp alternatively letting ai displaystyle a i nbsp be equal any other non zero scalar will also work and then let all other scalars be 0 displaystyle 0 nbsp explicitly this means that for any index j displaystyle j nbsp other than i displaystyle i nbsp i e for j i displaystyle j neq i nbsp let aj 0 displaystyle a j 0 nbsp so that consequently ajvj 0vj 0 displaystyle a j mathbf v j 0 mathbf v j mathbf 0 nbsp Simplifying a1v1 akvk displaystyle a 1 mathbf v 1 cdots a k mathbf v k nbsp gives a1v1 akvk 0 0 aivi 0 0 aivi ai0 0 displaystyle a 1 mathbf v 1 cdots a k mathbf v k mathbf 0 cdots mathbf 0 a i mathbf v i mathbf 0 cdots mathbf 0 a i mathbf v i a i mathbf 0 mathbf 0 nbsp Because not all scalars are zero in particular ai 0 displaystyle a i neq 0 nbsp this proves that the vectors v1 vk displaystyle mathbf v 1 dots mathbf v k nbsp are linearly dependent As a consequence the zero vector can not possibly belong to any collection of vectors that is linearly independent Now consider the special case where the sequence of v1 vk displaystyle mathbf v 1 dots mathbf v k nbsp has length 1 displaystyle 1 nbsp i e the case where k 1 displaystyle k 1 nbsp A collection of vectors that consists of exactly one vector is linearly dependent if and only if that vector is zero Explicitly if v1 displaystyle mathbf v 1 nbsp is any vector then the sequence v1 displaystyle mathbf v 1 nbsp which is a sequence of length 1 displaystyle 1 nbsp is linearly dependent if and only if v1 0 displaystyle mathbf v 1 mathbf 0 nbsp alternatively the collection v1 displaystyle mathbf v 1 nbsp is linearly independent if and only if v1 0 displaystyle mathbf v 1 neq mathbf 0 nbsp Linear dependence and independence of two vectors edit This example considers the special case where there are exactly two vector u displaystyle mathbf u nbsp and v displaystyle mathbf v nbsp from some real or complex vector space The vectors u displaystyle mathbf u nbsp and v displaystyle mathbf v nbsp are linearly dependent if and only if at least one of the following is true u displaystyle mathbf u nbsp is a scalar multiple of v displaystyle mathbf v nbsp explicitly this means that there exists a scalar c displaystyle c nbsp such that u cv displaystyle mathbf u c mathbf v nbsp or v displaystyle mathbf v nbsp is a scalar multiple of u displaystyle mathbf u nbsp explicitly this means that there exists a scalar c displaystyle c nbsp such that v cu displaystyle mathbf v c mathbf u nbsp If u 0 displaystyle mathbf u mathbf 0 nbsp then by setting c 0 displaystyle c 0 nbsp we have cv 0v 0 u displaystyle c mathbf v 0 mathbf v mathbf 0 mathbf u nbsp this equality holds no matter what the value of v displaystyle mathbf v nbsp is which shows that 1 is true in this particular case Similarly if v 0 displaystyle mathbf v mathbf 0 nbsp then 2 is true because v 0u displaystyle mathbf v 0 mathbf u nbsp If u v displaystyle mathbf u mathbf v nbsp for instance if they are both equal to the zero vector 0 displaystyle mathbf 0 nbsp then both 1 and 2 are true by using c 1 displaystyle c 1 nbsp for both If u cv displaystyle mathbf u c mathbf v nbsp then u 0 displaystyle mathbf u neq mathbf 0 nbsp is only possible if c 0 displaystyle c neq 0 nbsp and v 0 displaystyle mathbf v neq mathbf 0 nbsp in this case it is possible to multiply both sides by 1c textstyle frac 1 c nbsp to conclude v 1cu textstyle mathbf v frac 1 c mathbf u nbsp This shows that if u 0 displaystyle mathbf u neq mathbf 0 nbsp and v 0 displaystyle mathbf v neq mathbf 0 nbsp then 1 is true if and only if 2 is true that is in this particular case either both 1 and 2 are true and the vectors are linearly dependent or else both 1 and 2 are false and the vectors are linearly independent If u cv displaystyle mathbf u c mathbf v nbsp but instead u 0 displaystyle mathbf u mathbf 0 nbsp then at least one of c displaystyle c nbsp and v displaystyle mathbf v nbsp must be zero Moreover if exactly one of u displaystyle mathbf u nbsp and v displaystyle mathbf v nbsp is 0 displaystyle mathbf 0 nbsp while the other is non zero then exactly one of 1 and 2 is true with the other being false The vectors u displaystyle mathbf u nbsp and v displaystyle mathbf v nbsp are linearly independent if and only if u displaystyle mathbf u nbsp is not a scalar multiple of v displaystyle mathbf v nbsp and v displaystyle mathbf v nbsp is not a scalar multiple of u displaystyle mathbf u nbsp Vectors in R2 edit Three vectors Consider the set of vectors v1 1 1 displaystyle mathbf v 1 1 1 nbsp v2 3 2 displaystyle mathbf v 2 3 2 nbsp and v3 2 4 displaystyle mathbf v 3 2 4 nbsp then the condition for linear dependence seeks a set of non zero scalars such that a1 11 a2 32 a3 24 00 displaystyle a 1 begin bmatrix 1 1 end bmatrix a 2 begin bmatrix 3 2 end bmatrix a 3 begin bmatrix 2 4 end bmatrix begin bmatrix 0 0 end bmatrix nbsp or 1 32124 a1a2a3 00 displaystyle begin bmatrix 1 amp 3 amp 2 1 amp 2 amp 4 end bmatrix begin bmatrix a 1 a 2 a 3 end bmatrix begin bmatrix 0 0 end bmatrix nbsp Row reduce this matrix equation by subtracting the first row from the second to obtain 1 32052 a1a2a3 00 displaystyle begin bmatrix 1 amp 3 amp 2 0 amp 5 amp 2 end bmatrix begin bmatrix a 1 a 2 a 3 end bmatrix begin bmatrix 0 0 end bmatrix nbsp Continue the row reduction by i dividing the second row by 5 and then ii multiplying by 3 and adding to the first row that is 1016 5012 5 a1a2a3 00 displaystyle begin bmatrix 1 amp 0 amp 16 5 0 amp 1 amp 2 5 end bmatrix begin bmatrix a 1 a 2 a 3 end bmatrix begin bmatrix 0 0 end bmatrix nbsp Rearranging this equation allows us to obtain 1001 a1a2 a1a2 a3 16 52 5 displaystyle begin bmatrix 1 amp 0 0 amp 1 end bmatrix begin bmatrix a 1 a 2 end bmatrix begin bmatrix a 1 a 2 end bmatrix a 3 begin bmatrix 16 5 2 5 end bmatrix nbsp which shows that non zero ai exist such that v3 2 4 displaystyle mathbf v 3 2 4 nbsp can be defined in terms of v1 1 1 displaystyle mathbf v 1 1 1 nbsp and v2 3 2 displaystyle mathbf v 2 3 2 nbsp Thus the three vectors are linearly dependent Two vectors Now consider the linear dependence of the two vectors v1 1 1 displaystyle mathbf v 1 1 1 nbsp and v2 3 2 displaystyle mathbf v 2 3 2 nbsp and check a1 11 a2 32 00 displaystyle a 1 begin bmatrix 1 1 end bmatrix a 2 begin bmatrix 3 2 end bmatrix begin bmatrix 0 0 end bmatrix nbsp or 1 312 a1a2 00 displaystyle begin bmatrix 1 amp 3 1 amp 2 end bmatrix begin bmatrix a 1 a 2 end bmatrix begin bmatrix 0 0 end bmatrix nbsp The same row reduction presented above yields 1001 a1a2 00 displaystyle begin bmatrix 1 amp 0 0 amp 1 end bmatrix begin bmatrix a 1 a 2 end bmatrix begin bmatrix 0 0 end bmatrix nbsp This shows that ai 0 displaystyle a i 0 nbsp which means that the vectors v1 1 1 displaystyle mathbf v 1 1 1 nbsp and v2 3 2 displaystyle mathbf v 2 3 2 nbsp are linearly independent Vectors in R4 edit In order to determine if the three vectors in R4 displaystyle mathbb R 4 nbsp v1 142 3 v2 710 4 1 v3 215 4 displaystyle mathbf v 1 begin bmatrix 1 4 2 3 end bmatrix mathbf v 2 begin bmatrix 7 10 4 1 end bmatrix mathbf v 3 begin bmatrix 2 1 5 4 end bmatrix nbsp are linearly dependent form the matrix equation 17 241012 45 3 1 4 a1a2a3 0000 displaystyle begin bmatrix 1 amp 7 amp 2 4 amp 10 amp 1 2 amp 4 amp 5 3 amp 1 amp 4 end bmatrix begin bmatrix a 1 a 2 a 3 end bmatrix begin bmatrix 0 0 0 0 end bmatrix nbsp Row reduce this equation to obtain 17 20 189000000 a1a2a3 0000 displaystyle begin bmatrix 1 amp 7 amp 2 0 amp 18 amp 9 0 amp 0 amp 0 0 amp 0 amp 0 end bmatrix begin bmatrix a 1 a 2 a 3 end bmatrix begin bmatrix 0 0 0 0 end bmatrix nbsp Rearrange to solve for v3 and obtain 170 18 a1a2 a3 29 displaystyle begin bmatrix 1 amp 7 0 amp 18 end bmatrix begin bmatrix a 1 a 2 end bmatrix a 3 begin bmatrix 2 9 end bmatrix nbsp This equation is easily solved to define non zero ai a1 3a3 2 a2 a3 2 displaystyle a 1 3a 3 2 a 2 a 3 2 nbsp where a3 displaystyle a 3 nbsp can be chosen arbitrarily Thus the vectors v1 v2 displaystyle mathbf v 1 mathbf v 2 nbsp and v3 displaystyle mathbf v 3 nbsp are linearly dependent Alternative method using determinants edit An alternative method relies on the fact that n displaystyle n nbsp vectors in Rn displaystyle mathbb R n nbsp are linearly independent if and only if the determinant of the matrix formed by taking the vectors as its columns is non zero In this case the matrix formed by the vectors is A 1 312 displaystyle A begin bmatrix 1 amp 3 1 amp 2 end bmatrix nbsp We may write a linear combination of the columns as AL 1 312 l1l2 displaystyle A Lambda begin bmatrix 1 amp 3 1 amp 2 end bmatrix begin bmatrix lambda 1 lambda 2 end bmatrix nbsp We are interested in whether AL 0 for some nonzero vector L This depends on the determinant of A displaystyle A nbsp which is detA 1 2 1 3 5 0 displaystyle det A 1 cdot 2 1 cdot 3 5 neq 0 nbsp Since the determinant is non zero the vectors 1 1 displaystyle 1 1 nbsp and 3 2 displaystyle 3 2 nbsp are linearly independent Otherwise suppose we have m displaystyle m nbsp vectors of n displaystyle n nbsp coordinates with m lt n displaystyle m lt n nbsp Then A is an n m matrix and L is a column vector with m displaystyle m nbsp entries and we are again interested in AL 0 As we saw previously this is equivalent to a list of n displaystyle n nbsp equations Consider the first m displaystyle m nbsp rows of A displaystyle A nbsp the first m displaystyle m nbsp equations any solution of the full list of equations must also be true of the reduced list In fact if i1 im is any list of m displaystyle m nbsp rows then the equation must be true for those rows A i1 im L 0 displaystyle A langle i 1 dots i m rangle Lambda mathbf 0 nbsp Furthermore the reverse is true That is we can test whether the m displaystyle m nbsp vectors are linearly dependent by testing whether detA i1 im 0 displaystyle det A langle i 1 dots i m rangle 0 nbsp for all possible lists of m displaystyle m nbsp rows In case m n displaystyle m n nbsp this requires only one determinant as above If m gt n displaystyle m gt n nbsp then it is a theorem that the vectors must be linearly dependent This fact is valuable for theory in practical calculations more efficient methods are available More vectors than dimensions edit If there are more vectors than dimensions the vectors are linearly dependent This is illustrated in the example above of three vectors in R2 displaystyle mathbb R 2 nbsp Natural basis vectors editLet V Rn displaystyle V mathbb R n nbsp and consider the following elements in V displaystyle V nbsp known as the natural basis vectors e1 1 0 0 0 e2 0 1 0 0 en 0 0 0 1 displaystyle begin matrix mathbf e 1 amp amp 1 0 0 ldots 0 mathbf e 2 amp amp 0 1 0 ldots 0 amp vdots mathbf e n amp amp 0 0 0 ldots 1 end matrix nbsp Then e1 e2 en displaystyle mathbf e 1 mathbf e 2 ldots mathbf e n nbsp are linearly independent Proof Suppose that a1 a2 an displaystyle a 1 a 2 ldots a n nbsp are real numbers such that a1e1 a2e2 anen 0 displaystyle a 1 mathbf e 1 a 2 mathbf e 2 cdots a n mathbf e n mathbf 0 nbsp Since a1e1 a2e2 anen a1 a2 an displaystyle a 1 mathbf e 1 a 2 mathbf e 2 cdots a n mathbf e n left a 1 a 2 ldots a n right nbsp then ai 0 displaystyle a i 0 nbsp for all i 1 n displaystyle i 1 ldots n nbsp Linear independence of functions editLet V displaystyle V nbsp be the vector space of all differentiable functions of a real variable t displaystyle t nbsp Then the functions et displaystyle e t nbsp and e2t displaystyle e 2t nbsp in V displaystyle V nbsp are linearly independent Proof edit Suppose a displaystyle a nbsp and b displaystyle b nbsp are two real numbers such that aet be2t 0 displaystyle ae t be 2t 0 nbsp Take the first derivative of the above equation aet 2be2t 0 displaystyle ae t 2be 2t 0 nbsp for all values of t displaystyle t nbsp We need to show that a 0 displaystyle a 0 nbsp and b 0 displaystyle b 0 nbsp In order to do this we subtract the first equation from the second giving be2t 0 displaystyle be 2t 0 nbsp Since e2t displaystyle e 2t nbsp is not zero for some t displaystyle t nbsp b 0 displaystyle b 0 nbsp It follows that a 0 displaystyle a 0 nbsp too Therefore according to the definition of linear independence et displaystyle e t nbsp and e2t displaystyle e 2t nbsp are linearly independent Space of linear dependencies editA linear dependency or linear relation among vectors v1 vn is a tuple a1 an with n scalar components such that a1v1 anvn 0 displaystyle a 1 mathbf v 1 cdots a n mathbf v n mathbf 0 nbsp If such a linear dependence exists with at least a nonzero component then the n vectors are linearly dependent Linear dependencies among v1 vn form a vector space If the vectors are expressed by their coordinates then the linear dependencies are the solutions of a homogeneous system of linear equations with the coordinates of the vectors as coefficients A basis of the vector space of linear dependencies can therefore be computed by Gaussian elimination Generalizations editAffine independence edit See also Affine space A set of vectors is said to be affinely dependent if at least one of the vectors in the set can be defined as an affine combination of the others Otherwise the set is called affinely independent Any affine combination is a linear combination therefore every affinely dependent set is linearly dependent Conversely every linearly independent set is affinely independent Consider a set of m displaystyle m nbsp vectors v1 vm displaystyle mathbf v 1 ldots mathbf v m nbsp of size n displaystyle n nbsp each and consider the set of m displaystyle m nbsp augmented vectors 1v1 1vm textstyle left left begin smallmatrix 1 mathbf v 1 end smallmatrix right ldots left begin smallmatrix 1 mathbf v m end smallmatrix right right nbsp of size n 1 displaystyle n 1 nbsp each The original vectors are affinely independent if and only if the augmented vectors are linearly independent 3 256 Linearly independent vector subspaces edit Two vector subspaces M displaystyle M nbsp and N displaystyle N nbsp of a vector space X displaystyle X nbsp are said to be linearly independent if M N 0 displaystyle M cap N 0 nbsp 4 More generally a collection M1 Md displaystyle M 1 ldots M d nbsp of subspaces of X displaystyle X nbsp are said to be linearly independent if Mi k iMk 0 textstyle M i cap sum k neq i M k 0 nbsp for every index i displaystyle i nbsp where k iMk m1 mi 1 mi 1 md mk Mk for all k span k 1 i 1 i 1 d Mk textstyle sum k neq i M k Big m 1 cdots m i 1 m i 1 cdots m d m k in M k text for all k Big operatorname span bigcup k in 1 ldots i 1 i 1 ldots d M k nbsp 4 The vector space X displaystyle X nbsp is said to be a direct sum of M1 Md displaystyle M 1 ldots M d nbsp if these subspaces are linearly independent and M1 Md X displaystyle M 1 cdots M d X nbsp See also editMatroid Abstraction of linear independence of vectorsReferences edit G E Shilov Linear Algebra Trans R A Silverman Dover Publications New York 1977 Friedberg Stephen Insel Arnold Spence Lawrence 2003 Linear Algebra Pearson 4th Edition pp 48 49 ISBN 0130084514 Lovasz Laszlo Plummer M D 1986 Matching Theory Annals of Discrete Mathematics vol 29 North Holland ISBN 0 444 87916 1 MR 0859549 a b Bachman George Narici Lawrence 2000 Functional Analysis Second ed Mineola New York Dover Publications ISBN 978 0486402512 OCLC 829157984 pp 3 7External links edit Linear independence Encyclopedia of Mathematics EMS Press 2001 1994 Linearly Dependent Functions at WolframMathWorld Tutorial and interactive program on Linear Independence Introduction to Linear Independence at KhanAcademy Retrieved from https en wikipedia org w index php title Linear independence amp oldid 1202372736, wikipedia, wiki, book, books, library,

article

, read, download, free, free download, mp3, video, mp4, 3gp, jpg, jpeg, gif, png, picture, music, song, movie, book, game, games.