User:IssaRice/Linear algebra/Dual basis

From Machinelearning
Revision as of 19:16, 16 August 2020 by IssaRice (talk | contribs)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

see p. 224 of https://terrytao.files.wordpress.com/2011/06/blog-book.pdf

the following example is based on p. 115 of https://terrytao.files.wordpress.com/2016/12/linear-algebra-notes.pdf

Let V be the space of all mixtures of CO2 and CO, and let β:=(CO2,CO) and β:=(C,O).

The change of coordinate matrix, from β to β, is then [IV]ββ=(1121).

The change of coordinate matrix, from β to β, is the inverse of [IV]ββ, and we have [IV]ββ=([IV]ββ)1=(1121).

Now let us extend this example to discuss dual spaces.

Given some mixture (i.e. linear combination) a×CO2+b×CO, the dual basis of β consists of two linear functionals φ1,φ2 such that

φ1(a×CO2+b×CO)=a

φ2(a×CO2+b×CO)=b

Similarly, given some mixture c×C+d×O, the dual basis of β consists of two linear functionals ψ1,ψ2 such that

ψ1(c×C+d×O)=c

ψ2(c×C+d×O)=d

Now we can ask, given φ1, how can we write it in terms of ψ1,ψ2?

Given the mixture a×CO2+b×CO, we can write this as (a+b)×C+(2a+b)×O. Thus, ψ1(a×CO2+b×CO)=a+b and ψ2(a×CO2+b×CO)=2a+b. In other words, our task is to express a in terms of a+b and 2a+b. We get (2a+b)(a+b)=a, so φ1=ψ1+ψ2.

Similarly, we get φ2=2ψ11ψ2.

Thus, the matrix is [IV](φ1,φ2)(ψ1,ψ2)=(1211). This matrix is the transpose of [IV]ββ. This is not a coincidence.

In Tao's yards and feet example on pages 224-225 of https://terrytao.files.wordpress.com/2011/06/blog-book.pdf we writes that

1 yard=3 feet

yards(L)=feet(L)/3

The more general statement of this is that [IV](φ1,φ2)(ψ1,ψ2)=(([IV]ββ)1). In the one-dimensional case, the transpose does not change the matrix, so we just invert it, going from (3) to (1/3).

Why did I go through all of this? When reading Tao's "Coordinates" entry, the yards/feet example confused me: I knew that the matrix of the dual transformation is just the transpose, so in the one-dimensional case it shouldn't change anything. And yet, we had to take the reciprocal! The way out of this is to realize that in going to the dual space and taking the transpose, we also swap the order of the bases. So Tao could have written the two equations as follows:

1 yard=3 feet

feet(L)=3×yards(L)

Now the matrices are indeed just transposes of each other!

To see what was really going on, I had to first escape the too-simple one-dimensional case, so I went to the two-dimensional example that I remembered from Tao's linear algebra notes.


https://www.abstractmath.org/MM/MMUsefulBehaviors.htm#selfmonitoring.htm

The students and professors example is like the yards and feet example that tao gives in the coordinates entry of "compactness and contradiction".