User:IssaRice/Linear algebra/Dual basis: Difference between revisions

From Machinelearning
No edit summary
No edit summary
 
(11 intermediate revisions by the same user not shown)
Line 11: Line 11:
Now let us extend this example to discuss dual spaces.
Now let us extend this example to discuss dual spaces.


Given some mixture (i.e. linear combination) <math>a \times CO_2 + b \times CO</math>, the dual basis of <math>\beta</math> consists of two linear functionals <math>(\varphi_1, \varphi_2)</math> such that
Given some mixture (i.e. linear combination) <math>a \times CO_2 + b \times CO</math>, the dual basis of <math>\beta</math> consists of two linear functionals <math>\varphi_1, \varphi_2</math> such that


<math>\varphi_1(a \times CO_2 + b \times CO) = a</math>
<math>\varphi_1(a \times CO_2 + b \times CO) = a</math>
<math>\varphi_2(a \times CO_2 + b \times CO) = b</math>
<math>\varphi_2(a \times CO_2 + b \times CO) = b</math>


Similarly, given some mixture <math>c \times C + d \times O</math>, the dual space of <math>\beta'</math> consists of two linear functionals <math>(\psi_1, \psi_2)</math> such that
Similarly, given some mixture <math>c \times C + d \times O</math>, the dual basis of <math>\beta'</math> consists of two linear functionals <math>\psi_1, \psi_2</math> such that
 
<math>\psi_1(c \times C + d \times O) = c</math>
 
<math>\psi_2(c \times C + d \times O) = d</math>
 
Now we can ask, given <math>\varphi_1</math>, how can we write it in terms of <math>\psi_1, \psi_2</math>?
 
Given the mixture <math>a \times CO_2 + b \times CO</math>, we can write this as <math>(a + b) \times C + (2a + b) \times O</math>. Thus, <math>\psi_1(a \times CO_2 + b \times CO) = a+b</math> and <math>\psi_2(a \times CO_2 + b \times CO) = 2a+b</math>. In other words, our task is to express <math>a</math> in terms of <math>a+b</math> and <math>2a+b</math>. We get <math>(2a+b) - (a+b) = a</math>, so <math>\varphi_1 = -\psi_1 + \psi_2</math>.
 
Similarly, we get <math>\varphi_2 = 2\psi_1 -1\psi_2</math>.
 
Thus, the matrix is <math>[I_{V'}]_{(\varphi_1, \varphi_2)}^{(\psi_1, \psi_2)} = \begin{pmatrix}-1 & 2 \\ 1 & -1\end{pmatrix}</math>. This matrix is the transpose of <math>[I_V]_{\beta'}^\beta</math>. This is not a coincidence.
 
In Tao's yards and feet example on pages 224-225 of https://terrytao.files.wordpress.com/2011/06/blog-book.pdf we writes that
 
<math>1 \text{ yard} = 3\text{ feet}</math>
 
<math>\text{yards}(L) = \text{feet}(L)/3</math>
 
The more general statement of this is that <math>[I_{V'}]_{(\varphi_1, \varphi_2)}^{(\psi_1, \psi_2)} = (([I_V]_\beta^{\beta'})^{-1})^\top</math>. In the one-dimensional case, the transpose does not change the matrix, so we just invert it, going from <math>(3)</math> to <math>(1/3)</math>.
 
Why did I go through all of this? When reading Tao's "Coordinates" entry, the yards/feet example confused me: I knew that the matrix of the dual transformation is just the transpose, so in the one-dimensional case it shouldn't change anything. And yet, we had to take the reciprocal! The way out of this is to realize that in going to the dual space and taking the transpose, we also swap the order of the bases. So Tao could have written the two equations as follows:
 
<math>1 \text{ yard} = 3\text{ feet}</math>
 
<math>\text{feet}(L) = 3\times\text{yards}(L)</math>
 
Now the matrices are indeed just transposes of each other!
 
To see what was really going on, I had to first escape the too-simple one-dimensional case, so I went to the two-dimensional example that I remembered from Tao's linear algebra notes.
 
----
 
https://www.abstractmath.org/MM/MMUsefulBehaviors.htm#selfmonitoring.htm


<math>\varphi_1(c \times C + d \times O) = c</math>
The students and professors example is like the yards and feet example that tao gives in the coordinates entry of "compactness and contradiction".
<math>\varphi_2(c \times C + d \times O) = d</math>

Latest revision as of 19:16, 16 August 2020

see p. 224 of https://terrytao.files.wordpress.com/2011/06/blog-book.pdf

the following example is based on p. 115 of https://terrytao.files.wordpress.com/2016/12/linear-algebra-notes.pdf

Let V be the space of all mixtures of CO2 and CO, and let β:=(CO2,CO) and β:=(C,O).

The change of coordinate matrix, from β to β, is then [IV]ββ=(1121).

The change of coordinate matrix, from β to β, is the inverse of [IV]ββ, and we have [IV]ββ=([IV]ββ)1=(1121).

Now let us extend this example to discuss dual spaces.

Given some mixture (i.e. linear combination) a×CO2+b×CO, the dual basis of β consists of two linear functionals φ1,φ2 such that

φ1(a×CO2+b×CO)=a

φ2(a×CO2+b×CO)=b

Similarly, given some mixture c×C+d×O, the dual basis of β consists of two linear functionals ψ1,ψ2 such that

ψ1(c×C+d×O)=c

ψ2(c×C+d×O)=d

Now we can ask, given φ1, how can we write it in terms of ψ1,ψ2?

Given the mixture a×CO2+b×CO, we can write this as (a+b)×C+(2a+b)×O. Thus, ψ1(a×CO2+b×CO)=a+b and ψ2(a×CO2+b×CO)=2a+b. In other words, our task is to express a in terms of a+b and 2a+b. We get (2a+b)(a+b)=a, so φ1=ψ1+ψ2.

Similarly, we get φ2=2ψ11ψ2.

Thus, the matrix is [IV](φ1,φ2)(ψ1,ψ2)=(1211). This matrix is the transpose of [IV]ββ. This is not a coincidence.

In Tao's yards and feet example on pages 224-225 of https://terrytao.files.wordpress.com/2011/06/blog-book.pdf we writes that

1 yard=3 feet

yards(L)=feet(L)/3

The more general statement of this is that [IV](φ1,φ2)(ψ1,ψ2)=(([IV]ββ)1). In the one-dimensional case, the transpose does not change the matrix, so we just invert it, going from (3) to (1/3).

Why did I go through all of this? When reading Tao's "Coordinates" entry, the yards/feet example confused me: I knew that the matrix of the dual transformation is just the transpose, so in the one-dimensional case it shouldn't change anything. And yet, we had to take the reciprocal! The way out of this is to realize that in going to the dual space and taking the transpose, we also swap the order of the bases. So Tao could have written the two equations as follows:

1 yard=3 feet

feet(L)=3×yards(L)

Now the matrices are indeed just transposes of each other!

To see what was really going on, I had to first escape the too-simple one-dimensional case, so I went to the two-dimensional example that I remembered from Tao's linear algebra notes.


https://www.abstractmath.org/MM/MMUsefulBehaviors.htm#selfmonitoring.htm

The students and professors example is like the yards and feet example that tao gives in the coordinates entry of "compactness and contradiction".