Covariance - Revision history

IssaRice: /* Questions/things to explain */

2019-07-31T05:21:54Z

Questions/things to explain

← Older revision		Revision as of 05:21, 31 July 2019
Line 4:		Line 4:

	* A lot of explanations of covariance say things like "if the covariance is high, then the two variables vary together, so that when one is higher than average the other is as well". That sounds more like conditional expectation though, specifically <math>\mathrm E(Y - \mathrm E(Y) \mid X - \mathrm E(X))</math>. Can we express covariance in terms of this conditional language?		* A lot of explanations of covariance say things like "if the covariance is high, then the two variables vary together, so that when one is higher than average the other is as well". That sounds more like conditional expectation though, specifically <math>\mathrm E(Y - \mathrm E(Y) \mid X - \mathrm E(X))</math>. Can we express covariance in terms of this conditional language?

			Here is one attempt, though I don't think it helps much:

			<math>\begin{align}E[(X - EX)(Y - EY)] &= \sum_x \sum_y P(X=x,Y=x)(x-EX)(y-EY) \\ &= \sum_x (x-EX) \sum_y P(x,y)(y-EY) \\ &= \sum_x P(X=x)(x-EX) \sum_y \frac{P(x,y)}{P(X=x)}(y-EY) \\ &= \sum_x P(X=x)(x-EX) \sum_y P(Y=y\|X=x)(y-EY) \\ &= E_X[(X-EX)E[Y-EY\|X]]\end{align}</math>

	* Explain difference (in units, range of values) with correlation. Can we get positive/negative/large/small covariance and negative/positive/small/large correlation?		* Explain difference (in units, range of values) with correlation. Can we get positive/negative/large/small covariance and negative/positive/small/large correlation?
	** This seems like a good example of where correlation vs covariance matters: "Correlation is covariance divided by variance, so if A is highly predictive of B, there can be a strong “correlation” between them even if A is ranging from 0 to 9 and B is only ranging from 50.0001 and 50.0009. Price’s Equation runs on covariance of characteristics with reproduction—not correlation! If you can compress variance in characteristics into a tiny band, the covariance goes way down, and so does the cumulative change in the characteristic." [https://www.readthesequences.com/NoEvolutionsForCorporationsOrNanodevices]		** This seems like a good example of where correlation vs covariance matters: "Correlation is covariance divided by variance, so if A is highly predictive of B, there can be a strong “correlation” between them even if A is ranging from 0 to 9 and B is only ranging from 50.0001 and 50.0009. Price’s Equation runs on covariance of characteristics with reproduction—not correlation! If you can compress variance in characteristics into a tiny band, the covariance goes way down, and so does the cumulative change in the characteristic." [https://www.readthesequences.com/NoEvolutionsForCorporationsOrNanodevices]

IssaRice: /* Questions/things to explain */

2019-01-16T22:13:14Z

Questions/things to explain

← Older revision		Revision as of 22:13, 16 January 2019
Line 7:		Line 7:
	** This seems like a good example of where correlation vs covariance matters: "Correlation is covariance divided by variance, so if A is highly predictive of B, there can be a strong “correlation” between them even if A is ranging from 0 to 9 and B is only ranging from 50.0001 and 50.0009. Price’s Equation runs on covariance of characteristics with reproduction—not correlation! If you can compress variance in characteristics into a tiny band, the covariance goes way down, and so does the cumulative change in the characteristic." [https://www.readthesequences.com/NoEvolutionsForCorporationsOrNanodevices]		** This seems like a good example of where correlation vs covariance matters: "Correlation is covariance divided by variance, so if A is highly predictive of B, there can be a strong “correlation” between them even if A is ranging from 0 to 9 and B is only ranging from 50.0001 and 50.0009. Price’s Equation runs on covariance of characteristics with reproduction—not correlation! If you can compress variance in characteristics into a tiny band, the covariance goes way down, and so does the cumulative change in the characteristic." [https://www.readthesequences.com/NoEvolutionsForCorporationsOrNanodevices]
	* Visualization as signed area of rectangles: between all points [https://stats.stackexchange.com/a/18200] [http://www.davidchudzicki.com/posts/covariance-as-signed-area-of-rectangles/] and between the axes drawn by the means [https://mbernste.github.io/files/notes/VisualizingVarianceCovariance.pdf] [https://stats.seandolinar.com/covariance-different-ways-to-explain/]		* Visualization as signed area of rectangles: between all points [https://stats.stackexchange.com/a/18200] [http://www.davidchudzicki.com/posts/covariance-as-signed-area-of-rectangles/] and between the axes drawn by the means [https://mbernste.github.io/files/notes/VisualizingVarianceCovariance.pdf] [https://stats.seandolinar.com/covariance-different-ways-to-explain/]
			* comparison with independence of random variables
			* clarify how the expectation is taken in each of the three appearances

	[[Category:Probability]]		[[Category:Probability]]

IssaRice: /* Questions/things to explain */

2019-01-16T03:43:12Z

Questions/things to explain

← Older revision		Revision as of 03:43, 16 January 2019
Line 5:		Line 5:
	* A lot of explanations of covariance say things like "if the covariance is high, then the two variables vary together, so that when one is higher than average the other is as well". That sounds more like conditional expectation though, specifically <math>\mathrm E(Y - \mathrm E(Y) \mid X - \mathrm E(X))</math>. Can we express covariance in terms of this conditional language?		* A lot of explanations of covariance say things like "if the covariance is high, then the two variables vary together, so that when one is higher than average the other is as well". That sounds more like conditional expectation though, specifically <math>\mathrm E(Y - \mathrm E(Y) \mid X - \mathrm E(X))</math>. Can we express covariance in terms of this conditional language?
	* Explain difference (in units, range of values) with correlation. Can we get positive/negative/large/small covariance and negative/positive/small/large correlation?		* Explain difference (in units, range of values) with correlation. Can we get positive/negative/large/small covariance and negative/positive/small/large correlation?
			** This seems like a good example of where correlation vs covariance matters: "Correlation is covariance divided by variance, so if A is highly predictive of B, there can be a strong “correlation” between them even if A is ranging from 0 to 9 and B is only ranging from 50.0001 and 50.0009. Price’s Equation runs on covariance of characteristics with reproduction—not correlation! If you can compress variance in characteristics into a tiny band, the covariance goes way down, and so does the cumulative change in the characteristic." [https://www.readthesequences.com/NoEvolutionsForCorporationsOrNanodevices]
	* Visualization as signed area of rectangles: between all points [https://stats.stackexchange.com/a/18200] [http://www.davidchudzicki.com/posts/covariance-as-signed-area-of-rectangles/] and between the axes drawn by the means [https://mbernste.github.io/files/notes/VisualizingVarianceCovariance.pdf] [https://stats.seandolinar.com/covariance-different-ways-to-explain/]		* Visualization as signed area of rectangles: between all points [https://stats.stackexchange.com/a/18200] [http://www.davidchudzicki.com/posts/covariance-as-signed-area-of-rectangles/] and between the axes drawn by the means [https://mbernste.github.io/files/notes/VisualizingVarianceCovariance.pdf] [https://stats.seandolinar.com/covariance-different-ways-to-explain/]

	[[Category:Probability]]		[[Category:Probability]]

IssaRice at 03:40, 16 January 2019

2019-01-16T03:40:26Z

← Older revision		Revision as of 03:40, 16 January 2019
Line 6:		Line 6:
	* Explain difference (in units, range of values) with correlation. Can we get positive/negative/large/small covariance and negative/positive/small/large correlation?		* Explain difference (in units, range of values) with correlation. Can we get positive/negative/large/small covariance and negative/positive/small/large correlation?
	* Visualization as signed area of rectangles: between all points [https://stats.stackexchange.com/a/18200] [http://www.davidchudzicki.com/posts/covariance-as-signed-area-of-rectangles/] and between the axes drawn by the means [https://mbernste.github.io/files/notes/VisualizingVarianceCovariance.pdf] [https://stats.seandolinar.com/covariance-different-ways-to-explain/]		* Visualization as signed area of rectangles: between all points [https://stats.stackexchange.com/a/18200] [http://www.davidchudzicki.com/posts/covariance-as-signed-area-of-rectangles/] and between the axes drawn by the means [https://mbernste.github.io/files/notes/VisualizingVarianceCovariance.pdf] [https://stats.seandolinar.com/covariance-different-ways-to-explain/]

			[[Category:Probability]]

IssaRice: /* Questions/things to explain */

2018-07-11T22:44:34Z

Questions/things to explain

← Older revision		Revision as of 22:44, 11 July 2018
Line 5:		Line 5:
	* A lot of explanations of covariance say things like "if the covariance is high, then the two variables vary together, so that when one is higher than average the other is as well". That sounds more like conditional expectation though, specifically <math>\mathrm E(Y - \mathrm E(Y) \mid X - \mathrm E(X))</math>. Can we express covariance in terms of this conditional language?		* A lot of explanations of covariance say things like "if the covariance is high, then the two variables vary together, so that when one is higher than average the other is as well". That sounds more like conditional expectation though, specifically <math>\mathrm E(Y - \mathrm E(Y) \mid X - \mathrm E(X))</math>. Can we express covariance in terms of this conditional language?
	* Explain difference (in units, range of values) with correlation. Can we get positive/negative/large/small covariance and negative/positive/small/large correlation?		* Explain difference (in units, range of values) with correlation. Can we get positive/negative/large/small covariance and negative/positive/small/large correlation?
			* Visualization as signed area of rectangles: between all points [https://stats.stackexchange.com/a/18200] [http://www.davidchudzicki.com/posts/covariance-as-signed-area-of-rectangles/] and between the axes drawn by the means [https://mbernste.github.io/files/notes/VisualizingVarianceCovariance.pdf] [https://stats.seandolinar.com/covariance-different-ways-to-explain/]

IssaRice: /* Questions/things to explain */

2018-07-11T21:14:17Z

Questions/things to explain

← Older revision		Revision as of 21:14, 11 July 2018
Line 4:		Line 4:

	* A lot of explanations of covariance say things like "if the covariance is high, then the two variables vary together, so that when one is higher than average the other is as well". That sounds more like conditional expectation though, specifically <math>\mathrm E(Y - \mathrm E(Y) \mid X - \mathrm E(X))</math>. Can we express covariance in terms of this conditional language?		* A lot of explanations of covariance say things like "if the covariance is high, then the two variables vary together, so that when one is higher than average the other is as well". That sounds more like conditional expectation though, specifically <math>\mathrm E(Y - \mathrm E(Y) \mid X - \mathrm E(X))</math>. Can we express covariance in terms of this conditional language?
	* Explain difference (in units, range of values) with correlation.		* Explain difference (in units, range of values) with correlation. Can we get positive/negative/large/small covariance and negative/positive/small/large correlation?

IssaRice: /* Questions/things to explain */

2018-07-11T21:12:38Z

Questions/things to explain

← Older revision		Revision as of 21:12, 11 July 2018
Line 3:		Line 3:
	==Questions/things to explain==		==Questions/things to explain==

	* A lot of explanations of covariance say things like "if the covariance is high, then the two variables vary together, so that when one is higher than average the other is as well". That sounds more like conditional expectation though, specifically <math>\mathrm E(Y - \mathrm E(Y) \mid X - \mathrm E(X))</math>.		* A lot of explanations of covariance say things like "if the covariance is high, then the two variables vary together, so that when one is higher than average the other is as well". That sounds more like conditional expectation though, specifically <math>\mathrm E(Y - \mathrm E(Y) \mid X - \mathrm E(X))</math>. Can we express covariance in terms of this conditional language?
	* Explain difference (in units, range of values) with correlation.		* Explain difference (in units, range of values) with correlation.

IssaRice: Created page with "The covariance between two random variables $X$ and $Y$ is defined as $\operatorname{cov}(X,Y) = \mathrm E((X - \mathrm E(X))(Y - \mathrm E(Y)))$
2018-07-11T21:04:46Z

Created page with "The covariance between two random variables <math>X</math> and <math>Y</math> is defined as <math>\operatorname{cov}(X,Y) = \mathrm E((X - \mathrm E(X))(Y - \mathrm E(Y)))</ma..."

New page
The covariance between two random variables <math>X</math> and <math>Y</math> is defined as <math>\operatorname{cov}(X,Y) = \mathrm E((X - \mathrm E(X))(Y - \mathrm E(Y)))</math>.

==Questions/things to explain==

* A lot of explanations of covariance say things like "if the covariance is high, then the two variables vary together, so that when one is higher than average the other is as well". That sounds more like conditional expectation though, specifically <math>\mathrm E(Y - \mathrm E(Y) \mid X - \mathrm E(X))</math>.
* Explain difference (in units, range of values) with correlation.