User contributions
- 22:21, 8 November 2018 (diff | hist) . . (+641) . . N Backpropagation derivation using Leibniz notation (Created page with "The cost function <math>C</math> depends on <math>w^l_{jk}</math> only through the activation of the <math>j</math>th neuron in the <math>l</math>th layer, i.e. on the value o...")
- 05:21, 23 October 2018 (diff | hist) . . (+302) . . N User:IssaRice/Increasingly granular measuring stick (Created page with "Exercise 3.6.6 in Rosenthal's ''A First Look at Rigorous Probability Theory''. Theorem 5.5.9 (existence of least upper bound) and Proposition 5.4.14/exercise 5.4.5 in Tao's '...") (current)
- 18:43, 1 October 2018 (diff | hist) . . (+347) . . N User:IssaRice/Strength of a mathematical statement (Created page with " ==External links== * https://gowers.wordpress.com/2008/12/28/how-can-one-equivalent-statement-be-stronger-than-another/ (haven't read this yet) * https://gowers.wordpress.co...")
- 00:31, 22 September 2018 (diff | hist) . . (+1,095) . . N V-structure (Created page with "In graphical models, a '''v-structure''' is a set of three nodes in a graph such that there are two converging arrows and the tails of the arrows are not connected by an arrow...")
- 06:47, 16 September 2018 (diff | hist) . . (+2,378) . . N User:IssaRice/Decrement command in loop programs (Created page with "(started typing this up as a question for math SE, but I think I got it) Herbert Enderton’s ''Computability Theory: An Introduction to Recursion Theory'' defines a loop pro...")
- 03:08, 15 September 2018 (diff | hist) . . (+556) . . N User:IssaRice/First graph principle using a semirecursive relation (Created page with "This is about proposition 7.17 (first graph principle) in Boolos, Burgess, Jeffrey's ''Computability and Logic''. The proof in the book defines two functions as follows: :<m...")
- 02:38, 15 September 2018 (diff | hist) . . (+1,299) . . N User:IssaRice/Characteristic function of a semirecursive set (Created page with "What if we try to define a characteristic function for a semirecursive relation <math>S</math> as follows? :<math>\chi_S(x,y) = \begin{cases}1 & \text{if }S(x,y) \\ 0 & \text...")
- 22:57, 14 September 2018 (diff | hist) . . (+805) . . N User:IssaRice/Comparison of concepts in computability theory (Created page with "{| class="sortable wikitable" |- ! Set !! Intuitive meaning !! In terms of characteristic function |- | Primitive recursive set || || The characteristic function (which must b...")
- 19:09, 6 September 2018 (diff | hist) . . (+309) . . N User:IssaRice/Summary table of sets in computability (Created page with "{| class="sortable wikitable" |- ! Set !! Enumerable? !! Recursive? !! Primitive recursive? !! Recursively enumerable/semirecursive? |- | Set of natural numbers || Yes || Yes...")
- 18:13, 3 September 2018 (diff | hist) . . (+504) . . N User:IssaRice/Belief propagation two coins and a bell example (Created page with "This is an example that illustrates belief propagation in a simple polytree. The situation is given by Pearl (though he doesn't use it as an example of belief propagation). Th...")
- 04:53, 3 September 2018 (diff | hist) . . (+314) . . N User:IssaRice/Belief propagation and cognitive biases (Created page with "* "Several cognitive biases can be seen as confusion between probabilities and likelihoods, most centrally base-rate neglect." [https://www.greaterwrong.com/posts/tp4rEtQqRshP...")
- 21:11, 1 September 2018 (diff | hist) . . (+490) . . N User:IssaRice/Type checking Pearl's belief propagation notation (Created page with "this is all from Judea Pearl's ''Probabilistic Reasoning in Intelligent Systems'', chapter 4. Pearl writes expressions like "<math>\lambda(x)</math>" and "<math>\pi(x)</math>...")
- 20:56, 24 August 2018 (diff | hist) . . (+293) . . N User:IssaRice/Aumann's agreement theorem (Created page with "Hal Finney's example <math>\begin{array}{c|rrrrrr} & 1 & 2 & 3 & 4 & 5 & 6 \\ \hline 1 & 2 & 3 & 4 & 5 & 6 & 7 \\ 2 & 3 & 4 & 5 & 6 & 7 & 8 \\ 3 & 4 & 5 & 6 & 7 & 8 &...")
- 22:45, 13 August 2018 (diff | hist) . . (+1,376) . . N User:IssaRice/Minus notation in game theory (Created page with "In game theory, <math>s_{-i}</math> is a shorthand for <math>(s_1,\ldots,s_{i-1},s_{i+1},\ldots,s_n) \in S_1 \times \cdots \times S_{i-1} \times S_{i+1} \times \cdots \times S...")
- 05:21, 5 August 2018 (diff | hist) . . (+867) . . N User:IssaRice/Restricting some class of mathematical objects (Created page with "I'm not sure if this has a name, but I'll describe the pattern I'm thinking of and give an example. # We start with some general class of mathematical objects, and we want th...")
- 02:11, 3 August 2018 (diff | hist) . . (+711) . . N User:IssaRice/Logical induction notation (Created page with "This is in user space because it's not really about machine learning. {| class="sortable wikitable" |- ! Term !! Notation !! Type !! Definition !! Notes |- | <math>\mathcal F...")
- 07:24, 16 July 2018 (diff | hist) . . (+758) . . N Notational confusion of multivariable derivatives (Created page with "I think there's several different confusions that arise from multivariable derivative notation: * The thing where <math>\frac{\partial w}{\partial t}</math> can mean two diff...")
- 04:52, 16 July 2018 (diff | hist) . . (+312) . . N Summary table of multivariable derivatives (Created page with "This page is a '''summary table of multivariable derivatives'''. ==Table== ==See also== * calculus:Relation between gradient vector and partial derivatives * calculus...")
- 03:25, 14 July 2018 (diff | hist) . . (+42) . . N Principle component analysis (Redirected page to Principal component analysis) (current)
- 03:24, 14 July 2018 (diff | hist) . . (+42) . . N PCA (Redirected page to Principal component analysis) (current)
- 22:40, 13 July 2018 (diff | hist) . . (+405) . . N Derivative of a quadratic form (Created page with "Let <math>A \in \mathcal M_{n,n}(\mathbf R)</math> be an <math>n</math> by <math>n</math> real-valued matrix, and let <math>f\colon \mathbf R^n \to \mathbf R</math> be defined...")
- 21:11, 11 July 2018 (diff | hist) . . (+168) . . N Principal component analysis (Created page with " ==Questions/things to explain== * Analogously to the covariance matrix one can define a correlation matrix. What happens if you run SVD on the correlation matrix?")
- 21:09, 11 July 2018 (diff | hist) . . (+297) . . N Covariance matrix (Created page with " ==Questions/things to explain== * The covariance matrix is a matrix, so it's a linear transformation. So what is the transformation? What does it do to vectors? * Some defin...") (current)
- 21:04, 11 July 2018 (diff | hist) . . (+594) . . N Covariance (Created page with "The covariance between two random variables <math>X</math> and <math>Y</math> is defined as <math>\operatorname{cov}(X,Y) = \mathrm E((X - \mathrm E(X))(Y - \mathrm E(Y)))</ma...")
- 05:17, 8 July 2018 (diff | hist) . . (+45) . . N VC dimension (Redirected page to Vapnik–Chervonenkis dimension) (current)
- 05:17, 8 July 2018 (diff | hist) . . (+764) . . N Vapnik–Chervonenkis dimension (Created page with " just storing tabs here for now: * https://en.wikipedia.org/wiki/VC_dimension * https://www.quora.com/Explain-VC-dimension-and-shattering-in-lucid-Way * https://www.google.co...")
- 21:53, 2 June 2018 (diff | hist) . . (+344) . . N Collider (Created page with "In causal graphs, a '''collider''' is a node along a path where both directed edges of the node point to the node. ==Examples== * In the path <math>X \to Y \to Z \leftarrow...")
- 21:33, 2 June 2018 (diff | hist) . . (+758) . . N Methods of discovering causal effects (Created page with "'''Methods of discovering causal effects''': basically, after observing or interacting with the environment, how can we discover what causes what? When are we justified to cla...")
- 20:54, 2 June 2018 (diff | hist) . . (+716) . . N Reverse regression (Created page with "'''Reverse regression''' refers to a problem in statistical inference where a conclusion is reversed depending on the variable being adjusted. The example given by Pearl is t...")
- 20:27, 2 June 2018 (diff | hist) . . (+434) . . N Do operator (Created page with "The '''''do'' operator''' is used in causal inference to denote an intervention. Given random variables <math>X,Y</math>, we write <math>\Pr(Y=y \mid \mathit{do}(X=x))</math>...")
- 20:05, 2 June 2018 (diff | hist) . . (+934) . . N Hunting for Simpson's paradox (Created page with "Even given that one understands Simpson's paradox, it would be nice to have some way to recognize that a new situation involves the paradox. In other words, given our hamm...")
- 17:25, 2 June 2018 (diff | hist) . . (+928) . . N Back-door path (Created page with "A '''back-door path''' in a causal graph is an indirect path with an arrow into the treatment variable. Formally, given a graph with nodes including <math>X</math> (treat...")
- 17:00, 2 June 2018 (diff | hist) . . (+335) . . N Creation of causal graphs (Created page with "'''Creation of causal graphs'''; in other words, how are causal graphs created? Where do they come from? In all the examples I have seen, causal graphs are presented to the r...")
- 16:57, 2 June 2018 (diff | hist) . . (+576) . . N Causal inference (Created page with "'''Causal inference''' has to do with inferring causes of phenomena rather than just finding correlations. ==Is this even machine learning?== "It's probably obvious I think...") (current)
- 01:04, 24 March 2018 (diff | hist) . . (+625) . . N Backpropagation (Created page with "'''Backpropagation''' has several related meanings when talking about neural networks. Here we mean the process of finding the gradient of a cost function. ==Terminology...")
- 06:50, 1 January 2018 (diff | hist) . . (+340) . . N Probability (Created page with "Knowledge of probability is useful for machine learning, especially for machine learning theory/statistical learning theory. This wiki covers some aspects of probability (espe...") (current)
- 06:27, 1 January 2018 (diff | hist) . . (+133) . . N Summary table of probability terms (Created page with "'''Summary table of probability terms''' ==Table== ==See also== * Comparison of machine learning textbooks ==External links==")
- 04:18, 27 December 2017 (diff | hist) . . (+219) . . N Comparison of machine learning textbooks (Created page with "This page is a comparison of machine learning textbooks. {| class="sortable wikitable" ! Title !! Author !! Length !! Prerequisites !! Recommendations |} ==See also== ==Ref...")
- 01:06, 9 May 2016 (diff | hist) . . (+49) . . N User:IssaRice (Created page with "I am Issa Rice. [http://issarice.com My website].")
