Equivalence of random coinflips view and minimal programs view

From Machinelearning
Revision as of 00:12, 16 April 2019 by IssaRice (talk | contribs) (Created page with "Two of the several ways of viewing the deterministic variant of Solomonoff induction are: * The "random coinflips view": Given a monotone Turing machine, we feed the machine...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Two of the several ways of viewing the deterministic variant of Solomonoff induction are:

  • The "random coinflips view": Given a monotone Turing machine, we feed the machine with random data (such as from unbiased coinflips). The probability of string is then the probability that the machine outputs something starting with .
  • The "minimal programs view": Given a monotone Turing machine , the minimal programs producing are those programs such that (i.e. when run with produces an output starting with ) and such that no proper prefix of produces (i.e. if then ). This view then says that to get the probability of , we add up all the minimal programs weighted by length as follows: for each program we assign the weight , where is the length of . Thus the measure is , where the sum is taken over all minimal programs producing .

These two views turn out to be equivalent in the sense that .