Solomonoff induction is a principled formalization of Occam’s razor, inductive reasoning, the scientific method, prior-free Bayesian reasoning, and other deep parts of thinking and computing. I found it absolutely fascinating and quite readable. Geared toward an audience that has at least a vague idea of what Turing Machines and the halting problem are.

An Intuitive Explanation of Solomonoff Induction – LessWrong