The principle of parsimony, also known as ‘Occam's razor’, is a heuristic dictum that is thoroughly familiar to virtually all practitioners of science: Aristotle, Newton, and many others have enunciated it in some form or other. Even though the principle is not difficult to comprehend as a general heuristic guideline, it has proved surprisingly resistant to being put on a rigorous footing – a difficulty that has become more pressing and topical with the ‘big data’ explosion. We review the significance of Occam's razor in the philosophical and theological writings of William of Ockham, and survey modern developments of parsimony in data science.
BaakeM. (1997) Solution of coincidence problem in dimensions d ≤4. In: MoodyR.V. (ed.), The mathematics of long-range aperiodic order, pp. 9–44. Kluwer, Dordrecht.
2.
FeyerabendP.K. (1975) Against method: outline of an anarchist theory of knowledge.New Left Books, New York.
3.
BarnesJ. (1984) The complete works of Aristotle, revised Oxford translation, vol. 2. Princeton University Press, Princeton.
4.
CrombieA.C. (1953) Robert Grosseteste and the origins of experimental science 1100–1700.Oxford University Press, Oxford.
5.
CoplestonF.C. (1972) A history of medieval philosophy.University of Notre Dame Press, Notre Dame.
6.
RussellB. (1945) A history of Western philosophy.George Allen & Unwin, London.
