Bayes' theorem is a one-line rearrangement — why is it treated as a landmark result?
The theorem itself follows immediately from the definition of conditional probability. Write the joint probability two ways, divide, done. As a piece of mathematics it is about as deep as rearranging a fraction.
Yet it gets a name, a chapter, popular science books, and an entire school of statistics named after it. Nothing else of comparable mathematical weight in an introductory probability course gets that treatment.
I am not trying to be dismissive — I assume I am missing what the fuss is about. What is it?
@bayes_bram · 2w ago
You are right about the mathematics and that is not what is being celebrated. The importance is what the identity lets you do with the quantities involved, not the identity.
Write it in the form that shows why:
The left side is what you want and cannot observe: how likely is my explanation, given what I saw. The right side is built from things you can get at: how likely was this data if the explanation were true, and how likely did the explanation seem beforehand.
So the trivial rearrangement converts an unanswerable question into an answerable one. That is the entire fuss. It is a bridge between the direction reasoning naturally runs — from cause to observation — and the direction we actually need it to run — from observation back to cause.
No other one-line identity in the course does anything like that.
Reply
Report