Calibration Test: Are You Overconfident?
Being right is half of good judgment. The other half is knowing how sure to be. The Bayesian Betting Hall is a calibration test: you bet on whether claims are true and set your confidence, and confident mistakes cost the most.
Bayesian thinking in 2 sentences: It is the mathematical framework for learning from experience. Instead of seeing the world in black and white, Bayesians see degrees of belief that shift with every new piece of data.
In the Bayesian Betting Hall, you step into a simulated trading floor where "common knowledge" is the currency. Your task is to long the truths and short the falsehoods, but here’s the catch: you must also set your confidence level. This game trains you to quantify your uncertainty and adjust your worldview when the evidence changes.
BAYES_TERMINAL_V2
> WELCOME TRADER.
> MARKET VOLATILITY DETECTED IN "COMMON_KNOWLEDGE" SECTOR.
> YOUR OBJECTIVE: SHORT FALSEHOODS. LONG TRUTHS.
> WARNING: HIGH LEVERAGE (HIGH CONFIDENCE) ON INCORRECT POSITIONS WILL RESULT IN LIQUIDATION.
Why Updating Beliefs Matters in Decision-Making
The most successful decision-makers still get things wrong. They are just quicker than everyone else to notice.
By practicing Bayesian updating, you learn to treat your opinions as "working hypotheses" instead of fixed identities. That flexibility pays off in fast-changing fields like finance, technology, and science.
Alpha Training
The Bayesian Betting Hall helps you build the "rationality muscle" you need to get through a world full of noise and misinformation.
Frequently Asked Questions
What is a calibration test?
A calibration test checks whether your confidence matches your accuracy. If you are 90% sure of ten answers, about nine should be right. Most people are overconfident: their 90% answers are right far less often. Here you set a confidence level on each bet, and confident mistakes cost the most, so poor calibration shows up directly in your balance.
Is this a Dunning-Kruger test?
It tests the thing the Dunning-Kruger effect is about: the gap between how good you think your judgment is and how good it actually is. It does not diagnose anything. If you finish with less money than you started with while betting at high confidence, that gap is showing.
What is Bayesian thinking?
Bayesian thinking is a method of reasoning where you start with a prior belief, then update it as new evidence arrives. Named after statistician Thomas Bayes, it treats probability as a degree of belief rather than a fixed frequency, which makes for more rational decisions under uncertainty.
How does the Bayesian Betting Hall work?
You are presented with real-world claims and asked to bet on whether they are true or false, along with your confidence level. After each round you see the correct answer and how well-calibrated your confidence was. Over time, this builds the instinct to quantify uncertainty rather than think in absolutes.
Why do smart people struggle to change their minds?
A phenomenon called Belief Perseverance causes people to cling to existing beliefs even when contradictory evidence surfaces. Bayesian practice directly counters this by framing every belief as a "working hypothesis" with an assigned probability, so an update feels like ordinary reasoning instead of an admission of failure.