Exercise 2: Why a Controlled Study Beats a Single Smart Example — Possible Solution ====================================================================================== Pointing to one smart person who thinks clearly is genuinely weak evidence that critical thinking is trainable, because it can't rule out the alternative explanation: maybe that person was simply born with an unusually capable mind, and their clear thinking has nothing to do with any learnable technique at all. A single example, however impressive, doesn't distinguish between "this is a trait some people happen to have" and "this is a skill anyone could develop." The Good Judgment Project's real design directly rules out that alternative explanation. It didn't study one gifted individual - it recruited ordinary volunteers, gave many of them structured training in specific techniques, and then measured their real performance against a comparison group (professional intelligence analysts) across hundreds of real questions and over a million actual forecasts. The volunteers who used the trained techniques - not just people who happened to be naturally clever - consistently outperformed professionals with far more relevant credentials and access to classified information. That controlled comparison is what makes the result strong evidence for trainability, rather than a story about one unusually gifted person. ANSWER: A single smart person can't rule out the possibility that their clear thinking is simply an innate trait rather than a learned skill. The Good Judgment Project's real strength is that it tested trained ordinary volunteers against professional experts using a large, structured comparison (500 questions, over a million forecasts) - and the volunteers who used specific techniques won, which is much stronger evidence that the underlying skill can genuinely be learned, not just that it can occasionally occur naturally in a gifted individual. WHY THIS WORKS AS AN ANSWER ------------------------------ This explains the real methodological reason a controlled comparison is stronger evidence than a single example, directly engaging with what makes the Good Judgment Project's own design convincing.