We have all heard the stories: a grandfather who still uses a mechanical watch from the 1950s, a tech billionaire who dropped out of college, or a vintage car that runs better than a modern hybrid. These anecdotes often lead us to a common conclusion: "They just don't make them like they used to," or "Higher education is unnecessary for success." However, these conclusions are often the result of a dangerous mental shortcut known as survivorship bias. This logical fallacy occurs when we focus on the people or things that made it past a selection process and overlook those that did not, leading to a distorted view of reality.
Understanding the Basics of Survivorship Bias
Survivorship bias is a form of selection bias where we emphasize "survivors" while unintentionally ignoring the "failures." Because the failures are often invisible—they are the broken watches thrown away decades ago or the startups that went bankrupt in their first year—we base our strategies and beliefs on an incomplete data set. This can lead to overly optimistic beliefs and flawed decision-making in business, finance, and everyday life.
The Legend of the 70-Year-Old Watch
Consider the classic exclamation: "My grandfather has an old mechanical watch over 70 years old, and it still works perfectly! Materials were so much better back then." While it is true that the watch is still ticking, this is a prime example of survivorship bias in action.
The Missing Data Set
When we look at that 70-year-old watch, we are looking at the 0.1% of products that were exceptionally well-maintained, lucky, or over-engineered. We do not see the millions of other watches from the same era that rusted, broke, or were discarded because they were unreliable. By only looking at the surviving watch, we falsely conclude that all mid-century manufacturing was superior, ignoring the fact that modern manufacturing actually produces far fewer defects per thousand units.
The Riddle of the Fighter Planes
The most famous illustration of survivorship bias comes from a high-stakes military problem during World War II. The Allied forces were losing an alarming number of aircraft to enemy fire. To rectify this, the military examined the planes that returned from missions to determine where they should add extra armor plating.
Upon inspecting the returning bombers, the military saw a clear pattern: the fuselage and the wings were riddled with bullet holes. Naturally, the generals proposed reinforcing those specific areas. It seemed like a logical, data-driven decision. However, they were about to make a fatal mistake by only looking at the planes that survived.
Abraham Wald: A Radically New Approach
Enter Abraham Wald, a brilliant mathematician and a member of the Statistical Research Group (SRG). Wald looked at the same data as the generals but reached the exact opposite conclusion. He proposed a radically new approach that saved countless lives.
Seeing the Invisible Bullet Holes
Wald pointed out that the military was only looking at the planes that managed to fly back to the base. If a plane was hit in the fuselage or the wings, it was clearly capable of staying in the air and returning home. The bullet holes in the survivors showed the areas where a plane could take damage and still function.
The areas that were pristine on the surviving planes—the engines and the cockpit—were the real problem areas. Wald reasoned that planes hit in those spots didn't have bullet holes to show because they had crashed. Those were the "non-survivors." He recommended reinforcing the areas where the returning planes had no damage, correctly identifying that those were the fatal weak points.
How Survivorship Bias Distorts Modern Success
Today, survivorship bias is rampant in the "hustle culture" and professional world. We are constantly bombarded with stories of elite success while the graveyard of failure remains silent.
Entrepreneurship: We study the habits of Steve Jobs or Bill Gates, forgetting that thousands of others followed the exact same path, worked just as hard, and still failed due to timing, market shifts, or bad luck.
Financial Markets: Mutual funds often tout their 10-year track records. However, funds that perform poorly are often merged or closed, meaning the "average" performance shown only includes the winners that lasted the full decade.
Health and Lifestyle: You might hear about a 100-year-old person who smoked every day. Focusing on that one survivor ignores the millions for whom smoking was a fatal habit.
How to Combat Survivorship Bias
Recognizing this bias is the first step toward better critical thinking. Here are a few ways to ensure you are seeing the full picture:
1. Seek Out the Failures
When researching a new venture, don't just read books by CEOs. Look for post-mortems of failed companies. Understanding why others failed is often more instructive than hearing how one person got lucky.
2. Question the Data Source
Ask yourself: "What am I not seeing?" If you are looking at a success story, ask why the unsuccessful equivalent isn't present in your data set.
3. Distinguish Between Skill and Luck
Survivor bias often masks the role of luck. Just because a specific strategy worked for one person doesn't mean it is a repeatable system. Always look for a large enough sample size to prove consistency.
Conclusion
Survivorship bias is a subtle but powerful reminder that absence of evidence is not evidence of absence. Whether it’s appreciating your grandfather's vintage watch or making high-stakes business investments, we must remember Abraham Wald’s lesson: the most important data is often found in the holes left by those who didn't make it back. By looking beyond the survivors, we gain a clearer, more accurate understanding of the world around us.
