Why More Data Will Never Be Enough

There is a common sentiment in both contemporary business and modern culture that if we could just gather enough data—if we simply do more science, more STEM—everything will turn out fine. The assumption is that data will hand us the answers, resolve all our dilemmas, and ultimately reveal the meaning of the universe.

This assumption is unquestionably false. It fails for a very specific reason that might sound confusing at first, but is essential to grasp: it is false because there are always higher patterns.

The Limit of Bottom-Up Knowledge

In business, this belief typically sounds like: “All we need for this company is more data—more tracking of our users, our website traffic, or our product metrics. Once we acquire that data, the right business decisions will become obvious.” We see the exact same instinct in politics: if we only had exhaustive data regarding the population and the infrastructure, policy choices would solve themselves.

This perspective is, at best, half true. Bottom-up knowledge is certainly necessary, but you also need top-down knowledge.

Consider a single pixel on a computer screen. Even if you knew every conceivable metric about that individual pixel—its precise dimensions, coordinates in space, hex color value, and mathematical properties—you would still lack vital information about what that pixel actually is until you see the higher-order image of which it is a part.

Or take a single musical note. You could measure its exact acoustic frequency, amplitude, and timbre down to the decimal point, yet remain entirely ignorant of the melody, harmony, and emotional resolution of the symphony in which it participates.

The same holds true in chemistry with a hydrogen atom. You can know everything about its atomic and subatomic properties, but the moment two hydrogen atoms bond with an oxygen atom, entirely new emergent properties appear that cannot be deduced from hydrogen in isolation.

This is why nobody can cleanly predict the stock market. You might trade options and identify dozens of recurring statistical patterns, but your models remain inherently incomplete because higher-order patterns are constantly intervening. Those higher patterns might be macroeconomic shifts, geopolitical developments, or broad consumer sentiment. Reality does not sit on a single flat plane; it stacks in layers, with higher and more comprehensive patterns emerging as you ascend.

The Failure of Pure Reductionism

This layered hierarchy is the fundamental structure of the world. It explains why our disciplines are organized the way they are: physics sits at one level, above it chemistry, above that biology, and so on upward into psychology, sociology, and ethics. There are distinct rules, patterns, and worlds at every single tier, and you cannot comprehend a higher tier solely by accumulating data from the tier below it.

If you are a philosophical reductionist, reducing everything down to its lowest components is the ultimate dream. But our everyday experience consistently demonstrates that reductionism fails. Furthermore, we have no idea how high these levels go; there could always be a pattern one order higher than our current instruments can detect. Strict reductionism runs completely counter to the massive weight of common sense.

To see this clearly, consider a simple physical action: why does my finger move from one position to another? A committed reductionist would argue that if we possessed exhaustive data about every physical property in the system—the nerve impulses, the muscle fibers, perhaps every atom in the room—we could fully account for why the finger moved. But we all know the actual explanation: I formed a conscious intention in my mind, and I enacted it. An intention in my mind directed my finger to move. The higher-order reality of mind governed the physical behavior of those subatomic and chemical particles. There is an inescapable, higher-order explanation for the movement of the physical matter.

This has been a bedrock conviction in Christian theology from the beginning: God created a hierarchical cosmos featuring higher orders of human will, angelic will, and above all, the transcendent reality of the Divine will.

The View from the Ground and the Sky

Keeping this hierarchical reality in mind is immensely practical, both philosophically and pragmatically, because it trains you to evaluate every situation through two complementary lenses.

We can see this tension clearly in the abstract distinction between the political left and the political right—setting aside the confusing and often distorted political categories of modern American politics. In the abstract, the left tends to emphasize bottom-up causation. It focuses on the lived reality of individuals and local groups on the ground, seeking to construct social order upward from there. The right, by contrast, tends to adopt a top-down view—looking down as if examining an established map—and seeks to structure political life according to overarching patterns, inherited traditions, and high-level principles.

Ultimately, both perspectives are indispensable because both capture real features of reality. We eat physical food, yet we also read poetry; we take biochemical vitamins, yet we engage in self-reflection. There are patterns an airplane pilot can see from thirty thousand feet that a farmer on the ground cannot possibly perceive, and there are realities the farmer knows that the pilot will completely miss.

More data will never save you on its own. It provides, at best, only half the picture.

Watch the original episode.