All notes
It wasn't the model. It was your data.

June 15, 2026

It wasn't the model. It was your data.

Most AI projects fail — MIT found 95% of generative-AI pilots delivered no measurable profit, and RAND put the overall failure rate around 80%. When it goes wrong, the instinct is to blame the model: not smart enough, wrong choice, bad prompts. The data says otherwise. The single most-cited cause of failure is poor data quality, and only about 12% of organizations have data clean enough to support AI at all. You probably don't have a model problem. You have a data problem wearing a model problem's clothes. Here's how to tell.

The failure numbers for enterprise AI are brutal and worth saying out loud. MIT's research found 95% of generative-AI pilots delivered no measurable impact on profit, and RAND put the overall AI project failure rate around 80%. Most AI projects don't quietly underperform. They fail.

When that happens, almost everyone reaches for the same explanation: the model. We picked the wrong one, it wasn't smart enough, the prompts were off, we should try the new release. That instinct is comforting because it's fixable with a swap. It's also usually wrong. The most-cited reason AI projects fail isn't the model at all — it's poor data quality, named in around 85% of failed projects, and only about 12% of organizations have data clean enough to support AI in the first place. Let me make the case, because this is the difference between a fix that works and a year wasted swapping models.

The model is the visible part, so it takes the blame

When an AI feature gives bad answers, the model is what you see misbehaving, so it's what you blame. But the model is the last link in a chain, and it can only be as good as what flows into it. Feed a brilliant model scattered, contradictory, out-of-date, half-accessible data and it produces confident nonsense — not because it's a bad model, but because it's faithfully reflecting a bad input.

This is why model-swapping so often changes nothing. You move from one frontier model to a newer one, the demo still disappoints, and you conclude AI "isn't ready." What actually happened is you upgraded the one part that wasn't broken. The data was the bottleneck before the swap and it's the bottleneck after, because the new model is now reading the same mess the old one did.

Data is boring, so it's the work nobody wants to do

There's a reason this keeps happening: fixing data is tedious and invisible, and choosing a model is exciting and quick. Picking the model feels like progress — there's a leaderboard, a release, a demo. Cleaning up where your data lives, what it means, whether it's current, and whether the system can even reach it is grunt work with no highlight reel. So teams do the fun part and skip the part that actually decides the outcome.

And the numbers show the cost of skipping it. Gartner expects a large share of AI projects to be abandoned through 2026 specifically because the data wasn't ready. Not because the models were too weak — they've never been stronger — but because the unglamorous foundation underneath them was never built. The frontier raced ahead; the data plumbing stayed where it always was.

What to do before you blame the model

Next time an AI project underdelivers, run the data checklist before you touch the model:

  • Is the data accurate and current? If the source is wrong or stale, a smarter model just gives you wrong answers faster and more convincingly.
  • Can the system actually reach it? Data trapped in PDFs, silos, and systems the AI can't query might as well not exist. Access is half the battle.
  • Does it mean what you think it means? Inconsistent definitions, duplicates, and missing context break AI quietly — the output looks plausible and is subtly wrong.
  • Only then, look at the model. Nine times out of ten you'll have found your problem before you get here.

Fixing data is slow and unglamorous. It's also where the result actually lives.

The bottom line

The frontier models are extraordinary, which is exactly why they're so rarely the reason your AI project failed. The weak link is almost always the boring layer underneath.

Before you blame the model, check the data — because the most common cause of AI failure is the input, not the intelligence. Swapping models is the fix that feels productive and usually isn't. Cleaning your data is the fix nobody wants and the one that works.

Comments

No comments yet

Sign in to join the conversation.

Be the first to share a thought.