The GenAI Divide: Why Most Companies Are Still Failing to Find the ROI

The GenAI Divide: Why Most Companies Are Still Failing to Find the ROI

It’s kind of wild when you think about it. Since early 2023, we’ve been told that Generative AI is the modern steam engine—a tool so powerful it would rewrite every P&L statement on the planet. But as we settle into 2025, the honeymoon phase hasn't just ended; it’s hit a massive, expensive brick wall.

The "GenAI Divide" is the term researchers at MIT and NANDA are using to describe this mess. On one side, you have a tiny elite of companies actually making money. On the other? A massive 95% of organizations that have dumped billions into AI pilots only to see basically zero measurable return.

Honestly, it's a disaster.

But it’s also a blueprint. If you look at the 5% who are actually winning, they aren’t doing the same things as everyone else. They aren't just "playing" with ChatGPT. They're doing something much more radical.

The Reality of the 95% Failure Rate

We’ve all heard the hype, but the numbers from the July 2025 MIT report are sobering. Enterprises have spent somewhere between $30 billion and $40 billion on GenAI, yet the vast majority of these projects never make it out of the "science project" phase.

Why?

📖 Related: Private Credit News Today: Why the Golden Age is Getting a Reality Check

Because most companies are dropping a 2025 brain into a 1995 body. They take a shiny new Large Language Model (LLM) and bolt it onto a broken, siloed workflow. It’s like putting a Ferrari engine in a horse-drawn carriage. Sure, you might go a bit faster, but the wheels are going to fall off.

MIT calls this the learning gap. Most enterprise AI tools today are "static." They don't remember what you told them yesterday. They don't adapt to your specific company culture or data. If a tool doesn't get smarter every time an employee uses it, it eventually just becomes another chore. People stop using it, and the pilot dies a quiet death.

The Success Formula of the "5 Percenters"

So, what are companies like Mercedes-Benz, Mastercard, and Klarna doing differently? They aren't just using AI; they are re-architecting.

  • They buy more than they build. A huge takeaway from 2025 is that building your own LLM from scratch is a trap for most businesses. Success rates for externally sourced AI solutions are double those of internal "homegrown" projects.
  • They focus on the boring stuff. Everyone wants a "creative" AI, but the money is in the back office. We’re talking about supply chain simulations, automated contract auditing, and real-time fraud detection.
  • They’ve embraced "Agentic AI." This is the big shift for 2025. While the "laggards" are still typing prompts into a box, the leaders are deploying agents—AI that can actually do things, like book travel, update CRM records, or manage inventory without a human holding its hand.

Take a look at companies like Moglix. They used AI for vendor discovery and saw their sourcing efficiency jump from 12 crore to 50 crore per quarter. That's not just a "productivity hack." That's a fundamental shift in how they make money.

The Rise of the Shadow AI Economy

While CEOs are worrying about ROI, employees are just... doing it.

👉 See also: Syrian Dinar to Dollar: Why Everyone Gets the Name (and the Rate) Wrong

There is a massive Shadow AI Economy happening right now. Estimates suggest that while only 40% of companies have official enterprise AI subscriptions, over 90% of workers are using personal AI tools to get their jobs done.

Employees are crossing the GenAI divide on their own because the official corporate tools are often too restrictive or, frankly, just not as good as the latest consumer models. This is creating a weird tension. You have managers saying "we haven't seen the value yet," while their staff is secretly saving 10 hours a week using a personal Claude or ChatGPT account.

Why 2025 is the Year of Small Language Models (SLMs)

Last year was all about "bigger is better." In 2025, the trend has flipped.

Massive models are expensive and slow. The winners are moving toward Small Language Models. These are tiny, specialized models trained on specific company data. They’re cheaper to run, they’re faster, and because they live on-site or in private clouds, they don't have the same privacy nightmares as the big public bots.

If you’re a bank, you don’t need an AI that knows how to write poetry. You need one that knows every line of your 400-page compliance handbook. That's where the 5% are winning.

✨ Don't miss: New Zealand currency to AUD: Why the exchange rate is shifting in 2026

Crossing the Divide: Your 2025 Action Plan

If your company is stuck in the 95% group, you don't need a bigger budget. You need a better strategy.

First, stop doing "cool" pilots. If a project doesn't have a direct line to your P&L, kill it. Focus on Integration Hell—the hard work of connecting AI to your actual data.

Second, look at your "learning loops." If your AI isn't retaining feedback from your experts, it’s useless. You need systems that capture organizational knowledge.

Third, empower your "Shadow AI" users. Instead of banning personal tools, find out what your best employees are doing with them. They've already found the ROI; you just need to scale it.

The 12-to-18-month window to get this right is closing fast. By 2026, the companies that successfully crossed the GenAI divide won't just be ahead—they’ll be operating in a completely different league.


Next Steps for Leaders:

  • Audit your current AI pilots and aggressively cut any that don't have a defined ROI metric within 6 months.
  • Transition your focus from "chatbots" to "agents" that can execute multi-step workflows.
  • Invest in data governance now; your AI is only as good as the siloed data it can (or can't) access.