Companies struggling with AI might need to narrow their focus, said Boston Consulting Group's Sylvain Duranton.

• Some CEOs are asking when they'll make money from AI, BCG's Sylvain Duranton told Business Insider.
• He said the biggest factor in succeeding with AI isn't the tech, but changing how people work.
• Duranton said it can be tough to see gains from AI because the tech can be difficult to scale.

Like a first date that's gotten awkward, some companies struggling to win at artificial intelligence might be trying too hard.

They might take on too many projects or fail to understand that AI windfalls often come from rewiring how people work, not from "super-cool" AI engines or large-language models, said Sylvain Duranton, global leader of BCG X, the tech build and design division of Boston Consulting Group.

Those types of missteps can balloon into big-time frustrations for business leaders, he told Business Insider.

Duranton said that if CEOs' big question around AI in 2024 was which model to use, their ask in 2025 is "Where's my money?"

Indeed, he said, there are often challenges around implementing broad use of AI.

"Scaling this thing from a tech standpoint — it is hard," Duranton said.

To help companies salvage their AI efforts, he said, his "golden rule" is that organizations allocate about 10% of their effort and money to the algorithms — to build AI engines or train LLMs. Another 20% should be reserved for data and technology. Essentially, that's to make the AI work in a company's tech environment, Duranton said.

The bulk of the effort — the remaining 70% — should go to changing the way people work, he said.

"Assuming you have a technology that can scale, you need to bring that into the hands of the people. It's a massive change effort," said Duranton, who's based in the company's Paris office and oversees BCG X's global army of nearly 3,000 technologists, scientists, programmers, engineers, and others.

Some companies are struggling

Companies' frustration is real. In the final months of 2024, BCG surveyed some 1,800 C-suite execs from big companies in nearly 20 countries and found that while 75% of respondents ranked AI among their top-three priorities, only 25% reported seeing "significant value" from the technology.

To find more value, Duranton recommends that companies not try to do everything all at once. He said the scope of change that companies need likely can't be achieved with tens or hundreds of use cases.

"That's not the plan. The plan is to focus on a very few things, and the things that matter," he said.

Duranton said companies sometimes also look to "incremental initiatives." He said he thinks that's often a mistake. Instead, he said, companies should home in on a few "quintessential" things.

For a retailer, Duranton said, this might be using AI to ensure a brick-and-mortar store has the perfect product mix for that location to better withstand competitors nearby and online.