RESOLVING THE LEDGER
This is one outlet's own report from TechRadar — the article as it was filed. Other outlets are covering the same event; open the full story to compare every source side by side.
See the full story · 1 sources
As AI systems continue to evolve and advance, it's not just data center architecture being affected, but the wider infrastructure industry as a whole.
As Agentic AI workloads continue to scale, it is the CPU layer being particularly affected, with efficiency, coordination, and cost per task become increasingly important defining factors.
We spoke to Mohamed Awad, EVP, Cloud AI at Arm, to find out more.
Gartner predicts that over 40% of agentic AI projects will be canceled by 2027 due to operationalization difficulties. How does Arm’s approach to "system-level" architecture specifically address the friction points, like cost and complexity, that are causing these cancellations?
I think the Gartner prediction reinforces something we’re hearing broadly across the industry. Most organizations aren’t struggling because today’s models aren’t capable enough. They’re struggling because operationalizing AI at scale is fundamentally different from demonstrating it in a pilot.
At the largest scale, we're seeing many of the same operational challenges play out in the physical world as well. Building AI infrastructure now means solving for power, supply chains, land, permitting, and deployment timelines just as much as advances in compute.
Moving from a handful of AI interactions to continuous, production-grade workflows requires a much more holistic view of the infrastructure stack – but it also requires organizations to rethink how AI interacts with their existing data and business processes. AI performs best where information is structured and workflows are well understood. As organizations extend AI into more complex enterprise environments, both the infrastructure and the operational environment have to evolve together.
That’s why we’ve focused on optimizing the system, from the CPU and platform through to the software ecosystem. As organizations move from pilots to production, success will increasingly depend on how efficiently their entire infrastructure works together – not just how capable any individual model or processor is.
We’ve seen companies like Uber exhaust their AI budgets in months due to unstructured prompting costs. How does moving intelligence from ad-hoc tools to a "central intelligence layer" anchored by Arm CPUs change the economic ROI for an enterprise?
I'd actually look at examples like Uber a little differently. Rather than signaling that AI is too expensive, they demonstrate how much value organizations are finding when AI is deployed successfully. The challenge is that demand is growing faster than the infrastructure needed to support it economically.
That's why we're seeing AI token economics improve at an extraordinary pace as models, silicon, software, and inference infrastructure become more efficient. At the same time, organizations are learning to redesign workflows rather than simply replacing existing processes with AI. Together, those trends are helping make AI more economical to deploy at scale.
Arm's role is helping drive that efficiency by optimizing AI infrastructure from the ground up. Improving performance, memory bandwidth utilization, and energy efficiency across the compute platform helps lower both capital and operating costs as organizations scale AI.
You’ve argued that AI’s true economic impact will come from turning AI into reliable operational capacity. How does Arm help businesses transition from "casual experimentation" to high-throughput, daily business operations?
The biggest shift happens when AI stops being a tool people occasionally use and becomes part of the operational fabric of the business. At that point, reliability, latency, security, and efficiency become just as important as model capability.
Our role is to provide the compute foundation that helps make that transition possible at scale. We’re part of the broader industry effort to optimize AI infrastructure across silicon, platforms, and software so organizations can deploy AI more efficiently and economically in everyday operations. Ultimately, the goal isn’t simply to automate work – it’s to make AI reliable enough to help people accomplish more as part of their everyday workflows.
While GPUs dominated the first wave of AI, the "agentic era" seems to be hitting a bottleneck at the coordination layer. Why is the CPU now the defining factor in whether an agentic workflow - which might check a CRM, update a database, and trigger a task - actually succeeds?
GPUs remain fundamental for training models and accelerating inference. What’s changing is everything that happens around those models.
Every time an agent retrieves enterprise data, coordinates multiple models, invokes external tools, or manages a business workflow, those activities depend heavily on the CPU. As organizations deploy more autonomous AI systems, those system-level workloads continue to grow, making the CPU an increasingly important part of delivering efficient AI infrastructure.
The question is no longer simply “How fast can I execute a model?” It’s “How efficiently can I execute an entire AI workflow?”
The new Arm AGI CPU claims more than 2x performance per rack compared with x86 platforms. What specific architectural choices were made in this "historic first" production silicon to handle the continuous, system-level workloads of agentic AI?
Agentic AI places fundamentally different demands on infrastructure than traditional cloud computing. Rather than optimizing for peak benchmark performance, we designed Arm AGI CPU around the realities of modern AI data centers – fixed power, cooling, rack density, and continuous system-level workloads. That means optimizing how data moves through the system – from compute and memory bandwidth to efficient bandwidth utilization – so the CPU can orchestrate the continuous data movement, coordination, and reasoning workloads that agentic AI creates.
The objective wasn’t simply to build a faster CPU. It was to help organizations deploy more useful AI withi...
AIPROPX is an independent multi-source news index — we track, compare, and connect coverage from across the web into one place you won't find anywhere else.