Tantra’s Mantra Podcast – Episode 73

Episode 73:

Arm EVP on AGI CPU – Conception, Opportunity & Ecosystem Impact

Date: Aug 17, 2026
In the high-stakes AI infra market, GPUs were all the rage till Arm announced its AGI CPU and showed the world the importance of CPUs in the agentic AI world. Arm scored a masterstroke by targeting a high-value, unaddressed niche in the market without stepping on the toes of its large, long-time, loyal IP licensee ecosystem with its first chip.
In this episode, I talk to Mohamed Awad, EVP of Arm AI infrastructure BU, and the man behind AGI CPU, about the drivers, large and quickly growing opportunity, how the chip is designed for Agentic AI, the competitive landscape against X86 players, differentiation against hyperscalers with their own Arm CPUs, and most importantly, how it is allying the fear of its expansive licensee ecosystem worried about their licensor becoming a possible competitor. We also delve into the evolution of the AGI CPU, the interplay between Arm’s IP (cores), subsystems, and the AGI CPU roadmap, and whether this “product” strategy is limited to the AI CPU market or can extend to other markets as well.

Listen & Subscribe On

Index

00:00 – Intro
03:18 – 02:40 – Guest intro (Mohamed Awad, EVP, Cloud AI Business Unit at Arm)
04:02 – Internal and external drivers behind Arm’s decision to move from IP #licensing business to products – Meeting customers where they are
05:55 – Specific design choices made to build AGI CPU for Agentic AI – #Performance, #Efficiency, #Scalability
08:36 – Customization vs off-the-shelf – Democratizing off-the-shelf high-performance
13:05 – Focus of AGI CPU market: Hyperscalers w/o custom silicon (e.g. Meta Oracle ), #Neoclouds, moving from Arm in the #cloud to #onprem (e.g. @SAP), #X86 replacement (e.g. F5)
16:50 – AGI CPU fully built on Arm IP availability to licensees, no system or secret sauce. Licensees can develop AGI #CPU clones, if they like
21:00 – Can Hyperscalers using Arm IP for custom silicon learn from AGI CPU?
23:00 – Organizational challenges of changing from IP licensing business to product business (Fab and Memory supply constraints) – Same partners but from different relationship
26:03 – Contributing AGI CPU innovation back to #OCP (Open Compute Project) ecosystem
28:10 – Evolution of AGI CPU – Maximizing memory and I/O bandwidth per core to maximize CPU utilization; Equal access to Arm IP innovations for AGI CPU team and licensee
30:32 – Is making own silicon limited to the #AI infra market, or will it extend to others? – Meeting customers wherever they want (i.e., if market opportunity presents itself)
31:20 – Benefits of AGi CPU to the Arm ecosystem: 1)Hyperscalers both with custom silicon (Amazon Web Services (AWS), Google, Microsoft, NVIDIA ) and without; 2) Players such as Broadcom, Marvell Technology who help them; 3) Arm IP licensees
34:45 – Interesting landscape of AI infra CPU – X86 duopoly (Intel and @AMD) vs. wide variety of Arm ecosystem
37:49 – Dynamics of roadmap between IP, Compute Subsystem, and AGI CPU
39:25 – What does the success of Arm’s new pivot to making products look in the short and long term
41:18 – Closing
 If you want to read more articles like this and get an up-to-date analysis of the latest mobile and tech industry news, sign-up for our monthly newsletter at TantraAnalyst.com/Newsletter, or Read our Tantra Analyst Insights Articles.

Join over 40,000 professionals who get the latest news
and analysis from us. Please sign up for our newsletter!

You have successfully subscribed to the newsletter

There was an error while trying to send your request. Please try again.

Tantra Analyst will use the information you provide on this form to be in touch with you and to provide updates and marketing.