Arm Drives Next-Generation Performance for IoT with World’s First Armv9 Edge AI Platform – Arm Newsroom

The AI revolution is no longer confined to the cloud. As our world becomes increasingly connected and intelligent, from smart cities to industrial automation, the need to process AI workloads at the edge is not just advantageous, but essential. Today marks a significant milestone in this evolution with the introduction of the Armv9 edge AI platform, featuring the new Arm Cortex-A320 CPU and the leading AI accelerator for edge AI, Arm Ethos-U85 NPU, enabling AI models of over one billion parameters to run on-device.
OEMs are under pressure to deliver solutions faster than ever before. They need to meet the growing computing demands across IoT applications, such as autonomous vehicles navigating factory floors, smart cameras that can adapt their functionality through software updates, and human-machine interfaces that offer more natural, AI-driven interactions.
To innovate and scale at pace, they need the flexibility to execute their AI workloads where it makes sense, more robust security and increased software flexibility – and Armv9 technology delivers this at scale. Arm’s new platform brings together a brand-new ultra-efficient Armv9 CPU, Cortex-A320, along with the Ethos-U85 NPU with operator support for transformer networks, creating the world’s first Armv9 edge AI platform optimized for IoT. The platform delivers an 8x improvement in machine learning (ML) performance compared to the Cortex-M85-based platform we launched last year.
The ubiquity of our technology means that our partners can now deploy the power of Armv9 technology across the spectrum of computing, from cloud to edge. From silicon partners licensing this technology to build SoCs, to ODMs and OEMs building their next generation devices, this development has been welcomed by leading partners across the industry including AWS, Siemens, Renesas, Advantech and Eurotech.
The launch of this new edge AI platform marks a significant milestone in the evolution of edge computing. The Cortex-A320 brings advanced AI capabilities and developer benefits to IoT, extending the features of the Armv9 architecture to power efficient devices, alongside comprehensive software support.
Cortex-A320 takes advantage of Armv9 architectural features, such as SVE2 for ML performance, and delivers a 10x ML performance uplift and 30 percent scalar performance uplift compared to its predecessor, Cortex-A35.  
The platform’s Armv9.2 architecture also brings advanced security features like Pointer Authentication (PAC), Branch Target Identification (BTI) and Memory Tagging Extension (MTE) to even the smallest Cortex-A devices. This is crucial as edge devices often operate in exposed environments and handle sensitive data.
As edge AI continues to consolidate on Arm, with this new addition to the portfolio, we now offer the most advanced family of Armv9 Cortex processors for IoT, ranging from ultimate performance, to cost and energy-constrained devices.

Read more about the Cortex-A320 in this blog.
One of the most significant barriers to edge AI adoption has been the complexity of software development and deployment. This is where the platform’s software ecosystem comes into its own. We are extending Arm Kleidi to IoT – a set of compute libraries for developers of AI frameworks designed to optimize AI and ML workloads on Arm-based CPUs with no additional developer work needed. KleidiAI is already integrated into popular IoT AI frameworks, such as Llama.cpp and ExecuTorch or LiteRT via XNNPACK, accelerating the performance of key models, including Meta Llama 3 and Phi-3. As an example, KleidiAI brings up to 70% more performance to the new Cortex-A320 when running Microsoft’s Tiny Stories dataset on Llama.cpp.
This matters because in today’s fast-paced technology landscape, time-to-market can make or break the success of a product. The new platform also maintains software compatibility with higher-performance Cortex-A processors. This scalability ensures that developers can build solutions that grow and adapt as requirements change. With access to the vast Armv9 ecosystem and compatibility with both rich operating systems such as Linux, and real-time operating systems such as Zephyr, developers have unprecedented flexibility, can leverage existing tools and knowledge, and take advantage of software reuse, reducing time to market and lowering total cost of ownership. With over 20 million active Arm developers worldwide, the potential for innovation is immense.
As we look ahead, it’s clear that the future of AI will shift towards the edge and this new Arm platform will be a catalyst for the next wave of IoT innovation. The combination of Armv9 architecture features, advanced AI capabilities and comprehensive software support creates new possibilities for OEMs and developers alike.
The platform’s ability to run tuned large language models (LLMs) and small language models (SLMs) for agent-based AI applications opens up entirely new categories of edge use cases. We’re moving toward a future where intelligent decision-making happens closer to the point of data collection, reducing latency and improving privacy.
This isn’t just another incremental step forward – it represents a fundamental shift in how we approach edge computing and AI processing. For the first time, we’re seeing an Armv9 CPU specifically optimized for IoT applications, bringing together ultra-efficiency and advanced AI capabilities in a way that hasn’t been possible until now.
“The evolution of edge AI is accelerating, and advancements in Arm’s IoT computing architecture will bring new possibilities for intelligence at the edge. As a leading player in Edge Computing and Edge AI, Advantech sees this innovation as a significant step forward for the broader Arm ecosystem, enabling smarter, more efficient, and secure AI-driven applications across industries. This innovation will drive industry growth and technological breakthroughs in the edge computing market.” Miller Chang, President of Embedded Sector at Advantech
“The new Arm edge AI platform will enable our customers to run nucleus lite, a lightweight device runtime of AWS IoT Greengrass for constrained edge devices with minimal memory needs, on Armv9 technology. This seamless integration between the two technologies provides an optimized solution for developers to build modern edge AI applications like anomaly detection in precision agriculture, smart manufacturing, and autonomous vehicles.” Yasser Alsaied, Vice President of loT, AWS
“As the IoT market continues to scale, Eurotech continues to deliver solutions giving the performance, security and efficiency customers need for the latest edge AI applications. Arm’s new edge AI platform, provides us with the foundation to build the next generation of rich IoT devices, with Armv9 giving us access to new levels of secure performance, energy-efficiency and software flexibility.” Marco Carrer, CTO, Eurotech
“Renesas aims to serve the widest AIoT market segments with diverse use cases and increasingly intelligent workloads on a truly scalable compute platform. We are excited about the latest Armv9 Cortex-A320 CPU, which delivers high AI/ML performance and enhanced security with power and area efficiency. It will allow us to innovate at pace and implement efficiency with scalability.” Daryl Khoo, VP of Embedded Processing Product Group, Renesas
“Siemens is committed to unlocking the power of AI in edge applications. The new Armv9 based edge AI platform will help to extend our portfolio of highly secure, performant and energy efficient AI innovation to all of our customers, across a range of industrial, smart infrastructure and mobility applications.” Herbert Taucher, VP Research and Predevelopment for IC and Electronics, Siemens AG

Any re-use permitted for informational and non-commercial or personal use only.
🆕 Introducing the Armv9 edge AI platform.

Built on Arm Cortex-A320 CPU and Ethos-U85 NPU, it brings Armv9 performance, efficiency & security benefits to IoT, enabling on-device AI models of over 1B parameters to drive the next wave of edge AI innovation: https://newsroom.arm.com/news/armv9-edge-ai-platform?utm_source=twitter&utm_medium=social-organic&utm_content=newsroom&utm_campaign=mk02_iot_na
A new generation of AI-native companies is emerging, bringing innovations that could completely disrupt industries as we know them.

Speaking with @theCUBE, Arm CMO Ami Badani shares how Arm’s compute platform is driving this + her advice on staying ahead: 
Ami Badani, Arm | theCUBE + NYSE Wired: CMO Leaders Summit
Arm Badani at Arm talks with John Furrier at theCUBE + NYSE Wired: CMO Leaders Summit.
okt.to
We’ve worked with OpenCV on the first ever KleidiCV integration! 🎉 
 
With 4x performance uplifts on OpenCV 4.11, in Android KleidiCV is enabling faster responses across key computer vision tasks on mobile with no extra developer effort. 
 
Get the details:…
📢 Discover a new way to enhance your code with the Arm extension for @GitHub Copilot.

Available now on GitHub Marketplace, it makes migration to Arm simple with tailored architecture-specific answers and performance optimization tips: https://okt.to/CWdnEy
🤝 Together with @Synopsys we’re accelerating time-to-market for Arm CSS-based designs.
 
Earlier this week, Kevork Kechichian joined the team to celebrate the new ZeBu-200 and HAPS-200 hardware platforms that speed up time-to-market for AI innovations: https://okt.to/5WmCVL
We’re heading to #SXSW 2025! 🚀 

Join Arm CEO Rene Haas on Wednesday, March 12, as he shares insights on the AI era and the unprecedented opportunities being unlocked on the Arm compute platform.

Add it to your agenda: https://okt.to/609gAn
🥳 Congratulations to our new group of Distinguished Arm Ambassadors who lead and inspire developers every day.

Want to be a part of the community?

🔗 Applications for the Arm Ambassador Program are now open, join us!
Here’s to our new Distinguished Arm Ambassadors. 👏

Their continued support and exceptional contributions to the Arm Developer Program help inspire the software community to learn and innovate on the Arm compute platform. 

Thank you for everything you do!
Think chips are just in your gadgets? Think again. 🧠

@crmiller1 joins Rene Haas on Tech Unheard to reveal how semiconductors are powering our world – from tech innovation to globalization.

🎧 Search Tech Unheard or listen here: https://okt.to/o93Jtf
It’s been another record-breaking quarter in Q3 FYE25!

With revenue at an all-time high, we’re continuing to see strong momentum across the Arm ecosystem, with ongoing adoption of high-performance, power-efficient Armv9 and CSS platforms driven by AI:
Low power is more critical than ever in automotive.⚡

Catch Dipti Vachani’s interview with @TheSixFiveMedia’s @OABlanchard as they discuss what’s next for automotive innovation, and how low power is not just in Arm’s solutions but a core part of our culture and foundation.
Dipti Vachani, @Arm’s Automotive GM, joins analyst @OABlanchard to reveal how Arm is fueling the future of AI in cars. 🚗🌬️ Watch the full interview for her insights on the next generation of smart vehicles at CES 2025! https://youtu.be/8P9Cb8e8kOw
#CES2025 #OnArm #AI #automotive…
Together with @OpenAI, @SoftBank_Group Corp, & SoftBank Corp, we’re bringing AI agents to work.
 
Through Cristal intelligence, we’re developing Advanced Enterprise AI built on the Arm compute platform, setting new standards in productivity & efficiency: https://okt.to/oEc6CV
📱 #ICYMI: The new #GalaxyS25 Series of AI smartphones are coming from @SamsungMobile!
 
Powered by the Arm compute platform, the new devices bring next-gen AI capabilities to Android as part of a shared vision with Google.
 
Congrats, Samsung! #GalaxyAI

Galaxy S25 AI Phone Range Features Explained | Samsung UK
Learn about all the incredible features on the new Samsung Galaxy S25 AI Phone range at Samsung UK.
okt.to
With the first public spec of the CSA now available, Eddie Ramirez shares how it came about and what it means for the industry.

Speaking at the Chiplet Summit last week, Eddie shares why the CSA will help designers connect chiplets into composable SoCs:.
Arm Defines a New Standard for Chiplet Interoperability
In this video, learn why Arm is investing in chiplets as a way to build dynamic options for compute in the A…
okt.to
📸 Here’s a glimpse of an incredible week with Arm at #wef25 in Davos! ➡️

Explore our blog post for key insights from our panel discussion with world-leading AI academics: https://okt.to/rsdH5V
We’re driving the future of automotive. 🚙

Watch Dipti Vanchani’s insightful talk with @TheSixFiveMedia’s @OABlanchard as they discuss industry trends and Arm’s role in automotive AI innovation.
🚗 @OABlanchard and @Arm’s Dipti Vachani discuss 3 big trends in automotive AI: electrification, autonomy, & redefining the user experience. 🚘 Catch the full interview to see what’s driving the future of smart cars. https://sixfivemedia.com/events/ces-2025/how-arm-is-powering-the-next-generation-of-ai-enabled-vehicles/ #CES2025 #OnArm #AI #automotive…
Rene Haas spoke to @SquawkStreet about The Stargate Project and Arm’s involvement as a key initial technology partner.

Discussing its huge potential, Rene shares what Arm-based technology to expect and what he’s most looking forward to about the project: 
Arm Holdings CEO Rene Haas on $500B Stargate project: It's a big, big deal
Arm Holdings CEO Rene Haas joins 'Squawk on the Street' to discuss the $500 billion Stargate AI project, investing…
www.cnbc.com
🏁 The race is on with Android gaming on the new Lenovo Duet, built on the Arm-based @MediaTek Kompanio 838.
 
With powerful octa-core processing, enhanced multimedia experiences and all-day battery life, the race is in your hands – all you need to do is win!
Chances are, you’re hearing a lot more about semiconductors now than you once did.

🎙️ For the latest Tech Unheard episode, Economic Historian @crmiller1 joins Rene Haas to explore how AI is driving this change, and what it means for the future.

Full ep: https://okt.to/yHqsjm
To unlock the full potential of AI, we need tight collaboration between industry & academia to equip the next-generation with the skills to thrive.

Arm CMO Ami Badani opened up this important conversation at #wef25 with academic experts in the field of AI https://okt.to/Wp5j4q
With new AI applications emerging daily, Arm CMO Ami Badani shares why Arm is the trusted platform to meet the insatiable demand for compute.

Catch the full interview at the link below 👇
We’re proud to have been recognized as a winner of Glassdoor’s Best Places to Work in 2025, ranking number 1 on the UK Large list! 🏆🥳

The award, based on employee feedback, underscores our commitment to our core beliefs and helping our people to do their best work.
We’re excited to be a key initial technology partner in Stargate, bringing the power and pervasiveness of Arm’s compute platform to this bold initiative which will unlock AI’s potential for all.

This is how we shape the future of AI. 
Announcing The Stargate Project | SoftBank Group Corp.
The Stargate Project is a new company which intends to invest $500 billion over the next four years building new…
okt.to
🆕 The first public spec of the Chiplet System Architecture is now available!

This marks a crucial step toward a shared understanding of how to define & connect chiplets into composable SoCs that address varying AI workloads & different industry needs: https://okt.to/lqgceB
Lasting AI innovations must deliver more compute with the same level of energy.

We’re committed to addressing this challenge head-on.

For @TIME, Rene Haas reflects on Arm’s journey, from phones to the data center, that’s paved the way for this moment: 
Rene Haas on What Makes Arm's Chips Indispensable
The CEO talks about Arm’s role in the Fourth Industrial Revolution, the speed of AI advancement and sustainability efforts
okt.to

source

About The Author