AWS Graviton5: 192 Cores & Verified Isolation Unleashed

Graviton5: AI's New Compute Frontier?

AWS's Graviton5 launch marks a significant leap in ARM-based cloud computing, particularly for demanding workloads like agentic AI, code generation, and multi-step orchestration. The doubling of core count to 192, coupled with substantial L3 cache increases and the adoption of DDR5-8800 memory and PCIe Gen 6, positions these instances as powerful general-purpose processors. The standout innovation, however, is the formally verified hypervisor isolation within the Nitro System. This provides a mathematically proven security boundary, a critical advancement for multi-tenant environments and the execution of untrusted code, which is a growing concern with the proliferation of AI agents. The early customer benchmarks, showing significant performance gains for databases like ClickHouse and observability platforms like Honeycomb, underscore the tangible benefits of this hardware upgrade, even without code modifications. The broad adoption by major players like Meta, Uber, and Snowflake further validates the platform's potential and signals a significant shift towards ARM in large-scale cloud deployments.

Key Points

• AWS Graviton5 instances are now generally available, featuring up to 192 cores on four chiplets using TSMC's 3nm process.
• Key upgrades include 192 MB L3 cache (5x Graviton4), DDR5-8800 memory, and PCIe Gen 6.
• Graviton5 introduces formally verified hypervisor isolation, a first for production cloud environments, enhancing security for multi-tenant and untrusted code execution.
• AWS positions Graviton5 for agentic AI workloads, but its improvements benefit general-purpose computing like databases and web servers.
• Major customers like Meta are deploying tens of millions of Graviton5 cores for their AI initiatives.
• Customer benchmarks show significant performance boosts, e.g., 36% for ClickHouse and up to 60% query duration reduction for HubSpot's MySQL.
• M9g instances offer roughly 15% better price-performance compared to M8g, despite a 9% increase in on-demand rates.
• Future C9g (compute-optimized) and R9g (memory-optimized) variants are planned, suggesting further specialization.

---

📖 Source: AWS Graviton5 Reaches General Availability with 192 Cores and Formally Verified VM Isolation