Microsoft and Arm unveil Cobalt 200 cloud chips to speed up AI agents
Microsoft's new Arm-based Cobalt 200 virtual machines beat comparable AMD chips on database and AI workloads, offering up to 128 virtual CPUs.
Microsoft has introduced its Cobalt 200 virtual machines, powered by Arm’s Neoverse Compute Subsystems V3 design. The custom processors are built to handle the heavy demands of modern cloud workloads and autonomous software agents, marking the second generation of Microsoft’s custom Arm silicon following the Cobalt 100.
Benchmark results against x86
Arm tested the Cobalt 200 against contemporary x86 cloud hardware running on AMD EPYC Turin chips. According to Arm’s test results, Cobalt 200 achieved up to 139% faster MySQL performance for transactional database systems. It also showed a 56% improvement in NGINX web serving, a 65% boost in Redis in-memory caching, and 56% faster x265 4K video encoding.
The chips also demonstrated advantages in digital chip design testing. Across three electronic design automation simulation tasks, the Cobalt 200 ran 1.48 times faster on average than the AMD Turin instances.
Powering agentic AI and search
Beyond traditional web infrastructure, Microsoft designed the hardware to support multi-step software agents. These systems rely on small language models, data lookups, and automated tool calls to complete tasks like routing customer service tickets or writing software.
In benchmarkBenchmarkA standard test used to compare AI models or chips. Open in glossary tests for agentic systems, Cobalt 200 delivered 56% higher vector searchVector searchA search technique that matches data by mathematical meaning rather than exact keywords. Open in glossary throughput on Milvus HNSW and finished SWE-bench coding tasks 46% faster than AMD Turin with 144 concurrent workers. Additionally, engineering work on Microsoft’s DiskANN vector search algorithm produced 1.45 times higher queries per second on Cobalt 200 compared to the older Cobalt 100 processor.
The new virtual machines will launch across Azure’s Dpsv7, Dplsv7, and Epsv7 instance families. Enterprises can configure these instances with up to 128 virtual processing cores and 512 gibibytes of memory.
How does this story land?
One tap per reader.
Quick poll
Will custom Arm chips displace x86 processors in most cloud data centers?
One tap. No sign-up.
Ask this story
Still have a question?
Answers use only what is in this story. They are written by AI and can be wrong.