Microsoft Unveils Custom AI Chips and Copilot Studio at Ignite 2023
Microsoft introduces its first custom AI chip, the Azure Maia 100, and Copilot Studio to compete in the generative AI hardware space. The company emphasizes a systems-level approach while maintaining partnerships with Nvidia and AMD.
Microsoft expands its generative AI infrastructure by launching the Azure Maia 100 AI Accelerator and Copilot Studio at Ignite 2023. The Azure Maia 100 represents Microsoft's first in-house custom AI chip designed specifically to optimize the training and inferencing of large language models. This move signals Microsoft's evolution from a software giant into a comprehensive systems company that builds its own hardware.
The new Azure Maia chip features support for open-standard MX sub-8bit data types, industry-standard ethernet connectivity, and advanced 5nm process technology from TSMC. Microsoft designs the chip with a liquid-cooled architecture that packs four Maia accelerators per server. The hardware currently runs OpenAI models like GPT-3.5 and undergoes active testing for GitHub Copilot and Bing workloads.
Despite launching its own silicon, Microsoft reassures partners that it remains committed to working closely with Nvidia and AMD. The company plans to continue deploying the latest GPUs, such as the Nvidia H200 and AMD MI300x, alongside its custom Maia chips. CEO Satya Nadella emphasizes that this heterogeneous infrastructure allows Microsoft to optimize its entire technology stack and deliver the best performance for AI workloads across its 60 global data center regions.