OpenAI Launches Realtime Voice API for Developers Amid Company Shakeups
OpenAI introduces a public beta of its Realtime API, allowing developers to build low-latency, speech-to-speech AI applications. The announcement comes during a turbulent week of executive departures as the company fights to maintain its lead in a highly competitive AI market.
OpenAI hosts its 2024 DevDay conference and unveils a public beta of its Realtime API, a tool that allows developers to integrate low-latency, AI-generated voice responses into their applications. This new feature enables speech-to-speech experiences where users converse fluidly with an AI assistant, as demonstrated by a trip-planning app that verbally discusses travel plans and annotates a map in real time. The API provides six distinct, built-in voices and strictly prohibits third-party voice integrations to avoid copyright complications.
The product launch occurs during a chaotic period for OpenAI, following the sudden departures of chief technology officer Mira Murati and chief research officer Bob McGrew. Chief product officer Kevin Weil addresses these changes directly, stating that the company refuses to slow down despite the ongoing C-suite overhaul. OpenAI currently boasts over three million developers building on its platform, but the startup faces intense pressure from rivals like Google and Meta that continuously undercut its pricing.
To retain its developer base, OpenAI emphasizes that it reduces API access costs by 99% over the last two years. While the Realtime API mimics the capabilities of ChatGPT's Advanced Voice Mode, it functions as a distinct toolkit tailored specifically for app creators. By providing tools that can handle complex, multi-step tasks like making phone calls to order food, OpenAI aims to prove its platform remains the top choice for AI application development.