AI21 Labs Unveils Jurassic-1, a Massive Language Model to Rival GPT-3
AI21 Labs introduces Jurassic-1 Jumbo, a 178-billion-parameter language model designed to compete directly with OpenAI's GPT-3. The model demonstrates impressive capabilities by generating historically accurate rap lyrics without explicit prompting.
AI21 Labs releases Jurassic-1 Jumbo, a massive language model containing 178 billion parameters. This new system surpasses GPT-3 in scale by utilizing three billion additional parameters, though it remains smaller than a few other massive models like PanGu-Alpha and Wu Dao 2.0. The company makes this powerful tool available to the broader research and development community as the first in a planned sequence of advanced language models.
The system demonstrates its deep knowledge base through a unique musical application. Developers use Jurassic-1 to write rap lyrics about historical figures in the style of the musical Hamilton. By priming the model with existing lyrics about Alexander Hamilton, George Washington, and Eva Perón, the team successfully prompts the AI to generate a complete rap about Barack Obama.
Remarkably, the model generates accurate biographical details about Obama without receiving any explicit background information. The AI independently pulls encoded knowledge about his time at Harvard Law, his wife Michelle, and his connection to Chicago. The developers then pair these generated lyrics with an off-the-shelf deep fake engine and a musical beat to create a finished video.