Cassie Robot Learns to Walk Autonomously Using AI

Researchers use reinforcement learning to teach a bipedal robot named Cassie to walk without hand-tuned programming. This approach overcomes the sim-to-real gap and brings robots closer to navigating unpredictable human environments.

A bipedal robot named Cassie learns to walk entirely on its own using reinforcement learning, an AI technique that relies on trial and error. Developed by researchers at the University of California, Berkeley, the robot masters a variety of movements from scratch, including crouch-walking and carrying unexpected loads. This self-taught approach contrasts sharply with the highly choreographed and likely hand-tuned routines seen in popular viral videos of robots made by Boston Dynamics.

Teaching a robot to walk in a simulation is relatively easy, but transferring those skills to the physical world presents a massive challenge known as the sim-to-real gap. Minor discrepancies in friction or physical laws between a virtual environment and reality cause heavy two-legged robots to lose balance and fall. Because training a large, physical robot through real-world trial and error is dangerous, the Berkeley team employs a clever dual-simulation method to bridge this gap safely.

While Cassie does not dance like the famous Atlas robot, its ability to independently learn how to walk represents a significant leap forward for robotics. By mastering basic locomotion without human intervention, the robot becomes much better equipped to handle diverse terrains and recover from stumbles or physical damage. This foundational skill brings humanoid machines several steps closer to safely operating in everyday human environments.

Read More at the original source →