Hugging Face and partners launch RoboColosseum, an open real-world robot eval initiative with 10,000 free hours

Hugging Face, BitRobot Network, EAIC, and DJiafei's MAGIC Lab at NUS are the founding partners behind the initiative, which offers access to 100+ robots—including Unitree G1s, LeRobot SO-101s, i2rt YAMs, Franka arms, and Frodobots Earth Rovers—across 140+ in-the-wild scenes. Two eval tracks cover zero-shot open-world performance and fine-tuned performance on fixed open-source datasets. Across 20,000+ runs, policy rankings varied by task and robot. Five VLAs and three frontier models were tested, with human evaluators judging results. All rollout data, including failures, is open-sourced, and 10,000 free evaluation hours are available to academic labs.

✨ AI summary of the linked source — not editorial content.

Explore the topic

• Launch