Stop Thinking, Just Do!

Sungsoo Kim's Blog

Toward Generalist Humanoid Robots

tagsTags

4 November 2025


RI Seminar: Yuke Zhu : Toward Generalist Humanoid Robots

Abstract

In an era of rapid AI progress, leveraging accelerated computing and big data has unlocked new possibilities to develop generalist AI models. As AI systems like ChatGPT showcase remarkable performance in the digital realm, we are compelled to ask: Can we achieve similar breakthroughs in the physical world — to create generalist humanoid robots capable of performing everyday tasks? In this talk, I will outline our data-centric research principles and approaches for building general-purpose robot autonomy in the open world. I will present our recent work leveraging real-world, synthetic, and web data to train foundation models for humanoid robots. Furthermore, I will discuss the opportunities and challenges of building the next generation of intelligent robots. Bio: Yuke Zhu is an Associate Professor in the Computer Science Department of UT-Austin, where he directs the Robot Perception and Learning (RPL) Lab. He is also a Director and Distinguished Research Scientist at NVIDIA Research, where he co-leads the Generalist Embodied Agent Research (GEAR) lab. He focuses on developing intelligent algorithms for generalist robots and embodied agents to reason about and interact with the real world. He obtained his Ph.D. degree from Stanford University. He received the NSF CAREER Award, the IEEE RAS Early Academic Career Award, and various faculty fellowships and research awards from Amazon, JP Morgan, and Sony Research.