|
I'm currently a I'm interested in reinforcement learning, machine learning, robotics and some system stuff. Specifically, I'd like to build intelligent agent, which make decision with information coming from different sources Email / CV / Google Scholar / Github / Linkedin / Twitter I'm open to discussion or collaboration. Feel free to drop me an email if you're interested in my research. |
|
|
|
| * denotes equal contribution |
Manipulation |
|
Minghuan Liu*, Zixuan Chen*, Xuxin Cheng, Yandong Ji, Ruihan Yang, Xiaolong Wang CORL, 2024 (Oral) arXiv / Project Page / Code Visual whole body control with legged robot for mobile manipulation. |
|
Ruihan Yang, Yejin Kim, Rose Hendrix, Aniruddha Kembhavi, Xiaolong Wang, Kiana Ehsani IROS, 2024 ( Best Paper on Mobile Manipulation) arXiv / Project Page / Code Our model finish daily household tasks with minimum sensory data and simplest robot methodlogy. |
|
|
Ri-Zhao Qiu*, Yuchen Song*, Xuanbin Peng*, Sai Aneesh Suryadevara, Ge Yang, Minghuan Liu, Mazeyu Ji, Chengzhe Jia, Ruihan Yang, Xueyan Zou, Xiaolong Wang ICRA, 2025 project website / paper Long horizon loco-manipulation with LLM planner and learned wholebody skills. |
|
|
Shiqi Yang, Minghuan Liu, Yuzhe Qin, Runyu Ding, Jialong Li, Xuxin Cheng, Ruihan Yang, Sha Yi, Xiaolong Wang CORL, 2024 arXiv / Project Page / Code Our (low-cost cross-platform visual-exoskeleton) teleoperation system can generalize to humanoid hands, arm-hands, arm-gripper, and quadruped-gripper systems with high-precision teleoperation. |
|
Runyu Ding*, Yuzhe Qin*, Jiyue Zhu*, Chengzhe Jia, Shiqi Yang, Ruihan Yang, Xiaojuan Qi, Xiaolong Wang arXiv, 2024 arXiv / Project Page / Code Bunny-VisionPro is a real-time bimanual teleoperation system that prioritizes safety and minimal delay. It also features human haptic feedback to enhance immersion. |
|
Xialin He*, Chengjing Yuan*, Wenxuan Zhou, Ruihan Yang, David Held, Xiaolong Wang CORL, 2024 arXiv / Project Page We propose a system that enables quadruped to manipulate objects with legs. |
|
Ri-Zhao Qiu*, Yafei Hu*, Ge Yang, Yuchen Song, Yang Fu, Jianglong Ye, Jiteng Mu, Ruihan Yang, Nikolay Atanasov, Sebastian Scherer, Xiaolong Wang arXiv, 2024 arXiv / Project Page Open-ended, Language-grounded Mobile Manipulation with legged robots in the wild with generalizable NeRF. |
|
Yuzhe Qin*, Yueh-Hua Wu*, Shaowei Liu, Hanwen Jiang, Ruihan Yang, Yang Fu, Xiaolong Wang ECCV, 2022 arXiv / Project Page / Code We propose a new platform and pipeline, DexMV (Dexterous Manipulation from Videos), for imitation learning to bridge the gap between computer vision and robot learning. |
Locomotion |
|
Xuxin Cheng*, Yandong Ji*, Junming Chen, Ruihan Yang, Ge Yang, Xiaolong Wang RSS, 2024 arXiv / Project Page / Code Our policy can control a humanoid robot to walk in different styles, shake hands with humans, and even dance with a human in the real world |
|
Ruihan Yang*, Zhuoqun Chen*, Jianhan Ma*, Chongyi Zheng*, Yiyu Chen, Quan Nguyen, Xiaolong Wang CORL, 2024 CORL Deployable Workshop, 2023 (Best Paper Award) arXiv / Project Page Our system learns a Single Instructable Motion Prior from a diverse reference motion dataset. |
|
Ruihan Yang, Ge Yang, Xiaolong Wang CVPR, 2023 (Highlight) arXiv / Project Page Utilize 3D structure of the surrounding for visual locomotion over challenging terrain |
|
Ruihan Yang*, Minghao Zhang*, Nicklas Hansen, Huazhe Xu, Xiaolong Wang ICLR, 2022 (Spotlight) RSS VLRR Workshop, 2021 (Spotlight) arXiv / Project Page / Code Proposed LocoTransformer for Visual Locomotion with End2End RL |
|
Chieko Sarah Imai*, Minghao Zhang*, Yuchen Zhang*, Marcin Kierebiński, Ruihan Yang, Yuzhe Qin, Xiaolong Wang IROS, 2022 arXiv / Project Page / Code We propose Multi-Modal Delay Randomization (MMDR) to address the latency from the control pipeline when training with RL agents. |
Perception |
|
An-Chieh Cheng, Hongxu Yin, Yang Fu, Qiushan Guo, Ruihan Yang, Jan Kautz, Xiaolong Wang, Sifei Liu NeurIPS, 2024 arXiv / Project Page/ Code A powerful region-level VLM adept at 3D spatial reasoning. |
Reinforcement Learning |
|
Ruihan Yang, Huazhe Xu, Yi Wu, Xiaolong Wang NeurIPS, 2020 ICLR BeTR-RL workshop, 2020 (Oral) arXiv / Project Page / Code Proposed Soft Modularization for Multi-Task RL to avoid gradient interference between tasks and knowledge Sharing across tasks. |
|
Junjie Li, Sotetsu Koyamada, Qiwei Ye, Guoqing Liu, Chao Wang, Ruihan Yang, Li Zhao, Tao Qin, Tie-Yan Liu, Hsiao-Wuen Hon arXiv, 2020 arXiv / news Built (Strongest Mahjong AI around the world), now well matched to the top professional human player. |
|
|
|
UC San Diego, San Diego, CA • PhD in Machine Learning • 2021 to Present • M.S in Computer Science • 2019 to 2021 |
|
Nankai University, Tianjin, China • B.E in Software Engineering • 2015 to 2019 |
|
|
|
The AI Institute (Boston Dynamics AI Institute), Cambridge, MA • Research Intern @ DMM • Dec. 2024 ~ Mar.2025 |
|
Allen Institute for AI, Seattle, WA • Research Intern • Jun. 2023 ~ Dec. 2023 • Work on mobile manipulation, our work Harmonic Mobile Manipulation won Best Paper on Mobile Manipulation @ IROS 2024 (1 out of 2000+) |
|
Adobe Research, San Jose, CA(Remote) • Research Intern • Jun. 2021 ~ Dec.2021 • Work on Motion Synthesis |
|
Microsoft Research Asia, Beijing, China • Research Intern at Machine Learning group • Mar. 2018 ~ Jun.2019 • Core contributor of Suphx (Strongest Mahjong AI around the world), well matched to the top professional human player. Microsoft News |
|
Best Paper on Mobile Manipulation @ IROS 2024 (1 out of 2000+)
Oct, 2024
Best Workshop Paper @ CORL 2023 Deployable Workshop
Nov, 2023
|
|
Conference Reviewer:
ECCV / CVPR / ICCV / NeurIPS / ICLR / ICML / AAAI / ICRA / IROS / Humanoids
Journal Reviewer:
RAL / TRO
|
|
Math 155A, 3D Computer Graphics, UCSD
ECE 176, Introduction to Deep Learning & Applications, UCSD
ECE 285, Introduction to Visual Learning, UCSD |
|
Soccer: Man-United Fans |