Haoyang (Harry) Li
Hi!👋 I am Harry Li, a roboticist & researcher at UC San Diego advised by Prof. Hao Su. Previously, I helped build embodied AI foundations as an early member at Hillbot. During my undergraduate studies, I also co-founded a student healthcare robotics startup.
My research focuses on building interactive world models and multimodal agents that learn from physical interaction. I'm interested in scaling physically-grounded data to develop agents that deeply understand how the physical world works, and can meaningfully act in it, working alongside humans. I value 0-to-1 building, hands-on engineering, and community impact alongside rigorous research.
Research Interests:
- Interactive World Model: Modeling the big world to catalyze the emergence of intelligence and facilitate the continuous evolution of autonomous agents.
- Multimodal Agent: Developing foundation models that unify perception, reasoning, and action to create embodied agents that are reliable, generalizable, and useful in real-world settings.
- Robotics Infra: Architecting robust infrastructure that empowers robots to autonomously learn, adapt, and operate in the complex physical world.
Github
LinkedIn
Twitter
hal212 at ucsd dot edu
🏢 Office: Franklin Antonio Hall 3302 or (Atkinson Hall 5202), 9500 Gilman Drive, La Jolla, CA 92093
Scaling World Model for Hierarchical Manipulation Policies
EMU 3.5 Team, Haoyang Li
In Submission, 2026
Webpage •
PDF •
Code •
Model
Diffusion Dynamics Models with Generative State Estimation for Cloth Manipulation
Tongxuan Tian*, Haoyang Li*, Bo Ai, show more
Conference on Robot Learning (CoRL), 2025
★ Oral presentation at CoRL workshop on Learning to Simulate Robot
Worlds ★
★ RSS 2025 Structured World Models for Robotic Manipulation ★
Webpage •
PDF
OpenReal2Sim: A Toolbox for Real-to-Sim Reconstruction and Robotic Simulation
OpenReal2Sim Team
GitHub, 2025
Code
Hillbot Alpha: A Sim-to-Real Breakthrough in Mobile Manipulation Robotics
Hillbot Team
Hillbot Blog, 2024
★Embodied AI brains and foundational models in the world at #CES2025 ★
Blog Post
Portable Venipuncture Robot for Autonomous Vascular Access
Haoyang Li*, Tenghui Xie*, Jinhai Pan, show more
ASME Student Mechanism and Robot Design Competition, 2022
★ Best Robotic System Finalist ★
Webpage •
PDF •
2021
MIT Technology Review
Security Multimodal Agent (AEGIS)
2025
Google ADK Hackathon
Intelligent security system transforming passive surveillance into a responsive, conversational guardian using LLMs and real-time vision.
Related Direction: CCTV Agent.
Code •
Youtube
3DGS Active Exploration Agent
2024
Autonomous robot system navigating unknown indoor environments with LiDAR/RGB-D to reconstruct high-fidelity 3D scenes via Gaussian Splatting.
Related Direction: World Labs (Autonomous 3D generation).
Code
Home Cleaning Mobile Manipulation
2024
Mobile manipulation platform integrating a collaborative arm with a mobile base for household tasks like tidying toys.
Follow-ups: Related products from Roborock Saros Z70.
Youtube
Antipodal Grasp Generation
2023
Collision-free grasp generator analyzing 3D object meshes to propose viable Franka end-effector poses for RL priors and hardware co-design.
Code
RoboMaster
2020
Lead mechanical design for the dart launcher system in the RoboMaster University Series global competition.
To see the spectrum, to voice the silence. 🌍