Xiaohan Zhang

Xiaohan Zhang

Senior Research Scientist at Sudo AI

I am a Senior Research Scientist at Sudo AI. Previously, I was a roboticist at the Robotics & AI Institute (also known as the Boston Dynamics AI Institute). I completed my PhD in Computer Science at the State University of New York at Binghamton, advised by Shiqi Zhang. In the summer and fall of 2023, I was a Research Scientist Intern on the Embodied AI team at Meta AI (FAIR), working with Chris Paxton. In spring 2023, I visited the Learning Agents Research Group (LARG) at UT Austin, supervised by Peter Stone. In summer 2022, I was a Student Researcher with the Robotics team at Google DeepMind. I received my bachelor's degree from Renmin University of China in 2019.

My research is at the intersection of robotics and AI. My PhD thesis focuses on Symbol Grounding and Task and Motion Planning (TAMP). More recently, I'm interested in robotics foundation models and reinforcement learning.

Experience

– Present

Sudo AI

Senior Research Scientist

Meta AI (FAIR)

Research Scientist Intern, Embodied AI

Publications

* Equal contribution. † Equal advising.

2026

2026

Test-Time Spatial Reasoning for Robot Manipulation Using Generative Real-to-Sim

Ivan Kapelyukh, Yafei Hu, Ran Gong, Brandon May, Tushar Kusnur, Laura Herlant, Karl Schmeckpeper, Edward Johns, Xiaohan Zhang

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2026

2026

Robot Planning and Situation Handling with Active Perception

Austine Oloo, Zainab Altaweel, Yohei Hayamizu, Peiqi Liu, Yan Ding, Saeid Amiri, Hao Yang, Andy Kaminski, Chad Esselink, Chris Paxton, Xiaohan Zhang, Shiqi Zhang

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2026

2026

World-action model sim-to-real examples

Efficient Sim-to-Real Transfer of World-Action Models from Synthetic Priors

Zixing Wang, Kausik Sivakumar, Jinghuan Shang, Yafei Hu, Zhaoming Xie, Ran Gong, Xiaohan Zhang, Karl Schmeckpeper

CVPR Embodied AI Workshop, 2026

2026

Scaling Short-Term Memory of Visuomotor Policies for Long-Horizon Tasks

Rutav Shah, Rajat Kumar Jenamani, Xiaohan Zhang, Lingfeng Sun, Roberto Martín-Martín, Yuke Zhu, Deva Ramanan, Karl Schmeckpeper

Preprint, 2026

2026

ExpertGen: Scalable Sim-to-Real Expert Policy Learning from Imperfect Behavior Priors

Zifan Xu, Ran Gong, Maria Vittoria Minniti, Kausik Sivakumar, Ahmet Salih Gundogdu, Eric Rosen, Riedana Yan, Tushar Kusnur, Zixing Wang, Di Deng, Peter Stone, Xiaohan Zhang, Karl Schmeckpeper

Preprint, 2026

2026

You've Got a Golden Ticket: Improving Generative Robot Policies With A Single Noise Vector

Omkar Patil, Ondrej Biza, Thomas Weng, Karl Schmeckpeper, Wil Thomason, Xiaohan Zhang, Kausik Sivakumar, Robin Walters, Nakul Gopalan, Sebastian Castro, Stephen Hart, Eric Rosen

Preprint, 2026

2026

ZeroBot: Learning from Scratch in Minutes with Generative Real2Sim

Ivan Kapelyukh, Xiaohan Zhang, Stephen James, Laura Herlant, Edward Johns

IEEE Robotics and Automation Letters (RA-L), 2026

2025

2025

AnyTask: an Automated Task and Data Generation Framework for Advancing Sim-to-Real Policy Learning

Ran Gong*, Xiaohan Zhang*, Jinghuan Shang*, Maria Vittoria Minniti*, Jigarkumar Patel, Valerio Pepe, Riedana Yan, Ahmet Gundogdu, Ivan Kapelyukh, Ali Abbas, Xiaoqiang Yan, Harsh Patel, Laura Herlant, Karl Schmeckpeper

Preprint, 2025

2025

Data-Efficient Multitask DAgger overview

Data-Efficient Multitask DAgger

Haotian Fu, Ran Gong, Xiaohan Zhang, Maria Vittoria Minniti, Jigarkumar Patel, Karl Schmeckpeper

Preprint, 2025

2025

ParticleFormer: A 3D Point Cloud World Model for Multi-Object, Multi-Material Robotic Manipulation

Suning Huang, Qianzhong Chen, Xiaohan Zhang, Jiankai Sun, Mac Schwager

Conference on Robot Learning (CoRL), 2025

2025

LLM-GROP: Visually Grounded Robot Task and Motion Planning with Large Language Models

Xiaohan Zhang*, Yan Ding*, Yohei Hayamizu*, Zainab Altaweel*, Yifeng Zhu, Yuke Zhu, Peter Stone, Chris Paxton, Shiqi Zhang

The International Journal of Robotics Research (IJRR), 2025
Extended from IROS, 2023 and ICRA, 2022

2024

2024

Symbol grounding dissertation overview

Symbol Grounding for Task and Motion Planning in Robotics

Xiaohan Zhang

PhD Dissertation, State University of New York at Binghamton, 2024

2024

DKPrompt: Domain Knowledge Prompting Vision-Language Models for Open-World Planning

Xiaohan Zhang, Zainab Altaweel*, Yohei Hayamizu*, Yan Ding, Saeid Amiri, Hao Yang, Andy Kaminski, Chad Esselink, Shiqi Zhang

CVPR Embodied AI Workshop, 2024
ICRA Workshop on Robot Execution Failures, 2023

2024

OpenEQA: Embodied Question Answering in the Era of Foundation Models

Arjun Majumdar*, Anurag Ajay*, Xiaohan Zhang*, Pranav Putta, Sriram Yenamandra, Mikael Henaff, Sneha Silwal, Paul Mcvay, Oleksandr Maksymets, Sergio Arnaud, Karmesh Yadav, Qiyang Li, Ben Newman, Mohit Sharma, Vincent Berges, Shiqi Zhang, Pulkit Agrawal, Yonatan Bisk, Dhruv Batra, Mrinal Kalakrishnan, Franziska Meier, Chris Paxton, Sasha Sax, Aravind Rajeswaran

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024

2023

2023

Integrating Action Knowledge and LLMs for Task Planning and Situation Handling in Open Worlds

Yan Ding, Xiaohan Zhang, Saeid Amiri, Nieqing Cao, Hao Yang, Andy Kaminski, Chad Esselink, Shiqi Zhang

Autonomous Robots, 2023

2023

SLAP: Spatial-Language Attention Policies

Priyam Parashar, Vidhi Jain, Xiaohan Zhang, Jay Vakil, Sam Powers, Yonatan Bisk, Chris Paxton

Conference on Robot Learning (CoRL), 2023

2023

LLM+P planning framework overview

LLM+P: Empowering Large Language Models with Optimal Planning Proficiency

Bo Liu*, Yuqian Jiang*, Xiaohan Zhang, Qiang Liu, Shiqi Zhang, Joydeep Biswas, Peter Stone

Preprint, 2023

2023

Symbolic State Space Optimization for Long Horizon Mobile Manipulation Planning

Xiaohan Zhang, Yifeng Zhu, Yan Ding, Yuqian Jiang, Yuke Zhu, Peter Stone, Shiqi Zhang

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023

2023

Multimodal Embodied Attribute Learning by Robots for Object-Centric Action Policies

Xiaohan Zhang, Saeid Amiri, Jivko Sinapov, Jesse Thomason, Peter Stone, Shiqi Zhang

Autonomous Robots, 2023
Extended from Robotics: Science and Systems (RSS), 2021

2023

Robotic Table Wiping via Reinforcement Learning and Whole-body Trajectory Optimization

Thomas Lew, Sumeet Singh, Mario Prats, Jeffrey Bingham, Jonathan Weisz, Benjie Holson, Xiaohan Zhang, Vikas Sindhwani, Yao Lu, Fei Xia, Peng Xu, Tingnan Zhang, Jie Tan, Montserrat Gonzalez

IEEE International Conference on Robotics and Automation (ICRA), 2023

2022

2022

GLAD: Grounded Layered Autonomous Driving for Complex Service Tasks

Yan Ding, Cheng Cui, Xiaohan Zhang, Shiqi Zhang

Preprint, 2022

2022

Learning to Ground Objects for Robot Task and Motion Planning

Yan Ding, Xiaohan Zhang, Xingyue Zhan, Shiqi Zhang

IEEE Robotics and Automation Letters (RA-L), 2022

2021

2021

Learning to Guide Human Attention on Mobile Telepresence Robots with 360 Vision

Kishan Chandan, Jack Albertson, Xiaohan Zhang, Xiaoyang Zhang, Yao Liu, Shiqi Zhang

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021

2020

2020

Task-Motion Planning for Safe and Efficient Urban Driving

Yan Ding, Xiaohan Zhang, Xingyue Zhan, Shiqi Zhang

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020