Cunjun Yu

Cunjun Yu

Hi! I'm a PhD student at the National University of Singapore, under the guidance of Professor David Hsu. I aim to build robots capable of teaching humans a variety of skills, such as collaborating effectively, writing Chinese calligraphy, playing air hockey, and driving. I also work on planning under dynamic environments, for example, autonomous driving and human-robot collaboration.

I am deeply grateful for the opportunity to have previously interned at NVIDIA NVIDIA Research and Toyota Research Institute Toyota Research Institute, where I gained invaluable experiences.

Github     Google Scholar     LinkedIn

News (Expand)

Publications ( show selected / show all by date )

StreamCoach

Real-Time Coaching of Human Physical Skills with Large Language Models

Cunjun Yu, Deepak Edakkattil Gopinath, Andrew Silva, Pradyumna Tambwekar, Emily Sumner, Laporsha Dees, Guy Rosman, John J. Leonard, Avinash Balachandran, David Hsu

Preprint, 2025

StackItUp

“Stack It Up!": 3D Stable Structure Generation from 2D Hand-drawn Sketch

Yiqing Xu, Linfeng Li, Cunjun Yu, David Hsu

Conference on Robot Learning (CoRL), Oral Presentation, 2025

GSON

GSON: A Group-based Social Navigation Framework with Large Multimodal Model

Shangyi Luo*, Peng Sun*, Ji Zhu*, Yuhong Deng, Cunjun Yu, Anxing Xiao, Xueqian Wang

Robotics and Automation Letters (RA-L), 2025

State Prediction

State Prediction for Planning: Closing the Interactive Dynamics Gap

Haoran Wu*, Cunjun Yu*, Yiqing Xu, David Hsu, Sifa Zheng

Preprint, 2025

Robi Butler

Robi Butler: Remote Multimodal Interactions with Household Robot Assistant

Anxing Xiao, Nuwan Janaka, Tianrun Hu, Anshul Gupta, Kaixin Li, Cunjun Yu, David Hsu

International Conference on Robotics and Automation (ICRA), 2025

Play-to-Coach

Play-to-Coach: Coaching Humans to Play Air Hockey with Robots

Cunjun Yu, Zhimin Hou, Yiqing Xu, David Hsu

ICRA pHRI Workshop, 2024

InsActor

InsActor: Instruction-driven Physics-based Characters

Jiawei Ren*, Mingyuan Zhang*, Cunjun Yu*, Xiao Ma, Liang Pan, Ziwei Liu

Neural Information Processing Systems (NeurIPS), 2023

TeachingBot

TeachingBot: Robot Teacher for Human Handwriting

Zhimin Hou*, Cunjun Yu*, David Hsu, Haoyong Yu

Preprint, 2023

DiffMimic

DiffMimic: Efficient Motion Mimicking with Differentiable Physics

Jiawei Ren*, Cunjun Yu*, Siwei Chen, Xiao Ma, Liang Pan, Ziwei Liu

International Conference on Learning Representations (ICLR), 2023

DaXBench

DaXBench: Benchmarking Deformable Object Manipulation with Differentiable Physics

Siwei Chen*, Yiqing Xu*, Cunjun Yu*, Linfeng Li, Xiao Ma, Zhongwen Xu, David Hsu

International Conference on Learning Representations (ICLR), Notable Top 5%, 2023

What Matters

What Truly Matters in Trajectory Prediction for Autonomous Driving?

Tran Phong*, Haoran Wu*, Cunjun Yu*, Panpan Cai, Sifa Zheng, David Hsu

Neural Information Processing Systems (NeurIPS), 2023

COACH

COACH: Cooperative Robot Teaching

Cunjun Yu, Yiqing Xu, Linfeng Li, David Hsu

Conference on Robot Learning (CoRL), 2022

Balanced MSE

Balanced MSE for Imbalanced Visual Regression

Jiawei Ren, Mingyuan Zhang, Cunjun Yu, Ziwei Liu

Conference on Computer Vision and Pattern Recognition (CVPR), Oral Presentation, 2022

INVIGORATE

INVIGORATE: Interactive Visual Grounding and Grasping in Clutter

Hanbo Zhang*, Yunfan Lu*, Cunjun Yu, David Hsu, Xuguang Lan, Nanning Zheng

Robotics: Science and Systems (RSS), 2021

STAR

Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Prediction

Cunjun Yu*, Xiao Ma*, Jiawei Ren, Haiyu Zhao, Shuai Yi

European Conference on Computer Vision (ECCV), 2020

BALMS

Balanced Meta-Softmax for Long-Tailed Visual Recognition

Jiawei Ren, Cunjun Yu, Shunan Sheng, Xiao Ma, Haiyu Zhao, Shuai Yi, Hongsheng Li

Neural Information Processing Systems (NeurIPS), 2020

MessyTable

MessyTable: Instance Association in Multiple Camera Views

Zhongang Cai, Junzhe Zhang, Daxuan Ren, Cunjun Yu, Haiyu Zhao, Shuai Yi, Chai Kiat Yeo, Chen Change Loy

European Conference on Computer Vision (ECCV), 2020

Visual Servoing

Siamese Convolutional Neural Network for Sub-millimeter-accurate Camera Pose Estimation and Visual Servoing

Cunjun Yu*, Zhongang Cai*, Hung Pham, Quang-Cuong Pham

International Conference on Intelligent Robots and Systems (IROS), 2019