Email / CV / Google Scholar / Github / Twitter

News

June 2025: Co-organize two workshops at CVPR2025: 4DVision Workshop, all day on June 11th, and Agents In Interaction, from Human to Robots, all-day on June 12th. Come and check out our amazing program!

August 2024: PhD Defended!

June 2024: Co-organize a workshop MANGO at CVPR2024.

June 2024: I gave a talk at Visual Computing and Artificial Intelligence, MPI.

April 2024: Started visiting at MPI-PS, Tuebingen with Michael Black.

News History

Dec 2023: I gave a talk at GRASP Seminar, UPenn.

Nov 2023: Selected into EECS Rising Stars workshop.

June 2023: Presented at 3 workshops (4DHOI, 3D Scene Understanding, and RHOBIN) in CVPR2023.

Oct 2023: I gave a talk at Scene from Video workshop, MIT.

May 2023: I gave a talk at VGG, Oxford.

April 2023: Proposed my thesis! PhD student life counting down.

April 2023: I gave a talk at Scene Representation Group .

Sept 2022: Received NVIDIA Graduate Fellowship (2022-2023).

June 2022: Presented at workshop EGO4D-EPIC in CVPR2022.

June 2022: I gave a talk at IVG@SZ, Tsinghua.

Nov 2019: I gave a talk at Energy Efficient Computing Group , Tsinghua.

Research

	HEAD: Hand-Eye Autonomous Delivery: Learning Humanoid Navigation, Locomotion and Reaching Sirui Chen, Yufei Ye*, Zi-Ang Cao, Jennifer Lew, Pei Xu, C. Karen Liu, (* indicates equal contribution) CoRL 2025 project / arxiv / code / bibtex
	Web2Grasp: Learning Functional Grasps from Web Images of Hand-Object Interactions Hongyi Chen, Yunchao Yao, Yufei Ye, Zhixuan Xu, Homanga Bharadhwaj, Jiashun Wang, Shubham Tulsiani, Zackory Erickson, Jeffrey Ichnowski arXiv 2025 project / arxiv / bibtex
	HaPTIC: Predicting 4D Hand Trajectory from Monocular Videos Yufei Ye, Yao Feng, Omid Taheri, Haiwen Feng, Shubham Tulsiani, Michael J. Black (* indicates equal contribution) 3DV 2026 project / arxiv / code / bibtex
	St4RTrack: Simultaneous 4D Reconstruction and Tracking in the World Haiwen Feng, Junyi Zhang, Qianqian Wang, Yufei Ye, Pengcheng Yu, Michael J. Black, Trevor Darrell, Angjoo Kanazawa ICCV 2025 project / arxiv / bibtex
	PuzzleAvatar: Assembling 3D Avatars from Personal Albums Yuliang Xiu, Yufei Ye, Zhen Liu, Dimitrios Tzionas, Michael J. Black SIGGRAPH Asia 2024 project / code / video / arxiv / bibtex
	G-HOP: Generative Hand-Object Prior for Interaction Reconstruction and Grasp Synthesis Yufei Ye, Abhinav Gupta, Kris Kitani, Shubham Tulsiani CVPR 2024 Invited to CVPR workshop RHOBIN project / video / arxiv / slides / bibtex
<	Diffusion-Guided Reconstruction of Everyday Hand-Object Interaction Clips Yufei Ye, Poorvi Hebbar, Abhinav Gupta, Shubham Tulsiani ICCV , 2023 project / code / arxiv / bibtex
	Affordance Diffusion: Synthesizing Hand-Object Interactions Yufei Ye, Xueting Li, Abhinav Gupta, Shalini De Mello, Stan Birchfield, Jiaming Song, Shubham Tulsiani, Sifei Liu CVPR, 2023 Invited to 3 CVPR workshops (4DHOI, 3D Scene Understanding, and RHOBIN) Appearance in NVIDIA GTC project / video / arxiv / code / slides / bibtex
	What's in your hands? 3D Reconstruction of Generic Objects in Hands Yufei Ye, Abhinav Gupta, Shubham Tulsiani CVPR, 2022 Invited to CVPR workshop EGO4D-EPIC project / video / arxiv / code / colab demo / slides / bibtex
	Shelf-Supervised Mesh Prediction in the Wild Yufei Ye, Shubham Tulsiani, Abhinav Gupta CVPR, 2021 project / video / arxiv / code / poster / bibtex
	Object-centric Forward Modeling for Model Predictive Control Yufei Ye, Dhiraj Gandhi, Abhinav Gupta, Shubham Tulsiani CoRL, 2019 project / arxiv / poster / bibtex
	Compositional Video Prediction Yufei Ye, Maneesh Singh, Abhinav Gupta, Shubham Tulsiani ICCV, 2019 (* indicates equal contribution) project / arxiv / code / poster / bibtex
	Zero-shot Recognition via Semantic Embeddings and Knowledge Graphs Xiaolong Wang* Yufei Ye, Abhinav Gupta CVPR, 2018 ( indicates equal contribution) arXiv / code / poster / bibtex
	Practical automatic background substitution for live video Haozhi Huang, Xiaonan Fang, Yufei Ye, Songhai Zhang, and Paul L. Rosin. Computational Visual Media (CVM), 2017 paper / bibtex
	Locating Abnormality in OCT Images with Image-level Annotation Yufei Ye, Yankui Sun Graduate Thesis, 2017

Others

	Reading: Differential Geometry Erwin Kreyszig notes / summary, 2020
	Reading: Multiple View Geometry in Computer Vision Richard Hartley, Andrew Zisserman notes / exercise
	'TP-Link': a data explorer of the Hacker News data Yufei Ye, Dongyu Jiang, Lin Luo, Xi Luo, and Haoyue Shi. Google Girl Hackathon, 2017 (User Experience Award)*
	Somatic Game with RGB Hand Detector from scratch. Yufei Ye, Binghong Chen, and Jianxin Ma. Digital Logic Design, 2016 (Best Course Project)*
	Media Player on Cubieboard: Transparenting Android Bluetooth Protocols Stack for Car Yufei Ye, Binghong Chen, and Jianxin Ma. Intro to Software Engineering, 2016 (Best Course Project)*

Teaching

A guest lecture in 16-895 Understanding and Critiquing Generative Computer Vision, Fall 2023.

16-726 Learning-Based Image Synthesis, Spring 2021.

16-824 Visual Learning and Recognition, Spring 2020.

Education and Experience

I had wonderful time in several great research groups.

2023.5-2023.8: FAIR, w/ Kris Kitani

2022.5-2022.8: NVIIDA LPR, w/ Sifei Liu

2021.4-2022.4: Meta AI Mentorship (previously known as FRAIM), w/ Shubham Tulsiani

2016.11-2017.6: Visualization & Image Computing Group, w/ Yankui Sun.

2015.12 - 2016.2: Yitu Technology, w/ Yuanhao Chen.

2015 - 2016.11: Graphics & Geometric Computing Group, w/ Shi-Min Hu.

Selected Awards

I am very fortunate to receive recognition along the way:

EECS Rising Stars (2023);

NVIDIA Graduate Fellowship (2022-2023);

Excellent Undergraduate Student by Tsinghua University (2017);

Outstanding Undergraduate Student by Tsinghua Computer Science Dept (2017);

TP-Link Scholarship (2017);

Singapore Technologies Engineering China Scholarship (2015, 2016, and 2017);

National Scholarship, by the Ministry of Education of China (2014);

Sports Outstanding Award, by Tsinghua Computer Science Dept (2014, 2016, and 2017);

Student service Excellence Award, by Tsinghua University (2016);

Misc

Besides research, I’m passionate about music and sports! I played violin with the All University Orchestra (AUO) at CMU and the Tsinghua University Symphony Orchestra (TUSO), and recently picked up the guitar. I’m also an (inactive) member of the Stanford Badminton Club. Before that, I played for and served as coach of the CMU Badminton Team, and was captain of the Tsinghua Badminton Team. Here’s a fun CV about the other slices of my life.

This guy makes a nice webpage.

	Reading: Differential Geometry Erwin Kreyszig notes / summary, 2020
	Reading: Multiple View Geometry in Computer Vision Richard Hartley, Andrew Zisserman notes / exercise
	'TP-Link': a data explorer of the Hacker News data Yufei Ye, Dongyu Jiang, Lin Luo, Xi Luo, and Haoyue Shi. Google Girl Hackathon, 2017 (User Experience Award)*
	Somatic Game with RGB Hand Detector from scratch. Yufei Ye, Binghong Chen, and Jianxin Ma. Digital Logic Design, 2016 (Best Course Project)*
	Media Player on Cubieboard: Transparenting Android Bluetooth Protocols Stack for Car Yufei Ye, Binghong Chen, and Jianxin Ma. Intro to Software Engineering, 2016 (Best Course Project)*