DexWild introduces a dexterous human data collection system that works in diverse environments, without robots. We collect 9,290 human demos across 93 environments and show that cotraining with robot data unlocks generalization. In unseen scenes, Dexwild performs 3.8x better than training with robot data only.
FACTR: Force-Attending Curriculum Training for Contact-Rich Policy Learning
Jason Jingzhou Liu*, Yulong Li*, Kenneth Shaw, Tony Tao, Ruslan Salakhutdinov, Deepak Pathak
We present a low-cost bilateral teleoperation setup that allows you to feel what the robot is feeling. To leverage this force information, we present FACTR—a state-of-the-art policy learning framework designed to guide policies in attending to force information during training
AnyCar to Anywhere: Learning Universal Dynamics Model for Agile and Adaptive Mobility
Wenli Xiao*, Haoru Xue*, Tony Tao, Dvij Kalaria, John M. Dolan, Guanya Shi
AnyCar is a transformer-based dynamics model that can adapt to various vehicles, environments, state estimators, and tasks. We train a generalist model that exceeds specialist model capabilites across various different settings.
Agile Mobility with Rapid Online Adaptation via Meta-learning and Uncertainty-aware MPPI
Dvij Kalaria, Haoru Xue, Wenli Xiao, Tony Tao, Guanya Shi, John M. Dolan
This paper presents a meta-learning-based model adaptation approach for agile robotic mobility, integrating uncertainty-aware Model Predictive Path Integral (MPPI) control to enable rapid online adaptation to dynamic environments across various wheeled robot platforms.
Linear Delta Arrays for Compliant Dexterous Distributed Manipulation
Sarvesh Patil, Tony Tao, Tess Hellebrekers, Oliver Kroemer, F. Zeynep Temel
Delta Arrays demonstrate dexterous manipulation capabilities of a new type of distributed dexterous manipulator. We show a wide range of capablities for performing coordinated distributed manipulation including translation, alignment, prehensile squeezing, lifting, and grasping.