Selected Publications

Boyu Li, Siyuan He, Hang Xu, Haoqi Yuan, Xinrun Xu, yu zang, Liwei Hu, ZhenXiong Jiang, Junpeng Yue, Pengbo Hu, Börje F. Karlsson, Yehui Tang, Zongqing Lu

IEEE International Conference on Robotics and Automation (ICRA), 2026

Details PDF Project

[AAAI'26] Learning Diverse Bimanual Dexterous Manipulation Skills from Human Demonstrations

Bohan Zhou, Haoqi Yuan, Yuhui Fu, Zongqing Lu

AAAI Conference on Artificial Intelligence (AAAI), oral, 2026.

Details PDF Project

[NeurIPS'25] From Experts to a Generalist: Toward General Whole-Body Control for Humanoid Robots

Yuxuan Wang, Ming Yang, Weishuai Zeng, Yu Zhang, Xinrun Xu, Haobin Jiang, Ziluo Ding, Zongqing Lu

Thirty-Ninth Conference on Neural Information Processing Systems (NeurIPS), Dec. 2-7, 2025. (Acceptance Rate: 24.52%)

Details PDF Project

[NeurIPS'25] MEgoHand: Multi-Modal Egocentric Hand-Object Interaction Motion Generation

Bohan Zhou, Yi Zhan, Zhongbin Zhang, Zongqing Lu

Thirty-Ninth Conference on Neural Information Processing Systems (NeurIPS), Dec. 2-7, 2025. (Acceptance Rate: 24.52%)

Details PDF Project

[NeurIPS'25] OpenMMEgo: Enhancing Egocentric Understanding for LMMs with Open Weights and Data

Hao Luo, Zihao Yue, Wanpeng Zhang, Yicheng Feng, Sipeng Zheng, Deheng Ye, Zongqing Lu

Thirty-Ninth Conference on Neural Information Processing Systems (NeurIPS), Dec. 2-7, 2025. (Acceptance Rate: 24.52%)

Details PDF Project

[NeurIPS'25] Planning with Quantized Opponent Models

Xiaopeng Yu, Kefan Su, Zongqing Lu

Thirty-Ninth Conference on Neural Information Processing Systems (NeurIPS), Dec. 2-7, 2025. (Acceptance Rate: 24.52%)

Details PDF Project

[EMNLP'25] Taking Notes Brings Focus? Towards Multi-Turn Multimodal Dialogue Learning

Jiazheng liu, Sipeng Zheng, Börje F. Karlsson, and Zongqing Lu

Conference on Empirical Methods in Natural Language Processing (EMNLP), November 4-9, 2025. (Acceptance Rate: 22%=¹⁸¹¹⁄₈₁₇₄)

Details PDF Project

[ICCV'25] MotionCtrl: A Real-Time Controllable Vision-Language-Motion Model

Bin Cao, Sipeng Zheng, Ye Wang, Lujie Xia, Qianshan Wei, Qin Jin, Jing Liu, Zongqing Lu

International Conference on Computer Vision (ICCV), October 19-23, 2025. (Acceptance Rate: 24%)

Details PDF Project

[ICCV'25] Unified Multimodal Understanding via Byte-Pair Visual Encoding

Wanpeng Zhang, Yicheng Feng, Hao Luo, Yijiang Li, Zihao Yue, Sipeng Zheng, Zongqing Lu

International Conference on Computer Vision (ICCV), October 19-23, 2025. (Acceptance Rate: 24%)

Details PDF Project

[ICCV'25] VideoOrion: Tokenizing Object Dynamics in Videos

Yicheng Feng, Yijiang Li, Wanpeng Zhang, Sipeng Zheng, Hao Luo, Zihao Yue, Zongqing Lu

International Conference on Computer Vision (ICCV), October 19-23, 2025. (Acceptance Rate: 24%)

Details PDF Project

[ICCV'25] GTR: Guided Thought Reinforcement Prevents Thought Collapse in RL-based VLM Agent Training

Tong Wei, Yijun Yang, Junliang Xing, Yuanchun Shi, Zongqing Lu, Deheng Ye

International Conference on Computer Vision (ICCV), October 19-23, 2025. (Acceptance Rate: 24%)

Details PDF Project

[IROS'25] NOLO: Navigate Only Look Once

Bohan Zhou, Zhongbin Zhang, Jiangxing Wang, Zongqing Lu

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), October 19-25, 2025.

Details PDF Project Webpage

[ACL'25] Beyond Outcomes: Transparent Assessment of LLM Reasoning in Games

Wenye Lin, Jonathan Roberts, Yunhan Yang, Samuel Albanie, Zongqing Lu, Kai Han

The 63rd Annual Meeting of the Association for Computational Linguistics (ACL), July 27-August 1, 2025.

Details PDF Project Webpage

[UAI'25] Best Possible Q-Learning

Jiechuan Jiang and Zongqing Lu

Conference on Uncertainty in Artificial Intelligence (UAI), July 21-25, 2025. (Acceptance Rate: 30.7%=²³⁰⁄₇₅₀)

Details PDF Project

[UAI'25] Creative Agents: Empowering Agents with Imagination for Creative Tasks

Penglin Cai, Chi Zhang, Yuhui Fu, Haoqi Yuan, Zongqing Lu

Conference on Uncertainty in Artificial Intelligence (UAI), July 21-25, 2025. (Acceptance Rate: 30.7%=²³⁰⁄₇₅₀)

Details PDF Code Project Webpage

[ICML'25] Scaling Large Motion Models with Million-Level Human Motions

Ye Wang, Sipeng Zheng, Bin Cao, Qianshan Wei, Weishuai Zeng, Qin Jin, Zongqing Lu

Forty-Second International Conference on Machine Learning (ICML), July 13-19, 2025 (Acceptance Rate: 26.9%=³²⁶⁰⁄₁₂₁₀₇)

Details PDF Project

[ICML'25] Cradle: Empowering Foundation Agents towards General Computer Control

Weihao Tan, Wentao Zhang, Xinrun Xu, Haochong Xia, Ziluo Ding, Boyu Li, Bohan Zhou, Junpeng Yue, Jiechuan Jiang, Yewen Li, Ruyi An, Molei Qin, Chuqiao Zong, Longtao Zheng, YuJie Wu, Xiaoqiang Chai, Yifei Bi, Tianbao Xie, Pengjie Gu, Xiyun Li, Ceyao Zhang, Long Tian, Chaojie Wang, Xinrun Wang, Börje F. Karlsson, Bo An, Shuicheng YAN, Zongqing Lu

Forty-Second International Conference on Machine Learning (ICML), July 13-19, 2025 (Acceptance Rate: 26.9%=³²⁶⁰⁄₁₂₁₀₇)

Details PDF Code Project

[ICML'25] Revisiting Cooperative Off-Policy Multi-Agent Reinforcement Learning

Yueheng Li, Guangming Xie, Zongqing Lu

Forty-Second International Conference on Machine Learning (ICML), July 13-19, 2025 (Acceptance Rate: 26.9%=³²⁶⁰⁄₁₂₁₀₇)

Details PDF Project

[ICLR'25] Cross-Embodiment Dexterous Grasping with Reinforcement Learning

Haoqi Yuan, Bohan Zhou, Yuhui Fu, and Zongqing Lu

The Thirteenth International Conference on Learning Representations (ICLR), April 24-28, 2025. (Acceptance Rate: 32.08%)

Details PDF Project Webpage

[ICLR'25] Efficient Residual Learning with Mixture-of-Experts for Universal Dexterous Grasping

Ziye Huang, Haoqi Yuan, Yuhui Fu, and Zongqing Lu

The Thirteenth International Conference on Learning Representations (ICLR), April 24-28, 2025. (Acceptance Rate: 32.08%)

Details PDF Project

[ICLR'25] From Pixels to Tokens: Byte-Pair Encoding on Quantized Visual Modalities

Wanpeng Zhang, Zilong Xie, Yicheng Feng, Yijiang Li, Xingrun Xing, Sipeng Zheng, and Zongqing Lu

The Thirteenth International Conference on Learning Representations (ICLR), April 24-28, 2025. (Acceptance Rate: 32.08%)

Details PDF Project

[ICLR'25] Cross-Domain Offline Policy Adaptation with Optimal Transport and Dataset Constraint

Jiafei Lyu, Mengbei Yan, Zhongjian Qiao, Runze Liu, Xiaoteng Ma, Deheng Ye, Jing-Wen Yang, Zongqing Lu, and Xiu Li

The Thirteenth International Conference on Learning Representations (ICLR), April 24-28, 2025. (Acceptance Rate: 32.08%)

Details PDF Project

[ICLR'25] Discrete Latent Plans via Semantic Skill Abstractions

Haobin Jiang, Jiangxing Wang, and Zongqing Lu

The Thirteenth International Conference on Learning Representations (ICLR), April 24-28, 2025. (Acceptance Rate: 32.08%)

Details PDF Project

[ICLR'25] Learning Video-Conditioned Policy on Unlabelled Data with Joint Embedding Predictive Transformer

Hao Luo and Zongqing Lu

The Thirteenth International Conference on Learning Representations (ICLR), April 24-28, 2025. (Acceptance Rate: 32.08%)

Details PDF Project

[ICLR'25] MLLM as Retriever: Interactively Learning Multimodal Retrieval for Embodied Agents

Junpeng Yue, Xinrun Xu, Börje F. Karlsson, and Zongqing Lu

The Thirteenth International Conference on Learning Representations (ICLR), April 24-28, 2025. (Acceptance Rate: 32.08%)

Details PDF Project

[ICLR'25] Watch Less, Do More: Implicit Skill Discovery for Video-Conditioned Policy

Jiangxing Wang and Zongqing Lu

The Thirteenth International Conference on Learning Representations (ICLR), April 24-28, 2025. (Acceptance Rate: 32.08%)

Details PDF Project

[NAACL'25] LLM-Based Explicit Models of Opponents for Multi-Agent Games

Xiaopeng Yu, Wanpeng Zhang, and Zongqing Lu

Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics (NAACL), April 29- May 4, 2025.

Details PDF Project

[NeurIPS'24] Pre-Trained Multi-Goal Transformers with Prompt Optimization for Efficient Online Adaptation

Haoqi Yuan, Yuhui Fu, Feiyang Xie, and Zongqing Lu

Thirty-Eighth Conference on Neural Information Processing Systems (NeurIPS), Dec. 9-15, 2024. (Acceptance Rate: 25.8%)

Details PDF Project

[NeurIPS'24] A Novel Benchmark for Decision-Making in Uncertain and Competitive Games

Kefan Su, Yusen Huo, Zhilin Zhang, Shuai Dou, Chuan Yu, Jian Xu, Zongqing Lu, and Bo Zheng

Thirty-Eighth Conference on Neural Information Processing Systems (NeurIPS), Datasets and Benchmarks, Dec. 9-15, 2024. (Acceptance Rate: 25.3%, spotlight)

Details PDF Project

[NeurIPS'24] Multi-Agent Coordination via Multi-Level Communication

Ziluo Ding, Zeyuan Liu, Zhirui Fang, Kefan Su, Liwen Zhu, and Zongqing Lu

Thirty-Eighth Conference on Neural Information Processing Systems (NeurIPS), Dec. 9-15, 2024. (Acceptance Rate: 25.8%)

Details PDF Project

[NeurIPS'24] ODRL: A Benchmark for Off-Dynamics Reinforcement Learning

Jiafei Lyu, Kang Xu, Jiacheng Xu, Mengbei Yan, Jing-Wen Yang, Zongzhang Zhang, Chenjia Bai, Zongqing Lu, and Xiu Li

Thirty-Eighth Conference on Neural Information Processing Systems (NeurIPS), Datasets and Benchmarks, Dec. 9-15, 2024. (Acceptance Rate: 25.3%)

Details PDF Project

[NeurIPS'24] Opponent Modeling based on Subgoal Inference

Xiaopeng Yu, Jiechuan Jiang, and Zongqing Lu

Thirty-Eighth Conference on Neural Information Processing Systems (NeurIPS), Dec. 9-15, 2024. (Acceptance Rate: 25.8%)

Details PDF Project

[NeurIPS'24] RL-GPT: Integrating Reinforcement Learning and Code-as-policy

Shaoteng Liu, Haoqi Yuan, Minda Hu, Yanwei Li, Yukang Chen, Shu Liu, Zongqing Lu, and Jiaya Jia

Thirty-Eighth Conference on Neural Information Processing Systems (NeurIPS), Dec. 9-15, 2024. (Acceptance Rate: 25.8%, oral)

Details PDF Project

[ECCV'24] UniCode: Learning a Unified Codebook for Multimodal Large Language Models

Sipeng Zheng, Bohan Zhou, Yicheng Feng, Ye Wang, and Zongqing Lu

European Conference on Computer Vision (ECCV), Sep. 29- Oct. 4, 2024.

Details PDF Project

[ECCV'24] Visual Grounding for Object-Level Generalization in Reinforcement Learning

Haobin Jiang and Zongqing Lu

European Conference on Computer Vision (ECCV), Sep. 29- Oct. 4, 2024.

Details Project

[ECCV'24] Pre-Trained Visual Dynamics Representations for Efficient Policy Learning

Hao Luo, Bohan Zhou, and Zongqing Lu

European Conference on Computer Vision (ECCV), Sep. 29- Oct. 4, 2024.

Details Project

[ECCV'24] Reinforcement Learning Friendly Vision-Language Model for Minecraft

Haobin Jiang, Junpeng Yue, Hao Luo, Ziluo Ding, and Zongqing Lu

European Conference on Computer Vision (ECCV), Sep. 29- Oct. 4, 2024.

Details PDF Project

[ACL'24] Language Model Adaption for Reinforcement Learning with Natural Language Action Space

Jiangxing Wang, Jiachen Li, Xiao Han, Deheng Ye, and Zongqing Lu

Annual Meeting of the Association for Computational Linguistics, August 11-16, 2024.

Details Project

[ICML'24] Cross-Domain Policy Adaptation by Capturing Representation Mismatch

Jiafei Lyu, Chenjia Bai, Jing-Wen Yang, Zongqing Lu, and Xiu Li

Forty-first International Conference on Machine Learning (ICML), July 21-27, 2024 (Acceptance Rate: 27.5%=²⁶⁰⁹⁄₉₄₇₃)

Details Project

[ICML'24] Tackling Non-Stationarity in Reinforcement Learning via Causal-Origin Representation

Wanpeng Zhang, Yilin Li, Boyu Yang, and Zongqing Lu

Forty-first International Conference on Machine Learning (ICML), July 21-27, 2024 (Acceptance Rate: 27.5%=²⁶⁰⁹⁄₉₄₇₃)

Details PDF Project

[NAACL'24] AdaRefiner: Refining Decisions of Language Models with Adaptive Feedback

Wanpeng Zhang and Zongqing Lu

Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), Findings, June 16–21, 2024.

Details PDF Project

[NAACL'24] LLaMA Rider: Spurring Large Language Models to Explore the Open World

Yicheng Feng, Yuxuan Wang, Jiazheng Liu, Sipeng Zheng, and Zongqing Lu

Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), Findings, June 16–21, 2024.

Details PDF Project

[ICLR'24] Pre-Training Goal-Based Models for Sample-Efficient Reinforcement Learning

Haoqi Yuan, Zhancun Mu, Feiyang Xie, Zongqing Lu

Eighth International Conference on Learning Representations (ICLR), May 7-11, 2024. (Acceptance Rate: 1.2%, oral)

Details PDF Project

[ICLR'24] SEABO: A Simple Search-Based Method for Offline Imitation Learning

Jiafei Lyu, Xiaoteng Ma, Le Wan, Runze Liu, Xiu Li, Zongqing Lu

Eighth International Conference on Learning Representations (ICLR), May 7-11, 2024. (Acceptance Rate: 31%)

Details PDF Project

[ICLR'24] Steve-Eye: Equipping LLM-based Embodied Agents with Visual Perception in Open Worlds

Sipeng Zheng, Jiazheng Liu, Yicheng Feng, and Zongqing Lu

Eighth International Conference on Learning Representations (ICLR), May 7-11, 2024. (Acceptance Rate: 31%)

Details PDF Project

[AAMAS'24] Multi-Agent Alternate Q-Learning

Kefan Su, Siyuan Zhou, Jiechuan Jiang, Chuang Gan, Xiangjun Wang, and Zongqing Lu

Twenty-Third International Conference on Autonomous Agents and Multiagent Systems (AAMAS), May 6-10. (Acceptance Rate: 25%=²²⁹⁄₈₈₃)

Details PDF Project

[AAMAS'24] Towards Understanding How to Reduce Generalization Gap in Visual Reinforcement Learning

Jiafei Lyu, Le Wan, Xiu Li, and Zongqing Lu

Twenty-Third International Conference on Autonomous Agents and Multiagent Systems (AAMAS), extended abstract, May 6-10.

Details PDF Project

[AAAI'24] Learning Multi-Object Positional Relationships via Emergent Communication

Yicheng Feng, Boshi An, and Zongqing Lu

Thirty-Eighth AAAI Conference on Artificial Intelligence (AAAI), February 20-27, 2024 (Acceptance Rate: 23.75%=²³⁴²⁄₉₈₆₂)

Details PDF Project

[AAAI'24] Settling Decentralized Multi-Agent Coordinated Exploration by Novelty Sharing

Haobin Jiang, Ziluo Ding, and Zongqing Lu

Thirty-Eighth AAAI Conference on Artificial Intelligence (AAAI), February 20-27, 2024 (Acceptance Rate: 23.75%=²³⁴²⁄₉₈₆₂)

Details PDF Project

[NeurIPS'23] Learning from Visual Observation via Offline Pretrained State-to-Go Transformer

Bohan Zhou, Ke Li, Jiechuan Jiang, and Zongqing Lu

Thirty-Seventh Conference on Neural Information Processing Systems (NeurIPS), Dec. 10-16, 2023. (Acceptance Rate: 26.1%=³²²¹⁄₁₂₃₄₃)

Details PDF Project

[NeurIPS'23] Mutual-Information Regularized Multi-Agent Policy Iteration

Jiangxing Wang, Deheng Ye, and Zongqing Lu

Thirty-Seventh Conference on Neural Information Processing Systems (NeurIPS), Dec. 10-16, 2023. (Acceptance Rate: 26.1%=³²²¹⁄₁₂₃₄₃)

Details PDF Project

[ICCV'23] ReLeaPS: Reinforcement Learning-based Illumination Planning for Generalized Photometric Stereo

Junhoong Chan, Bohan Yu, Heng Guo, Jieji Ren, Zongqing Lu, and Boxin Shi

International Conference on Computer Vision (ICCV), October 2-6, 2023.

Details PDF Project

[ECAI'23] Offline Decentralized Multi-Agent Reinforcement Learning

Jiechuan Jiang and Zongqing Lu

26th European Conference on Artificial Intelligence (ECAI), Sept. 30-Oct. 4, 2023. (Acceptance Rate: 24%=³⁹¹⁄₁₆₃₁)

Details PDF Project

[ACL'23] Multi-Agent Language Learning: Symbolic Mapping

Yicheng Feng and Zongqing Lu

61st Annual Meeting of the Association for Computational Linguistics (ACL), Findings, July 9-14, 2023.

Details PDF Project

[ICML'23] Entity Divider with Language Grounding in Multi-Agent Reinforcement Learning

Ziluo Ding, Wanpeng Zhang, Junpeng Yue, Xiangjun Wang, Tiejun Huang, and Zongqing Lu

Fortieth International Conference on Machine Learning (ICML), July 23-29, 2023. (Acceptance Rate: 27.9%=¹⁸²⁷⁄₆₅₃₈)

Details PDF Project

[CVPR'23] Multi-Agent Automated Machine Learning

Zhaozhi Wang, Kefan Su, Jian Zhang, Huizhu Jia, Qixiang Ye, Xiaodong Xie, and Zongqing Lu

IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR), Jun 18-22, 2023. (Acceptance Rate: 25.78%=²³⁶⁰⁄₉₁₅₅)

Details PDF Project

[ICLR'23] State Advantage Weighting for Offline RL

Jiafei Lyu, Aicheng Gong, Le Wan, Zongqing Lu, and Xiu Li

Eleventh International Conference on Learning Representations (ICLR), Tiny Papers, May 1-5, 2023.

Details PDF Project NeurIPS’22 Workshop on Offline RL

[ICLR'23] More Centralized Training, Still Decentralized Execution: Multi-Agent Conditional Policy Factorization

Jiangxing Wang, Deheng Ye, and Zongqing Lu

Eleventh International Conference on Learning Representations (ICLR), May 1-5, 2023.

Details PDF Code Project

[AAMAS'23] Adaptive Learning Rates for Multi-Agent Reinforcement Learning

Jiechuan Jiang and Zongqing Lu

Twenty-Second International Conference on Autonomous Agents and Multiagent Systems (AAMAS), May 29 - June 2, 2023. (Acceptance Rate: 23%=²³⁷⁄₁₀₁₅)

Details PDF Project

[AAAI'23] Online Tuning for Offline Decentralized Multi-Agent Reinforcement Learning

Jiechuan Jiang and Zongqing Lu

Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI), February 7-14, 2023. (Acceptance Rate: 19%=¹⁷²¹⁄₈₇₇₇)

Details PDF Project

[NIPS'22] I2Q: A Fully Decentralized Q-Learning Algorithm

Jiechuan Jiang and Zongqing Lu

Thirty-Sixth Annual Conference on Neural Information Processing Systems (NIPS), November 28 - December 9, 2022. (Acceptance Rate: 25.6%=²⁶⁶⁵⁄₁₀₄₁₁)

Details PDF Code Project

[NIPS'22] Model-Based Opponent Modeling

Xiaopeng Yu, Jiechuan Jiang, Wanpeng Zhang, Haobin Jiang, and Zongqing Lu

Thirty-Sixth Annual Conference on Neural Information Processing Systems (NIPS), November 28 - December 9, 2022. (Acceptance Rate: 25.6%=²⁶⁶⁵⁄₁₀₄₁₁)

Details PDF Code Project

[NIPS'22] Mildly Conservative Q-Learning for Offline Reinforcement Learning

Jiafei Lyu, Xiaoteng Ma, Xiu Li, and Zongqing Lu

Thirty-Sixth Annual Conference on Neural Information Processing Systems (NIPS), November 28 - December 9, 2022. (Acceptance Rate: 25.6%=²⁶⁶⁵⁄₁₀₄₁₁, spotlight)

Details PDF Code Project

[NIPS'22] Double Check Your State Before Trusting It: Confidence-Aware Bidirectional Offline Model-Based Imagination

Jiafei Lyu, Xiu Li, and Zongqing Lu

Thirty-Sixth Annual Conference on Neural Information Processing Systems (NIPS), November 28 - December 9, 2022. (Acceptance Rate: 25.6%=²⁶⁶⁵⁄₁₀₄₁₁, spotlight)

Details PDF Project

[NIPS'22] Learning to Share in Multi-Agent Reinforcement Learning

Yuxuan Yi, Ge Li, Yaowei Wang, and Zongqing Lu

Thirty-Sixth Annual Conference on Neural Information Processing Systems (NIPS), November 28 - December 9, 2022. (Acceptance Rate: 25.6%=²⁶⁶⁵⁄₁₀₄₁₁)

Details PDF Code Dataset Project Best Cooperative AI Paper Award ICLR’22 Workshop on GamificationMAS ICLR'22 Workshop on Cells2Societies (oral)

[NIPS'22] Towards Human-Level Bimanual Dexterous Manipulation with Reinforcement Learning

Yuanpei Chen, Tianhao Wu, Shengjie Wang, Xidong Feng, Jiechuan Jiang, Stephen Marcus McAleer, Hao Dong, Zongqing Lu, Song-Chun Zhu, and Yaodong Yang

Thirty-Sixth Annual Conference on Neural Information Processing Systems (NIPS), November 28 - December 9, 2022.

Details PDF Code Project Datasets and Benchmarks

[ICML'22] Divergence-Regularized Multi-Agent Actor-Critic

Kefan Su and Zongqing Lu

Thirty-Ninth International Conference on Machine Learning (ICML), July 17-23, 2022 (Acceptance Rate: 22%=¹²³⁵⁄₅₆₃₀)

Details PDF Code Project

[ICML'22] Robust Task Representations for Offline Meta-Reinforcement Learning via Contrastive Learning

Haoqi Yuan and Zongqing Lu

Thirty-Ninth International Conference on Machine Learning (ICML), July 17-23, 2022 (Acceptance Rate: 22%=¹²³⁵⁄₅₆₃₀)

Details PDF Code Project

[ICML'22] Difference Advantage Estimation for Multi-Agent Policy Gradients

Yueheng Li, Guangming Xie, and Zongqing Lu

Thirty-Ninth International Conference on Machine Learning (ICML), July 17-23, 2022 (Acceptance Rate: 22%=¹²³⁵⁄₅₆₃₀)

Details PDF Project

[ICML'21] The Emergence of Individuality

Jiechuan Jiang and Zongqing Lu

Thirty-Eighth International Conference on Machine Learning (ICML), July 18-24, 2021 (Acceptance Rate: 3%=¹⁶⁶⁄₅₅₁₃, oral presentation)

Details PDF Project

[ICML'21] FOP: Factorizing Optimal Joint Policy of Maximum-Entropy Multi-Agent Reinforcement Learning

Tianhao Zhang, Yueheng Li, Chen Wang, Guangming Xie and Zongqing Lu

Thirty-Eighth International Conference on Machine Learning (ICML), July 18-24, 2021 (Acceptance Rate: 21%=¹¹⁸⁴⁄₅₅₁₃)

Details PDF Code Project

[AAAI'21] Hierarchically and Cooperatively Learning Traffic Signal Control

Bingyu Xu, Yaowei Wang, Zhaozhi Wang, Huizhu Jia, and Zongqing Lu

Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI), February 2-9, 2021. (Acceptance Rate: 21%=¹⁶⁹²⁄₇₉₁₁)

Details PDF Code Dataset Project

[DATE'21] Asynchronous Reinforcement Learning Framework for Net Order Exploration in Detailed Routing

Tong Qu, Yibo Lin, Zongqing Lu, Yajun Su, and Yayi Wei

Design, Automation and Test in Europe Conference (DATE), February 1-5, 2021.

Details PDF Project

[NIPS'20] Learning Individually Inferred Communication for Multi-Agent Cooperation

Ziluo Ding, Tiejun Huang, and Zongqing Lu

Thirty-Fourth Annual Conference on Neural Information Processing Systems (NIPS), December 6-12, 2020. (Acceptance Rate: 1%=¹⁰⁵⁄₉₄₅₄, oral)

Details PDF Code Project

[ICLR'20] Graph Convolutional Reinforcement Learning

Jiechuan Jiang, Chen Dun, Tiejun Huang and Zongqing Lu

International Conference on Learning Representation (ICLR), April 26-30, 2020. (Acceptance Rate: 26.5%=⁶⁸⁷⁄₂₅₉₄)

Details PDF Video Code Project

[AAAI'20] Generative Exploration and Exploitation

Jiechuan Jiang and Zongqing Lu

Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI), February 7-12, 2020. (Acceptance Rate: 21%=¹⁵⁹¹⁄₇₇₃₇)

Details PDF Project ICML'19 Workshop on ERL (Spotlight Talk)

[NIPS'19] Learning Fairness in Multi-Agent Systems

Jiechuan Jiang and Zongqing Lu

Thirty-Third Annual Conference on Neural Information Processing Systems (NIPS), December 8-14, 2019. (Acceptance Rate: 21%=¹⁴²⁸⁄₆₇₄₃)

Details PDF Video Code Project

[BuildSys'19] Heterogeneous Transfer Learning for Thermal Comfort Modeling

Weizheng Hu, Yong Luo, Zongqing Lu, and Yonggang Wen

In Proceedings of ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys), November 13-14, 2019. (Acceptance Rate: 31%=⁴⁰⁄₁₃₁)

Details PDF Project

[NIPS'18] Learning Attentional Communication for Multi-Agent Cooperation

Jiechuan Jiang and Zongqing Lu

Thirty-Second Annual Conference on Neural Information Processing Systems (NIPS), December 3-8, 2018. (Acceptance Rate: 21%=¹⁰¹¹⁄₄₈₅₆)

Details PDF Video Project

[INFOCOM'18] A Computing Platform for Video Crowdprocessing Using Deep Learning

Zongqing Lu, Kevin Chan, and Thomas La Porta

In Proceedings of IEEE International Conference on Computer Communications (INFOCOM), April 15-19, 2018. (Acceptance Rate: 19%=³⁰⁹⁄₁₆₀₆)

Details PDF Slides Project Journal Version

[MM'17] Modeling the Resource Requirements of Convolutional Neural Networks on Mobile Devices

Zongqing Lu, Swati Rallapalli, Kevin Chan, and Thomas La Porta

In Proceedings of ACM International Conference on Multimedia (MM), October 23-27, 2017. (Acceptance Rate: 28%=¹⁹¹⁄₆₇₅)

Details PDF Project Journal Version

[ICNP'16] On-demand Video Processing in Wireless Networks

Zongqing Lu, Kevin Chan, Rahul Urgaonkar, and Thomas La Porta

In Proceedings of IEEE International Conference on Network Protocols (ICNP), November 8-11, 2016. (Acceptance Rate: 20%=⁴⁶⁄₂₂₉)

Details PDF Project Journal Version

[INFOCOM'16] Cooperative Data Offloading in Opportunistic Mobile Networks

Zongqing Lu, Xiao Sun, and Thomas La Porta

In Proceedings of IEEE International Conference on Computer Communications (INFOCOM), April 10-15, 2016. (Acceptance Rate: 18%=³⁰⁰⁄₁₆₄₄)

Details PDF Slides Project Best-in-Session Presentation Award Journal Version

[PerCom'16] Networking Smartphones for Disaster Recovery

Zongqing Lu, Guohong Cao, and Thomas La Porta

In Proceedings of IEEE International Conference on Pervasive Computing and Communications (PerCom), March 14-18, 2016. (Acceptance Rate: 12%=²⁰⁄₁₆₈)

Details PDF Slides Project NSF Travel Grant Award Journal Version

[UbiComp'15] SymDetector: Detecting Sound-Related Respiratory Symptoms Using Smartphones

Xiao Sun, Zongqing Lu, Wenjie Hu, and Guohong Cao

In Proceedings of ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), September 7-11, 2015. (Acceptance Rate: 24%=⁹³⁄₃₉₄)

Details PDF Project

[ICCCN'15] Task Allocation for Mobile Cloud Computing in Heterogeneous Wireless Networks

Zongqing Lu, Jing Zhao, Yibo Wu, and Guohong Cao

In Proceedings of International Conference on Computer Communications and Networks (ICCCN), August 3-6, 2015. (Acceptance Rate: 25%=⁸⁸⁄₃₅₂)

Details PDF

[PerCom'15] Targeted Vaccination Based on a Wireless Sensor System

Xiao Sun, Zongqing Lu, Xiaomei Zhang, Marcel Salathe, and Guohong Cao

In Proceedings of IEEE International Conference on Pervasive Computing and Communications (PerCom), March 23-27, 2015. (Acceptance Rate: 15%=²⁹⁄₁₉₆)

Details PDF Project

[SECON'14] Skeleton Construction in in Mobile Social Networks: Algorithms and Applications

Zongqing Lu, Xiao Sun, Yonggang Wen, and Guohong Cao

In Proceedings of IEEE International Conference on Sensing, Communication and Networking (SECON), June 30-July 3, 2014. (Acceptance Rate: 20%=⁶⁸⁄₃₄₂)

Details PDF Project

[INFOCOM'14] Information Diffusion in Mobile Social Networks: The Speed Perspective

Zongqing Lu, Yonggang Wen, and Guohong Cao

In Proceedings of IEEE International Conference on Computer Communicaitons (INFOCOM), April 27-May 2, 2014. (Acceptance Rate: 19%=³²⁰⁄₁₆₄₅)

Details PDF Project Journal Version

[PerCom'13] Community Detection in Weighted Networks: Algorithms and Applications

Zongqing Lu, Yonggang Wen, and Guohong Cao

In Proceedings of IEEE International Conference on Pervasive Computing and Communications (PerCom), March 18-22, 2013. (Acceptance Rate: 15%=²⁰⁄₁₆₈)

Details PDF Project Journal Version

Journals

[RAL] DemoHLM: From One Demonstration to Generalizable Humanoid Loco-Manipulation

Yuhui Fu, Feiyang Xie, Chaoyi Xu, Jing Xiong, Haoqi Yuan, Zongqing Lu

IEEE Robotics and Automation Letters, 2026.

Details PDF Project

[RAL] CROSSER: Learning Generalizable Humanoid Locomotion Through Inverse Dynamics-Guided Cross-Simulator Adaptation

Zepeng Wang, Xiaochuan Shi, Ziluo Ding, Yuxuan Wang, Zhenguo Sun, Chao Ma and Zongqing Lu

IEEE Robotics and Automation Letters, vol. 10, no. 12, pp. 13336-13343, 2025

Details PDF Project

[TMLR] SELU: Self-Learning Embodied Multimodal Large Language Models in Unknown Environments

Boyu Li, Haobin Jiang, Ziluo Ding, Xinrun Xu, Haoran Li, Dongbin Zhao, and Zongqing Lu

Transactions on Machine Learning Research (TMLR), 2025

Details PDF Project

[TMLR] $f$-Divergence Policy Optimization in Fully Decentralized Cooperative MARL

Kefan Su and Zongqing Lu

Transactions on Machine Learning Research (TMLR), 2025

Details PDF Project

[JAIR] Understanding What Affects the Generalization Gap in Visual Reinforcement Learning: Theory and Empirical Evidence

Jiafei Lyu, Le Wan, Xiu Li, and Zongqing Lu

Journal of Artificial Intelligence Research (JAIR), 2024

Details PDF Project

[TMLR] A Fully Decentralized Surrogate for Multi-Agent Policy Optimization

Kefan Su and Zongqing Lu

Transactions on Machine Learning Research (TMLR), 2024

Details PDF Code Project

[TPAMI] Bi-DexHands: Towards Human-Level Bimanual Dexterous Manipulation

Yuanpei Chen, Yiran Geng, Fangwei Zhong, Jiaming Ji, Jiechuang Jiang, Zongqing Lu, Hao Dong, Yaodong Yang

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023

Details PDF Code Project

[TMLR] A Survey on Transformers in Reinforcement Learning

Wenzhe Li, Hao Luo, Zichuan Lin, Chongjie Zhang, Zongqing Lu, and Deheng Ye

Transactions on Machine Learning Research (TMLR), 2023.

Details PDF Project

[TKDE] MetaVIM: Meta Variationally Intrinsic Motivated Reinforcement Learning for Decentralized Traffic Signal Control

Liwen Zhu, Peixi Peng, Zongqing Lu, Yonghong Tian

IEEE Transactions on Knowledge and Data Engineering (TKDE), vol. 35, no. 11, pp 11570-11584, 2023.

Details PDF Code Dataset Project

[TCAD] Asynchronous Reinforcement Learning Framework and Knowledge Transfer for Net Order Exploration in Detailed Routing

Yibo Lin, Tong Qu, Zongqing Lu, Yajun Su, and Yayi Wei

IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, vol 41, no. 9, pp 3132 - 3142, 2022

Details PDF Project

[TBME] Towards More Accurate Automatic Sleep Staging via Deep Transfer Learning

Huy Phan, Oliver Chen, Philipp Koch, Zongqing Lu, Ian McLoughlin, Alfred Mertins, and Maarten De Vos

IEEE Transactions on Biomedial Engineering, vol. 68, no. 6, pp. 1787-1798, 2021.

Details PDF Project

[TMC] PicSys: Energy-Efficient Fast Image Search on Distributed Mobile Networks

Noor Felemban, Fidan Mehmeti, Hana Khamfroush, Zongqing Lu, Swati Rallapalli, Kevin Chan, and Thomas La Porta

IEEE Transactions on Mobile Computing, vol. 20, no. 4, pp. 1574-1589, 2021.

Details PDF Project

[TMC] Augur: Modeling the Resource Requirements of ConvNets on Mobile Devices

Zongqing Lu, Swati Rallapalli, Kevin Chan, Shiliang Pu, and Thomas La Porta

IEEE Transactions on Mobile Computing, vol. 20, no. 2, pp. 352-365, 2021

Details PDF Project

[TON] NetVision: On-demand Video Processing in Wireless Networks

Zongqing Lu, Kevin Chan, Rahul Urgaonkar, Shiliang Pu, and Thomas La Porta

IEEE/ACM Transactions on Networking, vol 28, no. 1, pp. 196-209, 2020

Details PDF Project

[TMC] CrowdVision: A Computing Platform for Video Crowdprocessing Using Deep Learning

Zongqing Lu, Kevin Chan, Shiliang Pu, and Thomas La Porta

IEEE Transactions on Mobile Computing, vol.18, no. 7, pp. 1513-1526, 2019

Details PDF Project

[TON] Cooperative Data Offload in Opportunistic Networks: From Mobile Devices to Infrastructure

Zongqing Lu, Xiao Sun, and Thomas La Porta

IEEE/ACM Transactions on Networking, vol. 25, no. 6, pp. 3382-3395, 2017.

Details PDF Project

[TMC] TeamPhone: Networking Smartphones for Disaster Recovery

Zongqing Lu, Guohong Cao, and Thomas La Porta

IEEE Transactions on Mobile Computing, vol. 16, no. 12, pp. 3554-3567, 2017.

Details PDF Project

[TMC] Towards Information Diffusion in Mobile Social Networks

Zongqing Lu, Yonggang Wen, Weizhan Zhang, Qinghua Zheng, and Guohong Cao

IEEE Transactions on Mobile Computing, vol. 15, no. 5, pp. 1292-1304, 2016.

Details PDF Project

[TPDS] Algorithms and Applications for Community Detection in Weighted Networks

Zongqing Lu, Xiao Sun, Yonggang Wen, Guohong Cao, and Thomas La Porta

IEEE Transactions on Parallel and Distributed Systems, vol. 26, no. 4, pp. 2916-2916, 2015.

Details PDF Project

[JSAC] Toward Efficient Distributed Algorithms for In-network Binary Operator Tree Placement in Wireless Sensor Networks

Zongqing Lu, Yonggang Wen, Fan Rui, Su-Lim Tan, and Jit Biswas

IEEE Journal on Selected Areas in Communications, vol. 31, no. 4, pp. 743-755, 2013.

Details PDF

Workshops

Towards General Computer Control: A Multimodal Agent for Red Dead Redemption II as a Case Study

Weihao Tan, Ziluo Ding, Wentao Zhang, Boyu Li, Bohan Zhou, Junpeng Yue, Haochong Xia, Jiechuan Jiang, Longtao Zheng, Xinrun Xu, Yifei Bi, Pengjie Gu, Xinrun Wang, Börje F Karlsson, Bo An, and Zongqing Lu

ICLR 2024 Workshop on LLM Agents.

Details PDF Project

Skill Reinforcement Learning and Planning for Open-World Long-Horizon Tasks

Haoqi Yuan, Chi Zhang, Hongcheng Wang, Feiyang Xie, Penglin Cai, Hao Dong, Zongqing Lu

NeurIPS 2023 Workshop on Foundation Models for Decision Making.

Details PDF Code Project

MTLight: Efficient Multi-Task Reinforcement Learning for Traffic Signal Control

Liwen Zhu, Peixi Peng, Zongqing Lu, and Yonghong Tian

ICLR 2022 Workshop on Gamification and Multiagent Solutions.

Details PDF Dataset Project