EnvPool is a fast, asynchronous, and parallel RL environment library designed for scaling reinforcement learning experiments. Developed by SAIL at Singapore, it leverages C++ backend and Python frontend for extremely high-speed environment interaction, supporting thousands of environments running in parallel on a single machine. It's compatible with Gymnasium API and RLlib, making it suitable for scalable training pipelines.

Features

  • Supports highly parallelized RL environment execution
  • Uses C++ backend for ultra-fast simulation
  • Compatible with Gym/Gymnasium and RLlib APIs
  • Asynchronous stepping and reset for better throughput
  • Supports a variety of classic control, Atari, and custom environments
  • Easy integration with existing RL libraries for training

Project Samples

Project Activity

See All Activity >

License

Apache License V2.0

Follow EnvPool

EnvPool Web Site

You Might Also Like
MongoDB Atlas runs apps anywhere Icon
MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of EnvPool!

Additional Project Details

Programming Language

C++

Related Categories

C++ Reinforcement Learning Libraries

Registered

2025-03-13