EnvPool is a fast, asynchronous, and parallel RL environment library designed for scaling reinforcement learning experiments. Developed by SAIL at Singapore, it leverages C++ backend and Python frontend for extremely high-speed environment interaction, supporting thousands of environments running in parallel on a single machine. It's compatible with Gymnasium API and RLlib, making it suitable for scalable training pipelines.
Features
- Supports highly parallelized RL environment execution
- Uses C++ backend for ultra-fast simulation
- Compatible with Gym/Gymnasium and RLlib APIs
- Asynchronous stepping and reset for better throughput
- Supports a variety of classic control, Atari, and custom environments
- Easy integration with existing RL libraries for training
Project Samples
Categories
Reinforcement Learning LibrariesLicense
Apache License V2.0Follow EnvPool
You Might Also Like
Gen AI apps are built with MongoDB Atlas
MongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of EnvPool!