Notable CleanRL-related projects: corl-team/CORL: Offline RL algorithm implemented in CleanRL style pytorch-labs/LeanRL: Fast optimized PyTorch implementation of CleanRL RL algorithms using CUDAGraphs ...

A PyPI package is not yet available. Just download and extract the zip package offered here. The zip package also includes some example files (as plain Python files and as Jupyter notebooks) ...