Working simplified version of Spinning Up that works on Windows + Pytorch (CPU)

[jchiwai]

Hi, I created a working streamlined version of the Pytorch SpinningUp algorithms where I removed the logging functionalities and MPI dependency. It works on my Windows PC using CPU only (only tested on HalfCheetah-v4 though)

Here are the minimal requirements:
Python 3.8.20 (+ itertools, copy)
Torch 2.4.1
Scipy 1.10.1
Gymnasium 0.29.1
MuJoCo 3.1.6
Numpy 1.24.3
Pillow 10.4.0

https://github.com/jchiwai/spinningup-simplified