MPE environemnts stuck with 25 max steps

[mariohevia]

The implementation does not have a way of assigning the max_steps when creating an MPE environment. I believe this is a really small change, but it needs to be made for every simple_*.py file.

In addition, the current implementation of the baseline IPPO for MPE use higher max_steps which makes the environment start over in a single update and there is no reset between updates. I suspect this is the case for other baseline algorithms.

[amacrutherford]

hey! on max_steps, have you tried changing this argument?

On the baselines, yes that is the case.

[mariohevia]

Hi, the argument that you mention is for the base class of the MPE environments and it is not accessible when creating one of the MPE environments.

For example, the class SimpleReferenceMPE does not have this argument and is set by default to 25 by the base class. I can change it afterwards calling something like env.max_steps=new_value but this is cumbersome and I feel that it should be possible to set it when creating the environment.

[amacrutherford]

Ah yep seen! I'll get this fixed ASAP :)