BabyAI-Text: Reproducing the same game using seed parameter

[HRezaei]

I'm trying to re-run a specific game over and over again. Assuming that the name of the game and seed are enough to generate the same game, I'm getting a different rendered grid every time with the same parameters!

name_env = 'BabyAI-MixedTrainLocal-v0'
env = gym.make(name_env, seed=100)
env.reset()
image = env.render(mode='rgb_array')

I tried to put up a short code for reproducing the bug, but struggled with installing the packages on Google Colab. Anyway, below is the link, if you manage to run the very last block multiple times, you'll see it renders a different layout, even though the seed and game name are not changed.

https://colab.research.google.com/drive/156zH3Z6ZyEPRaR4v3tsW_CJmg-k0xA0B?usp=sharing

Is there any other parameter I need to fix in order to get the same game all the time?

[ClementRomac]

Hi,

This is weird indeed, let me try to figure out what is happening.

[ClementRomac]

I found two issues in the current code thanks to your example:

• BabyAI's generation is properly seeded
• The issue only happens when using our "Mixed" environments
• First, the task selection (i.e. whether the instruction should be GoTo, Pickup...) is not seeded
• Second, our generation for the PutNextTo tasks is not properly seeded as well

This should be pretty easy to fix as all the problems come from this file. I have a relatively low bandwidth this week, but I can try my best to propose a fix. Feel free to propose one otherwise :)