Udacity Simulator

A copy of the simulator binary can be found on Google Drive.

Udacity Gym Environment

Install Python dependencies using pip:

pip3 install -r requirements.txt

Udacity Gym

Create a Gym:

from udacity.gym import UdacityGym
# Start Simulator
simulator = UdacitySimulator(
    sim_exe_path=simulator_exe_path,
    host=host,
    port=port,
)
simulator.start()

# Create Gym
env = UdacityGym(
    simulator=simulator,
    track="lake",
)

Run an experiment:

observation, _ = env.reset(track="lake")

for _ in range(200):
    action = agent(observation)
    observation, reward, terminated, truncated, info = env.step(action)