import gym
if __name__ == "__main__":
env = gym.make("CartPole-v0")
env = gym.wrappers.Monitor(env, "recording")
total_reward = 0.0
total_steps = 0
obs = env.reset()
while True:
action = env.action_space.sample()
obs, reward, done, _ = env.step(action)
total_reward += reward
total_steps += 1
if done:
break
print("Episode done in %d steps, total reward %.2f" % (
total_steps, total_reward))
env.close()
env.env.close()
these codes are from :Maxim Lapan. Deep Reinforcement Learning Hands-On
when i run these code,i get this:'gym.wrappers' has no attribute 'Monitor'
i try to search on google to find answer,but i still have no idea about the way to solve the question.
it looks like they've changed the API and removed the 'Monitor'-wrapper (https://github.com/openai/gym/releases/tag/0.23.0).
You could either use the version of 'gym' from the book (0.15.3) (e.g.
pip install gym==0.15.3
) or you could use therender()
-method of the updated environment class (from v0.23.0).In the latter case you'd need to include
env.render()
into the while-loop: