Name		Name	Last commit message	Last commit date
parent directory ..
4x3_grid_world_MC.ipynb		4x3_grid_world_MC.ipynb
L-Maze_MC.ipynb		L-Maze_MC.ipynb
README.md		README.md
assignment-frozen_lake.ipynb		assignment-frozen_lake.ipynb
frozen_lake_MC.ipynb		frozen_lake_MC.ipynb

README.md

Chapters 5: Monte Carlo Methods

Examples

Implementation of Monte Carlo ES: Monte Carlo prediction and control with exploring starts for the 4x3 grid world.
Monte Carlo prediction and control with exploring starts for Gymnasium's Frozen Lake Environment.
Monte Carlo prediction and control with exploring starts for the L-Maze.

Exercise

Implement Monte Carlo Control with an Epsilon-soft policy. Implement the algorithm an experiment with the Frozen Lake environment.

License

© 2026 Michael Hahsler. All code and documents in this repository are provided under Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) License.