https://marcgbellemare.info/en/books/Recent content in Books on Marc G. BellemareHugoen© {year} Marc G. BellemareTue, 30 May 2023 00:00:00 +0000https://marcgbellemare.info/en/books/distributional-rl/Tue, 30 May 2023 00:00:00 +0000https://marcgbellemare.info/en/books/distributional-rl/<p><strong>Marc G. Bellemare, Will Dabney, Mark Rowland</strong> MIT Press, May 2023 · 384 pages · Adaptive Computation and Machine Learning series</p> <ul> <li><a href="https://mitpress.mit.edu/9780262048019/distributional-reinforcement-learning/">MIT Press page</a></li> <li><a href="https://www.distributional-rl.org/">Book website</a></li> <li><a href="https://direct.mit.edu/books/oa-monograph/5590/Distributional-Reinforcement-Learning">Open-access PDF</a></li> <li>ISBN (hardcover): 9780262048019 · ISBN (eBook): 9780262374019</li> </ul> <hr> <p>This is the first comprehensive guide to distributional reinforcement learning, providing a new mathematical formalism for thinking about decisions from a probabilistic perspective. Rather than computing expected values, the book focuses on how total reward behaves as a probability distribution — presenting core concepts, mathematical proofs, and algorithmic developments for characterising, computing, estimating, and making decisions based on random returns. Applications span finance, computational neuroscience, psychology, macroeconomics, and robotics.</p>