https://marcgbellemare.info/en/publications/farebrother26compositional/2026-01-01T00:00:00+00:00https://marcgbellemare.info/en/2026-01-01T00:00:00+00:00https://marcgbellemare.info/en/publications/2026-01-01T00:00:00+00:00https://marcgbellemare.info/en/publications/jhaveri25convergence/2025-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/leroux25tapered/2025-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/wiltzer24successor/2024-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/wiltzer24continuous/2024-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/rowland24quantile/2024-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/rahn24steering/2024-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/lelan23subspaces/2023-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/schwarzer23bigger/2023-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/lelan23bootstrapped/2023-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/roccapriore23electron/2023-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/taiga23investigating/2023-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/rahn23policy/2023-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/farebrother23proto/2023-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/doro23sample/2023-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/obandoceron23small/2023-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/rowland23benefits/2023-07-01T00:00:00+00:00https://marcgbellemare.info/en/books/2023-05-30T00:00:00+00:00https://marcgbellemare.info/en/books/distributional-rl/2023-05-30T00:00:00+00:00https://marcgbellemare.info/en/publications/bellemare23book/2023-04-01T00:00:00+00:00https://marcgbellemare.info/en/publications/wiltzer22hjb/2022-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/lelan22generalization/2022-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/agarwal22reincarnating/2022-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/tang22nature/2022-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/agarwal21contrastive/2021-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/agarwal21statistical/2021-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/lelan21metrics/2021-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/buckman21pessimism/2021-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/dabney21value/2021-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/amortila20distributional/2020-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/jain20algorithmic/2020-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/bellemare20loon/2020-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/taiga20benchmarking/2020-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/machado20count/2020-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/ghosh20representations/2020-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/mathewson20shaping/2020-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/bard20hanabi/2020-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/touati20zooming/2020-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/lyle19comparative/2019-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/bellemare19geometric/2019-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/such19atari/2019-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/gelada19deepmdp/2019-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/bellemare19distributional/2019-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/fedus19hyperbolic/2019-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/gelada19bootstrapping/2019-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/rowland19statistics/2019-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/amortila19metrics/2019-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/dadashi19value/2019-07-01T00:00:00+00:00https://marcgbellemare.info/en/blog/2019/hanabi-learning-environment/2019-02-03T00:00:00+00:00https://marcgbellemare.info/en/categories/2019-02-03T00:00:00+00:00https://marcgbellemare.info/en/tags/hanabi/2019-02-03T00:00:00+00:00https://marcgbellemare.info/en/tags/multiagent/2019-02-03T00:00:00+00:00https://marcgbellemare.info/en/tags/reinforcement-learning/2019-02-03T00:00:00+00:00https://marcgbellemare.info/en/categories/research/2019-02-03T00:00:00+00:00https://marcgbellemare.info/en/tags/2019-02-03T00:00:00+00:00https://marcgbellemare.info/en/blog/2019-02-03T00:00:00+00:00https://marcgbellemare.info/en/publications/rowland18analysis/2018-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/francoislavet18introduction/2018-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/taiga18approximate/2018-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/dabney18distributional/2018-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/castro18dopamine/2018-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/machado18revisiting/2018-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/schaul18barbados/2018-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/gruslys18reactor/2018-07-01T00:00:00+00:00https://marcgbellemare.info/en/blog/2017/classic-and-modern-rl/2017-12-10T00:00:00+00:00https://marcgbellemare.info/en/tags/deep-rl/2017-12-10T00:00:00+00:00https://marcgbellemare.info/en/categories/reinforcement-learning/2017-12-10T00:00:00+00:00https://marcgbellemare.info/en/tags/ale/2017-11-28T00:00:00+00:00https://marcgbellemare.info/en/tags/arcade-learning-environment/2017-11-28T00:00:00+00:00https://marcgbellemare.info/en/blog/2017/ale-0-6-release/2017-11-28T00:00:00+00:00https://marcgbellemare.info/en/publications/bellemare17distributional/2017-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/machado17laplacian/2017-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/graves17automatic/2017-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/ostrovski17count/2017-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/bellemare17cramer/2017-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/bellemare16increasing/2016-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/harutyunyan16qlambda/2016-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/munos16safe/2016-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/bellemare16unifying/2016-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/veness15compress/2015-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/bellemare15countbased/2015-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/mnih15nature/2015-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/veness15online/2015-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/bellemare14skip/2014-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/bellemare13bayesian/2013-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/bellemare13fast/2013-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/bellemare13arcade/2013-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/bellemare12investigating/2012-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/bellemare12sketch/2012-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/ludvig11primer/2011-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/pineau07constructing/2007-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/bellemare07context/2007-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/bellemare07learning/2007-07-01T00:00:00+00:00https://marcgbellemare.info/en/publications/bellemare06cascade/2006-07-01T00:00:00+00:00https://marcgbellemare.info/en/contact/https://marcgbellemare.info/en/downloads/https://marcgbellemare.info/en/students/