Unifying Count-Based Exploration and Intrinsic Motivation

The room number in Montezuma's Revenge ranges from 00 to 23, and is stored at RAM address 0x83. This was used to generate the maps shown in the paper (email me if interested in reproducing these).