Fig. 18
From: Hierarchical intrinsically motivated agent planning behavior with dreaming in grid environments
Examples of four options used during the exhaustible resource experiment. The heat map visualizes a number of times the transition to a state was predicted during the execution of the corresponding option. Two small heat maps for each option: I is a probability to initialize an option in the corresponding state and \(\beta\)—terminate probability