Fig. 4From: Hierarchical intrinsically motivated agent planning behavior with dreaming in grid environmentsThe scheme of visit statistics evaluation. After n prediction TM steps the vector of column visits \(\nu _n\) is received. This vector is masked by clusters representations that gives \({\hat{\nu }}_n\). This vector represents the number of visits for each cluster after n steps from \(s_t\)Back to article page