Learning Reward Uncertainty in the Basal Ganglia
Fig 2
Changes in G and N for the AU model as a function of trial number.
Different rows correspond to different mean reward μr (indicated left of each row), and different columns correspond to different standard deviations of reward σr (indicated above each column). The rewards were sampled from a Gaussian distribution. Here, both G and N were initialized at 0, and we set α = 0.1. We have selected in order to make the figure easier to interpret, because then
, and hence in the middle row G and N approach σr. For each of the panels, the simulation was run 50 times, for 100 trials each.