When Does Model-Based Control Pay Off?
Fig 13
Comparison of trade-off between model-based control and reward across different paradigms.
We calculated the volume under the surface of coefficients of the linear relationship between the weighting parameter and the reward rate for each of the paradigms in the section above. Across these simulations, we progressively included elements that strengthened the relationship, as summarized in this figure.