Robust and brain-like working memory through short-term synaptic plasticity
Fig 5
Results of the hyperparameter sweep across number of hidden neurons, parameter regularization strength, and activity regularization strength.
Each row corresponds to a different parameter regularization (1e-4,1e-3,1e-2). Each column corresponds to a different observed quantity (brain-likeness, structural robustness, process robustness). Each subplot is a 10x10 grid, corresponding to 10 possible hidden size / activity regularization configurations. Shown in each square of that grid is the most brain-like/robust network corresponding to that particular hyperparameter configuration. LSTM and GRU networks were excluded (see S8 Fig for corresponding figure when they are included). Each color corresponds to a different network.