Synaptic balancing: A biologically plausible local learning rule that provably increases neural network noise robustness without sacrificing task performance
Fig 2
The local computations underlying synaptic balancing.
Each synapse (indicated in teal) calculates a cost as a function of synaptic strength, as in (13). Neuron k receives signals of incoming synaptic cost ckj and outgoing synaptic cost cik (teal arrows from synapses to soma) and computes the difference gk as in (17). The signal gk then propagates outwards (purple arrows from soma to synapses) to modify the strength of incoming and outgoing synaptic connections, as in (18), such that the total incoming and total outgoing costs are eventually balanced in every neuron.