Automatic Adaptation to Fast Input Changes in a Time-Invariant Neural Circuit
Fig 3
Schematic neural networks implementing predictive coding, through feedforward (a) or feedback (b) inhibition.
Networks’ parameters are: (a) Feedforward: ,
. (b) Feedback: α, Γ. In both circuits, the unit that outputs pt is termed the principal cell, and the unit that outputs nt the interneuron. There are two synapses onto each interneuron: (1) its external input and (2) a representation of its internal dynamics (right of the dashed line). We can describe its internal dynamics in this way because the interneuron is a leaky integrator, i.e. its internal dynamics (Eq (8)) are an infinite sum of past outputs, discounted at each time step by a fixed multiplier. Therefore, they can be represented by a delayed input across a synapse, with a multiplicative discounting factor, as in (a) and (b).