Skip to main content
Advertisement
  • Loading metrics

Combining sampling and attractor dynamics in spiking models of head direction systems

  • Vojko Pjanovic,

    Roles Formal analysis, Investigation, Methodology, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliations Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, Virginia, United States of America, Department of Machine Learning and Neural Computing, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, Netherlands

  • Jacob A. Zavatone-Veth,

    Roles Conceptualization, Investigation, Methodology, Writing – original draft, Writing – review & editing

    Affiliation Society of Fellows and Center for Brain Science, Harvard University, Cambridge, Massachusetts, United States of America

  • Paul Masset,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliations Department of Psychology, McGill University, Montréal, Québec, Canada, Mila - Quebec Artificial Intelligence Institute, Montréal, Québec, Canada

  • Sander W. Keemink ,

    Contributed equally to this work with: Sander W. Keemink, Michele Nardin

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Department of Machine Learning and Neural Computing, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, Netherlands

  • Michele Nardin

    Contributed equally to this work with: Sander W. Keemink, Michele Nardin

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    nardinm@janelia.hhmi.org

    Affiliation Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, Virginia, United States of America

Abstract

Neural populations can maintain stable representations of navigation-related variables while integrating uncertain sensory signals. Experimental evidence showed that the precision of head-direction (HD) representations in flies and mice depends on the reliability of sensory cues, highlighting the influence of input uncertainty in attractor-based neural circuits. How do neural dynamics maintain stability while computing under uncertainty? Here, we propose a spiking neural network that unifies two principles — stability through attraction and uncertainty through fluctuation — and reinterpret the HD circuit as an uncertainty-aware integrator rather than a deterministic compass. Specifically, the network uses sampling-based probabilistic inference, where a neural population represents input uncertainty by rapidly fluctuating among likely hypotheses about the world while preserving a stable representation of head direction along an attractor manifold. This formulation suggests why a classical HD “bump” becomes less precise, namely due to rapid fluctuations, reflecting the uncertainty in angular velocity inputs. Our implementation yields experimentally testable predictions: correlated subthreshold voltage fluctuations, multi-timescale nonlinear interaction patterns, and characteristic statistics of bump movement. By combining probabilistic inference with attractor dynamics within one single circuit, our framework suggests how neural populations across species can represent an estimate and its uncertainty through fluctuations while maintaining stability, which could be a general principle for uncertainty-aware computation in noisy biological systems.

Author summary

Animals rely on navigation for a broad repertoire of behaviors, including foraging, returning home, avoiding threats, finding mates, and moving between familiar locations; in turn, to enable efficient navigation, animals need to maintain an internal representation of navigational variables such as heading. Neural head-direction circuits are often modeled as attractor networks, which maintain a stable “bump” of neural activity representing orientation. However, real sensory inputs are noisy, such that animals must estimate how reliable those inputs are to guide their decision-making. We asked how one neural circuit could both maintain a stable head-direction estimate and represent uncertainty. We developed a spiking neural network model that combines attractor dynamics with sampling-based probabilistic inference. In the model, noisy angular-velocity inputs drive samples that are integrated over time into a head-direction estimate that remains constrained to a circular attractor. This means that fluctuations in the activity bump are not simply noise: they reflect uncertainty in the incoming motion signals. The model also explains how visual landmarks can recalibrate the head-direction representation according to cue reliability, and provides experimentally testable predictions regarding structured voltage correlations, multi-timescale interaction patterns, uncertainty-dependent bump movement, and skewed bump-velocity statistics. Our results suggest that combining attractor dynamics with probabilistic sampling allows neural circuits to represent both an estimate and its uncertainty, providing a general computational mechanism that bridges two traditionally separate frameworks for computation in noisy biological systems.

Introduction

Animals track their position and orientation as they navigate through uncertain and dynamic environments. To do so, neural populations maintain internal representations of navigational variables—such as head direction (HD) [1,2]—even in the face of noisy or conflicting sensory cues [35]. Across species, cue uncertainty modulates population-level HD representations, for example broadening an activity bump in flies and altering network gain and latent structure in mice [6,7]. In general, the brain faces the challenge of integrating uncertain inputs while maintaining coherent internal estimates of external variables and their uncertainties over time [811]. Here, we propose a spiking network that addresses this challenge and employ it to shed light on the HD system’s representation dynamics in the face of uncertainties across species.

When faced with uncertain inputs, neural circuits balance two demands: inferring the most likely external signals, potentially while tracking uncertainty [6,12], and maintaining stable, persistent outputs for computation and behavior [13]. Different computational perspectives have been used to describe these functions mechanistically. On the one hand, sampling-based probabilistic inference describes how neural variability can be harnessed to explore the posterior distribution over external signals. In sampling, neural variability is not merely noise, but it reflects a specific computation that generates a sequence of possible stimulus values whose statistics approximate the posterior. This has been used extensively to model the early stages of environmental stimulus processing [1428], and neural sampling-based mechanisms have accumulated substantial experimental support over the last decade [2933]. On the other hand, attractor network models explain how recurrent connectivity can stabilize neural activity patterns, supporting persistent representations of navigation variables such as head direction (HD) [13,3439]. Biologically, there is substantial evidence that attractor-like mechanisms are at play, with prominent examples in HD systems of rodents [40,41] and the central complex of the fruit fly [2,42,43].

How can an HD system represent a navigational variable while maintaining and relaying information about the uncertainty of sensory stimuli? In this work, we will consider the possibility that sampling-based inference and attractor dynamics might both be necessary to model higher-order navigation systems. While stochastic fluctuations have long been incorporated into attractor models of decision making [44], perceptual rivalry [45,46], and multistable memory [47,48], they are usually treated as a perturbation rather than as an explicit mechanism for probabilistic inference. On the other side, prior work has explored stochastic neural dynamics as a mechanism for sampling-based inference [10,18,24,29,30], but without explicitly incorporating structured continuous attractor manifolds as computational primitives. Here, we set out to construct a network in which: a) stochastic fluctuations play a functional role in implementing sampling-based inference; b) inferred quantities are integrated and attracted to a continuous attractor manifold; c) attractor dynamics are derived from a prior which represents the manifold; and d) input uncertainty is represented and broadcast downstream.

Starting from first principles of sampling with spikes [26] and attractor dynamics [49], we derive a spiking neural network model that combines the strengths of both computational paradigms: it uses stochastic voltage fluctuations to fully explore the probability distribution of sensory inputs, and recurrent connectivity to stabilize the integrated estimate on a continuous manifold. Using the HD system as a case study (Fig 1), we show that noise can serve as a computational resource: specifically, angular velocity signals encoded by noisy sensory neurons are continuously sampled, integrated over time, and constrained to evolve near a circular attractor representing head direction. Rather than focusing on the detailed anatomical implementation, here we focus on the high-level principles underlying HD computations: in particular, this framework proposes a novel view of navigation-related computations under uncertainty. Our HD model suggests a novel explanation of recent experimental data on HD dynamics under uncertainty [6,7], and provides testable predictions for subthreshold voltage correlations, connectivity motifs, and variability in bump movement.

thumbnail
Fig 1. Integrating noisy motion signals through sampling on an attractor.

(a) Angular velocity is encoded noisily by populations of neurons in different species (e.g., GLNO cells in fruit flies [50], brainstem’s dorsal tegmental nucleus (DTN) cells in rats [51]). The HD output activity lies on a circularly arranged set of neurons in the fruit fly’s brain [2], and on a circular manifold in a high space in the rat’s brain [41]. (b) For increasing noise levels on the encoding of the angular velocity, the posterior distribution will show more uncertainty. (c) Estimating true density and statistics through sampling (left line: true distribution; arrows: samples from true distribution; right line: samples histogram). (d) Angular velocity inputs are encoded as noisy Poisson spikes, which are in turn fed into a recurrent spiking neural network (SNN) that implements angular velocity sampling, integration, and attraction. The SNN represents the HD by linear readout, and is updated according to angular velocities sampled from the Poisson spikes. The readout will meander around a circular attractor, providing an immediate HD estimate as well as, implicitly, the input uncertainty encoded by the movement of the bump. Components of Fig 1A were created in BioRender. Nardin, M. (https://BioRender.com/x68r143) and (https://BioRender.com/w64d461) are licensed under CC BY 4.0.

https://doi.org/10.1371/journal.pcbi.1014577.g001

Results

A spiking network unifies sampling and attractor dynamics

To maintain an internal representation of an animal’s head direction (HD), an HD system must infer the head rotation velocity from noisy inputs [5052] and update the current HD estimate within circularity constraints [2,13,41] (Fig 1A). We modeled this process with a spiking network that performs probabilistic inference, expanding upon previous work [26,27,49,53,54], with the addition of an attractor-based integrator. The network receives angular velocity inputs from populations of noisy Poisson neurons that encode rotational motion. Noise makes it impossible to exactly recover the true latent variable; from a theoretical perspective, the best one can do is to consider a posterior distribution of possible angular velocities, with noise increasing uncertainty (Fig 1B). In contrast to classical attractor models that set aside or average out noise [34,37,38], our network explicitly treats population activity in short time windows as samples from an underlying probability distribution, a process called probabilistic sampling (Fig 1C, Box 1). Through local recurrent interactions, the network samples an estimate from the posterior distribution over angular velocity, integrates it over time, and attracts the activity pattern towards a circular manifold (Fig 1D). This combination allows the system to represent both the HD estimate and the stimulus encoding uncertainty (Fig 1E), providing a mechanistic bridge between probabilistic and dynamical views of HD computation.

Mechanisms for integrating velocity samples on an attractor

The HD circuit must transform angular velocity, , encoded through Poisson neurons following a distribution , into a coherent estimate of orientation, . Our model does this through local interactions by combining a sampling-based inference process with a stabilizing attractor manifold (Fig 1). Specifically, the network samples instantaneous rotational velocity from noisy inputs, and stabilizes the integrated HD estimate by attracting towards a circular manifold, where bump fluctuations encode stimulus uncertainty (Fig 1C). We implement sampling-based inference in spiking neural networks through Langevin sampling (Fig 2A), as proposed in previous work [26,55], which we extended to work with non-Gaussian distributions (Box 1, S1 Text).

thumbnail
Fig 2. Sampling-based integration of angular velocity on a circular manifold.

(a) Langevin dynamics allow one to sample from arbitrary probability distributions. This entails following the slope of the log distribution together with a source of stochasticity to promote exploration. In our networks, these terms are implemented via neuronal interactions and correlated voltage stochastic fluctuations, respectively. (b) In our implementation, the neural representation of HD consists of two variables x,y, linked to the angle via transformation and . Without a mechanism to pull the representation towards , the network readout can go to zero or diverge (see S6 Fig). Hence, we consider a specific prior to attract the network dynamics towards the circle. In this way, the network can explore two dimensions, as suggested in recent experiments [7]. (c) Top to bottom: rotational velocity ; noisy Poisson encoding of rotational velocity ; voltage V of a HD network with 8 neurons; HD network output spikes; HD network firing rates obtained by smoothing the spikes with an exponential kernel; network HD output vs. true angle. (d) HD representation drift measured as absolute angle difference of network output vs. true orientation during continuous clockwise turning at 5 rad/sec for low vs high input noise, implemented as different numbers of encoding neurons (1000 vs 5000), and averaged across 50 repetitions (solid line: mean; shaded area: 1STD). (e) Distribution of instantaneous bump movement for low- vs high-noise inputs for constant clockwise turning at 5 rad/sec. Overlay (black) true posterior distribution averaged over Poisson inputs.

https://doi.org/10.1371/journal.pcbi.1014577.g002

Box 1. Non-Gaussian sampling with Spike Coding Networks

Non-Gaussian distributions are important in neuroscience to explain various phenomena. For example, songbirds partially reject large auditory feedback perturbations, a phenomenon explained by non-Gaussian, heavy-tailed Bayesian models [56,57]. Similarly, in barn owls, prism-induced sensory conflicts produce adaptation that saturates or depends on gradual training, phenomena inconsistent with Gaussian cue integration [58,59].

In this paper, we use Spike Coding Networks (SCNs) to implement non-Gaussian sampling (S1 Fig). SCNs are a subset of Spiking Neural Networks that have the capability to embed dynamical systems in their network topology and reproduce the prescribed dynamics [53]. This network’s structure is fully derived from first principles and characterized by a combination of fast and slow recurrent connections, with a synaptic connectivity topology that ensures spikes occur only when the network state deviates from the target dynamical state. Probabilistic sampling was previously implemented in such SCNs as a dynamical system through Langevin Dynamics, as shown in [26,27,55].

A linear read-out of the network then represents a sample from a distribution , and over time converges to the correct distribution. However, all previous approaches were limited to purely Gaussian distributions.

Through the use of slow multiplicative synaptic interactions [49], we extended the computational capabilities to non-linear dynamical systems, which in turn allows for sampling from non-Gaussian distributions (S1C Fig). In the Appendix we explore the capability of these networks by sampling from high-dimensional and non-Gaussian distributions, including several multi-modal distributions, and analyze how sampling performance depends on the number of neurons, voltage timescales, and network weights (see S1 Text, S2 and S3 Figs).

The nonlinear extension to sampling from polynomial log-probabilities easily enables sampling-based inference for variables encoded by noisy Poisson neurons (S4 Fig), as is used for the networks in the main text, and also allows for the recovery of higher-order moments of the posterior distribution (S5 fig). The SCN sampling-based inference framework is flexible and can in principle be used for many other approaches besides head direction estimation. For example, it was previously used to study probabilistic systems for decision-making [28]. Our work extends these capabilities to non-Gaussian sampling, and can help deal with multimodal distributions and complex decision-making tasks. Finally, this approach could also be useful for neuromorphic systems that needs to efficiently and quickly estimate probability distributions and perform computations based on them.

We present the high-level steps of our derivations here and point the reader to the methods for a complete derivation. The fundamental computation that our network performs is to continuously update the HD estimate, , using the incoming spikes, , through approximate Bayesian filtering:

(1)

The first term on the right hand side, , represents the incoming angular velocity information, using , and the second term, , represents a prior over angles. In our implementation, we consider the angular representation in Cartesian coordinates and a small-angle approximation . Using discrete-time Langevin sampling on , we derive an update rule of the form:

(2)

If the gradient of is mostly driven by , this implementation effectively samples from the posterior over angular velocities given Poisson spikes . Implementing this method in any neural network requires: 1) dynamics, which follow the gradient of a probability distribution, implemented through neuronal interactions, and 2) stochasticity, to explore the entire probability landscape, implemented through correlated voltage fluctuations [6062] (Fig 2A). We implemented Eq 2 into a spike coding network, and obtained voltage dynamics of the form:

(3)

The network consists of representing spike trains, representing the filtered spike trains, and a few complementary components derived from first principles (see S1 Text):

  • Fast recurrent interactions (S1C Fig, top), specific to SCN networks and not related to the inference process, which allow the network to maintain an excitation/inhibition balance [53,54]. This timescale is consistent with AMPA and receptors, with rapid activation and decay [63].
  • Slow feedforward and recurrent interactions (S1C Fig, bottom), mediating linear and nonlinear computations, which implement the gradient of . In biology, this timescale is consistent with NMDA and receptors, with slow rise and longer-lasting activations [64,65]. The nonlinear recurrent interactions maintain a localized bump of activity near a circular manifold, providing a stable representation of head direction.
  • Finally, correlated voltage fluctuations , which are a high-dimensional projection of onto the neurons (S1D and S1E Fig), drive the network to explore the posterior distribution over angular velocities. These fluctuations allow the network to continually generate new probabilistic samples, which are then integrated into the evolving head-direction estimate.

The interplay between neuronal interactions and stochastic voltage fluctuations ensures that the network remains anchored to the circular attractor (Figs 2B and S6) while still reflecting sensory uncertainty in its moment-to-moment dynamics. As a baseline, this model reproduces several experimentally observed phenomena. Firstly, the network shows a localized “bump” of activity whose position correlates with the heading direction (Fig 2C). When velocity inputs are reliable, the bump moves smoothly and tracks the true head direction with high precision (Fig 2C). The network maintains a good HD estimate for a period of time but slowly loses the true orientation as the various sources of noise accumulate, reminiscent of biological studies [2,42]. When inputs are noisy or ambiguous, the inferred velocity samples become more variable, leading to faster deviations from true HD (Fig 2D). Furthermore, the average network activity is higher during periods of high angular velocity (S6D Fig), as previously shown [2]. Finally, this HD system can be implemented in very small networks (S7 Fig) [2,66]. Crucially, the movement of the bump implicitly encodes input uncertainty, with short-time bump velocities recovering the angular-velocity posterior (Fig 2E). This sampling-based inference formulation allows downstream areas to compute input uncertainty, or other high-order statistics of the posterior (S5 Fig). In the full HD network, posterior recovery depends on the regime of operation: when the attractor is too weak, the HD representation leaves the circular manifold (S6B and S6E Fig), leading to poor HD estimates; when it is too strong, bump motion is over-constrained and posterior variability is suppressed, leading to poor posterior estimates (S6E Fig).

In conclusion, across a range of parameters, the network maintains a stable circular representation while continuously integrating velocity samples. This results in trajectories that are both stochastic and structured, reminiscent of bump dynamics observed in fly and rodent HD systems [2,40]. Our model, therefore, suggests that stochasticity in HD circuits is not just noise superimposed on a deterministic attractor, but might represent a signature of probabilistic inference operating within an attractor manifold, and serves the purpose of relaying input uncertainty to downstream areas for further computation.

Visual reset through multimodal integration

Real HD systems have to cope with fluctuating sensory reliability and cues from multiple modalities [4,6,67]. To examine whether our framework deals with these challenges, we extended the model to incorporate additional input pathways and reset mechanisms.

Sampling-based inference is additive in log-probability, so additional inputs simply provide additional constraints on the inferred direction. When cues are consistent, the network rapidly aligns and stabilizes the head-direction estimate; when cues conflict, the network resolves them according to their reliability, producing larger variability in bump motion when the available information is ambiguous, yielding a broader posterior. This behavior does not require explicit tuning but rather emerges from the combination of multiple cues, each weighted according to its reliability, and the combined sampling and attraction process.

Visual cues realign the attractor through probabilistic biasing

In the absence of perfectly reliable inputs, uncertainty in sampled angular velocities leads to a gradual accumulation of bump drift. To mimic the role of stable landmarks observed in both flies and rodents, we introduce a secondary sensory population encoding the angular position of a visual anchor. A transient burst of activity from this population rapidly realigns the activity bump to the correct orientation, sharply reducing accumulated drift (Figs 3A, 3B, and S8). After this reset, the network resumes sampling-based integration of angular velocity as before. Importantly, this realignment mechanism does not overwrite the underlying sampling dynamics. Instead, it pushes the network state toward a more reliable region of the posterior by weighting the incoming visual anchor information based on its reliability.

thumbnail
Fig 3. Visual reset realigns the sampling-based attractor through multimodal integration.

(a) Schematic of the computational setting. The head-direction network integrates noisy angular velocity samples (yellow trace) through sampling-based inference, resulting in stochastic but bounded bump motion on a circular attractor. A transient visual anchor cue (red) provides an additional sensory inputs on orientation; both inputs are integrated according to their reliability. (b-c) Representative single trial dynamics during a reset event. During angular rotation, cue is encoded noisily by an external population of visual neurons when . Before cue onset, uncertainty in sampled angular velocities leads to a gradual drift of the inferred head direction. Activation of the visual anchor cue rapidly biases the network state toward the correct orientation, realigning the activity bump without disrupting ongoing sampling dynamics. After the reset, integration resumes with the same stochastic structure. Components of Fig 3A were created in BioRender. Nardin, M. (https://BioRender.com/x68r143) and (https://BioRender.com/w64d461) are licensed under CC BY 4.0.

https://doi.org/10.1371/journal.pcbi.1014577.g003

In flies, landmark alignment involves structured circuit interactions, plasticity, and experience-dependent remapping [2,52,68], whereas in mammals it is often described as landmark-driven realignment of head-direction tuning [1,67]. The dynamics produced by our model are reminiscent of external-cue realignment observed in rats, in which salient landmarks with high reliability rapidly override path-integration signals, realigning head-direction representations in both the anterior thalamic nuclei and postsubiculum [67]. Moreover, recent population-level recordings in mice show that head-direction dynamics during realignment transiently engage an additional latent dimension beyond the angular manifold [7]. Such higher-dimensional structure arises naturally in our framework and becomes particularly apparent during larger reset events, when the external sensory evidence quickly pushes the network towards the anchor orientation, temporarily overcoming the attraction towards the circle (S9 Fig).

These results demonstrate that the sampling-based attractor framework can accommodate biologically inspired computations, such as multimodal integration, and allows rapid realignment to reliable cues.

Physiological signatures of sampling in head direction systems

A central goal of our combining sampling-based inference with attractor dynamics in a single spiking circuit is to produce specific, experimentally testable predictions. These predictions arise from the implementation of the sampling process, the multiscale connectivity structure of the network, and the attractor stabilization; in turn, they map onto measurable features of real head-direction circuits, demonstrating the ability of this framework to inspire new experiments in biology.

Prediction 1: Structured subthreshold voltage correlations

The sampling process requires neurons to share structured sources of stochastic fluctuation. In our model, voltage noise is correlated across neurons according to their tuning similarity. Neurons with nearby preferred directions exhibit positively correlated subthreshold fluctuations, whereas neurons with opposite tuning show weak or negative correlations (Fig 4A). This pattern reflects the main underlying functional principle of our networks: shared voltage fluctuations enable coordinated exploration of the posterior distribution. This can be tested by computing cross-correlations between the voltages of nearby and distant cells and could be achieved experimentally, for example, in a fly navigating an artificial environment paired with voltage imaging of the central complex neurons [2,69,70], or head-fixed mice navigating in an artificial environment [70]. Moreover, given the absence of sensory stimuli during the larva/pupa stages of fruit fly development, one could study the dimensionality of neural activity, which will be driven by other areas’ inputs and other noisy sources, which taken altogether could be seen as structured voltage noise.

thumbnail
Fig 4. Experimentally testable predictions from networks performing HD computations through sampling.

(a) Correlated stochastic fluctuations predict specific patterns of subthreshold voltage correlations among neurons with similar tuning. Top: example voltage trace for dark green neuron. Around the circle: subthreshold voltage cross-correlations between the green neuron and the others in the network. Notice that neurons with opposite tuning exhibit negative subthreshold correlations. (b) Top: fast connections show nearest neighbor inhibition and long-range excitation, while slow connections show a classical nearest neighbor excitation and long-range inhibition. Bottom: short-time vs. long-time correlations in neural activity, measured on spiking activity convolved with a Gaussian kernel of 1ms vs. 100ms. (c) Left: decoded vs. true heading in a representative trial. At the dashed line, the outputs of the Poisson neurons encoding the angular velocity are “optogenetically inhibited”, effectuated in the model by reducing the neuronal gains in the population through scaling , after which the estimate drifts more. Right: grows after inhibition, showing that reduced input reliability increases bump jitter, leading to less reliable estimates; this is reflected in ensemble statistics, see S12 Fig. (d) Distribution of bump velocity for positive and negative angular velocity ( rad/sec). The variability in bump movement velocity reflects the uncertainty in the inferred angular velocity.

https://doi.org/10.1371/journal.pcbi.1014577.g004

Prediction 2: Multi-timescale interaction structure

The spiking model we present here, based on the theory of spike coding networks [53], separates computation across two distinct synaptic timescales, similar to previous implementations [26,27,49]. In our case, the fast connections, which operate on a timescale of a few milliseconds and ensure excitation-inhibition balance, show nearest-neighbor inhibition and long-range excitation. On the other hand, slow connections, which operate on the timescale of tens of milliseconds and implement the dynamics, show a ring-like topology with classical nearest neighbor excitation and long-range inhibition, reminiscent of what was used in previous computational studies [39] inspired by true biological connectivity [71] (Fig 4B, top). This is observable in the short-time versus long-time correlations in neural activity (Fig 4B, bottom), an analysis that could be carried out using ultra-fast calcium recording [72] or electrophysiology in the central complex of fruit fly, or with detailed knowledge of the timescales of interactions in a connectome [71]. Nonlinear interactions will act over slow timescales and constrain the activity to the desired manifold. These slower nonlinear interactions might be implemented through widespread peptidergic neuromodulation [73], and could be studied in a peptidergic connectome [74].

Prediction 3: Uncertainty-dependent bump movement

Because the network integrates samples of angular velocity, the motion of the bump reflects the variability of the sampled posterior rather than solely the mean of the input stream, potentially allowing downstream readers to estimate higher-order statistics of the underlying posterior distribution (S5 Fig). When sensory inputs are reliable, the bump jitters less and moves smoothly; when inputs are noisy or ambiguous, the inferred velocity samples vary more widely, producing larger and more irregular bump displacements (Fig 2E). These fluctuations are not signs of network failure; they reflect increased uncertainty about the inputs. The model links variability in bump speed and position to the statistical structure of incoming sensory spikes. This yields a direct, causal experimental test: optogenetically inhibiting the input population that conveys the angular velocity signal reduces the reliability of the encoded self-motion estimate and should therefore lead to more drift of the HD estimate and increased bump jitter (Figs 4C and S12), which is qualitatively in line with the bump broadening observed experimentally [6]. Our model explains this behavior not as degradation of the attractor, but as a functional expression of probabilistic inference operating within it.

Prediction 4: Asymmetries and skew in bump velocity distributions

Poisson-like sensory encoding does not, in general, produce symmetric posterior distributions over angular velocity. In particular, for low spike counts and nonlinear tuning curves, the resulting posterior is typically skewed (S1 Text). As a result, the inferred angular velocity exhibits asymmetric fluctuations, which translate into skewed distributions of bump velocity. This effect is especially pronounced at low input reliability, where the posterior is broader and more asymmetric. (Fig 4D). This prediction is tied to the sampling formulation, rather than structural requirements, and it is not expected from noiseless deterministic attractor models; in our network, reducing or removing the correlated voltage fluctuations reduced bump movement and leads to biased angular velocity estimates (S11 Fig). The prediction of skewed posteriors also differs from models in which fluctuations are treated as a perturbation of deterministic attractor dynamics, in that noise is typically symmetric and leads to less skew (S10 Fig). Assessing the skewness of fast bump movement might be feasible using fast imaging or electrophysiological measurements.

Discussion

Neural circuits maintain stable internal representations while preserving information about the uncertainty of inputs. We propose how these two requirements can be reconciled within a single spiking network by embedding sampling-based inference inside a continuous attractor. Concretely, we implemented inference as Langevin sampling of angular velocity from noisy spiking inputs, combined with a soft circular prior that stabilizes the integrated velocity vector inputs into a head direction (HD) estimate. This unifies two computations that are often treated separately: attractor dynamics that support persistent population codes, and probabilistic computation in which variability reflects uncertainty rather than being simple noise. While we do not claim that our model is a complete, circuit-level reproduction of any specific HD system, our goal is to identify requirements for sampling-based inference within attractor-based spiking circuits to inspire future experiments. As such, this model provides experimentally testable predictions related to the connectivity and neural activity correlations over different timescales, subthreshold inputs, and other bump kinematics measurements.

Head direction as an uncertainty-aware integrator

Classical ring attractor models of head direction typically treat angular velocity as a control signal that deterministically moves the bump, with noise introduced as a perturbation [35,37,38]. In contrast, we treat velocity inputs as noisy observations and cast decoding as an inference problem. The resulting dynamics can be understood as integrating samples from a posterior distribution over angular velocity while maintaining a stable circular representation of head direction. Under the assumption that neural dynamics are faster than behavioral dynamics, this reduces to integrating the posterior mean; at the same time, the movement of the bump preserves information about the uncertainty of the inputs, with the sampling formulation allowing for the computation of higher-order statistics of the posterior. Because the network samples from a posterior over angular velocity, increased variability in the bump trajectory corresponds to increased uncertainty in the self-motion signal being integrated. This suggests a potential functional role for these fluctuations: downstream circuits could use the temporal coherence of the HD representation as an implicit estimate of reliability, without requiring an explicit decoding of variance. More concretely, such fluctuations could support reliability-dependent cue integration. Increased bump variability would indicate that path integration is unreliable, favoring stronger weighting of external cues during reorientation, while stable dynamics would indicate high-confidence self-motion integration. In this way, the temporal statistics of HD activity could serve as an implicit reliability signal for downstream navigation circuits.

This perspective differs from approaches that explicitly track a variance-like quantity. For example, a Bayesian ring-attractor formulation based on a circular Kalman filter predicts that uncertainty/variance is reflected in bump amplitude and that direction selectivity should progressively decrease in the absence of visual inputs [75]. In contrast, in our model, increased uncertainty primarily manifests as an increased bump movement driven by the sampling process, while the instantaneous (ms) bump profile remains fairly constant. In flies, the HD bump can remain stable in darkness without losing direction selectivity [2,39,52], yet recent work reported bump width broadening under cue conflict and uncertainty [6]. These observations can be reconciled within our framework: increased uncertainty produces larger excursions of the bump trajectory, which can broaden the time-averaged ( ms) population activity even when the instantaneous bump shape is stable. Consistent with experimental reports, our simulations also reproduce hallmark features of head-direction dynamics, including increased activity during fast rotations and progressive loss of absolute orientation in darkness [2,52], and they achieve accurate integration with relatively small networks, consistent with compact insect circuits and recent theoretical results [39,76]. Finally, recent population-level recordings in mice suggest that HD networks during realignment explore a second dimension, beyond the circular manifold [7], which arises naturally in our model during cue-driven correction, due to the fact that we implemented velocity vector integration with a soft 2D circular prior, and rapid realignment forces the network to deviate from the vicinity of the circle briefly.

Feasibility of implementation and predictions

The model is theoretically derived from first principles, providing clear dependencies between aspects of the model and consequent phenomena and predictions. Implementing Langevin sampling requires two ingredients: (i) a drift term proportional to gradients of a log-probability and (ii) structured fluctuations that drive exploration of the distribution. In our networks, the drift term is generally nonlinear and can be implemented using multiplicative interactions [49]. Such nonlinearities can arise from dendritic mechanisms and synaptic integration, and they can also be approximated using additional populations or learned nonlinear function approximators [7780]. The stochastic component requires shared fluctuations, such as correlated subthreshold activity and shared variability, which are widely observed and provide a plausible biological substrate [60,61,81]. Our contribution is not simply to add stochasticity to an attractor network, as noise has been incorporated into attractor models in several contexts [4448]. Instead, we assign a functional role to neural variability within attractors through a principled sampling-based inference method. The computation we implemented is Langevin sampling with a soft circular constraint, and we used the theory of spike coding networks (SCNs), which offer an analytical solution to embedding low-dimensional dynamics into a spiking neural network [26,27,53,54]. Other implementations can, in principle, approximate the same drift and diffusion terms using alternative spiking frameworks or learning-based approaches, including the Neural Engineering Framework or recurrent networks with learned nonlinearities [79,80,82,83]. This distinction matters for interpretation of the physiological predictions: some follow from the sampling process, such as subthreshold voltage correlations, uncertainty-dependent bump movement statistics, and skewed statistics of inferred velocities, whereas others depend on the particular SCN implementation, such as distinct fast and slow interactions. Overall, the model’s interpretability makes the dependencies between model components and their associated phenomenology explicit, allowing causes and effects to be cleanly separated.

Relation to previous work

Several previous works have described functional roles for spiking variability in recurrent dynamics. For example, variability can stabilize bistable states in balanced spiking networks with nonlinear synaptic transmission [84], and can support nonlinear dynamics in fluctuation-driven networks of winner-take-all units [85]. Our framework is complementary: rather than treating variability as a mechanism for stabilizing or generating nonlinear dynamics, we use correlated voltage fluctuations to implement posterior sampling.

Our framework connects and extends two active lines of research. First, multiple spiking models have implemented ring-attractor dynamics for head direction in both insects and mammals, often aiming to capture circuit anatomy and deterministic bump updates [86,87]. Second, sampling-based probabilistic computation has been implemented in spiking networks using MCMC-like dynamics or Langevin samplers [2022,26,27]. Our contribution is to show how sampling-based inference can be embedded within a continuous attractor so that the circuit simultaneously maintains a stable representation and encodes uncertainty through sampling dynamics.

Outlook

We have explored how sampling-based computations and attractor dynamics can be implemented within spiking neural networks, specifically in the case of the HD system. This work supports the proposition of sampling-based methods as a viable and powerful framework for neural computation in non-sensory brain areas, and in turn offers testable hypotheses for experimental and computational neuroscience. Future work can extend these ideas to higher-dimensional manifolds (e.g., toroidal representations for grid-cell dynamics) and other task domains (e.g., decision making), incorporate plasticity to learn or approximate nonlinear interactions, and compare predicted subthreshold and population-level statistics to experimental data to shed light on probabilistic computations in the brain.

Materials and methods

Here, we highlight the main formalism for deriving head-direction representation by inferring angular velocity and integrating it onto an attractor, and the implementation thereof into an SCN; for a didactic build-up of the methodology, see the Appendix.

HD representation through integration of sampling-based inferred angular velocity

We want our network to represent the current head direction (HD), , which is updated by combining the previous HD estimate, and the noisily encoded angular velocity signal, , provided by the external neural population. We formalize this requirement in a probabilistic sense, considering

(4)

This probability can be decomposed using Bayes’ rule:

(5)

We consider the case where the external population input, , depends only on the change in angle, , and assume that

(6)

such that Eq 5 becomes

(7)

The term will inform the HD system about the angular velocity through Poisson spikes , while the term will implement a prior, which can take different forms, as described below.

Consider first Langevin sampling in : assume that , where we use to denote the vector containing all weights associated with each Poisson input neurons, and a flat prior :

(8)(9)(10)

where . Denote , then, assuming and rearranging, we obtain

(11)

This equation could be implemented in a SCN, see S1 Text, but would suffer from angular wraparound issues at the boundary. To avoid this problem, we will adopt a formalism, as explained below.

Softening of circular constraints and shift to Cartesian coordinates

To avoid angular wraparound issues, and allow for the exploration of a second dimension as suggested by [7], we consider the angular representation in x,y coordinates:

(12)

This will require us to soften the strict circular constraint that is intrinsic when using only . We still assume that knowing x,y will not inform us about the angular velocity, i.e., .

We assume that the angular velocity is well approximated in Cartesian coordinates by the small angle approximation

(13)

We consider a population of Poisson neurons responding to the angular velocity through a kernel and a soft ring prior of radius with form (Fig 4B and 4C). These choices allow us to rewrite Eq 6 as:

(14)

Taking the , we get

(15)

The exact form of the Langevin sampler will depend on the choice of the firing rate nonlinearity of the Poisson neurons. For example, using an exponential kernel

(16)

where is the neuronal gain, and taking the gradient , leads to

(17)

Considering the Langevin sampler in discrete time, and assuming that , one gets

(18)

where . Assuming small angles, we may write

(19)

and by moving the terms in to the left-hand side, simplifying, and again , we obtain the equation

(20)

This equation resembles a noisy angular velocity integrator informed by , with a nonlinear part that implements a soft circular constraint, whose strength can be regulated by an extra parameter , and takes the form of a limit cycle of radius [88]. This general procedure could be extended to more complicated examples, which we will explore below after considering the implementation of the equation in an SCN model.

HD representation through sampling-based inference and attractor dynamics in a SCN

The SCN model has the general form

(21)

where F specifies the target dynamics, which are tracked by the network and can be linearly read out from the spike rates through . This formalism has been treated for linear systems, i.e., is linear in [53], and has been adapted for sampling from Gaussian distributions [26]. We further extended this framework to perform sampling-based inference of non-Gaussian distributions through the use of multiplicative interactions in SCNs, which allow nonlinear dynamics such as [49]. By using multiplicative interactions in Eq 21, we can directly implement Eq 20 into an SCN, leading to the governing voltage equation:

(22)

where

(23)

with denoting the th row of , and

(24)

For completeness: is slow recurrent connectivity contributing to signal representation; is fast recurrent connectivity for maintaining excitation/inhibition balance; and , with , is projected noise for correlated voltage fluctuations. Note that in the main text we simplify the equation for readability, omitting the slow linear term and the damping factor .

Multimodal integration and possible reset mechanisms

The HD system receives both proprioceptive and allocentric cues, and it can reset towards a known landmark, which necessitates the integration of visual and angular velocity cues [2,35]. Consider an external input to the network, , that interacts with the other terms as in

(25)

and the prior is such that if , and otherwise.

A slightly more realistic example could entail an external input that encodes the direction of a known landmark, again at , noisily, such as and . In that case,

(26)

This can be implemented in as

(27)(28)

and in , assuming , as

(29)(30)

Supporting information

S1 Text. Extended methods. The extended methods contain the underlying derivations and additional details for the mathematical formulation presented in the Methods, as well as a convergence analysis for sampling distributions with varying parameters.

https://doi.org/10.1371/journal.pcbi.1014577.s001

(PDF)

S1 Fig. Spiking neural networks can sample from arbitrary distributions through a combination of nonlinear synaptic interactions and correlated voltage fluctuations.

https://doi.org/10.1371/journal.pcbi.1014577.s002

(PDF)

S2 Fig. Sampling from high non-Gaussian distributions in mSCNs.

https://doi.org/10.1371/journal.pcbi.1014577.s003

(PDF)

S3 Fig. Sampling behaviour and performance for various distributions.

https://doi.org/10.1371/journal.pcbi.1014577.s004

(PDF)

S4 Fig. Sampling-based inference of Poisson encoded angular velocity signals.

https://doi.org/10.1371/journal.pcbi.1014577.s005

(PDF)

S5 Fig. Sampling-based inference allows the computation of various statistics online on time-varying stimuli posterior distributions.

https://doi.org/10.1371/journal.pcbi.1014577.s006

(PDF)

S6 Fig. Constraining angular representations.

https://doi.org/10.1371/journal.pcbi.1014577.s007

(PDF)

S7 Fig. HD implementations in small vs large networks.

https://doi.org/10.1371/journal.pcbi.1014577.s008

(PDF)

S8 Fig. Performance of a visual reset mechanism.

https://doi.org/10.1371/journal.pcbi.1014577.s009

(PDF)

S9 Fig. Excursions from circular manifold.

https://doi.org/10.1371/journal.pcbi.1014577.s010

(PDF)

S10 Fig. Comparison of independent voltage noise vs correlated voltage fluctuations.

https://doi.org/10.1371/journal.pcbi.1014577.s011

(PDF)

S11 Fig. Removing correlated voltage fluctuation biases network posterior mean estimate.

https://doi.org/10.1371/journal.pcbi.1014577.s012

(PDF)

S12 Fig. Ensemble statistics for optogenetic inhibition experiment.

https://doi.org/10.1371/journal.pcbi.1014577.s013

(PDF)

Acknowledgments

We would like to express our gratitude to Ann Hermundstad, Brad Hulse, and Pavlo Bulanchuk for their insights and feedback on the project and the manuscript. We also acknowledge Shivam Chitnis, Farhad Pashakhanloo, Sandro Romani, Laura Grima, and William Podlaski for their valuable feedback on early versions of this manuscript. This work benefited from a research visit supported by the Janelia Visiting Scientist Program.

The cartoon of Drosophila melanogaster used throughout the figures, as well as the mouse cartoon, were created in BioRender: https://BioRender.com/x68r143, https://BioRender.com/w64d461.

References

  1. 1. Taube JS. The head direction signal: origins and sensory-motor integration. Annu Rev Neurosci. 2007;30:181–207. pmid:17341158
  2. 2. Seelig JD, Jayaraman V. Neural dynamics for landmark orientation and angular path integration. Nature. 2015;521(7551):186–91. pmid:25971509
  3. 3. Yoganarasimha D, Yu X, Knierim JJ. Head direction cell representations maintain internal coherence during conflicting proximal and distal cue rotations: comparison with hippocampal place cells. J Neurosci. 2006;26(2):622–31. pmid:16407560
  4. 4. Haberkern H, Chitnis SS, Hubbard PM, Goulet T, Hermundstad AM, Jayaraman V. Maintaining a stable head direction representation in naturalistic visual environments. BioRxiv. 2022:2022–05.
  5. 5. Mao D, Gu Y. Multisensory coding of self-motion and its contribution to navigation. Nat Rev Neurosci. 2025;26(11):715–32. pmid:40954320
  6. 6. Basnak MA, Kutschireiter A, Okubo TS, Chen A, Gorelik P, Drugowitsch J, et al. Multimodal cue integration and learning in a neural representation of head direction. Nat Neurosci. 2025;28(8):1729–40. pmid:40702322
  7. 7. Ajabi Z, Keinath AT, Wei X-X, Brandon MP. Population dynamics of head-direction neurons during drift and reorientation. Nature. 2023;615(7954):892–9. pmid:36949190
  8. 8. Knill DC, Pouget A. The Bayesian brain: the role of uncertainty in neural coding and computation. Trends Neurosci. 2004;27(12):712–9. pmid:15541511
  9. 9. Kepecs A, Uchida N, Zariwala HA, Mainen ZF. Neural correlates, computation and behavioural impact of decision confidence. Nature. 2008;455(7210):227–31. pmid:18690210
  10. 10. Fiser J, Berkes P, Orbán G, Lengyel M. Statistically optimal perception and learning: from behavior to neural representations. Trends Cogn Sci. 2010;14(3):119–30. pmid:20153683
  11. 11. Ma WJ, Jazayeri M. Neural coding of uncertainty and probability. Annu Rev Neurosci. 2014;37:205–20. pmid:25032495
  12. 12. Tessereau C, Xuan F, Jack RM, Dayan P, Dombeck D. Navigating uncertainty: reward location variability induces reorganization of hippocampal spatial representations. bioRxiv. 2025.
  13. 13. Khona M, Fiete IR. Attractor and integrator networks in the brain. Nat Rev Neurosci. 2022;23(12):744–66. pmid:36329249
  14. 14. Zemel RS, Dayan P, Pouget A. Probabilistic interpretation of population codes. Neural Comput. 1998;10(2):403–30. pmid:9472488
  15. 15. Ma WJ, Beck JM, Latham PE, Pouget A. Bayesian inference with probabilistic population codes. Nat Neurosci. 2006;9(11):1432–8. pmid:17057707
  16. 16. Kutschireiter A, Surace SC, Sprekeler H, Pfister J-P. Nonlinear Bayesian filtering and learning: a neuronal dynamics for perception. Sci Rep. 2017;7(1):8722. pmid:28821729
  17. 17. Aitchison L, Lengyel M. The Hamiltonian Brain: Efficient Probabilistic Inference with Excitatory-Inhibitory Neural Circuit Dynamics. PLoS Comput Biol. 2016;12(12):e1005186. pmid:28027294
  18. 18. Hennequin G, Aitchison L, Lengyel M. Fast Sampling-Based Inference in Balanced Neuronal Networks. In: Advances in Neural Information Processing Systems. vol. 27. Curran Associates, Inc.; 2014. https://papers.nips.cc/paper/2014/hash/a7d8ae4569120b5bec12e7b6e9648b86-Abstract.html
  19. 19. Zavatone-Veth JA, Masset P, Tong WL, Zak JD, Murthy VN, Pehlevan C. Neural Circuits for Fast Poisson Compressed Sensing in the Olfactory Bulb. Adv Neural Inf Process Syst. 2023;36:64793–828. pmid:40376274
  20. 20. Hoyer P, Hyvärinen A. Interpreting Neural Response Variability as Monte Carlo Sampling of the Posterior. In: Advances in Neural Information Processing Systems. vol. 15. MIT Press; 2002. https://proceedings.neurips.cc/paper_files/paper/2002/hash/a486cd07e4ac3d270571622f4f316ec5-Abstract.html
  21. 21. Buesing L, Bill J, Nessler B, Maass W. Neural dynamics as sampling: a model for stochastic computation in recurrent networks of spiking neurons. PLoS Comput Biol. 2011;7(11):e1002211. pmid:22096452
  22. 22. Pecevski D, Buesing L, Maass W. Probabilistic inference in general graphical models through sampling in stochastic networks of spiking neurons. PLoS Comput Biol. 2011;7(12):e1002294. pmid:22219717
  23. 23. Legenstein R, Maass W. Ensembles of spiking neurons with noise support optimal probabilistic inference in a dynamically changing environment. PLoS Comput Biol. 2014;10(10):e1003859. pmid:25340749
  24. 24. Zhang W-H, Wu S, Josić K, Doiron B. Sampling-based Bayesian inference in recurrent circuits of stochastic spiking neurons. Nat Commun. 2023;14(1):7074. pmid:37925497
  25. 25. Qi Y, Gong P. Fractional neural sampling as a theory of spatiotemporal probabilistic computations in neural circuits. Nat Commun. 2022;13(1):4572. pmid:35931698
  26. 26. Savin C, Denève S. Spatio-temporal Representations of Uncertainty in Spiking Neural Networks. Advances in Neural Information Processing Systems. vol. 27. Curran Associates, Inc.; 2014. https://proceedings.neurips.cc/paper_files/paper/2014/file/4e2545f819e67f0615003dd7e04a6087-Paper.pdf
  27. 27. Masset P, Zavatone-Veth JA, Connor JP, Murthy VN, Pehlevan C. Natural gradient enables fast sampling in spiking neural networks. Adv Neural Inf Process Syst. 2022;35:22018–34. pmid:37476623
  28. 28. Rullán BC, Savin C. A sampling-based circuit for optimal decision making. In: Advances in Neural Information Processing Systems. vol. 34. Curran Associates, Inc.; 2021. p. 14163–75. https://proceedings.neurips.cc/paper_files/paper/2021/hash/76444b3132fda0e2aca778051d776f1c-Abstract.html
  29. 29. Orbán G, Berkes P, Fiser J, Lengyel M. Neural Variability and Sampling-Based Probabilistic Representations in the Visual Cortex. Neuron. 2016;92(2):530–43. pmid:27764674
  30. 30. Echeveste R, Aitchison L, Hennequin G, Lengyel M. Cortical-like dynamics in recurrent circuits optimized for sampling-based probabilistic inference. Nat Neurosci. 2020;23(9):1138–49. pmid:32778794
  31. 31. Koblinger A, Fiser J, Lengyel M. Representations of uncertainty: where art thou? Current Opinion in Behavioral Sciences. 2021 Apr;38:150–62. https://www.sciencedirect.com/science/article/pii/S2352154621000577
  32. 32. Festa D, Aschner A, Davila A, Kohn A, Coen-Cagli R. Neuronal variability reflects probabilistic inference tuned to natural image statistics. Nat Commun. 2021;12(1):3635. pmid:34131142
  33. 33. Shrinivasan S, Lurz K-K, Restivo K, Denfield G, Tolias A, Walker E, et al. Taking the neural sampling code very seriously: A data-driven approach for evaluating generative models of the visual system. In: Advances in Neural Information Processing Systems 36, 2023. 21945–59. https://doi.org/10.52202/075280-0962
  34. 34. Amari S. Dynamics of pattern formation in lateral-inhibition type neural fields. Biol Cybern. 1977;27(2):77–87. pmid:911931
  35. 35. McNaughton BL, Chen LL, Markus EJ. “Dead reckoning,” landmark learning, and the sense of direction: a neurophysiological and computational hypothesis. J Cogn Neurosci. 1991;3(2):190–202. pmid:23972093
  36. 36. Ben-Yishai R, Bar-Or RL, Sompolinsky H. Theory of orientation tuning in visual cortex. Proc Natl Acad Sci U S A. 1995;92(9):3844–8. pmid:7731993
  37. 37. Zhang K. Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory. J Neurosci. 1996;16(6):2112–26. pmid:8604055
  38. 38. Skaggs WE, Knierim JJ, Kudrimoti HS, McNaughton BL. A model of the neural basis of the rat’s sense of direction. Adv Neural Inf Process Syst. 1995;7:173–80. pmid:11539168
  39. 39. Noorman M, Hulse BK, Jayaraman V, Romani S, Hermundstad AM. Accurate angular integration with only a handful of neurons; 2022. https://doi.org/10.1101/2022.05.23.493052
  40. 40. Taube JS, Muller RU, Ranck JB Jr. Head-direction cells recorded from the postsubiculum in freely moving rats. I. Description and quantitative analysis. J Neurosci. 1990;10(2):420–35. pmid:2303851
  41. 41. Chaudhuri R, Gerçek B, Pandey B, Peyrache A, Fiete I. The intrinsic attractor manifold and population dynamics of a canonical cognitive circuit across waking and sleep. Nat Neurosci. 2019;22(9):1512–20. pmid:31406365
  42. 42. Green J, Adachi A, Shah KK, Hirokawa JD, Magani PS, Maimon G. A neural circuit architecture for angular integration in Drosophila. Nature. 2017;546(7656):101–6. pmid:28538731
  43. 43. Kim SS, Rouault H, Druckmann S, Jayaraman V. Ring attractor dynamics in the Drosophila central brain. Science. 2017;356(6340):849–53. pmid:28473639
  44. 44. Wong K-F, Wang X-J. A recurrent network mechanism of time integration in perceptual decisions. J Neurosci. 2006;26(4):1314–28. pmid:16436619
  45. 45. Brascamp JW, van Ee R, Noest AJ, Jacobs RHAH, van den Berg AV. The time course of binocular rivalry reveals a fundamental role of noise. J Vis. 2006;6(11):1244–56. pmid:17209732
  46. 46. Moreno-Bote R, Rinzel J, Rubin N. Noise-induced alternations in an attractor network model of perceptual bistability. J Neurophysiol. 2007;98(3):1125–39. pmid:17615138
  47. 47. Amit DJ, Brunel N. Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. Cereb Cortex. 1997;7(3):237–52. pmid:9143444
  48. 48. Compte A, Brunel N, Goldman-Rakic PS, Wang XJ. Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. Cereb Cortex. 2000;10(9):910–23. pmid:10982751
  49. 49. Nardin M, Phillips JW, Podlaski WF, Keemink SW. Nonlinear computations in spiking neural networks through multiplicative synapses. Peer Community Journal. 2021;1.
  50. 50. Hulse BK, Stanoev A, Turner-Evans DB, Seelig JD, Jayaraman V. A rotational velocity estimate constructed through visuomotor competition updates the fly’s neural compass; 2023. http://biorxiv.org/lookup/doi/10.1101/2023.09.25.559373
  51. 51. Bassett JP, Taube JS, New Collective Author. Neural correlates for angular head velocity in the rat dorsal tegmental nucleus. J Neurosci. 2001;21(15):5740–51. pmid:11466446
  52. 52. Turner-Evans D, Wegener S, Rouault H, Franconville R, Wolff T, Seelig JD, et al. Angular velocity integration in a fly heading circuit. Elife. 2017;6:e23496. pmid:28530551
  53. 53. Boerlin M, Machens CK, Denève S. Predictive coding of dynamical variables in balanced spiking networks. PLoS Comput Biol. 2013;9(11):e1003258. pmid:24244113
  54. 54. Denève S, Machens CK. Efficient codes and balanced networks. Nat Neurosci. 2016;19(3):375–82. pmid:26906504
  55. 55. Grabska-Barwinska A, Beck J, Pouget A, Latham P. Demixing odors - fast inference in olfaction. In: Advances in Neural Information Processing Systems. vol. 26. Curran Associates, Inc.; 2013. https://papers.nips.cc/paper_files/paper/2013/hash/2bcab9d935d219641434683dd9d18a03-Abstract.html
  56. 56. Sober SJ, Brainard MS. Adult birdsong is actively maintained by error correction. Nat Neurosci. 2009;12(7):927–31. pmid:19525945
  57. 57. Zhou B, Hofmann D, Pinkoviezky I, Sober SJ, Nemenman I. Chance, long tails, and inference in a non-Gaussian, Bayesian theory of vocal learning in songbirds. Proc Natl Acad Sci U S A. 2018;115(36):E8538–46. pmid:30127024
  58. 58. Knudsen EI, Knudsen PF. Vision guides the adjustment of auditory localization in young barn owls. Science. 1985;230(4725):545–8. pmid:4048948
  59. 59. Linkenhoker BA, Knudsen EI. Incremental training increases the plasticity of the auditory space map in adult barn owls. Nature. 2002;419(6904):293–6. pmid:12239566
  60. 60. Lampl I, Reichova I, Ferster D. Synchronous membrane potential fluctuations in neurons of the cat visual cortex. Neuron. 1999;22(2):361–74. pmid:10069341
  61. 61. Poulet JFA, Petersen CCH. Internal brain state regulates membrane potential synchrony in barrel cortex of behaving mice. Nature. 2008;454(7206):881–5. pmid:18633351
  62. 62. Yarom Y, Hounsgaard J. Voltage Fluctuations in Neurons: Signal or Noise? Physiological Reviews. 2011 Jul;91(3):917
  63. 63. Wu SH, Ma CL, Kelly JB. Contribution of AMPA, NMDA, and GABA(A) receptors to temporal pattern of postsynaptic responses in the inferior colliculus of the rat. J Neurosci. 2004;24(19):4625–34. pmid:15140934
  64. 64. Otis TS, Mody I. Differential activation of GABAA and GABAB receptors by spontaneously released transmitter. J Neurophysiol. 1992;67(1):227–35. pmid:1348084
  65. 65. Gerstner W, Kistler WM, Naud R, Paninski L. Chapter 3: Single Neuron Models. In: Neuronal Dynamics. Cambridge University Press; 2014. https://neuronaldynamics.epfl.ch/online/Ch3.S1.html
  66. 66. Heinze S, Homberg U. Maplike representation of celestial E-vector orientations in the brain of an insect. Science. 2007;315(5814):995–7. pmid:17303756
  67. 67. Goodridge JP, Taube JS. Preferential use of the landmark navigational system by head direction cells in rats. Behav Neurosci. 1995;109(1):49–61. pmid:7734080
  68. 68. Kim SS, Hermundstad AM, Romani S, Abbott LF, Jayaraman V. Generation of stable heading representations in diverse visual scenes. Nature. 2019;576(7785):126–31. pmid:31748750
  69. 69. Abdelfattah AS, Zheng J, Singh A, Huang Y-C, Reep D, Tsegaye G, et al. Sensitivity optimization of a rhodopsin-based fluorescent voltage indicator. Neuron. 2023;111(10):1547-1563.e9. pmid:37015225
  70. 70. Hao YA, Lee S, Roth RH, Natale S, Gomez L, Taxidis J, et al. A fast and responsive voltage indicator with enhanced sensitivity for unitary synaptic events. Neuron. 2024;112(22):3680-3696.e8. pmid:39305894
  71. 71. Hulse BK, Haberkern H, Franconville R, Turner-Evans D, Takemura S-Y, Wolff T, et al. A connectome of the Drosophila central complex reveals network motifs suitable for flexible navigation and context-dependent action selection. Elife. 2021;10:e66039. pmid:34696823
  72. 72. Zhang Y, Rózsa M, Liang Y, Bushey D, Wei Z, Zheng J, et al. Fast and sensitive GCaMP calcium indicators for imaging neural populations. Nature. 2023;615(7954):884–91. pmid:36922596
  73. 73. Grossman CD, Cohen JY. Neuromodulation and Neurophysiology on the Timescale of Learning and Decision-Making. Annu Rev Neurosci. 2022;45:317–37. pmid:35363533
  74. 74. Wolff T, Eddison M, Chen N, Nern A, Sundaramurthi P, Sitaraman D, et al. Cell type-specific driver lines targeting the Drosophila central complex and their use to investigate neuropeptide expression and sleep regulation. bioRxiv. 2024 Oct:2024.10.21.619448. https://pmc.ncbi.nlm.nih.gov/articles/PMC11526984/
  75. 75. Kutschireiter A, Basnak MA, Wilson RI, Drugowitsch J. Bayesian inference in ring attractor networks. Proc Natl Acad Sci U S A. 2023;120(9):e2210622120. pmid:36812206
  76. 76. Honkanen A, Adden A, da Silva Freitas J, Heinze S. The insect central complex and the neural basis of navigational strategies. J Exp Biol. 2019;222(Pt Suppl 1):jeb188854. pmid:30728235
  77. 77. London M, Häusser M. Dendritic computation. Annu Rev Neurosci. 2005;28:503–32. pmid:16033324
  78. 78. Poirazi P, Brannon T, Mel BW. Pyramidal neuron as two-layer neural network. Neuron. 2003;37(6):989–99. pmid:12670427
  79. 79. Thalmeier D, Uhlmann M, Kappen HJ, Memmesheimer R-M. Learning Universal Computations with Spikes. PLoS Comput Biol. 2016;12(6):e1004895. pmid:27309381
  80. 80. Alemi A, Machens C, Deneve S, Slotine J-J. Learning Nonlinear Dynamics in Efficient, Balanced Spiking Networks Using Local Plasticity Rules. AAAI. 2018;32(1).
  81. 81. Faisal AA, Selen LPJ, Wolpert DM. Noise in the nervous system. Nat Rev Neurosci. 2008;9(4):292–303. pmid:18319728
  82. 82. Eliasmith C. A unified approach to building and controlling spiking attractor networks. Neural Comput. 2005;17(6):1276–314. pmid:15901399
  83. 83. Barak O, Romani S. Mapping Low-Dimensional Dynamics to High-Dimensional Neural Activity: A Derivation of the Ring Model From the Neural Engineering Framework. Neural Comput. 2021;33(3):827–52. pmid:33513322
  84. 84. Mongillo G, Hansel D, van Vreeswijk C. Bistability and spatiotemporal irregularity in neuronal networks with nonlinear synaptic transmission. Phys Rev Lett. 2012;108(15):158101. pmid:22587287
  85. 85. Pang R. Balanced state of networks of winner-take-all units. PLoS Comput Biol. 2025;21(6):e1013081. pmid:40498862
  86. 86. Song P, Wang X-J. Angular path integration by moving “hill of activity”: a spiking neuron model without recurrent excitation of the head-direction system. J Neurosci. 2005;25(4):1002–14. pmid:15673682
  87. 87. Kakaria KS, de Bivort BL. Ring Attractor Dynamics Emerge from a Spiking Model of the Entire Protocerebral Bridge. Frontiers in Behavioral Neuroscience. 2017 Feb;11. https://www.frontiersin.org/journals/behavioral-neuroscience/articles/10.3389/fnbeh.2017.00008/full
  88. 88. Strogatz S. Nonlinear dynamics and chaos: with applications to physics, biology, chemistry, and engineering. Repr. ed. Studies in nonlinearity. Cambridge, Mass: Westview Press; 2007.