White noise techniques have been used widely to investigate sensory systems in both vertebrates and invertebrates. White noise stimuli are powerful in their ability to rapidly generate data that help the experimenter decipher the spatio-temporal dynamics of neural and behavioral responses. One type of white noise stimuli, maximal length shift register sequences (m-sequences), have recently become particularly popular for extracting response kernels in insect motion vision. We here use such m-sequences to extract the impulse responses to figure motion in hoverfly lobula plate tangential cells (LPTCs). Figure motion is behaviorally important and many visually guided animals orient towards salient features in the surround. We show that LPTCs respond robustly to figure motion in the receptive field. The impulse response is scaled down in amplitude when the figure size is reduced, but its time course remains unaltered. However, a low contrast stimulus generates a slower response with a significantly longer time-to-peak and half-width. Impulse responses in females have a slower time-to-peak than males, but are otherwise similar. Finally we show that the shapes of the impulse response to a figure and a widefield stimulus are very similar, suggesting that the figure response could be coded by the same input as the widefield response.
Citation: Lee Y-J, Jönsson HO, Nordström K (2015) Spatio-Temporal Dynamics of Impulse Responses to Figure Motion in Optic Flow Neurons. PLoS ONE 10(5): e0126265. https://doi.org/10.1371/journal.pone.0126265
Academic Editor: Eric James Warrant, Lund University, SWEDEN
Received: November 20, 2014; Accepted: March 31, 2015; Published: May 8, 2015
Copyright: © 2015 Lee et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: All data files can be found at Dryad (http://dx.doi.org/10.5061/dryad.dm132).
Funding: This work was funded by the Swedish Research Council (VR, 2008-2933, 2012-4740) and US Air Force Research Laboratory (AFRL, FA9550-11-1-0349).
Competing interests: The authors have declared that no competing interests exist.
White-noise stimuli have been used successfully in visual research in many vertebrates and insects (e.g. [1–3]). White-noise stimuli are powerful in that they relatively rapidly provide the data needed to extract the spatio-temporal response dynamics to a particular stimulus. They have therefore been used to e.g. deduce the directional sensitivity of dragonfly ocellar neurons , to record the spatiotemporal dynamics of optic flow sensitive neurons in blowflies , and to map the receptive fields of primate retinal neurons .
White-noise techniques may treat the relationship between a given input (e.g. a stimulus) and the output (e.g. a biological response) as a time invariant linear system. An ideal linear system shows homogeneity and superposition . Time invariance means that a given stimulus produces an identical response regardless of when it is presented , homogeneity that the response doubles in amplitude if the stimulus doubles, and superposition that the response to two consecutive impulses can be predicted from the response to a single impulse.
In some systems it is necessary to introduce terms that account for additional nonlinearities (e.g. ), which may be static or dynamic. In other systems, including some biological ones, many underlying nonlinear processes combine in such a way that they produce linear responses within the limits of the experiment (e.g. ). Whether linear or non-linear, once the impulse response and the associated non-linearities (if any) of a system are indentified, in theory we can predict how the system will respond to any combination of such impulses, including complex combinations. However, since the impulse responses and non-linearities depend on the statistical properties of the stimulus [5, 10], perfect predictions are rarely possible.
Several different types of white-noise stimuli have been used in insect visual research. Examples include Brownian motion , pseudo-random white noise , and maximal length shift register sequences (m-sequences) [8, 11]. An m-sequence consists of a string of -1’s and +1’s, specifying the impulses of the stimulus, where +1 corresponds to an impulse of one polarity, and -1 to its opposite. Whereas an m-sequence appears random, it is a deterministic sequence. An m-sequence of the order n has a length of 2n-1, and has the following characteristics : 1) There are 2n-1 +1’s and 2n-1-1–1’s; 2) Every string of +1’s and -1’s of length n occurs only once; 3) The product of an m-sequence with a time-shifted copy of itself is the same m-sequence, but shifted. Recently, a double m-sequence technique has been used in quantitative fly behavior . In this case two visual stimuli controlled by two independent m-sequences are presented simultaneously, thus allowing the extraction of two impulse responses.
Many animals depend on motion vision cues for navigating in the surround, avoiding obstacles, or visualizing potential prey. One type of biologically important motion is the motion of a figure or feature moving independently of the background. Figure tracking behavior has been particularly well studied in flies and other insects, which orient towards vertically oriented, high-contrast features both during walking  and in flight . Human eye movements also orient towards salient features in the visual surround , but the behavior is not as robust as fly fixation of vertical bars in the fontal visual field .
In the third optic ganglion the fly brain houses lobula plate tangential cells (LPTCs ) with large receptive fields. The LPTCs can be broadly divided into a vertical system (VS) and a horizontal system (HS ). Whereas most dipteran flies have three HS cells, hoverflies have four . The fourth, hoverfly-unique HS neuron, HS North (HSN), has a remarkably narrow, frontally oriented receptive field . LPTC respond strongly to wide-field motion, but also to local, salient features in the surround. For example, blowfly HS neurons respond strongly to the translation of near-by features in optic flow reconstructed from real flight paths [21–23]. Hoverfly HS neurons have also been shown to respond strongly to salient vertical features within naturalistic panoramas .
We here use m-sequences to extract the impulse response of hoverfly HSN neurons to figure motion. We show that the impulse response to a high-contrast, vertical bar maintains its time-course, even when the figure is reduced in size, and that the time-to-peak does not vary significantly across the receptive field. However, we show that the response to a low-contrast figure has a significantly slower time-to-peak and a larger half-width. We further show that the impulse response in female HSN has a longer time-to-peak than in male HSN. Finally, we show that the shapes of the impulse responses to figure and widefield stimuli are similar.
Materials and Methods
Animals and electrophysiology
Hoverfly larvae (Eristalis spp.) were collected from cow dung at Cederholms Lantbruk. Adult flies were kept in a large net under a 12 h light/dark cycle, at ca. 22°C, and fed with pollen and sugar. At experimental time the hoverfly was immobilized with a bee’s wax and resin mixture. The fly’s head was tilted forward to gain access to the posterior back plate, where a hole was cut over the left lobula plate.
Sharp aluminosilicate electrodes were pulled on a P-1000 Brown-Flaming puller (Sutter Instruments, San Francisco) and filled with 2 M KCl. The electrodes had a typical tip resistance of 50–100 MΩ. The neural signal was amplified using a BA-03X amplifier (npi electronics, Germany) and 50 Hz electrical noise reduced with a HumBug (Quest Scientific, Canada). The signal was acquired at 10 kHz using a NiDAQ 16 bit data acquisition card (NI USB-6210, National Instruments, USA) and the data acquisition toolbox in Matlab (Mathworks, USA). HSN neurons were recorded intracellularly and identified based on their receptive field (Nordström et al., 2008).
The fly was placed 12–13 cm in front of a 160 Hz CRT monitor with a spatial resolution of 640 × 480 pixels, corresponding to ca. 100 × 75° of the hoverfly’s field of view. Visual stimuli were generated using flyfly (http://www.flyfly.se) with the Psychophysics toolbox in Matlab. The stimuli consisted of a 40 pixel wide bar (ca. 6°) or a full-screen background pattern. Both the bar and the background consisted of a random pattern of vertical white and black bars. A new pattern was generated before each trial, using Matlab’s random number generator to get values of 0 (black) or 1 (white). The stimuli were displayed at 100% or 10% contrast.
To quantify the impulse responses to preferred and anti-preferred direction motion in the resting neuron we displayed a stationary full-contrast bar on a mean luminance background. The bar jumped in the preferred or anti-preferred direction with an inter-jump interval of 1.25 s.
All other stimuli were controlled with sequences of non-stationary white noise (m-sequences, see e.g. [7, 25]). Each m-sequence was of the 8th order, thus having a total length of 28–1 (255) impulses. There are 16 possible m-sequence of the 8th order, which can be started at any of the 255 positions. Before each trial we chose one of these from a uniform distribution of pseudorandom numbers, and ran it at 160 Hz. Each m-sequence consisted of a string of -1’s and +1’s, specifying the 1 pixel (ca. 0.2°) velocity impulses of each stimulus in the preferred and anti-preferred direction, respectively.
For the spatio-temporal sensitivity the bar was displayed at 9 azimuthal positions, spaced 25 pixels apart (ca. 4°). Each start position was repeated 1–9 times (4.7 ± 0.6, mean ± std). Before and after each trial the screen was left at mean luminance for a minimum 3 s.
All data can be found at http://dx.doi.org/10.5061/dryad.dm132. Data were analyzed using Matlab (Mathworks, USA) and Prism (GraphPad Software, USA). We extracted the response kernels [h(t)] using the assumption that the neural response [y(t)] is related to the visual input [given by the m-sequence, x(t)], in the following way: where “*” indicates convolution and “t” time. The impulse response can thus be extracted using circular cross correlation of the neural response and the m-sequence (for step-by-step guides, see e.g. ). Here, we used the mathematical definition of circular cross correlation to extract the impulse response in Matlab. Since each experiment used a different m-sequence we first calculated the individual response kernels, before averaging the impulse responses across trials. In each neuron we then quantified the maximum amplitude, the half-width, and the time-to-peak from this impulse response.
For calculation of spatio-temporal sensitivity, bar impulse responses were interpolated across the 9 azimuthal locations using cubic interpolation.
Validation of the method
To predict the response to a new set of m-sequences we first calculated the average impulse responses for all available data from one neuron except for one trial. We used the averaged impulse response to predict the neural response to the excluded trial, by convolving the impulse response with the excluded trial’s m-sequence. We then calculated the mean percentage error (MPE) by comparing the predicted response and the measured response (as in ). To avoid overfitting the data we calculated the optimal length of the impulse response, i.e. the impulse response length that gives the minimal MPE. Return to baseline was calculated as the time it takes for the response to return to, and remain within, 1 standard deviation (sd) of the pre-stimulus membrane potential fluctuations.
We calculated the static non-linearity by comparing the measured neural responses with the predicted responses. Prediction values were first sorted in ascending order and then divided into groups with equal number of data points in each (as in ). We then calculated the mean of the prediction values and the mean of the measured responses within each group, through which we fitted a sigmoidal function:
The function was fitted using unconstrained nonlinear optimization. We quantified the impact of the non-linearity on the neural response by re-calculating the MPE after adding the non-linearity.
Throughout the text, n refers to the number of individual trials, and N to the number of animals, where NHSN = Nanimals. All values are given as mean ± sd unless otherwise indicated.
Using m-sequences in lobula plate tangential cells
M-sequences can be used to extract the impulse response kernels to visual stimuli . They have recently been used extensively in quantitative behavior (e.g. [9, 27]), but can also be used to measure neural responses . We here use an m-sequence to control the motion of a full-contrast, randomly striped, vertical bar. M-sequences consist of a series of +1’s and -1’s, which are here used to control a figure’s impulse jumps in the neuron’s preferred (left) and anti-preferred direction (right), respectively (Fig 1Ai). The cumulative sum of the series of impulses in the m-sequence thereby describes the relative position of the bar (Fig 1Aii) on the screen over time (Fig 1Aiii).
A. i) Schematic diagram of an m-sequence, consisting of a string of +1’s and -1’s. ii) In our experiments, the cumulative sum of the m-sequence describes the relative position of a vertical, striped bar on the screen. iii) The resulting space-time plot shows the bar’s motion over time. B. The impulse response kernel extracted from one m-sequence used in one neuron (n = 1). C. The intracellular response of an HS neuron to the m-sequence in panel A. D. Magnification of the data in panel C.
White noise techniques describe the relationship between the stimulus input (x(t), the m-sequence) and the output ((y(t), the neural membrane potential) . The impulse response (h(t)), with or without additional nonlinearities, describes the transformation between the two. In the example here, we extract the impulse response (Fig 1B, N = 1) by recording the HSN intracellular response (Fig 1C, n = 1, magnification of the response in Fig 1D) to a stimulus controlled by the m-sequence (Fig 1A). We then deconvolve the response to extract the impulse response corresponding to the bar’s motion. Note that this is the impulse response (Fig 1B) extracted from one trial using a single m-sequence in a single neuron.
Visual neurons are highly non-linear
It is well known that higher-order visual neurons can be highly non-linear (e.g. [28, 29]). To investigate how the non-linearity affects our experiments in more detail, we first identify the velocity impulse response in the resting neuron, where a stationary stimulus performs a single jump in the preferred direction, and then remains stationary in the new position. For this we use the same type of vertical, striped bar as above (6° x 75°, 100% contrast) moving in the center of the receptive field. The response to a preferred direction impulse is characterized by a rapid depolarization, followed by a slower decay to the resting membrane potential (black data, Fig 2A, N = 1, n = 105). The corresponding response to an anti-preferred direction impulse is slower (grey data, Fig 2A, N = 1, n = 126). Across 7 neurons preferred direction time-to-peak is ca 5 ms faster than in the anti-preferred direction (20.2 ± 2.8 ms compared with 25.3 ± 3.9 ms, p<0.05, Student’s paired t-test).
A. The impulse response of an un-adapted female HSN to a high-contrast figure jump in the preferred direction (black, N = 1, n = 105) and the anti-preferred direction (grey, n = 126). B. The same data as in panel A, but the anti-preferred direction response is inverted for more direct comparison. The red data show the corresponding impulse response extracted from an m-sequence (from the same female HSN, n = 11).
The data in Fig 2A show the impulse responses in a resting neuron. During continuous stimulation visual neurons adapt strongly (e.g. ) and impulse responses after adaptation are briefer and smaller than the impulse response in a resting neuron . This is confirmed by our own data where we see that the impulse responses measured in the resting neuron (grey and black data, Fig 2B) have a larger amplitude, and importantly, take longer to return to baseline than the impulse response in the same neuron to an identical bar controlled by an m-sequence (red, Fig 2B, N = 1, n = 11). Across neurons we find that the un-adapted preferred direction impulse has an amplitude of 2.84 ± 0.74 mV, and returns to baseline within 390 ± 96 ms, whereas the anti-preferred direction response has an amplitude of -2.78 ± 0.52 mV, and returns to baseline within 509 ± 205 ms (N = 5 female HSN). This should be compared with the impulse response extracted from m-sequences, which have an amplitude of 2.7 ± 0.3 mV, and return to baseline within 242 ± 25 ms (N = 5 female HSN, p<0.05, Student’s paired t-test).
Quantification of the non-linearity
To investigate whether m-sequences can be used at the neuronal level, despite the non-linearities described in Fig 2, we use previously extracted response kernels (as in Fig 1B) to predict the response to a new m-sequence. We do this by convolving the response kernel for the high-contrast figure in the center of the receptive field, with a new m-sequence. Despite the non-linearities described in Fig 2, we find that the predicted response (black data, Fig 3A, n = 1) looks very similar to the measured neural response (grey, Fig 3A, n = 1). To quantify this observation across neurons, we plot the measured response as a function of the predicted response. This analysis shows that the measured response correlates well with the predicted response (Fig 3B, male HSN, N = 6) with a mean percentage error (MPE, ) of only 7.9 ± 14%.
A. Male HSN response to an m-sequence (grey) and the predicted response (black) based on previously extracted impulse responses from the same neuron. B. The measured response as a function of the predicted response (6 male HSN, MPE = 7.9 ± 14%) to a full-contrast bar in the center of the receptive field. C. The static non-linearity extracted from the same 6 male HSN. The grey line shows the sigmoidal function fitted to the pooled data. D. A box-plot of the membrane potential fluctuations during m-sequence stimulation in the same 6 male HSN. The central mark in the box describes the median, and the edges of the box the 25th and 75th percentiles of the data. The whiskers describe the limits of the data set, excluding the statistical outliers, which are displayed as individual grey data points.
The data in Fig 3B suggest that the responses are close to linear across a large part of the response range. However, the most hyperpolarized and depolarized values seem to be overestimated. To account for this non-linearity we quantify it (as described in ). Briefly, the data is sorted in ascending order, and sorted in bins with equal number of values in each, through which we fit a sigmoidal function (Fig 3C, male HSN, N = 6). To quantify its impact we re-calculate the MPE with the addition of this non-linearity, and find that it is only slightly improved (5.9 ± 11%; ns, paired t-test). It thus seems as if the non-linearity only plays a minor role in the neural response.
How can the non-linearity of the neural responses be so small? An 8th order m-sequence has a length of 255, and thus contains 128 +1’s and 127–1’s. The number of impulses in the preferred and the anti-preferred direction are thus almost equal . Furthermore, our own data show that in the resting neuron, the preferred direction impulse response is larger than the anti-preferred direction impulse (Fig 2). One would thus expect the neural responses during continuous m-sequence stimulation to be skewed towards depolarizing values. However, a box-plot of the membrane potential fluctuations during m-sequence stimulation shows that the data are symmetrically distributed with the median very close to 0 (Fig 3D, male HSN, N = 6), with only a few statistical outliers that are biased towards depolarizing values (grey data points, Fig 3D). It thus seems as if the neuron is only depolarized for brief moments (see raw data in Fig 3A), and spends longer durations at hyperpolarized values, which would make the data more evenly distributed (Fig 3D) than predicted. The predominantly symmetrical distribution might contribute to the small static non-linearity (Fig 3C).
The impulse responses to smaller figures have similar time-course
We next measure how the figure response is affected by the height of the bar. The impulse response to a full-screen bar moving in the center of the receptive field, over a mean-luminance background (Fig 4A, N = 7) has a time-to-peak of 18 ms (Fig 4E) and a half-width of 10 ms (Fig 4F). When the bar is reduced to a height of 37° (Fig 4B, N = 5) the impulse response amplitude (Fig 4H) and time course (Fig 4F and 4G) remain virtually identical. When the bar height is reduced further, to 19° (Fig 4C, N = 5) or 9° (Fig 4D, N = 5) the response amplitude is reduced, but not significantly (Fig 4H, one-way ANOVA). The time-to-peak and the half-width of the impulse responses remain unaltered (Fig 4F and 4G; ns, one-way ANOVA).
A. The impulse response to full-contrast bar moving over a grey background. The bar covered the vertical extent of the screen (75°, see inset pictogram for the bar’s height relative to the HSN receptive field as projected on the visual display). The individual impulse responses from each neuron are displayed with thin lines, and the average impulse response across neurons is displayed with the fat black line (N = 7). B. The impulse response to a 37° high bar (N = 5). C. The impulse response to a 19° high bar (N = 5). D. The impulse response to a 9° high bar (N = 5). E. Time-to-peak (Ttp) values for the data in panels A-D. F. Half-width values, i.e. the width of the impulse response at 50% maximum amplitude, for the data in panels A-D. G. Peak amplitude values, i.e. the maximum amplitude, for the data in panels A-D. H. The optimal impulse response (IRopt) length for the data in panels A-D, defined as the impulse response length that gives the minimal MPE. I. The minimum MPE for the data in panels A-D. The black data show the results using only the impulse response, and the black data the MPE after adding the static non-linearity. In panels F-I the data show mean ± sd.
In all cases we quantify the MPE of impulse responses of different lengths to identify the optimal impulse response length, which reduces the MPE maximally without overfitting the data. For the experiments described here the optimal impulse response length is about 84 ms (Fig 4H), with no significant difference between figure heights. The MPE at the optimal impulse response length is 9.1% (black data, Fig 4I). To quantify the impact of the non-linearity, we recalculate the MPE after its addition (grey data, Fig 4I). This analysis shows that the non-linearity reduces the MPE from an average 9.1% to 6.7%, but the reduction is not significant (2-way ANOVA), confirming our previous observation (Fig 3) that the static non-linearity does not play a major role in the neural response to m-sequences.
Spatio-temporal response profile
To investigate the spatial profile of the response, we display the bar at different positions across the azimuth and interpolate the individual impulse response kernels. The spatial distribution of the figure response (Fig 5A, N = 5) largely reflects the underlying male HSN receptive field . Compared with the impulse response through the center of the receptive field (Fig 5B), the impulse response in the periphery (Fig 5C), is smaller in amplitude and has a broader half-width (p<0.05, one-way ANOVA followed by Bonferroni's multiple comparison test). However, there is no significant difference in time-to-peak between the central and peripheral receptive field.
A. The male HSN spatio-temporal impulse response profile shows the bar’s azimuthal position on the x-axis (interpolated from 9 start positions), the temporal profile of the impulse response on the y-axis, with the response amplitude color-coded. The bar moved on a grey background. N = 5. B. The individual impulse responses from the center of the receptive field (see arrow in panel A) in thin black, and the mean in fat black line. C. The impulse responses from the peripheral receptive field (see arrow in panel A). D. The spatio-temporal profile for female HSN. N = 4. E. The individual impulse responses from the center of the female HSN receptive field in thin black, and the mean in fat black line. F. The impulse responses from the female HSN peripheral receptive field. In panels B, C, E and F stars (*) indicate significant differences between the sexes, whereas crosses (†) indicate significant difference between stimulus locations (central or peripheral receptive field). Significance (p<0.05) was tested with one-way ANOVA followed by Bonferroni's multiple comparison tests.
In female HSN (Fig 5D, N = 4) we find a slightly broader spatial profile, consistent with earlier work showing that female hoverflies have larger HSN receptive fields [20, 32]. The impulse response through the center of the receptive field (Fig 5E) has a slightly longer time-to-peak than the impulse response through the center of the male HSN receptive field (p<0.05, one-way ANOVA followed by Bonferroni's multiple comparison test). The impulse response in the female peripheral receptive field has a similar time-to-peak as in the central receptive field, and a slightly broader half-width (but not significant, p>0.05, one-way ANOVA followed by Bonferroni's multiple comparison test).
The impulse responses to low contrast stimuli are slower
The time-to-peak of the male HSN impulse responses described above remained similar across conditions where the response amplitude was reduced by changing the height of the bar (Fig 4) or its placement in the visual field (Fig 5). We next investigate what happens to the impulse response when the contrast of the figure is rescaled to 10%. As expected, the impulse response to a low-contrast bar (Fig 6B, N = 5) has a significantly smaller amplitude than the impulse response to the high-contrast bar (Fig 6A, N = 7; p<0.05, one-way ANOVA followed by Bonferroni's multiple comparison test). The impulse response to the low contrast figure also has a slower time course with a significantly longer time-to-peak and wider half-width (Fig 6B).
A. The impulse response to a full contrast vertical bar (male HSN, N = 8). B. The impulse response to a 10% contrast bar (male HSN, N = 11). C. The impulse response to a full contrast, full screen background pattern (male HSN, N = 7). D. The impulse response to a 10% contrast, full screen background pattern (male HSN, N = 12). In all panels the pictograms display example space-time plots. Stars (*) indicate significant differences between contrast conditions, and crosses (†) indicate significant differences between stimulus types (bar or background). Significance (p<0.05) was tested with one-way ANOVA followed by Bonferroni's multiple comparison tests.
LPTCs are traditionally believed to be tuned to widefield movement stimuli . Are the HSN impulse responses to figure motion different from the impulse responses to widefield motion? We find that the impulse response to the motion of a 100% contrast background pattern (Fig 6C, N = 12) has similar time-to-peak and half-width as the impulse response to a full-contrast figure (Fig 6A), but a slightly larger amplitude. However, the amplitude does not scale up 16 times, despite the full-screen stimulus being 16 times larger than the bar (see  for a thorough description of dendritic gain control). When the background contrast is rescaled to 10% (Fig 6D, N = 11), the amplitude is significantly reduced compared with the full-contrast background response (p<0.05, one-way ANOVA followed by Bonferroni's multiple comparison test). The time-to-peak and half-width are more similar to the 10% contrast figure impulse response (Fig 6B) than to the full-contrast background impulse response (Fig 6C). The similar impulse responses to figure and background motion, whether displayed at full-contrast or reduced contrast, suggest that the figure response could be driven by similar underlying input dynamics.
White noise techniques
White-noise techniques have been used extensively for investigating neural responses to different visual stimuli. The impulse responses that we extract are faster than some of the insect impulse responses measured previously. For example, the time-to-peak of the impulse response in the locust lamina is ca. 40 ms , in blowfly medulla amacrine cells ca. 40 ms , in Drosophila medulla neurons ca. 50 ms , and in the blowfly LPTC H1 ca. 50 ms . However, direct comparisons are difficult since the experiments differ in terms of species, recording conditions and stimulus techniques. These factors all affect the response dynamics of neurons in the visual system. For example, the temperature  and the levels of stress hormones in the fly brain  have a strong effect on the response latency of visual neurons. It is also well known that parameters of the visual stimulus, such as its temporal frequency and contrast, have a large effect on the neural response onset . Therefore, the fact that the blowfly H1 recordings were performed in very dim light  could explain the slower responses. Indeed, Drosophila Foma-1 neurons, which are also located in the lobula complex, have a time-to-peak of 20 ms , more similar to the responses measured here. However, since the lamina and medulla are presynaptic to the lobula plate, one would expect those responses to be faster than those we measured in HSN. This remaining discrepancy might be explained by recent work which showed that Eristalis visual responses can be as much as 10 ms faster than Calliphora responses to the same stimuli .
The high similarity between the predicted responses to novel stimuli, and the measured HSN response to the same stimulus, show that the m-sequence method used here is robust and reliable (Fig 3A and 3B). We found MPEs around 9% for the linear model and around 6% after adding the static non-linearity (Fig 4I). It is intriguing that the addition of static non-linearities only slightly (and not significantly) improved the prediction of responses in our neurons given that previous studies have shown that the insect visual can display significant nonlinearities (e.g. [10, 44]). However, static non-linearities in lamina neurons and LPTCs have been shown to vary substantially between neuron types and pathways (e.g. [5, 37]). For example, the static non-linearity in the L2 pathway is much stronger that the static non-linearity in the L1 pathway . In experiments comparing the blowfly LPTCs H1 and V1, the static non-linearity was larger in H1 , despite these neurons otherwise being physiologically similar.
In fly photoreceptors linear models have been found to be poor predictors of visual responses, with MPEs around 25% [26, 45]. These errors were not due to noise as they were significantly reduced to values comparable to those found here in LPTCs when non-linearities were added. In L-neurons from the dragonfly ocelli, linear predictors produced MPEs as low as 10% when using optimal stimuli . In a recent study the spatio-temporal receptive fields of LPTCs were determined using Brownian motion , with predictive powers between 0.3 and 0.7. Predictive power was defined as the component of the response that could be explained by a model describing the impulse response and the receptive field. In quantitative behavior it has been shown that purely linear models predict the behavior well , at least in the frontal visual field . It is thus tempting to suggest that linear models become more useful for predicting responses the higher we travel up the visual processing pathway.
Previous work has shown a strong difference between adapted and un-adapted responses in HS neurons, as we saw in Fig 2. For example, the impulse response in the adapted neuron has a smaller amplitude and a briefer time course compared with the un-adapted response . The reduced response amplitude following motion adaptation is thoroughly established, and has been well investigated (see e.g. [46–48]). It is likely that the altered response magnitude, and time course, following adaptation serves a role in allowing neurons to appropriately respond to novel stimuli [49–51].
Lobula plate tangential cells as figure detectors
The physiological response properties of LPTCs correlate well with the behavioral optomotor response, and they are therefore generally described as underlying the optomotor response. However, the motion of local, high-contrast features also influence the LPTC responses. For example, during optic flow reconstructed from real flight paths, the translation of near-by, high-contrast features generates strong transient responses in blowfly HS neurons [21–23]. Indeed, the influence of the bar’s motion on the HS neurons’ membrane potential fluctuations was in some cases stronger than the influence of the background motion . The response to individual features within naturalistic widefield optic flow is called pattern noise . In blowflies, the pattern noise response to the relative motion of a vertical object is particularly strong if the background is simulated to be distant . The pattern noise depends on the receptive field, so that the hoverfly HSN, which has a much smaller receptive field than HSNE , displays stronger pattern noise , particularly to vertically elongated features.
Behavioral experiments on Drosophila show that the bar fixation response is strongest in the frontal visual field [25, 53], coinciding with the peak sensitivity of the hoverfly HSN receptive field . Interestingly, Drosophila track bars consisting of higher-order motion cues, not coded by typical delay-and correlate-type input [25, 54]. We recently found that hoverfly HS neurons respond to similar bars consisting of higher-order motion cues , with particularly high sensitivity in the frontal visual field . In this context it is interesting to note HS neurons were originally suggested to be involved in bar fixation behaviors (see e.g. ). However, even if a neuron responds to a stimulus, this does not imply that it was ‘designed’ for this purpose. Therefore, it is interesting that the impulse responses to figure motion (Fig 6A and 6B) are remarkably similar to the impulse responses to background motion (Fig 6C and 6D), suggesting the possibility for similar underlying coding. Furthermore, recent work has shown that the asymmetrical neural responses to preferred and anti-preferred direction motion (as seen here in Fig 2) could contribute to the observed sensitivity to figure motion in LPTCs .
Behavioral impulse responses to figure motion
Behavioral experiments using m-sequences in Drosophila show figure responses that differ remarkably from behavioral background motion responses . Indeed, the figure responses extracted from behavior have a sustained component with a very slow return to baseline, more similar to a step response than to an impulse response. This is very different from the neural impulse responses to figure motion that we describe here (Fig 4). Furthermore, the figure responses recorded in Drosophila behavior depend substantially on where in the receptive field the figure is presented, so that only figures in the frontal visual field are tracked, whereas those in the rear visual field lead to reduced tracking . We could only record figure responses in the frontal visual field (Fig 5), and not in the dorsal visual field, since this is outside the HSN receptive field . Nevertheless, the strikingly different responses to figure motion in Drosophila behavior and Eristalis LPTCs suggest that behavioral figure tracking may be supported by a different neural pathway (see e.g. ).
The impulse responses to background motion recorded in Drosophila behavior  look more like the LPTC background responses we recorded here (Fig 6). However, a more direct comparison of Drosophila HS and behavioral impulse responses to widefield motion show that whereas the neural response quickly returns to baseline, the behavioral response remains significantly elevated for several seconds . This suggests that the HS response does not correspond directly to the behavioral optomotor response, but that there is a leaky integrator between the HS cells and the motor output .
Importantly, whereas the lamina and medulla neurons are highly conserved across flies , there is much more variation in the lobula and lobula plate . Whereas Calliphora , Musca  and Drosophila  have three HS cells in each hemisphere, Eristalis hoverflies have four . Compared with the other dipteran HS cells, the hoverfly HSN is unique with a very narrow, frontally oriented receptive field . Calliphora and Drosophila HS cells have receptive fields that extend laterally, with peak sensitivity in the lateral visual field [59, 61], which makes more sense for neurons tuned to the motion of yaw optic flow . However, despite the small receptive field, Eristalis HSN responses are strongly correlated with yaw motion .
Besides the neural differences, compared with the more commonly studied dipteran flies, Eristalis hoverflies perform elaborate flight behavior. In highly cluttered environments male hoverflies set up and vigorously defend their territories, from which they pursue intruding conspecifics . Eristalis pursuits are extremely precise, high-speed and advanced, and they have been shown to intercept the target . In contrast, even if male Fannia , Calliphora  and Musca  follow moving targets, they do this at lower speed and they use a smooth-pursuit mode. Furthermore, compared with Calliphora the free flight patterns of Eristalis are also more elaborate, with stationary hovering, backwards and sidewards flights, and extremely rapid turns . Indeed, Eristalis hoverflies reach velocities of 10 m/s, and can turn at many thousand degrees per second , compared with 1–2 m/s and a few thousand degrees per second in Calliphora  and Fannia . It is thus potentially possible that the high sensitivity to bar motion that we have described here reflects the more elaborate flight behavior of hoverflies, rather than something universal for dipteran LPTCs.
This work was funded by the Swedish Research Council (VR, 2008–2933, 2012–4740) and US Air Force Research Laboratory (AFRL, FA9550-11-1-0349). We thank AB Cederholms Lantbruk for access to cow dung with Eristalis larvae, and Jonas Henriksson, Tomas Måhlberg and Linus Nilsson for software development and technical assistance. Patrick Shoemaker at Tanner Research, and Jacob Aptekar and Mark Frye at UCLA encouraged the use of m-sequences. Two anonymous reviewers and Andrew Straw and Andreas Poehlmann at IMP provided helpful and constructive feedback on earlier versions of the manuscript.
Conceived and designed the experiments: YL KN. Performed the experiments: YL KN. Analyzed the data: YL OJ KN. Contributed reagents/materials/analysis tools: KN. Wrote the paper: YL OJ KN.
- 1. James AC, Osorio D. Characterisation of columnar neurons and visual signal processing in the medulla of the locust optic lobe by system identification techniques. J Comp Physiol A. 1996;178(2):183–99. PubMed pmid:8592303.
- 2. Ringach DL. Mapping receptive fields in primary visual cortex. J Physiol. 2004;558(3):717–28. PubMed pmid:ISI:000223435900001.
- 3. Berry R, Stange G, Olberg R, van Kleef J. The mapping of visual space by identified large second-order neurons in the dragonfly median ocellus. J Comp Physiol A 2006;192(10):1105–23. Epub 2006/06/09. [doi]. PubMed pmid:16761130.
- 4. van Kleef J, Berry R, Stange G. Directional selectivity in the simple eye of an insect. J Neurosci. 2008;28(11):2845–55. Epub 2008/03/14. 28/11/2845 [pii] [doi]. PubMed pmid:18337415.
- 5. Weber F, Machens CK, Borst A. Spatiotemporal response properties of optic-flow processing neurons. Neuron. 2010;67(4):629–42. Epub 2010/08/28. S0896-6273(10)00555-6 [pii] [doi]. PubMed pmid:20797539.
- 6. Gauthier JL, Field GD, Sher A, Greschner M, Shlens J, Litke AM, et al. Receptive Fields in Primate Retina Are Coordinated to Sample Visual Space More Uniformly. PLoS Biol. 2009;7(4):e63. Epub 2009/04/10. 08-PLBI-RA-0586 [pii] [doi]. PubMed pmid:19355787.
- 7. Ringach D, Shapley R. Reverse correlation in neurophysiology. Cogn Sci. 2004;28(2):147–66. PubMed pmid:ISI:000220809300002.
- 8. Theobald JC, Ringach DL, Frye MA. Dynamics of optomotor responses in Drosophila to perturbations in optic flow. J Exp Biol. 2010;213(Pt 8):1366–75. Epub 2010/03/30. 213/8/1366 [pii] [doi]. PubMed pmid:20348349; PubMed Central PMCID: PMC2846167.
- 9. Fox JL, Frye MA. Figure-ground discrimination behavior in Drosophila. II. Visual influences on head movement behavior. J Exp Biol. 2014;217(Pt 4):570–9. Epub 2013/11/08. jeb.080192 [pii] [doi]. PubMed pmid:24198264; PubMed Central PMCID: PMC3922834.
- 10. van Kleef JP, Stange G, Ibbotson MR. Applicability of white-noise techniques to analyzing motion responses. J Neurophysiol. 2010;103(5):2642–51. Epub 2010/01/08. 00591.2009 [pii] [doi]. PubMed pmid:20053848.
- 11. Schnell B, Weir PT, Roth E, Fairhall AL, Dickinson MH. Cellular mechanisms for integral feedback in visually guided behavior. Proc Natl Acad Sci U S A. 2014;111(15):5700–5. Epub 2014/04/08. 1400698111 [pii] [doi]. PubMed pmid:24706794; PubMed Central PMCID: PMC3992680.
- 12. Aptekar JW, Keles M, Mongeau JM, Lu P, Frye MA, Shoemaker PA. Method and software for using m-sequences to characterize parallel components of higher-order visual tracking behavior in Drosophila. Frontiers in Neural Circuits. 2014;8:130. PubMed pmid:25400550; PubMed Central PMCID: PMC4215624.
- 13. Robie AA, Straw AD, Dickinson MH. Object preference by walking fruit flies, Drosophila melanogaster, is mediated by vision and graviperception. J Exp Biol. 2010;213(Pt 14):2494–506. Epub 2010/06/29. 213/14/2494 [pii] [doi]. PubMed pmid:20581279; PubMed Central PMCID: PMC2892423.
- 14. Reichardt W, Poggio T. Figure-ground discrimination by relative movement in the visual-system of the fly. Part I: Experimental results. Biol Cybern. 1979;35(2):81–100.
- 15. Borji A, Sihite DN, Itti L. What stands out in a scene? A study of human explicit saliency judgment. Vision Res. 2013;91:62–77. Epub 2013/08/21. S0042-6989(13)00191-0 [pii] [doi]. PubMed pmid:23954536.
- 16. Reichardt W, Poggio T. Visual control of orientation behaviour in the fly. Part I. A quantitative analysis. Q Rev Biophys. 1976;9(3):311–75, 428–38. PubMed pmid:790441.
- 17. Hausen K. The lobula-complex of the fly: Structure, function and significance in visual behavior. In: Ali M, editor. Photoreception and vision in invertebrates. New York: Plenum; 1984. p. 523–59.
- 18. Pierantoni R. A look into the cock-pit of the fly. The architecture of the lobular plate. Cell Tissue Res. 1976;171(1):101–22. Epub 1976/08/16. PubMed pmid:963732.
- 19. Buschbeck EK, Strausfeld NJ. The relevance of neural architecture to visual performance: Phylogenetic conservation and variation in dipteran visual systems. J Comp Neurol. 1997;383:282–304. pmid:9205042
- 20. Nordström K, Barnett PD, Moyer de Miguel IM, Brinkworth RSA, O'Carroll DC. Sexual dimorphism in the hoverfly motion vision pathway. Curr Biol. 2008;18(9):661–7. PubMed pmid:18450449.
- 21. Karmeier K, van Hateren JH, Kern R, Egelhaaf M. Encoding of naturalistic optic flow by a population of blowfly motion-sensitive neurons. J Neurophysiol. 2006;96(3):1602–14. PubMed pmid:16687623.
- 22. Boeddeker N, Lindemann JP, Egelhaaf M, Zeil J. Responses of blowfly motion-sensitive neurons to reconstructed optic flow along outdoor flight paths. J Comp Physiol A 2005;191(12):1143–55. PubMed pmid:16133502.
- 23. Liang P, Heitwerth J, Kern R, Kurtz R, Egelhaaf M. Object representation and distance encoding in three-dimensional environments by a neural circuit in the visual system of the blowfly. J Neurophysiol. 2012;107(12):3446–57. Epub 2012/03/17. jn.00530.2011 [pii] [doi]. PubMed pmid:22423002.
- 24. O'Carroll DC, Barnett PD, Nordström K. Local and global responses of insect motion detectors to the spatial structure of natural scenes. J Vis. 2011;11(14):20. pmid:22201615
- 25. Aptekar JW, Shoemaker PA, Frye MA. Figure tracking by flies is supported by parallel visual streams. Curr Biol. 2012;22(6):482–7. pmid:22386313
- 26. Niven JE, Vahasoyrinki M, Juusola M, French AS. Interactions between light-induced currents, voltage-gated currents, and input signal properties in Drosophila photoreceptors. J Neurophysiol. 2004;91(6):2696–706. Epub 2004/01/30. [doi] 01163.2003 [pii]. PubMed pmid:14749305.
- 27. Fox JL, Aptekar JW, Zolotova NM, Shoemaker PA, Frye MA. Figure-ground discrimination behavior in Drosophila. I. Spatial organization of wing-steering responses. J Exp Biol. 2014;217(Pt 4):558–69. Epub 2013/11/08. jeb.097220 [pii] [doi]. PubMed pmid:24198267; PubMed Central PMCID: PMC3922833.
- 28. Jung SN, Borst A, Haag J. Flight activity alters velocity tuning of fly motion-sensitive neurons. J Neurosci. 2011;31(25):9231–7. Epub 2011/06/24. 31/25/9231 [pii] [doi]. PubMed pmid:21697373.
- 29. Kalb J, Egelhaaf M, Kurtz R. Adaptation of velocity encoding in synaptically coupled neurons in the fly visual system. J Neurosci. 2008;28(37):9183–93. pmid:18784299
- 30. Barnett PD, Nordström K, O'Carroll DC. Motion adaptation and the velocity coding of natural scenes. Curr Biol. 2010;20(11):994–9. pmid:20537540
- 31. Harris RA, O'Carroll DC, Laughlin SB. Adaptation and the temporal delay filter of fly motion detectors. Vision Res. 1999;39(16):2603–13. pmid:10492824
- 32. Straw AD, Warrant EJ, O'Carroll DC. A 'bright zone' in male hoverfly (Eristalis tenax) eyes and associated faster motion detection and increased contrast sensitivity. J Exp Biol. 2006;209(Pt21):4339–54. PubMed pmid:17050849.
- 33. Borst A, Haag J, Reiff DF. Fly motion vision. Annu Rev Neurosci. 2010;33:49–70. Epub 2010/03/17. [doi]. PubMed pmid:20225934.
- 34. Single S, Haag J, Borst A. Dendritic computation of direction selectivity and gain control in visual interneurons. J Neurosci. 1997;17(16):6023–30. PubMed pmid:9236213.
- 35. Osorio D. Mechanisms of early visual processing in the medulla of the locust optic lobe: How self-inhibition, spatial-pooling, and signal rectification contribute to the properties of transient cells. Vis Neurosci. 1991;7:345–55. pmid:1751420
- 36. O'Carroll DC, Osorio D, James AC, Bush T. Local feedback mediated via amacrine cells in the insect optic lobe. J Comp Physiol A. 1992;171:447–55.
- 37. Behnia R, Clark DA, Carter AG, Clandinin TR, Desplan C. Processing properties of ON and OFF pathways for Drosophila motion detection. Nature. 2014. Epub 2014/07/22. nature13427 [pii] [doi]. PubMed pmid:25043016.
- 38. Srinivasan MV. The impulse response of a movement-detecting neuron and its interpretation. Vision Res. 1983;23(6):659–63. Epub 1983/01/01. PubMed pmid:6613007.
- 39. Tatler B, O'Carroll DC, Laughlin SB. Temperature and the temporal resolving power of fly photoreceptors. J Comp Physiol A. 2000;186(4):399–407. Epub 2000/05/08. PubMed pmid:10798727.
- 40. De Haan R, Lee Y-J, Nordström K. Octopaminergic modulation of contrast sensitivity. Front Integr Neurosci. 2012;6:55. pmid:22876224
- 41. Warzecha A-K, Egelhaaf M. Response latency of a motion-sensitive neuron in the fly visual system: Dependence on stimulus parameters and physiological conditions. Vis Res. 2000;40:2973–83. pmid:11000395
- 42. de Vries SE, Clandinin TR. Loom-sensitive neurons link computation to action in the Drosophila visual system. Curr Biol. 2012;22(5):353–62. Epub 2012/02/07. S0960-9822(12)00008-5 [pii] [doi]. PubMed pmid:22305754; PubMed Central PMCID: PMC3298569.
- 43. Geurten BRH, Kern R, Egelhaaf M. Species-specific flight styles of flies are reflected in the response dynamics of a homolog motion-sensitive neuron. Front Int Neurosci. 2012;6:11.
- 44. Fairhall AL, Lewen GD, Bialek W, de Ruyter Van Steveninck RR. Efficiency and ambiguity in an adaptive neural code. Nature. 2001;412(6849):787–92. Epub 2001/08/24. [doi] 35090500 [pii]. PubMed pmid:11518957.
- 45. van Kleef J, James AC, Stange G. A spatiotemporal white noise analysis of photoreceptor responses to UV and green light in the dragonfly median ocellus. J Gen Physiol. 2005;126(5):481–97. Epub 2005/11/02. jgp.200509319 [pii] [doi]. PubMed pmid:16260838; PubMed Central PMCID: PMC2266605.
- 46. O'Carroll DC, Barnett PD, Nordström K. Temporal and spatial adaptation of transient responses to local features. Front Neural Circuits. 2012;6:74. Epub 2012/10/23. [doi]. PubMed pmid:23087617; PubMed Central PMCID: PMC3474938.
- 47. Nordström K, Moyer de Miguel IM, O'Carroll DC. Rapid contrast gain reduction following motion adaptation. J Exp Biol. 2011;214:4000–9. pmid:22071192
- 48. Liang P, Kern R, Egelhaaf M. Motion adaptation enhances object-induced neural activity in three-dimensional virtual environment. J Neurosci. 2008;28(44):11328–32. Epub 2008/10/31. 28/44/11328 [pii] [doi]. PubMed pmid:18971474.
- 49. Ulanovsky N, Las L, Nelken I. Processing of low-probability sounds by cortical neurons. Nat Neurosci. 2003;6(4):391–8. Epub 2003/03/26. [doi] nn1032 [pii]. PubMed pmid:12652303.
- 50. Kurtz R, Egelhaaf M, Meyer HG, Kern R. Adaptation accentuates responses of fly motion-sensitive visual neurons to sudden stimulus changes. Proc Biol Sci. 2009;276(1673):3711–9. Epub 2009/08/07. rspb.2009.0596 [pii] [doi]. PubMed pmid:19656791.
- 51. Maddess T, Laughlin SB. Adaptation of the motion-sensitive neuron H1 is generated locally and governed by contrast frequency. Proc Biol Sci. 1985;225(1239):251–75.
- 52. Kimmerle B, Egelhaaf M. Performance of fly visual interneurons during object fixation. J Neurosci. 2000;20(16):6256–66. pmid:10934276
- 53. Hausen K, Egelhaaf M. Neural mechanisms of visual course control in insects. In: Stavenga DG, Hardie RC, editors. Facets of Vision. Berlin Heidelberg: Springer Verlag; 1989. p. 391–424.
- 54. Theobald JC, Duistermars BrJ, Ringach DL, Frye MA. Flies see second-order motion. Curr Biol. 2008;18(11):R464–5. Epub 2008/06/05. S0960-9822(08)00392-8 [pii] [doi]. PubMed pmid:18522814.
- 55. Lee Y-J, Nordström K. Higher order motion sensitivity in fly visual circuits. Proc Natl Acad Sci U S A. 2012;109(22):8758–63. pmid:22586123
- 56. Fenk LM, Poehlmann A, Straw AD. Asymmetric processing of visual motion for simultaneous object and background responses. Curr Biol. 2014;24(24):2913–9. Epub 2014/12/03. S0960-9822(14)01351-7 [pii] [doi]. PubMed pmid:25454785.
- 57. Egelhaaf M. On the neuronal basis of figure-ground discrimination by relative motion in the visual system of the fly. II. Figure-detection cells, a new class of visual interneurones. Biol Cybern. 1985;52:195–209.
- 58. Buschbeck EK, Strausfeld NJ. Visual motion-detection circuits in flies: Small-field retinotopic elements responding to motion are evolutionarily conserved across taxa. J Neurosci. 1996;16(15):4563–78. pmid:8764645
- 59. Krapp HG, Hengstenberg R, Egelhaaf M. Binocular contributions to optic flow processing in the fly visual system. J Neurophysiol. 2001;85(2):724–34. pmid:11160507
- 60. Buchner E, Buchner S, Bulthoff H. Identification of [3H]deoxyglucose-labelled interneurons in the fly from serial autoradiographs. Brain Res. 1984;305(2):384–8. Epub 1984/07/09. 0006-8993(84)90448-7 [pii]. PubMed pmid:6744073.
- 61. Schnell B, Joesch M, Forstner F, Raghu SV, Otsuna H, Ito K, et al. Processing of horizontal optic flow in three visual interneurons of the Drosophila brain. J Neurophysiol. 2010;103(3):1646–57. Epub 2010/01/22. 00950.2009 [pii] [doi]. PubMed pmid:20089816.
- 62. Franz MO, Krapp HG. Wide-field, motion-sensitive neurons and matched filters for optic flow fields. Biol Cybern. 2000;83(3):185–97. PubMed pmid:11007295.
- 63. Wellington W, Fitzpatrick S. Territoriality in the drone fly, Eristalis tenax (Diptera, Syrphidae). Can Entomol. 1981;113(6):695–704.
- 64. Collett TS, Land MF. How hoverflies compute interception courses. J Comp Physiol A. 1978;125:191–204.
- 65. Zeil J. The territorial flight of male houseflies (Fannia canicularis L.). Behav Ecol Sociobiol. 1986;19:312–219.
- 66. Boeddeker N, Kern R, Egelhaaf M. Chasing a dummy target: smooth pursuit and velocity control in male blowflies. Proc Biol Sci. 2003;270(1513):393–9. PubMed pmid:12639319.
- 67. Wehrhahn C, Poggio T, Bülthof H. Tracking and chasing in houseflies (Musca). Biol Cybern. 1982;45:123–30.
- 68. Geurten BR, Kern R, Braun E, Egelhaaf M. A syntax of hoverfly flight prototypes. J Exp Biol. 2010;213(Pt 14):2461–75. Epub 2010/06/29. 213/14/2461 [pii] [doi]. PubMed pmid:20581276.
- 69. Land MF, Collett TS. Chasing behaviour of houseflies (Fannia canicularis). J Comp Physiol A. 1974;89:331–57.