Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Orientation selectivity properties for integrated affine quasi quadrature models of complex cells

  • Tony Lindeberg

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    tony@kth.se

    Affiliation Computational Brain Science Lab, Division of Computational Science and Technology, KTH Royal Institute of Technology, Stockholm, Sweden

Correction

12 Feb 2026: Lindeberg T (2026) Correction: Orientation selectivity properties for integrated affine quasi quadrature models of complex cells. PLOS ONE 21(2): e0342936. https://doi.org/10.1371/journal.pone.0342936 View correction

Abstract

This paper presents an analysis of the orientation selectivity properties of idealized models of complex cells in terms of affine quasi quadrature measures, which combine the responses of idealized models of simple cells in terms of affine Gaussian derivatives by (i) pointwise squaring, (ii) summation of responses for different orders of spatial derivation and (iii) spatial integration. Specifically, this paper explores the consequences of assuming that the family of spatial receptive fields should be covariant under spatial affine transformations, thereby implying that the receptive fields ought to span a variability over the degree of elongation. We investigate the theoretical properties of three main ways of defining idealized models of complex cells and compare the predictions from these models to neurophysiologically obtained receptive field histograms over the resultant of biological orientation selectivity curves. It is shown that the extended modelling mechanisms lead to more uniform behaviour and a wider span over the values of the resultant that are covered, compared to an earlier presented idealized model of complex cells without spatial integration.

More generally, we propose to, based on the presented results: (i) include an explicit variability over the degree of elongation of the receptive fields in functional models of complex cells, and that (ii) the suggested methodology with comparisons to biological orientation selectivity curves and orientation selectivity histograms could be used as a new tool to evaluate other computational models of complex cells in relation to biological measurements.

Introduction

To understand the functional properties of the visual system, it is essential to aim at bridging the gap between computational models on one side and neurophysiological measurements on the other side. Specifically, whenever possible, it is desirable to construct theoretically principled models, which could then lead to a deeper understanding of visual processing modules and also generate predictions for further biological experiments. Regarding visual perception, it is in particular important to develop a good understanding of the receptive fields* (Hubel and Wiesel [14]) in the early layers of the visual hierarchy, which constitute the fundamental primitives that the higher layers in the visual hierarchy are based upon.

(See supplementary information “S1 File” for complementary explanations of the concepts marked by a star* in this introduction.)

One area where it indeed seems to be possible to bridge the gap between neurophysiological recordings and principled theory concerns the normative theory for visual receptive fields in Lindeberg [5]. This theory has been developed from principled assumptions regarding symmetry properties of an idealized vision system, and leads to a canonical family of linear receptive fields in terms of spatial derivatives of affine Gaussian kernels. Interestingly, the shapes of these idealized receptive fields do rather well correspond to the qualitative shapes of simple cells recorded by DeAngelis et al. [6,7], Conway and Livingstone [8] and Johnson et al. [9]; see Figs 12–18 in Lindeberg [5] for comparisons between biological receptive fields and idealized models.

One of the components in this normative theory for visual receptive fields is the assumption that the family of receptive fields ought to be covariant* under spatial affine transformations, so as to enable more robust processing of the image data as variations in the viewing conditions imply variabilities in the image data caused by natural image transformations (see Lindeberg [1012]). Specifically, if a visual observer views the same object from different distances and viewing directions, then the local image patterns will be deformed by the varying parameters of the perspective transformations, which to first order can be approximated by local affine transformations. In the area of computer vision, it has specifically been shown that the property of covariance under spatial affine transformations, referred to as affine covariance, enables more accurate estimation of surface orientation, compared to using only isotropic receptive fields that do not support affine covariance (Lindeberg and Gårding [13]).

To implement affine covariance in a vision system corresponds to using receptive field shapes subject to different affine spatial transformations, and will thereby specifically imply that receptive fields ought to be present for different degrees of elongation*. In a companion work (Lindeberg [14]), we have indeed investigated the consistency of that affine covariant hypothesis with neurophysiological measurements of the resultant of orientation selectivity curves obtained by Goris et al. [15]. There, we showed that predictions of orientation selectivity curves and orientation selectivity histograms generated from idealized models of simple cells in terms of Gaussian derivatives are for idealized model of simple cells in reasonable agreement with biological orientation selectivity histograms. Thereby, those results for simple cells are consistent with an expansion of the receptive field shapes over the degree of elongation in the primary visual cortex of higher mammals.

The modelling of complex cells* performed in Lindeberg [14] was, however, based on very much simplified models in terms of pointwise non-linear combinations of responses of simple cells, and thus not involving any spatial integration of the non-linear combinations over extended regions in the image domain. Additionally, the modelling of complex cells in Lindeberg [14] was based on input from simple cells up to only order two, and not involving simple cells up to order 4, which were shown to lead to better agreement between the predicted orientation selectivity histograms and the actual biological orientation selectivity histograms accumulated for simple cells by Goris et al. [15]. The subject of this paper is to investigate a set of extended models of complex cells, and to demonstrate that these models offer a potential to lead to better agreement with biological orientation selectivity histograms compared to previous work.

In this way, we will thus specifically demonstrate that the resulting modelling of complex cells is also consistent with an expansion of the receptive field shapes over the degree of elongation, and in this way consistent with the wider hypothesis about affine covariant visual receptive fields, previously proposed in Lindeberg [5,10,14]. Based on these results, to be presented below, we propose to include an explicit expansion over the degree of elongation of the receptive fields as an essential component when modelling the computational function of complex cells.

While the specific models of complex cells to be considered in this treatment will be highly idealized, in terms of generalized quadratic energy models of the output of idealized simple cells, we propose that the conceptual extension of models of complex cells with regard to an expansion over the degree of elongation of the receptive fields ought to generalize to also other types of functional models of complex cells.

More generally, we propose that the presented methodology made use of in this paper, of subjecting computational models of complex cells to similar probing tests as used for probing the orientation selectivity properties of biological complex cells, is important for understanding the theoretical properties of the computational mechanisms that are used for modelling biological complex cells. In this way, we will specifically demonstrate that complementing previous energy models of complex cells based on Gaussian derivatives with a spatial integration stage, as well as making use of spatial derivatives up to order 4 as opposed to previous use of spatial derivatives only up to order 2, has the potential of leading to better explanatory properties of orientation selectivity histograms of biological neurons, compared to the previous modelling approaches in Lindeberg [14,16].

Another important aspect of the presented work is that the proposed models for complex cells are based on theoretically well-founded models of simple cells, and specifically with very few free parameters to determine. By this functional modelling of the receptive fields at a coarse macroscopic level, the need for determining hyperparameters of the models is far lower compared what would be the case if one would instead base the analysis on more fine-grained models based on explicit neural models.

Thereby, the simulation work needed to reveal the qualitative properties of the computational models also becomes far lower compared to explicit simulations of networks of neural models, for which the result may also depend on the settings of the hyperparameters, and for which there may not be sufficient neurophysiological data available to tune the hyperparameters in a well-founded manner.

A general biological motivation for this study is that biological experiments often tend to reveal a variability of neurons in a variety of different respects. Connectivity analysis of the anatomy also tend to reveal a convergence along axonal projections. In this treatment, for idealized models of complex cells, we explain why there ought to be a variability in the degree of elongation, because of desirable affine covariance properties of an idealized vision system. Specifically, we demonstrate that this hypothesis is consistent with experimental results regarding orientation selectivity properties of biological neurons.

The theory of affine Gaussian derivative operators used as spatial models of the receptive fields also gives a theoretical motivation for the use of Gaussian derivative operators for different orders of spatial differentiation, with different numbers of main lobes in the receptive fields as function of the order of spatial differentiation. In combination with orientation selectivity histograms over the resultant of the orientation selectivity distributions for different orders of spatial differentiation, we demonstrate that the formulation of idealized models of complex cells based on a richer set of spatial derivatives leads to more uniform orientation selectivity histograms with closer similarity to orientation selectivity histograms accumulated from biological neurons.

In these ways, we demonstrate that the proposed computational mechanisms in terms of (i) a variability over the degree of elongation of the receptive fields, (ii) the combination of receptive field components corresponding to a richer set of orders of spatial differentiation, and (iii) the inclusion of explicit mechanisms for spatial integration provide ways towards bridging the gap between theoretical models of neural computation in relation to experimental results obtained from neurophysiological recordings of biological neurons.

Finally, we will use the results from the presented treatment (i) for stating a set of more general predictions in the section “Explicit predictions for further modelling of complex cells”, to be used as guide for further modelling of biological complex cells by mathematical models, and (ii) proposing a conceptual extension of the previous methodology for probing the orientation selectivity of biological neurons. The latter extension consists of instead of just recording the result for a single angular frequency for each image orientation instead performing a two-parameter variation over both the angular frequency and the image orientation, to be able to better reflect a variability in the degree of elongation between different individual biological neurons.

While the presented computational mechanisms are in the paper technically developed for the proposed family of affine quasi quadrature models of complex cells, we argue that corresponding additions of such computational mechanisms could be considered also for other types of theoretical and computational models of complex cells.

Methods

Related work

Orientation selectivity properties of biological neurons have been studied by Watkins and Berkley [17], Rose and Blakemore [18], Schiller et al. [19], Albright [20], Ringach et al. [21], Nauhaus et al. [22], Scholl et al. [23], Sadeh and Rotter [24], Goris et al. [15] and Sasaki et al. [25]. Biological mechanisms for achieving orientation selectivity have also been investigated by Somers et al. [26], Sompolinsky and Shapley [27], Carandini and Ringach [28], Lampl et al. [29], Ferster and Miller [30], Shapley et al. [31], Seriès et al. [32], Hansel and van Vreeswijk [33], Moldakarimov et al. [34], Gonzalo Cogno and Mato [35], Priebe [36], Pattadkal et al. [37], Nguyen and Freeman [38], Merkt et al. [39], Wei et al. [40] and Wang et al. [41]. In this paper, our focus is, however, not on neural mechanisms, but on functional properties at a macroscopic level.

Receptive field models of simple in terms of Gaussian derivatives have been formulated by Koenderink and van Doorn [4244], Young and his co-workers [4547] and Lindeberg [5,48], and in terms of Gabor functions by Marcelja [49], Jones and Palmer [50,51] and Porat and Zeevi [52]. More extensive theoretical models based on Gaussian derivatives have also been expressed by Lowe [53], May and Georgeson [54], Hesse and Georgeson [55], Georgeson et al. [56], Hansen and Neumann [57], Wallis and Georgeson [58], Wang and Spratling [59], Pei et al. [60], Ghodrati et al. [61], Kristensen and Sandberg [62], Abballe and Asari [63], Ruslim et al. [64] and Wendt and Faul [65].

The taxonomy into simple and complex cells in the primary visual cortex was proposed in the pioneering work by Hubel and Wiesel [14]. More extensive analysis of properties of simple cells have then been presented by DeAngelis et al. [6,7], Ringach [66,67], Conway and Livingstone [8], Johnson et al. [9], Walker et al. [68] and De and Horwitz [69], and regarding complex cells by Movshon et al. [70], Emerson et al. [71], Martinez and Alonso [72], Touryan et al. [73,74], Rust et al. [75], van Kleef et al. [76], Goris et al. [15], Li et al. [77] and Almasi et al. [78], as well as modelled computationally by Adelson and Bergen [79], Heeger [80], Serre and Riesenhuber [81], Einhäuser et al. [82], Kording et al. [83], Merolla and Boahen [84], Berkes and Wiscott [85], Carandini [86], Hansard and Horaud [87], Franciosini et al. [88], Lindeberg [89], Lian [90], Oleskiw et al. [91], Yedjour and Yedjour [92], Nguyen et al. [93] and Almasi et al. [94].

Notably, in relation to the generalized quadratic models of complex cells in V1 to be considered in this paper, Rowekamp and Sharpee [95] have found that quadratic computations strongly increase both the predictive power of their models of visual neurons in V1, V2 and V4 as well as their neural selectivity to natural stimuli.

There have been some neurophysiological studies reported that mention receptive fields with different aspect ratios (Tinsley et al. [96], Xu et al. [97]). According to our knowledge, there have, however, not been any previously developed models of complex cells, that involve explicit expansions of the receptive field shapes over the degree of elongation of the receptive fields, or or more specifically that are able to match the neurophysiological orientation selectivity histograms accumulated by Goris et al. [15].

Background theory

In this section, we will describe basic properties of the idealized models for idealized models of receptive fields and their orientation selectivity properties, which we will then build upon and extend in the section “Results”.

Idealized models for spatial receptive fields.

For modelling simple and complex cells in the primary visual cortex, we will build upon the generalized Gaussian derivative model for visual receptive fields proposed in Lindeberg [5,48] and further developed in Lindeberg [10,12,14,16].

Models for simple cells.

According to this theory, linear models of purely spatial receptive fields corresponding to simple cells are formulated in terms of affine Gaussian derivatives of the form

(1)

where

  • is the preferred orientation of the receptive field,
  • is the amount of spatial smoothing,
  • is an m:th-order directional derivative operator, in the direction ,
  • is a symmetric positive definite covariance matrix, with one of its eigenvectors in the direction of ,
  • is a 2-D affine Gaussian kernel with its shape determined by the spatial covariance matrix (2)
    for .

In Lindeberg [5], it was demonstrated that idealized receptive field models of this type do rather well model the qualitative shape of biological simple cells as obtained by neurophysiological measurements by DeAngelis et al. [6,7], Conway and Livingstone [8] and Johnson et al. [9].

Fig 1 shows examples of such receptive fields for different orders of spatial differentiation and different values of the scale parameter ratio between the here vertical and the horizontal scale parameters and , respectively, for the here preferred orientation for the receptive fields. In addition to this illustrated variability over the degree of elongation, an idealized vision system should additionally comprise a variability over the preferred orientation of the receptive fields, and possibly also over the overall size of the receptive fields, as further developed in Lindeberg [14].

thumbnail
Fig 1. Distribution of affine Gaussian derivative receptive fields

(for the preferred image orientation ) over the scale parameter ratio between 1 to 4, from left to right. Here, the vertical scale parameter kept is constant , while the horizontal scale parameter is smaller . (first row) First-order directional derivatives according to (1) for m = 1. (second row) Second-order directional derivatives according to (1) for m = 2. (third row) Third-order directional derivatives according to (1) for m = 3. (fourth row) Fourth-order directional derivatives according to (1) for m = 4. (Horizontal axes: image coordinate . Vertical axes: image coordinate .)

https://doi.org/10.1371/journal.pone.0332139.g001

Models for complex cells.

As a simplest possible extension to non-linear complex cells, an affine quasi-quadrature measure of the form (Lindeberg [89] Eq (39))

(3)

was studied in Lindeberg [14], where

  • and denote directional derivatives in the direction of orders 1 and 2 of convolutions of the input image with affine Gaussian derivative kernels of the form (1):(4)
    (5)
  • is a weighting factor between first and second-order information, which based on a theoretical analysis in Lindeberg [98] is often set to .

This model is closely related to the energy model of complex cells proposed by Adelson and Bergen [79] and Heeger [80], as well as inspired by the fact that odd- and even-shaped receptive fields have been reported to occur in pairs (De Valois et al. [99]). The quasi quadrature serves as an approximation of a quadrature pair, as formulated based on a Hilbert transform (Bracewell [100], pp. 267–272), although instead formulated in terms of affine Gaussian derivatives, which are then summed up in squares in to reduce the phase dependency; see Lindeberg [89] for further details.

Concerning the validity of such an energy-based model of simple cells to model the computational function of complex cells, it is interesting to note that when Touryan et al. [74] extracted the eigenvectors of second-order Wiener kernels to model the computational function of complex cells, the first two eigenvectors turned out the have spatial shapes that very well agree with the shapes of first- and second-order Gaussian derivatives; compare with Fig 5B in Touryan et al. [74]. Hence, even though an energy model of complex cells in terms of the output from a set of simple cells may not be able to span the full flexibility in terms of the possible computational functions of biological complex cells, an approximation of the computational function of a complex cell in terms of an energy model in such a way ought to be able to reveal essential properties of the computational functionalities of complex cells.

Orientation selectivity properties.

In Lindeberg [14,16], the orientation selectivity properties of these idealized models of simple and complex cells were investigated in detail, by computing the responses to sine wave functions of the form

(6)

where denotes the inclination angle of the sine wave in relation to the preferred orientation of the receptive field and β denotes the phase; see Fig 2 for an illustration.

thumbnail
Fig 2. Configuration for probing the orientation selectivity of an idealized receptive field model.

To measure the orientation selectivity properties of an idealized receptive field (here illustrated by the level curves of a first-order derivative of an affine Gaussian kernel in the horizontal direction with preferred orientation ), we compute the response to a sine wave (here illustrated by a set of darker level lines corresponding to the spatial maxima and minima of the sine wave) with inclination angle θ. (Horizontal axis: spatial coordinate x1. Vertical axis: spatial coordinate x2.) (Adapted from Lindeberg [16] OpenAccess.)

https://doi.org/10.1371/journal.pone.0332139.g002

Specifically, in Lindeberg [14,16], it was shown that with

(7)

denoting the ratio between the scale parameters and of the affine Gaussian kernel in the preferred direction vs. the orthogonal direction of the receptive field, the orientation selectivity curves are of the form

(8)

with

  • for an m:th-order model of a simple cell of the form (1) for and
  • for an idealized model of a complex cell of the form (3).

Notably, for all these idealized models of the receptive fields, a smaller value of the scale parameter ratio leads to wider orientation selectivity curves, whereas larger values of lead to more narrow orientation selectivity properties. In this respect, given the assumption that the affine Gaussian derivative model should constitute an appropriate model for the spatial component of simple cells, a variability in the degree of elongation of the receptive fields will correspond to a variability in the orientation selectivity and vice versa.

Results

Generalized idealized models of complex cells

In this work, we will extend the idealized model (3) for complex cells in two major ways:

  • by adding a spatial integration stage, and
  • considering derivatives up to order 4 in addition to derivatives up to order 2.

The motivation for adding a spatial integration stage is that the model for complex cell should then make use of input from more than two simple cells, specifically by accumulating input over multiple positions in the visual field.

The motivation for adding derivatives of higher order than 2 are: (i) to enable more narrow orientation selectivity properties and (ii) in Lindeberg [14] it was shown that models of simple cells up to order 4 lead to better agreement with the orientation selectivity histogram of simple cells recorded by Goris et al. [15] than simple cells up to order 2.

Thus, if we let and denote the directional derivatives in the direction of orders 3 and 4 of convolutions of the input image with affine Gaussian derivative kernels of the form (1):

(9)(10)

as well as consider the previous definitions of and according to (4) and (5), we will consider the following new generalized and integrated affine quasi quadrature measures for modelling complex cells:

(11)(12)(13)

where for the relative integration scale denotes a spatially larger affine Gaussian kernel than the affine Gaussian kernel used for computing the receptive field responses for the idealized models of simple cells. In the following experiments to be reported, we will throughout use the parameter setting .

Structurally, these expressions are similar in the sense that the squares of the directional derivative responses are first integrated for different orders m of spatial differentiation, and then summed of for different subsets , and , respectively. Specifically, the first of these integrated affine quasi quadrature measures can basically be seen as a spatially integrated extension of the pointwise affine quasi quadrature measure in (3).

Orientation selectivity curves for the generalized idealized models of complex cells

To characterize the orientation selectivity properties for the generalized integrated affine quasi quadrature measures (11), (12) and (13), let us first compute the responses for the underlying models of simple cells to a sine wave (6) according to Eqs (29) and (35) in Lindeberg [16]

(14)(15)

and according to Eqs (36) and (42) in the supplementary material of Lindeberg [14]

(16)(17)

where and denote the scale parameters of the affine Gaussian kernel in the horizontal and the vertical directions, respectively.

Let us next integrate the squares of these expressions spatially using a Gaussian window function with relative integration scale , with the actual calculations performed in Wolfram Mathematica and leading to results that are unfortunately too complex to be reproduced here.

(A Wolfram Mathematica notebook with the commands for computing these integrals in closed form, and more generally also generating all the results figures in this paper, including (i) the orientation selectivity curves , (ii) the resultant measures for different degrees of elongation , and (iii) the orientation selectivity histograms of the resultant for the different models for complex cells considered in this paper, is provided as supplementary information “S2 File”.)

Let us furthermore for the parameterization of the vertical scale parameter consider the angular frequencies , , and for which these expressions assume their maxima over angular frequencies according to Eqs (33) and (38) in Lindeberg [16]

(18)(19)

and according to Eqs (40) and (45) in the supplementary material of Lindeberg [14]

(20)(21)

Given these preferred angular frequencies for the different orders of spatial differentiation, let us next for the composed integrated affine quasi quadrature measures (11), (12) and (13) choose the geometric averages of the respective components according to

(22)(23)(24)

and adapt the angular frequency of the probing sine wave in these ways to the respective quasi quadrature measures according to (11), according to (12) and according to (13). This adaptation of the angular frequency of the sine wave to the internal parameters of the model of the complex cell corresponds to probing the corresponding complex cells for different values of the angular frequency ω and then choosing the orientation selectivity curve for the angular frequency that leads to the maximum response over all the frequencies ω.

Fig 3 shows the resulting orientation selectivity curves that we then obtain for different values of the scale parameter ratio , when using the relative integration scale for the spatial integration stage and the weighting factor when combining the responses for different orders m of differentiation. As can be seen from these graphs, for all the three generalized integrated affine quasi quadrature measures, the orientation selectivity curves become sharper with increasing values of the scale parameter ratio . In this respect, these results are consistent with the previously reported results in Lindeberg [14,16].

thumbnail
Fig 3. Graphs of the orientation selectivity curves for the generalized integrated affine quasi quadrature measures according to (11), according to (12) and according to (13),

and which combine integrated squared values of affine Gaussian derivative responses for different combinations of orders of integration when applied to an ideal sine wave of the form (6) with the angular frequency of the sine wave adapted so as to evoke a maximally strong response over the angular frequencies according to (22), (23) and (24), respectively. The resulting orientation selectivity curves are shown for different values of the scale parameter ratio , which parameterizes the degree of elongation of the receptive fields. (Horizontal axes: orientation . Vertical axes: Amplitude of the receptive field response relative to the maximum response obtained for .)

https://doi.org/10.1371/journal.pone.0332139.g003

Specifically, in relation to the previously recorded orientation selectivity curves for biological neurons reported in Nauhaus et al. [22], and which span a variability in orientation selectivity from wide to narrow orientation selectivity properties, these results are consistent with what would be the case if the receptive fields in the primary visual cortex would span a variability in the degree of elongation, as proposed as a working hypothesis in Lindeberg [10] Sect 3.2.1 and further investigated in Lindeberg [14].

Orientation selectivity histograms for the generalized idealized models of complex cells

The previous analysis is qualitative in the sense that it shows that the orientation selectivity curves become sharper for increasing values of the scale parameter ratio , and also in the respect that a variability in the orientation selectivity properties is consistent with an underlying variability in the degree of elongation of the receptive fields.

To aim at a more quantitative analys, let us compare the result of our idealized integrated models of complex cells with the quantitative measurements of orientation selectivity histograms reported by Goris et al. [15]. They accumulated histograms of the absolute value of the resultant with the underlying complex-valued resultant of an orientation selectivity curve of the form

(25)

Fig 4a gives a schematic illustration of the results that they obtained, reflecting a significant variability in wide vs. narrow orientation selectivity properties for different biological complex cells. Fig 4b shows a corresponding prediction of a histogram of the resultant of the orientation selectivity curves obtained in Lindeberg [14], based on the pointwise quasi quadrature measure in (3), and assuming that the scale parameter ratio would be uniformly distributed on a logarithmic scale over the interval for the arbitrary choice of .

thumbnail
Fig 4. Orientation selectivity histogram of the resultant of biological complex cells accumulated by Goris et al. [15] with comparison to histogram of the resultant from previous orientation selectivity analysis of maximally simplified models of complex cells in Lindeberg [14].

(Horizontal axes: 10 quantized bins over the resultant . Vertical axes: bin counts.)

https://doi.org/10.1371/journal.pone.0332139.g004

As can be seen from the comparison between the biological results and the idealized modelling results, the distribution over the resultant is somewhat biased towards both smaller and larger values of , specifically regarding the peaks in the histogram at the bins and , compared to the neurophysiologically accumulated resultant histograms. A natural question to ask is hence if this behaviour would be different if using more developed models of complex cells, that also comprise a spatial integration stage and derivatives of higher order than 2.

Fig 5 shows the result of computing the resultant measure as a function of the scale parameter ratio for each one of the integrated affine quasi quadrature measures , and according to (11), (12) and (13).

thumbnail
Fig 5. Graphs of the resultant for the idealized models of complex cells according to (11), according to (12) and according to (13).

(Horizontal axes in: scale parameter ratio . Vertical axes: resultant .)

https://doi.org/10.1371/journal.pone.0332139.g005

Fig 6a6c show corresponding resultant histograms for each of these integrated affine quasi quadrature measures, when assuming a uniform distribution over a logarithmic parameterization of the scale parameter ratio over the interval for the again arbitrary value of . Such a logarithmic distribution constitutes a natural default prior for a strictly positive variable according to Jaynes [101]. Fig 6d shows a combined histogram of the integrated affine quasi quadrature measures and , when assuming an equal number of idealized complex cells for these two types.

thumbnail
Fig 6. Orientation selectivity histograms for the resultant for (a–c) the integrated affine quasi quadrature measures , and according to (11), (12) and (13), when assuming a uniform distribution over a logarithmic parameterization of the scale parameter ratio , as well as (d) combined histogram of and , when assuming equal numbers of complex cells for these two types.

(Horizontal axes: 10 quantized bins over the resultant . Vertical axes: bin counts.)

https://doi.org/10.1371/journal.pone.0332139.g006

As can be seen from these histograms, the use of the integrated affine quasi quadrature measures , and leads to resultant histograms with different shapes than for pointwise quasi quadrature measure previously studied in Lindeberg [14]. Specifically, except for the peak at the bin corresponding to , the resultant histogram of is more uniform and without any bias the bias towards either smaller values of the resultant towards the bins and as for the resultant histogram of the pointwise quasi quadrature measure .

Additionally, when including third- and fourth-order terms, the integrated affine quasi quadrature measures and lead to accumulations to the bins and , while those bins are not really reached by the pointwise quasi quadrature measure . In these respects, this analysis suggests that the mechanisms of spatial integration and inclusion of higher-order terms than mere first- and second-order terms may be important to more quantitatively model the orientation selectivity properties of complex cells. Furthermore, one may speculate if a suitable reformulation of the non-linearities in the composed integrated affine quasi quadrature measure could move the peak for the bin to the bin positions and that lead to peaks in the resultant histogram for the biological complex cells.

Based on these results, we therefore propose to (i) include an explicit variability over the degree of elongation of the receptive fields, (ii) include third- and fourth-order models of simple cells in addition to previous use of first- and second-order models of simple cells and (iii) integrate non-linear transformations of such receptive field responses over extended regions in image space, when modelling the functional properties of complex cells. Specifically, we propose that the items (i) and (iii) above should be of much wider generality than restricted to computational models based on affine quasi quadrature measures, and thereby also apply to other families of computational models of complex cells.

Explicit predictions for further modelling of complex cells

More explicitly, based on the above results, we can thus state the following general predictions:

Prediction 1 (Flexibility in elongation would lead to better approximation properties when modelling individual complex cells): Given a sufficiently large set of biological complex cells, if the receptive fields of those are modelled by computational models, then such models that involve a flexibility in the degree of elongation of the underlying computational primitives would lead to better approximation properties than for computational models that do not involve a flexibility in the degree of elongation.

Prediction 2 (Variability in elongation over populations of complex cells): If the receptive fields sufficiently large set of complex cells are modelled by computational models that involve a flexibility in the degree of elongation of the underlying computational primitives, then such model fitting would lead to a substantial variability in the degree of elongation of the receptive fields over a sufficiently large population of modelled biological complex cells.

Prediction 3 (Spatial integration as a computational mechanism in complex cells): Given a sufficiently large set of biological complex cells, if their receptive fields are modelled by computational models, then models that are based on spatial integration of underlying computational primitives would lead to better approximation properties than computational models that do not comprise any spatial integration.

Specifically, we propose that these predictions could be explored and influence further modelling of complex cells in terms of mathematically based image primitives.

Explicit suggestion to extension of methodology for experimentally probing the orientation selectivity of complex cells that may comprise a variability in the degree of elongation between different visual neurons.

Furthermore, to allow for better distinctions between the validity of different types of computational models for complex cells, we propose to extend the experimental methodology for measuring the orientation selectivity properties of biological neurons to instead of (i) choosing a single angular frequency for the probing sine wave for generating the visual stimuli for each spatial image orientation, instead (ii) performing a simultaneous two-parameter variation over both the angular frequency and the image orientation. In such a way, the experimental data ought to be better suited for handling biological receptive fields with a variability in elongation. The reason for this, is that the generated visual stimuli would then better probe the dependency of two characteristic inherent spatial scales of the biological receptive fields compared to using a single inherent spatial scale for the visual stimuli.

As described in more detail in Lindeberg [16] Section 7, the choice of the angular frequency for sine wave for probing the orientation selectivity properties of visual neurons can significantly affect the shapes of the resulting orientation selectivity curves, and should thus warrant specific consideration.

Summary and discussion

We have presented a set of three new integrated affine quasi quadrature measures to model the functional properties of complex cells, and analyzed their orientation selectivity properties, based on the assumption that the receptive field shapes should span a variability over the degree of elongation of the simple cells that form the input to these models of complex cells.

This analysis has been performed in three ways; in terms of: (i) orientation selectivity curves, (ii) graphs of the resultant as function of the scale parameter ratio between the scale parameter in the direction perpendicular to the preferred orientation of the receptive field and the scale parameter in the direction of the preferred orientation of the receptive field, and (iii) histograms of the resultant when assuming a logarithmic distribution over the scale parameter ratio .

Specifically, by qualitative comparisons with the biological results by Nauhaus et al. [22], regarding a significant variability in orientation selectivity properties of biological neurons from wide to narrow orientation selectivity properties, and to Goris et al. [15], regarding orientation selectivity histograms over the resultant , we have found that these results are consistent with a previously proposed hypothesis in Lindeberg [10] further investigated in Lindeberg [14] that the receptive fields in the primary visual cortex should span a significant variability in the degree of elongation of the receptive fields. In this respect, the results are consistent with what becomes a natural consequence of stating desirable properties of an idealized vision system, that the receptive fields should be covariant under the natural geometric image transformations. In such a context, covariance properties of the family of receptive fields enable more accurate estimates of cues to the 3-D structure of the world, as the image data used as input to the vision system undergo significant variabilities, as caused by variations of the viewing conditions, such as the distance and the viewing direction between objects in the world and the observer.

Specifically, by simulating the orientation selectivity histograms that result from the presented new integrated affine quasi quadrature measures , and according to (11), (12) and (13), when combined with an assumption of a uniform distribution over the logarithm of the scale parameter ratio of the receptive fields, we have found that the extensions of the previous pointwise quasi quadrature measure according to (3) offer ways of changing the shapes of the predicted orientation selectivity histograms regarding both how uniform the predicted histograms will be in relation to the previously recorded biological orientation selectivity histograms by Goris et al. [15] and regarding the span of values of the resultant they cover.

Thus, we propose to: (i) include a variability over the degree of elongation of the receptive fields when modelling the computational function of complex cells, (ii) include the mechanisms of spatial integration and including receptive field responses of higher order than 2 when modelling complex cells, and (iii) use similar criteria to match predicted orientation selectivity histograms to biological orientation selectivity histograms, as used in the presented analysis, to evaluate also other types of computational models for complex cells.

Let us finally remark that it should most likely be the case that the non-linear behaviour of complex cells may be more complex than the computational mechanisms used in the proposed idealized models in terms of integrated affine quasi quadrature measures. The overall purpose with this work is on the other hand to demonstrate that the orientation selectivity properties of the proposed idealized models of complex cells can be analyzed with a structurally similar methodology as used for probing the orientation selectivity properties of biological receptive fields. From this viewpoint, the comparison to the biological orientation selectivity histogram accumulated by Goris et al. [15] is specifically to show that the gross behaviour in terms of an underlying distribution of receptive field shapes of different elongation can be used to reflect gross properties of the biological measurements. Our intention in this respect is to stimulate further tests of more complex computational models of complex cells, based on assuming distributions of the underlying receptive field shapes over the degree of elongation. The set of more explicit predictions in the section “Explicit predictions for further modelling of complex cells” are specifically aimed at providing a guide to such further research.

The proposed extension of the methodology for characterizing the orientation selectivity of visual neurons in the section “Explicit suggestion to extension of methodology for experimentally probing the orientation selectivity of complex cells that may comprise a variability in the degree of elongation between different visual neurons”, by instead of performing a one-parameter variation over the orientation of the probing sine wave instead performing a two-parameter variation over both the angular frequency and the orientation of the probing sine wave, is intended to provide richer experimental data that could better distinguish between the explanatory properties of different types of computational models of complex cells.

From the viewpoint of quasi quadrature models to be used for addressing computational tasks in computer vision, it should on the other hand also be mentioned that a hierarchical network constructed by applying a substantially simplified quasi quadrature model of complex cells in cascade can lead to quite reasonable results on computer vision benchmarks (Lindeberg [89]); see also the closely related work by Riesenhuber and Poggio [102], Serre et al. [103] and Pant et al. [104], who construct hierarchical networks for computer vision tasks from sets of idealized models of simple and complex cells coupled in cascade. These studies in computational vision do thus demonstrate that computational mechanisms structurally closely related to the affine quasi quadrature measures proposed and studied in this work can support spatial recognition tasks on visual data.

Supporting information

S1 File. Complementary explanations of main concepts used in the paper Lin25-PONE-suppl.pdf.

Explains the terminology regarding “receptive field”, “covariance”, “elongation” and “complex cell”.

https://doi.org/10.1371/journal.pone.0332139.s001

(PDF)

S2 File. Wolfram Mathematica notebook int-compl-ori-sel.nb.

Contains the Wolfram Mathematica commands used for generating the results presented in this paper, and specifically computing (i) the orientation selectivity curves , (ii) the resultant measures for different degrees of elongation , and (iii) the histograms of the resultant for the idealized models of complex cells proposed in this paper, given logarithmic distributions over the degree of elongation of the models in simple cells used for computing the responses of complex cells by spatially integrated quadratic computations.

https://doi.org/10.1371/journal.pone.0332139.s002

(NB)

Acknowledgments

I would like to thank the Editor and the Reviewers for valuable comments that have improved the presentation.

References

  1. 1. Hubel DH, Wiesel TN. Receptive fields of single neurones in the cat’s striate cortex. J Physiol. 1959;147:226–38.
  2. 2. Hubel DH, Wiesel TN. Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex. J Physiol. 1962;160(1):106–54. pmid:14449617
  3. 3. Hubel DH, Wiesel TN. Receptive fields and functional architecture of monkey striate cortex. The Journal of Physiology. 1968;195(1):215–43.
  4. 4. Hubel DH, Wiesel TN. Brain and visual perception: The story of a 25-year collaboration. Oxford University Press; 2005.
  5. 5. Lindeberg T. Normative theory of visual receptive fields. Heliyon. 2021;7(1):e05897. pmid:33521348
  6. 6. DeAngelis GC, Ohzawa I, Freeman RD. Receptive field dynamics in the central visual pathways. Trends in Neuroscience. 1995;18(10):451–7.
  7. 7. DeAngelis GC, Anzai A. A modern view of the classical receptive field: Linear and non-linear spatio-temporal processing by V1 neurons. In: Chalupa LM, Werner JS, editors. The Visual Neurosciences. MIT Press; 2004. p. 704–19.
  8. 8. Conway BR, Livingstone MS. Spatial and temporal properties of cone signals in alert macaque primary visual cortex. J Neurosci. 2006;26(42):10826–46. pmid:17050721
  9. 9. Johnson EN, Hawken MJ, Shapley R. The orientation selectivity of color-responsive neurons in macaque V1. J Neurosci. 2008;28(32):8096–106. pmid:18685034
  10. 10. Lindeberg T. Covariance properties under natural image transformations for the generalised Gaussian derivative model for visual receptive fields. Front Comput Neurosci. 2023;17:1189949. pmid:37398936
  11. 11. Lindeberg T. Relationships between the degrees of freedom in the affine Gaussian derivative model for visual receptive fields and 2-D affine image transformations, with application to covariance properties of simple cells in the primary visual cortex. Biological Cybernetics. 2025;119(2–3):15:1-25.
  12. 12. Lindeberg T. Unified theory for joint covariance properties under geometric image transformations for spatio-temporal receptive fields according to the generalized Gaussian derivative model for visual receptive fields. Journal of Mathematical Imaging and Vision. 2025;67:44:1-49.
  13. 13. Lindeberg T, Gårding J. Shape-adapted smoothing in estimation of 3-D shape cues from affine distortions of local 2-D structure. Image and Vision Computing. 1997;15(6):415–34.
  14. 14. Lindeberg T. Do the receptive fields in the primary visual cortex span a variability over the degree of elongation of the receptive fields?. J Comput Neurosci. 2025;53(3):397–417. pmid:40540232
  15. 15. Goris RLT, Simoncelli EP, Movshon JA. Origin and function of tuning diversity in macaque visual cortex. Neuron. 2015;88(4):819–31. pmid:26549331
  16. 16. Lindeberg T. Orientation selectivity properties for the affine Gaussian derivative and the affine Gabor models for visual receptive fields. J Comput Neurosci. 2025;53(1):61–98. pmid:39878929
  17. 17. Watkins DW, Berkley MA. The orientation selectivity of single neurons in cat striate cortex. Exp Brain Res. 1974;19(4):433–46. pmid:4827868
  18. 18. Rose D, Blakemore C. An analysis of orientation selectivity in the cat’s visual cortex. Exp Brain Res. 1974;20(1):1–17. pmid:4844166
  19. 19. Schiller PH, Finlay BL, Volman SF. Quantitative studies of single-cell properties in monkey striate cortex. II. Orientation specificity and ocular dominance. J Neurophysiol. 1976;39(6):1320–33. pmid:825622
  20. 20. Albright TD. Direction and orientation selectivity of neurons in visual area MT of the macaque. J Neurophysiol. 1984;52(6):1106–30. pmid:6520628
  21. 21. Ringach DL, Shapley RM, Hawken MJ. Orientation selectivity in macaque V1: diversity and laminar dependence. J Neurosci. 2002;22(13):5639–51. pmid:12097515
  22. 22. Nauhaus I, Benucci A, Carandini M, Ringach DL. Neuronal selectivity and local map structure in visual cortex. Neuron. 2008;57(5):673–9. pmid:18341988
  23. 23. Scholl B, Tan AYY, Corey J, Priebe NJ. Emergence of orientation selectivity in the Mammalian visual pathway. J Neurosci. 2013;33(26):10616–24. pmid:23804085
  24. 24. Sadeh S, Rotter S. Statistics and geometry of orientation selectivity in primary visual cortex. Biol Cybern. 2014;108(5):631–53. pmid:24248916
  25. 25. Sasaki KS, Kimura R, Ninomiya T, Tabuchi Y, Tanaka H, Fukui M, et al. Supranormal orientation selectivity of visual neurons in orientation-restricted animals. Sci Rep. 2015;5:16712. pmid:26567927
  26. 26. Somers DC, Nelson SB, Sur M. An emergent model of orientation selectivity in cat visual cortical simple cells. J Neurosci. 1995;15(8):5448–65. pmid:7643194
  27. 27. Sompolinsky H, Shapley R. New perspectives on the mechanisms for orientation selectivity. Curr Opin Neurobiol. 1997;7(4):514–22. pmid:9287203
  28. 28. Carandini M, Ringach DL. Predictions of a recurrent model of orientation selectivity. Vision Research. 1997;37(21):3061–71.
  29. 29. Lampl I, Anderson JS, Gillespie DC, Ferster D. Prediction of orientation selectivity from receptive field architecture in simple cells of cat visual cortex. Neuron. 2001;30(1):263–74. pmid:11343660
  30. 30. Ferster D, Miller KD. Neural mechanisms of orientation selectivity in the visual cortex. Annu Rev Neurosci. 2000;23:441–71. pmid:10845071
  31. 31. Shapley R, Hawken M, Ringach DL. Dynamics of orientation selectivity in the primary visual cortex and the importance of cortical inhibition. Neuron. 2003;38(5):689–99. pmid:12797955
  32. 32. Seriès P, Latham PE, Pouget A. Tuning curve sharpening for orientation selectivity: coding efficiency and the impact of correlations. Nat Neurosci. 2004;7(10):1129–35. pmid:15452579
  33. 33. Hansel D, van Vreeswijk C. The mechanism of orientation selectivity in primary visual cortex without a functional map. J Neurosci. 2012;32(12):4049–64. pmid:22442071
  34. 34. Moldakarimov S, Bazhenov M, Sejnowski TJ. Top-down inputs enhance orientation selectivity in neurons of the primary visual cortex during perceptual learning. PLoS Comput Biol. 2014;10(8):e1003770. pmid:25121603
  35. 35. Gonzalo Cogno S, Mato G. The effect of synaptic plasticity on orientation selectivity in a balanced model of primary visual cortex. Front Neural Circuits. 2015;9:42. pmid:26347615
  36. 36. Priebe NJ. Mechanisms of orientation selectivity in the primary visual cortex. Annu Rev Vis Sci. 2016;2:85–107. pmid:28532362
  37. 37. Pattadkal JJ, Mato G, van Vreeswijk C, Priebe NJ, Hansel D. Emergent orientation selectivity from random networks in mouse visual cortex. Cell Rep. 2018;24(8):2042-2050.e6. pmid:30134166
  38. 38. Nguyen G, Freeman AW. A model for the origin and development of visual orientation selectivity. PLoS Comput Biol. 2019;15(7):e1007254. pmid:31356590
  39. 39. Merkt B, Schüßler F, Rotter S. Propagation of orientation selectivity in a spiking network model of layered primary visual cortex. PLoS Comput Biol. 2019;15(7):e1007080. pmid:31323031
  40. 40. Wei W, Merkt B, Rotter S. A theory of orientation selectivity emerging from randomly sampling the visual field. bioRxiv. 2022; p. 2022–07.18.500396.
  41. 41. Wang H, Dey O, Lagos WN, Behnam N, Callaway EM, Stafford BK. Parallel pathways carrying direction-and orientation-selective retinal signals to layer 4 of the mouse visual cortex. Cell Rep. 2024;43(3):113830. pmid:38386556
  42. 42. Koenderink JJ. The structure of images. Biol Cybern. 1984;50(5):363–70. pmid:6477978
  43. 43. Koenderink JJ, van Doorn AJ. Representation of local geometry in the visual system. Biological Cybernetics. 1987;55(6):367–75.
  44. 44. Koenderink JJ, van Doorn AJ. Generic neighborhood operators. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1992;14(6):597–605.
  45. 45. Young RA. The Gaussian derivative model for spatial vision: I. Retinal mechanisms. Spat Vis. 1987;2(4):273–93. pmid:3154952
  46. 46. Young RA, Lesperance RM, Meyer WW. The Gaussian derivative model for spatial-temporal vision: I. Cortical model. Spat Vis. 2001;14(3–4):261–319. pmid:11817740
  47. 47. Young RA, Lesperance RM. The Gaussian derivative model for spatial-temporal vision: II. Cortical data. Spat Vis. 2001;14(3–4):321–89. pmid:11817741
  48. 48. Lindeberg T. A computational theory of visual receptive fields. Biol Cybern. 2013;107(6):589–635. pmid:24197240
  49. 49. Marcelja S. Mathematical description of the responses of simple cortical cells. J Opt Soc Am. 1980;70(11):1297–300. pmid:7463179
  50. 50. Jones JP, Palmer LA. The two-dimensional spatial structure of simple receptive fields in cat striate cortex. J Neurophysiol. 1987;58(6):1187–211. pmid:3437330
  51. 51. Jones JP, Palmer LA. An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. J Neurophysiol. 1987;58(6):1233–58. pmid:3437332
  52. 52. Porat M, Zeevi YY. The generalized Gabor scheme of image representation in biological and machine vision. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1988;10(4):452–68.
  53. 53. Lowe DG. Towards a computational model for object recognition in IT cortex. Biologically motivated computer vision. Springer; 2000. p. 20–31.
  54. 54. May KA, Georgeson MA. Blurred edges look faint, and faint edges look sharp: the effect of a gradient threshold in a multi-scale edge coding model. Vision Res. 2007;47(13):1705–20. pmid:17442367
  55. 55. Hesse GS, Georgeson MA. Edges and bars: where do people see features in 1-D images?. Vision Res. 2005;45(4):507–25. pmid:15610754
  56. 56. Georgeson MA, May KA, Freeman TCA, Hesse GS. From filters to features: scale-space analysis of edge and blur coding in human vision. J Vis. 2007;7(13):7.1-21. pmid:17997635
  57. 57. Hansen T, Neumann H. A recurrent model of contour integration in primary visual cortex. J Vis. 2008;8(8):8.1-25. pmid:18831631
  58. 58. Wallis SA, Georgeson MA. Mach edges: local features predicted by 3rd derivative spatial filtering. Vision Res. 2009;49(14):1886–93. pmid:19426750
  59. 59. Wang Q, Spratling MW. Contour detection in colour images using a neurophysiologically inspired model. Cognitive Computation. 2016;8(6):1027–35.
  60. 60. Pei Z-J, Gao G-X, Hao B, Qiao Q-L, Ai H-J. A cascade model of information processing and encoding for retinal prosthesis. Neural Regen Res. 2016;11(4):646–51. pmid:27212929
  61. 61. Ghodrati M, Khaligh-Razavi S-M, Lehky SR. Towards building a more complex view of the lateral geniculate nucleus: recent advances in understanding its role. Prog Neurobiol. 2017;156:214–55. pmid:28634086
  62. 62. Kristensen DG, Sandberg K. Population receptive fields of human primary visual cortex organised as DC-balanced bandpass filters. Sci Rep. 2021;11(1):22423. pmid:34789812
  63. 63. Abballe L, Asari H. Natural image statistics for mouse vision. PLoS One. 2022;17(1):e0262763. pmid:35051230
  64. 64. Ruslim MA, Burkitt AN, Lian Y. Learning spatio-temporal V1 cells from diverse LGN inputs. bioRxiv. 2023;:2023-11.30.569354.
  65. 65. Wendt G, Faul F. Binocular luster elicited by isoluminant chromatic stimuli relies on mechanisms similar to those in the achromatic case. J Vis. 2024;24(3):7. pmid:38536184
  66. 66. Ringach DL. Spatial structure and symmetry of simple-cell receptive fields in macaque primary visual cortex. J Neurophysiol. 2002;88(1):455–63. pmid:12091567
  67. 67. Ringach DL. Mapping receptive fields in primary visual cortex. J Physiol. 2004;558(Pt 3):717–28. pmid:15155794
  68. 68. Walker EY, Sinz FH, Cobos E, Muhammad T, Froudarakis E, Fahey PG, et al. Inception loops discover what excites neurons most using deep predictive models. Nat Neurosci. 2019;22(12):2060–5. pmid:31686023
  69. 69. De A, Horwitz GD. Spatial receptive field structure of double-opponent cells in macaque V1. J Neurophysiol. 2021;125(3):843–57. pmid:33405995
  70. 70. Movshon JA, Thompson ID, Tolhurst DJ. Receptive field organization of complex cells in the cat’s striate cortex. J Physiol. 1978;283:79–99. pmid:722592
  71. 71. Emerson RC, Citron MC, Vaughn WJ, Klein SA. Nonlinear directionally selective subunits in complex cells of cat striate cortex. J Neurophysiol. 1987;58(1):33–65. pmid:3039079
  72. 72. Martinez LM, Alonso JM. Construction of complex receptive fields in cat primary visual cortex. Neuron. 2001;32(3):515–25. pmid:11709161
  73. 73. Touryan J, Lau B, Dan Y. Isolation of relevant visual features from random stimuli for cortical complex cells. J Neurosci. 2002;22(24):10811–8. pmid:12486174
  74. 74. Touryan J, Felsen G, Dan Y. Spatial structure of complex cell receptive fields measured with natural images. Neuron. 2005;45(5):781–91. pmid:15748852
  75. 75. Rust NC, Schwartz O, Movshon JA, Simoncelli EP. Spatiotemporal elements of Macaque V1 receptive fields. Neuron. 2005;46(6):945–56.
  76. 76. van Kleef JP, Cloherty SL, Ibbotson MR. Complex cell receptive fields: evidence for a hierarchical mechanism. J Physiol. 2010;588(Pt 18):3457–70. pmid:20660567
  77. 77. Li YT, Liu BH, Chou XL, Zhang LI, Tao HW. Synaptic basis for differential orientation selectivity between complex and simple cells in mouse visual cortex. Journal of Neuroscience. 2015;35(31):11081–93.
  78. 78. Almasi A, Meffin H, Cloherty SL, Wong Y, Yunzab M, Ibbotson MR. Mechanisms of feature selectivity and invariance in primary visual cortex. Cereb Cortex. 2020;30(9):5067–87. pmid:32368778
  79. 79. Adelson EH, Bergen JR. Spatiotemporal energy models for the perception of motion. J Opt Soc Am A. 1985;2(2):284–99. pmid:3973762
  80. 80. Heeger DJ. Normalization of cell responses in cat striate cortex. Vis Neurosci. 1992;9(2):181–97. pmid:1504027
  81. 81. Serre T, Riesenhuber M. Realistic modeling of simple, complex cell tuning in the HMAX model and implications for invariant object recognition in cortex. AI Memo 2004 -017. MIT Computer Science and Artificial Intelligence Laboratory; 2004.
  82. 82. Einhäuser W, Kayser C, König P, Körding KP. Learning the invariance properties of complex cells from their responses to natural stimuli. Eur J Neurosci. 2002;15(3):475–86. pmid:11876775
  83. 83. Körding KP, Kayser C, Einhäuser W, König P. How are complex cell properties adapted to the statistics of natural stimuli?. J Neurophysiol. 2004;91(1):206–12. pmid:12904330
  84. 84. Merolla P, Boahn K. A recurrent model of orientation maps with simple and complex cells. In: Advances in Neural Information Processing Systems (NIPS 2004); 2004. p. 995–1002.
  85. 85. Berkes P, Wiskott L. Slow feature analysis yields a rich repertoire of complex cell properties. J Vis. 2005;5(6):579–602. pmid:16097870
  86. 86. Carandini M. What simple and complex cells compute. The Journal of Physiology. 2006;577(2):463–6.
  87. 87. Hansard M, Horaud R. A differential model of the complex cell. Neural Computation. 2011;23(9):2324–57.
  88. 88. Franciosini A, Boutin V, Perrinet L. Modelling complex cells of early visual cortex using predictive coding. In: Proceedings of the 28th Annual Computational Neuroscience Meeting; 2019. https://laurentperrinet.github.io/publication/franciosini-perrinet-19-cns/franciosini-perrinet-19-cns.pdf
  89. 89. Lindeberg T. Provably scale-covariant continuous hierarchical networks based on scale-normalized differential expressions coupled in cascade. Journal of Mathematical Imaging and Vision. 2020;62(1):120–48.
  90. 90. Lian Y, Almasi A, Grayden DB, Kameneva T, Burkitt AN, Meffin H. Learning receptive field properties of complex cells in V1. PLoS Comput Biol. 2021;17(3):e1007957. pmid:33651790
  91. 91. Oleskiw TD, Lieber JD, Simoncelli EP, Movshon JA. Foundations of visual form selectivity for neurons in macaque V1 and V2. bioRxiv. 2024.
  92. 92. Yedjour H, Yedjour D. A spatiotemporal energy model based on spiking neurons for human motion perception. Cogn Neurodyn. 2024;18(4):2015–29. pmid:39104665
  93. 93. Nguyen P, Sooriyaarachchi J, Huang Q, Baker CL Jr. Estimating receptive fields of simple and complex cells in early visual cortex: a convolutional neural network model with parameterized rectification. PLoS Comput Biol. 2024;20(5):e1012127. pmid:38820562
  94. 94. Almasi A, Sun SH, Jung YJ, Ibbotson M, Meffin H. Data-driven modelling of visual receptive fields: comparison between the generalized quadratic model and the nonlinear input model. J Neural Eng. 2024;21(4):10.1088/1741-2552/ad5d15. pmid:38941988
  95. 95. Rowekamp RJ, Sharpee TO. Computations that sustain neural feature selectivity across processing stages. PLoS Comput Biol. 2025;21(6):e1013075. pmid:40540478
  96. 96. Tinsley CJ, Webb BS, Barraclough NE, Vincent CJ, Parker A, Derrington AM. The nature of V1 neural responses to 2D moving patterns depends on receptive-field structure in the marmoset monkey. J Neurophysiol. 2003;90(2):930–7. pmid:12711710
  97. 97. Xu T, Li M, Chen K, Wang L, Yan HM. Aspect ratio of the receptive field makes a major contribution to the bandwidth of orientation selectivity in cat V1. In: Advances in Cognitive Neurodynamics (V) Proceedings of the Fifth International Conference on Cognitive Neurodynamics-2015; 2016. p. 133–42.
  98. 98. Lindeberg T. Dense scale selection over space, time and space-time. SIAM Journal on Imaging Sciences. 2018;11(1):407–41.
  99. 99. De Valois RL, Cottaris NP, Mahon LE, Elfar SD, Wilson JA. Spatial and temporal receptive fields of geniculate and cortical cells and directional selectivity. Vision Res. 2000;40(27):3685–702. pmid:11090662
  100. 100. Bracewell RN. The Fourier Transform and its Applications. New York: McGraw-Hill; 1999.
  101. 101. Jaynes ET. Prior probabilities. Transactions on Systems Science and Cybernetics. 1968;4(3):227–41.
  102. 102. Riesenhuber M, Poggio T. Hierarchical models of object recognition in cortex. Nat Neurosci. 1999;2(11):1019–25. pmid:10526343
  103. 103. Serre T, Wolf L, Bileschi S, Riesenhuber M, Poggio T. Robust object recognition with cortex-like mechanisms. IEEE Trans Pattern Anal Mach Intell. 2007;29(3):411–26. pmid:17224612
  104. 104. Pant N, Rodriguez IF, Beniwal A, Warren S, Serre T. HMAX strikes back: Self-supervised learning of human-like scale invariant representations. In: Cognitive Computational Neuroscience; 2024.