Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Pupillary response to real, illusory, and implied motion

  • Serena Castellotti,

    Roles Data curation, Formal analysis, Investigation, Methodology, Software, Writing – original draft

    Affiliation Department of Neurofarba, University of Florence, Florence, Italy

  • Carlo Francisci,

    Roles Data curation, Investigation

    Affiliation Department of Neurofarba, University of Florence, Florence, Italy

  • Maria Michela Del Viva

    Roles Conceptualization, Data curation, Funding acquisition, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing

    maria.delviva@unifi.it

    Affiliation Department of Neurofarba, University of Florence, Florence, Italy

Pupillary response to real, illusory, and implied motion

  • Serena Castellotti, 
  • Carlo Francisci, 
  • Maria Michela Del Viva
PLOS
x

Abstract

The perception of moving objects (real motion) is a critical function for interacting with a dynamic environment. Motion perception can be also induced by particular structural features of static images (illusory motion) or by photographic images of subjects in motion (implied motion, IM). Many cortical areas are involved in motion processing, particularly the medial temporal cortical area (MT), dedicated to the processing of real, illusory, and implied motion. Recently, there has been a growing interest in the influence of high-level visual processes on pupillary responses. However, just a few studies have measured the effect of motion processing on the pupil, and not always with consistent results. Here we systematically investigate the effects of real, illusory, and implied motion on the pupil diameter for the first time, by showing different types of stimuli (movies, illusions, and photos) with the same average luminance to the same observers. We find different pupillary responses depending on the nature of motion. Real motion elicits a larger pupillary dilation than IM, which in turn induces more dilation than control photos representing static subjects (No-IM). The pupil response is sensitive even to the strength of IM, as photos with enhanced IM (blur, motion streaks, speed lines) induce larger dilation than simple freezed IM (subjects captured in the instant they are moving). Also, the subject represented in the stimulus matters: human figures are interpreted as more dynamic and induce larger dilation than objects/animals. Interestingly, illusory motion induces much less dilation than all the other motion categories, despite being seen as moving. Overall, pupil responses depend on the individual perception of dynamicity, confirming that the pupil is modulated by the subjective interpretation of complex stimuli. We argue that the different pupillary responses to real, illusory, and implied motion reflect the top-down modulations of different cortical areas involved in their processing.

Introduction

Motion perception, defined as the perception of change of position of an object over time, is a crucial function for successfully interacting with a dynamic environment and is fundamental for survival [1, 2]. The neural activity of the medial temporal/medial superior temporal areas (MT+/V5+ and MST) of monkeys is dedicated to process directionality and speed [37] of moving visual stimuli. This seems to be true for humans as well, as demonstrated by anatomical [810], PET [1113], and fMRI studies [1417]. Damages to the MT area in humans may selectively impair movement perception [18].

Humans can perceive motion even in static images due to the combined effect of particular structural features, such as colors, contrast, shapes, and their position (illusory motion) [1922]. Visual motion areas dedicated to real motion processing have been shown to be active in the presence of illusory motion as well [2325]. For instance, apparent motion of figures defined by illusory contours evokes a considerable fMRI activation in V2 and MT/MST [23]. PET studies found an increase of regional cerebral blood flow (rCBF) in V5 while observers perceived illusory motion, similar to that recorded while the same observers viewed a physically moving stimulus [25]. Surprisingly though, illusory motion stimuli do not elicit significant activity in V1, which is highly active when real motion stimuli are presented. Cortical areas other than the visual cortex are also activated during observation of motion illusions, but not during the presentation of real moving objects [25]. It has been speculated that the activity in these non-visual areas, particularly the cingulate gyrus, is related to attention [25]. Overall, perception of illusory motion seems to depend on the activity of specialized visual motion areas but also on the activity of other brain regions that are not involved in the processing of real motion [25].

Visual motion can be also perceived in stimuli that are static in nature but representing motion situations (Implied motion, IM). That is, we are able to perceive a dynamic visual scene from static images that show directional information or particular form elements [2633]. The impression of movement of a subject in a static image can be conveyed by different cues, such as action sequencing, action freezing, motion streaks/speed lines, or motion blur in the direction of the represented movement [3441]. The dynamic state of a subject in a still image can even be inferred from the complex shape of the subject itself, as its postural expression, arms or legs position, or muscular tension [32, 37, 42], showing that the extraction of motion information from stationary pictures is a process of inference, that can also involve prior experiences [28].

Several fMRI and neurophysiological studies suggested that the perception of real and implied motion share the same neural substrates. It has been shown that the same subpopulations of cells in dorsal areas responding to real motion are also responsive for implied motion, showing that they are indifferent to the cue (implied or real) that generates the motion [43, 44]. Even motion after-effect (MAE), caused by prior exposure to motion in the opposite direction [45] and mediated by MT [14], can be induced by viewing a series of static photographs with implied motion in a particular direction [32]. Furthermore, the prototypical visual motion areas (MT+/MST) seem to be more active with real-life pictures depicting implied motion rather than static subjects [26, 28, 29, 31, 44]. For example, stronger fMRI activation within MT+/MST areas has been found with photographs of athletes in action compared with humans at rest, or even with nature scenes depicting inanimate motion [44]. MT activity resulted to be modulated in relation to the degrees of dynamism and speed inherent within images [29, 31]. Even the observation of a sculpture specifically settled out to convey an impression of dynamicity, was found to influence intracortical excitability of the motor cortex [26]. Several other studies found that V5 is involved in extracting motion information from complex pictorial representations, such as figurative paintings depicting subjects in movement [4648] or even abstract paintings without any representational content [47, 49]. Given the existing evidence for specialized cortical areas for visual processing of the human body (Extrastriate Body Area, EBA) and faces (Fusiform Face Area, FFA, and Occipital Face Area, OFA) [5057], the investigation of motion’s processing should take into account the nature of the subject. Indeed, the perception of implied motion operates differently when the subject presented is a human figure, due to our inherent tendency to infer other people’s intentions from their actions [5860]. Several studies showed higher activation of motion areas for stimuli depicting humans in action than inanimate objects depicted as moving [61]. Besides MT+, human-implied motion seems also to involve activation of a larger number of cortical areas, than non-human IM, including the superior temporal sulcus, the motor cortex, and the mirror system areas [29, 6264].

Recently, there has been a growing interest in high-level cognitive processes, elaborated at cortical level, that have an influence on the pupillary response. Indeed, it is now well established that the pupillary light reflex (PLR), the low-level mechanism that simply regulates the amount of light entering the eye [65, 66], is not the only factor that modulates the pupil size. Pupil size can also dilate under steady lighting conditions in response to a range of cognitively relevant factors including changes in stimulus salience, mental effort, and internal states [6770]; all linked to an increased level of arousal mediated by the activation of the sympathetic nervous system [67, 7173]. More recently, pupillometry studies have focused on the investigation of the effects of high-level visual processes on the pupil diameter, such as visual attention [7480], perceptual illusions [8183], visual imagery [84, 85], high-level processing of images content [74, 75, 86, 87], and interpretation of complex stimuli like paintings [88].

Despite several studies on top-down modulations of the pupil, the effect of cognitive interpretation of motion has not yet been systematically investigated. Very few studies tried to measure the pupil size in response to motion processing; and those who did provided contrasting results [89, 90]. As an example, the onset of coherent movement generated in a pattern of random dots has been found to trigger pupil constriction, that cannot be accounted for in terms of PLR [90]. This effect has been linked to the changes in neural activity in the visual cortex occurring in case of sudden changes of stimulus properties [9092]. Instead, pupil dilation was found in response to illusory motion in peripheral drift images and this result was attributed to the physiologically arousing nature of illusory motion [89].

These findings suggest that cortical mechanisms involved in motion processing may influence pupil size independently on luminance changes, but they do not allow to reach exhaustive conclusions on how the pupil responds to motion, especially in connection to the different types of motion. These studies perhaps suggest the existence of different pathways and mechanisms regulating pupil dilation in response to real and illusory motion but given the differences in stimuli and procedures, a comparison of them may be not appropriate.

In the present work, we systematically investigate the effect of motion perception and interpretation on the pupillary response, by showing different types of stimuli with the same average luminance to the same group of observers. To explore the effects of real, illusory, and implied motion we use respectively movies with moving objects/animals or humans, visual illusions that convey the perception of motion, and photographs with dynamic scenes of moving objects/animals or humans. Since human images, both static and in motion (e.g., biological motion) are processed by selective neural processes, we choose stimuli both with humans and animals or objects to explore the possibility that they might have different effects on the pupillary response, a question never experimentally investigated so far.

It is known that pupil responses are modulated by the subjective interpretation of images [81, 84, 87, 88]. For this reason, we assess for each image the degree of motion perceived by participants with a rating test. The results of the test are used in the analysis of pupil responses for each motion category. Using a single experimental paradigm and stimuli with matching physical luminance, our study may allow a comparison of the effect of different types of motion on the pupil size, broadening the knowledge about the influence of motion cognitive processing on the pupil.

Materials and methods

Participants

Twenty-four participants (15 women and 9 men, mean age = 25 ± 3 years) took part in the experiment. All selected participants had a normal or corrected-to-normal vision (by contact lenses) and did not take any type of medication. Participants were asked to not wear eye makeup. Participants were unaware of the aim of the experiment and gave written informed consent prior the participation. All experimental procedures were approved by the local ethics committee (Comitato Etico Pediatrico Regionale—Azienda Ospedaliero-Universitaria Meyer—Firenze FI) and were compliant with the Declaration of Helsinki.

Apparatus and set-up

Stimuli were displayed on a 51 x 29 cm ASUS monitor (MX239H) with a resolution of 1920 x 1080 pixels. The observer was positioned at a 57 cm distance from the monitor with a chin rest to stabilize the head position. Stimulus presentation and data collection programs were developed using the Psychophysics Toolbox extensions [9395] for Matlab (R2016b version). The experimental procedure was carried out in a dark room with no illumination other than the display screen. The diameter of both eyes was measured with a CRS LiveTrack FM system (Cambridge Research Systems) at 60 Hz, collecting 240 data points per trial. Throughout the whole pupil recording, the experimenter monitored the corrected position of the participants’ eyes by using a camera (using QuickTime software) on a dedicated computer (iMac Retina 5K, 27-inch, mid 2015 3.3 GHz Intel Core i5 processor, MacOs Sierra software 10.12.6). Participants’ manual responses to the final rating test were provided on a standard Dell keyboard. JASP software (Version 0.8.6) was used for statistical analyses.

Procedure

The experimental procedure consisted of 100 trials, divided into six blocks: from blocks 1 to 4 static stimuli (photos and illusions, 70 total) were shown, block 5 consisted of 20 movies, and in block 6 10 illusions’ control images were presented. The sequence of stimuli presentation was randomly predetermined and kept the same for all observers. Before the first and the third block, a standard nine-point calibration routine was run to ensure the correct working of the eye tracker. There was a pause of about 5 minutes between blocks. Trials started with the presentation of a fixation slide (124 cd/m2) for 2 seconds, with a black fixation cross (5 x 5 mm) in the center. This was followed by the presentation of one stimulus for 2 seconds, keeping the fixation cross visible in the center of the screen. Participants were required to look at the stimuli without performing any other task, and they were not aware of the motion rating test we proposed after the pupil recording. To avoid any effect of eye movements on pupil size, during fixation and stimulus presentation participants were instructed to refrain from blinking and to maintain their gaze on the fixation cross without exploring the stimuli with eye movements. Fixation was monitored by the experimenter (see Apparatus and set-up section). The luminance of the background screen was kept constant at 124 cd/m. Each trial was followed by the presentation of a blank screen (124 cd/m2) of 2 seconds, while pupil recording was suspended. During this inter-trial interval, participants were allowed to blink and rest their eyes before the next trial, preventing the build-up of after-images and allowing the pupil to return its baseline size (Fig 1A).

thumbnail
Fig 1. Procedure and stimuli.

(A) Schematic of the experimental paradigm. Image shown is n° 67 of S1 List. (B) Examples of photos representing different motion categories and content. Images (from left to right) are n° 44, 59, 63, 4, 18, and 22 of S1 List. (C) Example of motion illusion (n° 88 of S1 List) and its control image. (D) Examples of movies of animated and inanimate subjects, represented here with a single frame. Images (from up to down) are extracted from movies n° 76 and 35 of S1 List. Images shown are copyright-free. All experimental stimuli, except controls for illusions, were retrieved from Internet (see S1 List for web sources).

https://doi.org/10.1371/journal.pone.0254105.g001

After the recordings, all the static stimuli (photos and illusions) were presented again in the same sequence to the observers without time limitation. Observers were asked to rate from 0 to 2 the degree of motion (implied or illusory) they perceived in each (0—No motion; 1—Weak motion, 2—Strong motion), by pressing a computer key. The results of the rating were used as detailed in the Data processing section.

The complete procedure took about 45 minutes per observer, about 30 minutes of which were for pupil recordings.

Stimuli

Before the experiment, an initial set of 120 photos and illusions had been rated by a group of 15 naive judges that did not take part to data collection, on a 3 levels Likert scale—0 (no motion), 1 (weak motion), 2 (strong motion). The images that reached the higher agreement between the judges (never less than 70%) were selected in the final sample of stimuli. Each image was then nominally assigned to one of the different categories of the experiment, based on this motion rating.

The selected images were 60 realistic photos and 10 optical illusions (see S1 List for web sources). Photos consisted of 20 pictures of static subjects (nominal categorization as “No-implied motion”, No-IM), 40 pictures of dynamic subjects (“Implied motion”, IM). Twenty of these photos capture subjects while they are moving (“Freezed IM”), and 20 were purposely created by photographers to enhance the presence of motion—for example showing action sequencing, motion streaks, speed lines, blurred subjects, or blurred backgrounds (“Enhanced IM”). These three photos’ categories included 10 images of objects or animals and 10 images of human figures each. Examples of photos are reported in Fig 1B. Photos of static subjects (objects, animals, or humans) were used as controls for implied motion stimuli (freezed and enhanced IM) because they are realistic full-color images with a complex content without containing any embodied motion information. The set of optical illusions (“Illusory motion”) contained 10 illusions that were rated in the initial test as those conveying the strongest impression of motion (example in Fig 1C).

As a control for illusions, we created 10 matching images, sharing the same patterns of color saturation and luminance, without conveying the impression of illusory motion (“Illusions’ control”) (example in Fig 1C). That is, they consist of basic geometric shapes (squares, rectangles, and circles) on a grey background, with repeating symmetric patterns that disrupt the illusion of motion [19, 89].

To compare the response to implied motion in static pictures with real motion, we also used a set of 20 movies (“Real motion”), also divided into 10 videos of moving objects or animals, and 10 videos of moving people (see S1 List for web sources). All movies were cut to 2-seconds clips of 120 frames (examples in Fig 1D).

All images and movies were rescaled to a common resolution (28.35 pixels/cm), and they were resized (conserving proportions) to either a width or a height of 340 pixels, with the other side ranging from 171 to 340 pixels. By looking at such small images, observers could have a gist of the whole image without having to explore its parts with eye movements [88, 96].

Finally, the luminance of all images and movies (frame by frame) was modified and rescaled to the value corresponding to the average luminance of the whole set (25 cd/m2), to obtain our experimental stimuli. The Fourier power spectra of our stimuli have the same general shape and the majority of the power lie outside the 2–10 c/deg frequency range; this may dilute a possible constriction exerted by these frequencies [97, 98].

Data processing

Raw data recorded by the eye-tracker consisted of measurements of the width and the height of both pupils (in pixels). Right and left pupil diameters were averaged, and the resulting value was converted from pixels to millimeters, based on the instrument’s recording of a 4 mm artificial pupil, positioned at the location of the observer’s left eye.

The analysis of the pupil responses elicited by different categories of stimuli follows a method widely used in literature for this type of experiments [86, 88, 96]. For each observer, a baseline pupil diameter was calculated by averaging pupil diameter recorded over the last 500 ms of the fixation slide in each trial. This baseline was subtracted from each recording of that observer over the whole 4 sec period [88, 99]. Baseline-corrected pupil size as a function of time of each observer was calculated by averaging the pupil traces of the ten stimuli of each stimulus category. Final traces for each category were then obtained by averaging all observers’ traces. The slopes of the traces were evaluated by fitting data in the interval between 400 ms and 650 ms from stimulus onset with straight lines. The slope values were compared by using z-tests.

An average pupil size was calculated for each category as follows. First the average pupil size of each observer for each image/video was calculated by averaging the baseline-corrected pupil values during the stimulus presentation (120 data points). Then, for each observer, these values were averaged over all ten stimuli of the same category. Finally, the averages for each category were obtained by averaging over all observers. Differences between the means of categories were assessed with ANOVAs, and pairwise comparisons were done with post-hoc t-tests (Bonferroni corrected). The size effect of differences between categories was evaluated by Cohen’s d statistics [100, 101].

The eye-tracker also recorded the observer’s eye position along the horizontal and vertical axes. To control fixation two different analyses were done. First, for all categories, we measured the average distance of the eyes, with respect to fixation, of all subjects during stimulus presentation in all trials. ANOVA was used for comparisons between average distances of categories. To control eye positions during the presentation of the stimuli, we measured root mean square errors (RMSE) of horizontal eye positions for all categories and we compared their distributions with Kolmogorov-Smirnov tests (KS).

Following the idea that the pupil size reflects the individual interpretation of the stimulus [81, 84, 87, 88], data were corrected based on the amount of motion perceived in each image by each observer participating to the experiment, assessed with the rating test. Pupillary responses to stimuli that participants did not categorize in agreement with the nominal classification were considered as "misinterpretations" and were excluded from the analysis. For instance, images assigned to the “Implied motion” nominal category in which, however, observers did not perceive motion (answer “0 –No Motion” in the test) were excluded from the mean of that category for those observers. In the same way, images belonging to the “No-implied motion” nominal category, for which participants perceived motion (answer “1—Weak motion” or “2—Strong motion”), were excluded from the mean of No-IM category as well. Percentage of misinterpretations across categories were compared with the Chi-square test (χ2). Pupil responses of observers which interpreted the same image differently were compared by using a non-parametric, one-tailed, Mann-Whitney ranking test. In those cases where only one misinterpretation occurred, the p-value was directly determined as the ratio of the rank of the outlier and the total number of observers. To assess the overall significance for the presence of the effect of individual motion interpretation on pupillary response, individual p-values were combined according to Fisher’s method [102].

Results

The main result of this work is reported in Fig 2. It clearly shows that real, implied, and illusory motion produce different pupillary responses, both in time course and magnitude.

thumbnail
Fig 2. Mean pupillary response for different types of motion.

(A) Baseline-corrected pupil size for different motion categories plotted as a function of time from trial onset. The horizontal line represents the baseline: data over the zero-line represent pupil dilation whereas data under the line represent pupil constriction. The vertical line indicates the stimulus onset. Error bars are SE. (B) Mean pupillary diameter for different categories of motion during stimulus presentation. Categories include both objects/animals’ and humans’ subjects. Yellow: photos with no implied motion (No-IM); orange: photos with implied motion (freezed and enhanced IM); blue: movies with moving subjects (real motion); purple: motion illusions (Illusory motion). Error bars are SE. Asterisks mark statistically significant pairwise comparisons across image categories: *** p < 0.001.

https://doi.org/10.1371/journal.pone.0254105.g002

Pupil dilation for the different motion categories during the first ~350 ms is almost the same, as expected with PLR in response to stimuli with the same mean luminance presented on a much lighter background (Fig 2A). However, if responses were based on stimulus’ luminance only, we would expect the same dilation and with the same time course for all types of motion stimuli. Instead, after about half a second, pupil responses begin to differ between motion categories. The slopes of the curves, where they start to differ (between 400 and 650 ms of stimulus presentation) are very different across conditions (pairwise z-test comparisons, p < 0.0001). The slope of the real motion curve is positive (0.005 ± 0.0002) and greater than that of the IM (0.003 ± 0.00007), that in turn is greater than that of No-IM (0.002 ± 0.0001), indicating the stronger the perception of movement, the faster the change in pupil size. After 650 ms from stimulus onset, pupil response to photos, both with IM (orange line) and without IM (yellow line), produce a similar path of progressive increase in pupil diameter, even though, on average, photos with IM caused more dilation. Instead, the initial large increase in dilation caused by movies (blue line) stops after just about a second of exposure, leading to a mostly stable pupil diameter over the last 800 ms. This stabilization can be understood by considering that +0.3 mm with respect to baseline corresponds to a pupil diameter of about 8 mm, which is the physiological limit for dilation [103].

Interestingly, the pupil response to motion illusions (purple line) turns out to be very different from that of photos and movies. Pupil size instead of increasing starts decreasing progressively, with a negative slope (-0.0034 ± 0.0001). After reaching constriction pupils remain constricted for about 500 ms. Finally, during the last second of recording, the pupil diameter increases progressively, however remaining much less dilated than for the other stimuli.

The average response to the different types of motion is reported in Fig 2B. Significant differences between the means of all categories are evidenced by ANOVA (F(3) = 64.64, p < 0.001). IM causes pupillary dilation (M = 0.14 ± 0.01 mm), statistically larger (t(3) = 4.74, p < 0.001) than that produced by No-IM (M = 0.10 ± 0.01 mm), with a large effect size (d = 0.9). These results suggest different effects on pupil size depending on whether a subject is perceived as dynamic or static.

Real motion causes the largest dilation (M = 0.21 ± 0.01 mm), statistically larger than that produced by IM (t(3) = -4.98, p < 0.001) and No-IM (t(3) = -7.72, p < 0.001), and the magnitude of the effects is large (d = 1.01) and very large respectively (d = 1.5). The average dilation induced by illusory motion is very small (M = 0.02 ± 0.02), almost absent, as expected from inspection of pupil traces, and significantly lower than that that produced by No-IM (t(3) = -9.12, p < 0.001), IM (t(3) = -9.12, p < 0.001) and real motion (t(3) = -10.33, p < 0.001), with very large to huge effect sizes (in order: d = 1.8; d = 1.15; d = 2.11).

Individual data highlight the same differences between responses to real, implied, and illusory motion, as shown in Fig 3, where the differences in pupil response to photos of static subjects (No-IM), photos of dynamic subjects (IM), movies (real motion) and motion illusions (illusory motion) are plotted for each participant. The difference between pupil response to No-IM and real motion is positive for all observers; the difference between No-IM and IM is almost always positive (even if lower than that with real motion and negligible for some participants); whereas the difference between No-IM and illusory motion is negative for all observers, confirming group results.

thumbnail
Fig 3. Individual differences between responses to no-implied motion vs real, implied, and illusory motion.

Blue squares: differences between average pupil response to movies and photos with No-IM; orange circles: differences between average pupil response to photos with IM and photos with No-IM; purple rhombuses: differences between average pupil response to motion illusions and photos with No-IM. Error bars are the errors on the differences.

https://doi.org/10.1371/journal.pone.0254105.g003

It is known that motion viewing can trigger eye movements—for example to track a moving subject [104, 105], and that eye movements can influence pupil size [106]. For this reason, although our observers were instructed to keep fixation and their eye movements were monitored by the experimenter during recording, we measured the average position of their eyes with respect to the fixation cross, for the different stimulus categories. The average distance from fixation is minimal (No-IM: 2.90 ± 0.5 mm; IM: 1.90 ± 0.3 mm; Real motion: 2.07 ± 0.4 mm; Illusory motion: 1.80 ± 0.3 mm) and the same for all categories (ANOVA, F(3) = 1.88, p = 0.13). We also tested that the variation of eye positions along the horizontal axis did not differ between categories, by comparing the distributions of root mean square errors (RMSE). All pairwise comparisons do not highlight any differences between categories (all KS test yield p > 0.05).

The peculiar effect on the pupil produced by illusory motion may be due to the different structural characteristics of the illusions compared with those of photos or movies. Indeed, while motion perception in movies is induced by real changes of objects’ positions during time, in photos this is achieved by representing dynamic scenes with subjects in action. Instead, the perception of visual motion in the illusions is due to specific images’ features such as the colors’ combination and the repeating asymmetric patterns arrangement [95, 99]. To assess the influence of these low-level visual properties on the pupil constriction observed for illusions, we compared responses to illusions with their control images (same color saturation, same shapes, same luminance, without conveying motion perception—see Fig 1C for examples) shown in Fig 4. The two categories induce very different effects. Control images induce pupillary dilation that slowly increases over time, while illusions cause a decrease followed by an increase of pupil size, as discussed before (Fig 4A). Paired sample t-tests show that the mean pupil dilation induced by the controls (M = 0.08 ± 0.02 mm) is statistically greater (t(23) = 5.23, p < 0.001) than that elicited by illusory motion (M = 0.02 ± 0.02 mm), with large effect size (d = 1.06). Individual illusions induce different effects on pupil size as shown in Fig 4B (purple bars). However, each of them elicits a pupil size smaller than that of its control image (Fig 4B, grey bars).

thumbnail
Fig 4. Control for illusory motion effect.

(A) Baseline-corrected pupil size for illusory motion and illusions’ control, plotted as a function of time from trial onset. The horizontal line represents the baseline: data over the zero-line represent pupil dilation whereas data under the line represent pupil constriction. The vertical line indicates the stimulus onset. Error bars are SE. Asterisks mark statistically significant comparison across image categories: *** p < 0.001. (B) Mean pupillary diameter for each illusion and the corresponding control image. Purple: motion illusions; grey: illusions’ control images. Error bars are SE.

https://doi.org/10.1371/journal.pone.0254105.g004

As discussed above (Fig 2), pupil dilation increases with the strength of the motion represented in the figurative stimuli, from photos with static subjects to photos with implied motion to real movies. It is then interesting to further investigate the effect of the strength of the motion represented in IM pictures. For this purpose, we re-analyzed our data by considering the type of IM and looking for possible differences between responses elicited by photos with motion blur or motion strikes (Enhanced IM), and those elicited by photos showing simple freezed IM (see Fig 1B for examples). Furthermore, given that, for social reasons, we have dedicated systems for the analysis of human motion, it is also interesting to re-analyze our data by considering the subjects represented in the stimuli: objects/animals versus human figures.

Average pupil dilation in response to different motion categories divided according to stimulus content (Fig 5) shows that real motion induces the largest mean pupil dilation followed by images with enhanced IM and freezed IM, and last No-IM (the same trend observed for the pooled data, compare Fig 5 with Fig 2B). Overall, there is a significant effect of motion categories (F(3) = 31.07, p < 0.001) and stimulus content (F(1) = 15.94, p < 0.001) on pupil diameter, as found with a 2-Way ANOVA—factors: motion category (four levels: No-IM, Freezed IM, Enhanced IM, and Real motion) and image content (two levels: Objects/animals and humans). No interaction between the two factors (F(1) = 1.927, p = 0.28) is found.

thumbnail
Fig 5. Pupillary response to different motion categories and stimulus content.

Comparison between the mean pupillary dilation for different motion categories and subjects (objects/animals’: green; humans: red). Color saturation of bars increases with motion strength, in order: No-IM, Freezed IM, Enhanced IM, Real Motion (see S1 List for stimuli). Error bars are SE. Asterisks mark statistically significant post-hoc comparisons: * p < 0.05, ** p < 0.01, *** p < 0.001. All data shown were corrected based on each observer’s motion rating test.

https://doi.org/10.1371/journal.pone.0254105.g005

Post-hoc comparisons for motion categories, independently of stimulus content, show that real motion induces more dilation than enhanced IM (t(3) = -4.54, p < 0.001), freezed IM (t(3) = -4.88, p < 0.001), and No-IM (t(3) = -7.77, p < 0.001). No-IM induces less dilation than freezed IM (t(3) = 3.23, p < 0.05), and enhanced IM (t(3) = 6.10, p < 0.001). Interestingly, the difference between freezed IM and enhanced IM is also significant (t(3) = 3.06, p < 0.05), showing that the greater the motion strength in the pictures the stronger the pupil dilation.

Multiple comparisons show that the statistical difference between human and non-human subjects is due to the response to images in the No-IM category (t(3) = 3.86, p < 0.01), although in all motion categories human subjects elicit a larger dilation than non-human (compare red bars with green bars in Fig 5).

Other interesting findings emerge when combining pupil responses with the results of the motion rating test. A weak but significant correlation emerge between subjective motion strength and pupil size (r(1680) = .1, p < .0001). Indeed, some photos have been categorized differently from our observers, that is, the same image was considered as “static” by some participants (answer 0 –No motion) and as “dynamic” (answer 1 –Weak motion, or 2 –Strong motion) by others. We consider a response to be a “misinterpretation” if the participant’s rating does not correspond to our nominal classification (for example if a photo of IM category has been rated as static by a participant). Examples of photos misinterpreted by more than one participant are reported in Fig 6.

thumbnail
Fig 6. Effect of subjective interpretation of implied motion.

(A) Photos (n° 3 and 49 of S1 List, copyright-free) belonging to No-IM category that have been rated as dynamic instead of static. (B) Photos (n° 20 and 55 of S1 List, copyright-free) belonging to IM category that have been rated as static instead of dynamic. Images shown in (A) and (B) are those that scored higher misinterpretation by our participants, whose number is reported under each bar. Error bars are SE. Asterisks mark statistically significant comparisons between groups, non-parametric one-tailed Mann-Whitney test, * p < 0.05; ** p < 0.01, *** p < 0.001.

https://doi.org/10.1371/journal.pone.0254105.g006

The proportion of misinterpretations is not evenly distributed across categories. Considering the rating of all observers for all images, in 10% of cases, humans photos belonging to No-IM category are misinterpreted as dynamic rather than static, versus 2% of cases for objects/animals’ photos (X2(1) = 12.83, p < 0.001). In the same way, photos of human IM are misinterpreted as static only 5% of times compared with 8% for non-human IM (even if this difference is not significant; X2(1) = 2.21, p = 0.14) These results suggest that images representing human figures are more likely to be interpreted as “dynamic” compared with images with objects or animals.

Another notable result emerges from the analysis of pupillary responses to misinterpreted photos, that have not been considered in the calculation of the means of each category. Pupil size of observers that misinterpreted as dynamic the photos belonging to No-IM category, is significantly larger than pupil size of those who correctly interpreted the same images—both for human and non-human photos (examples in Fig 6A). In the same way, photos belonging to the IM category, induce smaller pupillary dilation in observers perceiving them as static than in those perceiving them as dynamic, both for human and non-human photos (examples in Fig 6B). These results do not depend on eye movements: misinterpretations and correct interpretations yield statistically compatible RMSE distributions (all pairwise KS comparisons have p-values > 0.05). Statistical analyses to assess the overall significance of the effect of subjective motion interpretation (see Data processing for details), yield an overall p-value < 0.01. Thus, pupil response seems to be modulated by the observer’s interpretation of the photos as dynamic or static, leading to larger dilation for motion.

Motion illusions also give way to a certain number of misperceptions, in which participants did not perceive any motion (image rated as "0—No Motion"). This happens in 5% of the cases, and, in each of these, the observers’ pupil size is smaller than when illusory motion is perceived. An example of this is shown in Fig 7. As for misinterpretations of photos, a non-parametric, one-tailed, Mann-Whitney ranking test was performed for all illusions that gave way to at least one misperception. Individual p values were combined according to Fisher’s method [99] yielding an overall p-value < 0.05. No difference in eye position emerges across subjects perceiving the illusions as moving versus those perceiving them as static (all RMSE distributions are statistically compatible—all pairwise KS comparisons have p-values > 0.05). Again, pupil size seems to be mostly dependent on the subjective perception of stimuli. Note that the perception of illusory motion induces less pupillary dilation (sometimes even constriction) whereas the lack of perception of illusory motion results in pupil dilation. This is the exact opposite of what is observed for IM.

thumbnail
Fig 7. Effect of perception of illusory motion.

The image shown (n° 81 of S1 List) is the one scoring the highest number of misinterpretations (3). Asterisks mark statistically significant comparisons between groups, non-parametric one-tailed Mann-Whitney test, *** p < 0.001.

https://doi.org/10.1371/journal.pone.0254105.g007

Discussion

In the present study, for the first time, pupil diameter of observers has been recorded while they were viewing different kinds of motion stimuli, such as movies, illusions, and photos, representing a variety of subjects. All stimuli have the same mean luminance, whereby a simple model in which pupil size exclusively depends on luminance would predict the same amount of pupillary dilation for all stimulus’ categories. Instead, pupil responses to the different motion categories result to be different, showing that there must be a pupil modulation from mechanisms other than the PLR.

Movies and photos showing figurative subjects in action (humans, objects, or animals) induce an increase in pupil size, although with differences in time courses and average dilation. Perception of real motion induces a rapid increase in pupil size after stimulus onset, reaching an average pupillary dilation greater than that produced by all other categories. Processing of implied motion also induces dilation, but with a lower increase with time and a smaller average size compared to real motion. Within IM stimuli, Enhanced IM, specifically created by photographers to increase our motion perception, induce more dilation than simple freezed IM, where subjects are photographed while they are moving. Photos of static scenes (No-IM) induce less pupil dilation than photos of dynamic subjects (IM), although sharing the same low-level features. Therefore, these results suggest that the greater the perception of movement in the stimulus, the stronger the pupillary dilation of the observer.

These findings show that the processing of real and implied motion of a variety of figurative subjects modulates the pupil diameter, an effect not investigated in previous studies, which used non-figurative stimuli [90]. The only other study measuring pupil responses to real moving stimuli used random moving dots and found that the onset of coherent motion triggers pupillary constriction [90]. This result seems to be at odds with our results on movies, but the two studies are hardly comparable. First, in Sahraie and Barbur’s experiment motion perception was generated by artificial stimuli, instead of realistic subjects in action. Realistic stimuli may activate a more complex network of cortical areas like those activated in real-life conditions. Secondly, their stimuli were shown in the periphery of the visual field while observers fixate the screen center, while our movies are directly attended in the fovea.

The observed pupillary dilation to real motion could be attributed to the activation of the sympathetic system, which regulates important bodily functions (for a review see [107]) and, once activated, causes a series of physiological reactions which prepare the organism for action, including pupillary dilation. Indeed, pupil size has been shown to be a useful indicator of physiological arousal [6972], with direct connections to the locus coeruleus arousal network [71, 73]. Therefore, pupillary dilation in response to motion could reflect a physiological response of the system preparing for a highly dynamic situation causing arousal. Another plausible explanation may rely on the fact that pupillary dilation could be related to the need for a wider visual field to track objects in motion. We know that in real-life conditions we need a large field of view to perceive physical movement [2], and it has been suggested that increasing pupil size increases the visual field [108]. Therefore, it could be that the pupil dilates to enlarge the portion of visual field to improve the perception of objects’ movement in the periphery of the visual field. The explanations hypothesized above might be held for the effect of IM as well. That is, the same mechanisms, but to a smaller extent, might happen for photos with IM, which simulate the subject’s shift in the visual scene, also explaining the smaller pupil dilation in response to implied than real motion.

The different pupil responses to real and implied motion could also be attributed to different top-down cortical modulations of the pupil. Specifically, our findings could reflect different degrees of activation of the cortical area MT, dedicated to the processing of both real motion [8, 10, 1215, 18, 24] and dynamic information represented in static images [26, 28, 29, 31, 44]. In the latter, MT activation increases with the strength of IM [31], then probably explaining the bigger dilation for photos showing enhanced IM compared to photos with freezed IM. The hypothesis that pupil dilation for IM may depend on the processing of the embodied motion information in the photos is also supported by the fact that, for a given photo, pupil size was bigger for those subjects that rated it as dynamic with respect to those that rated it as static.

Areas other than the prototypical motion ones could be involved in high-level cognitive processing of our stimuli, which contain complex scenes (foreground moving, detailed background, colors, etc.) with moving objects of different nature that could trigger multiple mental processes (attention, object recognition, familiarity, memory, and imagination). In fact, our data show that pupillary responses are also influenced by the type of subject represented in the stimuli, independently of its motion. Photos containing humans induce a bigger dilation than photos of non-humans of the same category. This could be dependent on the activation of additional areas in charge of visual processing of the human body and face [5057], and/or areas specialized for human biological motion processing [16, 6264, 109114], and/or systems responding to an increase of the arousal due to viewing humans figures [115117]. Also, visual scenes showing humans in action are perceived as more dynamic than representations of moving objects or animals, maybe due to our tendency to attribute intention to move to other people [5860]. This is in agreement with the higher activation of MT during observation of human actions rather than non-biological movements [61].

A completely different and opposite effect is obtained with illusory motion. In fact, by presenting motion illusions pupil diameter decreases significantly. Pupil reaches constriction, remains constricted for a while, and finally starts to dilate slowly. The average size in this condition is therefore smaller than in all the other motion conditions.

The effect we found with motion illusions is not in line with the only other study measuring pupil response to illusory motion [89], but the inconsistency can be explained by several differences in the stimuli, experimental procedures, and data analysis used. First, Beukema and colleagues [89] measured in all trials the response to one single optical illusion, which gives way to the perception of peripheral drift, while we presented ten different illusions giving the impression of motion with different speeds and directions, making our conclusions more general. Then, more importantly, while pupil behaviours with time are almost the same in both experiments, the average diameter they obtain is much larger. They exclude from the analysis the response during the first second from stimulus onset, during which the pupil constricts, that they consider just the effect of the PLR. We argue that the effect of PRL is found during the first 350 ms after stimulus onset [86, 96], during which we measured the same amount of pupil dilation for all photos, movies, and illusions, as expected from PLR for stimuli with the same and lower luminance than the fixation slide. After 350 ms, all stimuli induced different pupil responses and, in our view, this is what makes the difference between responses to different categories.

We can only make speculations about the causes of the observed constriction for illusory motion. We could argue that the constriction does not depend on aesthetic pleasantness (not measured here), which has been found to be similar to that for symmetric non-illusory patterns [118], and generally induces pupil dilation [119, 120]. Another explanation might rely on the low-level properties of illusions, different from those of naturalistic photos, and purposely introduced to create the impression of motion [19, 21, 22]. By design, our illusions and control images have the same color saturation but induce opposite responses. Therefore, saturation does not seem to play a major role in the observed constriction. The effect might still depend on chromatic and luminance contrast [91, 121]. In any case the same illusion, therefore with the same low-level features, induce different effects in the observers according to their perception of illusory motion. This suggests that responses to illusions are not solely dependent on their low-level properties, but, at least in part, influenced by high-level motion processing.

Overall, in the same observers, perception of real and implied motion induces pupillary dilation, whereas perception of illusory motion induces pupillary constriction. These effects cannot be explained by the top-down influence of visual motion areas only. In fact, MT is activated in the same way by real, implied, and illusory motion [2325]. It can be explained neither by a delayed response of MT+ to illusory motion, which could be the cause of the observed different time courses of pupil size, because the delay for illusory and real motion is similar [24]. Our data also exclude the possibility that pupil responses for the different types of motion are influenced by observers’ eye movement. We argue that, beside motion perception, other cognitive factors may be involved in the observed pupil differences, that reflects on top-down modulation by a larger cortical network. For example, attention may play an important role in pupil modulation. In fact, to sustain the sensation of motion, observers had to attend more closely to illusions than to real motion, leading to the speculation that other non-visual areas, part of an attentional network, are activated during observation of motion illusions, but not during the presentation of real moving objects [25]. Another plausible factor involved in the effects observed here may be a different amount of arousal triggered by artificial and naturalistic stimuli, hence a different amount of activation of the sympathetic system. The norepinephrine (NE) released from the locus coeruleus (LC) during cognitive and emotional processes, including attention and arousal, has been shown to play a critical role in the pupil dilation [71, 122125]. Thus, the pupillary modulation observed here might also be mediated, at least in part, by the activation of the LC. Also, perception of real motion or intention to move, being fundamental for survival, has led to fine-tuned dedicated brain mechanisms in all species [57, 1214, 16, 125, 126], while artificial motion illusions may rely only in part on such specialized motion mechanisms. Another plausible explanation may be the intrinsic difference between realistic photos/movies and artificial illusions reflecting on differences in the low-level visual features of these stimuli, as discussed above.

Finally, all our data, independently on the type of motion, show a strong relationship between the pupil diameter of observers and their subjective perception and interpretation of dynamicity. This confirms previous studies finding that the subjective interpretation of complex images has a relevant effect on pupil size [81, 83, 84, 87, 88], inducing responses that, in some cases, can override the simple PLR.

Conclusions

The present study provides further evidence that, besides the simple subcortical system mediating the PLR, the pupil is sensitive to top-down cortical modulations. We demonstrated that high-level processing of visual motion influences the pupil diameter, and the effect may be different based on the nature of motion: real, implied, or illusory. This suggest that there are distinct mechanisms for the analysis of the different types of motion, despite we are not able to identify with certainty the neural pathways underlying these top-down modulations of pupil. Also, the modulation reflects the observer’s interpretation of the images as dynamic or static. For this reason, we argue that testing the subjective interpretation of each stimulus for each participant has become a necessity in pupillometry studies when using complex and ambiguous stimuli.

Supporting information

S1 List. Web sources of all stimuli.

Photos and movies are divided by type of subject (objects/animals, humans) and motion category (No-IM, freezed IM, enhanced IM, real motion). Some images have been cut with respect to the originals to better fit with the assigned nominal category.

https://doi.org/10.1371/journal.pone.0254105.s001

(XLSX)

References

  1. 1. Albright TD, Stoner GR. Visual motion perception. Proc Natl Acad Sci U S A. 1995;92(7):2433–40. pmid:7708660
  2. 2. Andersen RA. Neural mechanisms of visual motion perception in primates. Neuron. 1997. pmid:9208854
  3. 3. Albright TD. Direction and orientation selectivity of neurons in visual area MT of the macaque. J Neurophysiol. 1984;52(6):1106–30. pmid:6520628
  4. 4. Britten KH, Newsome WT, Shadlen MN, Celebrini S, Movshon JA. A relationship between behavioral choice and the visual responses of neurons in macaque MT. Vis Neurosci. 1996. pmid:8730992
  5. 5. Dubner R, Zeki SM. Response properties and receptive fields of cells in an anatomically defined region of the superior temporal sulcus in the monkey. Brain Res. 1971;35(2):528–32. pmid:5002708
  6. 6. Maunsell JHR, Van Essen DC. Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. J Neurophysiol. 1983;49(5):1127–47. pmid:6864242
  7. 7. Van Essen DC, Maunsell JHR, Bixby JL. The middle temporal visual area in the macaque: Myeloarchitecture, connections, functional properties and topographic organization. J Comp Neurol. 1981;199(3):293–326. pmid:7263951
  8. 8. Clarke S, Miklossy J. Occipital cortex in man: Organization of callosal connections, related myelo- and cytoarchitecture, and putative boundaries of functional visual areas. J Comp Neurol. 1990.
  9. 9. Sereno MI, Allman JM. Cortical Visual Areas in Mammals. In: Leventhal AG, editor. The Neural Basis of Visual Funtion. 1st ed. London: Macmillan; 1991. p. 160–72.
  10. 10. Tootell RBH, Taylor JB. Anatomical evidence for MT and additional cortical visual areas in humans. Cereb Cortex. 1995. pmid:7719129
  11. 11. Lueck CJ, Zeki S, Friston KJ, Deiber MP, Cope P, Cunningham VJ, et al. The colour centre in the cerebral cortex of man. Nature. 1989;340(6232):386–9. pmid:2787893
  12. 12. Zeki S, Watson JDG, Lueck CJ, Friston KJ, Kennard C, Frackowiak RSJ. A direct demonstration of functional specialization in human visual cortex. J Neurosci. 1991;11(3):641–9. pmid:2002358
  13. 13. Watson JDG, Shipp S, Zeki S, Watson JDG, Myers R, Frackowiak RSJ, et al. Area v5 of the human brain: Evidence from a combined study using positron emission tomography and magnetic resonance imaging. Cereb Cortex. 1993;3(2):79–94. pmid:8490322
  14. 14. Tootell RBH, Reppas JB, Kwong KK, Malach R, Born RT, Brady TJ, et al. Functional analysis of human MT and related visual cortical areas using magnetic resonance imaging. J Neurosci. 1995;15(4):3215–30. pmid:7722658
  15. 15. Sunaert S, Van Hecke P, Marchal G, Orban GA. Motion-responsive regions of the human brain. Exp Brain Res. 1999;127(4):355–70. pmid:10480271
  16. 16. Howard RJ, Brammer M, Wright I, Woodruff PW, Bullmore ET, Zeki S. A direct demonstration of functional specialization within motion- related visual and auditory cortex of the human brain. Curr Biol. 1996;6(8):1015–9. pmid:8805334
  17. 17. Morrone MC, Tosetti M, Montanaro D, Fiorentini A, Cioni G, Burr DC. A cortical area that responds specifically to optic flow, revealed by fMRI. Nat Neurosci. 2000. pmid:11100154
  18. 18. Zihl J, Von Cramon D, Mai N. Selective disturbance of movement vision after bilateral brain damage. Brain. 1983;106(2):313–40. pmid:6850272
  19. 19. Chi M Te, Lee TY, Qu Y, Wong TT. Self-animating images: Illusory motion using repeated asymmetric patterns. ACM Trans Graph. 2008.
  20. 20. Zanker JM, Hermens F, Walker R. Quantifying and modeling the strength of motion illusions perceived in static patterns. J Vis. 2010. pmid:20462314
  21. 21. Backus BT, Oruç I. Illusory motion from change over time in the response to contrast and luminance. J Vis. 2005. pmid:16441202
  22. 22. Kitaoka A. Color-dependent motion illusions in stationary images and their phenomenal dimorphism. Perception. 2014. pmid:25420331
  23. 23. Goebel R, Khorram-Sefat D, Muckli L, Hacker H, Singer W. The constructive nature of vision: Direct evidence from functional magnetic resonance imaging studies of apparent motion and motion imagery. Eur J Neurosci. 1998;10(5):1563–73. pmid:9751129
  24. 24. Luo J, He K, Andolina IM, Li X, Yin J, Chen Z, et al. Going with the flow: The neural mechanisms underlying illusions of complex-flow motion. J Neurosci. 2019;39(14):2664–85. pmid:30777886
  25. 25. Zeki S, Watson JDG, Frackowiak RSJ. Going beyond the information given: The relation of illusory visual motion to brain activity. Proc R Soc B Biol Sci. 1993;252(1335):215–22. pmid:8394582
  26. 26. Concerto C, Al Sawah M, Infortuna C, Freedberg D, Chusid E, Aguglia E, et al. Neural circuits underlying motor facilitation during observation of implied motion. Somatosens Mot Res. 2015;32(4):207–10. pmid:26422799
  27. 27. Kolesar TA, Kornelsen J, Smith SD. Separating neural activity associated with emotion and implied motion: An fMRI study. Emotion. 2016;17(1):131–40. pmid:27504596
  28. 28. Pavan A, Cuturi LF, Maniglia M, Casco C, Campana G. Implied motion from static photographs influences the perceived position of stationary objects. Vision Res. 2011;51(1):187–94. pmid:21092745
  29. 29. Proverbio AM, Riva F, Zani A. Observation of static pictures of dynamic actions enhances the activity of movement-related brain areas. PLoS One. 2009;4(5). pmid:19421311
  30. 30. Senior C, Barnes J, Giampietroc V, Simmons A, Bullmore ET, Brammer M, et al. The functional neuroanatomy of implicit-motion perception or “representational momentum”. Curr Biol. 2000;10(1):16–22. pmid:10660297
  31. 31. Williams AL, Wright MJ. Static representations of speed and their neural correlates in human area MT/V5. Neuroreport. 2009;20(16):1466–70. pmid:19770688
  32. 32. Winawer J, Huk AC, Boroditsky L. A motion aftereffect from still photographs depicting motion. Psychol Sci. 2008;19(3):276–83. pmid:18315801
  33. 33. Shirai N, Imura T. Implied motion perception from a still image in infancy. Exp Brain Res. 2014;232(10):3079–87. pmid:24888536
  34. 34. Burr D. Motion vision: Are “speed lines” used in human visual motion? Curr Biol. 2000;10(12):440–3. pmid:10873792
  35. 35. Burr DC, Ross J. Direct evidence that “speedlines” influence motion mechanisms. J Neurosci. 2002;22(19):8661–4. pmid:12351740
  36. 36. Geisler WS. Motion streaks provide a spatial code for motion direction. Nature. 1999;400(6739):65–9. pmid:10403249
  37. 37. Kawabe T, Miura K. Representation of dynamic events triggered by motion lines and static human postures. Exp Brain Res. 2006;175(2):372–5. pmid:16944106
  38. 38. Kawabe T, Yamada Y, Miura K. Memory displacement of an object with motion lines. Vis cogn. 2007;15(3):305–21.
  39. 39. Francis G, Kim H. Motion parallel to line orientation: Disambiguation of motion percepts. Perception. 1999;28(10):1243–55. pmid:10694972
  40. 40. Burr D. Motion smear. Nature. 1980;284:164–5. pmid:7360241
  41. 41. Harrington TL, Harrington MK, Wilkins CA, Koh YO. Visual orientation by motion-produced blur patterns: Detection of divergence. Percept Psychophys. 1980;28(4):293–305. pmid:7465312
  42. 42. Kourtzi Z. But still, it moves. Trends Cogn Sci. 2004;8(2):47–9. pmid:15588804
  43. 43. Krekelberg B, Vatakis A, Kourtzi Z. Implied motion from form in the human visual cortex. J Neurophysiol. 2005;94(6):4373–86. pmid:16107528
  44. 44. Kourtzi Z, Kanwisher N. Activation in human MT/MST by static images with implied motion. J Cogn Neurosci. 2000;12(1):48–55. pmid:10769305
  45. 45. Anstis S, Verstraten FAJ, Mather G. The motion aftereffect. Trends in Cognitive Sciences. 1998. pmid:21227087
  46. 46. Battaglia F, Lisanby SH, Freedberg D. Corticomotor excitability during observation and imagination of a work of art. Front Hum Neurosci. 2011.
  47. 47. Cattaneo Z, Schiavi S, Silvanto J, Nadal M. A TMS study on the contribution of visual area V5 to the perception of implied motion in art and its appreciation. Cogn Neurosci. 2017.
  48. 48. di Dio C, Ardizzi M, Massaro D, di Cesare G, Gilli G, Marchetti A, et al. Human, nature, dynamism: The effects of content and movement perception on brain activations during the aesthetic judgment of representational paintings. Front Hum Neurosci. 2016. pmid:26793087
  49. 49. Kim CY, Blake R. Brain activity accompanying perception of implied motion in abstract paintings. Spat Vis. 2007. pmid:18338460
  50. 50. Downing PE, Chan AWY, Peelen M V., Dodds CM, Kanwisher N. Domain specificity in visual cortex. Cereb Cortex. 2006;16(10):1453–61. pmid:16339084
  51. 51. Downing P, Kanwisher N. A cortical area specialized for visual processing of the human body. J Vis. 2001;1(3):2470–4. pmid:11577239
  52. 52. Kanwisher N. Domain specificity in face perception. Nat Neurosci. 2000;3(8):759–63. pmid:10903567
  53. 53. Kanwisher N, Yovel G. The fusiform face area: A cortical region specialized for the perception of faces. Philos Trans R Soc B Biol Sci. 2006;361(1476):2109–28. pmid:17118927
  54. 54. Kanwisher N, McDermott J, Chun MM. The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception. J Neurosci. 1997;1(11):4302–11. pmid:9151747
  55. 55. Peelen M V., Downing PE. Within-subject reproducibility of category-specific visual activation with functional MRI. Hum Brain Mapp. 2005;25(4):402–8. pmid:15852382
  56. 56. Spiridon M, Fischl B, Kanwisher N. Location and spatial profile of category-specific regions in human extrastriate cortex. Hum Brain Mapp. 2006;27(1):77–89. pmid:15966002
  57. 57. Urgesi C, Calvo-Merino B, Haggard P, Aglioti SM. Transcranial magnetic stimulation reveals two cortical pathways for visual body processing. J Neurosci. 2007;27(30):8023–30. pmid:17652592
  58. 58. Blakemore SJ, Decety J. From the perception of action to the understanding of intention. Nat Rev Neurosci. 2001;2(8):561–7. pmid:11483999
  59. 59. Gallese V, Goldman A. Mirror neurons and the theory of mind rreading. Trends Cogn Sci. 1998;2(12):493–501. pmid:21227300
  60. 60. Manera V, Schouten B, Becchio C, Bara BG, Verfaillie K. Inferring intentions from biological motion: A stimulus set of point-light communicative interactions. Behav Res Methods. 2010;42(1):168–78. pmid:20160297
  61. 61. Holz EM, Doppelmayr M, Klimesch W, Sauseng P. EEG correlates of action observation in humans. Brain Topogr. 2008;21(2):93–9. pmid:18780176
  62. 62. Saygin AP. Superior temporal and premotor brain areas necessary for biological motion perception. Brain. 2007;130(9):2452–61. pmid:17660183
  63. 63. Saygin AP, Wilson SM, Hagler DJ, Bates E, Sereno MI. Point-light biological motion perception activates human premotor cortex. J Neurosci. 2004;24(27):6181–8. pmid:15240810
  64. 64. Puce A, Perrett D. Electrophysiology and brain imaging of biological motion. Philos Trans R Soc B Biol Sci. 2003;358(1431):435–45. pmid:12689371
  65. 65. Bremner FD. THE PUPIL: ANATOMY, PHYSIOLOGY, AND CLINICAL APPLICATIONS: By Loewenfeld Irene E. 1999. Oxford: Butterworth-Heinemann. Price pound180. Pp. 2278. ISBN 0-750-67143-2. Brain. 2001.
  66. 66. Gamlin PD, Clarke RJ. The pupillary light reflex pathway of the primate. J Am Optom Assoc. 1995. pmid:7560728
  67. 67. Joshi S, Gold JI. Pupil Size as a Window on Neural Substrates of Cognition. Vol. 24, Trends in Cognitive Sciences. 2020. pmid:32331857
  68. 68. Hess EH, Polt JM. Pupil size in relation to mental activity during simple problem-solving. Science (80-). 1964. pmid:17833905
  69. 69. Hess EH, Polt JM. Pupil size as related to interest value of visual stimuli. Science (80-). 1960. pmid:14401489
  70. 70. Henderson RR, Bradley MM, Lang PJ. Modulation of the initial light reflex during affective picture viewing. Psychophysiology. 2014. pmid:24849784
  71. 71. Joshi S, Li Y, Kalwani RM, Gold JI. Relationships between Pupil Diameter and Neuronal Activity in the Locus Coeruleus, Colliculi, and Cingulate Cortex. Neuron. 2016.
  72. 72. Bradley MM, Miccoli L, Escrig MA, Lang PJ. The pupil as a measure of emotional arousal and autonomic activation. Psychophysiology. 2008. pmid:18282202
  73. 73. Aston-Jones G, Cohen JD. AN INTEGRATIVE THEORY OF LOCUS COERULEUS-NOREPINEPHRINE FUNCTION: Adaptive Gain and Optimal Performance. Annu Rev Neurosci. 2005. pmid:16022602
  74. 74. Binda P, Murray SO. Keeping a large-pupilled eye on high-level visual processing. Trends in Cognitive Sciences. 2015.
  75. 75. Binda P, Pereverzeva M, Murray SO. Attention to bright surfaces enhances the pupillary light reflex. J Neurosci. 2013. pmid:23365255
  76. 76. Binda P, Pereverzeva M, Murray SO. Pupil size reflects the focus of feature-based attention. J Neurophysiol. 2014. pmid:25231615
  77. 77. Mathôt S, van der Linden L, Grainger J, Vitu F. The pupillary light response reveals the focus of covert visual attention. PLoS One. 2013. pmid:24205144
  78. 78. Naber M, Alvarez GA, Nakayama K. Tracking the allocation of attention using human pupillary oscillations. Front Psychol. 2013. pmid:24368904
  79. 79. Tkacz-Domb S, Yeshurun Y. The size of the attentional window when measured by the pupillary response to light. Sci Rep. 2018. pmid:30089801
  80. 80. Unsworth N, Robison MK, Miller AL. Pupillary correlates of fluctuations in sustained attention. J Cogn Neurosci. 2018. pmid:29488845
  81. 81. Laeng B, Endestad T. Bright illusions reduce the eye’s pupil. Proc Natl Acad Sci U S A. 2012. pmid:22308422
  82. 82. Suzuki Y, Minami T, Laeng B, Nakauchi S. Colorful glares: Effects of colors on brightness illusions measured with pupillometry. Acta Psychol (Amst). 2019. pmid:31288107
  83. 83. Zavagno D, Tommasi L, Laeng B. The Eye Pupil’s Response to Static and Dynamic Illusions of Luminosity and Darkness. Iperception. 2017.
  84. 84. Laeng B, Sulutvedt U. The Eye Pupil Adjusts to Imaginary Light. Psychol Sci. 2014. pmid:24285432
  85. 85. Mathôt S, Grainger J, Strijkers K. Pupillary Responses to Words That Convey a Sense of Brightness or Darkness. Psychol Sci. 2017. pmid:28613135
  86. 86. Naber M, Nakayama K. Pupil responses to high-level image content. J Vis. 2013. pmid:23685390
  87. 87. Sperandio I, Bond N, Binda P. Pupil Size as a Gateway Into Conscious Interpretation of Brightness. Front Neurol. 2018. pmid:30631301
  88. 88. Castellotti S, Conti M, Feitosa-Santana C, Del Viva MM. Pupillary response to representations of light in paintings. J Vis. 2020. pmid:33052409
  89. 89. Beukema S, Olson JA, Jennings BJ, Kingdom FAA. Pupil dilation to illusory motion in peripheral drift images: Perception versus reality. J Vis. 2017;17(8):1–13 1. pmid:28672367
  90. 90. Sahraie A, Barbur JL. Pupil response triggered by the onset of coherent motion. Graefe’s Arch Clin Exp Ophthalmol. 1997. pmid:9285218
  91. 91. Kohn M, Clynes M. COLOR DYNAMICS OF THE PUPIL. Ann N Y Acad Sci. 1969. pmid:5258025
  92. 92. Ukai K. Spatial pattern as a stimulus to the pupillary system. J Opt Soc Am A. 1985. pmid:4020507
  93. 93. Brainard DH. The Psychophysics Toolbox. Spat Vis. 1997. pmid:9176952
  94. 94. Kleiner M, Brainard DH, Pelli DG, Broussard C, Wolf T, Niehorster D. What’s new in Psychtoolbox-3? Perception. 2007.
  95. 95. Pelli DG. The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spat Vis. 1997. pmid:9176953
  96. 96. Binda P, Pereverzeva M, Murray SO. Pupil constrictions to photographs of the sun. J Vis. 2013;13(6). pmid:23685391
  97. 97. Barbur JL, Thomson WD. Pupil Response As an Objective Measure of Visual Acuity. Ophthalmic Physiol Opt. 1987;7(4):425–9. pmid:3454921
  98. 98. Hu X, Hisakata R, Kaneko H. Effects of spatial frequency and attention on pupillary response. J Opt Soc Am A. 2019;36(10):1699. pmid:31674435
  99. 99. Mathôt S, Fabius J, Van Heusden E, Van der Stigchel S. Safe and sensible preprocessing and baseline correction of pupil-size data. Behav Res Methods. 2018. pmid:29330763
  100. 100. Cohen J. Statistical Power Analysis for the Behavioural Science (2nd Edition). In: Statistical Power Anaylsis for the Behavioral Sciences. 1988.
  101. 101. Sawilowsky SS. New Effect Size Rules of Thumb. J Mod Appl Stat Methods. 2009;
  102. 102. Mosteller F. Questions and Answers. Am Stat. 1948.
  103. 103. Alexandridis E, Alexandridis E. Pupil Size. In: The Pupil. 1985.
  104. 104. Spering M, Montagnini A. Do we track what we see? Common versus independent processing for motion perception and smooth pursuit eye movements: A review. Vol. 51, Vision Research. 2011. pmid:20965208
  105. 105. Lisberger SG, Morris EJ, Tychsen L. Visual motion processing annd sensory-motor integration for smooth pursuit eye movements. Vol. Vol. 10, Annual Review of Neuroscience. 1987.
  106. 106. Gagl B, Hawelka S, Hutzler F. Systematic influence of gaze position on pupil size measurement: Analysis and correction. Behav Res Methods. 2011;43(4):1171–81. pmid:21637943
  107. 107. McCorry LK. Physiology of the autonomic nervous system. Am J Pharm Educ. 2007. pmid:17786266
  108. 108. Gabriel P, Kitchen C, Brown B. Effect of pupil size on kinetic visual field measurements. Clin Exp Optom. 1988.
  109. 109. Beauchamp MS, Lee KE, Haxby J V., Martin A. fMRI Responses to Video and Point-Light Displays of Moving Humans and Manipulable Objects. J Cogn Neurosci. 2003;15(7):991–1001. pmid:14614810
  110. 110. Bonda E, Petrides M, Ostry D, Evans A. Specific involvement of human parietal systems and the amygdala in the perception of biological motion. J Neurosci. 1996;16(11):3737–44. pmid:8642416
  111. 111. Grèzes J, Fonlupt P, Bertenthal B, Delon-Martin C, Segebarth C, Decety J. Does perception of biological motion rely on specific brain regions? Neuroimage. 2001;13(5):775–85. pmid:11304074
  112. 112. Grossman E, Donnelly M, Price R, Pickens D, Morgan V, Neighbor G, et al. Brain areas involved in perception of biological motion. J Cogn Neurosci. 2000;12(5):711–20. pmid:11054914
  113. 113. Grossman ED, Blake R. Brain areas active during visual perception of biological motion. Neuron. 2002;35(6):1167–75. pmid:12354405
  114. 114. Vaina LM, Solomon J, Chowdhury S, Sinha P, Belliveau JW. Functional neuroanatomy of biological motion perception in humans. Proc Natl Acad Sci U S A. 2001;98(20):11656–61. pmid:11553776
  115. 115. Norris CJ, Chen EE, Zhu DC, Small SL, Cacioppo JT. The interaction of social and emotional processes in the brain. J Cogn Neurosci. 2004;16(10):1818–29. pmid:15701231
  116. 116. Yang J, Bellgowan PSF, Martin A. Threat, domain-specificity and the human amygdala. Neuropsychologia. 2012;50(11):2566–72. pmid:22820342
  117. 117. Cao Z, Zhao Y, Tan T, Chen G, Ning X, Zhan L, et al. Distinct brain activity in processing negative pictures of animals and objects—The role of human contexts. Neuroimage. 2014;84. pmid:24099847
  118. 118. Stevanov J, Marković S, Kitaoka A. Aesthetic valence of visual illusions. Iperception. 2012. pmid:23145272
  119. 119. Kuchinke L, Trapp S, Jacobs AM, Leder H. Pupillary Responses in Art Appreciation: Effects of Aesthetic Emotions. Psychol Aesthetics, Creat Arts. 2009.
  120. 120. Blackburn K, Schirillo J. Emotive hemispheric differences measured in real-life portraits using pupil diameter and subjective aesthetic preferences. Exp Brain Res. 2012. pmid:22526951
  121. 121. Tsujimura S, Wolffsohn JS, Gilmartin B. A linear chromatic mechanism drives the pupillary response. Proc R Soc B Biol Sci. 2001;268(1482):2203–9. pmid:11674867
  122. 122. Laeng B, Sirois S, Gredebäck G. Pupillometry: A window to the preconscious? Perspect Psychol Sci. 2012. pmid:26168419
  123. 123. Peinkhofer C, Knudsen GM, Moretti R, Kondziella D. Cortical modulation of pupillary function: Systematic review. PeerJ Comput Sci. 2019. pmid:31119083
  124. 124. Einhäuser W, Stout J, Koch C, Carter O. Pupil dilation reflects perceptual selection and predicts subsequent stability in perceptual rivalry. Proc Natl Acad Sci U S A. 2008. pmid:18250340
  125. 125. Howard CJ, Holcombe AO. Unexpected changes in direction of motion attract attention. Atten Percept Psychophys. 2010. pmid:21097853
  126. 126. Wurtz RH, Yamasaki DS, Dufy CJ, Roy JP. Functional specialization for visual motion processing in primate cerebral cortex. In: Cold Spring Harbor Symposia on Quantitative Biology. 1990.