Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Eye-Gaze direction triggers a more specific attentional orienting compared to arrows

Abstract

Numerous studies have shown that eye-gaze and arrows automatically shift visuospatial attention. Nonetheless, it remains unclear whether the attentional shifts triggered by these two types of stimuli differ in some important aspects. It has been suggested that an important difference may reside in how people select objects in response to these two types of cues, eye-gaze eliciting a more specific attentional orienting than arrows. To assess this hypothesis, we examined whether the allocation of the attentional orienting triggered by eye-gaze and arrows is modulated by the presence and the distribution of reference objects (i.e., placeholders) on the scene. Following central cues, targets were presented either in an empty visual field or within one of six placeholders on each trial. In Experiment 2, placeholder-objects were grouped following the gestalt’s law of proximity, whereas in Experiment 1, they were not perceptually grouped. Results showed that cueing one of the grouped placeholders spreads attention across the whole group of placeholder-objects when arrow cues were used, while it restricted attention to the specific cued placeholder when eye-gaze cues were used. No differences between the two types of cues were observed when placeholder-objects were not grouped within the cued hemifield, or no placeholders were displayed on the scene. These findings are consistent with the idea that socially relevant gaze cues encourage a more specific attentional orienting than arrow cues and provide new insight into the boundary conditions necessary to observe this dissociation.

Introduction

The capacity to follow the focus of attention of another individual is of great importance for the development of social communication [1, 2].

In order to understand what others are paying attention to, we usually rely on information provided through non-verbal communication, such as gestures, postures, and the direction of the gaze [3]. The perception, interpretation and evaluation of the information obtained through these sources help us inquire about other people’s intentions and mental states and, consequently, anticipate their next step and increase the probability of successfully building social interactions [46]. Together with other biologically relevant stimuli [3, 7] averted gaze of another person can shift the observer’s attention in the same direction as the observed gaze (e.g., [8, 9], see [10] for review), allowing the establishment of “joint attention” [11]. This behaviour has been considered highly beneficial to individuals and has been a crucial step in the development of social-communicative skills [2, 12, 13]. For this reason, many studies have investigated the mechanisms underlying this phenomenon.

Friesen and Kingstone [14] were the first to demonstrate that looking at eye-gaze will trigger the shift of our attentional focus into the gazed-at location. They used a variant of the classic visuospatial cueing paradigm [15] in which, at the centre of the screen, a schematic face appeared, gazing either straight ahead, left or right. The participants’ task was to detect, locate or discriminate a target that would appear congruently at the gazed location or incongruently at the opposite one. They found that targets appearing at the congruent location were detected, located, or discriminated more quickly than targets appearing at the incongruent one. Since then, an increasing number of researchers have further studied this effect using the same or slight variations of this cueing paradigm. Results repeatedly demonstrated that even when gaze direction is not predictive of target location (e.g., [1619]) or is counterpredictive (e.g., [8]), the gaze shift automatically directs the observer’s attention to the same location indicated by it (see [6, 10] for a review).

Based on these behavioural findings and the evolutionary and social significance of eye gaze [5], several authors have suggested that the attentional orienting triggered by the eye-gaze direction may represent a unique attentional process that can be differentiated from that produced by directional stimuli with no biological relevance, such as arrows (e.g. [9, 18, 20]), which have proven as well to facilitate attentional orienting, even if they are non-predictive [21]. In this regard, many studies have tried to answer whether arrow and gaze cues produce the same or different behavioural or neural effects, leading to mixed results, with some of them finding a significant difference between the two stimuli and others suggesting that the effect triggered by them is indistinguishable (e.g., [2226]).

However, clarifying this debate, recent meta-analytical evidence [27] has shown no behavioural differences between the attentional orienting triggered by eye-gaze and arrow cues. For instance, it remains unclear whether the attentional shifts induced by these two types of cues differ in some other important aspects. Recently, a study by Marotta, Lupiáñez, Martella, and Casagrande [18] suggested that the source of a possible difference between eye-gaze and arrow attentional cues may lie in the dissimilar way people select objects in response to these two types of cues. In particular, they speculated that “biologically and socially relevant gaze cues may encourage more specific attentional orienting, compared to arrow cues, since a specific intention may be automatically attributed to gaze and not to arrows” ([18], p. 333). Consistent with this view, they found that when using eye-gaze as a cue, attention is directed specifically to the location or part of the object being looked at. In contrast, when using an arrow, attention spreads across the entire cued object.

The property of gaze cues to induce “specific” attentional orienting has also been corroborated by Wiese, Zwickel, and Müller [28], showing that when previewed location placeholders were used, gaze cues induced a facilitation effect only when targets appeared inside the exact placeholder pointed at, but not when targets appeared in different spatially located objects within the cued hemifield. However, when no placeholders were presented, gaze cueing effects were detectable in response to the specific cued location but also spread across the entire cued hemifield. In light of these findings, another person’s gaze may trigger a specific attentional orienting only when an object is presented in the visual scene.

Considering the importance of orienting attention to the same object of others’ attentional direction to establish a social joint attention episode, this makes perfect sense. In other words, another person’s gaze may induce a specific attentional orienting only when an object is present in the environment and can be interpreted as the goal of the gaze. However, this should not be observed in response to arrow cues since arrows have a directional property, like gaze, but no biological or social significance. However, to date, no studies have directly compared the attentional selection produced by these two types of stimuli in the presence or absence of placeholders within the visual field. To accomplish this aim, in the present study, we have used a paradigm very similar to that used by Wiese and colleagues [28], in which, in response to gaze and arrow cues, participants had to respond to targets presented in one of three possible locations within a cued hemifield: 0° and +/-60° from the horizontal meridian. Placeholder objects for the targets will be presented on half the trials (placeholder-present condition), while on the other half, no placeholders will be presented (placeholder-absent condition).

In the placeholder-present condition, we expected that gaze cues would elicit a specific attentional orienting benefit only for targets presented within the object (i.e., placeholder) looked at, but not for targets appearing in different spatial locations within the cued hemifield. Arrows should elicit a more general attentional benefit across the entire cued hemifield. As mentioned above, the cued object should be interpreted as the goal of another person’s attention only in response to gaze cues (i.e., looked at object) but not in response to arrows. On the other hand, no difference between gaze and arrow attentional effect should be observed when no objects are presented on the scene (placeholder-absent condition), cueing effects spreading across the entire cued hemifield with both gaze and arrow cues.

Experiment 1

Method

Participants.

Thirty-seven undergraduate students (24 female; mean age: 22 years) gave their informed consent before voluntarily participating in this research. There was no clear experiment of reference for computing the needed sample size in our first experiment, as this was the first time our paradigm was used. We could use as reference the study by Wiese et al., [28], but they did not compare arrows and gaze, which was critical for our experiment. Instead, we could use Marotta et al. [18] experiments, in which objects instead of group of objects (i.e., placeholders) were used, but they did compare gaze with arrow cues. Marotta et al. [18] used samples of 24 and 30 participants, so we decided to use a minimum of 36 participants for Experiment 1. Because the sample size was not computed a priori based on the effect size of a previous study, we used G*Power [29] to compute sensitivity of our specific relevant analyses regarding the orienting effects (t-test). With our sample size (37 participants) the minimum effect size that could be detected for α = 0.5, and 1−β = 0.80, is Cohen’s dz = 0.417, which is higher than most effect sizes of interest.

All participants had normal or corrected to normal vision and were unaware of the purpose of the experiment. In this and the following experiments, participants received course credits for their participation. All experiments were approved by the Ethical Committee of the University of Granada (175/CEIH/2017) and conducted in conformity with the ethical standards of the Declaration of Helsinki.

Apparatus and stimuli.

The cueing-discrimination task used in this experiment was presented on a 21-inch VGA colour monitor of a computer running E-Prime software [30] to control the presentation of the stimuli, timing operations, and data collection.

On the hemifield placeholder-present condition, the fixation display consisted of three placeholder boxes presented within each hemifield at 0° and +/-60° from the horizontal meridian; the central fixation stimuli changed depending on the cue type. For the arrow trials, a horizontal line was presented at the centre of the screen, and for the gaze trials, the display was a schematic face with the eyes looking straight. During experimental trials, the face pupils, or the appearance of an arrowhead, signalled left or right from fixation. Target stimuli were the letters “X” or “O”. The background of the screen was white, and all the stimuli were black.

Procedure.

After giving their informed consent, participants were seated at about 55cm from a computer screen in a quiet, dimly lit room. Trials started with a fixation display that differed depending on the cue type. In gaze cueing trials, a schematic face with a straight gaze was presented as fixation, whereas, in arrow cueing trials, the fixation stimulus was a horizontal line centred on the screen. This display was presented for 700ms; then, a change was made to the arrow or eye gaze fixation points to indicate left or right on the horizontal meridian (importantly, no other position or placeholder was directly cued). Following the presentation of the cue, a target (either the letter “X” or “O”) appeared unpredictably in one of six possible locations (see Fig 1).

thumbnail
Fig 1. Schematic view of a trial sequence for both the gaze cue and the arrow cue conditions.

The example represents: A) gaze-cue/placeholder-absent/same-hemifield condition, and B) arrow-cue/placeholder-present/same-location/same-hemifield condition.

https://doi.org/10.1371/journal.pone.0280955.g001

Stimulus onset asynchrony (SOA) was 300ms. Cue and target remained on the screen until a response was given or for 1500ms in case of no response. Then, a blank display was presented for 700ms. Targets appeared either in one of the three placeholder boxes presented within each hemifield (placeholder-present condition) or at one of the same positions in an empty space when no placeholder boxes were presented (placeholder-absent condition).

Participants were required to discriminate the letter “X” or “O” by pressing either the “M” key (with the right hand) or the “Z” key (with the left hand) on the computer keyboard, depending on the target letter that was presented. Half of the participants pressed “M” for target “X” and “Z” for target “O”, whereas the other half received the reversed mapping. They were also instructed to respond as quickly and accurately as possible and maintain central fixation throughout all trials. They were informed that the direction of the central stimuli did not predict the location of the target, so they should ignore it.

Cue direction, target stimuli, target location, and placeholder presence were randomly interspersed within each block of trials, whereas cue type was manipulated between blocks in a counterbalanced order. There were two experimental blocks of 288 trials each (one for each cuetype), each preceded by a practice block of eight trials (where participants received feedback for their performance), summing up 592 trials in total.

Design.

Three-factor repeated measure design was used to analyse an overall effect in this experiment, 2 (cue-type) x 2 (placeholder-condition) x 4 (validity). The cue-type had two levels, arrow and eye-gaze; placeholder-condition consisted of placeholder-present and placeholder-absent conditions, and the four validity levels were same-location/same-hemifield, opposite-location/opposite-hemifield, same-hemifield and opposite-hemifield trials.

Given our main interest on specific attentional orienting mechanisms, t-test analyses were performed to analyse specific effects of validity (general-cueing and hemifield-effects), and its modulation by relevant variables. For the general-cueing effect, the comparison of cue-target relations consisted of same-location/same-hemifield trials vs opposite-location/opposite-hemifield trials; for the hemifield-effect, the cue-target relation consisted of same-hemifield vs opposite-hemifield trials (see Fig 2).

thumbnail
Fig 2. Illustration of the four types of cue-target relation of Experiment 1.

The images represent the gaze-cue in a placeholder-present condition. The cue-target relation for the placeholder-absent condition was the same, with the exception that no placeholder boxes were presented on the scene.

https://doi.org/10.1371/journal.pone.0280955.g002

Results

For the reaction time analysis, trials with correct responses faster than 100ms or slower than 1200ms (0.5%), and incorrect response trials (5.69%) were excluded. Mean RT, standard deviations, and error percentage for all conditions are shown in Table 1.

thumbnail
Table 1. Mean reaction times (RT), standard deviation (SD), and percentage of incorrect responses (%IR) as a function of the placeholder-condition, type of cue, and cue-target (CT) relation in Experiment 1.

https://doi.org/10.1371/journal.pone.0280955.t001

A cue-type (arrows vs. gaze) x placeholder-condition (placeholder-present vs. placeholder-absent) x validity (same-location/same-hemifield, opposite-location/opposite-hemifield, same-hemifield and opposite-hemifield) repeated measures ANOVA was performed to analyse an overall effect.

The analysis reported a main effect of placeholder-condition (F1,36 = 21.33, p = < .001, η2p = 0.372), showing that overall reaction times were faster when no placeholders were presented on the scene (M = 487, SD = 63.36) than when placeholders were presented (M = 502, SD = 66.28). A main effect of validity was also found (F3,108 = 30.24, p = < .001, η2p = 0.457), showing that reaction times were faster when the target appeared at the same-location/same-hemifield (M = 483, SD = 63.65), followed by opposite-location/opposite-hemifield (M = 495, SD = 67.51), same-hemifield (M = 499, SD = 63.26) and opposite-hemifield (M = 502, SD = 65.27) respectively.

The placeholder-condition X validity interaction was also significant (F3,108 = 6.20, p = < .001, η2p = 0.147). Partial ANOVAs for each validity condition showed that when the targets appeared at the same-location/same-hemifield, there were no differences related to the presence or absence of placeholders in the scene (p>.05). However, when targets appeared at opposite-location/opposite-hemifield, same-hemifield and opposite-hemifield participants were significantly faster when no placeholder objects were presented (all ps < .05).

More importantly, separate t-test analyses were conducted to analyse, on the one hand, the general-cueing effect (same-location/same-hemifield vs. opposite-location/opposite-hemifield) and, on the other, the hemifield-effect (same-hemifield vs opposite-hemifield), in both the placeholder-absent and the placeholder-present conditions. The results revealed that the general-cueing effect was significant for both the placeholder absent (t(36) = -3.889, p = < .001, d = -0.639) and the placeholder-present conditions (t(36) = -4.719, p = < .001, d = -0.776), showing that in general, reaction times were faster when targets appeared at the same-location/same-hemifield trials than at the opposite-location/opposite-hemifield trials regardless the presence of placeholders on the scene (see Fig 3). When analysing the hemifield-effect, no significant effect was found for any of the placeholder conditions (all ps>.05).

thumbnail
Fig 3. Reaction times (RTs) results from Experiment 1.

Results are shown separately for the general-cueing effect (Same-Location/Same Hemifield vs. Opposite-Location/Opposite Hemifield) and the hemifield-effect (Same-Hemifield vs. Opposite Hemifield). Mean RTs presented for each type of cue as a function of the cue-target relation in the placeholder-present and placeholder-absent conditions. Error bars represent the standard error of the mean, computed following Cousineau’s [31] method to eliminate variability between participants.

https://doi.org/10.1371/journal.pone.0280955.g003

Importantly, neither the main effect of cue-type, nor its interaction with any other variable reached significance (all ps >.05).

Discussion

This experiment tested whether eye-gaze attentional cues trigger more specific attentional orienting than arrows when placeholder objects are presented on the signalled hemifield. However, the results of this experiment showed that arrows and eyes triggered very similar attentional cueing effects in both placeholder-absent and present conditions. In particular, with both cues, a significant attentional benefit was only observed for targets appearing at the specifically cued location but not for targets appearing in different spatial locations within the cued hemifield.

At first sight, these findings seem to suggest that attention triggered by social and non-social cues is not modulated by the presence of placeholders on the scene, and they are consistent with the literature, which has generally reported similar behavioural cueing effects for gaze and arrows in the normotypical population (for review, see [32]). On the other hand, they seem to contrast with our hypothesis according to which attentional benefits should be observed only for targets presented in the specific object (or part of an object) when signalled by eye-gaze cues, and for all the targets, independently from their position in the cued hemifield, when signalled by arrows.

Indeed, we assumed that arrows should elicit a more general attentional benefit spreading across the cued hemifield, based on our previous findings showing that arrows, but not eye-gaze, allow attentional shifts to spread through to the entire surface of an object presented in the cued visual field. Nevertheless, given the specific paradigm we used in our previous experiment, an alternative explanation could be plausible. As shown in Fig 2, the six objects were equidistant and distributed across the circle of objects that served as a background fixation display. Then it makes sense that only a general-cueing effect is observed for both arrows and gaze. It could then be possible that arrows trigger attentional orienting spreading the cued object’s entire surface but not across the entire cued hemifield. This would explain why in the present experiment, an attentional effect was observed only for targets appearing at the specifically cued location or object, as both arrows and gaze similarly orient attention to the specifically cued signalled object. In the following experiments, we decided to modify the proximity between the objects within each hemifield so that participants would perceive one easily segregated group of objects.

Experiment 2

The goal of experiment 2 was to investigate whether, by manipulating the distribution of placeholders within the hemifield (i.e., following the gestalt’s law of proximity [33, 34]), cues would trigger attention not only to the specific cued object but also towards the entire group of signalled placeholder objects. In particular, since there is evidence that the attention system similarly treats perceptually grouped objects [35, 36], we expected that by grouping by proximity the placeholders, the attentional effect would be similar to the one found by Marotta and colleagues [18]: attention would spread to the whole group of placeholder objects only when using an arrow, while, when using eye-gaze, attention would be directed just to the specific cued placeholder. Moreover, we did not expect such an effect when no placeholders were presented on the scene.

Method

Participants.

A new sample of seventy-five undergraduate volunteers (64 females; 18–35 years) were recruited through an experimental online platform from the University of Granada. Participants followed the protocol equally and had the same characteristics as those in experiment 1. Given the online collection of data we decided to double the sample size.

Again, as in experiment 1, because the sample size was not computed a priori based on the effect size of the previous study, we used G*Power [29] to compute sensitivity of our specific relevant analyses regarding the orienting effects (t-test). With our sample size (75 participants) the minimum effect size that could be detected for α = 0.5, and 1−β = 0.80, is Cohen’s dz = 0.290, which is higher than most effect sizes of interest.

Apparatus and stimuli.

Unlike Experiment 1, the cueing discrimination task was designed using the graphical experiment builder OpenSesame [37]. As shown in Fig 4, the stimuli in this experiment were nearly the same as those used in the previous experiment, except for the placeholder boxes distribution. This time in the displays of the placeholder-present condition, the three placeholder boxes subtending within each hemifield were located at 0°, +/- 45° and +/-90° from the horizontal meridian and were randomly presented in two possible distributions (+/-45° from the vertical meridian). No other changes were made to the stimuli.

thumbnail
Fig 4. Schematic view of a trial sequence for both the gaze cue and the arrow cue conditions of Experiment 2.

The example represents: A) gaze/placeholder-absent/same-location/same-group condition, B) arrow/placeholder-present/opposite-group condition.

https://doi.org/10.1371/journal.pone.0280955.g004

Procedure.

Participants completed this experiment online. They were provided with a link to a survey (using the Lime Survey platform; https://www.limesurvey.org/) to complete the informed consent, receive instructions and be redirected to the online behavioural task (hosted on a JATOS server). All participants were given a clear indication of using a computer to complete the task in order to prevent them from utilising a different device (e.g., smartphone or tablet). Furthermore, the experiment was programmed in a way that a keyboard was needed for the correct recording of responses.

Furthermore, the procedure of this experiment was similar to the one used in experiment 1, although some changes were made. First, the presentation of the placeholder-condition (present and absent) was separated into two blocks. Second, the order of spatial cues (arrow and gaze) was randomly interspersed within each block of trials. Third, as stated above, in the placeholder-present condition, the positions of the six placeholder boxes were grouped into quadrants, appearing at radial distances of 0°, +/- 45° and +/- 90° from the horizontal axis of a central stimulus (see, Fig 4) and were randomly positioned in two possible distributions (+/-45° from the vertical meridian). Finally, the six possible target positions were adapted as the distribution of the placeholder boxes described above (0°, +/- 45° and +/- 90° from the horizontal axis) for both placeholder-present and placeholder-absent conditions. The four critical cue-target relations for the analysis were almost equal to the previous experiment but just adapted to the new possible target positions (see, Fig 5). The remaining characteristics of the procedure were the same as in experiment 1.

thumbnail
Fig 5. Illustration of the four types of cue-target relation of Experiments 2.

The placeholder-group tilted orientation shown here is -45˚ from vertical. The top images represent an example of gaze cue in a placeholder-present condition; the bottom images represent the arrow cue in a placeholder-present condition. The cue-target relation for the placeholder-absent condition was the same, with the exception that no placeholder boxes were presented on the scene.

https://doi.org/10.1371/journal.pone.0280955.g005

Design.

As in experiment 1, in this experiment, an overall effect was analysed by using a three-factor repeated measure design, 2 (cue-type) x 2 (placeholder-condition) x 4 (validity). Similar to experiment 1, the cue-type had two levels, arrow and eye-gaze; placeholder-condition had two levels, placeholder-present and placeholder-absent, and validity had four levels, now-called same-location/same-group, opposite-location/opposite-group, same-group and opposite-group. To analyse the general-cueing effect and the now called grouping-effect (targets appearing at +/- 45° and, +/- 90° from the horizontal meridian of the cue), T-test analyses were performed separately for each placeholder condition. For the general-cueing effect, the comparison of cue-target relations consisted of same-location/same-group trials vs opposite-location/opposite-group trials; for the grouping-effect, the cue-target relation consisted of same-group vs opposite-group trials. When no placeholders were presented, the cue-target relations corresponding to same-group and opposite-group conditions were created by distributing the up and down trials between those two types of cue-target relations. The order of blocks of each placeholder condition (present/absent) was counterbalanced across participants.

Results

Correct response trials with RT faster than 100ms or slower than 1200ms (0.8%) and incorrect response trials (6.29%) were excluded from the RT analysis. Mean RT, standard deviations, and error percentage for all conditions are shown in Table 2.

thumbnail
Table 2. Mean reaction times (RT), standard deviation (SD), and percentage of incorrect responses (%IR) as a function of placeholder-condition, type of cue, and cue-target (CT) relation in Experiment 2.

https://doi.org/10.1371/journal.pone.0280955.t002

A cue-type (arrows vs. gaze) x placeholder-condition (placeholder-present vs. placeholder-absent) x validity (same-location/same-group, opposite-location/opposite-group, same-group and opposite-group) repeated measures ANOVA was performed to analyse an overall effect.

The analysis reported a main effect of placeholder-condition (F1,74 = 26.86, p = < .001, η2p = 0.266), showing that overall reaction times were faster when no placeholders were presented on the scene (M = 527, SD = 68.63) than when placeholders were presented (M = 552, SD = 79.88). A main effect of validity was also found (F3,222 = 61.25, p = < .001, η2p = 0.087), showing that reaction times were faster when the target appeared at the same-location/same-group (M = 523 SD = 72.56), followed by opposite-location/opposite-group (M = 540, SD = 75.96), same-group (M = 546, SD = 75.04) and opposite-group (M = 550, SD = 75.59) respectively.

The placeholder x validity interaction was also significant (F3,222 = 18.07 p = < .001, η2p = 0.196). Partial ANOVAs showed that when the targets appeared at the same-location/same-group, no differences related to the presence or absence of placeholders in the scene were found (p>.05); nonetheless, when targets appeared at the opposite-location/opposite-group, same-group, and opposite-group, participants were significantly faster when no placeholder objects were presented (all ps < .001).

The main effect of cue-type, nor its interaction with the variables placeholder condition or validity reached significance (all ps >.05). Nonetheless, a three-way interaction of placeholders x cue type x validity was found (F3,222 = 7.11 p = < .001, η2p = 0.088), showing that when no placeholders were presented, as expected, only the main effect of validity was significant (F3,222 = 9.75, p = < .001, η2p = 0.016), whereas when placeholders were presented both the main effect of validity (F3,222 = 72.99, p = < .001, η2p = 0.496), and the cue type x validity interaction (F3,222 = 6.73, p = < .001, η2p = 0.083), were significant.

Indeed, T-test analyses, separately conducted for placeholder absent and present conditions and for each cue type, revealed that when placeholders were absent, it was possible to observe a general-cueing effect for both gaze (t(74) = -2.376, p = 0.02, d = -0.274) and arrows (t(74) = -2.027, p = 0.046, d = -0.234); in this condition, no grouping effect was found for any of the cue types (all ps>.05). When placeholders were presented on the scene, the general-cueing effect was also observed for both gaze (t(74) = -2.472, p = 0.016, d = -0.285) and arrows (t(74) = -6.247, p = < .001, d = -0.721). Nevertheless, and importantly, in this condition, the analysis revealed a main effect of grouping but this was observed only when arrows were used as cue (t(74) = -3.618, p = < .001, d = -0.418); when gaze was used as cue, no grouping-effect was observed (t(74) = -0.769, p = .445, d = -0.089; see Fig 6).

thumbnail
Fig 6. Reaction times (RTs) results from Experiment 2.

Results are shown separately for the general-cueing effect and the grouping-effect. Mean RTs presented for each type of cue as a function of the cue-target relation in the placeholder-present and placeholder-absent conditions. Error bars represent the standard error of the mean, computed following Cousineau’s [31] method to eliminate variability between participants.

https://doi.org/10.1371/journal.pone.0280955.g006

Discussion

As in the previous experiment, no facilitation effect was observed for any cue beyond the specifically cued location when no placeholder objects were presented. However, experiment 2 was conducted to assess whether attention would spread to an entire group of placeholders within a hemifield when using a central non-informative arrow cue and whether eye-gaze will trigger attention just to the specific location or placeholder of the group that is being signalled. Results showed that both arrow and gaze cues provoke attentional facilitation when targets appear at the exact object/location that is being pointed at (general-cueing effect). On the other hand, only arrows, but not eye-gaze, seemed to orient attention to targets appearing in the same group of objects but in a different position than the one indicated by the cue (grouping-effect/placeholder-present condition).

These findings can lead us to speculate that biologically relevant stimuli such as eye-gaze may trigger more specific attentional orienting than arrows due to the particular intention that we may attribute to the others’ focus of attention. However, this specific gaze effect is only observed when measuring attentional facilitation beyond the specifically cued location/object, where a general-cueing effect is observed for arrows and gaze, consistently with the literature. Furthermore, in order for attention to spread to close objects, these must be perceptually organized into distinct groups of objects, as in this experiment, and differently from the previous one. Interestingly, attention spread to nearby objects within the group only with arrow cues even under these conditions. Conversely, when a gaze cue was used, attention was restricted to the specifically cued object within the group.

General discussion

The present study aimed to explore through a series of two experiments whether the attentional orienting in response to non-predictive arrow and eye-gaze cues differs when placeholder objects are presented on the scene.

Results suggest that when several placeholders are grouped into a perceptual object as a function of Gestalt principles of proximity (Experiment 2), gaze and arrows cues elicit attentional effects similar to those first reported by Marotta and colleagues ([18], see [38] for replication). In particular, they showed that when objects were present in the display, eye-gaze cues directed attention to the specific part of the cued object, while arrow cues spread attention to the entire signalled object. Here, we extend these results to new displays in which no entire objects but groups of placeholders, grouped according to their proximity, were presented. In particular, it was observed that attention spread to the whole group of placeholder objects only when using an arrow, while it was restricted to the specific cued placeholder when eye-gaze cues were used. This pattern of results has been replicated in a different on-line study with a larger sample size in which we investigated the modulation of gender/sex over the orienting effects observed with arrows and gaze [39].

On the other hand, when placeholder objects were not grouped within a cued hemifield, as in Experiment 1, arrows and eyes triggered very similar attentional cueing effects with a significant attentional benefit only for targets appearing at a specifically cued location or placeholder, but not for targets appearing in other spatial locations or placeholders. The fact that with arrow cues, the RT advantage for targets presented in the placeholders of the cued hemifield is not present when placeholders are not grouped suggests that arrows trigger attentional orienting spreading to the entire surface of a cued perceptual object but not across the entire cued hemifield, neither when different ungrouped objects are spread out in the hemifield (i.e., in the placeholders present condition in Experiment 1), nor in the absence of any object (in the placeholders absent condition in Experiments 1 and 2).

As a potential limitation, it is important to note that for the arrow cues, the horizontal line is present and then the arrowhead appears at cue onset, whereas for the gaze cues, the pupils are present and then move to the left or the right at cue onset. Also, eye movements were not controlled, which could allow for the differences observed between cue types. Note, however, that if these differences were due to these factors, they would be observed independently of the presence or absence of placeholders, and whether they could be easily grouped or not into two objects. However, the differences seem to be related to how the two cue types interact with attention to groups of objects.

Indeed, the present results have important implications for the perceptual grouping literature, as well as the social attention literature. Interestingly, the influence of Gestalt principles in attentional selection tasks had been previously established in earlier research using peripheral cues (e.g., [36, 40]). The offered results extend these findings to central non-predictive non-social cues. It has been previously suggested that cueing a portion of an object spreads attention across the entire object when arrow cues are used, while it restricts attention at the specific portion of the cued object when eye-gaze cues are used. The present results extend this notion, suggesting that this attentional dissociation is also observed when grouped objects are cued by eye-gaze and arrow cues. The boundary conditions for this effect seem to be related to Gestalt laws of perceptual grouping, as no grouping-effect was observed in Experiment 1 when distance and similarity perhaps led to the perceptual segregation of the display on a single group of objects (i.e., the six placeholders) rather than into two groups of objects (one cued and the other uncued) as in Experiment 2.

Therefore, both peripheral cueing and the effects of symbolic non-predictive non-social cues seem to be triggered automatically and mediated by object-based processes. Importantly, although social directional cues like gaze might produce an effect of a similar nature, as the common effect observed with the standard gaze cueing paradigm and the general-cueing effect observed in our experiments, they must produce an extra effect that restricts attention to the specifically looked-at location. The idea that gaze triggers both an effect similar to the one induced by non-social cues [27] and an extra specific effect has also been shown with other paradigms. Indeed, Marotta and colleagues [41], in a study in which both behavioural and electrophysiological data were collected, observed that arrows and gaze produce a similar effect at earlier event-related components (P1 and N1) but opposite effects at later components (N2 and P300).

Thereby, the present results seem to argue in favour of the idea that biologically relevant stimuli such as eye-gaze may trigger a unique attentional process, qualitatively distinct from the attentional process triggered by non-biologically relevant stimuli such as arrows. Marotta and colleagues [18] suggested that this specific attentional orienting effect of eye-gaze might be mediated by the automatic attribution of intention to gaze and not to arrows. This notion seems to be supported by the present study results and by the observations of Vuilleumier [42] and Wiese et al., [28], showing that when reference objects are presented on the scene, gaze cues trigger a facilitation effect but only to the specific gaze-at object.

For decades, an eye-gaze major role in social communication has been of interest to many researchers (see [5, 43, 44] for reviews). In particular, literature explains how eye-gaze is likely to be used to perceive and understand the emotional and mental states of others and subsequently how it may be a reliable source to anticipate their actions. Thus, rather than gaze-cue not being able to direct attention to a place other than the signalled location, participants may attribute a specific intention to the eye-gaze by retaining their attention specifically at the inferred-at location or the signalled placeholder and not to the entire hemifield or nearby placeholders. Consequently, if these social mechanisms are involved in the specific attentional orienting triggered by eye-gaze, it seems logical to expect that when the spatial cue is non-biologically relevant as an arrow, such a mechanism would not be activated, and attention would be rather spread to nearby objects or the other extreme of the object when larger objects are used [18] following perceptual grouping laws.

Therefore, in order to investigate social attention, paradigms that measure qualitative rather than quantitative differences between biologically and non-biologically relevant stimuli should be used, since the standard gaze-cueing paradigm has proven not to be suitable to capture differences in the attentional orienting effect elicited by social and non-social cues [27]. It will be interesting for future research to explore whether the aforementioned qualitative differences between eye-gaze and arrow cues can be observed in populations with reduced social abilities, such as people with autism spectrum disorder or schizophrenia. Perhaps, in these populations, no difference between social and non-social attentional cues may be observed.

References

  1. 1. Baron-Cohen S. Mindblindness: An essay on autism and theory of mind. MIT press; 1997.
  2. 2. Tomasello M. Joint attention as social cognition. Joint attention: Its origins and role in development. 1995;103130:103–30.
  3. 3. Langton SR, Watt RJ, Bruce V. Do the eyes have it? Cues to the direction of social attention. Trends in cognitive sciences. 2000 Feb 1;4(2):50–9. pmid:10652522
  4. 4. Capozzi F, Ristic J. How attention gates social interactions. Annals of the New York Academy of Sciences. 2018 Aug;1426(1):179–98. pmid:29799619
  5. 5. Emery NJ. The eyes have it: the neuroethology, function and evolution of social gaze. Neuroscience & Biobehavioral reviews. 2000 Aug 1;24(6):581–604. pmid:10940436
  6. 6. Dalmaso M, Castelli L, Galfano G. Social modulators of gaze-mediated orienting of attention: A review. Psychonomic Bulletin & Review. 2020 Oct;27(5):833–55. pmid:32291650
  7. 7. Cooney SM, O’Shea A, Brady N. Point me in the right direction: Same and cross category visual aftereffects to directional cues. PloS one. 2015 Oct 28;10(10):e0141411. pmid:26509881
  8. 8. Driver IV J, Davis G, Ricciardelli P, Kidd P, Maxwell E, Baron-Cohen S. Gaze perception triggers reflexive visuospatial orienting. Visual cognition. 1999 Oct 1;6(5):509–40.
  9. 9. Friesen CK, Ristic J, Kingstone A. Attentional effects of counterpredictive gaze and arrow cues. Journal of Experimental Psychology: Human Perception and Performance. 2004 Apr;30(2):319. pmid:15053691
  10. 10. Frischen A, Bayliss AP, Tipper SP. Gaze cueing of attention: visual attention, social cognition, and individual differences. Psychological bulletin. 2007 Jul;133(4):694. pmid:17592962
  11. 11. Butterworth G, Jarrett N. What minds have in common is space: Spatial mechanisms serving joint visual attention in infancy. British journal of developmental psychology. 1991 Mar;9(1):55–72.
  12. 12. Baron-Cohen S. The Eye Direction Detector (EDD) and the Shared Attention Mechanism (SAM): Two cases for evolutionary psychology. Joint attention: Its origins and role in development. 1995.
  13. 13. Bruner J. Child’s talk: Learning to use language. Child Language Teaching and Therapy. 1985 Jan;1(1):111–4.
  14. 14. Friesen CK, Kingstone A. The eyes have it! Reflexive orienting is triggered by nonpredictive gaze. Psychonomic Bulletin & Review. 1998 Sep:5:490–495.
  15. 15. Posner MI. Orienting of attention. Quarterly journal of experimental psychology. 1980 Feb;32(1):3–25. pmid:7367577
  16. 16. Blair CD, Capozzi F, Ristic J. Where is your attention? Assessing individual instances of covert attentional orienting in response to gaze and arrow cues. Vision. 2017 Sep;1(3):19. pmid:31740644
  17. 17. Bonmassar C, Pavani F, van Zoest W. The role of eye movements in manual responses to social and nonsocial cues. Attention, Perception, & Psychophysics. 2019 Jul;81(5):1236–52. pmid:30737756
  18. 18. Marotta A, Lupiáñez J, Martella D, Casagrande M. Eye gaze versus arrows as spatial cues: two qualitatively different modes of attentional selection. Journal of Experimental Psychology: Human Perception and Performance. 2012 Apr;38(2):326. pmid:21688940
  19. 19. Xu B, Tanaka JW. The cued recognition task: dissociating the abrupt onset effect from the social and arrow cueing effect. Attention, Perception, & Psychophysics. 2015 Jan;77(1):97–110. pmid:25190323
  20. 20. Marotta A, Román-Caballero R, Lupiáñez J. Arrows don’t look at you: Qualitatively different attentional mechanisms triggered by gaze and arrows. Psychonomic bulletin & review. 2018 Dec;25(6):2254–9. pmid:29546665
  21. 21. Hommel B, Pratt J, Colzato L, Godijn R. Symbolic control of visual attention. Psychological science. 2001 Sep;12(5):360–5. pmid:11554667
  22. 22. Brignani D, Guzzon D, Marzi CA, Miniussi C. Attentional orienting induced by arrows and eye-gaze compared with an endogenous cue. Neuropsychologia. 2009 Jan 1;47(2):370–81. pmid:18926835
  23. 23. Guzzon D, Brignani D, Miniussi C, Marzi CA. Orienting of attention with eye and arrow cues and the effect of overtraining. Acta Psychologica. 2010 Jul 1;134(3):353–62. pmid:20421095
  24. 24. Hietanen JK, Nummenmaa L, Nyman MJ, Parkkola R, Hämäläinen H. Automatic attention orienting by social and symbolic cues activates different neural networks: An fMRI study. Neuroimage. 2006 Oct 15;33(1):406–13. pmid:16949306
  25. 25. Joseph RM, Fricker Z, Keehn B. Activation of frontoparietal attention networks by non-predictive gaze and arrow cues. Social Cognitive and Affective Neuroscience. 2015 Feb 1;10(2):294–301. pmid:24748545
  26. 26. Stevens SA, West GL, Al-Aidroos N, Weger UW, Pratt J. Testing whether gaze cues and arrow cues produce reflexive or volitional shifts of attention. Psychonomic Bulletin & Review. 2008 Dec;15(6):1148–53. pmid:19001582
  27. 27. Chacón-Candia JA, Román-Caballero R, Aranda-Martín B, Casagrande M, Lupiáñez J, Marotta A. Are there quantitative differences between eye-gaze and arrow cues? A meta-analytic answer to the debate and a call for qualitative differences. Neuroscience & Biobehavioral Reviews. 2022 Dec;7:104993. pmid:36496190
  28. 28. Wiese E, Zwickel J, Müller HJ. The importance of context information for the spatial specificity of gaze cueing. Attention, Perception, & Psychophysics. 2013 Jul;75(5):967–82. pmid:23504713
  29. 29. Faul F, Erdfelder E, Lang AG, Buchner A. G* Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior research methods. 2007 May;39(2):175–91. pmid:17695343
  30. 30. Schneider W, Eschman A, Zuccolotto A. E-Prime: User’s Guide. Reference Guide. Getting Started Guide. Psychology Software Tools, Incorporated; 2002.
  31. 31. Cousineau D. Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson’s method. Tutorials in quantitative methods for psychology. 2005 Mar;1(1):42–5.
  32. 32. Birmingham E, Kingstone A. Human social attention. Progress in brain research. 2009 Jan 1;176:309–20. pmid:19733765
  33. 33. Han S, Humphreys GW, Chen L. Uniform connectedness and classical Gestalt principles of perceptual grouping. Perception & psychophysics. 1999 Jan;61(4):661–74. pmid:10370335
  34. 34. Wagemans J, Elder JH, Kubovy M, Palmer SE, Peterson MA, Singh M, et al. A century of Gestalt psychology in visual perception: I. Perceptual grouping and figure–ground organization. Psychological bulletin. 2012 Nov;138(6):1172. pmid:22845751
  35. 35. Baylis GC, Driver J. Visual parsing and response competition: The effect of grouping factors. Perception & Psychophysics. 1992 Mar;51(2):145–62. pmid:1549433
  36. 36. Dodd M, Pratt J. Allocating visual attention to grouped objects. European Journal of Cognitive Psychology. 2005 Jul 1;17(4):481–97.
  37. 37. Mathôt S, Schreij D, Theeuwes J. OpenSesame: An open-source, graphical experiment builder for the social sciences. Behavior research methods. 2012 Jun;44(2):314–24. pmid:22083660
  38. 38. Chacón-Candia JA, Lupiáñez J, Casagrande M, Marotta A. Sex differences in attentional selection following gaze and arrow cues. Frontiers in psychology. 2020 Feb 14;11:95. pmid:32116911
  39. 39. Chacón-Candia, J. A. Sex differences in the dissociation between social and non-social attention [Doctoral dissertation]. Granada, Spain: Universidad de Granada & Rome, Italy: Sapienza Università di Roma; 2022.
  40. 40. Botta F, Lupiáñez J, Sanabria D. Visual unimodal grouping mediates auditory attentional bias in visuo-spatial working memory. Acta psychologica. 2013 Sep 1;144(1):104–11. pmid:23792666
  41. 41. Marotta A, Lupiáñez J, Román-Caballero R, Narganes-Pineda C, Martín-Arévalo E. Are eyes special? Electrophysiological and behavioural evidence for a dissociation between eye-gaze and arrows attentional mechanisms. Neuropsychologia. 2019 Jun 1;129:146–52. pmid:30935837
  42. 42. Vuilleumier P. Perceived gaze direction in faces and spatial attention: a study in patients with parietal damage and unilateral neglect. Neuropsychologia. 2002 Jan 1;40(7):1013–26. pmid:11900753
  43. 43. Argyle M, Cook M. Gaze and mutual gaze. Cambridge U Press. 1976.
  44. 44. Kleinke CL. Gaze and eye contact: a research review. Psychological bulletin. 1986 Jul;100(1):78. pmid:3526377