Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Exogenous capture of visual spatial attention by olfactory-trigeminal stimuli

  • Matthieu Ischer,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Writing – original draft

    Affiliations Swiss Center for Affective Sciences, University of Geneva, Geneva, Switzerland, Department of Psychology, University of Geneva, Geneva, Switzerland

  • Géraldine Coppin,

    Roles Writing – original draft, Writing – review & editing

    Affiliations Swiss Center for Affective Sciences, University of Geneva, Geneva, Switzerland, Department of Psychology, University of Geneva, Geneva, Switzerland, Swiss Distance University Institute (UniDistance/FernUni), Brig, Switzerland

  • Axel De Marles,

    Roles Data curation

    Affiliation Swiss Center for Affective Sciences, University of Geneva, Geneva, Switzerland

  • Myriam Essellier,

    Roles Data curation

    Affiliations Swiss Center for Affective Sciences, University of Geneva, Geneva, Switzerland, Department of Psychology, University of Geneva, Geneva, Switzerland

  • Christelle Porcherot,

    Roles Methodology, Resources

    Affiliation Firmenich, S.A., Geneva, Switzerland

  • Isabelle Cayeux,

    Roles Methodology, Resources

    Affiliation Firmenich, S.A., Geneva, Switzerland

  • Christian Margot,

    Roles Methodology, Resources

    Affiliation Firmenich, S.A., Geneva, Switzerland

  • David Sander,

    Roles Conceptualization, Writing – review & editing

    Affiliations Swiss Center for Affective Sciences, University of Geneva, Geneva, Switzerland, Department of Psychology, University of Geneva, Geneva, Switzerland

  • Sylvain Delplanque

    Roles Conceptualization, Formal analysis, Methodology, Project administration, Writing – review & editing

    sylvain.delplanque@unige.ch

    Affiliations Swiss Center for Affective Sciences, University of Geneva, Geneva, Switzerland, Department of Psychology, University of Geneva, Geneva, Switzerland

Exogenous capture of visual spatial attention by olfactory-trigeminal stimuli

  • Matthieu Ischer, 
  • Géraldine Coppin, 
  • Axel De Marles, 
  • Myriam Essellier, 
  • Christelle Porcherot, 
  • Isabelle Cayeux, 
  • Christian Margot, 
  • David Sander, 
  • Sylvain Delplanque
PLOS
x

Abstract

The extent to which a nasal whiff of scent can exogenously orient visual spatial attention remains poorly understood in humans. In a series of seven studies, we investigated the existence of an exogenous capture of visual spatial attention by purely trigeminal (i.e., CO2) and both olfactory and trigeminal stimuli (i.e., eucalyptol). We chose these stimuli because they activate the trigeminal system which can be considered as an alert system and are thus supposedly relevant for the individual, and thus prone to capture attention. We used them as lateralized cues in a variant of a visual spatial cueing paradigm. In valid trials, trigeminal cues and visual targets were presented on the same side whereas in invalid trials they were presented on opposite sides. To characterize the dynamics of the cross-modal attentional capture, we manipulated the interval between the onset of the trigeminal cues and the visual targets (from 580 to 1870 ms). Reaction times in trigeminal valid trials were shorter than all other trials, but only when this interval was around 680 or 1170 ms for CO2 and around 610 ms for eucalyptol. This result reflects that both pure trigeminal and olfactory-trigeminal stimuli can exogenously capture humans’ spatial visual attention. We discuss the importance of considering the dynamics of this cross-modal attentional capture.

Introduction

Many species display odor-guided spatial navigation. This has been demonstrated in insects [1], fishes [2], birds [3] but also in mammals (e.g., mice [4]; rats [5]; or dogs [6]). This ability is crucial considering that olfaction is essential for detecting and identifying food items, suitable partners and potentially harmful volatile substances [7, 8].

Evidence showing that humans are able to voluntarily (endogenously) pay attention to the spatial location of odors [9] is rare. Humans can track an outdoor whiff of scent, improve this ability with training and display behaviors similar to dogs when the scent changes direction [10]. Moreover, after being disoriented, they can find their way back to a location based only on chemical stimuli [11]. But can this spatial information be exogenously extracted and used to orient attention in other sensory modalities, e.g. vision? We hypothesized it can, based on three main pieces of evidence.

First, we perceive chemical stimuli in the environment [12, 13] through the olfactory and the trigeminal systems [14]. The trigeminal component of a chemical stimulus enables the differentiation of a stimulation coming from the left vs. the right nostril [12, 1517]. Although still unclear, inter-nostril comparisons [18] are precisely the process purportedly underlying voluntary scent-tracking [10]. Consequently, the olfactory trigeminal system allows a spatial lateralized information, which could be used to orientate attention. Second, the trigeminal system conveys sensations of pain, cooling, warmth and intensity [19, 20]. In this regard, this system can be considered as an alert one, protecting the organism against potentially dangerous chemical stimuli in the environment [21]. Such stimuli are considered salient ones, which are precisely known to capture attention [2224]. Third, there is a common pool of attentional resources for the processing of stimuli from all sensory modalities and chemical senses are no exception [25, 26]. Noteworthy, the presence of an ambient odor of lemon (which activates both the olfactory and trigeminal systems) in the environment will facilitate visual search of a lemon picture [27].

The above-mentioned results suggest that there could be an exogenous capture of visual attention by pure nasal trigeminal or by olfactory-trigeminal stimulations. But the questions we asked are more specific: Will attention be exogenously captured by an olfactory-trigeminal stimulus delivered at a given spatial location? If so, will the processing of a visual stimulus (a target) presented at the same location be impacted? To investigate these questions, it is essential to use an appropriate methodology (see [28] for a discussion on this aspect). One of the most used paradigms to test the exogenous capture of attention within and between modalities is the spatial cueing task [29]. In the visual version of the paradigm, a cue and a target are presented successively to the participant on one side or the other of the visual field. The participant’s task is to detect a predefined feature of the target (e.g., its horizontal vs. vertical orientation) as fast and accurately as possible independently of its location. Trials in which cues and targets are on the same side are considered valid. Conversely, invalid trials are those in which cues and targets are on opposite sides. An attentional capture by the cue is demonstrated if reaction times (RTs) in valid trials are shorter than in invalid and control (i.e., when no cue is presented) trials. This result was found in a robust way within the visual, auditory and tactile modalities but also in a less documented way between these modalities [26, 3035].

A first piece of evidence suggests that this result could also be found when using olfactory-trigeminal stimuli as cues and visual stimuli as targets. Using these cues and targets, Wudarczyk and colleagues [36] showed that, although participants were not statistically faster for valid trials than for invalid ones, they were more accurate in the valid condition than in the invalid one. These results consequently suggest that lateralized trigeminal cues can influence visual spatial attention. We believe that the demonstration of an exogenous capture of visual attention by trigeminal stimulation on reaction times could be provided by changing one critical aspect of the experimental design: the Stimulus Onset Asynchrony (SOA).

Our reasoning is the following: attentional capture by stimuli is observed in very specific time windows [37]. In classical spatial cueing tasks, this interval corresponds to the time between the cue onset and the target onset–i.e., the SOA. This SOA is known to be critical to observe attentional capture effects both within [38] and between [39] sensory modalities [32, 33]. In Wudarczyck et al.’s experiment [36], SOA was 500 ms, which might not be optimal to observe an attentional capture with trigeminal (e.g., CO2) cues. Effective SOAs depend mainly on the sensory modality. Yet, the chemosensory related sensory processes are known to be slow, which is reflected by long reaction times during detection and categorization tasks [4044], and the attentional capture effect may therefore require longer SOAs.

This research therefore aims at i) determining whether a lateralized olfactory-trigeminal stimulus exogenously orientates visual spatial attention and ii) providing a first indication on the time window in which this attentional capture occurs. To do so, the trigeminal system was stimulated with CO2 and eucalyptol. CO2 gas provokes stinging and/or pungency sensations in the nose [45]. Since the CO2 almost exclusively stimulates the trigeminal system [20, 46], it provides a rare and ideal candidate to investigate trigeminal interactions with visual spatial attention. Thus, in a first step, we used a purely trigeminal stimulation, which prevented us from introducing potential interactions between the trigeminal and the olfactory systems. This allowed us to put ourselves in the "ideal" experimental situation, i.e. restricting the observed effects exclusively to an activation of the trigeminal system. We also used eucalyptol, which is more likely to be found in natural situations. Eucalyptol activates both the olfactory and trigeminal system [20] and is widely used in clinical research to assess trigeminal sensitivity [15]. Thus, in a second step, we considered the "ecological" argument, i.e. that CO2 at the used concentrations is not a very common stimulation in nature. Consequently, the phenomenon of attentional capture that we expected to observe with CO2 could be artificial, which would have reduced the scope of the results. We therefore decided to use a mixed olfactory and trigeminal compound that is easily found in our daily lives in order to extend the conclusions brought by CO2. The trigeminal system is activated via several types of receptors (e.g.,20] that are more or less specific to certain compounds. It seemed interesting to study attentional capture effects for at least two types of receptors/molecules to rule out the possibility that these attentional effects are solely and quite artificially produced by CO2. We hypothesized that as soon as a compound or gas has the property to stimulate the trigeminal system, we should observe an attentional capture, i.e., that reaction times of valid trial cued by pure trigeminal (CO2) and olfactory-trigeminal (eucalyptol) stimulations will be shorter than the reaction times for all other trials.

In seven studies, we used either CO2 or eucalyptol as cues and visual stimuli as targets in a cross-modal spatial cueing task. Through our studies, we used SOAs ranging from approximatively 580 ms to 1870 ms. To facilitate the presentation of the studies, we named experiments according to i) a letter representing the type of trigeminal stimulation (C for CO2 and E for eucalyptol) and ii) the SOA used. We hypothesized that as soon as a compound or gas has the property to stimulate the trigeminal system, we should observe an attentional capture, i.e., that reaction times of valid trial cued by pure trigeminal (CO2) and olfactory-trigeminal (eucalyptol) stimulations will be shorter than the reaction times for all other trials.

Materials and methods

All participants were recruited among undergraduate and graduate students of the University of Geneva and their acquaintances. Characteristics of the sample size, gender and age of the samples are presented in Table 1. A priori determination of sample sizes was not possible since, to our knowledge, no study has reported different reaction times of valid trials cued by trigeminal stimulations being different from reaction times for all other trials. Rather, we calculated the effect sizes (η2) required in the main contrast analysis for each experiment using G*Power 3 [47], given α = .05 and power (1 − β) = .8. Required η2s: C580 = .24, C680 = .25, C1170 = .25, C1870 = .31, E610 = .25, E830 = .25 and E1120 = .31.

thumbnail
Table 1. Name of the experiment, trigeminal compound, SOA used, sample size (number of female) mean age (± SD) for all studies.

https://doi.org/10.1371/journal.pone.0252943.t001

All participants had self-reported normal or corrected to normal vision, self-reported normal olfaction, and no reported psychiatric nor neurological diseases. They received money or partial course credits for their participation in the studies, which were approved by the Faculty of Psychology and Educational Sciences Ethics committee of the University of Geneva. A signed informed consent was obtained from all participants upon their arrival in the laboratory.

Olfactory-trigeminal stimuli

The olfactory-trigeminal stimuli (that we will call trigeminal for simplicity) consisted of CO2 or eucalyptol, depending on the study. The CO2 gas was diluted in cleaned air to obtain an individual concentration determined according to the participant’s perception and lateralization performance evaluated in two tasks (described below). The eucalyptol stimuli were made of 7 mL of pure eucalyptol injected into tampons of cylindric felt-tip pens (14 cm long, inner diameter 1.3 cm) positioned in glass vials. Control trials were composed of cleaned air.

All control and trigeminal stimuli were delivered via a custom-made olfactometer which is fully described in Ischer et al. [48],. This device reliably delivers various kinds of chemical stimulations over multiple trials, without contamination from one trial to another, at known latencies, and without additional noise or tactile stimulation [23, 4850]. CO2 and eucalyptol were embedded in respectively 1 L.min-1 and in 0.7 L.min-1 constant and filtered airstream.

Control and trigeminal stimulations were delivered directly into the nasal cavity through sterilized stainless steel tips of 4 mm diameter, which were partially introduced into the nostrils (~1 cm, Fig 1A and 1B). The aim was to directly deliver the stimulations in the direction of the anterior portion of the nasal cavity, which is the most sensitive area to trigeminal stimulations [51]. We use E-prime software to present the visual stimuli, to control the olfactometer and to record participant’s behavioral responses (Psychology Software Tools Inc., Pittsburg, PA).

thumbnail
Fig 1.

A) Drawing of the experimental set up. The color of the tubes differentiates the part that carries air (control condition) from the part that carries trigeminal stimuli. B) Stainless steel tips. Left panel = front view, right panel = lateral view C) Summary of experimental procedure for all studies that used CO2 (in red) and Eucalyptol (in green).

https://doi.org/10.1371/journal.pone.0252943.g001

Physiological recordings

Respiration and electro-oculography activities were recorded (1 KHz sampling rate) using the MP150 Biopac Systems (Santa Barbara, CA) in order to monitor participants’ compliance with the breathing and gaze position instructions during the experiment. The respiratory activity was recorded through a 2.5 mm tube (interior diameter) taped on the stainless steel tip used to deliver olfactory stimulations and connected to a differential pressure transducer (Biopac TSD160A) to continuously record variations in nostrils airflow [52]. Horizontal electro-oculographical (EOG) activity was assessed using Beckman Ag-AgCl electrodes (8-mm diameter active area) placed at 2 centimeters posterior to the outer canthus of each eye. A supplementary reference electrode was positioned in the middle of the upperpart of the forehead.

Procedure

Participants first provided their written consent and filled a form to ensure the respect of inclusion criteria and to collect demographic data. The studies using CO2 consisted in 4 different phases: (1) an individual determination of CO2 concentration; (2) a lateralization task; (3) the calibration of the EOG; and (4) the cross-modal spatial cueing task. Studies using pure eucalyptol were composed of phases 2, 3 and 4 only. The entire experimental session took approximately 70 minutes with the CO2 and 60 minutes with the eucalyptol (Fig 1C).

Determination of CO2 concentration.

This procedure allowed participants to familiarize with the set up and to choose the concentration they found clearly perceptible but not painful. In parallel, participants were instructed and trained on how to proceed with the cued sniffing procedure, which was going to be used during the entire study in order to avoid any interference in the nasal perception due to the natural flow [53]. For each trial (manually triggered), a countdown of 4 seconds was presented on the computer screen, followed by the trigeminal stimulation delivered at zero during 500 ms. Participants were requested to hold their breath from the “1” of the countdown until the end of the trial when they can breathe evenly. The CO2 concentration was set first at the lowest concentration (3% v/v). The mix is first created in a mixing carboy by manually adjusting the input flow of pure CO2 into the cleaned airflow. The CO2 concentration was then increased (or decreased) and adjusted to reach a reported comfortable, not painful but clear perception.

Lateralization task.

Participants performed a lateralization performance task to assess their ability to lateralize the trigeminal stimulations (CO2 or eucalyptol depending of the study) delivered at the chosen concentration. Twenty trigeminal and 20 control (cleaned air) stimulations embedded in a constant 1 L.min-1 airflow were randomly but equally delivered in the right or left nostril for 500 ms. For each trial (every 15 s), participants were requested to indicate if they felt any change in the left or right nostril by pressing the left or right arrow of a keyboard, accordingly. They were requested not to press if they could not feel any change at all. The success criteria was determined using the binomial distribution (one-tailed, α < .05, probability of guessing p = .5, n = 10) to ensure that participants lateralized the trigeminal stimulation above chance. Participants obtaining less than 7 correct judgments out of 10 possible correct answers for CO2 trials were not included in the main experiment (n = 13 across all studies).

Electro-oculographic calibration task.

We recorded eye movements using electro-oculography (EOG) to control for possible horizontal saccades that may occur during the spatial cueing task if the participant does not comply with the instruction to maintain their gaze fixed. To perform this crucial control [30], we first determined what would be the EOG signal corresponding to a saccade performed from the fixation cross to the lateralized targets presented during the spatial cueing task. Participants were requested to look at a white fixation cross presented in the middle of the black screen for 5 seconds and orientate their gaze at the white targets randomly appearing for 1 second on the right (10 trials) or left side (10 trials) at the same location as in the main spatial cueing task. Targets were rectangles of 0.5 cm by 0.1 cm presented either horizontally or vertically. The distance between the fixation cross and the center of each target was 15 cm, resulting in a visual angle of about 10° for the participant positioned at 80 cm of the screen.

Cross-modal spatial cueing task.

In this cross-modal adaptation of a classical spatial cuing task [29], an olfactory cue was delivered either in the right or left nostril prior to a visual target presented during 120 ms either in the right or the left visual field (Fig 2).

thumbnail
Fig 2. Cross-modal adaptation of a spatial cueing task [29].

Each trial started with a countdown (3 s) at the end of which participants held their breath. It was followed by the presentation of a fixation cross (500–1000 ms) that participants had to fix. The olfactory cue was then delivered in one nostril during a period which length depended on the SOA. The target appeared for 120 ms on the right or left side of the screen. Participants had to indicate as fast and accurate as possible the orientation of the target (horizontal vs. vertical). Participants breathed evenly after their response. In valid trials, cues and targets appeared on the same side and on opposite sides in invalid trials.

https://doi.org/10.1371/journal.pone.0252943.g002

In valid trials, cues and targets were delivered on the same side. In invalid trials, they were delivered on opposite sides. SOA values were a priori fixed and increased depending on the study and a jitter appeared due to the loading of the olfactometer’s control libraries by the stimulus presentation software (E-prime). This unexpected but measurable jitter was maintained for all studies since it prevented the participant to anticipate the appearance of the target. Resulting mean SOAs and standard deviation for each experiment are presented Table 2. The SOA also determined the duration of the olfactory cue. Nasal cues, equally distributed on both sides, were non-informative of the target location, also equally distributed on both sides (i.e., exogenous cueing). For half of the trial, the cue consists of a trigeminal stimulation. For the other half, a valve delivering the same clean air as during inter-stimulus intervals was delivered as a cue. These trials constitute control conditions that mimic every potential other physical changes (e.g., sound, tactile, temperature changes) due to the cueing. Using their right hand, participants were requested to indicate as fast and accurately as possible the orientation of the target using the left arrow key (i.e., horizontal) or the down arrow key (i.e., vertical), both orientations being presented in equal proportions. In total, 64 trials were delivered randomly to each participant (16 for each combination of CO2 or eucalyptol, air, valid and invalid conditions).

thumbnail
Table 2. Mean (± SD) stimulus onset asynchrony (SOA) for all studies.

https://doi.org/10.1371/journal.pone.0252943.t002

Electrophysiological data analyses

The respiratory flow signal was low-pass filtered at 1 Hz and the flow amplitude calculated as the mean flow values between the cue onset and the target onset. The EOG signal was low-pass filtered at 20 Hz, the activity corresponding to the position of the gaze on the fixation cross (baseline) was calculated as the mean voltage obtained in the calibration phase during the 200 ms preceding the appearance of the target. Typical EOG activities linked to saccades toward left or right targets were determined during the calibration phase by calculating the averaged extremum voltage values calculated while participants were requested to voluntarily look at right (10 trials) and left targets (10 trials). During the cross-modal spatial cueing tasks, gaze position was controlled by averaging extremum voltage values between cue onset and target onset for all relevant trials (air left, air right, trigeminal left, trigeminal right). Those values were then compared with mean EOG activities obtained during both baseline and target fixation periods of the EOG calibration task.

Statistical analyses

To test our a priori hypothesis, we performed planned contrast comparisons on correct reaction times (RT in ms) to evaluate our specific predictions [5456] using Statistica (v.13). More specifically, visual attentional capture by trigeminal stimuli would result in shorter reaction times for trigeminal valid trials than for all other trials. Contrast cell weights were as follows: −1 for the invalid air cell, −1 for the valid air cell, −1 for the for the invalid trigeminal cell, and +3 for valid trigeminal cell. We report p values and partial η2 as estimates of effect size and their 90% confidence interval (CI). We conducted these very same analyses on response accuracy (ACC) since a better accuracy has been previously reported in valid trigeminal trials as compared to other trials [36]. We also calculated and performed these analyses on the “inverse efficiency score” (RT/ACC, [57]), a measure that combines speed and error to investigate whether the attentional capture resulted in an increase in efficiency of the response (that cannot be derived from reaction time or accuracy alone). Individual respiratory flow values obtained separately for trigeminal, air, left nostril and right nostril stimulations were submitted to t-tests against zero (i.e., no flow). EOG values obtained in baseline, air left, air right, trigeminal left, trigeminal right, left target and right target conditions were submitted to a repeated measures analyses of variance (ANOVAs). Pairwise post-hoc tukey HSD tests were further performed when relevant. An alpha level of.05 was chosen for all the statistical analyses performed.

Results

Determination of CO2 concentration

The average percentage of CO2 in the air was 28.28% ± 1.08 (Mean ± SEM). The means’ concentration of CO2 are presented Fig 3A as a function of SOA. This concentration was not statistically different between studies, F(3,98) = 2.35, p = .08, η2 = .07, 90% CI = [0,.14].

thumbnail
Fig 3.

A) Boxplots and violin plots of CO2 concentrations (% in air) used for the spatial cueing tasks with CO2 as a function of SOA (in ms). B) Mean correct responses (± SEM) to the lateralization tasks for all types of stimulations, for all studies. TRIG = trigeminal trials, CTRL = control trials (clean air), EXPE = experiment name. C) Mean correct responses (± SEM) to the different conditions of the cross-modal spatial cueing tasks, for CO2 and Eucalyptol studies, separately. TRIG = trigeminal trials, CTRL = control trials, i = invalid trials and v = valid trials.

https://doi.org/10.1371/journal.pone.0252943.g003

Lateralization task

As expected after selecting participants who obtained a minimum of 7 correct lateralization out of 10 possible for each nostril, mean correct lateralization performances for CO2 and eucalyptol stimulations were very high, M = 9.25, SD = 0.88. The number of correct lateralization did not statistically differ across all studies, F(6,174) = 2.09, p = .056, η2 = .07, 90% CI = [0,.10]. By contrast, participants’ performance to lateralize control stimulations never reached the statistical criterion of 7 correct responses, whatever the study and the nostril stimulated (M = 1.78, SD = 1.69). Means of correct trigeminal and control stimulations obtained for all participants are presented Fig 3B as a function of the experiment.

Cross-modal spatial cueing task

Response accuracy.

On average, participants were able to indicate the orientation of the target with a very high accuracy (M = 14.99, SD = 0.96, Fig 3C). Response accuracy did not statistically differ between trigeminal valid trials as compared to all other trials, whatever the study, all Fs < 1.53, ps >.23, η2s < .05.

Reaction time.

Table 3 provides participants mean reaction times (± SEM) in every condition for the seven studies.

thumbnail
Table 3. Mean (M) reaction times (± SEM) for the trigeminal valid (TRIG valid) and all other conditions together (Others) obtained during the cross-modal spatial cueing tasks for all studies.

https://doi.org/10.1371/journal.pone.0252943.t003

Attentional capture by CO2.

Contrasts analyses did not reveal any statistically significant difference between valid trigeminal trials and all other trials for SOAs around 580 ms, F(1,27) = 2.41, p = .13, η2 = .08, 90% CI = [0,.26], and 1870 ms, F(1,19) = 0.01, p = .909, η2 < .01, 90% CI = [0,.04]. Planned comparisons revealed statistically significant shorter reaction times for valid trigeminal trials than all other types of trials for a SOA of around 680 ms, mean difference = 24 ± 9 ms (SEM), F(1,26) = 7.01, p = .014, η2 = .21, 90% CI = [.03,.41], and 1170 ms, (30 ± 6 ms), F(1,26) = 22.03, p < .001, η2 = .46, 90% CI = [.21,.61] (Fig 4A).

thumbnail
Fig 4. Mean (black dot) correct reaction times with their 95% CI, as well as individual correct reactions times (blue circles) obtained for the seven studies in response to targets in valid trials after cueing with trigeminal stimulations (trig. valid) and all other trial types averaged (other).

Panel A is for CO2 and panel B for eucalyptol. Mean SOAs are reported on the top of each study’s graph. * = p < .05, ** = p < .01, *** = p < .001 and ns. = no statistical significance for the main reported contrasts.

https://doi.org/10.1371/journal.pone.0252943.g004

Attentional capture by eucalyptol.

Contrasts analyses did not reveal any statistically significant difference between valid trigeminal trials and all other trials with a SOA around 830 ms, F(1,26) = 0.52, p = .48, η2 = .02, 90% CI = [0,.17], and 1120 ms, F(1,24) = 0.76, p = .39, η2 = .03, 90% CI = [0,.20]. Reaction times to trigeminal valid trials were statistically shorter than for other trials with a SOA around 610 ms, (42 ± 14 ms), F(1,26) = 9.00, p = .006, η2 = .26, 90% CI = [.05,.45] Fig 4B.

Cost effects analysis

To examine possible cost effects that might have been observed for invalid trigeminal trials (attention retained at the invalid location), we performed another planned contrast comparison on correct reaction times (RT in ms). Contrast cell weights were as follows: −1 for the invalid air cell, −1 for the valid air cell, + 2 for the for the invalid trigeminal cell, and 0 for valid trigeminal cell. For the three experiments that revealed an attentional capture, response times did not statistically differ between trigeminal invalid trials as compared to all other control trials, all Fs < 1.84, ps >.18, η2s < .07.

Efficiency

Inverse efficiency scores were smaller, indicating an increase in efficiency in response to valid trigeminal trials when compared to all other trials in C1170 [F(1,24) = 7.840, p = .009, η2 = .24, 90% CI [.03,.44]] and E610 [F(1,26) = 5.88, p = .022, η2 = 0.18, 90% CI [.01,.38]] experiments. In the other five experiments, the analyses did not reveal any statistically significant difference (all Fs < 1.67, ps >.20).

Experimental controls.

Respiratory activity measured during the cue-target period did not statistically differ from 0 (T-tests against mean, -1.56 < all ts > 1.87, all p s >.07), indicating participants held their breath as requested. For all studies, averaged EOG activity statistically differed during baseline, cue-target periods and voluntary saccades (Fig 5), all Fs > 121.88, ps < .001, η2s >.84. More precisely, Tukey HSD post hoc comparisons revealed that the average EOG activity during the cue-target period did not statistically differ from the baseline activity in all studies (all ps >.13) and were statistically different than during the voluntary saccades toward the target positions (all ps < .001). This result indicates that trigeminal cues did not trigger any saccade toward the target location during the cue-target period of the cross-modal spatial cueing task.

thumbnail
Fig 5. Mean EOG activities calculated for the seven studies during baselines (circle) and cue-target periods in the cross-modal spatial cueing task, as a function of the cue type (square for TRIG and lozenge for CTRL) and the cue side (left in black or right in grey).

Mean EOG activities calculated during deliberate saccades (triangle) pointing to left or right targets during the calibration task. Error bars represent ± 1 standard error of the mean and are corrected for within-subject design [58]. CTRL = control trials, TRIG = trigeminal trials, SACC = saccade.

https://doi.org/10.1371/journal.pone.0252943.g005

Discussion

In this research, we tested whether nasal olfactory-trigeminal stimuli can exogenously capture visual attention. To do so, we used olfactory-trigeminal stimuli as lateralized cues and visual stimuli as lateralized targets in a cross-modal spatial cueing paradigm [29]. We recorded EOG activity in order to rule out the potential role of eye movements in this task. Moreover, we carefully considered the temporal window(s) in which this cross-modal attentional capture may occur. More specifically, we used different SOAs, SOA being a parameter known to be crucial in spatial cueing paradigms [32, 42, 59], and a potential reason why a previous study [36] failed to observe an attentional capture by olfactory-trigeminal stimuli on reaction times. We used seven SOAs, varying from (in average) 580 to 1870 ms. We found that olfactory-trigeminal stimuli can exogenously capture visual attention, as reflected by smaller RTs to valid compared to all other trials. This visual attention capture occurred for both stimuli we used: CO2 and eucalyptol. However, this attentional capture was only present in specific temporal windows, i.e. with specific SOAs.

CO2 did not capture visual attention when using a SOA of around 580 ms. These results complement Wudarczyk et al. [36]’s experiment, where the authors used a 500 ms SOA. Congruently with our results, Wudarczyk et al. did not find an attentional capture by trigeminal stimuli, as reflected by RTs. With longer SOAs (i.e., 680 ms and 1170 ms in average), we found that reaction times in response to valid trials were about 20 ms shorter than for invalid trials (cue facilitating effect). These two studies provide unequivocal evidence of a visual attention capture by CO2.

CO2 almost exclusively stimulates the trigeminal system [20]. To gain ecological validity, we replicated our experimental procedure in three more experiments with eucalyptol as olfactory-trigeminal cue. Eucalyptol captured visual attention with a SOA of 610 ms in average. With SOAs of 830 ms and 1120 ms in average, this visual attention capture was no longer present.

It is tempting to speculate on the similarities and differences we found between these two trigeminal substances with different SOAs. For instance, it is possible that some trigeminal stimuli may capture attention faster and/or longer than others. Comparing systematically 2 of them–e.g., CO2 and eucalyptol–would require using several and symmetrical SOAs for both. Moreover, if one wants to determine when attentional capture starts occurring and when it stops with these stimuli, much less wide time windows than the ones used here would be necessary. Consequently, rather than comparing the results we obtained with different SOAs and different stimuli, we prefer to emphasize the importance of carefully considering the SOA when studying attentional capture in a spatial cueing paradigm. This is true for trigeminal stimuli, but also for stimuli from other sensory modalities [30].

What we do know is that the time window where we found an attentional capture is congruent with the timeframe of a breath in [60]. Remember nevertheless that we chose to ask participants to refrain from breathing during a trial. This methodological choice was motivated by potential unwanted interactions between the natural flow of air and the one sent by the olfactometer. Although likely technically challenging, we encourage researchers to replicate our results while participants are naturally breathing. This would provide a more ecological protocol to study visual attention capture by trigeminal stimuli.

When the visual and auditory modality are involved, cross-modal attentional capture effects are already observed for SOAs of 200 ms (e.g., [61]). This is related to the high speed of stimulus processing for both modalities. For olfaction, trigeminal cue processing is much longer as compared to other sensory modalities [4042, 62]. Early olfactory trigeminal event related potentials that reflect endogenous olfactory processes (i.e., N1, P1 and P2) are observed from 200 to 650 ms [20, 63, 64]. We speculate that there could not be any effect of trigeminal stimulation on the attention allocated to process the target until the perceptual processes of the cue are completed. This could explain why longer SOAs are needed in our paradigm to observe attentional capture by trigeminal stimuli. On the contrary, when the target appears after a critical period of time (i.e., long SOAs) we no longer observed evidence of an attentional capture by CO2 or eucalyptol. In the same way that capture is observed for longer SOAs in olfactory than in visual, inhibition of return would be observed for longer SOAs in olfactory than in visual. We can speculate that we did not use SOAs long enough to observe this mechanism.

Contrary to Wudarczyk et al. [36], we did not find evidence of significant differences in accuracy between valid and invalid trials, neither in the first part or not the second part of our experiments (results not reported here). In Wudarczyk et al. [36]’s first experiment with CO2 cues, there was a significant difference in accuracy in the 8 last trials but not in the 8 first ones. This difference was not associated with RTs differences between valid and invalid trials. As we had speculated, it is highly likely that the results we obtained here in terms of reaction times were due to the choice of SOA.

The extent to which the size of the facilitating effect we reported here is congruent with what is known for other cross-modal spatial cueing tasks is beyond the scope of this research (particularly since too little olfactory cross-modal cueing data is available). The cueing effects we reported of about 25 ms for CO2 and 40 ms for eucalyptol are close to those reported for other cross-modal experiments [26].

Hence, in more natural conditions, the ability to transfer spatial attention from trigeminal stimuli to visual ones gives a unique opportunity to exogenously orient attention towards purportedly relevant stimuli in the environment [21]. Congruently, in other sensory modalities, unpleasant [65], pleasant [24], and a-priori neutral stimuli associated with primary rewards [23, 66] can capture attention. In our experiments, most people considered the pure trigeminal stimulus (i.e., CO2) as unpleasant and the olfactory and trigeminal stimulus (i.e., eucalyptol) as pleasant. It is difficult in our series of studies to know whether the unpleasant and pleasant aspects of the trigeminal stimuli participate in the attentional capture we observed. For this, it would be particularly interesting to deliver trigeminal stimuli in one nostril while non trigeminal ones would be delivered in the other nostril. These two stimuli could be pleasant or unpleasant, which would help to disentangle the attentional capture effects linked to the trigeminal aspect from those linked to the valence of the stimulation.

Stimulations of the trigeminal system evoke different types of sensations: cooling, warmth, tingling or even pain [19, 20]. Theses sensations are caused by the activation of different types of trigeminal receptors (see [20] for a recent review). Here, CO2 and eucalyptol molecules do not evoke the whole spectrum of trigeminal sensations. Using other molecules, future studies could investigate how the attentional capture highlighted in this research is specific to a type of receptors and/or sensations.

Only an experiment with variable SOAs and constant cue duration could formally answer the question of whether the different durations of trigeminal/olfactory-trigeminal cues have influenced the results. However, another important characteristic of the trigeminal system’s functioning goes against the idea that habituation could explain the results we observed: repeated stimulation with high concentration of CO2 can activate pain fibers of the trigeminal nerve and even produce an increase in perceived intensity [67]. Longer SOAs should allow for more influence of trigeminal stimulation, thus potentially favouring more attentional capture or feedback inhibition. This is not what we observed–in our results, there seems to be an optimal SOA time window to observe attentional capture.

Finally, we want to point out an important limitation of this series of experiments, i.e. the lack of systematisation in the choice of the duration of the SOA. Its main objective was to find an SOA duration that could allow the observation of an attentional capture effect. It would have surely been more rigorous to fix a particular SOA (e.g., 1000 ms) and to increase or decrease it in steps of 250 ms for example. Moreover, this would have made possible to really observe the kinetics of the attentional capture effect. We can only hope that the flaw will be addressed in future research and will motivate researchers to study more rigorously the influence of SOA on the size of the attentional capture effect.

Conclusion

Using a visual spatial cueing paradigm, we tested whether different trigeminal stimuli can capture visual attention. In seven experiments, we found robust evidence of an exogenous capture of visual attention by both CO2 and eucalyptol. Together with Wudarczyk et al. [36]’s results, this data suggests not only that humans can detect, to some degree, the spatial location of chemical stimuli but also that this information is used to orient the spatial attention across modalities. In future studies examining the dynamics of this cross-modal attentional capture, we invite researchers to carefully choose the interval between the trigeminal cues and the visual targets: our data suggests that this attentional capture is present only in specific intervals.

Acknowledgments

The authors thank Nadine Gaudreau and all the members of the Perception and Bioresponses Department of the Research and Development Division of Firmenich, SA, for their precious advice and their theoretical and technical competence. This study was conducted at the Brain and Behavior Laboratory (BBL) at the University of Geneva and benefited from the support of the BBL technical staff.

References

  1. 1. Steck K. Just follow your nose: homing by olfactory cues in ants. Curr Opin Neurobiol. 2012 Apr;22(2):231–5. pmid:22137100
  2. 2. DeBose JL, Nevitt GA. The use of Odors at Different Spatial Scales: Comparing Birds with Fish. J Chem Ecol. 2008 Jul;34(7):867–81. pmid:18566861
  3. 3. Gagliardo A. Forty years of olfactory navigation in birds. J Exp Biol. 2013 Jun 15;216(12):2165–71. pmid:23720797
  4. 4. Gire DH, Kapoor V, Arrighi-Allisan A, Seminara A, Murthy VN. Mice Develop Efficient Strategies for Foraging and Navigation Using Complex Natural Stimuli. Curr Biol. 2016 May;26(10):1261–73. pmid:27112299
  5. 5. Rajan R. Rats Smell in Stereo. Science. 2006 Feb 3;311(5761):666–70. pmid:16456082
  6. 6. Thesen A, Steen JB, Døving KB. Behaviour of dogs during olfactory tracking. J Exp Biol. 1993 Jul;180:247–51. pmid:8371085
  7. 7. Pinto JM. Olfaction. Proc Am Thorac Soc. 2011 Mar 1;8(1):46–52. pmid:21364221
  8. 8. Stevenson RJ. An Initial Evaluation of the Functions of Human Olfaction. Chem Senses. 2010 Jan 1;35(1):3–20. pmid:19942579
  9. 9. Lambrou-Louca A. Directional Smell. In: Shackelford TK, Weekes-Shackelford VA, editors. Encyclopedia of Evolutionary Psychological Science [Internet]. Cham: Springer International Publishing; 2018 [cited 2020 Nov 12]. p. 1–4. http://link.springer.com/10.1007/978-3-319-16999-6_1018-1
  10. 10. Porter J, Craven B, Khan RM, Chang S-J, Kang I, Judkewitz B, et al. Mechanisms of scent-tracking in humans. Nat Neurosci. 2007 Jan 1;10(1):27–9. pmid:17173046
  11. 11. Jacobs LF, Arter J, Cook A, Sulloway FJ. Olfactory Orientation and Navigation in Humans. Louis M, editor. PLOS ONE. 2015 Jun 17;10(6):e0129387. pmid:26083337
  12. 12. Croy I, Schulz M, Blumrich A, Hummel C, Gerber J, Hummel T. Human olfactory lateralization requires trigeminal activation. NeuroImage. 2014 Sep;98:289–95. pmid:24825502
  13. 13. Hoskison EE. Olfaction, pheromones and life. J Laryngol Otol. 2013 Dec;127(12):1156–9. pmid:24280062
  14. 14. Doty RL, Brugger WE, Jurs PC, Orndorff MA, Snyder PJ, Lowry LD. Intranasal trigeminal stimulation from odorous volatiles: Psychometric responses from anosmic and normal humans. Physiol Behav. 1978 Feb;20(2):175–85. pmid:662939
  15. 15. Hummel T, Futschik T, Frasnelli J, Hüttenbrink K-B. Effects of olfactory function, age, and gender on trigeminally mediated sensations: a study based on the lateralization of chemosensory stimuli. Toxicol Lett. 2003 Apr;140–141:273–80. pmid:12676474
  16. 16. Kobal G, Van Toller S, Hummel T. Is there directional smelling? Experientia. 1989 Feb;45(2):130–2. pmid:2493388
  17. 17. Wysocki CJ, Cowart BJ, Radil T. Nasal trigeminal chemosensitivity across the adult life span. Percept Psychophys. 2003 Jan;65(1):115–22. pmid:12699314
  18. 18. von Békésy G. Olfactory analogue to directional hearing. J Appl Physiol. 1964 May 1;19(3):369–73.
  19. 19. Filiou R-P, Lepore F, Bryant B, Lundstrom JN, Frasnelli J. Perception of Trigeminal Mixtures. Chem Senses. 2015 Jan 1;40(1):61–9. pmid:25500807
  20. 20. Frasnelli J, Manescu S. The Intranasal Trigeminal System. In: Buettner A, editor. Springer Handbook of Odor [Internet]. Cham: Springer International Publishing; 2017 [cited 2020 Nov 12]. p. 113–4. http://link.springer.com/10.1007/978-3-319-26932-0_46
  21. 21. Frasnelli J, Hummel T. Intranasal trigeminal thresholds in healthy subjects. Environ Toxicol Pharmacol. 2005 May;19(3):575–80. pmid:21783529
  22. 22. Müller S, Rothermund K, Wentura D. Relevance drives attention: Attentional bias for gain- and loss-related stimuli is driven by delayed disengagement. Q J Exp Psychol. 2016 Apr;69(4):752–63. pmid:25980956
  23. 23. Pool E, Brosch T, Delplanque S, Sander D. Where is the chocolate? Rapid spatial orienting toward stimuli associated with primary rewards. Cognition. 2014;130(3):348–59. pmid:24389311
  24. 24. Pool E, Brosch T, Delplanque S, Sander D. Attentional Bias for Positive Emotional Stimuli: A Meta-Analytic Investigation. Psychol Bull. 2015; pmid:26390266
  25. 25. Spence C, Kettenmann B, Kobal G, McGlone FP. Shared Attentional Resources for processing Visual and Chemosensory Information. Q J Exp Psychol Sect A. 2001 Aug;54(3):775–83. pmid:11548034
  26. 26. Spence C, Santangelo V. Capturing spatial attention with multisensory cues: A review. Hear Res. 2009 Dec;258(1–2):134–42. pmid:19409472
  27. 27. Chen K, Zhou B, Chen S, He S, Zhou W. Olfaction spontaneously highlights visual saliency map. Proc R Soc B Biol Sci. 2013 Oct 7;280(1768):20131729. pmid:23945694
  28. 28. Moessnang C, Finkelmeyer A, Vossen A, Schneider F, Habel U. Assessing Implicit Odor Localization in Humans Using a Cross-Modal Spatial Cueing Paradigm. Goldreich D, editor. PLoS ONE. 2011 Dec 27;6(12):e29614. pmid:22216331
  29. 29. Posner MI. Orienting of Attention. Q J Exp Psychol. 1980 Feb;32(1):3–25. pmid:7367577
  30. 30. Chica AB, Martín-Arévalo E, Botta F, Lupiáñez J. The Spatial Orienting paradigm: How to design and interpret spatial attention experiments. Neurosci Biobehav Rev. 2014 Mar;40:35–51. pmid:24462751
  31. 31. La Buissonnière-Ariza V, Frasnelli J, Collignon O, Lepore F. Olfactory priming leads to faster sound localization. Neurosci Lett. 2012 Jan;506(2):188–92. pmid:22094382
  32. 32. Spence C. Crossmodal spatial attention. Ann N Y Acad Sci. 2010 Mar;1191(1):182–200. pmid:20392281
  33. 33. McDonald JJ, Teder-Sälejärvi WA, Hillyard SA. Involuntary orienting to sound improves visual perception. Nature. 2000 Oct;407(6806):906–8. pmid:11057669
  34. 34. Spence C, Driver J. Audiovisual links in exogenous covert spatial orienting. Percept Psychophys. 1997 Jan;59(1):1–22. pmid:9038403
  35. 35. Spence C, McGlone F. Reflexive spatial orienting of tactile attention. Exp Brain Res. 2001 Dec 1;141(3):324–30. pmid:11715076
  36. 36. Wudarczyk OA, Habel U, Turetsky BI, Gur RE, Kellermann T, Schneider F, et al. Follow your nose: Implicit spatial processing within the chemosensory systems. J Exp Psychol Hum Percept Perform. 2016 Nov;42(11):1780–92. pmid:27386733
  37. 37. Shulman GL, Remington RW, McLean JP. Moving attention through visual space. J Exp Psychol Hum Percept Perform. 1979;5(3):522–6. pmid:528957
  38. 38. Klein RM. Inhibition of return. Trends Cogn Sci. 2000 Apr;4(4):138–47. pmid:10740278
  39. 39. Van der Stoep N, Spence C, Nijboer TCW, Van der Stigchel S. On the relative contributions of multisensory integration and crossmodal exogenous spatial attention to multisensory response enhancement. Acta Psychol (Amst). 2015 Nov;162:20–8. pmid:26436587
  40. 40. Bensafi M, Rouby C, Farget V, Vigouroux M, Holley A. Asymmetry of pleasant vs. unpleasant odor processing during affective judgment in humans. Neurosci Lett. 2002 Aug;328(3):309–13. pmid:12147332
  41. 41. Boesveldt S, Frasnelli J, Gordon AR, Lundström JN. The fish is bad: Negative food odors elicit faster and more accurate reactions than other odors. Biol Psychol. 2010 May;84(2):313–7. pmid:20227457
  42. 42. Croy I, Krone F, Walker S, Hummel T. Olfactory Processing: Detection of Rapid Changes. Chem Senses. 2015 Jun 1;40(5):351–5. pmid:25911421
  43. 43. Dematte ML, Sanabria D, Spence C. Olfactory Discrimination: When Vision Matters? Chem Senses. 2008 Sep 15;34(2):103–9. pmid:18794200
  44. 44. Olofsson JK. Time to smell: a cascade model of human olfactory perception based on response-time (RT) measurement. Front Psychol [Internet]. 2014 [cited 2020 Nov 12];5. http://journal.frontiersin.org/article/10.3389/fpsyg.2014.00033/abstract pmid:24550861
  45. 45. Wang YY, Chang RB, Liman ER. TRPA1 Is a Component of the Nociceptive Response to CO2. J Neurosci. 2010 Sep 29;30(39):12958–63. pmid:20881114
  46. 46. Kobal G, Hummel C. Cerebral chemosensory evoked potentials elicited by chemical stimulation of the human olfactory and respiratory nasal mucosa. Electroencephalogr Clin Neurophysiol Potentials Sect. 1988 Jul;71(4):241–50. pmid:2454788
  47. 47. Faul F, Erdfelder E, Lang A-G, Buchner A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007 May;39(2):175–91. pmid:17695343
  48. 48. Ischer M, Baron N, Mermoud C, Cayeux I, Porcherot C, Sander D, et al. How incorporation of scents could enhance immersive virtual experiences. Front Psychol [Internet]. 2014 Jul 17 [cited 2020 Nov 12];5. http://journal.frontiersin.org/article/10.3389/fpsyg.2014.00736/abstract pmid:25101017
  49. 49. Pool E, Delplanque S, Porcherot C, Jenkins T, Cayeux I, Sander D. Sweet reward increases implicit discrimination of similar odors. Front Behav Neurosci. 2014;8(MAY). pmid:24834039
  50. 50. Sharvit G, Vuilleumier P, Delplanque S, Corradi-Dell’Acqua C. Cross-modal and modality-specific expectancy effects between pain and disgust. Sci Rep. 2015 Dec 22;5(1):17487. pmid:26631975
  51. 51. Frasnelli J, Heilmann S, Hummel T. Responsiveness of human nasal mucosa to trigeminal stimuli depends on the site of stimulation. Neurosci Lett. 2004 May;362(1):65–9. pmid:15147782
  52. 52. Johnson BN, Russell C, Khan RM, Sobel N. A Comparison of Methods for Sniff Measurement Concurrent with Olfactory Tasks in Humans. Chem Senses. 2006 Aug 10;31(9):795–806. pmid:16914503
  53. 53. Scheibe M, van Thriel C, Hummel T. Responses to Trigeminal Irritants at Different Locations of the Human Nasal Mucosa. The Laryngoscope. 2008 Jan;118(1):152–5. pmid:17975506
  54. 54. Furr RM, Rosenthal R. Repeated-Measures Contrasts for “Multiple-Pattern” Hypotheses. Psychol Methods. 2003;8(3):275–93. pmid:14596491
  55. 55. Richter M. Pay attention to your manipulation checks! Reward impact on cardiac reactivity is moderated by task context. Biol Psychol. 2010 May;84(2):279–89. pmid:20206226
  56. 56. Rosenthal R, Rosnow RL. Contrast analysis: focused comparisons in the analysis of variance. Cambridge [Cambridgeshire]; New York: Cambridge University Press; 1985. 107 p.
  57. 57. Townsend J, Ashby F. Methods of modeling capacity in simple processing systems. In: Cognitive Theory. 1978. p. 199–239.
  58. 58. Cousineau D. Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson’s method. Tutor Quant Methods Psychol. 2005 Sep 1;1(1):42–5.
  59. 59. McDonald J, Green J, Störmer V, Hillyard S. Cross-Modal Spatial Cueing of Attention Influences Visual Perception. In: The Neural Bases of Multisensory Processes [Internet]. CRC Press; 2011 [cited 2020 Nov 12]. p. 509–28. (Frontiers in Neuroscience; vol. 20111651). http://www.crcnetbase.com/doi/abs/10.1201/9781439812174-33
  60. 60. Noto T, Zhou G, Schuele S, Templer J, Zelano C. Automated analysis of breathing waveforms using BreathMetrics: a respiratory signal processing toolbox. Chem Senses. 2018 Sep 22;43(8):583–97. pmid:29985980
  61. 61. Sanz LRD, Vuilleumier P, Bourgeois A. Cross-modal integration during value-driven attentional capture. Neuropsychologia. 2018 Nov;120:105–12. pmid:30342964
  62. 62. Sela L, Sobel N. Human olfaction: a constant state of change-blindness. Exp Brain Res. 2010 Aug;205(1):13–29. pmid:20603708
  63. 63. Iannilli E, Wiens S, Arshamian A, Seo H-S. A spatiotemporal comparison between olfactory and trigeminal event-related potentials. NeuroImage. 2013 Aug;77:254–61. pmid:23298751
  64. 64. Pause BM, Sojka B, Krauel K, Ferstl R. The nature of the late positive complex within the olfactory event-related potential (OERP). Psychophysiology. 1996 Jul;33(4):376–84. pmid:8753937
  65. 65. Bar-Haim Y, Lamy D, Pergamin L, Bakermans-Kranenburg MJ, van IJzendoorn MH. Threat-related attentional bias in anxious and nonanxious individuals: A meta-analytic study. Psychol Bull. 2007;133(1):1–24. pmid:17201568
  66. 66. Pool E, Brosch T, Delplanque S, Sander D. Stress increases cue-triggered “wanting” for sweet reward in humans. J Exp Psychol Anim Learn Cogn. 2015;41(2):128–36. pmid:25734754
  67. 67. Hummel T, Gruber M, Pauli E, Kobal G. Chemo-somatosensory event-related potentials in response to repetitive painful chemical stimulation of the nasal mucosa. Electroencephalogr Clin Neurophysiol Potentials Sect. 1994 Sep;92(5):426–32. pmid:7523087