Color adaptation induced from linguistic description of color

Recent theories propose that language comprehension can influence perception at the low level of perceptual system. Here, we used an adaptation paradigm to test whether processing language caused color adaptation in the visual system. After prolonged exposure to a color linguistic context, which depicted red, green, or non-specific color scenes, participants immediately performed a color detection task, indicating whether they saw a green color square in the middle of a white screen or not. We found that participants were more likely to perceive the green color square after listening to discourses denoting red compared to discourses denoting green or conveying non-specific color information, revealing that language comprehension caused an adaptation aftereffect at the perceptual level. Therefore, semantic representation of color may have a common neural substrate with color perception. These results are in line with the simulation view of embodied language comprehension theory, which predicts that processing language reactivates the sensorimotor systems that are engaged during real experience.


Introduction
Two families of theories have proposed contrasting ways of how language is processed in the brain in relation to the sensorimotor systems. In the traditional symbolic view, language processing is based on abstract, amodal symbols [1,2,3], and people gain the meaning of language through the relations among symbols. From this point of view, the mind is an abstract information processor and sensorimotor systems are not relevant to language processing. In contrast, theories of embodied language comprehension propose a direct link between language and sensorimotor systems. They propose that language is understood by constructing mental simulations of the objects and events being described, and these simulations involve the reactivation of sensory, motor, and affective systems that are engaged during real experience [4,5,6,7]. In this account, language processing recruits, to some extent, sensorimotor systems. Thus, embodied semantics predict that comprehension should interact with perception processing, as they recruit the same sensorimotor system. A large number of empirical studies have been claimed to support the embodied semantics. In neuroscience, researchers have found that the same sensorimotor regions of the brain are PLOS  neurons representing red will be more easily activated than the neurons representing green. Then, the selective adaptation of neurons tuned to a certain color (e.g., red) would result in relatively stronger activity of neurons tuned to its complementary color (e.g., green) in the adapted region. This is somewhat like the motion aftereffect mentioned above. In this experiment, the language stimuli were discourses depicting red, green or non-specific color sceneries (neutral discourse). We tested whether color-related language adaptation could cause color aftereffect. The typical color aftereffect is color afterimage. Previous studies often tested the duration of afterimage to assess perceptual color aftereffect [25]. However, it is very hard to induce afterimage after listening to color-related sentences, let alone estimate its duration. So we have to develop another way to assess the linguistic adaptation color aftereffect. Given that aftereffects actually lead to a change in sensitivity, we focused on the sensitivity difference to a certain color after exposing to different linguistic contexts. The detection task was used to assess sensitivity change. After listening to a few sentences, participants needed to decide whether they saw a green color square in the middle of the screen. There were three conditions according to the relation between the color of the language stimuli (discourses) and the visual stimuli (green color squares): complementary ("red" discourse, green square), congruent ("green" discourse, green square), unrelated (neutral discourse, green square). The embodied view predicts that understanding linguistic descriptions of color recruits the same neural networks as involved in color perception, so that prolonged exposure to a color linguistic context will cause an adaptation effect to improve the sensitivity of its complementary color. Consequently, participants will be more likely to perceive the green color square after listening to the red discourse than the green or neutral discourse. By contrast, symbolic semantics hold that comprehension is independent of neural networks involved in perception, so there should be no significant difference across conditions or a semantic priming effect that the green color square will be more likely to be perceived in the congruent condition than the complementary or unrelated condition. The later hypothesis is based on the view that language will prime the perceptual process at the semantic level [18].
The results of the detection task could be calculated with Signal Detection Theory [26], so that we could assess whether and at which level language comprehension affects color perception. And the effects those at the perceptual level (sensitivity) and the decision level (criterion) could be separated. If language comprehension activates the earliest stage of sensory processes, we would expect an effect on sensitivity. If language comprehension acts only on high-level processes, we would expect an effect on the decision criterion, but not sensitivity [27]. Based on the above analysis, we can test the embodied view and symbolic view of language by investigating the influence on color perception from the adaptation induced form language stimuli.

Ethics statement
The current study was approved by the Academic Committee of the School of Psychology at South China Normal University. All participants gave written informed consent before participating in the experiments.

Participants
Thirty-eight students (23 females, 15 male) from South China Normal University participated in exchange for a small payment. All of them were native Chinese speakers. Participants had normal or corrected-to-normal visual acuity and were naive to the purpose of the experiment. All had binocular vision and binaural hearing. No participants reported having dyslexia or any problems with distinguishing colors.

Adaptation stimuli
Nine texts depicting sceneries were used. They were broken up into one longer and five shorter "top-up" installments so that multiple measurements could be collected. The first paragraph was long, including about one hundred Chinese characters, and the other 5 paragraphs were short, including about fifty Chinese characters. Then the texts were converted into sound, with the first paragraph lasting 30 seconds or so, and others about 15 seconds. The audio recording was made of a female student who was blind to the color manipulation. The audio files were presented via closed stereo headphones.
According to the color being described, the nine discourses were divided evenly across three types: red (e.g., sunrise), green (e.g., bamboo forest), and neutral (e.g., spring tide). For detail, see the appendix.

Test stimuli
Following each discourse installment, participants indicated whether they saw a green color square in the middle of the white screen. All experiments were carried out on the same computer. The distance between the subjects' eyes and the screen was fixed at 60 cm. A chin rest was used to maintain viewing distance. Test stimuli were presented on a 17-inch cathode-ray tube monitor with a resolution of 1024×768 pixels and a refresh rate of 60 Hz. The display adaptor software is 32-bit color. The monitor's color temperature was set to 9300K. The Contrast was set to maximum and the Luminance was 100 cd/m2. The monitor gamma is 2.2.
Six green color squares were used as text stimuli, which could be divided into small and large groups according to the visual angle: 5.0×5.0, 2.7×2.7 degrees; Each group included three squares which differed on the alpha value: 1% (small 1, large 1), 2% (small 2, large 2), 3% (small 3, large 3). The alpha channel is independent of the RGB channel, it was introduced by Alvy Ray Smith in the 1970s. Alpha value is a measure of opacity and ranges from 0%-100%. Values between 0% and 100% make it possible for pixels to show through a background like a glass. If a pixel has a value of 0% in its alpha channel, it is fully transparent (and, thus, invisible), whereas a value of 100% in the alpha channel gives a fully opaque pixel. The alpha channel allows easy image compositing. In this study, it allows us to make light green squares.
The green squares were presented in a white background, lower the alpha value was, the square looked less green and was harder to be detected. It should be noted that the alpha values used here are very low, so the light green squares being used were not easy to be detected. The average accuracy to detect them was about 50%, close to the thereshold. Besides green squares, blank white screen without squares on it was also being tested. Therefore, we had seven types of test stimuli: small or large green color squares of three alphas, and the white screen. We first set the RGB values to 0, 255, 0 to get pure green squares, and also modulated the alpha value of each square. The RGBA value of each square are as follows: small 1/large 1 = 0, 255, 0, 0.01; small 2/large 2 = 0, 255, 0, 0.02; small 3/large 3 = 0, 255, 0, 0.03; the white background = 255, 255, 255, 1.
Because the green squares were displayed in a white background, so we composited the green square with the white background. And we used this compositing images as test stimuli. There were 3 discourses with 6 installments in each condition, so that 18 green squares were used as test stimuli in one block. The frequency of each test stimulus used in one condition is shown in Table 1. Reasons for us to choose the current frequencies are as follows: firstly, if we only use one kind of stimulus, participants would soon learn to respond to the test stimuli expertly, which would lead to practice effects. Secondly, different kinds of stimuli could make the participants stay alert so that to avoid the potential fatigue effect. Two previous studies [22,28] concerning motion also used several kinds of test stimuli. Thirdly, we used signal detection theory (SDT) to calculate the accuracy data, so most of the test stimuli should be sufficiently difficult yet discriminable for participants. And comparing with 3 alpha squares, 1% or 2% alpha value squares could better meet the requirement. Therefore, most of the test stimuli were 1% or 2% alpha value squares. Lastly, we used the SDT, so the test stimuli included blank stimuli for calculating the false alarm rate.

Design and procedure
The experiment was a one factor (the relation between the color of the discourse and the square: complementary, congruent, unrelated) within-subject design. Three types of discourses (red, green, neutral) were presented in three interleaved blocks. Each block consisted of three discourses with six installments each, for a total of 18 trials per block. A trial was defined as a single presentation of the adapting stimulus followed by a single presentation of a color square or a white screen.
Participants were asked to close their eyes when listening to the discourse. Following each installment, they heard a short sound "ding" and opened their eyes immediately to indicate whether or not they see a green color square in the middle of the screen by pressing one of the designated keys ("F" corresponds to "Yes" and "J" corresponds to "No") on a standard keyboard. If they made no response within 2500ms, the test window would disappear.
Before the formal experiment, there was a practice phase. The whole experiment lasted about 20 minutes. The orders of blocks and the orders of discourses within each block were balanced for each subject. No participants reported knowledge of color adaptation, motion aftereffect, and similar phenomena.

Data analysis
Participants were excluded from analysis if the hit rate or false alarm was beyond 2.5SDs above or below the average. Finally, data from 32 participants (19 females, 13 male) were included in subsequent analysis. 9 trials (1.56% of the total) were deleted for making no response. The data were submitted to a one-way repeated measure ANOVA using SPSS 17.0.
The dependent measures were color-detection accuracy (SDT measure) and RT. It should be noted that in order to rule out an RT/accuracy tradeoff we used the median RT (in case there were outliers on the long end). Results were analyzed for three conditions: complementary (red discourse, green square), congruent (green discourse, green square), unrelated (colorless discourse, green square).
For SDT analysis, we used the accuracy data to calculate the percentage of "Yes" responses (correct detections) on green color square trials (hits) and the percentage of "Yes" responses (incorrect detections) on white screen trials (false alarms). The nonparametric indexes of perceptual sensitivity, A', and response criterion, B", were calculated from hit and false alarm rates. Calculations were performed in Excel using equations taken from Stanislaw and Todorov [26]:

Results
First, we calculated the mean accuracy and median reaction times of each test stimulus, as Tables 2 and 3 show. Table 4 shows the mean accuracy for each level of transparency. Considering the limited number of each test stimulus, further analysis was carried out over all the test stimuli within each condition. The means of the hit rate and false alarm estimates are given in Table 5. The means of the resulting A', B" estimates are given in Table 6. The one-way repeated measure yielded a main effect for A' and B", see Fig 1. For RT, there was no significant difference across conditions.

A'
The relation between the color of the discourse and the square significantly modulated perceptual sensitivity for green color square. There was a significant main effect of condition [F (2, 62) = 4.00, p = 0.024, ŋ p 2 = 0.113]. Pairwise comparison revealed a significant difference  Overall, participants were more sensitive to green color square after listening to the discourses denoting red than after listening to the discourses denoting green or non-specific color information. In other words, listening to

Discussion
This study is the first one to make use of color aftereffect to investigate the influence of language comprehension on color perception within the embodied cognition framework. Sentences denoting color-related information were followed by a color square detection task. We found that listening to discourses denoting a certain color (red) improved the sensitivity to its complementary color (green) and also influenced the internal decision criterion, but not the speed in performing a color detection task. The results found here were consistent with a previous study done by Meteyard, Bahrami, & Vigliocco [27], but for motion language instead of color language. A' is a sensitivity index of SDT, higher A' means better discriminability. The results showed that A' was higher when the color of the sentences and the test square complementary to each other (red, green) compared to the congruent or unrelated condition, suggesting that listening to sentences denoting a certain color (red) will improve the sensitivity to its complementary color (green). This linguistic adaptation color aftereffect could be compared with the perceptual adaptation color aftereffect that after looking at a red object for minutes, people will perceive a green afterimage on a white background. Both may activate the neural basis responsible for color perception and cause a neural adaptation. Thus, we can deduce that listening to a discourse describing red is like seeing the real red visual object. This is in accordance with the hypothesis of simulation view of embodied language, which believed that language comprehension is constructing mental simulations of the things being described, and these simulations will re-activate the sensorimotor systems responsible for real perception and action.
B" is a response bias index of SDT, higher B" suggesting a higher criterion, which signifies that the participant is being more conservative and have a bias to respond "no" [26]. We found an upward shift B" in the complementary condition than the congruent or unrelated condition, which indicated that at the decision stage, participants would be more likely to respond "I didn't see a green color square" after hearing "red" sentences. In other words, the color of the sentences primed participants' reactions to the perceptual stimuli of the same color. The result of B" revealed a match advantage effect (priming effect) at the decision stage, which was consistent with the hypothesis of the symbolic semantics. However, the symbolic view could not account for the result of A', because the symbolic semantics hold that language comprehension acts only on high-level processes, but not the early stage of sensory processes. Therefore, an effect on the decision criterion would be expected, but not sensitivity. However, the embodied semantics predict a complementary advantage effect on low level perceptual sensitivity, which had been proved by the higher A' in the complementary condition, and the effect on decision (B") was a consequence of the change in sensitivity. For example, in the previous study [25], researchers suggested that the priming effect on B" could be accounted for by task-based expectations: color sentences created an expectation of the particular color and this expectation influenced processing generally, which resulted in priming at the decision level.
To sum up, the traditional symbolic semantics could not explain the current result that language comprehension infected the early stage of perceptual processes. The results of the perceptual sensitivity (A') and the internal decision criterion (B") could be better explained by the embodied semantics which predict that language comprehension affected the low level perceptual system regardless of the task-induced change at the decision stage.
It should be noted that neither A' nor B" was significant between the congruent and unrelated condition. This result was beyond our expectation that a "green" discourse should make for a lower sensitivity rather than being equal to the effect of the neutral discourse. The possible reason was that the non-specific color discourse lent the participants more toward green imagery than red. For example, in the "spring tide" text, people might be more likely to imagine lush greenery around the river depicted by the story than they would be to imagine red elements. This could be why the "green" and "colorless" stimuli pattern similarly. This is a possible reason, but in the study of Meteyard et al [27], they also found that there was no significant difference between the congruent and neutral condition, so there may exited other reasons responsible for this phenomenon. Further studies were needed to explore this problem.
The reaction times were not significantly different across conditions, which was basically consistent with our expectations. On one hand, purpose of our study was to investigate whether the sensitivity to a certain color would be meditated by linguistic stimuli. What we concerned was whether and to what extent they could perceive the green square but not how fast they making a response. Therefore, in this study, we attached more importance to SDT indexes, which were also used in the former study done by Pavan and Baggio [18] to investigate the effect of motion words on direction discrimination task. On the other hand, participants were asked to close eyes when listening to the sentences, and open eyes when heard the sound "ding" and then make a response. It should be noted that in each trial, the timing they opening eyes and the time needed from opening eyes to making a response varied, which would definitely influence the reaction times (from the onset of the test window to the start of making a response). Taking this into consideration, the RT data could not reliably reflect the effect of experimental treatments.
The language adaptation method is an improvement of the previous prime paradigm (a word or a sentence as a priming stimulus). The biggest difference was longer exposure to linguistic stimuli which provided the possibility of neural adaptation, as being revealed by Dlis and Boroditsy [22]. The results found here put further evidence for the previous match advantage effect [16,29]. The defect of the match advantage effect was that it could be explained not only at the perceptual level but also at the semantic level. However, the adaptation aftereffect found here could only be explained at the low level of perceptual system or neural networks. Thus, we can deduce that the interaction between language and color perception occurs at the perceptual level, which is the focus of the debate between the embodied view and the symbolic view. Furthermore, the adaptation aftereffect could be seen as a mismatch aftereffect, because A' decreased in the congruent (match) condition compared to the complementary (mismatch) condition. However, it was different from the previous mismatch advantage found by Kaschak et al [12]. In their study, the sentence and the visual stimulus were presented concurrently. The task was determining the motion direction indicated by the sentence. And a mismatch advantage was found because the perceptual stimulus engages the processing mechanisms needed to simulate the sentence, which resulted in comprehension difficulty when the content of the sentence matched the content of the stimulus [12]. In the present study, sentences and color squares were presented sequentially, which ruled out the possibility of cognitive resource competition.
As far as we know, two other studies also used the adaptation paradigm to investigate the relations between language comprehension and perception, and both focused on motion aftereffects. Dlis and Boroditsky's results [22] were consistent with the embodied semantics as were our results. However, Pavan and Baggio [18] used a visual-adaptation paradigm to test whether the perceptual adaptation would influence the language comprehension and found a match advantage effect which was contrary to the embodied view. It seems like that the adaptation caused by language does influence motion perception, but not vice versa. Further studies are needed to investigate this problem. However, from our point of view, in Pavan's experiments, participants were required to judge the motion direction of the verb phrase as soon as possible; thus, there existed a possibility that in this rapid language processing condition, participants had no time to use the sensorimotor information to construct mental simulation. So the verb phrases were processed at the semantic level and were not influenced by the motion aftereffect. In this way, the results perhaps demonstrate that in the case of rapid language processing condition, semantic information is more preferable than sensory information in constructing the meaning of language. If the deduction could be further confirmed, we can propose a theoretical assumption that: in general, language comprehension reactivates the sensorimotor system. Whereas, in the case of rapid language processing, individuals taking advantage of the existing semantic but not perceptual information in the first place to gain the meaning of language. To be brief, language comprehension will activate the perceptual information automatically, but the perceptual information will not facilitate the process of language in an automatic way. Of course, this is a preliminary idea, and a series of experiments would be required for verification.
There are limitations in this study worth mentioning. First, only green squares were used as test stimuli. It would lead to a potential problem that the observed color aftereffect was not caused by the color information implied in the discourse but other potential factors indicated by the discourses. A better way to avoid this problem was using both green and red squares as test stimuli. However, in this study, considering the formation of color adaptation process would be disturbed, we only used green squares. To avoid the potential problem, we carefully controlled the discourses being used when designing materials. For example, the number of Chinese characters, sentences, and color words was controlled. The contents of the discourses were all about sceneries. And all of the texts were read by a subject who did not know anything about the main experiment. In this way, the interference factors could be excluded to a large extent. In the field of color perception, red adaptation could cause green afterimage, and in turn, green adaptation could cause red afterimage. Then, this should also be true for the linguistic color aftereffect that red context should causes sensitivity increase for green square and green context should in turn causes sensitivity increase for red square. In future studies, this problem should be taken into serious consideration, such as dividing the experiment in green and red adapter sessions. In this study, we have tried our best to control the irrelevant variables of the discourse, so we could make a relative strong claim that the effect found was actually a color aftereffect.
The second limitation of this study is that we didn't calibrate the monitor in a very strict way. Computer generated colors are often deeply affected by the monitor characteristics. So even though we provide the RGB values and the CIE coordinates of the stimulus, it is not enough. The monitor should be calibrated before starting the experiment, otherwise the color deviation will make the results less credible and harm the reproducibility of the experiment. The flaw is that we calibrated the monitor only by naked eyes instead of using professional calibration tools, this maybe too arbitrary and subjective, because accurate color-matching call for professional calibration. However, considering that we did actually controlled the contrast, luminance, color temperature of the monitor, and all the experiments were carried out on the same computer, which means the gamma value, resolution and other parameters of the screen stay the same. In this way, the color deviation could be minimized to a large extent. Further more, our research topic is color afterimage, previous study [30] has shown that the afterimage perceived was roughly, not exactly complementary to the hue of the color perceived during adaptation. And the afterimage itself is not stable, the strength, brightness and duration varies a lot [31]. Therefore, we believe that the color aftereffect founded in this study is not so vulnerable to small color deviation of the test stimuli. In sum, the color deviation may exist, but it has little effect on the results. However, future study should pay more attention to monitor calibration to avoid potential problems.
The third limitation was lack of discussion about whether the linguistic adaptation color aftereffect tends to build and strengthen with exposure to the adapting stimuli. In Dlis and Boroditsky's [22] research of the language motion aftereffect, they found no aftereffect when participants finished listening to the first two paragraphs of a story, but after participants finished listening to the whole story, the results showed a motion aftereffect. Thus, further studies could concentrate on the addictive feature of adaptation aftereffect in order to assure that the language-induced color aftereffect was caused by the same process-neuron adaptation-as the perceptual color aftereffect. Another interesting question is whether the aftereffect resulted from the whole text (narrative level) or the color words (lexical level). That is to say, whether a single word independent of the context could activate the simulation mechanism?
On the whole, we made use of the linguistic adaptation paradigm instead of the previous match-mismatch paradigm to investigate the influence of language comprehension on color perception. Our study made up the insufficiency of the previous studies on simulation theory about color. The linguistic adaptation color aftereffect revealed here is different from the previous match or mismatch advantage effect and provides more powerful support for the embodied semantics that language comprehension and perceptual processing share, at least to some extent, the same neural mechanism. Our study also has important implications in terms of methodology. The linguistic adaptation paradigm proposed here provides a new means to examine the effect of language processing on perception, so that we have a more powerful method to test whether the neural bases of conceptual and perceptual processing are overlapped. As such, it might also be promising to expand the paradigm for studying the comprehension of words or sentences conveying other perceptual information.
color. The sky, the mountain range and the branches all seemed to be dressed in red brocade and that was rosy dawn. Gradually, the sun showed up in the shape of half round with brightly red color.
2. The red, half-round sun rose continuously. The color of the sun was deep red, like a shining bloody red plate of agate.
3. Finally, the red sun became rounder and rounder and rose over the horizon. As red and powerful as fire, the sun came out.
4. The light of the sun spreads around, so there appeared thousands of rosy clouds, making the clouds nearby dyed in magnificent red color.
5. The expanse earth was smeared with a layer of brightly red greasepaint and all things on earth were dressed in splendid attire.
6. Red trees, red chicken and red houses were all under the light of the rosy dawn, the red color of which was really adorable.
Maple trees: 1. Walking along the mountain path and all of a sudden, a large piece of red chunk came into sight, like a ball of burning fires, sparkling in the sunlight, which is extremely beautiful! Take a closer look, they are maple trees. Mountains have a winding distribution and were covered with red maple leaves, like an immense red cloth spreading out on the ground.
2. The whole hillside is covered by the brightly burning maple trees. Looking from a distance, it seems like the mountain is flaming.
3. All the maple trees together are like a cluster of flames with scarlet color. They are burning, leaping and dancing in the wind.
4. The color of the dancing leaves is red. They are so bright and hot, like fireballs. The red color makes people excited and heartbeat.
5. The maple leaves are hot red as fire, fresh and bright. Dancing and waving in the autumn wind. it seems like they are boasting themselves.
6. With red leaves, the gleam of sunny clouds is dazzling as splendid brocade. It is the most charming warm color in the cool autumn.

Azalea:
1. Azalea, also called rhododendron, has a reputation of "the beauty of flowers". The petals of azalea are red. They are next to each other, pushing and pressing, how lovely! When standing in front of ten thousands mu of azaleas. You can see fiery-red azaleas blooming all over the slope. The land is like being coated with a layer of rouge.
2. The red color of the boundless azalea bushes is fervent, solemn and stirring. It looks like the red was going to stretch to the horizon.
3. See from a distance, the wall of red flowers dying the sky red. Flaming red flowers covered the branches, bravely waving in the wind. 4. Each blooming azalea is like a red agate, fluttering in the wind. And exposure in the sunlight makes them more bight and vivid.