From Cues to Signals: Evolution of Interspecific Communication via Aposematism and Mimicry in a Predator-Prey System

Current theory suggests that many signaling systems evolved from preexisting cues. In aposematic systems, prey warning signals benefit both predator and prey. When the signal is highly beneficial, a third species often evolves to mimic the toxic species, exploiting the signaling system for its own protection. We investigated the evolutionary dynamics of predator cue utilization and prey signaling in a digital predator-prey system in which prey could evolve to alter their appearance to mimic poison-free or poisonous prey. In predators, we observed rapid evolution of cue recognition (i.e. active behavioral responses) when presented with sufficiently poisonous prey. In addition, active signaling (i.e. mimicry) evolved in prey under all conditions that led to cue utilization. Thus we show that despite imperfect and dishonest signaling, given a high cost of consuming poisonous prey, complex systems of interspecific communication can evolve via predator cue recognition and prey signal manipulation. This provides evidence supporting hypotheses that cues may serve as stepping-stones in the evolution of more advanced communication and signaling systems that incorporate information about the environment.


Introduction
Signaling systems represent a basic form for inter-and intraspecific communication. Signals are an evolved means of actively conveying information and influencing the behavior of receivers. In contrast, cues are passive, non-evolving biological and environmental traits that inherently provide the observer with information [1,2]. Organisms have evolved to use both signals and cues to inform their behavior. One of the most pervasive examples of signaling systems in the animal world is aposematism: the warning coloration of poisonous and distasteful species. Aposematism occurs in a wide variety of taxa [3][4][5] and represents a striking example of evolution [6]. The characteristics of these aposematic signaling systems are highly variable. Chief among these, the toxicity (ranging from merely distasteful to poisonous or venomous) of the aposematic prey (i.e. the model) and the occurrence, palatability, and accuracy of mimics differ between systems. Studies of a variety of aposematic systems have provided insight into a vast number of evolutionary concepts including character displacement [7], frequency dependence [8,9], species diversity [10,11], gene flow [12], co-evolution and co-evolutionary arms races [13,14], and adaptive landscapes [15]. Despite these studies, and the development of theoretical models on aposematic signaling and mimicry [16][17][18][19][20][21][22][23], we do not fully understand the conditions necessary for their evolution because no studies have been able to investigate their evolution from a primordial system. To complicate matters, predator learning is not fully understood and its importance for the evolution of aposematism and mimicry likely varies between species [24].
Current theory suggests that evolution of aposematic signaling in toxic species is adaptive [17]. Prey benefit when predators learn to avoid them and predators benefit by avoiding harmful prey. Such signaling systems often include one or more additional species that mimic the aposematic signal, reducing their predation risk. In Müllerian mimicry, a number of species share a common warning signal to advertise toxicity. The species within such mimicry rings share the costs associated with educating a common predator [25]. In contrast, Batesian mimics advertise a warning signal while remaining palatable [26]. This dishonest signal benefits only the toxic signaler and the receiving predator because it degrades the information quality of the aposematic signal [27].
In terms of accuracy of mimic signals, for both Müllerian and Batesian mimicry, predation on imperfect mimics is expected to select for perfect mimicry, or automimicry (e.g., [28]). For automimicry systems, quantitative models suggest that levels of protection enjoyed by the mimic scale with the toxicity of the model prey [29,30]. In addition, a number of experimental studies have shown that accurate mimicry evolves when the model is scarce relative to the abundance of mimics [8].
Although selection often favors automimicry, stable systems of imperfect mimicry are prevalent in nature and occur under many conditions [20][21][22]. In order to describe the processes by which they can evolve, systems of imperfect mimicry have been widely studied from both the experimental [23,28,[31][32][33][34][35][36] and theoretical perspectives [20,22,29,[37][38][39][40][41]. From these, two primary effects seem to support the evolution of imperfect mimics. First, selective pressure for perfect mimicry relaxes when imperfect mimics are rare relative to the model or when imperfect mimics are unprofitable due to other factors (e.g., size or agility) [20,42]. Second, predators exert less selective pressure on imperfect mimics when they generalize the poisonous prey's characteristics, leading to behavioral avoidance of any species that exhibit these generalized traits [20,43,44].
In order to determine the evolutionary trajectories, beginning from a naïve predator-prey system through to a fully functional aposematic signaling system, quantitative models have outlined the theoretical conditions under which aposematic signaling systems stabilize (e.g., [15,30,[45][46][47][48][49][50][51][52][53]). However, such models require substantial simplification of the signaling system, assumptions of unnatural conditions, or reliance on extant signaling systems. Additionally, no studies have been able to experimentally examine the conditions necessary for a predator-prey signaling system to evolve from scratch. This is a difficult challenge, given that, in order to fully evaluate the conditions necessary for the evolution of aposematic signaling, one must observe its evolution in a naïve system where signaling has not yet evolved. However, all natural predators available for experiments have preexisting and established signal recognition systems. To resolve these issues, we used the digital evolution research platform Avida [54] to test the conditions leading to the evolution of a mimicry signal from an aposematic cue in a coevolutionary predator-prey system. We tested for levels of toxicity necessary for the evolutionary emergence of (1) recognition of signaling cues by predators and (2) dishonest signaling by prey mimics. Highly toxic model species are predicted to support more numerous and less accurate mimics [20][21][22]42,43]. Further, the maintenance of a dishonest signal, as in Batesian mimicry, is expected to require accurate mimicry when an abundant signal accompanies low toxicity [29,30]. Accordingly, we also tested the level of mimic accuracy required to support a successful Batesian mimic population while varying the levels of model toxicity. We hypothesized that these two conditions (high toxicity or accurate mimicry) provide the necessary selective pressures for dishonest signaling to arise from an existing cue.

Materials and Methods
We used the digital evolution software Avida to assess the conditions facilitating the evolution of predators that utilize cues to inform their behavior and prey that actively signal via mimicry, thereby influencing the feeding habits of cue-receptive and cuesensitive predators. Avida organisms have a sequence of program instructions that controls their behavior and serves as genetic information inherited by their offspring. Instructions executed on the genome dictate the actions taken by an organism, allowing it to sense and interact with the environment (e.g., obstacles, food, other organisms), process information, or reproduce [54]. The genome replication process is imperfect, allowing for the introduction of mutations into offspring genomes. Differential fitness in the populations occurs as a consequence of mutations producing novel combinations of operations. Combined, these properties of Avida provide the conditions necessary for adaptive evolution via natural selection: replication, inheritance, variation, and differential fitness [55]. Over the course of evolution, digital organisms in Avida often exhibit behaviors similar to biological organisms observed in natural systems [56].
We configured Avida to enable predator-prey interactions [56] using a modified form of Avida's Heads-EX hardware [57]. To allow for the evolution of predators, we included an attack instruction that, when mutated into the genome, enabled organisms to consume other organisms. In our digital ecosystems, prey species consumed spatially distributed, limited resources across a 2516251 grid-cell environment. Once resources in a cell were consumed, the environmental resource was replenished at a rate of 0.01 resource units per cell per update, to a maximum percell level of 1 full unit (1 unit = minimum level consumable by prey). Prey organisms could utilize sensory information and movement instructions to locate and reach edible resources. Predators (once evolved) had the same set of potential genetic instructions as prey. Thus predators could evolve to use the same instructions to locate and consume prey, through which they gained 25% of their captured prey's previously collected resources. For comparison, we conducted additional experiments using conversion efficiencies of 10% and 50% (Fig. S1). While a conversion efficiency of 10% would have more closely reflected natural efficiencies [58,59], at this level, most populations did not evolve stable predator subpopulations in the allotted time, particularly at high poison levels (see below). Ultimately, varying the conversion efficiency appeared to impact only threshold poison levels for the evolution of predator cue recognition, not overall evolutionary or behavioral patterns (see Fig. S1).
All organisms were required to consume a total of 10 units of resource before they could reproduce, either directly from the environment (prey) or from consuming prey that had consumed resources (predators). Reproduction was thus limited by resource consumption: the faster an organism gathered food, the sooner it could reproduce. Accordingly, for predators, advantageous mutations were those that allowed for more rapid targeting and capturing of prey. Likewise, any prey mutations that conferred greater foraging efficiency or predator avoidance skills would give prey a selective advantage.
Prey organisms were divided into three classes of morphs: nonpoisonous or 'safe', poisonous (toxic), and mimic. To control for subpopulation size effects, and because predators could not act as a top-down control on the poison prey class, classes were assigned at birth such that 50% were poisonous, 25% were safe, and the remaining 25% were potential mimics. The designated class was a part of the prey's phenotype visible to other organisms. Each morph class foraged for separate environmental resources.
'Non-poisonous' prey organisms directly transferred 25% of their gathered resources to predators when consumed. The 'poison' prey organisms, upon consumption, reduced a predator's gathered resources by a factor (i.e. 'poison level', see below) of what that prey had previously gathered. The 'mimic' prey provided the same resource benefit as 'non-poisonous' prey when consumed by a predator. However, mimic prey were unique in that, if appropriate mutations had occurred, they could execute an instruction that allowed them to change their visible phenotype to that of a different prey class. This instruction had no effect in organisms not in the mimic class, even if the relevant mutations occurred. Displayed and visible classes provided a cue for predators, and served as an evolutionary opportunity for them to evolve abilities for recognizing and avoiding poisonous prey. If these behaviors evolved, mimics would then be able to further evolve to manipulate that cue, avoiding predation by providing the predators with a false signal.
Organisms were classified as predators after they made their first kill. The prey class preference of each predator was determined by a specific instruction sequence defining the 'attack organism operation' (see Table 1). The default sequence, constituting a single attack instruction, performed a 'generalist' attack, targeting any prey organism in the cell in front of the predator, regardless of the prey's displayed signal. Three additional attack options (first requiring the acquisition of appropriate mutations) consisted of an attack instruction followed by one of eight modifying instructions that specified the target prey morph type. If the victim's displayed class did not match the specified attack type (i.e. predator preference), the attack would fail. As a result, a predator's prey preference was explicitly heritable, though multiple preferences could be expressed if multiple attack instruction sequences existed within the predator's genome. Under most treatments, for a successful kill of a mimic, the predator's expressed prey preference had to match the mimic's displayed class (i.e. what it mimicked), not its true class. However, select treatments, as noted in the results, further altered the fidelity of the apparent prey phenotype such that predators perceived the true class, instead of the displayed class, with the specified probability (i.e. imperfect mimicry).
All experiments were started with the introduction of one prey organism from each class. Each organism's genome was 100 instructions long, and each of these ancestors moved randomly through the Avida landscape, attempting only to consume resources and reproduce. Genetic mutation rates applied to offspring genomes were a 0.25 probability of a single instruction substitution, and a 0.05 probability each that a single instruction would be inserted or deleted (after [57]). Assignment of offspring to prey classes ensured that half of all prey born were safe for predators to eat, and that the cue from the poisonous prey outnumbered any signaling by the mimics. Importantly, this does not mean heeding the cue was always advantageous: the reward for eating a signaling mimic may have outweighed the penalty for eating a poisonous prey. Furthermore, as we controlled only birth ratios, it was possible for the number of mimics in a given population to outnumber the poisonous prey. In such cases, if enough mimics successfully signaled that they were poisonous, it could be advantageous for a predator to ignore the signal and feed on the excess mimics. Assigning classes in this way also helped stabilize the system, preventing the extinction of any one prey class.
Because predators could not act as a top-down control on the poisonous prey class, we limited the number of prey in each class to 1,000 organisms and imposed the following method of classspecific population size limitations. Whenever an organism was born, it was assigned to a prey class. If the inclusion of the newly born organism would increase the number of prey in that class beyond the prey type cap, a random existing individual from that class was removed from the population. This method follows the same logic used in Avida by default in which population sizes are limited by physical space constraints [54], except that we applied independent limits to each class, instead of to the population as a whole. We set resource inflow levels sufficiently high to ensure that they did not directly limit prey population levels. Consequently, cases in which a prey class population was substantially less than 1,000 specifically indicated that the class was top-down limited by predators. Unlike the three prey classes, predators were not limited to a maximum class size: predator resources (i.e. prey) were always finite and in a negative frequency relationship with the predator population size. To prevent population extinctions and standardize prey population sizes, the total minimum prey levels across all morph classes, below which predator attacks would be blocked (until another birth occurred), was set to 900 (after [59] and [60]).
All populations were evolved for 500,000 updates (an update is an arbitrary time unit in Avida, roughly equivalent to the time

Results
We tested for levels of toxicity necessary for the evolutionary emergence of signal recognition from a cue by predators and dishonest signaling by prey mimics. We also tested the level of mimic accuracy required to support a successful mimic population.

Predator Recognition of a Cue
We assessed the conditions under which predators evolved to preferentially avoid consuming poisonous prey using a logistic regression model that related predation levels to the eight levels of toxicity of the poisonous prey (0.01, 0.025, 0.05, 0.1, 0.2, 0.3, 0.4, 0.75, 1.0). In this model, we classified each of the 30 poison prey sub-populations as being under predation pressure if their realized abundance fell below 800 individuals (80% of the maximum) at the end of the experimental trial. This threshold was chosen arbitrarily during preliminary data analysis in an effort to reduce noise as experimental abundances were either significantly above or significantly below this value, but the individual abundance values were highly stochastic. Based on the proportion of evolved populations in which poison prey were not under predation pressure, the model predicts the probability that predators will evolve to preferentially avoid consuming poisonous prey at a given a poison efficacy level (Figure 1). At poison levels below 0.2, the selective pressure to avoid such prey is weak, resulting in a low probability that predators evolved selective predation habits. However, when the efficacy of the poisonous prey is above 0.2, predator populations nearly universally evolve to avoid predating poisonous prey. To illustrate the potential realized cost of consuming a poisonous prey, a poison level of 0.1 would cause a 10% reduction in the resources available for an attacking predator to satisfy the threshold for reproduction (10 units). As such, in order to compensate for 10% 'energetic' loss, if a predator had previously stored 9 units, it would now have to consume eight young prey that each had consumed 1 unit of environmental resource, or one better-fed prey that had consumed 8 units. On the other hand, had that same predator killed a non-poisonous species, it could reproduce immediately.

Selective Targeting of Prey Types
For all tested poison levels, the three prey classes rapidly grew toward the population cap until predators began exerting topdown controlling pressure (Figure 2). At low poison levels (Figures 2a and 2b), mimic and safe prey subpopulation sizes remained relatively comparable and constant throughout evolution, suggesting that predators were consuming non-poisonous prey in proportion to their availability, predators were not distinguishing between poisonous and non-poisonous phenotypes, and the cue was not affording protection to the mimic class. However, at higher poison levels (Figures 2c and 2d), the poisonous prey subpopulations converged to the maximum subpopulation size, indicating that they were no longer under topdown predation control and that predators had evolved selective targeting of non-poisonous prey. At the same time, realized predator population sizes were higher in high poison efficacy trials. This indicates that predators could have benefited from evolving skills for discriminating prey at low poison levels. However, at those levels, the selection pressures were not (apparently) strong enough for predator populations to realize this potential in the allotted evolutionary time.

Evolved Manipulation of a Communicative Signal
In all populations, prey evolved to alter their apparent phenotypic signal (i.e. appearance) when in the mimic class ( Figure 3). However, at low poison levels (0.1 and 0.2, Figure 3a and 3b, respectively), mimic class prey did not demonstrate a clear preference for mimicking poisonous prey. In contrast, at high poison levels (0.3 and 0.4, Figure 3c and 3d, respectively), mimic prey showed a clear preference toward mimicking poisonous prey. Thus it was only when poison efficacy was high and predators evolved to selectively avoid poisonous prey (Figure 1) that prey evolved to selectively mimic that prey type.

Signal Noise and the Effect of Information Loss
In the treatments considered above, the phenotypic appearance of mimics was perceived with perfect fidelity by the predators (i.e. predators always saw what the mimics intended them to see). In order to test the robustness of strategies for mimicking poisonous prey, we further evaluated mimicry choices by evolving populations under 'imperfect' mimicry conditions. Under imperfect mimicry, predators perceived the intended mimic signal 10% of the time, with the true (mimic) phenotype apparent to the predator the rest of the time. From the final populations, we calculated the ratio of the mean proportion of organisms of each population that were mimicking poisonous prey under the low accuracy mimicry conditions to the mean proportion mimicking poisonous prey when mimicry was perfect for each of the five poison levels (0.10, 0.20, 0.30, 0.40, 0.75, 1.0; Figure 4). By this measure, ratios under 1.0 would indicate a greater proportion of organisms were attempting to mimic poisonous prey when mimicry was perfect than when it was imperfect. We calculated 95% bootstrap confidence intervals [65] for these measures by repeatedly calculating the ratio from sampled subsets of the source populations (i.e. 10% and 100% accuracy populations) over Overall, these data indicate that relatively low proportions of organisms in the mimic class chose to mimic poisonous prey when mimicry was imperfect. However, moderate and high poison efficacy (. = 0.30) provided enough protection to poison prey phenotypes that a higher proportion of prey in the mimicry class had evolved to appear poisonous, even though mimicry was highly imperfect.

Discussion
We have demonstrated that adequate toxicity is required for aposematic cue recognition to evolve and inform predatory behavior. At poison levels below 0.2, predators never distinguished between prey types. However, at higher poison efficacy levels, predator recognition and selection of prey types increased, with the behavior fixing in all trial populations for poison levels at and above 0.4. This agrees with previous findings that predator learning is enhanced by highly toxic prey [23]. At the same time, selective pressures on prey were strong enough to promote the evolution of dishonest signaling through mimicry of the aposematic signal (Figure 3). Mimics and dishonest signaling did not cause predators to ignore the aposematic cue (Figures 1-2). Instead, while the presence of mimics increased the poison level triggering evolution of predator cue and signal recognition ( Figure  S2), at the given prey class 'immigration' rates used here, the evolution of deceptive signaling by mimics did not destabilize predator cue recognition (Figure 3). Additionally, once predators began to cue in on and respond to prey signals, higher proportions of mimics signaled that they were poisonous, leading to an increase in mimic survival relative to safe prey ( Figure 2).
Despite being capable of mimicking poisonous species, mimics did not universally evolve to employ this strategy. Instead, as has often been observed in nature and is predicted in mathematical models [22,66,67], the ratio of expressed mimic signals appears to reach equilibrium. This occurred at all poison levels, suggesting that the toxicity of the model can only provide protection to a certain number of mimics and that this level of protection is governed by negative frequency dependence. Any non-poisonous species that becomes highly abundant will experience increased selection pressure, potentially driving it into rarity while other prey species populations increase, causing an increase in predation on that species and ultimately leading to stable signaling ratios, as are apparent in Figure 3.
Brower's model [29] demonstrated that highly toxic prey can support an abundance of perfect mimics. Similarly, we found that the proportion of mimics signaling toxicity increased as the toxicity of the model increased ( Figure 3). Under conditions of imperfect mimicry (Figure 4), predators increasingly generalize the signals of toxic prey as the prey's toxicity increases, because the cost of failing to identify a model as a mimic is too high [43,68], particularly in the presence of alternative prey [49]. However, our experiments also show that in environments with coevolving naïve predators, imperfect mimicry is supported without requiring high levels of toxicity. This finding lends support to Fisher's theory [6] of gradual evolution of mimicry. Our results suggest that other dishonest signals may have evolved gradually in situations where the cost of incorrectly distinguishing a dishonest from honest signal is high. Similarly, in the coral snake mimicry complex, the most perfect mimics appear at the edge of the model range [69] and high model abundance at the center supports imprecise mimicry because of predatory generalization [43]. At the same time, our findings of predator generalization and the evolution of imperfect mimicry contrast with the assertion that mimicry must evolve in a two-step process that starts with feature saltation [41,70]. Such feature saltation would allow a species to jump the adaptive valley between crypsis and mimicry, and then gradually evolve toward the adaptive peak defined by the model's appearance [37,70]. Our results suggest that this two-step process is not a necessary mechanism for the evolution of mimicry systems.
Overall, we have demonstrated that mechanisms of communication based on cue recognition readily evolve when it provides adequate benefits to both parties. Further, we have shown that these systems are robust to high levels of noise: cues, once recognized, can support the evolution of dishonest mimicry signaling, even when the mimicry signal is highly imperfect, without disrupting the communication system. Understanding how basic signaling systems evolve can help us understand the selective pressures leading to more complex communication and language systems. Our findings suggest that communicative . Moderate and high poison efficacy levels promote the evolution of mimicry, even when mimicry is highly imperfect. Shown are mean ratios of the mean proportion of organisms in each population that were mimicking poisonous prey under low accuracy mimicry conditions (10%) to the mean proportion mimicking poisonous prey when mimicry was perfect (100% accuracy). At low poison levels, a lower proportion of organisms in the mimic class mimic poison prey when mimicry is imperfect. CI's given are 95% bootstrapped confidence intervals. Bootstrapping was performed by repeatedly calculating the ratio from sampled subsets of the source populations (i.e. 10% and 100% accuracy populations) at 500,000 updates. doi:10.1371/journal.pone.0091783.g004 signaling systems can evolve readily and gradually, without feature saltation, and can confer adaptive advantages allowing populations to cross adaptive valleys toward increasingly sophisticated signalreceiver communications systems.

Supporting Information
Figure S1 Prey to predator conversion efficiency shifts critical poison level thresholds, without altering overall patterns. Data shown represent fits from logistic regression models relating poison level to the probability that predator species will evolve to avoid consuming poisonous prey (based on proportion of evolved populations in which poison prey were no longer under predation pressure) when predators receive 10% (left) and 50% (right) of the value of their preys' consumed resources. Solid black line indicates the predicted probability. Red dashed lines represent the 95% bootstrap confidence intervals of the model. Circles indicate the observed values in our experiments. Due to low prey densities, in many populations, predators did not evolve into the systems when conversion efficiency was low and poison levels were high (only populations with at least 100 predators were considered here, n = 92 out of 270 for 10% and 270 out of 270 for 50%). (TIFF) Figure S2 Exclusion of mimicry behaviors reduces poison levels needed to trigger the evolution of cue recognition. Data shown represent fits from logistic regression models relating poison level to the probability that predator species will evolve to avoid consuming poisonous prey (based on proportion of evolved populations in which poison prey were no longer under predation pressure) when mimic morphs were prevented from mimicking (compare to Fig. 1). Solid black line indicates the predicted probability. Red dashed lines represent the 95% bootstrap confidence intervals of the model. Circles indicate the observed values in our experiments. (TIFF)