## Figures

## Abstract

We studied the formation of trail patterns by Argentine ants exploring an empty arena. Using a novel imaging and analysis technique we estimated pheromone concentrations at all spatial positions in the experimental arena and at different times. Then we derived the response function of individual ants to pheromone concentrations by looking at correlations between concentrations and changes in speed or direction of the ants. Ants were found to turn in response to local pheromone concentrations, while their speed was largely unaffected by these concentrations. Ants did not integrate pheromone concentrations over time, with the concentration of pheromone in a 1 cm radius in front of the ant determining the turning angle. The response to pheromone was found to follow a Weber's Law, such that the difference between quantities of pheromone on the two sides of the ant divided by their sum determines the magnitude of the turning angle. This proportional response is in apparent contradiction with the well-established non-linear choice function used in the literature to model the results of binary bridge experiments in ant colonies (Deneubourg et al. 1990). However, agent based simulations implementing the Weber's Law response function led to the formation of trails and reproduced results reported in the literature. We show analytically that a sigmoidal response, analogous to that in the classical Deneubourg model for collective decision making, can be derived from the individual Weber-type response to pheromone concentrations that we have established in our experiments when directional noise around the preferred direction of movement of the ants is assumed.

## Author Summary

Many ant species produce large dendritic networks of trails around their nest. These networks result from self-organized feedback mechanisms: ants leave small amounts of a chemical -a pheromone- as they move across space. In turn, they are attracted by this same pheromone so that eventually a trail is formed. In our study, we introduce a new image analysis technique to estimate the concentrations of pheromone directly on the trails. In this way, we can characterise the ingredients of the feedback loop that ultimately leads to the formation of trails. We show that the response to pheromone concentrations is linear: an ant will turn to the left with frequency proportional to the difference between the pheromone concentrations on its left and right sides. Such a linear individual response was rejected by previous literature, as it would be incompatible with the results of a large number of experiments: trails can only be reinforced if the ants have a disproportionally higher probability to select the trail with higher pheromone concentration. However, we show that the required non-linearity does not reside in the perceptual response of the ants, but in the noise associated with their movement.

**Citation: **Perna A, Granovskiy B, Garnier S, Nicolis SC, Labédan M, et al. (2012) Individual Rules for Trail Pattern Formation in Argentine Ants (*Linepithema humile*). PLoS Comput Biol 8(7):
e1002592.
doi:10.1371/journal.pcbi.1002592

**Editor: **Bard Ermentrout, University of Pittsburgh, United States of America

**Received: **January 31, 2012; **Accepted: **May 8, 2012; **Published: ** July 19, 2012

**Copyright: ** © 2012 Perna et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

**Funding: **This work was supported by a European Research Council starting grant to D.J.T.S. (ref: IDCAB) and by a research grant from the MESOMORPH project (French National Research Agency ANR-06-BYOS-0008). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

**Competing interests: ** The authors have declared that no competing interests exist.

## Introduction

Many ant species produce large dendritic patterns of trails around their nests (figure 1). These patterns are among the most important examples of transportation networks built by animals: they mediate the exploration of space and the coordination of foraging activities across the whole colony [1], [2] and channel the daily movements of hundreds or thousands of ants. Empirical observations [3]–[6] and models [7], [8] have shown that ant trail networks provide efficient solutions for transporting and searching for food.

Each picture is obtained by summing all the ants detected from arena-level snapshots during 5 minutes (300 snapshots). The contrast and gamma are adjusted to make single ants visible in the images.

In spite of having coherent and efficient organization on a large scale, ant trail formation can be explained as the result of a completely self-organized process. Simulations supported by experiments have shown that the trails are the result of an autocatalytic process: ants move in response to local concentrations of pheromone and in turn change these same concentrations by laying new pheromone where they go [9]–[17].

The link between models and experiment is weak in one important respect: the exact nature of how individual ants move on the trail and respond to pheromone remains unknown. Important work in the direction of answering this question was done by Jean Louis Deneubourg and collaborators [11], [18]–[21], (see [22] for a review). In Deneubourg's model, when individual ants face a bifurcating trail, their behaviour depends on pheromone concentrations on the trails ahead with a function of the form(1)where the probability () for an ant to select the left (right) branch of a bifurcating trail is expressed as a function of the concentrations of pheromone on the left (*L*) and right (*R*) branches. The parameter *a* determines the degree of nonlinearity of the choice. A high value of *a* means that even if one branch has only slightly more pheromone than the other, the ant will have a disproportionally large probability of choosing it. If *a* = 1 the ants react in a linear, proportional manner to pheromone concentration. The parameter *h* acts as a threshold for response to pheromone. For larger values of *h*, more marking is necessary for the choice to become significantly non-random.

Equation 1 (or variants of it) accounts well for the results of experiments in which ants face a branching point in their trail, usually in the form of a double bridge. For example, Deneubourg et al. [23] studied a colony of Argentine ants (*Linepithema humile*), which was given access to a bridge with two bifurcating branches leading to the same source of food. At the beginning of the experimental trials, ants took both branches in similar numbers, but ultimately selected one of the two bridges [18], [23]. Selection of one single branch is only possible if the choice function has a sigmoidal shape, i.e. when . The exact value of the exponent *a* that reproduced experimental results the best changes for different experimental setups. In ref. [23] it was found that an exponent reproduces experimental results, while another experiment with ants moving in a corridor found *a* = 4 [24]. Beckers et al. [19], [20] went on to establish similar results for *Lasius niger*, also finding an exponent . This work has led to an established ‘wisdom’ that ants react disproportionally (i.e. ) to pheromone concentration. Equation 1 with *a* = 2 has further been the basis of models of self-organised trail formation (e.g. [9]) re-enforcing the idea that a disproportional response by ants at an individual level is required for trail formation.

Double bridge experiments do not however capture individual ant behaviour and are instead fitted directly to the global outcome. Many different mechanisms in which individual preferences are amplified by positive feedback can all explain the selection of one single branch (see e.g. [25]) while little is known about the actual rules used by *individual* ants to respond to pheromone concentrations. Questions such as how ants adjust their turning angle depending on pheromone concentrations, or whether they integrate pheromone information over a certain distance before committing to a decision, remain open.

How insects perceive and react to environmental stimuli has been studied in many contexts other than pheromone trails. For example, various studies have established that perceptual errors are proportional to the magnitude of the stimuli [26]–[28]. Such observations are what we expect if insect perception follows a Weber's Law [29]. A Weber's Law holds if the response *U* to a difference between two stimuli and is proportional to ratios of the type “signal difference”/“average signal”. In the case of stimuli for which and are equivalent and represented in similar proportion in the sensory field we have(2)where *c* is a constant. The ratio in equation 2 is known as the “Michelson contrast” of the stimulus pattern. Weber's Law is known to hold for insects (e.g. [30]), and is particularly well studied for human perception in different sensorial modalities (musical pitch, sound loudness, image brightness, length, speed, shape, time and numerosity). Equation 2 is a linear function of difference and is thus analogous to a version of equation 1 in which *a* = 1 (see methods).

Studying individual responses to the trail pheromone is non-trivial since pheromone density is not readily visible. Two possible approaches are to test the ants' response to synthetic pheromone [31]–[33] or to place strips removed from trails formed under controlled conditions [34], [35]. The former of these approaches allows us to control concentration, but it does not reproduce the physical and physico-chemical properties of the trails. It is difficult to relate the concentrations of synthetic pheromones to the actual concentrations present on the trail. For instance, pure (Z)-9-hexadecenal -the active compound of Argentine ant trail pheromone- is 200 times less active when presented alone than in the form of ant gaster extracts with an equivalent amount of molecule [31]. Trails formed on strips capture physical characteristics of the trail but do not allow us to tightly control concentrations. In addition, trails on paper strips are necessarily one-dimensional and cannot be easily used to study pheromone response in two dimensions.

In our study we use novel imaging and analysis techniques to overcome these limitations and study trail following behaviour over a large number of tracking events. We assume that the concentration of pheromone at a particular position in the arena at a particular time is proportional to the number of ants that have previously passed that position. We use various assumptions about evaporation to test the robustness of our results. In this way, we can derive the response function of individual ants to pheromone concentrations directly on the trails produced by the ants themselves.

## Results

### Arena-level observations of trail formation

The ants explore the arena uniformly in all directions around the entrance in the beginning of the experiment, but soon start to form trails that persist for some time. Later in the experiment these trails are either abandoned or amplified (see figure 1). The kinetics of arena exploration is shown in figure 2. The figure reports the total number of ants in the arena (figure 2A) and of those along the arena border (figure 2B) as a function of time from the beginning of the trial. Ants start entering the arena soon after they are given access to it and start concentrating along the border of the arena about 10 minutes later. Usually the number of ants in the arena reaches a maximum about 30 minutes after the beginning of the experiment and then decreases slightly during the rest of the experiment. Roughly at the same time as the number of ants in the arena reaches its maximum, the number of trails also attains a maximum.

A. Number of ants in the arena over time. B. Number of ants along the arena border (i.e. less than 2.5 cm from the border) over time. For each plot the curve gives the mean and standard deviation over all trials.

### Individual-level behaviour

A first characterisation of individual ant motion is provided by the measure of ant speed (figure 3A). Speed, measured over time intervals of 0.4 seconds for all the 600,000 tracking events, averaged to slightly less than 2 cm/s. The distribution of speeds is wide, and a few ants were observed to move at speeds of up to 6 cm/s.

The graph in A is from all data, while the one in B is limited to “moving” ants (ants that move at least 0.4 cm in each of the two time intervals; see methods) because of the difficulty in defining regions L and R for ants that do not move. The speed measured in both graphs is the average speed over 0.4 second intervals. The median and other percentiles are affected by small quantization effects, because ant position is recorded in pixel coordinates (, with small differences in different trials). The sample sizes of the boxplots in B are different. The whiskers in all the boxes represent data within of the quartiles; circles represent outlier data points.

We tested whether speed depends on pheromone concentrations experienced by the ants. Figure 3b gives box plots of ant speeds measured over the 0.4 seconds immediately after the ant experienced a given pheromone concentration in the two sectors of radius 1 cm and as illustrated in figure 4 (see methods). The speed is clearly not influenced by pheromone concentration at this short time scale. This does not exclude the possibility that “over a longer time scale ants move faster on marked than on unmarked substrates. For example, a higher turning rate on substrates with little pheromone might result in lower distance travelled than when walking directly down a well-marked trail.

For each tracking event we get the position of the ant at time and its direction at times immediately prior to or after (average directions during intervals). The angle is the change from previous direction. and are the integrals of all pheromone in two circular sectors ahead of the ant on the left and right side, respectively. In order to avoid spurious correlations between ant movement and the pheromone added by the ant during that same movement, we always calculate correlations with the pheromone map as it was 16 seconds before the tracking event ().

Let us consider the angle changes made by ants in response to pheromone concentrations. For each level of total pheromone we look at how the average turning angle depends on the difference between the two concentrations of pheromone on the left and on the right, i.e. . Figure 5 shows this plot for six different values of total pheromone. Here (and in figure 6) individual tracking data from all the trials are combined together (table 1 provides statistics for the individual trials when assuming no significant pheromone evaporation and table 2 reports the same data when pheromone evaporation is assumed). Ants tend to turn in the direction of higher pheromone concentration. For all concentrations of total pheromone , the turning angle increases linearly with the difference between pheromone on the left and on the right of the ant(3)The slope of the linear relation changes from one plot to the other. In particular, the maximum turning angle is always of the order of degrees, occurring when all the pheromone is concentrated on one side of the ant. This also coincides approximately with the typical standard deviation in the angle given the fit of equation 3, indicating that 35 degrees is the relevant scale for changes in direction for our chosen observation scale.

Each graph is for a different range of values of total pheromone . Given the large number of data points involved in the plot, and to improve visualization, we only report the mean and standard deviation of data binned in intervals of 20 pheromone units. The red line is a linear fit (on the unbinned data) of the form . Statistics on the fitted slope are as follows: (A) ; , ; . (B) ; , ; . (C) ; , ; . (D) ; , ; . (E) ; , ; . (F) ; , ; . Angles increase anticlockwise: positive angles indicate an ant turn to the left. The data from all the trials are merged for this figure.

Error bars associated with each data point are confidence intervals on the slope estimation. A. no pheromone evaporation. B. pheromone evaporation with half-life of 30 min. The red line is a power-law fit of the form (non-weighted linear least squares of the log-transformed data; fitting parameters for the curve in A: . curve in B: ); fit restricted to the data point with pheromone units. Assuming and fitting directly a function of the form to all the original data, where is a threshold for pheromone detection, gives the best fitting values and for the condition without evaporation and and for the condition with evaporation.

In order to visualize how the slope *k* changes with the total pheromone concentration , figure 6 plots *k* versus . For a wide range of pheromone concentrations, the values of *k* follow a straight line in the log-log plot. This indicates a power-law relationship of the type(4)for some constant , or substituting equation 3(5)The curve bends down for low concentrations of total pheromone ( pheromone units). This probably reflects the fact that ants cannot sense pheromone concentrations below a certain threshold. This can happen because the substrate was not properly marked (because real ants mark intermittently [36] and could have skipped that patch) and/or because the concentration of pheromone is lower than the minimal amount that one ant can sense (the sensory detection threshold of the ant). If the ant does not sense the pheromone, we expect it on average to continue moving forward without changing direction, i.e. we expect the curves of figure 6 to go to zero when is equal to the detection threshold. Assuming a threshold of 50 pheromone units, we can fit equation 4 directly to all 12 trials (table 1). In all cases and when all trials are combined the best-fit slope is . For , equation 4 becomes(6)which expresses a relation between pheromone concentrations and turning angles of the same type we would expect based on Weber's Law.

It is important to notice that this relation does not depend on the specific scale used to measure pheromone: the same relation holds if we multiply both and by the same constant. This makes the result independent of the assumption used in the methods that ants mark one square millimetre of arena with one unit of pheromone every one second: whatever the amount of pheromone laid down per time step, we will find the same result. Another implication of the form of equation 6 is that this result is not likely to be strongly affected by pheromone evaporation. Evaporation decreases pheromone in proportion to its quantity, on average producing an effect similar to multiplying both and by some constant smaller than one. In fact, assuming an evaporation rate of pheromone with min leads to a curve (in figure 6B) very similar to the one obtained without evaporation at all (in figure 6A). Nonetheless, evaporation at a much faster rate would probably have an effect because pheromone quantity drops below the detection threshold.

We also made the assumption that pheromone marking is reasonably constant in time. This implies that the values of and on which we base the analysis are proportional to the actual pheromone concentrations. We know that the marking rate of real ants is not constant, but it is likely to vary both because of random fluctuations and inter-individual variability. However, provided this variability is uncorrelated with pheromone concentrations it will only add noise to the data, but won't change our results. It remains to be thoroughly tested whether ants might modulate their trail laying behaviour depending on the concentration of already present pheromone. The existing evidence does not however support such a hypothesis. Aron and collaborators [37] report that Argentine ant colonies keep marking the substrate over time, but they do not test if the marking frequency (or the amount of pheromone per marking event, which is more difficult to test) remains constant. In his master thesis, Gerbier describes a control experiment for the paper [38]. In this experiment, Argentine ants were allowed to move between a nest and a food source through a narrow bridge. Focusing on two cm of the bridge, he measured the proportion of ants marking with pheromone, both 10 and 20 minutes after the beginning of the experiment. For ants directed towards the food source (which can be better compared to our experiments, in which there is no food at all in the arena) he measured a proportion of marking ants of after 10 minutes and after 20 minutes: in spite of the fact that the ant traffic in these conditions is much higher than in our experiments (because the whole colony is foraging for food along a narrow bridge) the proportion of marking ants did not change significantly over time. Earlier experiments by Beckers and collaborators [19] on *Lasius niger* had also found “that negative feedback between the trail strength and the trail laying is not so clearly in evidence”. Even if these studies are not directly comparable to ours because they involve the presence of food, it is reasonable to believe that if ants were to modulate their trail laying behaviour, they would be more likely to do it when there is food than when there is no food in the arena, and for this reason we should not expect such a modulation of pheromone deposition in our experimental conditions.

In our analyses, we assumed that ants respond to pheromone in front of them and up to a distance of one centimetre. We still have no real knowledge of what regions around their position ants actually use to detect pheromone. This raises several questions. For instance, we would like to know the perception radius over which ants can respond to pheromone, or at which points in front of the ant pheromone concentrations have the greatest effect on movement decisions. We would also like to check whether locations behind the ant are important. If this were the case, it would imply integration of pheromone concentrations over some time before deciding to change direction.

In order to explore these issues we recomputed the predicted turning angle, but this time instead of integrating over the entire regions and we calculated and for each combination of two pixels at positions and relative to the position of the ant (see figure 4). is always positive, while is either positive or negative, depending on whether we are looking at points in front or behind the ant. We then calculated(7)for each distance combination and . For each pixel pair we measured the correlation coefficient between the real turning angles observed in all tracking events and the angles predicted by equation 7. Figure 7 reports the resulting correlation map for one replicate of the experiment. The maximum correlation is found at about one cm from the ant position and around degrees from the heading direction. This value could be compatible with the position of the antennae. Care should however be taken in interpreting this result, since for small the pheromone field is necessarily highly correlated. In other words, is small in such cases.

The colour associated with each point (, ) represents the value of the correlation coefficient between the observed turning angle and the turning angles predicted from equation 5 . The ant is situated in the centre of the map, facing upwards, and its approximate dimensions are given by the cyan rectangle. The scale for the figure is provided by+symbols, which are spaced 1 cm. apart. The map is for trial T09 and no pheromone evaporation. Similar maps are found in all the trials.

Negative correlations behind the ant are small, and can probably result from sensory adaptation at the level of the antennae: the left and right antenna would underestimate the amount of pheromone if they have just been exposed to high pheromone concentrations. The correlation becomes positive around the position of the ant, indicating a small temporal delay between perception and response (absence of integration). Given the measured ant speed of about 2 cm/s, if ants required a processing time of, for example, 0.5 seconds from the moment when they sense the pheromone until the moment when they change direction, then the correlation should become positive already behind the position of the ant, which is not observed.

### Modelling collective patterns

The response rules of individual ants to pheromone concentrations established here are, at first sight, different from the disproportional response (equation 1) found in the literature for large-scale binary choice experiments. To explain this discrepancy we ran an agent based simulation in a binary bridge setup where each agent (each ant) responds to pheromone according to the same rules identified from the experiments (see methods). Figure 8B reports the percentage of ants on each of the two branches for one run of the simulations. The selection reaches a plateau at about 70% of the ants taking one of the two branches. This response can be made stronger or weaker depending on the size of the bridge, the noise term and the interaction zone of the ant. A quantitative comparison with experiments reported in the literature is not directly possible, as our parameters for ant movement were estimated in an open arena, where thigmotactic responses are not important. These responses are no longer negligible in a binary bridge setup. However, the simulations indicate that a Weber's Law response to pheromone concentrations is compatible with the collective selection of one single branch of the bridge.

**A**. Illustrative drawing of the simulation domain; the blue dot near the top of maze represents the nest, while the large blue region at the bottom is the food source. **B**. Percentages of simulated ants on each branch of the maze at different times in one run of simulation (each point represent the average over three minutes of simulation). C. Schema providing an intuitive explanation of equation 8. The target direction of one ant depends linearly on . The probability for the ant to choose the left branch depends on the target direction and the directional noise. More precisely, if we assume that the branching point between left and right branch is at direction zero, the probability that the ant chooses the left branch is given by the integral of the curve in panel B from to 0. D. Bifurcation diagram for the density of ants on one branch of the bridge () as a function of the total flow of ants in the setup.

To see why a proportional response inherent in Weber's law produces a disproportional outcome, consider the case of one ant approaching the branching point in which there is slightly more pheromone on the right than on the left and the total pheromone concentration is low (i.e. and small). Assuming that the journey towards the branching point is a random walk with a bias proportional to equation 6 (toward the “target direction” in figure 8C), then the point at which the ant reaches the branching point will be determined by a Normal distribution around the target direction. The probability of arriving at a point left of the branching point is then given by the integral of the Normal distribution over all values on the left of the branching point (from to in figure 8C):(8)where is the number of steps in the random walk before the branching point and is a measure of the directional error in the ant movement. A more formal derivation of equation 8 is provided in the methods. The error function (erf) is, like equation 1, a sharply increasing non-linear function. For practical purposes, both equation 8 and equation 1 would provide equally good fits to double bridge data and have similar mathematical properties. Figure 8D plots the bifurcation diagram for the density of ants on one of the two branches of a binary bridge when the individual choice function is of the form of equation 8 (see methods). This diagram is similar to the one obtained from equation 1.

When the simulation is run with the same parameters in a circular open arena, it leads to the formation of distinct trails (figure 9). The timescale for the formation of trails is similar in the simulation and in the experiments, although the trails start appearing a bit earlier in the simulations. This discrepancy is in part because real ants show some latency for entering the arena at the beginning of the experiment. The most important difference between real and simulated trails is that simulated paths are more winding and more prone to form loops than real ones. Loops can form in the experiments as well. They are often stable for a long time, but usually they result from two trails connecting the nest to the arena border and a third one forming an arc of a circle around the border of the arena, a region where the density of ants is always high (see figure 1 and figure 2-B).

Each image is obtained by summing 300 snapshots of the simulation taken at equal intervals of 1 second of simulation time (corresponding to 5 minutes of simulation) in a similar way to what had been done for the experimental data.

## Discussion

Weber's Law has previously been established in a wide range of animals and for different sensory stimuli [39], [40]. Using such an internal metric allows animals to process different sensorial stimuli over a wide range of scales using a limited number of neurons [41]. The presence of Weber's Law for Argentine ants is partially explained by their need to respond to pheromone at very different concentrations [42]. Weber's Law implements a mechanism of perception where the response only depends on the ratio between pheromone concentrations and : multiplying both and by the same number does not change the ants' response. Pheromone evaporation essentially corresponds to multiplying both and by the same constant smaller than one. Hence, Weber's Law-like mechanisms offer the additional advantage of determining stable responses even in the presence of evaporation.

We have shown that the use of Weber's Law also explains the formation of ant trail networks. In the context of social interactions, the perceptual response is coupled with positive feedback to generate collective patterns. In our case, positive feedback is mediated through leaving pheromone, and the collective pattern is the trail network. We can imagine that other collective phenomena, such as group decision-making, could also be founded on coupling between Weber's Law and simple feedback mechanisms.

In contexts where groups of animals are faced with choosing between multiple options, such as the shortest path to food or the best direction to move [43], [44], disproportional non-linear responses are often implicated [23], [45], [46]. The Weber's Law we have established here is essentially a proportional linear response to stimulus differences. Indeed it is similar to a Deneubourg model (equation 1) with . This raised a potential contradiction between our current results and earlier double bridge and binary choice experiments, which have established . We can explain this apparent contradiction by noticing that the actual end point of one ant approaching a branching point depends not only on the pheromone concentrations, but also on the directional noise. The probability of entering the left or right branch of a binary bridge is then obtained by integrating over all the possible outcomes on the left and on the right sides of the bifurcation. This integral is a non-linear error function, which is in many respects equivalent to a Deneubourg model for collective decision.

While our observations are consistent with double bridge experiments, we do not have a complete explanation for the formation of trail networks. Comparing figures 1 and 9 we see several differences. The general structures of the trail networks are similar, but the trails obtained in the simulations appear earlier, are more winding and as a result contain more loops. By tuning the error we can improve some of these properties, but usually at the expense of realism in some other property. More specifically, the formation of trails in the experiments is often preceded by a short phase of isotropic exploration around the entrance (see figure 1). In the simulations, this pattern can be reproduced by increasing the error. However, doing so makes the trails appear later and can produce extremely winding trails that form loops just around the entrance. Our model shows to what degree trail networks can be explained by the ant response to a single pheromone, leading us to conclude that this response alone is not sufficient to completely explain the structure of the trails. Even if *Linepithema humile* ants are known to rely predominantly on chemical signals for orientation [37], we can imagine that they complement information carried by pheromone with more global inferences of their position and direction of movement. Many mechanisms such as path integration or klinotaxis can provide this additional information. Path integration in particular could explain some of the differences between real and simulated trails. In fact, the simulations are a direct implementation of the rules of response to pheromone measured experimentally over single time steps. As such, they reproduce exactly the pattern of movement of ants at the time scale of one time step. At a longer time scale, however, the trails produced in simulation bend in different directions, whereas the real trails are straighter. Path integration would imply that the turning angles of the ants are anti-correlated at longer time scales, ensuring that they remain more or less straight in spite of the noisier movement of ants at single time steps. This would effectively produce trails that preserve the same local structure, but are straighter at a larger scale. For a subset of the data we traced individual ant movement over a relatively long time period. From these traces we looked at the correlation between the turning angle of one ant at time and its turning angle at time . This analysis showed a slight positive correlation on a short time scale ( small): an ant turning left at time is likely to also turn left one or two seconds later. These correlations decayed for longer time intervals, but never inverted sign, indicating that there is no “oscillatory” movement around a trail with a fixed periodicity, though the ants might still have an increased probability of turning in the opposite direction after a variable interval of time. However, the set of data for which reliable individual tracking was available over multiple time steps was relatively small and did not allow us to discern whether the autocorrelations in turning angles are due to path integration, or whether they simply reflect correlations with the pheromone map experienced by the ants.

Antennal contacts can also help an ant head toward the nest, or away from it, by sensing whether or not colony mates travelling on the same trail have recently come out of the nest. Another aspect that is not reproduced in our model but is often seen in ant trails is branching. Surprisingly, however, trail branching is not particularly prevalent in arena-level observations. The branching that does occur maybe only be explainable in terms of trails “colliding” instead of an active formation of bifurcations. We can speculate that crowding and ant interactions on the trail are the main factors that determine branching [47]. Once formed, we would expect that Weber's Law response would aid the stability of branches. We can see this by noting that large in equation 8 results in each branch of a trail being nearly equally likely to be chosen even in the presence of small differences between and .

To answer these remaining questions more detailed arena-level observations of trail formation are needed, combined with detailed observations of how the ants interact with each other on the trails. We believe that the computer-automated approach we have used here can be further refined to produce such analyses.

## Methods

### Experiments and data analysis

We used colonies of the Argentine ant *Linepithema humile* (Formicidae, Dolichoderinae) collected on the University Campus in Toulouse, France. In the south of France, Argentine ants are an invasive species that forms a single gigantic colony extending along the Mediterranean coast from Italy to Portugal [48]. Ants were housed in artificial plaster nests and reared in an experimental room at a constant temperature of C under constant light conditions (L:D 12:12) and fed ad libitum with a mixture of eggs, carbohydrates, and vitamins [49] and with *Musca domestica* maggots. Twelve groups containing 1,000 workers each, no queen and no brood were counted about one week prior to the experiments and placed in separate nests 10 cm in diameter, connected to a small foraging arena also 10 cm in diameter. These groups were starved for 24 hours before each experiment to stimulate exploratory behaviour.

Argentine ants leave pheromone both when moving out of the nest in search for food and when going back to the nest in food recruitment [50] as well as during exploration [51]. In the experiment, the ants were left free to explore an initially unmarked circular arena (diameter 1 m). The arena was enclosed by 20 cm high walls covered with Fluon® to prevent ants from escaping. The floor of the arena was covered with a sheet of chlorine free paper, replaced after each trial. The entire setup was surrounded with white homogeneous curtains to eliminate as many orientation cues as possible. No food source was present in the arena at any time. Prior to the beginning of each trial, one colony was put under the arena and given access to it through a plastic tube opening on the arena centre. Each trial began when the first ant enters the arena and lasted for one hour. We conducted 12 such trials in total.

Under these conditions, Argentine ants start exploring the arena homogeneously around the entrance, but soon end up forming trails, some of which are then abandoned after some time and some of which are reinforced (figure 1).

Two sets of data were collected for each trial. Snapshots of the whole arena were collected every 1 s with a digital photo camera (Canon EOS 20D) and stored as 3504×2336 pixels RGB colour images. Image quality was sufficient to clearly see all the ants in the arena. These images were used for all arena-level observations of trail formation. At the same time, a smaller portion of the arena was filmed at 25 FPS and pixel resolution. The videos offered the additional temporal resolution necessary to analyse individual-level behaviour and were used for all quantifications of individual ant movement and response to pheromone. Each trial involved the recording of 3600 snapshots of the whole arena and 90000 video frames.

The positions of all the ants were detected from each frame (and from each camera snapshot) with standard image analysis techniques (see e.g. [52], [53]: subtraction of a reference image, binarization (by thresholding independently the red, green and blue channel to detect pixels that were significantly darker than in the corresponding reference image for all channels), detection and labelling of connected components. Each connected component usually represented a single ant, but in rare cases it could mark two (and very rarely more) ants close together. We could easily detect the number of ants in a component by comparing its size with the typical size of single ants on the image (estimated as the mode of the number of pixels in each connected component detected throughout the experiment).

Pheromone levels cannot be measured directly in our experimental setup. Instead, as a proxy for the concentration of “pheromone” at each particular point in the arena we use the number of passages of ants over that point. Here we used only data from the individual-level film camera. An empty “pheromone map”, corresponding to the field of view of the camcorder was initialized at the beginning of each trial. Then, at each frame, the “pheromone” of all the pixels that were covered by one ant was incremented by a fixed amount , where is chosen in such a way that every ant marked on average the equivalent of one square millimetre of surface with one unit of pheromone every one second. This scaling with is purely arbitrary, but it allows us to compare between different trials. Supplementary video S1 illustrates the outcome of the above process on a sample movie. The pheromone map at time on site is defined as(9)where if patch is covered by (at least) one ant at time and 0 otherwise. We explore two possible scenarios: in the first scenario () the pheromone does not undergo evaporation throughout the duration of the trial. The second scenario is one in which the pheromone evaporates with a half-life time . The choice of these two different scenarios is motivated by previous results by Van Vorhis Key and collaborators. In particular, from the data reported in [31] it appears that the synthetic argentine ant pheromone (Z)-9-hexadecenal is active with a half-life of the order of 30 minutes. However, when gaster extracts obtained directly from ants were used [54] the compound was active for a much longer time, with a half-life of the order of 4 hours. So, 30 min is a lower bound for the half-life time of pheromone evaporation. The results with and without pheromone evaporation are similar; when not specified our figures report results in the condition without evaporation.

In order to characterise the movement of ants we automatically tracked all the ants in the individual level videos over short time periods. This involves about 50,000 tracking events for each experimental trial, for a total of tracking events throughout the whole experiment. Every twenty frames (0.8 seconds) we mark the positions of all the ants in the field of view of the camera (see supplementary video S2), follow them for ten frames, mark their positions again, follow them for ten more frames and mark their final positions. Occasionally, ants moved very little (less than 0.4 cm) in either of the two 10 frames intervals. Given the difficulty of estimating directions of movement and turning angles in these conditions, these data were discarded from all the analyses (except for computing the distribution of ant speeds in figure 3A). This provides us with a simplified description of ant movement in terms of two straight segments and a turning angle. (See supplementary video S2 for a visual representation of these operations).

We looked at the total pheromone within a one centimetre radius of the ant. In particular, we define L to be the total pheromone in a 90 degrees front-left sector relative to the ants position (see figure 4 and supplementary video S2). Similarly, is the total pheromone in a 90 degrees front-right sector. During an exploratory phase of data analysis we investigated multiple sectors with angles of 45 degrees and/or larger radius. The results were robust to such changes.

### Simulation

In order to test the ability of the individual response rules to the pheromone concentration to explain trail formation at a larger scale, we set up an agent-based model of Argentine ant arena exploration using the NetLogo 4.1.1 modelling environment. The NetLogo world consists of square patches each with its own pheromone concentration. We run the simulation both in an open arena setup (diameter = 1000 patches) and in a “binary bridge” setup (total length of the setup 440 patches, all other proportions as in figure 8A, with one nest at one extremity of the bridge and a “food source” at the opposite extremity. Parameters for patch size (one patch = 1 millimetre) and time step (one time step = 0.1 seconds) were chosen so as to provide a convenient scaling with the experiments.

1000 ants are initialized inside the nest at the beginning of the simulation; each ant enters the arena with a probability of 1/1000 per time step. Once in the arena, ants move at a constant speed (2 patches per time step, equal to the average speed of ants measured in the experiment). Their movement is not bound to the dimensions of the patches (ants move off-lattice), while pheromone concentrations are updated at the grain size of the grid, as pheromone is a property of the patches themselves. The ants move at every time step and update their direction of movement every four time steps (equivalent to 0.4 s, the same interval used when analysing the data). The new direction of movement is determined by the concentration of pheromone within two circular sectors oriented 45 degrees to the left and to the right of the ants position. Each sector subtends an angle of 45 degrees, with a radius of 20 patches (2 cm). The angle of direction change is then given by(10)where A is determined by fitting the data and and are random normal variables distributed with mean 0 and standard deviations and , respectively. In our simulations and . Once an ant moves to a new location, it leaves 0.1 units of pheromone at that location before making its next move.

All the simulation parameters are chosen to match as closely as possible the experimental measures on real ant behaviour. We do not have experimental data to characterise the behaviour of ants along the arena border. In the simulation, ants heading against the border align with it, pointing to the direction that involves the minimum change from previous direction. In the binary bridge setup, ants heading against the border align with the border pointing away from the latest visited site (either nest or food source).

Ants that have been out in the arena for a long period can be marked with a special “back-to-nest” label. If such a labelled ant happens to be within two centimetres of the nest, then it will set its heading towards the nest and go directly there. In the open arena simulation, the ants are given a back-to-nest label randomly, with probability of 1 every 10 minutes of simulation time; in the binary bridge setup, the label is given to all the ants that have reached the food source at the distal extremity of the bridge (the dark blue region in figure 8A).

The simulations implement a very simplistic model of ant behaviour: ants respond only to local concentrations of pheromone, with no memory of past position and direction of movement. There are no direct ant-ant interactions. As such their purpose is to test to what degree the observed pheromone trail patterns are explainable simply in terms of their reaction to pheromone concentrations using equation 10.

### Relationship between Weber's law and the Deneubourg model

In the introduction, we stated that equation 2 is similar to equation 1 with . To see this, impose (and ) in equation 1 we obtain(11)Assume that a trail-following ant experiences pheromone concentration to its left and to its right and it moves to the left or to the right with probability , respectively . After following this procedure for time steps the expected position of the ant is equal to(12)which has the same form as equation 2.

In the derivation of equation 8 for the double bridge experiment the question is not about expected position, but rather the probability of ants arriving at either side of a branching point on the bridge. Consider ants which move up a single bridge toward a branching point. We can model the time evolution of the probability density of an individual to be at a particular position as(13)where and are respectively the drift and the diffusion coefficients. In our case the drift is, from equation 12, equal to(14)and we assume it to be constant for the whole duration of the walk in the decision zone between the left and right branches of the bridge. We further assume the diffusion, , to be constant.

The initial condition is a delta function at zero, , so that initially the ant enters the middle of the bridge. The solution of equation 13 subject to this initial condition is(15)The survival probability, that is, the total probability at time of finding the individual in the region from to is(16)We are interested in the probability that the ant ends up to the left of its starting point, i. e. , which, after integrating, is given by(17)where is the error function. Since the time and variance are arbitrary parameters we can without loss of generalization set them both equal to unity and obtain(18)Like equation 1 with , this equation is a sigmoidal function of .

### Bifurcation diagram for ants on a binary bridge

Let and be the densities of ants on each of the two branches and of a binary bridge setup (figure 8A). The evolution equation for the density of ants on each branch of the bridge can be written as(19)(20)The first positive terms in equations 19 and 20 correspond to the traffic on and respectively. Here is the total flux of individuals per unit time and is the probability of taking a particular branch. The negative term corresponds to the spontaneous retirement of ants from each branch. The particular form of chosen here is consistent with equation 18, i.e.(21)The additional parameter captures the threshold level of response found in the experiment (see figure 6).

At the stationary state, putting , and adding equation 19 and 20 we have(22)replacing 22 in 19(23)which can be solved numerically.

Figure 8D gives the bifurcation diagram of against . We see that the figure displays a pitchfork bifurcation, reminiscent of the behaviour of Deneubourg's model on a bridge experiment with two equal paths: the homogeneous state, stable for small values of flow, loses its stability at a critical value where two new inhomogeneous solutions appear. The stability has been checked by integrating equations 19 and 20 numerically.

## Supporting Information

### Video S1.

**Video illustrating how the pheromone maps are inferred from the movement of the ants.** Whenever a portion of the arena is covered by one ant for one frame, the pheromone map at that location is incremented by a constant amount. Notice that the video is made for illustrative purposes: real experiments involved filming a larger portion of the arena from above and from the very beginning of the trial; pheromone quantities were stored with 24 bit precision.

doi:10.1371/journal.pcbi.1002592.s001

(MOV)

### Video S2.

**Video illustrating how the movement of the ants is analysed and correlated to the pheromone maps.** Every twenty frames (0.4 s) each ant present under the field of view of the camcorder is detected and its position marked. The ant is followed over two intervals of 10 frames each and its path is described by two paths of ten frames each and a turning angle . These measures of ant movement are stored together with the whole pheromone map around the ant position in correspondence with the turning angle (more precisely with the map computed 16 seconds before the tracking event). This analysis is repeated every twenty frames for the whole duration of the arena level videos. Only the tracking events for which the ant was clearly detected in all the frames and did not meet any other ant were kept for the analyses.

doi:10.1371/journal.pcbi.1002592.s002

(MOV)

## Author Contributions

Conceived and designed the experiments: AP SG GT VF. Performed the experiments: AP SG ML. Analyzed the data: AP SCN DJTS. Contributed reagents/materials/analysis tools: BG SCN. Wrote the paper: AP DJTS.

## References

- 1.
Hölldobler B, Wilson EO (1990) The ants. Cambridge, Mass: Belknap Press of Harvard University Press.
- 2. Franks NR, Gomez N, Goss S, Deneubourg JL (1991) The blind leading the blind in army ant raid patterns – testing a model of self organization (hymenoptera, formicidae). J Insect Behav 4: 583–607.
- 3. Acosta FJ, López F, Serrano JM (1993) Branching angles of ant trunk trails as an optimization cue. J Theor Biol 160: 297–310.
- 4. Buhl J, Hicks K, Miller E, Persey S, Alinvi O, et al. (2009) Shape and efficiency of wood ant foraging networks. Behav Ecol Sociobiol 63: 451–460.
- 5. Latty T, Ramsch K, Ito K, Nakagaki T, Sumpter DJT, et al. (2011) Structure and formation of ant transportation networks. J R Soc Interface 8: 1298–1306.
- 6. Reid CR, Sumpter DJT, Beekman M (2011) Optimisation in a natural system: Argentine ants solve the towers of hanoi. J Exp Biol 214: 50–58.
- 7. Solé RV, Bonabeau E, Delgado J, Fernández P, Marín J (2000) Pattern formation and optimization in army ant raids. Artif Life 6: 219–226.
- 8. Berthouze L, Lorenzi A (2008) Bifurcation angles in ant foraging networks: A trade-off between exploration and exploitation? J Theor Biol 12: 113–122.
- 9. Deneubourg JL, Goss S, Franks N, Pasteels JM (1989) The blind leading the blind – modeling chemically mediated army ant raid patterns. J Insect Behav 2: 719–725.
- 10. Calenbuhr V, Chretien L, Deneubourg JL, Detrain C (1992) A model of osmotropotactic orientation (i). J Theor Biol 158: 359–393.
- 11. Calenbuhr V, Deneubourg JL, Detrain C (1992) A model of osmotropotactic orientation (ii). J Theor Biol 158: 395–407.
- 12. Watmough J, Edelstein-Keshet L (1995) Modelling the formation of trail networks by foraging ants. J Theor Biol 176: 357–371.
- 13. Edelstein-Keshet L, Watmough J, Ermentrout G (1995) Trail following in ants: individual properties determine population behaviour. Behav Ecol Sociobiol 36: 119–133.
- 14. Helbing D, Keltsch J, Molnár P (1997) Modelling the evolution of human trail systems. Nature 388: 47.
- 15. Helbing D, Schweitzer F, Keltsch J, Molnár P (1997) Active walker moel for the formation of human and animal trail systems. Phys Rev E 56: 2527–2539.
- 16. Schweitzer F, Lao K, Family F (1997) Active random walkers simulate trunk trail formation by ants. Biosystems 41: 153–166.
- 17. Couzin ID, Franks NR (2003) Self-organized lane formation and optimized traffic flow in army ants. Proc Biol Sci 270: 139–146.
- 18. Goss S, Aron S, Deneubourg JL, Pasteels JM (1989) Self-organized shortcuts in the argentine ant. Naturwissenschaften 76: 579–581.
- 19. Beckers R, Deneubourg JL, Goss S (1992) Trail laying behaviour during food recruitment in the ant Lasius niger (l.). Insect Soc 39: 59–72.
- 20. Beckers R, Deneubourg JL, Goss S (1993) Modulation of trail laying in the ant Lasius niger (hymenoptera: Formicidae) and its role in the collective selection of a food source. J Insect Behav 6: 751–759.
- 21. Jeanson R, Ratnieks F, Deneubourg JL (2003) Pheromone trail decay rates on different substrates in the pharaohs ant, Monomorium pharaonis. Physiol Entomol 28: 192–198.
- 22.
Camazine S, Deneubourg JL, Franks NR, Sneyd J, Theraulaz G, et al. (2001) Self-organization in biological systems. Princeton studies in complexity. Princeton, N.J: Princeton University Press.
- 23. Deneubourg JL, Aron S, Goss S, Pasteels JM (1990) The self organizing exploratory pattern of the argentine ant. J Insect Behav 3: 159–168.
- 24. Vittori K, Talbot G, Gautrais J, Fourcassié V, Araujo AFR, et al. (2006) Path efficiency of ant foraging trails in an artificial network. J Theor Biol 239: 507–515.
- 25. Stickland TR (1993) Algorithms for ant foraging. Naturwissenschaften 80: 427–430.
- 26. Cheng K, Srinivasan MV, Zhang SW (1999) Error is proportional to distance measured by honeybees: Weber's law in the odometer. Anim Cogn 2: 11–16.
- 27. Sommer S, Wehner R (2004) The ant's estimation of distance travelled: experiments with desert ants, Cataglyphis fortis. J Comp Physiol A 190: 1–6.
- 28. Shafir S, Menda G, Smith BH (2005) Caste-specific differences in risk sensitivity in honeybees, Apis mellifera. Anim Behav 69: 859–868.
- 29.
Weber EH (1834) De pulsu, resorptione, auditu et tactu. Annotationes anatomicae et physiologicae. Koehler, Leipzig.
- 30. Smith BH, M GW (1994) Nonpheromonal olfactory processing in insects. Annu Rev Entomol 39: 351–375.
- 31. Van Vorhis Key SE, Baker TC (1982) Trail-following responses of the argentine ant, Iridomyrmex humilis (mayr), to a synthetic trail pheromone component and analogs. J Chem Ecol 8: 3–14.
- 32. Van Vorhis Key SE, Baker TC (1982) Trail pheromone-conditioned anemotaxis by the argentine ant, Iridomirmex humilis. Ent Exp & Appl 32: 232–237.
- 33. Suckling D, Peck R, Manning L, Stringer L, Cappadonna J, et al. (2008) Pheromone distruption of argentine ant trail integrity. J Chem Ecol 34: 1602–1609.
- 34. Robinson EJH, Jackson DE, Holcombe M, Ratnieks FLW (2005) ‘no entry’ signal in ant foraging. Nature 438: 442.
- 35. Jackson DE, Martin SJ, Holkombe M, WRFL (2006) Longevity and detection of persistent foraging trails in pharaohs ants, Monomorium pharaonis (l.). Anim Behav 71: 351–359.
- 36. Wilson EO, M P (1959) Glandular sources and specificity of some chemical releasers of social behavior in dolichoderine ants. Psyche 66: 70–76.
- 37. Aron S, Beckers R, Deneubourg JL, Pasteels JM (1993) Memory and chemical communication in the orientation of two mass-recruiting ant species. Insectes Soc 40: 369–380.
- 38. Gerbier G, Garnier S, Rieu C, Theraulaz G, V F (2008) Are ants sensitive to the geometry of tunnel bifurcation? Anim Cogn 11: 637–642.
- 39. Stevens SS (1957) On the psychophysical law. Psychol Rev 64: 153–181.
- 40. Johnson KO, Hsaio SS, Yoshioka T (2002) Neural coding and the basic law of psychophysics. Neuroscientist 8: 111–121.
- 41. Van Hateren JH (1992) A theory of maximizing sensory information. Biol Cybern 68: 23–29.
- 42.
Pasteels M, Deneubourg JL, Verhaeghe JC, Boevé JL, Quinet Y (1986) Mechanisms in insect olfaction,. In: Payne TL, Birch MC, Kennedy CEJ, editors. chapter Orientation along terrestrial trails by ants. pp. 131–138. Oxford University Press, Oxford.
- 43. Sumpter DJT, Krause J, James R, Couzin ID, Ward AJW (2008) Consensus decision making by fish. Curr Biol 18: 1773–1777.
- 44. Amé J, Halloy J, Rivault C, Detrain C, Deneubourg JL (2006) Collegial decision making based on social amplification leads to optimal group formation. Proc Natl Acad Sci U S A 103: 5835–5840.
- 45. Sumpter DJT, Pratt SC (2009) Quorum responses and consensus decision-making. Phill Trans R Soc B 364: 743–753.
- 46. Dussutour A, Deneubourg JL, Fourcassie V (2005) Amplification of individual preferences in a social context: the case of wall-following in ants. Proc R Soc B 272: 705–714.
- 47. Dussutour A, Fourcassie V, Helbing D, Deneubourg JL (2004) Optimal traffic organization in ants under crowded conditions. Nature 428: 70–73.
- 48. Vogel V, Pedersen JS, Giraud T, Krieger MJB, Keller L (2010) The worldwide expansion of the argentine ant. Divers Distrib 16: 170–186.
- 49. Bhatkar A, Whitcomb WH (1970) Artificial diet for rearing various species of ants. Florid Entomol 53: 229–232.
- 50. Van Vorhis Key SE, Baker TC (1986) Observations on the trail deposition and recruitment behaviors of the argentine ant, Iridomyrmex humilis (hymenoptera:formicidae). Ann Ent Soc Am 79: 283–288.
- 51. Aron S, Pasteels JM, Deneubourg JL (1989) Trail-laying behaviour during exploratory recruitment in the argentine ant, Iridomyrmex humilis (mayr). Biol Behav 14: 207–217.
- 52.
Parker JR (1997) Algorithms for Image Processing and Computer Vision. John Wiley & Sons, New York, NY.
- 53.
Gonzalez RC, Woods RE (2002) Digital Image Processing. Prentice Hall, Upper Saddle River, New Jersey.
- 54. Van Vorhis Key SE, Gaston LK, Baker TC (1981) Effect of gaster extract trail concentration on the trail following behaviour of the argentine ant, Iridomyrmex humilis (mayr). J Insect Physiol 6: 363–370.