A striking but unexplained pattern in biology is the promiscuous mating behaviour in socially monogamous species. Although females commonly solicit extra-pair copulations, the adaptive reason has remained elusive. We use evolutionary modelling of breeding ecology to show that females benefit because extra-pair paternity incentivizes males to shift focus from a single brood towards the entire neighbourhood, as they are likely to have offspring there. Male-male cooperation towards public goods and dear enemy effects of reduced territorial aggression evolve from selfish interests, and lead to safer and more productive neighbourhoods. The mechanism provides adaptive explanations for the common empirical observations that females engage in extra-pair copulations, that neighbours dominate as extra-pair sires, and that extra-pair mating correlates with predation mortality and breeding density. The models predict cooperative behaviours at breeding sites where males cooperate more towards public goods than females. Where maternity certainty makes females care for offspring at home, paternity uncertainty and a potential for offspring in several broods make males invest in communal benefits and public goods. The models further predict that benefits of extra-pair mating affect whole nests or neighbourhoods, and that cuckolding males are often cuckolded themselves. Derived from ecological mechanisms, these new perspectives point towards the evolution of sociality in birds, with relevance also for mammals and primates including humans.
Citation: Eliassen S, Jørgensen C (2014) Extra-Pair Mating and Evolution of Cooperative Neighbourhoods. PLoS ONE 9(7): e99878. doi:10.1371/journal.pone.0099878
Editor: Claudia Mettke-Hofmann, Liverpool John Moores University, United Kingdom
Received: May 28, 2013; Accepted: May 20, 2014; Published: July 2, 2014
Copyright: © 2014 Eliassen, Jørgensen. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The study was funded by the Research Council of Norway. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Females of many socially monogamous species mate with extra-pair males while leaving it to their social mate to provide paternal care . Paternity data exist for more than 200 species of birds, and for 90% of them extra-pair paternity is common . The advantage of such extra-pair mating is obvious for males who may sire additional offspring without the cost of care, but why do females actively solicit extra-pair copulations , , ? After all, a main expectation is that the social male will withdraw his parental care if his share of paternity becomes too low  – why would females risk that ? Using evolutionary modelling, we show that females who mate with neighbours incentivize males to cooperate towards public goods. From a male perspective, multiple mating and paternity uncertainty imply that their offspring may be spread across several neighbouring nests; this makes it beneficial to focus on the safety and productivity of the entire neighbourhood rather than monopolizing resources for their own social nest. Since many males share that perspective, it is in their self-interest to cooperate with other males to provide such public goods more efficiently. From a female perspective, the benefits of a cooperative neighbourhood may outweigh the risk of lost care from her social mate. Besides, males maintain incentives to stay around, although their paternal investments may be redirected from care provided at their own nest (such as feeding), towards neighbourhood activities (such as vigilance, predator mobbing, or expulsion of intruders).
Our explanation for extra-pair mating in birds is also a new mechanism for the evolution of cooperation, one which may sustain public goods among unrelated males in large groups. One has to be cautious with semantics as the term “cooperation” has different definitions depending on context. In discussions of mating systems, “cooperation” is often used synonymously with “cooperative breeding” , a particular mating system in which some sexually mature individuals sacrifice all or some of their reproduction and instead help more dominant individuals to succeed reproductively. In this paper we will use “cooperation” in a broader sense to denote costly and voluntary investments that benefit others (beyond own offspring), and we will in particular focus on cases where collective action is more efficient than multiple individuals acting in isolation.
The discipline of cooperation theory has identified several mechanisms whereby cooperation may evolve, including reciprocity where favours are returned , kin selection benefiting relatives , mutualism where there is no net cost to cooperation , and group-level selection where cooperative groups are more productive and replace selfish groups . Reciprocity has received considerable attention  and may be efficient in pairwise interactions . In larger groups, stable cooperation based on reciprocity requires assortative interactions so that cooperative individuals meet more often than by chance , , agents capable of recognizing cooperative individuals , , or sanctioning of cheaters . With many players, cooperative benefits need not arise through pairwise interactions but may result from collective investments in a public good; this logic is formalized in public goods games . Here individuals perform costly cooperative acts that produce a public good of greater value than the sum of individual investments, but which anyone in the group may benefit from, regardless of investment. The conflict between the group, which would perform optimally if everyone invested in cooperation, and the individual, who would be better off by exploiting the public good while letting others pay the cooperative investment, is at the heart of the tragedy of the commons . In some cases kin selection may stabilize public goods , and in humans sanctioning institutions play a critical role . But in many cases cooperators are neither kin nor do sanctioning institutions exist, from which Clutton-Brock  concluded that “cooperation between unrelated individuals remains a problem” and May  even argued that “the most important unanswered question in evolutionary biology, and more generally in the social sciences, is how cooperative behaviour evolved and can be maintained in human or other animal groups and societies.”
Before we detail our mechanism of how extra-pair mating may cause evolution of cooperation it is worthwhile to briefly review the main current explanations for why females in socially monogamous relationships mate multiply. The first class of explanations relate to genetic benefits, often referred to as indirect effects or ‘good genes’. Trivers  argued that because females generally invest more in each offspring than males do, they should be choosy about the mate’s quality while males should prioritize the quantity of mates. The ‘good genes’ hypotheses state that since not all females can be paired with the genetically best male, they seek copulations with extra-pair males of superior genetic makeup to increase offspring fitness , . A variant focuses on compatibility between the paternal and maternal genome , as genetically complementary males may sire heterozygous offspring  with potentially higher fitness e.g. through improved immuno-competence . By selecting partners with the right level of genetic complementarity, females may avoid both out- and inbreeding . Theoretical studies suggest that the potential benefits of genetic effects are most likely small , that heterozygosity of extra-pair offspring may be overestimated , and that beneficial effects to extra-pair half-siblings may be due to maternal effects . Meta-analyses conclude that genetic effects do not provide benefits of the magnitude required to explain its widespread occurrence –. Parker and Birkhead  argued that “given the amount of effort that has been invested (…) and the lack of evidence that females gain indirect benefits, it may be time to consider alternative explanations.”
In contrast to ‘good genes’ effects, females may mate with extra-pair males to obtain direct or ecological benefits, for example to ensure fertilization of their eggs , to obtain nuptial gifts from several mates , , or to recruit increased paternal care at her nest , –. Observations on red-winged blackbirds (Agelaius phoeniceus) suggest an even wider cast of female-extra-pair mating. In some populations, females solicit extra-pair copulations after which a territorial male may allow extra-pair females to forage on his territory; he may also defend her nest against predators but not offer similar benefits to other females , . Females who included feeding areas outside their social mate’s territory increased the mean and reduced variance in foraging rates . In the group-breeding alpine accentor (Prunella collaris) dominant females interrupt copulations of subdominant females and thereby mate with comparatively more males, as a consequence they receive more help and achieve higher offspring survival , . Although such conspicuous exchanges of benefits with extra-pair mates are rare , we argue that many forms of paternal care potentially are overlooked because they involve investments towards public goods away from the nest. By mating with extra-pair males, females may construct a social network centred at her nest, and which provides benefits to her but in a distributed and diffuse manner. This is in line with Lima’s  review of the abundant but poorly explained cooperative behaviours at bird breeding grounds, and may be common in species where offspring are dependent for a prolonged period . Examples of public goods in bird systems include vigilance , alarm calls , calling networks , , and predator mobbing . In other taxa, public goods include defence of burrows , patrolling of joint territories , and sharing of large prey .
In this paper we illustrate how the problems of explaining extra-pair mating and evolution of cooperation are two linked questions with a common solution. One direct consequence of extra-pair mating is that it causes paternity uncertainty, which may reduce the risk of infanticide , . We extend this logic by noting that paternity uncertainty incentivizes a male not only to abstain from inflicting harm on a potentially direct descendant, but also to cooperate and positively create public goods for the whole neighbourhood since his offspring can belong to any of several broods. From a set of models we derive hypotheses that align with observations of abundant  and sex-specific  cooperative behaviours at breeding sites, a positive correlation between productivity of offspring mass and rates of extra-pair paternity , a strong effect of predation mortality , , the dominance of neighbours as successful extra-pair sires , , and aggregation during breeding despite potential for competition and conflict .
Our models focus on socially monogamous birds because there exists a rich literature on extra-pair mating for this taxon , , , . Extra-pair mating is also common among fish , , , also live-bearing ones . The literature on mammals more often refers to multi-male mating, which occurs widely for example in rodents ,  and group-living primates , . The general theoretical insights thus have relevance for other taxa than birds, so we will return to a general treatment of extra-pair mating in the Discussion.
Models and Results
We use evolutionary models to analyse the influence of extra-pair mating on cooperative behaviours. The models consider two or more socially monogamous breeding pairs, and quantify fitness and selection gradients on traits that determine individual reproductive strategies. We assume no ‘good genes’ benefits but focus only on how the ecological effects of care, provisioning, and protection affect expected offspring survival. We present models for two separate ecological mechanisms, each with specific trade-offs. In our first model, there is competition between males over territories that contain resources required for breeding, and the key trade-off for males is between paternal care at the nest and territorial defence. In a second model, males may engage in collective vigilance and anti-predator behaviours, and the key trade-off is between paternal care and investment in cooperative defence. After showing results from each model we extend both models by assuming a trade-off between an individual’s total reproductive investment and survival, which introduces parental conflict and the possibility of males to abandon nests.
Territorial competition over resources
The ecology of territorial breeding.
In many species males defend breeding territories and compete with their neighbours for mates, breeding sites, and food resources , . Territorial defence requires vigilance to detect strangers, displays to signal occupancy, and sometimes fighting to expel intruders. The time and resources needed to sustain these activities are often traded off against other activities such as foraging, resting, or parental care . Territorial behaviours may also increase the risk of mortality, as combats may incur injury or fatality, or when vocalizations and displays attract the attention of predators , .
Territorial behaviours are most conspicuous while borders are fluid and being negotiated . Failing to challenge intruders may lead to territory loss  and delayed trade-offs are likely, for example if early investments into establishing a territory has energetic costs that reduce survival or the ability to provide care later in the season .
The model for resource defence.
Our model focuses on bird mating systems where males monopolize resources within their breeding territory, and where these resources can be exploited by the male and female to provision their young. Males can thus invest in territory defence , as well as in offspring care , which is directed at the nest and includes provisioning and protection of the young. Females lay a fixed number of eggs at a cost and invest in maternal care at the nest. For simplicity we assume linear trade-offs between these activities, so reproductive investment is given as and for males and females, respectively. We start with the assumption that , i.e. that males and females have a fixed total investment in reproduction. The amount of resources a male monopolizes is modelled as a tug-of-war, and thus depends on a focal male’s investment in territory defence and the defence strategy of his neighbour(s), plus competitive pressure from non-resident floaters. In the simplest case we consider two pairs; then the effect of resource defence on offspring survival is
The relative investment in territorial defence hence determines the proportion of resources that the focal male controls and α scales the influence of resources on offspring survival. The effect of care on offspring survival depends on contributions from each parent, i.e. . Our argument is not particularly sensitive to the shape of these functions, but we generally assume diminishing returns or a linear effect of investments, i.e. . Investments in care benefit offspring directly, whereas the value of resource defence by the male depends also on the defence strategies of neighbouring males. The expected number of surviving offspring w is our fitness measure, where with prime denoting the focal male’s strategy (see Supporting Information S1). Note how care at the nest and access to resources need to be balanced to achieve high offspring survival.
Extra-pair paternity and fitness.
Consider first a single breeding season and only two neighbouring nests. With no extra-pair paternity, male fitness is identical to female fitness . Average offspring survival would be maximized if males cooperated and refrained from aggression, and instead invested heavily in care. In effect, this endpoint of the model corresponds to males defending only external borders of a joint resource territory to keep non-territorial floaters at a distance. This cooperative solution is evolutionarily unstable because a territorial male who aggressively attains a larger share of the resources will have higher fitness. Strong territorial defence will therefore spread and dominate in the population (see Fig. 1).
(A) Evolutionarily optimal male investment strategy in territory defence (green area) versus care (orange) as function of EPP. (B) Average fitness as a function of paternal investment. Increasing EPP levels climb the fitness landscape until the ESS (★) at the cooperative solution (white circle) ( = 0; = = 1; other parameters as in Table 1).
Extra-pair paternity may alter this outcome. If each male sires a proportion x of the offspring in the neighbour’s nest, male fitness now depends on offspring production both in his social nest and in the neighbouring nest :
We first assume that males have the same probability of gaining and losing paternity (this assumption is relaxed in the pairwise invasibility plot of Fig. 2); the number of expected offspring is therefore the same but how offspring are distributed across nests has changed. From a male perspective, neighbouring-nest fitness becomes more important when x rises. For a male, monopolized resources benefit his offspring in the home nest, but at the same time this takes resources away from his extra-pair offspring in the neighbouring nest. A female who mates with a neighbour therefore incentivizes this extra-pair male to relax territorial defence so that resources flow to his potential extra-pair offspring in her nest. Now facing a less aggressive neighbour, the female’s social mate would gain more resources if he maintained the same territorial behaviour. Because of the trade-off between territorial defence and care, however, his fitness is optimized by reducing aggression, but only so much that he still secures slightly more resources than before. This has the important consequence that it frees time for care. By parallel reasoning, the neighbouring female will benefit from recruiting an extra-pair mate too, which may reduce territory defence even further (see also Supporting Information S2 for an interpretation of the resource territoriality trade-off in terms of a Prisoner’s Dilemma game).
(A) Pairwise invasibility plot showing relative fitness of a focal female with a different extra-pair paternity (EPP) level than the population mean. For any EPP level along the x-axis, a female with higher EPP than the population mean (above the black diagonal) has higher fitness and can invade and replace the dominant strategy in the population. Arrows show a hypothetical sequence of invasions until the ESS (★) is reached when EPP is 50%. (B) Female extra-pair mating has minor consequences for the neighbouring female, who with these parameters actually benefit too and should therefore not oppose the behaviour. (C) The social mate of the focal female experiences a severe drop in fitness if she increases her level of EPP, and one can expect counterstrategies such as mate guarding to prevent paternity loss in his social nest. (D) As expected, the highest fitness benefit accrues to the neighbouring male, who gets extra offspring that two neighbours will provide the care for. Above sperm, his contribution is to relax territorial defence to allow some resources to flow in the direction of his extra-pair offspring.
Evolutionarily stable strategies and invasion analysis.
For a given extra-pair paternity (EPP) rate we find the best male strategy for care and territorial defence using invasion analysis ,  (see also Supporting Information S1). This approach assumes a population where all individuals follow the same strategy (termed “resident”) and considers the growth rate of a rare strategy (referred to as “mutant” and denoted with prime). By making small changes to the strategy for male investment in care and territorial defence we calculate growth rate of this mutant strategy and iteratively replace it with one that does better, until a strategy that cannot be invaded by any mutant strategy is reached; this is considered to be the best male response to a given EPP level. We then repeat this for many EPP values to show how males should optimally respond to different female mating behaviours.
To test whether extra-pair mating can evolve as a female-driven strategy we compare two nests where one of the females follows a mutant extra-pair mating strategy that results in a marginally higher EPP level than in the resident population; if she experiences a net fitness increase it is assumed that genes for that behaviour can spread and establish themselves in the population. When testing mutant EPP strategies, male extra-pair paternity is not symmetrically distributed among the neighbouring males: the social mate experiences increased levels of cuckoldry whereas neighbours benefit from higher EPP. Using the approach described above we find the male strategy that is the best response (denoted with asterisk) of both the within and extra-pair mate of the female mutant. This implicitly assumes that males use female behaviour or other cues to assess within- and extra-pair paternity , and that they facultatively adjust paternal care at the nest ,  in response to their mate’s mating behaviour (i.e., males respond by evolved phenotypic plasticity). We then calculate the selection gradient on , and through repeated iterations make small changes to the resident female strategy in the direction of a positive gradient. Given the model and assumptions it makes, we define the evolutionarily stable strategy (ESS) as the male and female strategy set where mutants of either sex no longer can invade.
Results from resource territory model: EPP reduces male investment in territorial defence.
Increased levels of EPP select for male strategies with more care and less neighbourhood aggression (a ‘dear enemy’ effect) (Fig. 1A). From a female perspective, reduced territoriality frees time for paternal care, which benefits her offspring. There is thus a positive selection gradient on female extra-pair mating behaviour that leads to higher EPP, provided that males respond to variations in female EPP levels (Fig. 2A). As a result, the mating strategies climb the fitness landscape towards the cooperative solution (Fig. 1B). In the extreme case where the two males have equal proportions of within-pair and extra-pair offspring, each male has the same interest in both broods, resources are equally distributed but defended less aggressively, and the cooperative solution has become the best male response (Fig. 1B).
Despite the benefit of reduced aggression as males gain paternity in several nests, each male has a strong incentive to protect paternity in his own nest (indicated by the strong fitness gradient when moving parallel to the y-axis in Fig. 2C,D). In the model we assume that females fully control the level of EPP, although males that guard their mate may constrain female extra-pair mating behaviour , . This may weaken female incentives for engaging in extra-pair mating, reduce EPP levels, and prevent evolution from reaching the cooperative solution.
The effect of reduced territorial aggression is not restricted to a neighbouring pair but may be extended to an entire neighbourhood (see Supporting Information S1). Male incentives for aggressive defence are, however, stronger in larger neighbourhoods because the reduction of one male’s defence will allow several neighbours to grab a larger territorial share; females therefore need to push EPP higher to attain similar benefits.
Collective vigilance and anti-predator defence
The ecology of collective anti-predator behaviours.
Breeding birds often engage in cooperative predator defence: they take turns being vigilant, collectively mob predators, or elicit alarm calls that warn others of approaching dangers , . A comprehensive study of colonial breeding in bank swallows (Riparia riparia) found multiple costs of group living while the only benefit supported by their data was collective anti-predator defence . Cooperation over shared vigilance  and collective defence ,  is often more efficient than individual investments and frees time for other activities such as foraging and care. Alarm calls may, however, give away the location of the caller and possibly that of its nest , and mobbing may increase risk of injury or death of individuals that participate . Alarm calls and mobbing are thus risky for the individual but beneficial for all group members; an ecological setting similar to public goods games where a common good, shared by a group of individuals, increases with cooperative investments but involves costs to individual cooperators .
The model for collective vigilance and defence.
The general assumptions are similar to those of the resource territory model where males and females allocate their reproductive investment between different activities. Here we let male investment in cooperative behaviours k conflict with provisioning and care for offspring at the nest , so . A male who cooperates in collective defence will therefore increase the public good, but at a cost of reduced care in his own nest. We assume that the public good increases with the sum of cooperative investments from all males in a group, and that all group members benefit regardless of their investment. Group members may also experience aggregation costs such as intensified food competition, elevated conflict levels, and higher susceptibility to parasites and diseases. The net group effect for a group of pairs where all males invest in collective anti-predator defence except for one focal male (denoted by prime) who invests slightly more is hence:where the aggregation cost increases with the number of neighbours and the interference strength . The cooperative benefit increases with the sum of investments in collective defence (Fig. 3), and changes most rapidly when the sum of collective investments is close to .
(A) The relative effect of care on offspring fledging success is the same as for the resource territory model, and is the sum of effects of male and female care. (B) The effect of cooperative predator defence is modelled as a sigmoid function of cumulative investments in the group. The thick green line is the effect if the resident strategy, i.e. the mean level of investment in the group , were to change. The thin black line is the effect of one focal individual in a group of = 8 changing his investment in cooperative defence, assuming that the remaining group members follow the resident strategy with = 0.5. (C) Fitness is the product of the orange and green lines from panels A and B, respectively, and peaks (★) at intermediate values. ( = 0.02; = = 1; other parameters in Table 1).
The evolutionary dilemma is that collective anti-predator defence is more efficient than solitary actions, but each male has incentives to prioritize provisioning and care for offspring in his nest and let others invest in cooperative defence. Again, females can change the evolutionary outcome by extra-pair mating. In a group of n pairs, the focal male who invests slightly more in cooperation than the rest, has fitness:
More cooperation () will increase the public good () and benefit all his offspring, whereas reduced care () only affects the within-pair offspring in his own nest. As the proportion of extra-pair young increases with higher , the male experiences the full benefit of a given cooperative investment, but the cost affects only his social nest and is reduced. As before, the fitness of the mutant strategy is related to that of the resident population and the best male strategy is found where no is larger than the fitness of the resident strategy.
Results from collective vigilance and anti-predator defence model: Extra-pair mating increases cooperative investments.
Extra-pair mating incentivizes males to invest in cooperative behaviours. This happens because the cost in a male’s social nest affects both his genetic offspring and extra-pair young sired by others, whereas his cooperative investment benefits all his offspring independent of location. As the proportion of within-pair offspring in his own nest decreases, the threshold for engaging in cooperation is lowered. The evolutionarily stable male strategy involves higher investments in collective defence and less care directed towards his social nest, which adds up to a benefit to the whole neighbourhood (Fig. 4A). Females benefit from recruiting extra-pair mates because they will cooperatively protect her nest, but this comes at the cost of reduced investment from her social mate as he gains less paternity. Although females receive less help with care, they experience a net fitness benefit because offspring survival increases. As EPP levels increase and trigger higher cooperative investments by males, cooperation can be stable also in groups larger than two pairs and thus become more efficient. Extra-pair mating may thus be a mechanism to extend the social neighbourhood with a positive effect on fitness, as shown by the fitness landscape in the background of Figure 4B where offspring survival peaks at intermediate group sizes and relatively high levels of extra-pair paternity.
Males trade-off paternal care and cooperative predator defence. (A) As EPP increases, males cooperate more because costs of reduced paternal care affect only within-pair young whereas cooperative defence protects all offspring. (group size = 5; = 1.0 of which egg investment = 0.3; see Table 1 for other parameters). (B) Fitness landscape as a function of neighbourhood size and male cooperative investment. With no EPP the evolutionary outcome is solitary breeding with no cooperation (lower left corner). EPP increases along the black line (dots mark each 10%). Short-lived species reach the cooperative solution (white circle) for high EPP levels.
Extending models with trade-offs between current and future reproduction
Males may respond to cuckoldry by decreasing current reproductive investments if alternative reproductive opportunities exist , . We include this possibility by allowing males and females to allocate reproductive investments across several breeding seasons. Reproductive investment in one season may influence future reproductive events, for instance by reducing the probability that a parent will survive to the next breeding season –. This trade-off makes the game between the male and the female more pronounced and there is room for parental conflict with potential consequences for future breeding attempts and longevity. We assume that the risk of mortality increases with higher reproductive investments , from a baseline mortality :where and scale the relative cost of current investments. Male and female reproductive strategies affect their expected longevity, and mortality may also reduce current reproductive output if one of the parents dies during the breeding season. If females invest more in reproduction than males, they have lower survival probability, which affects the operational sex ratio and may intensify male-male competition for mates (see Supporting Information S1).
Results from extended models: Extra-pair paternity declines with expected longevity.
When longevity increases and future breeding becomes more likely, both males and females evolve reduced annual reproductive investment. Females benefit from EPP only as long as reduced aggression over resources increases male investments in care (resource territory model; Fig. 5, Supporting Information S1) or when the benefits of male-produced anti-predator defence outweigh the costs of reduced paternal care (collective vigilance and defence model; Fig. 6). Males who lose paternities in the home nest reduce their reproductive investment more than others; females therefore need to balance the cost of reduced care against the benefits they can achieve through EPP and male-male cooperation. In model for collective vigilance and anti-predator defence, joint protection from neighbours makes it easy for cheating males to opt out of the cooperative defence by reducing current investments or even abandoning the nest. This is an obvious cost for females and EPP levels are consequently predicted to decline and approach zero as longevity increases (Supporting Information S1), which is in line with observations  and general theory , . Note that the model does not assume any carry-over effects of reproductive investments, so any surviving individual has the same probability of being mated, which may have implications for the level and stability of cooperation.
Annual reproductive investment evolves in a trade-off with survival. (A) EPP is common in short-lived species (grey) and drops with increasing life-expectancy (black line, parameters in Table 1). The pattern is robust but the predicted EPP level depends on ecological parameters, e.g., mortality cost of reproduction (green, = 0.05 and = 0.2 for thin and bold line, respectively; blue, = 2 and = 4), and the proportion of adult mortality experienced during breeding (orange, = 0.1 and = 0.5). (B) For short-lived species, the ESS involves high EPP, reduced defence, and elevated care. With increasing longevity, the evolutionary outcome is low or no EPP (black line) and more territorial defence. (C) Fitness landscape for combinations of male care and defence strategies in a short-lived species (longevity 0.5 breeding seasons; = 1.59). Higher EPP results in less territorial defence, but the evolutionarily stable care strategy (★) is below that of the cooperative solution (○).
Fitness landscape as a function of neighbourhood size and male investment in cooperative defence. With no EPP the evolutionary outcome is solitary breeding with no cooperation (as in Fig. 4B). As EPP increases along the coloured lines, the best male strategy (★) approaches the cooperative solution (white circle) in short-lived species (dots mark each 10% increase in EPP). In more long-lived species males prioritize future reproduction and high EPP levels are not beneficial to females; the best male strategies are found further away from the cooperative solution (baseline mortality; is 1.69 (black), 0.83 (green), 0.49 (blue), and 0.30 (red)).
In this paper we have presented a new mechanism for the evolution of cooperation towards public goods. The logic is simple. When a male has all his offspring in a single nest, evolution favours reproductive strategies that focus his attention there: by competing with others to maximize his share of resources; or by cheating on public goods and withdrawing from cooperative investments, thereby causing a tragedy of the commons. Female extra-pair mating has the important role of altering the incentives for males: because males potentially have offspring in several nests, natural selection favours males who cooperate towards the productivity and security of the entire neighbourhood. This may include sharing of resources, reducing aggression, being vigilant, alarming of dangers, and defending the neighbourhood rather than the single nest. Cooperation thus evolves from individual male and female self-interests, making the whole neighbourhood safer and more productive.
Paternity and paternal investment
Effects of paternity uncertainty.
It has been noted that multi-male mating confounds paternity and thus prevents males from committing infanticide of offspring that are potentially theirs . Hrdy  extended this logic in the context of allo-parental care; her focus was how high male mortality in many hunter-gatherer societies makes it unlikely that a paternal care-giver will survive for the whole duration of offspring dependence. Extra-pair mating may then serve a bet-hedging function, as mothers can enlist support from other males in case her partner dies. Stacey  suggested a more direct causation, in that females through extra-pair mating may recruit multiple males to help with care for the female’s offspring. This thinking was central also to the eye-opening studies on the intricate and variable mating systems of the dunnock , . The common logic is that paternity uncertainty may not only prevent something negative but may also produce something positive. Our approach extends this perspective by showing mechanisms through which neighbourhood cooperation among unrelated males may evolve.
Paternal reproductive investment beyond care at the nest.
Studies of paternal care in birds have focused on quantifiable male activities at the nest; these typically include brooding, feeding, and offspring protection , . Behaviours at the nest need not be the only activities a male engages in to maximize the fitness of his offspring. Lima  pointed to many cooperative behaviours at bird breeding grounds that resemble public goods but which have received little attention, including alarm calling  and mobbing , , . These are seldom regarded as parental care investments, but as long as cooperative behaviours benefit potential offspring and are costly to the male in terms of energy, survival, or opportunity, they should be included in the budget of reproductive investment , .
Although paternal contributions away from the nest are central to our models, it is important to note that the cooperative benefit and its consequences for care differ between our two models. In the model for collective vigilance and anti-predator defence, extra-pair mating causes individual males to provide less paternal care at their social nest and instead take part in neighbourhood activities that produce a public good, such as vigilance and mobbing. This is in contrast to the resource territory model, where extra-pair mating causes more paternal care at the nest because paternity spread takes away reasons for aggressive resource monopolization.
Reproductive conflict and the mating game
At breeding grounds, both competition and cooperation with others influence individual pay-offs. The male and female of a mated pair shares a common interest in raising viable offspring, but each may benefit from having the other investing more in care and protection . Among males, the traditional view is that conflict dominates , but a consequence of the mechanisms in our models is that cooperation among unrelated males emerges. This brings with it new and sex-specific lines of conflicts, where males may adjust care investments in response to mating access or paternity , . Mating with multiple males may be a mating strategy by which females trigger help from additional males , and they may hence compete with other females to channel benefits produced by males towards their own nest. Although there is intense competition among males for matings, the game changes once eggs have been fertilized as neighbourhood cooperation may be favoured by individual-level selection.
Female mating tactics.
Our models show that the level of extra-pair mating may evolve as a female-driven strategy, which is corroborated by several empirical observations: females are observed to actively seek extra-pair copulations in many species , , ; forced copulation is not common in birds ; and in one particularly well-studied population of song sparrows (Melospiza melodia) the heritability of male extra-pair success is virtually none  whereas the proportion of extra-pair young in a female’s brood shows significant heritability . These lines of evidence support the view that extra-pair mating is at least partly under female control, but to what degree may vary even among populations of the same species . Females can also control fertilization through post-copulatory selection and sperm competition , including ejection of sperm from previous matings . If females synchronize their fertile period, males experience a stronger conflict between mate guarding and soliciting of extra-pair copulations, which likely makes it easier for females to control their mating activity , .
Male mating tactics.
To evolve as a female-driven strategy, extra-pair mating has to channel more benefits towards a female’s nest than achieved by less promiscuous females. This requires phenotypic plasticity in the male response to the shift of paternity distribution, and therefore that they have some information on which to act. In birds, males can rarely recognize their own offspring , but they may use information about their mate’s behaviour to assess within-pair paternity. When it comes to extra-pair paternities, it is a safe assumption that males have information about their own extra-pair mating activity and can use that to assess the likely distribution of offspring in the neighbourhood. Although our models assume that males have full information, preliminary models in which extra-pair males have more accurate information than social males predict that extra-pair mating may evolve more easily and to higher levels.
The models have for simplicity omitted several important behaviours. For example, males may attempt to pre-empt paternity losses through mate guarding or compete to sire extra-pair offspring . It is in each male’s interest to protect paternity in his own nest, regardless of the cooperative benefit that follows from paternity being spread across different nests (consider the very steep drop in fitness of the social male if his female increases extra-pair mating in Fig. 2C). Whether mate guarding, frequent within-pair copulation, increased advertisement, or extra-pair mating effort evolve depends on how males best can allocate their reproductive investment . Such strategies may bring the realized extra-pair paternity level in the population below that predicted by our models.
Our models only caricature the complex behavioural interactions at bird breeding grounds, but even from this simplified evolutionary game several general patterns emerge. It is worth stressing that the mechanisms we propose do not preclude the simultaneous operation of ‘good genes’ effects, infertility insurance, or other mechanisms that may cause extra-pair mating or cooperation.
Prediction: Extra-pair mating increases fitness of whole nests and neighbourhoods.
A key prediction from ‘good genes’ hypothesis is that extra-pair offspring (EPO) should have higher fitness than their within-pair (WPO) half-siblings. Conclusions from detailed population studies are variable: sometimes there is no difference between WPO and EPO or even a survival cost to EPO , sometimes there is a benefit to some EPO , , and in other cases EPO show more consistent benefits . Meta-analyses that integrate across studies conclude that genetic benefits to EPO are weak or absent in most cases and are unlikely to be the main driver behind the widespread occurrence of extra-pair mating , .
In contrast, it follows from our mechanism that extra-pair mating improves fecundity or survival of whole nests or neighbourhoods. The most striking observation of this is not from birds but from a rodent, the Gunnison’s prairie dog (Cynomys gunnisoni), for which there was a direct relationship between litter size and the number of males the female had copulated with . In this species, groups of multiple males and multiple females share a network of underground burrows, and females forage aboveground, frequently beyond territory borders. This could be consistent with our model for resource territories, although the paper does not report territory location for the extra-pair males. To our knowledge, bird data has only rarely been analysed for whole-nest effects in a similar way. Predator mobbing is common in tree swallows (Tachycineta bicolor), and here older and experienced females had more extra-pair sires , higher hatching success , and larger clutch size . In dark-eyed juncos (Junco hyemalis) extra-pair offspring had higher fitness: sons through extra-pair offspring and daughters through increased fecundity , which is as expected from our theory if female extra-pair mating and male cooperative investment are heritable traits. It would be interesting to see further analyses of whole-nest and neighbourhood effects and to contrast populations of the same species differing in the level of extra-pair paternity.
Prediction: Neighbours dominate as extra-pair sires.
We predict that extra-pair copulations should be predominantly with neighbours who can share resources, be vigilant, or help with nest defence. Where spatial patterns in extra-pair sires have been reported, neighbours dominate , , , , –. In song sparrows territory neighbours sired 95% of the extra-pair young in a spread-out mainland population  and 88% of all EPO in a dense island population . There was a tenfold difference in territory size between these sites, suggesting that being a neighbour may be more important than distance itself, a conclusion also reached for reed buntings (Emberiza schoeniclus) .
The prevalence of local extra-pair sires is not readily explained by genetic benefits, although it has often been hypothesized that frequent encounters make assessment of genetic quality easier or allow more opportunity for copulation . Counterarguments could be i) that extra-pair copulations with distant sires likely would reduce the probability of being detected; and ii) that several studies report higher heterozygosity for EPO with long-distance sires but no such effect for EPO with neighbours , . The latter observation suggests that while compatibility benefits may explain extra-pair mating with non-neighbours, there is a need to look beyond genetic benefits to explain the dominance of local extra-pair sires.
Prediction: Cuckolding males are often cuckolded themselves.
It is expected from our models that recruiting contributions from neighbouring males may enhance fitness of a female’s brood even if she is socially paired with a high-quality male. This aligns with the common observation that males who are successful at gaining extra-pair paternity are no better than the rest at defending paternity in their home nest , , , , which is not easily explained by ‘good genes’ hypotheses.
Prediction: Males show ‘dear enemy’ effects during the breeding season.
Many territorial species are less aggressive towards neighbours than strangers , and such a ‘dear enemy’ effect is a direct outcome of our resource territory model. The model predicts a ‘dear enemy’ effect in the period from fertilization to fledging, while the rest of the time there might be intense competition over mates, fertilizations, and resources. This was found in the skylark (Alauda arvensis), where males showed no ‘dear enemy’ effect during settlement and pair formation early in the breeding season, reduced levels of aggression against neighbours but not strangers in the middle of the breeding season, while aggression towards neighbours increased again later when fledglings became independent . This indicates that the ‘dear enemy’ effect is not linked to familiarity with neighbours per se, but that the presence of offspring, potentially extra-pair, might cause it (20% of offspring in the skylark population were extra-pair ).
There are two additional twists following from our hypothesis. First, the dear enemy effect is predicted mainly in the model where territories combine breeding and resources, which was found also in a literature review . Second, our theory predicts that males should reduce aggression against neighbours more than females would, and in the same review the ‘dear enemy’ effect was shown most often in males, sometimes in both sexes, and only rarely in females only .
Prediction: Extra-pair paternity is correlated with predation risk.
Females may not be equally successful in recruiting a cooperative network under all conditions. Low predation risk might reduce extra-pair mating and male-male cooperation through two routes. Firstly, the expected benefit from male-male protection might be low when there are few predators (model for collective vigilance and defence), which would reduce the incentive for females to engage in extra-pair mating in the first place. Secondly, the expected longevity of males will likely be higher when predation is low, and males may then reduce current reproductive investments and prioritize future breeding attempts if extra-pair paternity levels are high. The prediction of reduced extra-pair paternity at low mortality rates has been documented in literature reviews ,  but is also a prediction from theory that does not consider cooperative benefits .
Individuals might show flexible behaviours or mating strategies in response to perceived predation risk. When exposed to stuffed predators, willingness to engage in mobbing and other cooperative behaviours was increased in pied flycatchers (Ficedula hypoleuca) , , but it remains to be seen whether this may also correlate with extra-pair mating behaviour.
Prediction: Extra-pair paternity is correlated with breeding density.
It follows from our hypothesis that a positive within-species relationship between breeding density and extra-pair mating can be expected, as has been observed for several species , , . Figure 4B shows increasing fitness with increasing group size, indicating that if females can choose where to settle they might prefer dense neighbourhoods. In species where males settle first, this may lead males to choose territories within aggregations because they attain higher mating success. A positive correlation between breeding density and extra-pair mating has been documented within some bird species , , , but not between species , . Such correlations may arise through several mechanisms, for example, extra-pair mating has been viewed as a cost of sociality and not a cause for it, exemplified by the ‘opportunity hypothesis’ where extra-pair mating is more common in dense breeding aggregations because females interact with more potential mates . Related is the ‘hidden lek’ hypothesis , suggesting a female preference for breeding in aggregations because it allows them to better compare male quality. From both these hypotheses one would expect strong mating skew in breeding aggregations, but studies on birds often suggest a more equal partitioning of extra-pair offspring, in line with our hypothesis. No reproductive skew was found in aggregations of least flycatchers (Empidonax minimus) , but direct effects in the form of more alarm calling  or lower predation rates in central nests was found in some studies  although not all . In yellowthroat warblers (Geothlypis trichas) there was lower variance in male reproductive success in dense breeding areas . Interestingly, there was increased production of both within-pair and extra-pair young in dense neighbourhoods . In bank swallows large colonies had positive effects on offspring survival because predator mobbing was more efficient . It would be interesting to see further comparisons of cooperative behaviours and extra-pair mating between high- and low-density breeding sites.
Prediction: Sex-specific division of labour.
As a consequence of extra-pair mating a male’s fitness incentives are spread across the neighbourhood whereas a female still has all her offspring in the nest. The distinction between maternity certainty and paternity uncertainty suggests a new evolutionary basis for sex-specific division of labour, where we predict that males are more likely to cooperate towards public goods than females. It has been noted that mobbing often is performed predominantly by males , , but none of the adaptive reasons for predator mobbing listed by Curio  provide adequate explanations for why there should be sex-specificity. A particularly interesting example of male-male cooperation is the calling network among red-winged blackbird males . Using seven different call types, males continuously echo the background call they hear from other males to signal that all is clear , but change signal if there is danger or disturbance. The new signal is picked up and repeated over the entire neighbourhood, and due to this vigilance network females can forage more efficiently . Song matching, whereby males incorporate elements of neighbours’ songs in their own, is also known from other songbirds  and may serve a similar function. From this perspective it makes evolutionary sense that alarm calls uttered by females more often are directed at her offspring to make them hide or be silent, whereas alarm calls by males more often are broadcast wider .
Prediction: Cooperative behaviours are extra common during breeding.
Lima  reviewed anti-predator behaviours in breeding birds and noted that cooperative behaviours are abundant but that most are diffuse, have received little attention, and are poorly understood. This is puzzling, given that sociality and cooperative behaviours are particularly difficult to explain during breeding as birds often are territorial and compete for mates and resources.
Studies on red-winged blackbirds  and great tits (Parus major) ,  found positive effects of breeding with familiar neighbours, i.e. between individuals who had been neighbours also during a previous breeding season. These studies further suggested that the positive effect may be related to cooperative behaviours in the neighbourhood. In both species, familiar neighbours were more likely to join in predator mobbing , . In great tits, the strongest effects on reproduction occurred when a female had many familiar male neighbours, that is, between the individuals who ‘seal the deal’ over extra-pair mating and cooperative investment also in our model . In addition, there was a small positive effect on nest success (avoidance of nest predation) if also the neighbourhood males were familiar with each other.
Systemic effects and future directions
This paper presents a simple mechanism with far-reaching consequences: where maternity certainty incentivizes each female to focus care towards offspring in her social nest, paternity uncertainty and a potential for offspring in several nests incentivize males to invest in communal benefits and public goods. In this section we evaluate some of the systemic effects of our hypothesis and consequences beyond birds and beyond social monogamy.
Extra-pair mating in the light of kin selection.
Kin selection theory , ,  often considers relatedness between breeders or between breeders and helpers to explain evolutionarily stable levels of cooperation. In this context, extra-pair mating reduces relatedness in family groups and may therefore erode the basis for cooperation , . Our models do not challenge the result that cooperative breeding in kin groups becomes more unstable with extra-group mating. Where we disagree is that this would have effects for cooperation in general, an inference that seems to follow e.g. from Cornwallis et al.  using ‘cooperative breeding’, for which their conclusion is valid, interchangeably with ‘cooperation’, which is a much broader phenomenon.
In our models patterns of relatedness emerge from mating strategies  so that the distribution of kin differs between male and female breeders. Although this alters incentives and pay-offs towards favouring male-male cooperation, the invasion analyses emphasize how male-male interactions are flavoured both by conflict over fertilizing mom’s babies as well as cooperation to benefit dad’s ‘maybes’ wherever in the neighbourhood they might be.
Synergy with other mechanisms for evolution of cooperation.
Cooperation theory has extended the parameter region in which cooperation can be stable by including biologically plausible mechanisms such as individual recognition  or lack thereof , interaction networks , individual variation , assortative interactions , choice of cooperative partner , , social standing , self-regard , and reward or punishment . Our models differ from classic cooperation models by allowing the cooperative investment to be a continuous trait , , by letting pay-offs be gradual and emerge from ecological interactions, and by including several types of players that differ in their characteristics and motivation. This adds ecological realism to cooperation models , but was also essential for understanding that cooperative dynamics may underlie an ecologically well-studied problem such as extra-pair mating.
Although reciprocity, kin selection, and group-level selection are not included in our models, these mechanisms may act in synergy with extra-pair mating and make it easier for cooperation to evolve to the high levels observed in breeding populations. In principle, a small effect of ‘good genes’ or infertility insurance could favour an initially low rate of female extra-pair mating, which could trigger and entrain selection towards cooperative behaviours and higher extra-pair mating. If males can recognize extra-pair offspring or divert attention to nests that more likely contain them, the behavioural interactions become less diffuse and more reciprocal , . If males signal cooperativeness and females base their choice of extra-pair mates on such a signal, then competitive altruism may add momentum to the evolution of cooperation , . Once established, female extra-pair mating and male-male cooperation could spread through group-level selection . It is interesting to note that among birds, relative brain size, which could be relevant for individual recognition of cooperative partners or for manoeuvring the complex behavioural games when extra-pair mating is involved, is correlated with social monogamy but not with genetic monogamy .
Individual differences: A methodological challenge but evolutionarily potent.
Our models do not include individual differences among males or among females, but in the wild individuals differ from each other in age, experience, condition, plumage, parasite load, etc. Obviously, these differences may lead to variation in reproductive success and context- or state-dependent mating strategies.
With no individual variation, the models predict an equal share of paternity among males and an equal share of cooperative benefits to all females and their offspring. With variation in individual characteristics these patterns will likely change, but to predict the direction is not straightforward. Assume that males vary in their resource holding power, then males capable of defending rich territories may obtain a higher share of extra-pair matings than the average male in his neighbourhood, and individual differences may be a source of variation in male reproductive success. In contrast, differences may equalize among females, as females with poor mates or territories may gain access to additional resources and protection through extra-pair mating. There is also increasing awareness of how variation in individual quality may mask trade-offs or relationships between individual performance across traits , as some individuals excel in pretty much everything  or because motivation differs , .
With individual differences, a basis for mate preferences arises. If females actively seek extra-pair mates who invest more heavily in cooperation, this may enhance or stabilize cooperative investments in public goods , . Females not only benefit from cooperative extra-pair males, but also from care-giving social mates, which may cause females to prefer different traits in extra-pair compared to social mates . Finally, there may be conflict between choosing a care-giving social partner and choosing a cooperative neighbourhood for breeding, as cooperative males may settle assortatively to boost the effects of their cooperative investments.
Relevance beyond birds and social monogamy.
To extend the relevance to other taxa there is a need to consider taxon-specific differences in reproductive physiology and the mode of fertilization. In fish, fertilization is most often external, which allows the male to better assess paternity as he can know whether he released gametes in proximity of the spawning female and often whether other males were around too. With higher paternity certainty males can identify conditions when it is safe to invest in care for a single brood, and exclusively paternal care is widespread among fish . One interesting manipulation of paternity spread in fish is found in the cichlid Julidochromis transcriptus. Here females spawn in wedges between rocks and so use the topography of the environment to distribute paternity: large males who provide safety only can fertilize the outer eggs whereas the innermost eggs can only be reached by a much smaller male, who later cares for the brood .
With internal fertilization there is greater paternity uncertainty but it also allows a greater share of the parental investment to be physiologically linked to the female. Internal fertilization in fish is often related to live-bearing and having big offspring with little direct care from males. Female birds produce large eggs while males may share incubation and subsequent feeding and protection until fledging. In mammals the period of exclusively maternal care is further prolonged by lactation, and male provisioning of dependent young is much rarer. Interestingly, the prevalence of multi-male mating for viviparous species is roughly the same when comparing fishes to mammals to reptiles  and to birds .
In birds, the combination of paternity uncertainty and only limited reproductive investment being inextricably linked to female physiology pave the way for social monogamy where males and females may share several of the tasks involved in reproduction. In contrast, investments are often split temporally in fish where females produce eggs while males may provide care, or by task in mammals where males may help with vigilance or defence but not so often with direct offspring provisioning or care , .
The considerations above imply that the core mechanism of paternity uncertainty and male-male cooperation may actually be reversed in fish. In the many species with external fertilization and where males build nests and brood eggs, our theory suggests that when females lay eggs in several nests they gain diffuse maternity incentives across the neighbourhood.
In primates and humans males hunt and share large game and engage in vigilance , warfare, and defence , ; activities that all resemble public goods. In some human societies there are even cultural practices by which extra-pair mating is ritualized following communal work days  or collective hunting , suggesting that extra-pair mating may have influenced evolution of cooperation and sociality in our own species.
The right end-point of Figures 1A and 4A are analogous to group breeding as paternities in each nest are divided evenly among the breeding males. Among primates there are many group-living species with frequent multi-male mating and paternity spread. In these, within-group mating may enable peaceful and productive group dynamics by favouring male cooperative behaviours , . The logic of our mechanism may even be extended to extra-group mating to obtain between-group friendliness , , .
The privileged status of genetic explanations for female choice, suggested by Darwin  and canonized by Trivers , may have led to a historical downplay of ecological benefits as a possible explanation for extra-pair mating. Our suggested mechanism reinstates ecology and direct benefits in this perspective, and links variation in predation risk or breeding habitat to differences in male and female competitive and cooperative behaviours. By redistributing paternity and fitness incentives across a neighbourhood, female-driven extra-pair mating may have been a central step towards evolution of the high levels of cooperation observed in many species. In addition to being a mechanism for the evolution of cooperation, our model suggests that extra-pair mating may also be driving the evolution of breeding aggregations, and together cooperation and aggregation are cornerstones of sociality. The theory presented here may thus provide one missing step towards explaining the highly developed sociality, what is often termed pro-sociality, in many primates and humans .
Supplementary methods. Contains detailed model description, full table of variables and parameters, and supporting figures.
Comparison with Prisoner’s Dilemma. Compares the dynamics of the resource territoriality model with a standard Prisoner’s Dilemma game.
We thank Marc Mangel for comments and advice. Models and presentation also benefitted from comments by Dag L. Aksnes, Katja Enberg, Jarl Giske, Michael Jennions, Michael Taborsky, and Robert Trivers, plus many anonymous reviewers.
Conceived and designed the experiments: SE CJ. Performed the experiments: SE CJ. Analyzed the data: SE CJ. Wrote the paper: SE CJ.
- 1. Griffith SC, Owens IPF, Thuman KA (2002) Extra pair paternity in birds: a review of interspecific variation and adaptive function. Molecular Ecology 11: 2195–2212.
- 2. Davies NB (1992) Dunnock behaviour and social evolution; May RM, Harvey PH, editors. Oxford: Oxford University Press.
- 3. Kempenaers B, Verheyen GR, Van den Broeck M, Burke T, Van Broeckhoven C, et al. (1992) Extra-pair paternity results from female preference for high-quality males in the blue tit. Nature 357: 494–496.
- 4. Sheldon BC (1994) Sperm competition in the chaffinch: the role of the female. Animal Behaviour 47: 163–173.
- 5. Houston AI, Szekely T, McNamara JM (2005) Conflict between parents over care. Trends in Ecology & Evolution 20: 33–38.
- 6. Cornwallis CK, West SA, Davis KE, Griffin AS (2010) Promiscuity and the evolutionary transition to complex societies. Nature 466: 969–972.
- 7. Trivers RL (1971) The evolution of reciprocal altruism. The Quarterly Review of Biology 46: 35–57.
- 8. Hamilton WD (1963) The evolution of altruistic behavior. The American Naturalist 97: 354–356.
- 9. Noë R, Hammerstein P (1994) Biological markets: supply and demand determine the effect of partner choice in cooperation, mutualism and mating. Behavioral Ecology and Sociobiology 35: 1–11.
- 10. Wilson DS, Wilson EO (2007) Rethinking the theoretical foundation of sociobiology. Quarterly Review of Biology 82: 327–348.
- 11. Axelrod R, Hamilton W (1981) The evolution of cooperation. Science 211: 1390–1396.
- 12. Trivers R (2006) Reciprocal altruism: 30 years later. In: Kappeler P, Schaik C, editors. Cooperation in primates and humans. Berlin: Springer. 67–83.
- 13. Ohtsuki H, Hauert C, Lieberman E, Nowak MA (2006) A simple rule for the evolution of cooperation on graphs and social networks. Nature 441: 502–505.
- 14. Rankin DJ, Taborsky M (2009) Assortment and the evolution of generalized reciprocity. Evolution 63: 1913–1922.
- 15. Nowak MA, Sigmund K (1998) Evolution of indirect reciprocity by image scoring. Nature 393: 573–577.
- 16. McNamara JM, Barta Z, Fromhage L, Houston AI (2008) The coevolution of choosiness and cooperation. Nature 451: 189–192.
- 17. Fehr E, Gächter S (2002) Altruistic punishment in humans. Nature 415: 137–140.
- 18. Nowak MA (2006) Five rules for the evolution of cooperation. Science 314: 1560–1563.
- 19. Hardin G (1968) The tragedy of the commons. Science 162: 1243–1248.
- 20. Hamilton WD (1964) The genetical evolution of social behaviour. II. Journal of Theoretical Biology 7: 17–52.
- 21. Ostrom E (1990) Governing the commons: the evolution of institutions for collective action. Cambridge, UK: Cambridge University Press.
- 22. Clutton-Brock T (2009) Cooperation between non-kin in animal societies. Nature 462: 51–57.
- 23. May RM (2006) Address of the President, Lord May of Oxford OM AC FRS, given at the Anniversary Meeting on 30 November 2005: Threats to tomorrow’s world. Notes and Records of the Royal Society 60: 109–130.
- 24. Trivers RL (1972) Parental investment and sexual selection. In: Campbell B, editor. Sexual Selection and the Descent of Man, 1871–1971. Chicago: Aldine-Atherton. 136–179.
- 25. Jennions MD, Petrie M (2000) Why do females mate multiply? A review of the genetic benefits. Biological Reviews 75: 21–64.
- 26. Kempenaers B (2007) Mate choice and genetic quality: A review of the heterozygosity theory. Advances in the Study of Behavior 37: 189–278.
- 27. Suter SM, Keiser M, Feignoux R, Meyer DR (2007) Reed bunting females increase fitness through extra-pair mating with genetically dissimilar males. Proceedings of the Royal Society B: Biological Sciences 274: 2865–2871.
- 28. Johnsen A, Andersen V, Sunding C, Lifjeld JT (2000) Female bluethroats enhance offspring immunocompetence through extra-pair copulations. Nature 406: 296–299.
- 29. Cohas A, Yoccoz NG, Bonenfant C, Goossens B, Genton C, et al. (2008) The genetic similarity between pair members influences the frequency of extrapair paternity in alpine marmots. Animal Behaviour 76: 87–95.
- 30. Kirkpatrick M, Barton NH (1997) The strength of indirect selection on female mating preferences. Proceedings of the National Academy of Sciences 94: 1282–1286.
- 31. Wetzel DP, Westneat DF (2009) Heterozygosity and extra-pair paternity: biased tests result from the use of shared markers. Molecular Ecology 18: 2010–2021.
- 32. Magrath MJL, Vedder O, van der Velde M, Komdeur J (2009) Maternal effects contribute to the superior performance of extra-pair offspring. Current Biology 19: 792–797.
- 33. Arnqvist G, Kirkpatrick M (2005) The evolution of infidelity in socially monogamous passerines: the strength of direct and indirect selection on extrapair copulation behavior in females. The American Naturalist 165: S26–S37.
- 34. Akçay E, Roughgarden J (2007) Extra-pair paternity in birds: review of the genetic benefits. Evolutionary Ecology Research 9: 855–868.
- 35. Slatyer RA, Mautz BS, Backwell PRY, Jennions MD (2012) Estimating genetic benefits of polyandry from experimental studies: a meta-analysis. Biological Reviews 87: 1–33.
- 36. Parker GA, Birkhead TR (2013) Polyandry: the history of a revolution. Philosophical Transactions of the Royal Society B: Biological Sciences 368.
- 37. Sheldon BC (1994) Male phenotype, fertility, and the pursuit of extra-pair copulations by female birds. Proceedings of the Royal Society B: Biological Sciences 257: 25–30.
- 38. Arnqvist G, Nilsson T (2000) The evolution of polyandry: multiple mating and female fitness in insects. Animal Behaviour 60: 145–164.
- 39. Tryjanowski P, Hromada M (2005) Do males of the great grey shrike, Lanius excubitor, trade food for extrapair copulations? Animal Behaviour 69: 529–533.
- 40. Stacey PB (1982) Female promiscuity and male reproductive success in social birds and mammals. The American Naturalist 120: 51–64.
- 41. Davies NB, Hartley IR, Hatchwell BJ, Langmore NE (1996) Female control of copulations to maximize male help: a comparison of polygynandrous alpine accentors, Prunella collaris, and dunnocks, P. modularis. Animal Behaviour 51: 27–47.
- 42. Soltis J, McElreath R (2001) Can females gain extra paternal investment by mating with multiple males? A game theoretic approach. The American Naturalist 158: 519–529.
- 43. Gray EM (1996) Female control of offspring paternity in a western population of red-winged blackbirds (Agelaius phoeniceus). Behavioral Ecology and Sociobiology 38: 267–278.
- 44. Gray EM (1997) Female red-winged blackbirds accrue material benefits from copulating with extra-pair males. Animal Behaviour 53: 625–639.
- 45. Westneat DF, Schofield M, Wright J (2013) Parental behavior exhibits among-individual variance, plasticity, and heterogeneous residual variance. Behavioral Ecology 24: 598–604.
- 46. Nakamura M (1998) Multiple mating and cooperative breeding in polygynandrous alpine accentors. I. Competition among females. Animal Behaviour 55: 259–275.
- 47. Nakamura M (1998) Multiple mating and cooperative breeding in polygynandrous alpine accentors. II. Male mating tactics. Animal Behaviour 55: 277–289.
- 48. Lima SL (2009) Predators and the breeding bird: behavioral and reproductive flexibility under the risk of predation. Biological Reviews 84: 485–513.
- 49. Taborsky M (1994) Sneakers, satellites, and helpers: Parasitic and copperative behaviour in fish reproduction. Advances in the Study of Behavior 23: 1–100.
- 50. Lima SL, Dill LM (1990) Behavioral decisions made under the risk of predation - a review and prospectus. Canadian Journal of Zoology-Revue Canadienne De Zoologie 68: 619–640.
- 51. Maynard Smith J (1965) The evolution of alarm calls. The American Naturalist 99: 59–63.
- 52. Wickler W (1985) Coordination of vigilance in bird groups. The “Watchman’s Song” hypothesis. Zeitschrift für Tierpsychologie 69: 250–253.
- 53. Beletsky LD, Higgins BJ, Orians G (1986) Communication by changing signals: call switching in red-winged blackbirds. Behavioral Ecology and Sociobiology 18: 221–229.
- 54. Curio E (1978) The adaptive significance of avian mobbing. I. Teleonomic hypotheses and predictions. Zeitschrift für Tierpsychologie 48: 175–183.
- 55. Hoogland JL (1981) The evolution of coloniality in white-tailed and black-tailed prairie dogs (Sciuridae: Cynomys leucurus and C. ludovicianus). Ecology 62: 252–272.
- 56. Boesch C (2009) The real chimpanzee - sex strategies in the forest. Cambridge, UK: Cambridge University Press.
- 57. Gurven M, Hill K (2009) Why do men hunt? A reevaluation of “Man the Hunter” and the sexual division of labor. Current Anthropology 50: 51–74.
- 58. Hrdy SB (1979) Infanticide among animals: A review, classification, and examination of the implications for the reproductive strategies of females. Ethology and Sociobiology 1: 13–40.
- 59. Opie C, Atkinson QD, Dunbar RIM, Shultz S (2013) Male infanticide leads to social monogamy in primates. Proceedings of the National Academy of Sciences 110: 13328–13332.
- 60. Curio E (1980) An unknown determinant of a sex-specific altruism. Zeitschrift für Tierpsychologie 53: 139–152.
- 61. Taff CC, Freeman-Gallant CR, Dunn PO, Whittingham LA (2013) Spatial distribution of nests constrains the strength of sexual selection in a warbler. Journal of Evolutionary Biology 26: 1392–1405.
- 62. Arnold KE, Owens IPF (2002) Extra-pair paternity and egg dumping in birds: life history, parental care and the risk of retaliation. Proceedings of the Royal Society of London Series B-Biological Sciences 269: 1263–1269.
- 63. Foerster K, Delhey K, Johnsen A, Lifjeld JT, Kempenaers B (2003) Females increase offspring heterozygosity and fitness through extra-pair matings. Nature 425: 714–717.
- 64. Bouwman KM, Burke T, Komdeur J (2006) How female reed buntings benefit from extra-pair mating behaviour: testing hypotheses through patterns of paternity in sequential broods. Molecular Ecology 15: 2589–2600.
- 65. Stamps JA (1988) Conspecific attraction and aggregation in territorial species. The American Naturalist 131: 329–347.
- 66. Taborsky M (2008) Alternative reproductive tactics in fish. In: Oliveira R, Taborsky M, Brockmann HJ, editors. Alternative reproductive tactics: An integrative approach. Cambridge, UK: Cambridge University Press. 251–299.
- 67. DeWoody JA, Avise JC (2001) Genetic perspectives on the natural history of fish mating systems. Journal of Heredity 92: 167–172.
- 68. Avise JC, Liu J-X (2011) Multiple mating and its relationship to brood size in pregnant fishes versus pregnant mammals and other viviparous vertebrates. Proceedings of the National Academy of Sciences 108: 7091–7095.
- 69. Wolff JO, Macdonald DW (2004) Promiscuous females protect their offspring. Trends in Ecology & Evolution 19: 127–134.
- 70. Solomon NG, Keane B (2008) Reproductive strategies in female rodents. In: Wolff JO, Sherman PW, editors. Rodent societies: an ecological and evolutionary perspective. Chicago, IL: University of Chicago Press. 59–73.
- 71. Shultz S, Opie C, Atkinson QD (2011) Stepwise evolution of stable sociality in primates. Nature 479: 219–222.
- 72. Brown JL (1964) The evolution of diversity in avian territorial systems. The Wilson Bulletin 76: 160–169.
- 73. Schoener TW (1987) Time budgets and territory size: Some simultaneous optimization models for energy maximizers. American Zoologist 27: 259–291.
- 74. Hegner RE, Wingfield JC (1987) Effects of experimental manipulation of testosterone levels on parental investment and breeding success in male house sparrows. The Auk 104: 462–469.
- 75. Arcese P (1987) Age, intrusion pressure and defence against floaters by territorial male song sparrows. Animal Behaviour 35: 773–784.
- 76. Metz JAJ, Nisbet RM, Geritz SAH (1992) How should we define fitness for general ecological scenarios. Trends in Ecology & Evolution 7: 198–202.
- 77. Dieckmann U, Law R (1996) The dynamical theory of coevolution: a derivation from stochastic ecological processes. Journal of Mathematical Biology 34: 579–612.
- 78. Kempenaers B, Sheldon BC (1996) Why do male birds not discriminate between their own and extra-pair offspring? Animal Behaviour 51: 1165–1173.
- 79. Suter SM, Bielanska J, Rothlin-Spillmann S, Strambini L, Meyer DR (2009) The cost of infidelity to female reed buntings. Behavioral Ecology 20: 601–608.
- 80. Møller AP, Birkhead TR (1993) Cuckoldry and sociality: a comparative study of birds. The American Naturalist 142: 118–140.
- 81. Johnsen A, Andersson S, Örnborg J, Lifjeld JT (1998) Ultraviolet plumage ornamentation affects social mate choice and sperm competition in bluethroats (Aves: Luscinia s. svecica): a field experiment. Proceedings of the Royal Society of London Series B: Biological Sciences 265: 1313–1318.
- 82. Hoogland JL, Sherman PW (1976) Advantages and disadvantages of bank swallow (Riparia riparia) coloniality. Ecological Monographs 46: 33–58.
- 83. van Schaik CP, van Noordwijk MA, Warsono B, Sutriono E (1983) Party size and early detection of predators in Sumatran forest primates. Primates 24: 211–221.
- 84. Olendorf R, Getty T, Scribner K (2004) Cooperative nest defence in red-winged blackbirds: reciprocal altruism, kinship or by-product mutualism? Proceedings of the Royal Society of London Series B: Biological Sciences 271: 177–182.
- 85. Williams GC (1966) Natural selection, the costs of reproduction, and a refinement of Lack’s principle. American Naturalist 100: 687–690.
- 86. Lindén M, Møller AP (1989) Cost of reproduction and covariation of life history traits in birds. Trends in Ecology & Evolution 4: 367–371.
- 87. Boonekamp JJ, Salomons M, Bouwhuis S, Dijkstra C, Verhulst S (2014) Reproductive effort accelerates actuarial senescence in wild birds: an experimental study. Ecology Letters 17: 599–605.
- 88. Mauck RA, Marschall EA, Parker PG (1999) Adult survival and imperfect assessment of parentage: effects on male parenting decisions. The American Naturalist 154: 99–109.
- 89. Hrdy SB (2009) Mothers and others: the evolutionary origins of mutual understanding. Cambridge, MA: Belknap Press.
- 90. Møller AP (2000) Male parental care, female reproductive success, and extrapair paternity. Behavioral Ecology 11: 161–168.
- 91. Krams I, Berzins A, Krama T (2009) Group effect in nest defence behaviour of breeding pied flycatchers, Ficedula hypoleuca. Animal Behaviour 77: 513–517.
- 92. Westneat DF, Stewart IRK (2003) Extra-pair paternity in birds: Causes, correlates, and conflict. Annual Review of Ecology Evolution and Systematics 34: 365–396.
- 93. Smuts BB, Smuts RW (1993) Male aggression and sexual coercion of females in nonhuman primates and other mammals: Evidence and theoretical implications. Advances in the Study of Behavior 22: 1–63.
- 94. Reid JM, Arcese P, Sardell RJ, Keller LF (2011) Additive genetic variance, heritability, and inbreeding depression in male extra-pair reproductive success. The American Naturalist 177: 177–187.
- 95. Reid JM, Arcese P, Sardell RJ, Keller LF (2011) Heritability of female extra-pair paternity rate in song sparrows (Melospiza melodia). Proceedings of the Royal Society B: Biological Sciences 278: 1114–1120.
- 96. Yezerinac SM, Gibbs HL, Briskie JV, Whittam R, Montgomerie R (1999) Extrapair paternity in a far northern population of Yellow Warblers Dendroica petechia. Journal of Avian Biology 30: 234–237.
- 97. Stutchbury BJM, Neudorf DL (1998) Female control, breeding synchrony, and the evolution of extra-pair mating systems. Ornithological Monographs 49: 103–121.
- 98. Kokko H (1999) Cuckoldry and the stability of biparental care. Ecology Letters 2: 247–255.
- 99. Sardell RJ, Arcese P, Keller LF, Reid JM (2012) Are there indirect fitness benefits of female extra-pair reproduction? Lifetime reproductive success of within-pair and extra-pair offspring. The American Naturalist 179: 779–793.
- 100. Gerlach NM, McGlothlin JW, Parker PG, Ketterson ED (2012) Promiscuous mating produces offspring with higher lifetime fitness. Proceedings of the Royal Society B: Biological Sciences 279: 860–866.
- 101. Hoogland JL (1998) Why do female Gunnison’s prairie dogs copulate with more than one male? Animal Behaviour 55: 351–359.
- 102. Dunn PO, Lifjeld JT, Whittingham LA (2009) Multiple paternity and offspring quality in tree swallows. Behavioral Ecology and Sociobiology 63: 911–922.
- 103. Whittingham LA, Dunn PO (2010) Fitness benefits of polyandry for experienced females. Molecular Ecology 19: 2328–2335.
- 104. Robertson RJ, Rendell WB (2001) A long-term study of reproductive performance in tree swallows: The influence of age and senescence on output. Journal of Animal Ecology 70: 1014–1031.
- 105. Gibbs HL, Weatherhead PJ, Boag PT, White BN, Tabak LM, et al. (1990) Realized reproductive success of polygynous red-winged blackbirds revealed by DNA markers. Science 250: 1394–1397.
- 106. Yezerinac SM, Weatherhead PJ, Boag PT (1995) Extra-pair paternity and the opportunity for sexual selection in a socially monogamous bird (Dendroica petechia). Behavioral Ecology and Sociobiology 37: 179–188.
- 107. Sardell RJ, Keller LF, Arcese P, Bucher T, Reid JM (2010) Comprehensive paternity assignment: genotype, spatial location and social status in song sparrows, Melospiza melodia. Molecular Ecology 19: 4352–4364.
- 108. Hill CE, Akçay Ç, Campbell SE, Beecher MD (2011) Extrapair paternity, song, and genetic quality in song sparrows. Behavioral Ecology 22: 73–81.
- 109. Mayer C, Pasinelli G (2013) New support for an old hypothesis: density affects extra-pair paternity. Ecology and Evolution 3: 694–705.
- 110. Stapleton M, Kleven O, Lifjeld J, Robertson R (2007) Female tree swallows (Tachycineta bicolor) increase offspring heterozygosity through extrapair mating. Behavioral Ecology and Sociobiology 61: 1725–1733.
- 111. Yezerinac SM, Weatherhead PJ, Boag PT (1996) Cuckoldry and lack of parentage-dependent paternal care in yellow warblers: A cost-benefit approach. Animal Behaviour 52: 821–832.
- 112. Temeles EJ (1994) The role of neighbours in territorial systems: when are they ‘dear enemies’? Animal Behaviour 47: 339–350.
- 113. Briefer E, Rybak F, Aubin T (2008) When to be a dear enemy: flexible acoustic relationships of neighbouring skylarks, Alauda arvensis. Animal Behaviour 76: 1319–1325.
- 114. Wink M, Dyrcz A (1999) Mating systems in birds: a review of molecular studies. Acta Ornithologica 34: 91–109.
- 115. Krams I, Krama T, Igaune K, Mänd R (2008) Experimental evidence of reciprocal altruism in the pied flycatcher. Behavioral Ecology and Sociobiology 62: 599–605.
- 116. Krams I, Bērzin.š A, Krama T, Wheatcroft D, Igaune K, et al. (2010) The increased risk of predation enhances cooperation. Proceedings of the Royal Society B: Biological Sciences 277: 513–518.
- 117. Charmantier A, Perret P (2004) Manipulation of nest-box density affects extra-pair paternity in a population of blue tits (Parus caeruleus). Behavioral Ecology and Sociobiology 56: 360–365.
- 118. García-Navas V, Ferrer ES, Bueno-Enciso J, Barrientos R, Sanz JJ, et al. (2014) Extrapair paternity in Mediterranean blue tits: socioecological factors and the opportunity for sexual selection. Behavioral Ecology 25: 228–238.
- 119. Westneat DF, Sherman PW (1997) Density and extra-pair fertilizations in birds: a comparative analysis. Behavioral Ecology and Sociobiology 41: 205–215.
- 120. Møller AP, Ninni P (1998) Sperm competition and sexual selection: a meta-analysis of paternity studies of birds. Behavioral Ecology and Sociobiology 43: 345–358.
- 121. Wagner RH (1998) Hidden leks: sexual selection and the clustering of avian territories. Ornithological Monographs 49: 123–145.
- 122. Tarof SA, Ratcliffe LM, Kasumovic MM, Boag PT (2005) Are least flycatcher (Empidonax minimus) clusters hidden leks? Behavioral Ecology 16: 207–217.
- 123. Perry EF, Andersen DE (2003) Advantages of clustered nesting for least flycatchers in north-central Minnesota. The Condor 105: 756–770.
- 124. Perry EF, Manolis JC, Andersen DE (2008) Reduced predation at interior nests in clustered all-purpose territories of least flycatchers (Empidonax minimus). The Auk 125: 643–650.
- 125. Tarof SA, Ratcliffe LM (2004) Habitat characteristics and nest predation do not explain clustered breeding in least flycatchers (Empidonax minimus). The Auk 121: 877–893.
- 126. Peek FW (1971) Seasonal change in the breeding behavior of the male red-winged blackbird. The Wilson Bulletin 83: 383–395.
- 127. Krebs JR, Ashcroft R, Orsdol KV (1981) Song matching in the great tit Parus major L. Animal Behaviour. 29: 918–923.
- 128. Searcy WA, Yasukawa K (1995) Polygyny and sexual selection in red-winged blackbirds; Krebs JR, Clutton-Brock T, editors. Princeton, NJ: Princeton University Press.
- 129. Beletsky LD, Orians GH (1989) Familiar neighbors enhance breeding success in birds. Proceedings of the National Academy of Sciences 86: 7933–7936.
- 130. Grabowska-Zhang AM, Sheldon BC, Hinde CA (2012) Long-term familiarity promotes joining in neighbour nest defence. Biology Letters 8: 544–546.
- 131. Grabowska-Zhang AM, Wilkin TA, Sheldon BC (2012) Effects of neighbor familiarity on reproductive success in the great tit (Parus major). Behavioral Ecology 23: 322–333.
- 132. Hamilton WD (1964) The genetical evolution of social behaviour. I. Journal of Theoretical Biology 7: 1–16.
- 133. Gavrilets S (2012) Human origins and the transition from promiscuity to pair-bonding. Proceedings of the National Academy of Sciences 109: 9923–9928.
- 134. Nowak MA, Tarnita CE, Wilson EO (2010) The evolution of eusociality. Nature 466: 1057–1062.
- 135. Pfeiffer T, Rutte C, Killingback T, Taborsky M, Bonhoeffer S (2005) Evolution of cooperation by generalized reciprocity. Proceedings of the Royal Society B: Biological Sciences 272: 1115–1120.
- 136. Nowak MA, Sigmund K (1992) Tit for tat in heterogeneous populations. Nature 355: 250–253.
- 137. Roberts G (1998) Competitive altruism: from reciprocity to the handicap principle. Proceedings of the Royal Society B: Biological Sciences 265: 427–431.
- 138. Jacquet J, Hauert C, Traulsen A, Milinski M (2011) Shame and honour drive cooperation. Biology Letters 7: 899–901.
- 139. Sigmund K, Hauert C, Nowak MA (2001) Reward and punishment. Proceedings of the National Academy of Sciences 98: 10757–10762.
- 140. West RJD (In press) The evolution of large brain size in birds is related to social, not genetic, monogamy. Biological Journal of the Linnean Society.
- 141. Wilson RS, Niehaus AC, David G, Hunter A, Smith M (2014) Does individual quality mask the detection of performance trade-offs? A test using analyses of human physical performance. The Journal of Experimental Biology 217: 545–551.
- 142. Reznick D, Nunney L, Tessier A (2000) Big houses, big cars, superfleas and the costs of reproduction. Trends in Ecology & Evolution 15: 421–425.
- 143. Houston AI, McNamara JM (1999) Models of adaptive behaviour: an approach based on state. Cambridge, UK: Cambridge University Press. 378 p.
- 144. Clark CW, Mangel M (2000) Dynamic state variable models in ecology. New York: Oxford University Press. 289 p.
- 145. Delhey K, Johnsen A, Peters A, Andersson S, Kempenaers B (2003) Paternity analysis reveals opposing selection pressures on crown coloration in the blue tit (Parus caeruleus). Proceedings of the Royal Society of London Series B: Biological Sciences 270: 2057–2063.
- 146. Taborsky M (2001) The evolution of bourgeois, parasitic and cooperative reproductive behaviors in fishes. Journal of Heredity 92: 100–110.
- 147. Kohda M, Heg D, Makino Y, Takeyama T, Shibata J-y, et al. (2009) Living on the wedge: female control of paternity in a cooperatively polyandrous cichlid. Proceedings of the Royal Society B: Biological Sciences 276: 4207–4214.
- 148. Wolff JO, Sherman PW (2007) Rodent societies - an ecological & evolutionary perspective. Chicago, IL.: University of Chicago Press.
- 149. Kaplan H, Hill K (1985) Hunting ability and reproductive success among male ache foragers: Preliminary results. Current Anthropology 26: 131–133.
- 150. Crocker WH, Crocker JG (2004) The Canela: kinship, ritual and sex in an Amazonian tribe; Spindler G, editor. Belmont, Ca: Wadsworth.
- 151. Pollock D (2002) Partible paternity and multiple maternity among the Kulina. In: Beckerman S, Valentine P, editors. Cultures of multiple fathers - the theory and practice of partible paternity in lowland South America. Gainesville, FL: University Press of Florida. 42–61.
- 152. Malinowski B (1929) The sexal life of savages in North Western Melanesia.
- 153. Kowalewski MM, Garber PA (2010) Mating promiscuity and reproductive tactics in female black and gold howler monkeys (Alouatta caraya) inhabiting an island on the Parana River, Argentina. American Journal of Primatology 72: 734–748.
- 154. Darwin C (1871) The descent of man, and selection in relation to sex. London: J. Murray.