It is often assumed that in public goods games, contributors are either strong or weak players and each individual has an equal probability of exhibiting cooperation. It is difficult to explain why the public good is produced by strong individuals in some cooperation systems, and by weak individuals in others. Viewing the asymmetric volunteer's dilemma game as an evolutionary game, we find that whether the strong or the weak players produce the public good depends on the initial condition (i.e., phenotype or initial strategy of individuals). These different evolutionarily stable strategies (ESS) associated with different initial conditions, can be interpreted as the production modes of public goods of different cooperation systems. A further analysis revealed that the strong player adopts a pure strategy but mixed strategies for the weak players to produce the public good, and that the probability of volunteering by weak players decreases with increasing group size or decreasing cost-benefit ratio. Our model shows that the defection probability of a “strong” player is greater than the “weak” players in the model of Diekmann (1993). This contradicts Selten's (1980) model that public goods can only be produced by a strong player, is not an evolutionarily stable strategy, and will therefore disappear over evolutionary time. Our public good model with ESS has thus extended previous interpretations that the public good can only be produced by strong players in an asymmetric game.
Citation: He J-Z, Wang R-W, Li Y-T (2014) Evolutionary Stability in the Asymmetric Volunteer's Dilemma. PLoS ONE 9(8): e103931. https://doi.org/10.1371/journal.pone.0103931
Editor: Zhen Wang, Hong Kong Baptist University, China
Received: May 24, 2014; Accepted: July 4, 2014; Published: August 11, 2014
Copyright: © 2014 He et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The authors confirm that all data underlying the findings are fully available without restriction. All relevant data are within the paper and its Supporting Information file.
Funding: This research was supported by the National Natural Science Foundation of China (31270433, 31170408, 71161020), the Yunnan Natural Science Foundation (2013FD030), National Science Fund for Distinguished Young Scholars (31325005), NSFC- Yunnan United fund (U1302267), the Program for Innovative Research Team (in Science and Technology) in University of Yunnan Province, the West Light Foundation of the Chinese Academy of Sciences, Special Fund for the Excellent Youth of the Chinese Academy of Sciences (KSCX2-EW-Q-9), Scientific Research Foundation for Introduction of Talent of Yunnan University of Finance and Economics (YC2013D05), Special Fund for Chair Professor Lei Shi, Special Fund for Provincial Key Disciplines–Statistics. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
In social groups, voluntary acts play a critical role in the maintenance and evolution of cooperation –. Volunteers provide public goods for the group by contributing services or by punishing cheaters. For example, in meerkats watchful sentinels might warn other individuals of predators by using alarm calls , , or a commercial company might sanction another that is violating the price level agreed upon by the member firms of a cartel . However, potential volunteers face a dilemma in that volunteers produce the public good at a cost to themselves, whereas cheaters exploit the benefits but forego the costs –. The resulting question then arises: which individuals pay the extra cost to voluntarily produce a public good?
The volunteer's dilemma (VD) is an N-person, binary-choice game designed to explain why the participants would be inclined to pay the cost of providing a public good shared by every individual in a social group , –. In this game, each individual faces a binary set of options, including a costly to volunteer and a costless no volunteer choice, and the symmetric Nash equilibrium that involves mixed strategies which imply each individual has equal probability to cooperate , . The conventional form of the VD makes the basic assumption that partners interact symmetrically, with equal payoffs in a game of cooperative interaction . However, almost all of the well-studied inter-specific cooperation systems –, and intra-specific systems –, have shown that cooperative individuals interact asymmetrically. This asymmetric interaction could, for example, be a difference in resource allocation among players, a difference in the probability of winning a fight with others, or any other similar characteristics between dominant and subordinate individuals , . Dominant and subordinate are terms in theoretical models more frequently referred to as “strong” or “weak” players, respectively . This asymmetric interaction leads to different payoffs of the involved players and might therefore influence the choices of action of individuals , , –.
Selten (1980) developed an asymmetry model that assumed that the distribution of the payoff is unequal between players . Using evolutionary game theory with a two-person game, his model showed that the public good would only be produced by the “strong” player. However, these theoretical results were not easily reconciled with experimental observations, because the public good is produced by weak players in some systems . The fact that the two-person game model loses generality might be what raises the difficulty of Selten's (1980) model in explaining why public goods are produced by the “weak” players in some cooperative systems.
Another asymmetric volunteer's dilemma game developed by Diekmann (1993), but with N-persons, introduced an unequal distribution of costs and interests among different players. Using standard game theory, Diekmann's model showed that players might adopt mixed strategies. The mixed strategies of the asymmetric game predicted that the players with lower costs (i.e., “strong” players) will contribute less frequently than players with high costs (i.e., “weak” players), a result contradicting many empirical observations (e.g., Harsanyi-Selten theory, Schelling's “prominence theory”; see , , ).
Clearly, the multiplayer assumption of Diekman's (1993) model is consistent with real cooperative systems, whilst the evolutionary game theory used by Selten (1980) is more universal. A combination of the advantages of both approaches may thus give further insight into the public goods dilemma.
In this paper, we follow Diekmann (1993) in enriching Selten's (1980) model to incorporate some important aspects of asymmetric systems, namely that the model should contain the N-person game, and both symmetric and asymmetric interactions. In our model, Diekmann's paradox disappears. We find the evolutionarily stable strategy (ESS) of the asymmetric volunteer's dilemma, and describe the conditions how the public good is produced by both “strong” and “weak” players in an asymmetric game.
Asymmetric Volunteer's Dilemma Game
Diekmann's (1993) asymmetric volunteer's dilemma game introduced an unequal distribution of costs and interests among players, and analyzed the binary-decision N-Person game with each player i's decision an alternative between (cooperation) and (defection). Assuming that for all i's , the payoff structure is as follows:
- Employing strategy always yields the net payoff of ; whereas
- Employing strategy yields the maximum payoff of whenever at least one other player employs strategy (“volunteering” for other players); otherwise
- If all players employ strategy , they yield a payoff of 0.
Based on this structure, the asymmetric volunteer's dilemma game has N efficient and strict equilibriums with exactly one “volunteer” and N-1 “free-riders”. Moreover, an additional equilibrium point in mixed strategies exists .
In real systems, such as bees, ants or monkeys, there is a single dominant reproductive individual. Therefore we will study a special case of the asymmetric volunteer's dilemma game with one “strong” player and N-1 “weak” players. This implies that the “strong” player will obtain either greater utility or a lower cost than “weak” players . In addition, we assume that N-1 “weak” players have an equal degree of weakness (i.e. N-1 “weak” players possess an equal payoff) and the population of N-1 “weak” players is monomorphic in which all “weak” players use the same strategy . From the assumptions, we have:(2.1)Here / and / are the cost of cooperation and unity of public goods to the “strong/weak” player, respectively.
If we let and be the defection probabilities of the “strong” player and N-1 “weak” co-players respectively, and let , represent the payoff of the cooperation (C) and defection (D) strategies of “strong” players and a similar notation for , for the “weak” players, then:(2.2)Thus, the average payoffs for the “strong” and “weak” players respectively are:(2.3)Equation (2.3) implies the payoffs of both “strong” and N-1 “weak” players depend on the mixed strategies of the “weak” players and these payoff functions are non-linear.
For the mixed strategies, Diekmann's (1993) analytical exploration implies that the defection probability of “strong” and “weak” players will be: and respectively, indicating that the defection probability of “strong” players is greater than for “weak” players. However, this result is contradictory to the concept of Schelling (i.e. prominent solution) that the “strong” player produces the public goods , , . This is also contradictory to empirical observations that queens (“strong” player) police eggs in some species of social insects, while workers (“weak” player) police eggs in other species , , rather than the “strong” and “weak” players all produce public goods with mixed strategies.
Dynamics and Evolutionary Stability of the Asymmetric Volunteer's Dilemma Game
In the asymmetric volunteer's dilemma game, we imagine a multi-population setting for the purpose of extending the static N-player game to an evolutionary game. This means that players in the model described previously (section 2.1), are replaced by populations in this model, as it has been done previously , . We present an evolutionary game that describes how the frequencies of strategies within a population change in time according to the success of different strategists –, and explore which equilibrium will survive over evolutionary time.
Here, we study a special case of the asymmetric volunteer's dilemma game with one “strong” population and N-1 “weak” populations. Each population simultaneously decides whether to “cooperate” or “defect”. In addition, we assume that N-1 “weak” populations have an equal degree of weakness (i.e. N-1 “weak” populations gain equal payoffs). All “weak” populations are monomorphic in which these players adopt the same strategy in the system .
Combining the assumptions of the asymmetric volunteer's dilemma game model with the rule of replicator dynamics—that the per capita rate of growth is given by the difference between the payoff for the strategy type and the average payoff in the population , – - we can establish the replicator dynamics of the asymmetric volunteer's dilemma game as follows:(2.4a)where and are the defection probabilities of the “strong” population/player and the “weak” populations/players respectively, and / and / are respectively the payoff of the defection and the average payoffs of “strong/weak” populations/players, which are the same as described previously in section 2.1.
From the equations (2.5), we can obtain six equilibrium points of the system (2.4) (see Appendix) and denote them as: , , , , , , where elements of vector are respectively the frequencies of defection of “strong” and “weak” populations/players and, , .
It is noteworthy that the equilibrium point corresponds to the mixed strategy equilibrium of Diekmann's (1993) model, and that , and correspond to the pure strategy profiles of the replicator dynamics of the asymmetric volunteer's dilemma game (2.4). The equilibrium point means all populations/players adopt the “free-rider” strategy. At the equilibrium point , the “weak” population/player will adopt the “free-rider” strategy, but at the equilibrium point , “strong” populations/players will adopt the “free-rider” strategy, while the opponents adopt “volunteer” at these two equilibriums points. The equilibrium point predicts that “weak” populations/players produce the public good while the “strong” population/player adopts the “free-rider” strategy. This equilibrium does not appear in Diekmann's (1993) results.
Clearly, the replicator dynamics of the asymmetric volunteer's dilemma game (2.4) is a nonlinear system, and we could therefore study the local asymptotic stability of equilibrium points by linearization. Therefore, the linearization of the replicator dynamics (2.4) at an equilibrium point is(2.6)Where (here is the transpose of vector ), and represents the equilibrium point, where and are respectively the frequencies of defection of “strong” and “weak” populations/players.
By analyzing the property of the matrices' eigenvalues, produced by the linearization of the replicator dynamics at these six equilibrium points (see Appendix S1, Figure 1 and Figure 2), we find that and are sinks (stable), and are sources (unstable), while and are saddles (unstable) , . It is also noteworthy that the stability of equilibrium point depends on the special condition, that is, the equilibrium point is only stable if and only if the cost-benefit ratio of the “strong/weak” player and the group size satisfy inequality (see Figure 3 and Appendix S1). Furthermore, the rest point exists in the interior of the unit square if and only if this same inequality holds and the group size N is not too large (i.e. ). Thus, the replicator dynamics of the game are illustrated in two evolutionary stability points and (Figure 1).
Sink points and are the stable equilibrium solutions (red diamonds), and source points B, D (green circles) and saddle points C, F (purple red stars) are unstable equilibrium solutions. The parameters are fixed at and .
The parameters are fixed at and .
The initial values are , and in (a), (b) and (c) respectively, where and are the initial values of the defection probability of the “strong” player and the “weak” co-players respectively. The cost in (a) and (b) while in (c). The other parameters are fixed at and .
These two stable points and are local stability (see Appendix S1), which each have their own basins of attraction. Obtaining the basins of attraction of local stable equilibrium points has proven extremely useful for analyzing the behaviors of individuals, but they are difficult to obtain in nonlinear systems –. Using numerical simulations, we are able to obtain the properties of the basins of attraction in the replicator dynamics of the asymmetric volunteer's dilemma game. The “shadow region” and “blank region” (here, the boundary between shadow and blank regions go through the point F) are the basins of attraction of equilibrium points and (Figure 2); in effect, the solution trajectories will converge to the point if the initial values of the system fall in the “shadow region,” while they converge to the point if the initial values of the system fall in the “blank region” (see Figures 2 and Figures 3).
Results and Discussion
In the symmetric equilibrium of the volunteers' dilemma with symmetric costs, each player has an equal probability of cooperation , . However, in real social dilemmas, costs may be asymmetric, and the payoffs might therefore be unequal , , , . The model we have developed is the volunteers' dilemma with one “strong” population/player and N-1 “weak” populations/players. Using evolutionarily game theory, our results show that the mixed strategy used by Diekmann (1993) is not evolutionary stable, that is, the paradox that the defection probability of the “strong” population/player is greater than the “weak” populations/players disappears in our evolutionary analysis. Similar to our demonstration here, Selten (1980) previously demonstrated that a mixed strategy will never achieve an evolutionarily stable strategy in asymmetric games , , . Furthermore, the model we present here shows that two evolutionarily stable strategies might exists in an asymmetric cooperation system, and whether the “strong” population/player or “weak” populations/players produce the public good will depend on the initial condition of the system (Figures 2 and Figures 3).
From the analysis presented in section 2.2, the “strong” population/player will produce the public good if the initial condition of the systems fall in the basin of attraction of local stable equilibrium points (the “shadow region” in Figure 2), and it yields a pareto-efficient equilibrium. Conversely, if the initial conditions of the system fall in the basin of attraction of local stable equilibrium points (the “blank region” in Figure 2), the public good is produced by the “weak” populations/players. These simulations also show that the evolutionary stability of this system is sensitive to the initial conditions (Figure 3a,b).
In our model, the public goods of the asymmetric system is produced by the “strong” population/player under some initial conditions, and this result is similar to previous models , . Moreover, the model we developed also predicts that “weak” populations/players might also produce the public good under other initial conditions. The different initial conditions correspond with the initial states of individual strategies in our model, while the initial states of individual strategies could be defined as the phenotype or initial strategy of the individuals . The phenotype or initial strategy of individuals might be inherited from parents , . For instance, the social rank of the offspring of the spotted hyena depends on the rank of their mothers –. The phenotype or initial strategy of individuals (i.e., initial state of individual strategy) might also greatly be affected by the juvenile environment, not just determined by genetics (i.e., inheritance from its parents) . Synthesizing the above-mentioned analysis, varying initial states might stem from the differences of both inheritance and habitat.
It is necessary to point out that the ESS is a boundary strategy equilibrium, which implies that the “strong” population/player always defects and the N-1 “weak” populations/players defect with a probability . When the “weak” populations/players produce the public good, we see that the cooperation probability of “weak” populations/players decreases with increasing group size () or decreasing cost-benefit ratio (), since the probability of volunteering for “weak” populations/players is . In the ESS , the probability of the production of the public good is , whose limit value is lower than the probability of the production of the public good (1) by the “strong” population/player in the ESS .
We thank Marco Archetti, Christopher X. J. Jensen, Derek W. Dunn, Bo Wang, Li-Li Li, Ya-Qiang Wang, Chao-Qian Li, Qi-Long Liu and Lei Gao for their discussion and comments during the preparation and revision of this manuscript, and anonymous reviewers for perceptive comments and suggestion that improved the manuscript.
Conceived and designed the experiments: JZH RWW YTL. Performed the experiments: JZH YTL. Analyzed the data: JZH RWW. Contributed reagents/materials/analysis tools: YTL JZH. Contributed to the writing of the manuscript: JZH RWW YTL.
- 1. Hauert C, Szabo G (2003) Prisoner's dilemma and public goods games in different geometries: compulsory versus voluntary interactions. Complexity 8: 31–38.
- 2. Hauert C, Holmes M, Doebeli M (2006) Evolutionary games and population dynamics: maintenance of cooperation in public goods games. Proceedings of the Royal Society B-Biological Sciences 273: 2565–2570.
- 3. Archetti M (2009) Cooperation as a volunteer's dilemma and the strategy of conflict in public goods games. Journal of Evolutionary Biology 22: 2192–2200.
- 4. Archetti M, Scheuring I (2010) Coexistence of cooperation and defection in public goods games. Evolution 65: 1140–1148.
- 5. Xu ZJ, Wang Z, Zhang LZ (2010) Bounded rationality in volunteering public goods games. Journal of Theoretical Biology 264: 19–23.
- 6. Clutton-Brock TH (1999) Selfish sentinels in cooperative mammals. Science 284: 1640–1644.
- 7. Archetti M (2010) A strategy to increase cooperation in the volunteer's dilemma: reducing vigilance improves alarm calls. Evolution 65: 885–892.
- 8. Diekmann A (1993) Cooperation in an asymmetric volunteer's dilemma game theory and experimental evidence. International Journal of Game Theory 22: 75–85.
- 9. Hardin G (1968) The tragedy of the commons. Science 162: 1243–1248.
- 10. Axelrod R (1984) The Evolution of Cooperation. Basic Books, New York.
- 11. Frank SA (1998) Foundations of Social Evolution. Princeton University Press, Cambridge.
- 12. Rankin DJ, Bargum K, Kokko H (2007) The tragedy of the commons in evolutionary biology. Trends in Ecology & Evolution 22: 643–651.
- 13. Crowley PH, Baik KH (2010) Variable valuations and voluntarism under group selection: an evolutionary public goods game. Journal of Theoretical Biology 265: 238–244.
- 14. Szolnoki A, Perc M, Szabó G (2009) Topology-independent impact of noise on cooperation in spatial public goods games. Physical Review E 80: 056104.
- 15. Diekmann A (1985) Volunteer's dilemma. Journal of Conflict Resolution 29: 605–610.
- 16. Weesie J, Franzen A (1998) Cost sharing in a volunteer's dilemma. Journal of Conflict Resolution 42: 600–618.
- 17. Archetti M (2009) The volunteer's dilemma and the optimal size of a social group. Journal of Theoretical Biology 261: 475–480.
- 18. He JZ, Wang RW, Christopher XJJ, Li YT, Li CQ (2012) Cooperation in an asymmetric volunteer's dilemma game with relatedness. Chinese Science Bulletin 57: 1972–1981.
- 19. Otsubo H, Rapoport A (2008) Dynamic volunteer's dilemmas over a finite horizon–an experimental study. Journal Conflict Resolution 52: 961–984.
- 20. Pellmyr O, Huth CJ (1994) Evolutionary stability of mutualism between yuccas and yucca moths. Nature 372: 257–260.
- 21. Pellmyr O, Leebens-Mack J (2000) Reversal of mutualism as a mechanism for adaptive radiation in Yucca Moths. The American Naturalist 156: S62–S76.
- 22. Wang RW, Ridley J, Sun BF, Zheng Q, Shi L, et al. (2009) stabilize a fig-wasp mutualism. PLoS ONE 4: e7802.
- 23. Wang RW, Sun BF, Zheng Q (2010) Diffusive coevolution and mutualism maintenance mechanisms in a fig-fig wasp system. Ecology 91: 1308–1316.
- 24. Wang RW, Sun BF, Zheng Q, Shi L, Zhu LX (2011) Asymmetric interaction and indeterminate fitness correlation between cooperative partners in the fig -fig wasp mutualism. Journal of the Royal Society Interface 8: 1487–1496.
- 25. Wang RW, Derek W Dunn, Sun Bao Fa (2014) Discriminative host sanctions in a fig–wasp mutualism. Ecology 95: 1384–1393.
- 26. Reeve HK (1992) Queen activation of lazy workers in colonies of the eusocial naked mole-rat. Nature 358: 147–149.
- 27. Singh M, Krishna BA, Singh M (2006) Dominance hierarchy and social grooming in female lion-tailed macaques (Macaca silenus) in the Western Ghats, India. Journal of Biosciences 31: 369–377.
- 28. Wenseleers T, Ratnieks FLW (2006) Comparative analysis of worker reproduction and policing in eusocial hymenoptera supports relatedness theory. The American Naturalist 168: E163–E179.
- 29. Ratnieks FLW, Wenseleers T (2008) Altruism in insect societies and beyond: voluntary or enforced? Trends in Ecology & Evolution 23: 45–52.
- 30. Maynard Smith J (1982) Evolution and the Theory of Game. Cambridge University Press, Cambridge.
- 31. Wang RW, He JZ, Wang YQ, Shi L, Li YT (2010) Asymmetric interaction will facilitate the evolution of cooperation. Science China-Life Sciences 53: 1041–1046.
- 32. Grafen A (1987) The logic of divisively asymmetric contests: respect for ownership and the desperado effect. Animal Behaviour 35: 462–467.
- 33. Gaunersdorfer A, Hofbauer J, Sigmund K (1991) On the dynamics of asymmetric games. Theoretical Population Biology 39: 345–357.
- 34. Samuelson L, Zhang JB (1992) Evolutionary stability in asymmetric game. Journal of economic theory 57: 363–391.
- 35. Binmore K, Samuelson L (2001) Can mixed strategies be stable in asymmetric games? Journal of Theoretical Biology 210: 1–14.
- 36. Nikiforakis N, Normann HT, Wallace B (2010) Asymmetric enforcement of cooperation in a social dilemma. Southern Economic Association 76: 638–659.
- 37. Selten R (1980) A note on evolutionary stable strategies in asymmetric animal conflicts. Journal of Theoretical Biology 84: 93–101.
- 38. Schelling TC (1960) The Strategy of Conflict. Harvard University Press, Cambridge, Mass.
- 39. Doebeli M, Hauert C, Killingback T (2004) The evolutionary origin of cooperators and defectors. Science 306: 859–862.
- 40. Wittman D (1985) Counter-intuitive results in game theory. European Journal of Political Economy 1: 77–85.
- 41. Hofbauer J, Sigmund K (1998) Evolutionary Games and Population Dynamics. Cambridge University Press, Cambridge.
- 42. Hofbauer J, Sigmund K (2003) Evolutionary game dynamics. Bulletin of the American Mathematical Society 40: 479–519.
- 43. Wang Z, Szolnoki A, Perc M (2013) Interdependent network reciprocity in evolutionary games. Scientific Reports 3: 1183.
- 44. Perc M, Gómez-Gardeñes J, Szolnoki A, Floría LM, Moreno Y (2013) Evolutionary dynamics of group interactions on structured populations: a review. Journal of the Royal Society Interface 10: 20120997.
- 45. Taylor PD, Jonker LB (1978) Evolutionarily stable strategies and game dynamics. Mathematical biosciences 40: 145–156.
- 46. Hauert C, Monre SD, Hofbauer J, Sigmund K (2002) Replicator dynamics for optional public good games. Journal of Theoretical Biology 218: 187–194.
- 47. Szolnoki A, Perc M, Szabó G (2009) Phase diagrams for three-strategy evolutionary prisoner's dilemma games on regular graphs. Physical Review E 80: 056104.
- 48. Hirsch MW, Smale S, Devaney RL (2004) Differential Equations, Dynamical Systems, and an Introduction to Chaos. California Academic Press, California.
- 49. Menck PJ, Heitzig J, Marwan N, Kerths J (2013) How basin stability complements the linear-stability paradigm. Nature Physics 9: 89–92.
- 50. Szolnoki A, Perc M (2013) Correlation of Positive and Negative Reciprocity Fails to Confer an Evolutionary Advantage: Phase Transitions to Elementary Strategies. Physical Review X 3: 041021.
- 51. He JZ, Zhao Y, Cai HJ, Wang RW (2013) Spatial games and the maintenance of cooperation in an asymmetric Hawk-Dove game. Chinese Science Bulletin 58: 2248–2254.
- 52. Harsanyi JC, Selten R (1988) A general theory of equilibrium selection in game. MA: MIT Press, Cambridge.
- 53. Weibull JW (1996) Evolutionary game theory. MA: MIT Press, Cambridge.
- 54. Maynard Smith J, Price GR (1973) The logic of animal conflict. Nature 246: 15–18.
- 55. Kruuk H (1972) The Spotted Hyena: a Study of Predation and Social Behavior. University of Chicago Press, Chicago.
- 56. Holekamp KE, Smale L (1991) Dominance acquisition during mammalian social development: the ‘inheritance’ of maternal rank. American Zoologist 31: 306–317.
- 57. Engh AL, Esch K, Smale L, Holekamp KE (2000) Mechanisms of maternal rank ‘inheritance’ in the spotted hyaena, Crocuta crocuta. Animal Behaviour 60: 323–332.
- 58. Van Horn RC, Engh AL, Scribner KT, Funk SM, Holekamp KE (2004) Behavioural structuring of relatedness in the spotted hyena (Crocuta crocuta) suggests direct fitness benefits of clan-level cooperation. Molecular Ecology 13: 449–458.
- 59. Frankino WA, Pfenning DW (2001) Condition-dependent expression of trophic polyphenism: effects of individual size and competitive ability. Evolutionary Ecology Research 3: 939–951.