Mertens-stable equilibrium

In game theory, Mertens stability is a solution concept used to predict the outcome of a non-cooperative game. A tentative definition of stability was proposed by Elon Kohlberg and Jean-François Mertens^[1] for games with finite numbers of players and strategies. Later, Mertens^[2][3] proposed a stronger definition that was elaborated further by Srihari Govindan and Mertens.^[4] This solution concept is now called Mertens stability, or just stability.

Like other refinements of Nash equilibrium^[5] used in game theory stability selects subsets of the set of Nash equilibria that have desirable properties. Stability invokes stronger criteria than other refinements, and thereby ensures that more desirable properties are satisfied.

Desirable Properties of a Refinement

Refinements have often been motivated by arguments for admissibility, backward induction, and forward induction. In a two-player game, an admissible decision rule for a player is one that does not use any strategy that is weakly dominated by another (see Strategic dominance). Backward induction posits that a player's optimal action in any event anticipates that his and others' subsequent actions are optimal. The refinement called subgame perfect equilibrium implements a weak version of backward induction, and increasingly stronger versions are sequential equilibrium, perfect equilibrium, quasi-perfect equilibrium, and proper equilibrium. Forward induction posits that a player's optimal action in any event presumes the optimality of others' past actions whenever that is consistent with his observations. Forward induction^[6] is satisfied by a sequential equilibrium for which a player's belief at an information set assigns probability only to others' optimal strategies that enable that information to be reached.

Kohlberg and Mertens emphasized further that a solution concept should satisfy the invariance principle that it not depend on which among the many equivalent representations of the strategic situation as an extensive-form game is used. Thus it should depend only on the reduced normal-form game obtained after elimination of pure strategies that are redundant because their payoffs for all players can be replicated by a mixture of other pure strategies. Mertens^[7][8] emphasized also the importance of the small worlds principle that a solution concept should depend only on the ordinal properties of players' preferences, and should not depend on whether the game includes extraneous players whose actions have no effect on the original players' feasible strategies and payoffs.

Kohlberg and Mertens demonstrated via examples that not all of these properties can be obtained from a solution concept that selects single Nash equilibria. Therefore, they proposed that a solution concept should select closed connected subsets of the set of Nash equilibria.^[9]

Properties of Stable Sets

• Admissibility and Perfection: Each equilibrium in a stable set is perfect, and therefore admissible.
• Backward Induction and Forward Induction: A stable set includes a proper equilibrium of the normal form of the game that induces a quasi-perfect and therefore a sequential equilibrium in every extensive-form game with perfect recall that has the same normal form. A subset of a stable set survives iterative elimination of weakly dominated strategies and strategies that are inferior replies at every equilibrium in the set.
• Invariance and Small Worlds: The stable sets of a game are the projections of the stable sets of any larger game in which it is embedded while preserving the original players' feasible strategies and payoffs.^[10]
• Decomposition and Player Splitting. The stable sets of the product of two independent games are the products of their stable sets. Stable sets are not affected by splitting a player into agents such that no path through the game tree includes actions of two agents.

For two-player games with perfect recall and generic payoffs, stability is equivalent to just three of these properties: a stable set uses only undominated strategies, includes a quasi-perfect equilibrium, and is immune to embedding in a larger game.^[11]

Definition of a Stable Set

A stable set is defined mathematically by essentiality of the projection map from a closed connected neighborhood in the graph of the Nash equilibria over the space of perturbed games obtained by perturbing players' strategies toward completely mixed strategies. This definition requires more than every nearby game having a nearby equilibrium. Essentiality requires further that no deformation of the projection maps to the boundary, which ensures that perturbations of the fixed point problem defining Nash equilibria have nearby solutions. This is apparently necessary to obtain all the desirable properties listed above.

Mertens provided several formal definitions depending on the coefficient module used for homology or cohomology.

A formal definition requires some notation. For a given game ${\displaystyle G}$  let ${\displaystyle \Sigma }$  be product of the simplices of the players' of mixed strategies. For each ${\displaystyle 0<\delta \leq 1}$ , let ${\displaystyle P_{\delta }=\{\,\epsilon \tau \mid 0\leq \epsilon \leq \delta ,\tau \in \Sigma \,\}}$  and let ${\displaystyle \partial P_{\delta }}$  be its topological boundary. For ${\displaystyle \eta \in P_{1}}$  let ${\displaystyle {\bar {\eta }}}$  be the minimum probability of any pure strategy. For any ${\displaystyle \eta \in P_{1}}$  define the perturbed game ${\displaystyle G(\eta )}$  as the game where the strategy set of each player ${\displaystyle n}$  is the same as in ${\displaystyle G}$ , but where the payoff from a strategy profile ${\displaystyle \tau }$  is the payoff in ${\displaystyle G}$  from the profile ${\displaystyle \sigma =(1-{\bar {\eta }})\tau +\eta }$ . Say that ${\displaystyle \sigma }$  is a perturbed equilibrium of ${\displaystyle G(\eta )}$  if ${\displaystyle \tau }$  is an equilibrium of ${\displaystyle G(\eta )}$ . Let ${\displaystyle {\mathcal {E}}}$  be the graph of the perturbed equilibrium correspondence over ${\displaystyle P_{1}}$ , viz., the graph ${\displaystyle {\mathcal {E}}}$  is the set of those pairs ${\displaystyle (\eta ,\sigma )\in P_{1}\times \Sigma }$  such that ${\displaystyle \sigma }$  is a perturbed equilibrium of ${\displaystyle G(\eta )}$ . For ${\displaystyle (\eta ,\sigma )\in {\mathcal {E}}}$ , ${\displaystyle \tau (\eta ,\sigma )\equiv (\sigma -\eta )/(1-{\bar {\eta }})}$  is the corresponding equilibrium of ${\displaystyle G(\eta )}$ . Denote by ${\displaystyle p}$  the natural projection map from ${\displaystyle {\mathcal {E}}}$  to ${\displaystyle P_{1}}$ . For ${\displaystyle E\subseteq {\mathcal {E}}}$ , let ${\displaystyle E_{0}=\{\,(0,\sigma )\in E\,\}}$ , and for ${\displaystyle 0<\delta \leq 1}$  let ${\displaystyle (E_{\delta },\partial E_{\delta })=p^{-1}(P_{\delta },\partial P_{\delta })\cap E}$ . Finally, ${\displaystyle {\check {H}}}$  refers to Čech cohomology with integer coefficients.

The following is a version of the most inclusive of Mertens' definitions, called *-stability.

Definition of a *-stable set: ${\displaystyle S\subseteq \Sigma }$  is a *-stable set if for some closed subset ${\displaystyle E}$  of ${\displaystyle {\mathcal {E}}}$  with ${\displaystyle E_{0}=\{\,0\,\}\times S}$  it has the following two properties:

• Connectedness: For every neighborhood ${\displaystyle V}$  of ${\displaystyle E_{0}}$  in ${\displaystyle E}$ , the set ${\displaystyle V\setminus \partial E_{1}}$  has a connected component whose closure is a neighborhood of ${\displaystyle E_{0}}$  in ${\displaystyle E}$ .
• Cohomological Essentiality: ${\displaystyle p^{*}:{\check {H}}^{*}(P_{\delta },\partial P_{\delta })\to {\check {H}}^{*}(E_{\delta },\partial E_{\delta })}$  is nonzero for some ${\displaystyle \delta >0}$ .

If essentiality in cohomology or homology is relaxed to homotopy, then a weaker definition is obtained, which differs chiefly in a weaker form of the decomposition property.^[12]

References

1. Kohlberg, Elon; Mertens, Jean-François (1986). "On the Strategic Stability of Equilibria" (PDF). Econometrica. 54 (5): 1003–1037. CiteSeerX 10.1.1.295.4592. doi:10.2307/1912320. JSTOR 1912320.
2. Mertens, Jean-François (1989). "Stable Equilibria—A Reformulation Part I. Definition and basic properties". Mathematics of Operations Research. 14 (4): 575–625. doi:10.1287/moor.14.4.575. JSTOR 3689732.
3. Mertens, Jean-François (1991). "Stable Equilibria—A Reformulation Part II. Discussion of the definition, and further results". Mathematics of Operations Research. 16 (4): 694–753. doi:10.1287/moor.16.4.694. JSTOR 3689907.
4. Govindan, Srihari; Mertens, Jean-François (2004). "An Equivalent Definition of Stable Equilibria". International Journal of Game Theory. 32 (3): 339–357. doi:10.1007/s001820400165. hdl:10.1007/s001820400165.
5. Govindan, Srihari & Robert Wilson, 2008. "Refinements of Nash Equilibrium," The New Palgrave Dictionary of Economics, 2nd edition. (PDF). Archived from the original (PDF) on 2010-06-20. Retrieved 2012-02-12.{{cite web}}: CS1 maint: archived copy as title (link)
6. Govindan, Srihari; Wilson, Robert (2009). "On Forward Induction". Econometrica. 77 (1): 1–28. doi:10.3982/ECTA6956.
7. Mertens, Jean-François (2003). "Ordinality in Non Cooperative Games". International Journal of Game Theory. 32: 387–430. doi:10.1007/s001820400166.
8. Mertens, Jean-François (1992). "The Small Worlds Axiom for Stable Equilibria". Games and Economic Behavior. 4 (4): 553–564. doi:10.1016/0899-8256(92)90036-R.
9. The requirement that the set is connected excludes the trivial refinement that selects all equilibria. If only a single (possibly unconnected) subset is selected then only the trivial refinement satisfies the conditions invoked by Norde, Henk; Potters, Jos; Reijnierse, Hans; Vermeulen, Dries (1996). "Equilibrium Selection and Consistency". Games and Economic Behavior. 12 (2): 219–225. doi:10.1006/game.1996.0014. hdl:2066/27895.
10. See Appendix D of Govindan & Wilson (2012)
11. Govindan, Srihari; Wilson, Robert (2012). "Axiomatic Theory of Equilibrium Selection for Generic Two-Player Games" (PDF). Econometrica. 80 (4): 1639–1699. doi:10.3982/ECTA9579.
12. Govindan, Srihari; Wilson, Robert (2008). "Metastable Equilibria". Mathematics of Operations Research. 33 (4): 787–820. doi:10.1287/moor.1080.0336.