Computing perfect stationary equilibria in stochastic games

B-Tier
Journal: Economic Theory
Year: 2024
Volume: 78
Issue: 2
Pages: 347-387

Authors (3)

Peixuan Li (not in RePEc) Chuangyin Dang (not in RePEc) P. Jean-Jacques Herings (Universiteit van Tilburg)

Score contribution per author:

0.670 = (α=2.01 / 3 authors) × 1.0x B-tier

α: calibrated so average coauthorship-adjusted count equals average raw count

Abstract

Abstract The notion of stationary equilibrium is one of the most crucial solution concepts in stochastic games. However, a stochastic game can have multiple stationary equilibria, some of which may be unstable or counterintuitive. As a refinement of stationary equilibrium, we extend the concept of perfect equilibrium in strategic games to stochastic games and formulate the notion of perfect stationary equilibrium (PeSE). To further promote its applications, we develop a differentiable homotopy method to compute such an equilibrium. We incorporate vanishing logarithmic barrier terms into the payoff functions, thereby constituting a logarithmic-barrier stochastic game. As a result of this barrier game, we attain a continuously differentiable homotopy system. To reduce the number of variables in the homotopy system, we eliminate the Bellman equations through a replacement of variables and derive an equivalent system. We use the equivalent system to establish the existence of a smooth path, which starts from an arbitrary total mixed strategy profile and ends at a PeSE. Extensive numerical experiments, including relevant applications like dynamic oligopoly models and dynamic legislative voting, further affirm the effectiveness and efficiency of the method.

Technical Details

RePEc Handle
repec:spr:joecth:v:78:y:2024:i:2:d:10.1007_s00199-024-01565-w
Journal Field
Theory
Author Count
3
Added to Database
2026-01-25