Repeated game
Repeated game
In game-theory, a repeated game (or iterated game) is an extensive-form-game that consists of a number of repetitions of some base game (called a stage game). The stage game is usually one of the well-studied 2-person games. Repeated games capture the idea that a player will have to take into account the impact of their current action on the future actions of other players; this impact is sometimes called their reputation. Single stage game or single shot game are names for non-repeated games.
Example
Consider two gas stations that are adjacent to one another. They compete by publicly posting pricing, and have the same and constant marginal cost c (the wholesale price of gasoline). Assume that when they both charge , their joint profit is maximized, resulting in a high profit for everyone.
Despite the fact that this is the best outcome for them, they are motivated to deviate. By modestly lowering the price, either can steal all of their competitors' customers, nearly doubling their revenues. , where their profit is zero, is the only price without this profit deviation. In other words, in the pricing competition game, the only nash-equilibrium is inefficient (for gas stations) that both charge .
This is more of a rule than an exception: in a staged game, the Nash equilibrium is the only result that an agent can consistently acquire in an interaction, and it is usually inefficient for them. This is because the agents are just concerned with their own personal interests, and do not care about the benefits or costs that their actions bring to competitors. On the other hand, gas stations make a profit even if there is another gas station adjacent. One of the most crucial reasons is that their interaction is not one-off. This condition is portrayed by repeated games, in which two gas stations compete for pricing (stage games) across an indefinite time range t = 0, 1, 2,....
Finitely vs infinitely repeated games Repeated games may be broadly divided into two classes, finite and infinite, depending on how long the game is being played for.
- Finite games are those in which both players know that the game is being played a specific (and finite) number of rounds, and that the game ends for certain after that many rounds have been played. In general, finite games can be solved by backwards induction.
- Infinite games are those in which the game is being played an infinite number of times. A game with an infinite number of rounds is also equivalent (in terms of strategies to play) to a game in which the players in the game do not know for how many rounds the game is being played. Infinite games (or games that are being repeated an unknown number of times) cannot be solved by backwards induction as there is no "last round" to start the backwards induction from.
Even if the game being played in each round is identical, repeating that game a finite or an infinite number of times can, in general, lead to very different outcomes (equilibria), as well as very different optimal strategies.
Infinitely repeated games The most widely studied repeated games are games that are repeated an infinite number of times. In iterated prisoner's dilemma games, it is found that the preferred strategy is not to play a Nash strategy of the stage game, but to cooperate and play a socially optimum strategy. An essential part of strategies in infinitely repeated game is punishing players who deviate from this cooperative strategy. The punishment may be playing a strategy which leads to reduced payoff to both players for the rest of the game (called a trigger-strategy). A player may normally choose to act selfishly to increase their own reward rather than play the socially optimum strategy. However, if it is known that the other player is following a trigger strategy, then the player expects to receive reduced payoffs in the future if they deviate at this stage. An effective trigger strategy ensures that cooperating has more utility to the player than acting selfishly now and facing the other player's punishment in the future.
There are many results in theorems which deal with how to achieve and maintain a socially optimal equilibrium in repeated games. These results are collectively called *"Folk Theorems"*. An important feature of a repeated game is the way in which a player's preferences may be modelled. There are many different ways in which a preference relation may be modelled in an infinitely repeated game, but two key ones are : [[folk-theorem-(game-theory)|Limit of means]] - If the game results in a path of outcomes <math>x_t</math> and player i has the basic-game utility function <math>u_i</math>, player is utility is: :<math>U_i = \lim_{T\to \infty} \inf \frac{1}{T} \sum_{t=0}^{T} u_i(x_t)</math> *[[folk-theorem-(game-theory)|Discounting]] - If player i's valuation of the game diminishes with time depending on a discount factor <math>\delta<1</math>, then player *is utility is: :<math>U_i = \sum_{t \geq 0} \delta^t u_i(x_t)</math> For sufficiently patient players (e.g. those with high enough values of <math>\delta</math>), it can be proved that every strategy that has a payoff greater than the minmax payoff can be a nash-equilibrium - a very large set of strategies.
Finitely repeated games Repeated games allow for the study of the interaction between immediate gains and long-term incentives. A finitely repeated game is a game in which the same one-shot stage game is played repeatedly over a number of discrete time periods, or rounds. Each time period is indexed by 0 < t ≤ T where T is the total number of periods. A player's final payoff is the sum of their payoffs from each round.
For those repeated games with a fixed and known number of time periods, if the stage game has a unique nash-equilibrium, then the repeated game has a unique subgame perfect Nash equilibrium strategy profile of playing the stage game equilibrium in each round. This can be deduced through backward-induction. The unique stage game Nash equilibrium must be played in the last round regardless of what happened in earlier rounds. Knowing this, players have no incentive to deviate from the unique stage game Nash equilibrium in the second-to-last round, and so on this logic is applied back to the first round of the game. This ‘unravelling’ of a game from its endpoint can be observed in the chainstore-paradox.
If the stage game has more than one Nash equilibrium, the repeated game may have multiple subgame perfect Nash equilibria. While a Nash equilibrium must be played in the last round, the presence of multiple equilibria introduces the possibility of reward and punishment strategies that can be used to support deviation from stage game Nash equilibria in earlier rounds. To interpret: this result means that the very presence of a known, finite time horizon sabotages cooperation in every single round of the game. Cooperation in iterated games is only possible when the number of rounds is infinite or unknown.