Skip to main content
Logo image

Section 3.1 Introduction to Repeated Games

Now that we are experts at finding equilibrium pairs, what happens when a game doesn’t have any equilibrium pairs? What should our players do? As we saw in Section 2.6, if there is no equilibrium point then no matter which strategies are played, at least one player wants to switch.

Activity 3.1.1. A \(2\times 2\) repeated game.

Consider the following zero-sum game
\begin{equation*} \left[\begin{matrix}1\amp 0\\ -1\amp 2 \end{matrix} \right]. \end{equation*}

(a)

Does this game have an equilibrium pair?

(b)

Play this game with an opponent 10 times. Tally your wins and losses.

(c)

Describe how you chose which strategy to play. Describe how your opponent chose which strategy to play.

(d)

When playing the game several times, does it make sense for either player to play the same strategy all the time? Why or why not?
Up until this point we have used the term “strategy” to mean which row or column a player chooses to play. Now we want to refer to how a player plays a repeated game as the player’s strategy. In order to avoid confusion, in repeated games we will define some specific strategies.

Definition 3.1.1.

In a repeated game, if a player always plays the same row or column, we say that she is playing a pure strategy.
For example, if Player 1 always plays Row A, we say she is playing pure strategy A.

Definition 3.1.2.

If a player varies which row or column he plays, then we say he is playing a mixed strategy.
For example, if a player plays Row A 40% of the time and Row B 60% of the time, we will say he is playing a (.4, .6) strategy, as we generally use the probability rather than the percent. The probabilities of each strategy will be listed in the same order as the strategies in the matrix.
It is not enough just to determine how often to play a strategy. Suppose Player 1 just alternates rows in Activity 3.1.1. Can Player 2 “out-guess” Player 1? What might be a better way for Player 1 to play?
We’d really like to find a way to determine the best mixed strategy for each player in a repeated game. Let’s start with what we already know: games with equilibrium points. If a game has an equilibrium pair of strategies, would a player want to play a mixed strategy? Recall that a strategy pair is an equilibrium pair if neither player gains by switching strategy.

Example 3.1.3. Repeating a Game with an Equilibrium.

Consider the following zero-sum game
\begin{equation*} \left[\begin{matrix}-1\amp 1\\ 0\amp 2 \end{matrix} \right]. \end{equation*}
This game has an equilibrium pair. Convince yourself that if this game is played repeatedly, each player should choose to play a pure strategy.
Thus, if the game has an equilibrium we know that players will play the pure strategies determined by the equilibrium pairs. So let’s get back to thinking about games without equilibrium pairs. If we play such a game once, can we predict the outcome? What about if we repeat the game several times, can we predict the outcome? Think about tossing a coin. If you toss it once, can you predict the outcome? What if you toss it 100 times, can you predict the outcome? Not exactly, but we can say what we expect: if we toss a coin 100 times we expect to have half of the coins turn up heads and half turn up tails. This may not be the actual outcome, but it is a reasonable prediction. Now is a good time to remind yourself about finding the expected value, Definition 2.3.4.
Recall the familiar game of Rock-Paper-Scissors: Rock beats Scissors, Scissors beat Paper, and Paper beats Rock. Using the payoff matrix and experimentation, we will try to determine the best strategy for this game.

Activity 3.1.2. RPS payoff matrix.

Construct a game matrix for Rock-Paper-Scissors.

Activity 3.1.3. RPS and equilibrium points.

Is Rock-Paper-Scissors a zero-sum game? Does it have an equilibrium point? Explain.

Activity 3.1.4. Play RPS.

We want to look at what happens if we repeat Rock-Paper-Scissors.

(a)

Play the game ten times with an opponent. Record the results (list strategy pairs and payoffs for each player).

(b)

Describe any strategy you used to play Rock-Paper-Scissors.

(c)

Reflect on your chosen strategy. Does it guarantee you a win? What should it mean to win in a repeated game? What are the strengths and weaknesses of your strategy?

(d)

Discuss your strategy with your opponent. After sharing your ideas for a strategy, can you improve your previous strategy?
Although you may have come up with a good strategy, let’s see if we can’t decide what the “best” strategy should be for Rock-Paper-Scissors.

Activity 3.1.5. Exploring some straegies.

Let’s assume we are playing Rock-Paper-Scissors against the smartest player to ever live. We will call such an opponent the “perfect” player. You can think of this player as one who can figure out your strategy easily.

(a)

Explain why it is not a good idea to play a pure strategy; i.e., to play only Rock, only Paper, or only Scissors.

(b)

Does it make sense to play one option more often than another (for example, Rock more often than Paper)? Explain.

(c)

How often should you play each option?

(d)

Do you want to play in a predictable pattern or randomly? What are some advantages and disadvantages of a pattern? What are some advantages and disadvantages of a random strategy?
Hopefully, you concluded that the best strategy against our perfect player would be to play Rock, Paper, Scissors 1/3 of the time each, and to play randomly. We can say that our strategy is to play each option randomly with a probability of 1/3, and call this the Random(1/3, 1/3, 1/3) strategy.

Activity 3.1.6. Testing the random strategy.

Let’s try out the Random(1/3, 1/3, 1/3) strategy

(a)

Using this strategy, what do you predict the long term payoff will be for Player 1? For Player 2?

(b)

Let’s check our prediction. Using a die, let 1 and 2 represent Rock, 3 and 4 represent Paper, and 5 and 6 represent Scissors. Play the game 20 times with someone in class where each player rolls to determine the choice of Rock, Paper, or Scissors. Keep track of the strategy pairs and payoffs. What was the total payoff for each player? (At this point, if you still feel that you have a better strategy, try your strategy against the random one to see what happens!)

(c)

How did the actual outcome compare to your predicted outcome? What do you expect would happen if you play the game 100 times? (Or more?)
Using ideas about probability and expected value we can more precisely predict the long term payoff for each player when playing a random mixed strategy.

Activity 3.1.7. Expected payoff when both players play the random strategy.

Assume both players are using the Random(1/3, 1/3, 1/3) strategy.

(a)

List all the possible outcomes for a single game (the outcome is the strategy pair and the payoff, for example [R, P], \((-1, 1)\)).

(b)

What is the probability that any particular pair of strategies will be played? Are the strategy pairs equally likely?

(c)

Using these probabilities and payoffs, calculate the expected value of the game for each player.

Activity 3.1.8. Strategy for the repeated \(2\times 2\) game.

Now consider the matrix from Activity 3.1.1:
\begin{equation*} \left[\begin{matrix}1\amp 0\\ -1\amp 2 \end{matrix} \right]. \end{equation*}
See if you can determine how often Player 1 should play each row, and how often Player 2 should play each column. Try testing your proposed strategy (you may be able to use a variation on the dice as we saw in Activity 3.1.6). Write up any conjectured strategies and the results from playing the game with your strategy. Do you think you have come up with the best strategy? Explain.
You may have had an idea about the best way to play Rock-Paper-Scissors before working through this section, but how can we find solutions to other games, such as the one in Activity 3.1.8? We don’t want to just use a “guess and check” method. Especially since there are infinitely many possible mixed strategies to try! The rest of the chapter will develop mathematical methods for solving repeated games with no equilibrium point.

Reading Questions Check Your Understanding

1.

    True or False: In Rock-Paper-Scissors, the best strategy is to always play Rock.
  • True.

  • If a player always plays Rock, then the opponent can always play Paper.
  • False.

  • If a player always plays Rock, then the opponent can always play Paper.

2.

    True or False: In Rock-Paper-Scissors, the best strategy is to play Rock more often than Paper or Scissors.
  • True.

  • If a player plays Rock more often, then the opponent can play Paper more often.
  • False.

  • If a player plays Rock more often, then the opponent can play Paper more often.

3.

    True or False: In Rock-Paper-Scissors, the best strategy is to play Rock, then Paper, then Scissors.
  • True.

  • If a player always plays Rock, then Paper, then Scissors, then the opponent can play Paper, then Scissors, then Rock.
  • False.

  • If a player always plays Rock, then Paper, then Scissors, then the opponent can play Paper, then Scissors, then Rock.

4.

    True or False: The following game has an equilibruim.
    \begin{equation*} \left[\begin{matrix} (10, -10)\amp (-10, 10)\\ (-20, 20) \amp (0, 0) \end{matrix}\right]\hspace{.5in} \end{equation*}
  • True.

  • For each outcome, at least one player wants to switch.
  • False.

  • For each outcome, at least one player wants to switch.

5.

    Suppose the following game is played repeatedly.
    \begin{equation*} \left[\begin{matrix} (10, -10)\amp (-10, 10)\\ (-20, 20) \amp (0, 0) \end{matrix}\right]\hspace{.5in} \end{equation*}
    Player 1 should play
  • Pure strategy Row 1.
  • Then Player 2 would play Column 2 repeatedly.
  • Pure strategy Row 2.
  • Then Player 2 would play Column 1 repeatedly.
  • A mixed strategy, varying Row 1 and Row 2.
  • Correct. We will learn how to find the exact strategy later.

6.

    Suppose the following game is played repeatedly.
    \begin{equation*} \left[\begin{matrix} (10, -10)\amp (-10, 10)\\ (-20, 20) \amp (0, 0) \end{matrix}\right]\hspace{.5in} \end{equation*}
    Player 2 should play
  • Pure strategy Column 1.
  • Then Player 1 would play Row 1 repeatedly.
  • Pure strategy Column 2.
  • Then Player 1 would play Row 2 repeatedly.
  • A mixed strategy, varying Column 1 and Column 2.
  • Correct. We will learn how to find the exact strategy later.

7.

    True or False: The following game has an equilibruim.
    \begin{equation*} \left[\begin{matrix} (10, -10)\amp (0, 0)\\ (-20, 20) \amp (-1, 1) \end{matrix}\right]\hspace{.5in} \end{equation*}
  • True.

  • \((0, 0)\) is an equilibruim.
  • False.

  • \((0, 0)\) is an equilibruim.

8.

    Suppose the following game is played repeatedly.
    \begin{equation*} \left[\begin{matrix} (10, -10)\amp (0, 0)\\ (-20, 20) \amp (-1, 1) \end{matrix}\right]\hspace{.5in} \end{equation*}
    Player 1 should play
  • Pure strategy Row 1.
  • Player 1 always prefers Row 1 to Row 2.
  • Pure strategy Row 2.
  • Player 1 always prefers Row 1 to Row 2.
  • A mixed strategy, varying Row 1 and Row 2.
  • Since Player 1 always prefers Row 1 to Row 2, there is no reason for Player 1 to play Row 2

9.

    Suppose the following game is played repeatedly.
    \begin{equation*} \left[\begin{matrix} (10, -10)\amp (0, 0)\\ (-20, 20) \amp (-1, 1) \end{matrix}\right]\hspace{.5in} \end{equation*}
    Player 2 should play
  • Pure strategy Column 1.
  • Player 1 should always play Row 1, so Player 2 does better to play Column 2.
  • Pure strategy Column 2.
  • Player 1 should always play Row 1, so Player 2 does better to play Column 2.
  • A mixed strategy, varying Column 1 and Column 2.
  • Since Player 1 should always play Row 1, Player 2 should always play Column 2.

10.

    True or False: If a repeated game has an equilibrium, then the players should play a pure strategy.
  • True.

  • If there is an equilibrium, there is no reason for the players to switch strategies.
  • False.

  • If there is an equilibrium, there is no reason for the players to switch strategies.

11.

    True or False: In a repeated game with no equilibrium, it is better to play a mixed strategy with a predictable pattern.
  • True.

  • If a player is predictable, we can assume the opponent will guess the pattern.
  • False.

  • If a player is predictable, we can assume the opponent will guess the pattern.