One of the significant drawbacks of the graphical solution from the previous sections is that it can only solve 2 X 2 matrix games. If each player has 3 options, we would need to graph in three dimensions. Technically this is possible, but rather complicated. If each player has more than 3 options, since we can’t graph in four or more dimensions, we are at a complete loss. So we need to think about an alternate way to solve for the mixed strategies. Although we will begin with 2 X 2 games, this method will easily generalize to larger games.
Consider the game in which each player can choose HEADS (H) or TAILS (T); if the two players match, Player 1 wins; if the two players differ, Player 2 wins. What strategy should each player play?
We could use our previous graphical method to determine the expected value of the game (you might quickly try this just to verify your prediction). However, as we have noted, a major drawback of the graphical solution is that if our players have 3 or more options, then we would need to graph an equation in 3 or more variables; which, I hope you agree, we don’t want to do. Although we will continue to focus on \(2 \times 2\) games, we will develop a new method which can more easily be used to solve larger games.
\begin{align*}
P_1(H) \amp = \mbox{ the probability that Player 1 plays H; }\\
P_1(T) \amp = \mbox{ the probability that Player 1 plays T;}\\
P_2(H) \amp = \mbox{ the probability that Player 2 plays H; }\\
P_2(T) \amp = \mbox{ the probability that Player 2 plays T.}
\end{align*}
Also, we will let \(E_1(H)\) be the expected value for Player 1 playing pure strategy H against a given strategy for Player 2. Similarly, \(E_2(H)\) will be Player 2’s expected value for playing pure strategy H.
We can use expected value to compute what Player 1 should do in response to Player 2’s 60/40 strategy. First, consider a pure strategy for Player 1. Compute the expected value for Player 1 if she only plays H while Player 2 plays H with probability .6 and T with probability .4. This expected value is \(E_1(H)\text{,}\) above.
Which pure strategy has a higher expected value for Player 1? If Player 1 plays this pure strategy, will she do better than your predicted value of the game?
From Activity 3.4.8 we now know that Player 2 wants \(E_1(H)=E_1(T)\text{,}\) we can use a little algebra to compute the best defensive strategy for Player 2. Remember, we want to assume that Player 1 will always be able to chose the strategy that will be best for her, and thus Player 2 wants to protect himself. Let’s find the probabilities with which Player 2 should play H and T.
The expected value, \(E_1(H)\text{,}\) is (Player 1’s payoff for [H, H]\(\times\) the probability Player 2 plays H)\(+\) (Player 1’s payoff for [H, T]\(\times\) the probability Player 2 plays T).
Since we want \(E_1(H)=E_1(T)\text{,}\) set your two equations equal to each other. This gives you one equation in terms of \(P_2(H)\) and \(P_2(T)\text{.}\)
So in general, to solve for Player 2’s strategy, we want to write an equation for each of Player 1’s pure strategy expected values in terms of Player 2’s probabilities. For example, \(E_1(H)\) and \(E_1(T)\) in terms of variables \(P_2(H)\) and \(P_2(T)\text{.}\) We then set the expected values equal to each other. We now have an equation just in terms of Player 2’s probabilities.
In order to solve for the probabilities, we also need to use the fact that Player 2’s probabilities sum to 1. For example, \(P_2(H)+P_2(T)=1\text{.}\) For a \(2 \times 2\) game, you now have 2 equations with 2 unknowns (\(P_2(H)\) and \(P_2(T)\)). Use an algebraic method such as substitution or elimination to solve the system of equations.
Activity3.4.10.Solve for Player 2’s probabilities.
Using the equations from Activity 3.4.9 solve for \(P_2(H)\) and \(P_2(T)\text{.}\) You now have the equilibrium mixed strategy for Player 2. Does this match the mixed strategy you determined in Activity 3.4.3?
We should have an equation for \(E_2(H)\) and one for \(E_2(T)\text{.}\) Since we are looking for the probabilities of each of Player 1’s options, the equations should involve \(P_1(H)\) and \(P_1(T)\text{.}\)
We now have a new method for finding the best mixed strategies for Players 1 and 2, assuming that each player is playing defensively against an ideal player. But how can we find the value of the game? For Player 2, we assumed \(E_1(H)=E_1(T)\text{.}\) In other words, we found the situation in which Player 1’s expected value is the same no matter which pure strategy she plays. Thus, Player 1 is indifferent to which pure strategy she plays. If she were not indifferent, then she would play the strategy with a higher expected value. But, as we saw, this would be bad for Player 2. So Player 1 can assume that Player 2 will play the equilibrium mixed strategy. Thus, as long as Player 1 plays a mixed strategy, it doesn’t matter whether at any given time, she plays H or T (this is the idea that she is indifferent to them). Hence, the expected value of the game for Player 1 is the same as \(E_1(H)\text{,}\) which is the same as \(E_1(T)\text{.}\) Similarly, we find that the expected value of the game for Player 2 is \(E_2(H)\) (or \(E_2(T)\)). This is a pretty complicated idea. You may need to think about it for a while. In the meantime, use the probabilities you found for each player and the equations for \(E_1(H)\) and \(E_2(H)\) to find the value of the game for each player.
Activity3.4.12.Find Player 1’s expected value of the game.
Use the probabilities you calculated in Activity 3.4.10 to find \(E_1(H)\text{,}\) and hence the expected value of the game for Player 1. How does this compare to your prediction for the value of the game that you gave in Activity 3.4.3?
Activity3.4.13.Find Player 2’s expected value of the game.
Use the probabilities you calculated in Activity 3.4.11 to find \(E_2(H)\text{,}\) and hence the expected value of the game for Player 2. How does this compare to your prediction for the value of the game that you gave in Activity 3.4.3?
Activity3.4.14.Solve a \(2\times 2\) repeated game using expected values.
Apply this method of using expected value to Activity 3.1.1, which we solved using the graphical method in Section 3.2 to find the equilibrium mixed strategies for each player and the value of the game for each player:
Activity3.4.15.Expected value solution for Rock-Paper-Scissors.
As we noted in this section, this method can be used to solve bigger games. We just have more equations. Use the expected value method to find the equilibrium mixed strategy for Rock-Paper-Scissors for Player 2.
You will need to set \(E_1(R)=E_1(P)\) and \(E_1(P)=E_1(S)\text{;}\) solve for \(P_2(R), P_2(P), P_2(S)\text{;}\) etc. It should be very similar to what you did for Matching Pennies, but there will be three equations and three unknowns.
If you found this last activity to be algebraically challenging, don’t worry, we will be able to use technology to help us solve equations with several variables.
Consider the zero-sum game given by Table 3.4.2. Suppose Player 2 plays the C 50% of the time and D 50% of the time. We can call this the (50, 50) or (1/2, 1/2) strategy. What is \(E_1(A)\text{?}\)
Consider the zero-sum game given by Table 3.4.2. Suppose Player 2 plays the C 50% of the time and D 50% of the time. We can call this the (50, 50) or (1/2, 1/2) strategy. What is \(E_1(B)\text{?}\)
Consider the zero-sum game given by Table 3.4.2. Suppose Player 2 plays the C 25% of the time and D 75% of the time. We can call this the (25, 75) or (1/4, 3/4) strategy. What is \(E_1(A)\text{?}\)
Consider the zero-sum game given by Table 3.4.2. Suppose Player 2 plays the C 25% of the time and D 75% of the time. We can call this the (25, 75) or (1/4, 3/4) strategy. What is \(E_1(B)\text{?}\)