Section 2.4 A Game of Chance
¶Now that we have worked with expected value, we can begin to analyze some simple games that involve an element of chance.
Example 2.4.1. One-Card Stud Poker.
We begin with a deck of cards in which 50% are Aces (you can use Red cards for Aces) and 50% are Kings (you can use Black cards for Kings). There are two players and one dealer. The play begins by each player putting in the ante (1 chip). Each player is dealt one card face down. WITHOUT LOOKING AT HIS OR HER CARD, the players decide to Bet (say, 1 chip) or Fold. Players secretly show the dealer their choice. If one player bet and the other folded, then the player who bet wins. If both bet or both fold, then Ace beats King (or Red beats Black); winner takes the pot (all the chips from the ante and any bets). If there is a tie, they split the pot.
Exercise 2.4.2. Play One-Card Stud Poker.
Play the game several times with two other people (so you have two players and a dealer), keeping track of the strategy choices of the players and the resulting payoffs.
Exercise 2.4.3. Guess a strategy.
Based on playing the game, determine a possible winning strategy.
Exercise 2.4.4. Check if zero-sum.
Is this a zero-sum game? Why or why not?
Exercise 2.4.5. Relationship between the deal and the strategy.
Does the actual deal affect the choice of strategy?
Exercise 2.4.6. Strategy choices.
On any given deal, what strategy choices does a player have?
Before moving on, you should attempt to determine the payoff matrix. The remainder of this section will be more meaningful if you have given some thought to what the payoff matrix should be. It is OK to be wrong at this point, it is not OK to not try.
Exercise 2.4.7. Determine a possible payoff matrix.
Write down a possible payoff matrix for this game.
Now let's work through creating the payoff matrix for One-Card Stud Poker.
Exercise 2.4.8. Payoff for [Bet, Fold].
If Player 1 Bets and Player 2 Folds, does it matter which cards were dealt? How much does Player 1 win? How much does Player 2 lose? What is the payoff vector for [Bet, Fold]? (Keep in mind your answer to Exercise 2.4.4.)
Exercise 2.4.9. Payoff for [Fold, Bet].
If Player 1 Folds and Player 2 Bets, does it matter which cards were dealt? What is the payoff vector for [Fold, Bet]?
Exercise 2.4.10. Payoff and the actual deal.
If both players Bet, does the payoff depend on which cards were dealt?
To determine the payoff vector for [Bet, Bet] and [Fold, Fold] we will need to consider which cards were dealt. We can use some probability to determine the remaining payoff vectors.
Exercise 2.4.11. Probability of each deal.
There are four possible outcomes of the deal– list them. What is the probability that each occurs? (Remember: the probability of an event is a number between 0 and 1.)
Exercise 2.4.12. Payoff for each deal with [Bet, Bet].
Consider the pair of strategies [Bet, Bet]. For each possible deal, determine the payoff vector. For example, if the players are each dealt an Ace (Red), how much does each player win? (Again, keep in mind your answer to Exercise 2.4.4.)
In order to calculate the payoff for [Bet, Bet], we need to take a weighted average of the possible payoff vectors in Exercise 2.4.12. In particular, we will “weight” a payoff by the probability that it occurs. Recall that this is the expected value. We will calculate the expected value separately for each player.
Exercise 2.4.13. Player 1's expected value for [Bet, Bet].
Find the expected value for [Bet, Bet] for Player 1.
Exercise 2.4.14. Player 2's expected value for [Bet, Bet].
Find the expected value for [Bet, Bet] for Player 2.
The pair of expected values from Exercise 2.4.13 and Exercise 2.4.14 is the payoff vector for [Bet, Bet].
Exercise 2.4.15. Justify using expected value as the payoff.
Explain why it should make sense to use the expected values for the payoffs in the matrix for the strategy pair [Bet, Bet].
Think about what a player needs to know to choose a strategy in a game of chance.
We can use a similar process to find the payoff vector for [Fold, Fold].
Exercise 2.4.16. Repeat for [Fold, Fold].
Repeat Exercise 2.4.12, Exercise 2.4.13, and Exercise 2.4.14 for the pair of strategies [Fold, Fold].
Exercise 2.4.17. Complete payoff matrix.
Summarize the above work by giving the completed payoff matrix for One-Card Stud Poker.
Now that you have done all the hard work of finding the payoff matrix for One-Card Stud Poker, we can analyze our two-player zero-sum game using the techniques we learned in the previous sections. It is also important to see how the mathematical solution compares to our conjectured solution from Exercise 2.4.3.
Exercise 2.4.18. Best strategy for One-Card Stud.
Use the payoff matrix to determine the best strategy for each player. If each player uses their best strategy, what will be the outcome of the game?
Exercise 2.4.19. Compare strategies.
Compare the strategy you found in Exercise 2.4.18 to your suggested strategy in Exercise 2.4.3. In particular, discuss how knowing the payoff matrix might have changed your strategy. Also compare the payoff that results from the strategy in Exercise 2.4.18 to the payoff that results from your original strategy in Exercise 2.4.3 .
Since One-Card Stud Poker has an element of chance, we should see what happens if we play the game several times using the strategy from Exercise 2.4.18.
Exercise 2.4.20. Payoff for repeated One-Card Stud.
Use the payoff matrix to predict what the payoff to each player would be if the game is played ten times.
Exercise 2.4.21. Play repeated One-Card Stud.
Play the game ten times using the best strategy. How much has each player won or lost after ten hands of One-Card Stud Poker? Compare your answer to your prediction in Exercise 2.4.20. Does the actual payoff differ from the theoretical payoff? If so, why do you think this might be?
Exercise 2.4.22. Fair game.
Explain why this game is considered fair.
Example 2.4.23. Generalized One-Card Stud Poker.
In One-Card Stud Poker we anted one chip and bet one chip. Now, suppose we let players ante a different amount and bet a different amount (although players will still ante and bet the same amount as each other). Suppose a player antes \(a\) and bets \(b\text{.}\) How might this change the game?
Exercise 2.4.24. Payoff matrix for Generalized One-Card Stud.
Use the method outlined for One-Card Stud Poker to determine the payoff matrix for Generalized One-Card Stud Poker.
Exercise 2.4.25. Strategy for Generalized One-Card Stud.
Does the strategy change for the generalized version of the game? Explain.
Now that we have analyzed several zero-sum games, we can see how important is is to find any equilibrium pairs. In the next section we explore equilibrium strategies in more detail.