Solve Exercise 10 on page 69 of my lecture notes (Chapter Repeated Games).