Those watching the Olympics on TV might be surprised to see lots of empty seats in many games.