Olympic fan's dream shattered by spectator ban