Since the game started at 5pm, there were scores of people coming from work who had to miss the beginning of the game while standing on the security line