Because the roads are busier as people are trying to get there for the same time as you. If you leave later you are joining the end of that traffic, as it dies down. If you leave earlier you just become part of that traffic.