Rockets need to go fast parallel to Earth surface rather than just high, though atmosphere slows you down, so you start by going up to get where atmosphere is less dense faster and angle yourself steadily to gain orbital speed.

The first two pictures here explain it better than I ever could