You're sort of right. The change in distance from the surface is insignificant, but a spacecraft orbiting a bigger planet has to travel further with each orbit so its speed must be faster to avoid falling out of orbit, even if the gravitational acceleration at its orbital height is the same.