Yeah, we’re not a regular, balanced geometric shape. Without a tether or something to help stabilize against, every marginal push or pull (like gravity, or the marginal friction of the ionosphere) will tend to send us tumbling.