There are plenty of small companies that don’t grow. Think mom and pop shops and self employed tradesmen.

I’ve you get a bit bigger and you’ve already got the hassle of employing lots of people in multiple places you can’t really balance it to be neutral, you will grow or shrink and it’s a lot more pleasant to grow than shrink.