That’s not at all how it works. In particular, it didn’t start from an original, dense point. It started everywhere, with nearly uniform density apparently infinitely in all directions.