It also makes no sense that there would be nothing for an infinite amount of time

Time only started existing after the Big Bang. Before that, there was nothing.