Yes. But world exploration tend to happen on horizontal.

Also additional height is often used as a way to store alternative dimensions (like nether or end). As there’s is not another built in way to do so.