There are live distros that run directly from thumb drives.

Many distros run this way for their installer (e.G. Mint).

So it really depends on what you’re trying to do.