There definitely will be games which are just unplayable if you got no inference accelerator. The moment, AI generates the actual visuals, you either are able to do AI image gen at playable FPS - or you don’t. Those games can’t ship with an alternative renderer because the game needing no textures or shaders is the whole point of full AI rendering.
But if you don’t like AI, you will not miss out on anything. The first such games will probably be absolute dog shit anyway.