The Switch Lite is exactly this. $200 handheld that runs first party games. There are android handhelds like the Retroid pocket 5 as well.

A Steam Deck Lite would be incredible. Small, cheap, linux-based, and powerful enough to run indie games and some light 3D. I think that form factor basically needs an arm cpu though.