Comment on Large Language Models in Video Games?
icecreamtaco@lemmy.world 1 day agoThey don’t need a ton of ram if you use a tiny LLM customized for the game’s use cases, and that’s what games would be doing.
Comment on Large Language Models in Video Games?
icecreamtaco@lemmy.world 1 day agoThey don’t need a ton of ram if you use a tiny LLM customized for the game’s use cases, and that’s what games would be doing.
embed_me@programming.dev 1 day ago
The downside is the tinier the model the stupider it will be
icecreamtaco@lemmy.world 1 day ago
Tiny models only get stupid like that because you’re compressing a general purpose model that knows everything in the world farther than it can handle. If you start with a model that only knows how to speak basic english and info about a few hundred things in the game world, it can be much smaller.