Comment on Large Language Models in Video Games?
embed_me@programming.dev 2 months agoThe downside is the tinier the model the stupider it will be
Comment on Large Language Models in Video Games?
embed_me@programming.dev 2 months agoThe downside is the tinier the model the stupider it will be
icecreamtaco@lemmy.world 2 months ago
Tiny models only get stupid like that because you’re compressing a general purpose model that knows everything in the world farther than it can handle. If you start with a model that only knows how to speak basic english and info about a few hundred things in the game world, it can be much smaller.