Comment on AI Driving Game Players Are Burning Through So Many Tokens Its Developer Had to Take Out a Bank Loan to Keep It Running

<- View Parent
GenosseFlosse@feddit.org ⁨1⁩ ⁨week⁩ ago

Not everyone has a GPU with enough RAM. I have a 3060 with 12GB, and I cannot run ollama and a 3D game at the same time. As soon as ollama starts processing, the GPU is at 100% and game and ollama start swapping data in and out of the GPU RAM, which means the whole computer becomes unresponsive for a long time. I had to set up a script that disables ollama if steam is running.

source
Sort:hotnewtop