Comment on AI Driving Game Players Are Burning Through So Many Tokens Its Developer Had to Take Out a Bank Loan to Keep It Running
12GB is a lot of ram. By small local models I am talking about fine tuning something like < 2GB LLM