Comment on OpenAI releases a free GPT model that can run on your laptop
fuckwit_mcbumcrumble@lemmy.dbzer0.com 1 week agoI tried it out last night and it ran quite well on my heavily thermally limited i9 11950h/rtx 3080 laptop. I had maybe 6 or 7 gigs of main ram used in total, with docker running. It was only using about 12 gigs of vram in my very limited testing.