Comment on OpenAI releases a free GPT model that can run on your laptop

<- View Parent
fuckwit_mcbumcrumble@lemmy.dbzer0.com ⁨1⁩ ⁨week⁩ ago

I tried it out last night and it ran quite well on my heavily thermally limited i9 11950h/rtx 3080 laptop. I had maybe 6 or 7 gigs of main ram used in total, with docker running. It was only using about 12 gigs of vram in my very limited testing.

source
Sort:hotnewtop