Comment on [deleted]

<- View Parent
itslilith@lemmy.blahaj.zone ⁨7⁩ ⁨months⁩ ago

It’s static, yes, but the static price is orders of magnitude higher. It still involves loading the whole model into VRAM and performing matrix multiplication on trillions of numbers

source
Sort:hotnewtop