Comment

Comment on Abrahamm3r/Z-Image-SDNQ-uint4-svd-r32 · A 4-bit quantized version of Tongyi-MAI/Z-Image using SDNQ (Structured Decomposable Neural Quantization)

db0@lemmy.dbzer0.com ⁨1⁩ ⁨week⁩ ago

What are the tradeoffs? I can’t believe a 50% to 75% RAM reduction is free. Is this like quantization?

Sort:hotnew top

Even_Adder@lemmy.dbzer0.com ⁨1⁩ ⁨week⁩ ago
Yeah, it’s a different form of quantization.

source
- db0@lemmy.dbzer0.com ⁨1⁩ ⁨week⁩ ago
  gotcha, so this downloads its own custom quantization models?
  
  source
  - Even_Adder@lemmy.dbzer0.com ⁨1⁩ ⁨week⁩ ago
    Yeah.
    
    source