You need comfyui-sdnq to load SDNQ quantized models in ComfyUI: github.com/EnragedAntelope/comfyui-sdnq
Abrahamm3r/Z-Image-SDNQ-uint4-svd-r32 · A 4-bit quantized version of Tongyi-MAI/Z-Image using SDNQ (Structured Decomposable Neural Quantization)
Submitted 1 week ago by Even_Adder@lemmy.dbzer0.com to stable_diffusion@lemmy.dbzer0.com
https://huggingface.co/Abrahamm3r/Z-Image-SDNQ-uint4-svd-r32
db0@lemmy.dbzer0.com 1 week ago
What are the tradeoffs? I can’t believe a 50% to 75% RAM reduction is free. Is this like quantization?
Even_Adder@lemmy.dbzer0.com 1 week ago
Yeah, it’s a different form of quantization.
db0@lemmy.dbzer0.com 1 week ago
gotcha, so this downloads its own custom quantization models?