Use kobold.cpp instead of all of those backends. Plus it also does text to speech. github.com/LostRuins/koboldcpp
Belullama - A stand-alone AI application bundle
Submitted 3 months ago by Even_Adder@lemmy.dbzer0.com to stable_diffusion@lemmy.dbzer0.com
Comments
SGforce@lemmy.ca 3 months ago
mutaphysis@discuss.tchncs.de 3 months ago
Sadly just CPU only
kate@lemmy.uhhoh.com 3 months ago
lol no