Use kobold.cpp instead of all of those backends. Plus it also does text to speech. github.com/LostRuins/koboldcpp
Belullama - A stand-alone AI application bundle
Submitted 1 month ago by Even_Adder@lemmy.dbzer0.com to stable_diffusion@lemmy.dbzer0.com
Comments
SGforce@lemmy.ca 1 month ago
mutaphysis@discuss.tchncs.de 1 month ago
Sadly just CPU only
kate@lemmy.uhhoh.com 1 month ago
lol no