Comment on A local server designed to load one or more pre-trained NLP models during startup and expose them through a clean, RESTful API

muntedcrocodile@lemm.ee ⁨1⁩ ⁨week⁩ ago

Seems fun like I could just plug it into openwebui docker compose. Mind you is the only benefit of this that u can run non ollama compatible models.

source
Sort:hotnewtop