Yes I was just writing that, I would love to see more integrations that can talk against ollama.
Comment on Mozilla Firefox new alt-text generator powered by "fully private on-device AI model"
umami_wasbi@lemmy.ml 6 months agoOllama + llava-llama3
You now just need a cli wrapper interact with the ollama api
Zworf@beehaw.org 6 months ago
jherazob@beehaw.org 6 months ago
So, it’s possible to build but no one has made it yet? Because i have negative interest in messing with that kinda tech, and would rather just “apt-get install whatever-image-describing-gizmo” so i wouldn’t be the one who does it
Swedneck@discuss.tchncs.de 6 months ago
this is how i feel about basically all technology nowadays, it’s all so artificially limited by capitalism.
nothing fucking progresses unless someone figures out a way to monetize it or an autistic furry decides to revolutionize things in a weekend because they were bored and inventing god was almost stimulating enough
drwho@beehaw.org 6 months ago
Folks have made it - I think ollama was name-checked specifically because it’s on Github and in Homebrew and in some distros’ package repositories (it’s definitely in Arch’s). I think some folks (at least) aren’t talking about it because of the general hate-on folks have for LLMs these days.
jherazob@beehaw.org 6 months ago
I don’t want an LLM to chat with or whatever folks do with those things, i want a command i can just install, i call the binary on a terminal window with an image of some sort as a parameter, it returns a single phrase describing the image, on a typical office machine with no significant GPU and zero internet access.
Right now i cannot do this as far as i know. Pointing me at some LLM and “Go build yourself something with that” is the direct opposite of what i stated that i desire. So, it doesn’t currently seem to exist, that’s why i stated that i wished somebody ripped it off the Firefox source and made it a standalone command.
umami_wasbi@lemmy.ml 6 months ago
And you expect someone just do it for you?
drwho@beehaw.org 6 months ago
I thought that feature was built into it, but okay.