Comment on The Media's Pivot to AI Is Not Real and Not Going to Work
p03locke@lemmy.dbzer0.com 1 day agoMy hope is that the “AI” craze culminates in a race to the bottom where we end up in a less terrible state: local models on people’s phones, reaching out to reputable websites for queries and redirection.
We’re already heading there. But, it’s not going to happen by sitting on your hands and waiting for the billionaires to hand you these local models on a silver platter. You honestly believe the overlords that own your phone will give you shit for free? They want you hooked on subscriptions, that send all of your personal data and social security numbers to their huge databases, until the day you die. And then they’ll sell that data to your children and your grandchildren just to make even more profit.
You have to take it. You have to find it yourself. You found Lemmy. Good. So, go find other shit. Discover open source. Discover piracy. Discover Linux. Stay on top of it.
Google just killed uBlock Origin, but I’m using Firefox, because the writing was on the wall at least a year ago.
brucethemoose@lemmy.world 1 day ago
I mean, I run Nemotron and Qwen every day, you are preaching to the choir here :P
p03locke@lemmy.dbzer0.com 1 day ago
Have you used any good ComfyUI workflows specifically for chat LLMs?
brucethemoose@lemmy.world 1 day ago
Not specifically. Ultimately, ComfyUI would build prompts/API calls, which I tend to do in Python scripts.
I tend to use Mikupad or Open Web UI for more general testing.
There are some neat tools with ‘lower level’ integration into LLM engines, like SGlang (which leverages caching and constrained decoding) to do things one can’t do over standard APIs: docs.sglang.ai/frontend/frontend.html
p03locke@lemmy.dbzer0.com 8 hours ago
ComfyUI is just a bunch of Python code tied into I/O nodes. I’m surprised there isn’t a good set of nodes for SGLang yet.