LLMs are expensive to operate, hard to find free such services…
[deleted]
Submitted 6 months ago by PumpkinDrama@reddthat.com to [deleted]
Comments
occultist8128@infosec.pub 6 months ago
breakingcups@lemmy.world 6 months ago
There’s a few, some of them have a free tier, most of them are paid. They are often geared towards role play or storytelling. If you search for uncensored roleplaying AI I’m sure you’ll find some.
CubitOom@infosec.pub 6 months ago
You are right that something that most others will host for free are going to be censored since otherwise they might have some kind of responsibility legally. I learned this while trying to diagnose an issue with my cars door lock.
At the end of the day, anything you ask some hosted llm is being recorded so if you actually want something uncensored or something that gives you a sense of freedom then the only real option is to self host.
Luckily, it’s very simple and can even be done on a low powered device if you pick the right model. The amount and type of ram you have a will dictate how many parameters you can run at a decent speed.
Here’s 3 options with increasing difficulty (not much however) written for Arch Linux: 0bin.net/paste/nkUrzIRo#GZrM NXK-QiPcv1bHWnGsviY8…
avattar@lemmy.sdf.org 6 months ago
It says wrong key on the 0bin
jol@discuss.tchncs.de 6 months ago
perchance.org/aí-story-generator is so. Pletely uncensored and free.
hendrik@palaver.p3x.de 6 months ago
I don't know which one of them is good, but I've seen like a dozen or so online services, mostly for roleplay / virtual girl/boyfriend stuff etc. They're paid, though. Or you can pay openrouter (more general LLM connector, also paid). I'm not sure if you're looking for something like that or something free.
It's mostly OpenAI, Microsoft etc who have free services, but they're limited in what they'll talk about. And there is one free community project I'm aware of: that would be AI Horde. It's mostly for images but offers text, too. I haven't used it in a while, not sure how/if it works.
db0@lemmy.dbzer0.com 6 months ago
AI Horde does both text and image yes. You can easily use it on the browser from artbot.site (images) or lite.koboldai.net (text). You can register an account for free on aihorde.net/register to go faster than anons (or it’s going to be quite slow). It’s crowdsourced and volunteer run.
Toes@ani.social 6 months ago
If you’re not able to run one yourself.
Try DuckDuckGo in mixtral mode. duckduckgo.com/?q=DuckDuckGo+AI+Chat&ia=chat&duck…
xmunk@sh.itjust.works 6 months ago
Not certain if it’s still active but koboldai seems to be a community sourced tool that doesn’t have built-in limitations because it’s a non-commercial site.
antihumanitarian@lemmy.world 6 months ago
Was about to post a Hugging Face link til I finished reading. For what it’s worth, once you have Ollama installed it’s a single command to download, install, and immediately drop into a chat with a model, either from Ollama’s library or Hugging Face, or anyone else. On Arch the entire process to get it working with gpu acceleration was installing 2 packages then start ollama.
Landless2029@lemmy.world 6 months ago
Gab.AI
belastend@slrpnk.net 6 months ago
Wasnt that the one with the in-built holocaust denial?
Landless2029@lemmy.world 6 months ago
No idea. I used it to translate stuff uncensored
pepperprepper@lemmy.world 6 months ago
Very easy to run yourself theses days as long as you have a decent GPU or Mac unified silicon. OpenWebUi will let you host your own ChatGPT that you can choose different models to run. Dolphin Mixtral is a pretty popular “unlocked” model.