Comment on Anyone in tech confirm?
Mika@piefed.ca 3 weeks ago
Not really. But the more you understand tech, the less you like the high tech market solutions and have the urge to have the same but in opensource.
I kinda dream that one day setups for mid-power home AI racks would be affordable enough to drop all the proprietary AIs and start automating my daily routines with agents & helping me build my local knowledge vector database with AI embeddings. No way in hell I’m exposing anything like that to thirdparties.
Unforeseen@sh.itjust.works 3 weeks ago
Illecors@lemmy.cafe 3 weeks ago
Moar deets, please!
cornshark@lemmy.world 3 weeks ago
What do you mean framework? What are the specs?
Mika@piefed.ca 3 weeks ago
If you are capable of running 120b, the mistral cli bigger open source model in agentic mode could be available to you.
How much did your setup cost, if you don’t mind to disclose such information?
Unforeseen@sh.itjust.works 3 weeks ago
Mika@piefed.ca 3 weeks ago
That’s a good value! I was worrying something running mid power LLMs would cost 10k+ today. Sure ram screwup nuked the field, but it’s also not on the top list of my priorities. So it gives me hope that by the time I would be ready it would be in even better shape.