What do you mean framework? What are the specs?
Comment on Anyone in tech confirm?
Unforeseen@sh.itjust.works 2 months ago[deleted]
cornshark@lemmy.world 2 months ago
Mika@piefed.ca 2 months ago
If you are capable of running 120b, the mistral cli bigger open source model in agentic mode could be available to you.
How much did your setup cost, if you don’t mind to disclose such information?
Unforeseen@sh.itjust.works 2 months ago
[deleted]Mika@piefed.ca 2 months ago
That’s a good value! I was worrying something running mid power LLMs would cost 10k+ today. Sure ram screwup nuked the field, but it’s also not on the top list of my priorities. So it gives me hope that by the time I would be ready it would be in even better shape.
Illecors@lemmy.cafe 2 months ago
Moar deets, please!