The real issue and what those AI dependent companies are banking on is that they can capture a user base and when OpenAI starts to reach the end of the road with LLM improvements and moves to the extract phase it can buy these little companies to ingest their user base.
Everyone else in that space will be instantly fucked since they will now be competing directly with openai while paying their margin but that’s the bet they are making.
CatsPajamas@lemmy.dbzer0.com 4 days ago
They’re banking on diffusion eliminating the hallucination problem, but it’s too onerous to run very, very large models with it yet. Auto regressive LLMs are a dead end. One that is far away. LLMs are not and we will continue to learn a lot about them as we continue to implement them. Anyone who thought we were at a dead end should use the new Gemini. It’s like a GPT 3.5 to GPT 4 level of improvement.