I’ve been told that the LLMs are reaching pretty hard diminishing returns, in that you need exponentially increasing amounts of compute for linear returns in model performance. The cost of marginal improvements is bumping into theoretical limits.

It can’t turn into general AI, that’s not how LLMs work. So they’re uselessly throwing money after nothing.