scrubbles@poptalk.scrubbles.tech 2 days ago
Leopold Aschenbrenner (born 2001 or 2002[1]) is a German artificial intelligence (AI) researcher and investor. He was part of OpenAI’s “Superalignment” team before he was fired in April 2024 over an alleged information leak, which Aschenbrenner disputes. He has published a popular essay called “Situational Awareness” about the emergence of artificial general intelligence and related security risks.[2] He is the founder and chief investment officer (CIO) of Situational Awareness LP, a hedge fund investing in companies involved in the development of AI technology.
So, I’m calling bullshit. I’ve read the papers, I’ve kept up on everything. I run AI models myself to keep up with everything, I’ve built my own agents and my own agentic workflows. It keeps coming back to a few big things that unless they’ve suddenly had another massive breakthrough - I don’t see happening.
- LLMs already have the vast majority of data associated with them, and they still hallucinate. The docs say that it will take exponentially more data to train them on a linear trajectory. So to get double the performance, we’d need the current amount of data squared.
- LLMs and Agentic flows are very cool, and very useful for me. But they’re incredibly unreliable. And it’s just how models work - it’s a black box. You can say “that didn’t work” and it’ll train next time that it was a bad option, but it’s never going be zero. Businesses are learning (see Taco Bell and several others), that AI is not code. It is not true or false. It’s probably true or probably false. That doesn’t work when you’re putting in an order or deciding how much money to spend.
- We’ve certainly plateaued with AI for the time being. There will be more things that come out, but until the next major leap we’re pretty much here. GPT5 proved that, it was mediocre, it was… the next version. They promised groundbreaking, but there just isn’t any more ground to break with current AI. Like I said agents were kind of the next thing, and we’re already using them.