making the most with what you have

That is, indeed, the motto of ML research for a long time. Just finding more efficient approaches.

It’s people like Altman the introduced the idea of not innovating and just scaling up what you already have. Hence many in the research community know he’s full of it.