Comment on Google just had its first negative cash flow quarter due to massive AI spending
Markaos@discuss.tchncs.de 6 days agoWhat about “Attention Is A You Need”, the white paper that kick-started the whole generative AI and LLM thing? OpenAI’s GPT models are built off of that architecture, like pretty much everything that came after it.
Like sure, modern Google is notoriously bad at building the actual end products, but it publishes a lot of research and some of it pushes others forward quite a lot.
Valmond@lemmy.dbzer0.com 6 days ago
The LLM page was published in 2019 right? 7 years ago!
Markaos@discuss.tchncs.de 6 days ago
2017, actually. But the search engine (supposedly the last innovation according to the previous comment) has seen most of its leaps forward in late 90s to early 2000s, which is a lot earlier.
Also it’s pretty hard to find a more clear example of Google sharing well done research than the white paper that started the current AI bubble. But they do publish a lot of stuff.
no_name_dev_from_hell@programming.dev 6 days ago
I think it was 2017.
EliteCloneMike@lemmy.zip 6 days ago
Yea, and the main discovery being transformers (GPT predecessor). That allowed for the groundbreaking technology of AlphaFold to come into being, for which a Nobel prize was awarded to Demis Hassabis and John Jumper (who just left Google DeepMind to join Anthropic).
Valmond@lemmy.dbzer0.com 6 days ago
Okay my bad, thx.