dream_weasel
@dream_weasel@sh.itjust.works
- Comment on Lutris now being built with Claude AI, developer decides to hide it after backlash 1 week ago:
Unless that’s how people are designing front ends for models, it literally DOESN’T work like that. It works like that until you finish training an embedding model with masking related tasks, but that’s the tip of the iceberg. The input vector, after being tokenized, is ingested wholesale. Now there’s sometimes funny business to manage the size of a context window effectively but this isn’t that unless you’re home-rolling and you’re caching your own inputs or something before you give it to the model.
- Comment on I would like to solve the puzzle 1 week ago:
Bzz bzz!
That is incorrect.
Dream_weasel?
“I’d like to solve the puzzle: Slipping in mustard and crying”
- Comment on No but seriously 1 week ago:
Hmmm…
… … .
Nope.
- Comment on Spicy spicy 2 weeks ago:
That’s how I feel about “slop”.
- Comment on It's important to know where you stand in the hierarchy 2 weeks ago:
Uneducated doesn’t ALWAYS mean dumb.
These are states that can definitely coexist though.
- Comment on [deleted] 2 weeks ago:
Hooray. I’m free!
- Comment on Dumb glasses 2 weeks ago:
Uh… I think you used the wrong pgp key, all I see is *******
- Comment on Dumb glasses 2 weeks ago:
How will that help? I don’t have access to myemail@myprovider.com. Will you share the PW with us?
- Comment on A sudden epiphany. 2 weeks ago:
And I gotta say I really appreciate it!
- Comment on [deleted] 2 weeks ago:
Yock.
- Comment on Lutris now being built with Claude AI, developer decides to hide it after backlash 2 weeks ago:
The joke is that stopping discussion is healthy (which was obviously wrong). So I said I was stopping you–and thus the discussion–and then showed it was healthy with a salad.
- Comment on Lutris now being built with Claude AI, developer decides to hide it after backlash 3 weeks ago:
I get it. You can’t get by “Ai iS slOp” at top level comments anymore. I get that kind of ending because I would add it… but then I also don’t mind collecting downvotes so ymmv I guess.
- Comment on Lutris now being built with Claude AI, developer decides to hide it after backlash 3 weeks ago:
I feel like there needs to be a post (and I don’t want to write it, but maybe I eventually will) that outlines what a model really is. It is not just a statistical text prediction machine unless you are being so loose with the definition of “statistical” that it doesn’t even mean anything anymore.
A decent example of a statistical text prediction machine is the middle word suggested by your phone when you’re using the keyboard. An LLM is not that.
In the most general terms, this kind of language model tokenizes a corpus of text based on a vocabulary (which is probably more than just the words in the dictionary), uses an embedding model to translate these tokens into a vector of semantic “meaning” which minimized loss in a bidirectional encoding (probably), that is then trained against a rubric for one or more topic area questions, retrained for instruction and explainability, retrained with reinforcement learning and human feedback to provide guardrails, and retrained again to make use of supplemental materials not part of the original training corpus (resource augmented generation), then distilled, then probably scaled and fine tuned against topic areas of choice (like coding or Korean or whatever) and maybe THEN made available to people to use. There are generally more parts to curriculum learning even than that but it’s a representative-ish start.
My point being that, yes, it would be nuts to pose ANY question to a predictor that says “with 84% probability, the word that is most likely follows ‘I really like’ is ‘gooning’ on reddit”, but even Grok is wildly more sophisticated than that and Grok is terrible.
- Comment on Lutris now being built with Claude AI, developer decides to hide it after backlash 3 weeks ago:
A little personal flourish doesn’t invalidate the rest IMO. Humans get aggravated and humans are aggravating.
- Comment on Lutris now being built with Claude AI, developer decides to hide it after backlash 3 weeks ago:
20 line commit: 5 issues and suggestions.
5k line commit: “looks good to me!”
- Comment on Lutris now being built with Claude AI, developer decides to hide it after backlash 3 weeks ago:
I’m just gonna stop you right there.
🥗
- Comment on Missing Letter 4 weeks ago:
The dyslexic?
- Comment on it's just science 1 month ago:
He traveled forward to ADD his name to give additional notoriety to the files like a Chad.
- Comment on ESL homework 1 month ago:
So I find it to actually be a really helpful “barometer” of language skill. When I’m in France, if I go in a store and conduct s full conversation in French, I know my accent, word choice, and general language skill is good. If halfway through the exchange we switch to English, I know I either made an egregious language error or I started sounding like an American. If the conversation switched to English right away, I either made a critical language mistake OR I just happened across a very competent English speaker.
- Comment on Sleep well 1 month ago:
I’m honestly not much of a belt buckle guy so it probably wouldn’t get as much use.
- Comment on Sleep well 1 month ago:
Get out of here BBB!
- Comment on Sleep well 1 month ago:
I want the shit out of this pillow
- Comment on We really need to bring back the 70s conversation pits 1 month ago:
Just fill it with water. People love indoor pools.
- Comment on Is it really dangerous to fall sleep in the bath? 1 month ago:
I roughed it like that in college with a book and a hookah, but a little bigger is a lot better to me if you’re average height or taller. Otherwise it’s tough to get knees and nipples in the water at the same time.
- Comment on Is it really dangerous to fall sleep in the bath? 1 month ago:
It’s not the same it is way better.
Not the shower/tub combo bath, those kinda suck, but a jacuzzi or soaking tub with a book is excellent.
- Comment on Slice radishes, toss them with a little olive oil, salt, and seasoning, and air fry at 380°F for 10-12 minutes, shaking halfway 1 month ago:
It’s too hard to get the bits of radish out of the strings at the top of the fret board for me.
- Comment on Pan Galactic Gargle Blaster 1 month ago:
Chocolate?!
- Comment on Probably helps that I'm happy to listen to whatever genre 1 month ago:
“Yarrr, add it to me playlist.”
- Comment on Work smarter, not harder 1 month ago:
I’m from North kilt town!
- Comment on thank you fb 2 months ago:
Probably Roko’s Leviathan.