dream_weasel
@dream_weasel@sh.itjust.works
- Comment on 🐙 Octopus is Octopus 🐙 1 day ago:
I’ll add the book to my list.
I am not suggesting by the way that words should never change in meaning. Rather, I don’t think that the default mode shouldn’t be “ah well whatever, let’s just add a new colloquial definition”. The dictionary can chase language, but maybe it shouldn’t go at exactly the same pace that people say things on tik tok.
I came across a word I had never seen before this week in a book I’m reading (“schismogenesis” which is apparently a common word in anthropology, but not for engineering) and I immediately had a working definition. This is the reward for learning to me. I have another friend who did similar schooling and he is of the opinion that knowing “$5 words” is stupid and is reading the same book as part of our book club. I can’t imagine what it must be like for him to read a book and constantly feel like all you’re getting is the gist. The dumbing down of language eliminates nuance because the real depth doesn’t come at the 4th grade reading level it feels like descriptivism wants to sink to.
I don’t like flattening out language to meet the least common denominator.
- Comment on Get in the AI cube 1 day ago:
In fairness, you can probably keep enough whole humans to stack in there without touching and then just liquefy the rest. That should save some money and time.
- Comment on 🐙 Octopus is Octopus 🐙 1 day ago:
Sure, languages evolve I guess but this isn’t really that IMO.
The whole idea of etymology is that you can figure out what a word means from its roots. If you throw all that out, you give up the scaffolding that makes words make any sense. Same goes for grammatical rules. It seems like the argument for descriptivism is “let’s not be elitist when people become less competent with the rules of a language”, and while that’s a fine ideal, yer usin ma words wrong!
I suspect there is also a body of professional linguists who oppose your point for the same reasons.
- Comment on Spring break on a budget 6 days ago:
“Aaaahahaha… Blyat.”
- Comment on Millennials Owe 500% More in Student Debt Than Their Parents Did 6 days ago:
To get an associates your course load was probably disproportionally gen ed requirements so… No kidding.
- Comment on Fear the bean 1 week ago:
You want the Ted like the stuffed animal? I guess that could work too.
- Comment on Fear the bean 1 week ago:
Tedpool - like Bill and Ted.
- Comment on type shit 1 week ago:
It’s like that sometimes 🤷
- Comment on type shit 1 week ago:
Cya.
- Comment on type shit 1 week ago:
Yep! After too!
- Comment on type shit 1 week ago:
As a follow on, is your username supposed to be “Holmes” but you decided to wing it on the spelling test?
I’m also circumcised and find getting bent out of shape over it 18 years later to be… an unusual response.
- Comment on [deleted] 2 weeks ago:
It means this person is outrageously pretentious and also not great at written English.
If you try to unpack this word salad, basically this person is of the opinion that you should protest dirty and smart (I get some hard lefty, “mop” kind of vibes), as opposed to just showing up in huge numbers once in awhile not getting anything done. This person then makes an offhand assertion that the system is rigged against this kind of protest in some double standard way. It seems like they think this is not effective, and also that the people that rise to the top in these situations are not the kind of people you probably want in leadership.
It makes me think the person feels they are much smarter than they actually are. Instead they ended up looking kind stupid in a “I’m in high school and I am very smart” sort of way.
At least that’s what I got from reading it twice and that’s as much effort as I have to give it.
- Comment on Vaginal PH by region 2 weeks ago:
Thought this was c/cartographyanarchy for a second.
- Comment on Lutris now being built with Claude AI, developer decides to hide it after backlash 4 weeks ago:
Unless that’s how people are designing front ends for models, it literally DOESN’T work like that. It works like that until you finish training an embedding model with masking related tasks, but that’s the tip of the iceberg. The input vector, after being tokenized, is ingested wholesale. Now there’s sometimes funny business to manage the size of a context window effectively but this isn’t that unless you’re home-rolling and you’re caching your own inputs or something before you give it to the model.
- Comment on I would like to solve the puzzle 4 weeks ago:
Bzz bzz!
That is incorrect.
Dream_weasel?
“I’d like to solve the puzzle: Slipping in mustard and crying”
- Comment on No but seriously 4 weeks ago:
Hmmm…
… … .
Nope.
- Comment on Spicy spicy 5 weeks ago:
That’s how I feel about “slop”.
- Comment on It's important to know where you stand in the hierarchy 5 weeks ago:
Uneducated doesn’t ALWAYS mean dumb.
These are states that can definitely coexist though.
- Comment on [deleted] 5 weeks ago:
Hooray. I’m free!
- Comment on Dumb glasses 5 weeks ago:
Uh… I think you used the wrong pgp key, all I see is *******
- Comment on Dumb glasses 5 weeks ago:
How will that help? I don’t have access to myemail@myprovider.com. Will you share the PW with us?
- Comment on A sudden epiphany. 5 weeks ago:
And I gotta say I really appreciate it!
- Comment on [deleted] 5 weeks ago:
Yock.
- Comment on Lutris now being built with Claude AI, developer decides to hide it after backlash 5 weeks ago:
The joke is that stopping discussion is healthy (which was obviously wrong). So I said I was stopping you–and thus the discussion–and then showed it was healthy with a salad.
- Comment on Lutris now being built with Claude AI, developer decides to hide it after backlash 1 month ago:
I get it. You can’t get by “Ai iS slOp” at top level comments anymore. I get that kind of ending because I would add it… but then I also don’t mind collecting downvotes so ymmv I guess.
- Comment on Lutris now being built with Claude AI, developer decides to hide it after backlash 1 month ago:
I feel like there needs to be a post (and I don’t want to write it, but maybe I eventually will) that outlines what a model really is. It is not just a statistical text prediction machine unless you are being so loose with the definition of “statistical” that it doesn’t even mean anything anymore.
A decent example of a statistical text prediction machine is the middle word suggested by your phone when you’re using the keyboard. An LLM is not that.
In the most general terms, this kind of language model tokenizes a corpus of text based on a vocabulary (which is probably more than just the words in the dictionary), uses an embedding model to translate these tokens into a vector of semantic “meaning” which minimized loss in a bidirectional encoding (probably), that is then trained against a rubric for one or more topic area questions, retrained for instruction and explainability, retrained with reinforcement learning and human feedback to provide guardrails, and retrained again to make use of supplemental materials not part of the original training corpus (resource augmented generation), then distilled, then probably scaled and fine tuned against topic areas of choice (like coding or Korean or whatever) and maybe THEN made available to people to use. There are generally more parts to curriculum learning even than that but it’s a representative-ish start.
My point being that, yes, it would be nuts to pose ANY question to a predictor that says “with 84% probability, the word that is most likely follows ‘I really like’ is ‘gooning’ on reddit”, but even Grok is wildly more sophisticated than that and Grok is terrible.
- Comment on Lutris now being built with Claude AI, developer decides to hide it after backlash 1 month ago:
A little personal flourish doesn’t invalidate the rest IMO. Humans get aggravated and humans are aggravating.
- Comment on Lutris now being built with Claude AI, developer decides to hide it after backlash 1 month ago:
20 line commit: 5 issues and suggestions.
5k line commit: “looks good to me!”
- Comment on Lutris now being built with Claude AI, developer decides to hide it after backlash 1 month ago:
I’m just gonna stop you right there.
🥗
- Comment on Missing Letter 1 month ago:
The dyslexic?