ndru
@ndru@lemmy.world
- Comment on How close are we to "manually tuning" LLMs? 1 month ago:
I read a series of super interesting set of posts a few months back where someone was exploring the dimensional concept space in LLMs. The jump off point was the discovery of weird glitch tokens which would break GPTs, making them enter a tailspin of nonsense, but the author presented a really interesting deep dive into how concepts are clustered dimensionally. I don’t know if any of that means we’re any where cost to being able to find those conceptual weighting clusters and tune them, but well worth a read for the curious. There’s also a YouTube series which really dives into the nitty gritty of LLMs, much of which goes over my head, but helped me understand at least the outlines of how the magic happens.
(Excuse any confused terminology here, my knowledge level is interested amateur!)
Posts on glitch tokens and exploring how an LLM encodes concepts in multidimensional space. lesswrong.com/…/solidgoldmagikarp-iii-glitch-toke…
YouTube series is by 3Blue1Brown - m.youtube.com/@3blue1brown
- Comment on The color blurple 1 year ago:
Tip of the iceberg. I’m perplexed about every 30 minutes working on this codebase.
- Submitted 1 year ago to mildlyinfuriating@lemmy.world | 5 comments
- Comment on How much did photography "stole" painter jobs ? 1 year ago:
Just to add some cool etymology to your reply: the word silhouette comes from a type of affordable portrait made by quickly painting or cutting out a persons profile in black paper.
The word silhouette is derived from the name of Étienne de Silhouette, a French finance minister who, in 1759, was forced by France’s credit crisis during the Seven Years’ War to impose severe economic demands upon the French people, particularly the wealthy.[3] Because of de Silhouette’s austere economies, his name became synonymous with anything done or made cheaply and so with these outline portraits.[4][5] Prior to the advent of photography, silhouette profiles cut from black card were the cheapest way of recording a person’s appearance.[6][7]
en.wikipedia.org/wiki/Silhouette
This is also an interesting article on the subject of pre-photographic portraiture: en.m.wikipedia.org/wiki/Portrait_miniature
