When students progress in school, they are no longer interested in simple problems and need harder problems as challenges to stay motivated. They got something similar in the work :
quote :
To address this, we removed more than 50% of our data tagged as easy by using Llama models as a judge and did lightweight SFT on the remaining harder set. In the subsequent multimodal online RL stage, by carefully selecting harder prompts, we were able to achieve a step change in performance.
Eventually, we will ask a question one of those systems and they will consider us with disdain.
Also, for what i read in their work, elaborating such systems becomes more and more convoluted. Eventually, people working on these things, will lose the trail of what they did before. So, they will forget why they came to do something one specific way.
nectar45@lemmy.zip 1 month ago
Why are we only inventing ai nowadays? Where is my flying car?