Comment on Should have seen it coming

• deranger@sh.itjust.works ⁨2⁩ ⁨months⁩ ago

  I thought the innovative part was using more efficient code, not what it’s trained on.

  source

  • theunknownmuncher@lemmy.world ⁨2⁩ ⁨months⁩ ago

    arxiv.org/abs/2405.20304 they invented their own reinforcement learning framework called Group Relative Policy Optimization

    source

    • Sanctus@lemmy.world ⁨2⁩ ⁨months⁩ ago

      Yeah the original comment in this chain more describes US Telcos and shit, not this particular instance.

      source
  • kreskin@lemmy.world ⁨2⁩ ⁨months⁩ ago

    thats capitalisms dark secret. Its only innovative when it has to be.

    source
  • quokka1@mastodon.au ⁨2⁩ ⁨months⁩ ago

    @deranger @theunknownmuncher the US trying to stifle Chinese progress/stop chip exports has had exactly what anyone could see. China is making leaps and bounds in all sorts of tech areas, innovating around obstacles

    source
  • Fungah@lemmy.world ⁨2⁩ ⁨months⁩ ago

    That’s what they said.

    Like. You can compile better or more diverse datasets to train a model on. But you can also have better code training on the same dataset.

    The model is what the code poops out after its eaten the dataset.

    source