Comment on Big Walk Used AI In 'The Final Stretch' Of Development, Kicking Off Intense Awards Debate

• KeenFlame@feddit.nu ⁨2⁩ ⁨days⁩ ago

  This is the infantile mansplaining-like phenomenon I was eluding to. You don’t know. You think that it is a compression algorithm. Another, that it is a stochastic parrot and yet another that it is a live being. It is rare except for the people that actually read and understand the code that people admit, that the inner workings of the neural net is still a complete mystery. Oh, we know things like that the k-space seem to emphasize phrases that are adjacent to but not necessarily part of output. We know that we can afford certain sidebands for orthogonal functions we also don’t understand, except that they improve this or that tendency. It is extremely not a compression algorithm for several reasons. The first one being the inability to reform the original message with confidence, or with the slightest hint of efficiency. We do not know how it works, and it is easy to spot emotional counterfactual discourse by the confidence with which they proclaim to understand how modern machine learning models work.

  source

  • lime@feddit.nu ⁨2⁩ ⁨days⁩ ago

    i feel like there is a fundamental difference between “we don’t know why it chooses the coefficients it does” and “we don’t know how it works”. if anything, that’s what’s infantile. that, and accusing people of it. the fact that gzip can be used as a language model should be a pretty big indicator.

    source