Comment on I wish I was as bold as these authors.

Seraph@fedia.io ⁨5⁩ ⁨months⁩ ago

• GBU_28@lemm.ee ⁨5⁩ ⁨months⁩ ago

  Spicy auto complete is a useful tool.

  But these things are nothing more

  source
• JackGreenEarth@lemm.ee ⁨5⁩ ⁨months⁩ ago

  Whenever any advance is made in AI, AI critics redefine AI so its not achieved yet according to their definition. Deep Blue Chess was an AI, an artificial intelligence. If you mean human or beyond level general intelligence, you’re probably talking about AGI or ASI (general or super intelligence, respectively).

  And the second comment about LLMs being parrots arises from a misunderstanding of how LLMs work. The early chatbots were actual parrots, saying prewritten sentences that they had either been preprogrammed with or got from their users. LLMs work differently, statistically predicting the next token (roughly equivalent to a word) based on all those that came before it, and parameters finetuned during training. Their temperature can be changed to give more or less predictable output, and as such, they have the potential for actually original output, unlike their parrot predecessors.

  source

  • SkyNTP@lemmy.ml ⁨5⁩ ⁨months⁩ ago

    You completely missed the point. The point is people have been lead to believe LLM can do jobs that humans do because the output of LLMs sounds like the jobs people do, when in reality, speech is just one small part of these jobs. It turns, reasoning is a big part of these jobs, and LLMs simply don’t reason.

    source
  • Prunebutt@slrpnk.net ⁨5⁩ ⁨months⁩ ago

    Bullshit. These people know exactly how LLMs work.

    LLMs reproduce the form of language without any meaning being transmitted. That’s called parroting.

    source

    • fartsparkles@sh.itjust.works ⁨5⁩ ⁨months⁩ ago

      [deleted]

      source

      • Prunebutt@slrpnk.net ⁨5⁩ ⁨months⁩ ago

        AI is a marketing buzzword. When someone claims that so-called “AGI” is close, they’re either doing marketing or falling for marketing.

        Since you didn°t address the “parroting” part, I’m assuming that you retract yopr point.

        source
    • lunarul@lemmy.world ⁨5⁩ ⁨months⁩ ago

      LLMs reproduce the form of language without any meaning being transmitted. That’s called parroting.

      Even if an AGI is going to be achieved, there will be people calling it parroting by your definition. That’s the Chinese room argument

      source

      • Prunebutt@slrpnk.net ⁨5⁩ ⁨months⁩ ago

        You’re moving the goalposts.

        source

        • -> View More Comments
  • Tar_alcaran@sh.itjust.works ⁨5⁩ ⁨months⁩ ago

    LLMs work differently, statistically predicting the next token (roughly equivalent to a word) based on all those that came before it, and parameters finetuned during training.

    Which is what a parrot does.

    source

    • naevaTheRat@lemmy.dbzer0.com ⁨5⁩ ⁨months⁩ ago

      Yeah this is the exact criticism. They recombine language pieces without really doing language. The end result looks like language, but it lacks any of the important characteristics of language such as meaning and intention.

      If I say “Two plus two is four” I am communicating my belief about mathematics.

      If an llm emits “two plus two is four” it is outputting a stochastically selected series of tokens linked by probabilities derived from training data. If the statement is true or false then that is accidental.

      Hence, stochastic parrot.

      source

      • ignotum@lemmy.world ⁨5⁩ ⁨months⁩ ago

        If i train an LLM to do math, for the training data i generate a+b=cstatements, never showing it the same one twice.

        It would be pointless for it to “memorize” every single question and answer it gets since it would never see that question again. The only way it would be able to generate correct answers would be if it gained a concept of what numbers are, and how the add operation operates on them to create a new number.
        Rather than memorizing and parroting it would have to actually understand it in order to generate responses.

        It’s called generalization, it’s why large amounts of data is required (if you show the same data again and again then memorizing becomes a viable strategy)

        If I say “Two plus two is four” I am communicating my belief about mathematics.

        Seems like a pointless distinction, you were told it so you believe it to be the case? Why can’t we say the LLM outputs what it believes is the correct answer? You’re both just making some statement based on your prior experiences which may or may not be true

        source

        • -> View More Comments
    • doubtingtammy@lemmy.ml ⁨5⁩ ⁨months⁩ ago

      This is parrot libel

      source
    • ignotum@lemmy.world ⁨5⁩ ⁨months⁩ ago

      You take in some information, combine that with some precious experiences, and then output words

      Which is what an LLM does.

      source

      • WalnutLum@lemmy.ml ⁨5⁩ ⁨months⁩ ago

        Flat epistemological statements like this are why I feel like more STEM people need to take Philosophy.

        source

        • -> View More Comments
  • lunarul@lemmy.world ⁨5⁩ ⁨months⁩ ago

    AI hasn’t been redefined. For people familiar with the field it has always been a broad term meaning code that learns (and subdivided in many types of AI), and for people unfamiliar with the field it has always been a term synonymous with AGI. So when people in the former category put out a product and label it as AI, people in the latter category then run with it using their own definition.

    For a long time ML had been the popular buzzword in tech and people outside the field didn’t care about it. But then Google and OpenAI started calling ML and LLMs simply “AI” and that became the popular buzzword. And when everyone is talking about AI, and most people conflate that with AGI, the results are funny and scary at the same time.

    source

    • force@lemmy.world ⁨5⁩ ⁨months⁩ ago

      and for people unfamiliar with the field it has always been a term synonymous with AGI.

      Gamers screaming about the AI of bots/NPCs making them mad beg to differ

      source

      • lunarul@lemmy.world ⁨5⁩ ⁨months⁩ ago

        I was going to add a note about the exception of video games but decided I’m digressing

        source
  • Seraph@fedia.io ⁨5⁩ ⁨months⁩ ago

    I appreciate you taking the time to clarify thank you!

    source
  • WagyuSneakers@lemmy.world ⁨5⁩ ⁨months⁩ ago

    LLMs have more in common with chatbots than AI.

    source

    • JackGreenEarth@lemm.ee ⁨5⁩ ⁨months⁩ ago

      You are very skilled in the art of missing the point. LLMs can absolutely be used as chatbots, amongst other things. They are more advanced than their predecessors in this, and work in a different way. That does not stop them from being a form of artificial intelligence. Chatbots and AI are not mutually exclusive terms, the first is a subset of the second. And you may indeed be referring to AGI or ASI as AI, a misconception I addressed in my earlier comment.

      source

      • WagyuSneakers@lemmy.world ⁨5⁩ ⁨months⁩ ago

        I work on ML projects. I’m telling you, as a matter of fact, you do not understand what you are talking about.

        Try being less smug and pedantic.

        source

        • -> View More Comments
• frezik@midwest.social ⁨5⁩ ⁨months⁩ ago

  The paper actually argues otherwise, though it’s not fully settled on that conclusion, either.

  source