Comment on Chatbot letdown: Hype hits rocky reality

• Creesch@beehaw.org ⁨8⁩ ⁨months⁩ ago

  I don’t know how to say this in a less direct way. If this is your take then you probably should look to get slightly more informed about what LLMs can do. Specifically, what they can do if you combine them with with some code to fill the gaps.

  Things LLMs can do quite well:

  • Generate useful search queries.
  • Dig through provided text to determine what it contains.
  • Summarize text.

  These are all the building blocks for searching on the internet. If you are talking about local documents and such retrieval augmented generation (RAG) can be pretty damn useful.

  source

  • Dark_Arc@social.packetloss.gg ⁨8⁩ ⁨months⁩ ago

    That’s not entirely fair either though… They can incorrectly summarize, omit important information, or just make stuff up.

    source

    • Creesch@beehaw.org ⁨8⁩ ⁨months⁩ ago

      True, though that isn’t all that different from people doing knee jerk responses on the internet…

      I am not claiming they are perfect, but for the steps I described a human aware of the limitations is perfectly able to validate the outcome. While still having saved a bunch of time and effort on doing an initial search pass.

      All I am saying is that it is fine to be critical of LLM and AI claims in general as there is a lot of hype going on. But some people seem to lean towards the “they just suck, period” extreme end of the spectrum. Which is no longer being critical but just being a reverse fanboy/girl/person.

      source

      • Dark_Arc@social.packetloss.gg ⁨8⁩ ⁨months⁩ ago

        All I am saying is that it is fine to be critical of LLM and AI claims in general as there is a lot of hype going on. But some people seem to lean towards the “they just suck, period” extreme end of the spectrum. Which is no longer being critical but just being a reverse fanboy/girl/person.

        Fair, nuance is an endangered species.

        source
  • mikegioia@lemmy.ml ⁨8⁩ ⁨months⁩ ago

    Ask it to search or list all of Bach’s children and you can see the wheels completely fall off. It was inventing people with actual fake birth and death dates and also gave me some of Handel’s children!

    source

    • Creesch@beehaw.org ⁨8⁩ ⁨months⁩ ago

      What do you mean by “it”? The chatGPT interface? Could be, but then you are also missing the point I am making.

      After all, chatGPT is just one of the possible implementations of LLMs and indeed not perfect in how they implemented some things. In fact,

      What I am saying is that it is possible to implement search functionality around LLMs that is both capable and can be reviewed by a human user to make sure it is not fucking up.

      Let me demonstrate. I am doing some steps that you would normally automate with conventional code:

      I asked chatGPT

      *“I want to provide a list of all the children bach had. What would be a suitable google query”

      It then responded with.

      “To compile a comprehensive list of Johann Sebastian Bach’s children, a suitable Google query would be: “List of Johann Sebastian Bach’s children names”. This query is specific enough to indicate that you’re looking for a detailed list, including the names of all the children, which should yield targeted results.”

      The following step I did manually, but is something you would normally have automated. I put the suggested query in google, I quickly grabbed the first 5 links and then put the following in chatGPT.

      The top 5 results in google are the pages I provided below. Browse to each page, and answer the query “List of Johann Sebastian Bach’s children names”. Just answer the query, but let me know if there is conflicting information on the page

      en.wikipedia.org/wiki/Bach_family
      www.classicfm.com/composers/bach/…/children/
      bachonbach.com/…/faq-26-what-were-the-names-of-al…
      www.spiritsound.com/music/bachchildren.html
      www.grahamsmusic.net/…/bach-s-wives-and-children

      It then proceeded to give me the following answer

      Johann Sebastian Bach had 20 children in total. With his first wife, Maria Barbara Bach, he had seven children, four of whom survived into adulthood: Catharina Dorothea, Wilhelm Friedemann, Carl Philipp Emanuel, and Johann Gottfried Bernhard. With his second wife, Anna Magdalena Wilcke, he had 13 children, of whom six survived into adulthood: Gottfried Heinrich, Elisabeth Juliane Friederica, Johanna Carolina, Regina Susanna, Johann Christoph Friedrich, and Johann Christian

      Going over the search results myself seems to confirm this list.

      source
• millie@beehaw.org ⁨8⁩ ⁨months⁩ ago

  Gpt is fantastic at search. Like, check its work but it’ll check hundreds of pages of results way faster than you can.

  source