Comment on Are there any llms made from 100% public domain / permissively licensed training data?

CameronDev@programming.dev ⁨8⁩ ⁨hours⁩ ago

• ell1e@leminal.space ⁨8⁩ ⁨hours⁩ ago

  huggingface.co/datasets/…/Nemotron-CC-Code-v1 They’re using Common Crawl and there’s no mention of filtering for public domain licenses in this text. Pretty safe to say it’s probably a bad dataset. (In my opinion, I’m not a lawyer. This isn’t legal advice.)

  source

  • CameronDev@programming.dev ⁨7⁩ ⁨hours⁩ ago

    If that dataset has copyrighted material, nvidia committed a clear copyright violation by publishing it publically. I’m happy to trust that nvidias lawyers have vetted it properly.

    source

    • dhork@lemmy.world ⁨5⁩ ⁨hours⁩ ago

      I’m happy to trust that nvidias lawyers have vetted it properly.

      Yes, but while you would vet it by “what complies with laws”, large companies use the “what can we getaway with” metric. And if the only penalty is a fine, they will just consider that cost of doing business, and do it anyway.

      source

      • CameronDev@programming.dev ⁨4⁩ ⁨hours⁩ ago

        True, but as per the anthropic settlement linked in another comment, the penalties are pretty significant. 1.5B is a pretty reasonable fine against a 59B profit. Copyright still has some pretty significant teeth.

        Its not like its antitrust /j

        source

        • -> View More Comments
    • pulsewidth@lemmy.world ⁨7⁩ ⁨hours⁩ ago

      You think the wealthiest business on Earth is afraid of a little thing like copyright law?

      source
    • ell1e@leminal.space ⁨7⁩ ⁨hours⁩ ago

      oh you sweet summer child…

      twobirds.com/…/landmark-ruling-of-the-munich-regi…

      reuters.com/…/us-judge-approves-anthropics-15-bil…

      (I’m just linking random lawsuits. I’m not a lawyer, this isn’t legal advice.)

      source

      • Grimy@lemmy.world ⁨5⁩ ⁨hours⁩ ago

        oh you sweet summer child

        Image

        source
      • CameronDev@programming.dev ⁨6⁩ ⁨hours⁩ ago

        There is no need to call me a sweet summer child.

        I’m not terribly swayed by a Munich regional case, especially as its still under appeal.

        The anthropic settlement definitely is a bit more meaningful though, although it does contradict the Munich one:

        We reached this settlement in 2025, after the court’s landmark ruling that training AI on books is fair ​use under copyright law

        The basically settled because they stole the copies of books they used to train on. If they had just paid for a copy of the books they possibly would have been fine.

        source

        • -> View More Comments
      • TrickDacy@lemmy.world ⁨4⁩ ⁨hours⁩ ago

        I’m not a lawyer, this isn’t legal advice.

        What an annoying and pointless thing to write several times in a row. One time was more than enough.

        source

        • -> View More Comments
• False@lemmy.world ⁨3⁩ ⁨hours⁩ ago

  They’re also some of the better open weight models

  source

  • CameronDev@programming.dev ⁨3⁩ ⁨hours⁩ ago

    Ive never tried them tbh, have you? Do they work for code?

    source

    • False@lemmy.world ⁨2⁩ ⁨hours⁩ ago

      Not personally, the larger ones rate well, but may be out of reach for most home users due to hardware requirements. Generally open weights models have been about about 3 to 6 months behind the big closed frontier models

      source