Comment on Larian CEO Responds to Divinity Gen AI Backlash: 'We Are Neither Releasing a Game With Any AI Components, Nor Are We Looking at Trimming Down Teams to Replace Them With AI'

• utopiah@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

  There are AI’s that are ethically trained

  Can you please share examples and criteria?

  source

  • dogslayeggs@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

    Sure. My company has a database of all technical papers written by employees in the last 30-ish years. Nearly all of these contain proprietary information from other companies (we deal with tons of other companies and have access to their data), so we can’t build a public LLM nor use a public LLM. So we created an internal-only LLM that is only trained on our data.

    source

    • Fmstrat@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

      I’d bet my lunch this internal LLM is a trained open weight model, which has lots of public data in it. Not complaining about what your company has done, as I think that makes sense, just providing a counterpoint.

      source
    • utopiah@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

      You are solely using your own data or rather you are refining an existing LLM or rather RAG?

      I’m not an expert but AFAIK training an LLM requires, by definition, a vast mount of text so I’m skeptical that ANY company publish enough papers to do so. I understand if you can’t share more about the process. Maybe me saying “AI” was too broad.

      source
    • tb_@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

      Completely from scratch?

      source
  • oplkill@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

    It can use public domain licenced data

    source

    • utopiah@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

      Right, and to be clear I’m not saying it’s not possible. This isn’t a trick question, it’s a genuine request to hopefully be able to rely on such tools.

      source
  • Fmstrat@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

    Apertus was developed with due consideration to Swiss data protection laws, Swiss copyright laws, and the transparency obligations under the EU AI Act. Particular attention has been paid to data integrity and ethical standards: the training corpus builds only on data which is publicly available. It is filtered to respect machine-readable opt-out requests from websites, even retroactively, and to remove personal data, and other undesired content before training begins.

    www.swiss-ai.org/apertus

    Fully open source, even the training data is provided for download. That being said, this is the only one I know of.

    source

    • utopiah@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

      Thanks, a friend recommended it few days ago indeed but unfortunately AFAICT they don’t provide the CO2eq in their model card nor an analogy equivalence non technical users could understand.

      source
  • Hackworth@piefed.ca ⁨3⁩ ⁨weeks⁩ ago

    Adobe’s image generator (Firefly) is trained only on images from Adobe Stock.

    source

    • utopiah@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

      Does it only use that or doesn’t it also use an LLM to?

      source

      • Hackworth@piefed.ca ⁨2⁩ ⁨weeks⁩ ago

        The Firefly image generator is a diffusion model, and the Firefly video generator is a diffusion transformer. LLMs aren’t involved in either process. I believe there are some ChatGPT integrations with Reader and Acrobat, but that’s unrelated to Firefly.

        source

        • -> View More Comments
• riskable@programming.dev ⁨3⁩ ⁨weeks⁩ ago

  It’s even more complicated than that: “AI” is not even a well-defined term. Back when Quake 3 was still in beta (“the demo”), id Software held a competition to develop “bot AIs” that could be added to a server so players would have something to play against while they waited for more people to join (or you could have players VS bots style matches).

  That was over 25 years ago. What kind of “AI” do you think was used back then? 🤣

  The AI hater extremists seem to be in two camps:

  • Data center haters
  • AI-is-killing-jobs

  The data center haters are the strangest, to me. Because there’s this default assumption that data centers can never be powered by renewable energy and that AI will never improve to the point where it can all be run locally on people’s PCs (and other, personal hardware).

  Yet every day there’s news suggesting that local AI is performing better and better. It seems inevitable—to me—that “big AI” will go the same route as mainframes.

  source

  • acosmichippo@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

    colloquially today most people mean genAI like LLMs when they say “AI” for brevity.

    Because there’s this default assumption that data centers can never be powered by renewable energy

    that’s not the point at all. the point is, even before AI, our energy needs have been outpacing our ability/willingness to switch to green energy. We are STILL using more fossil fuels than at any point in the history of the world. Now AI is just adding a whole other layer of energy demand on top of that.

    source

    • riskable@programming.dev ⁨3⁩ ⁨weeks⁩ ago

      The power use from AI is orthogonal to renewable energy. From the news, you’d think that AI data centers have become the number one cause of global warming. Yet, they’re not even in the top 100. Even at the current pace of data center buildouts, they won’t make the top 100… ever.

      AI data center power utilization is a regional problem specific to certain localities. It’s a bad idea to build such a data center in certain places but companies do it anyway (for economic reasons that are easy to fix with regulation). It’s not a universal problem across the globe.

      Aside: I’d like to point out that the fusion reactor designs currently being built and tested were created using AI. Much of the advancements in that area are thanks to “AI data centers”. If fusion power becomes a reality in the next 50 years it’ll have more than made up for any emissions from data centers. From all of them, ever.

      source
  • dogslayeggs@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

    Power source is only one impact. Water for cooling is even bigger. There are data centers pumping out huge amounts of heat in places like AZ, TX, CA where water is scarce and temps are high.

    source

    • lightnsfw@reddthat.com ⁨3⁩ ⁨weeks⁩ ago

      Is the water “consumed” when used for this purpose? I don’t know how data centers do it but it wouldn’t seem that it would need to be constantly drawing water from a local system. They could even source it from elsewhere if necessary.

      source

      • dogslayeggs@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

        thecurrentga.org/…/data-centers-consume-massive-a…

        Some use up the water through evaporation, so they constantly draw water. Some “consume” the water, meaning they have a closed system of cooling water, but that uses a lot more electricity than evaporative cooling, which also uses water to generate.

        source
      • riskable@programming.dev ⁨3⁩ ⁨weeks⁩ ago

        Data centers typically use closed loop cooling systems but those do still lose a bit of water each day that needs to be replaced. It’s not much—compared to the size of the data center—but it’s still a non-trivial amount.

        A study recently came out (it was talked about extensively on the Science VS podcast) that said that a long conversation with an AI chat bot (e.g. ChatGPT) could use up to half a liter of water—in the worst case scenario.

        This statistic has been used in the news quite a lot recently but it’s a bad statistic: That water usage counts the water used by the power plant (for its own cooling). That’s typically water that would come from ponds and similar that would’ve been built right alongside the power plant (your classic “cooling pond”). So it’s not like the data centers are using 0.5L of fresh water that could be going to people’s homes.

        For reference, the actual data center water usage is 12% of that 0.5L: 0.06L of water (for a long chat). Also remember: This is the worst-case scenario with a very poorly-engineered data center.

        Another stat from the study that’s relevant: Generating images uses much less energy/water than chat. However, generating videos uses up an order of magnitude more than both (combined).

        So if you want the lowest possible energy usage of modern, generative AI: Use fast (low parameter count), open source models… To generate images 👍

        source
  • jjjalljs@ttrpg.network ⁨2⁩ ⁨weeks⁩ ago

    The data center haters are the strangest, to me. Because there’s this default assumption that data centers can never be powered by renewable energy

    Opportunity costs

    source