Comment on OpenAI Is A Bad Business

• circuscritic@lemmy.ca ⁨1⁩ ⁨month⁩ ago

  Llama is the model I use most often, followed by ChatGPT and Claude.

  Others as well, but yes, it is incredible useful for what I use it for.

  source

  • avidamoeba@lemmy.ca ⁨1⁩ ⁨month⁩ ago

    Self-hosted?

    source

    • circuscritic@lemmy.ca ⁨1⁩ ⁨month⁩ ago

      Yes and no, I have self-hosted models on one of my Linux boxes, but even with a relatively modern 70 series Nvidia GPU, it’s still faster to use free non-local services like ChatGPT or DDG.

      My rule of thumb is to never enter in any data that I wouldn’t also be willing to upload cleartext to Google Drive or OneDrive.

      Sometimes that means modifying text before submitting it, and other times having to rely entirely on self-hosted tools.

      source