Comment on Making a better CLIP interrogator with the FLUX T5 encoder?

erenkoylu@lemmy.ml ⁨2⁩ ⁨months⁩ ago

• AdComfortable1514@lemmy.world ⁨2⁩ ⁨months⁩ ago

  Hmm. I mean the FLUX model looks good

  , so there must maybe be some magic with it ?

  T5 Huggingface: huggingface.co/docs/transformers/model_doc/t5

  T5 paper : arxiv.org/pdf/1910.10683

  Any suggestions on what LLM i ought to use instead of T5?

  source

  • erenkoylu@lemmy.ml ⁨2⁩ ⁨months⁩ ago

    aya based llms are extremely powerful. same with qwen

    source

    • AdComfortable1514@lemmy.world ⁨2⁩ ⁨months⁩ ago

      That’s good to know. I’ll try them out. Thanks.

      source

      • erenkoylu@lemmy.ml ⁨2⁩ ⁨months⁩ ago

        qwen2.5 just came out, and looks amazing. You can try it with ollama.

        source

        • -> View More Comments