Comment on Mozilla Firefox new alt-text generator powered by "fully private on-device AI model"
rho50@lemmy.nz 5 months agoPower management is going to be a huge emerging issue with the deployment of transformer model inference to the edge.
I foresee some backpedaling from this idea that “one model can do everything”. LLMs have their place, but sometimes a good old LSTM or CNN is a better choice.