Comment on Mozilla Firefox new alt-text generator powered by "fully private on-device AI model"
mox@lemmy.sdf.org 4 weeks ago
Neat. I just hope it can be disabled to save power.
Comment on Mozilla Firefox new alt-text generator powered by "fully private on-device AI model"
mox@lemmy.sdf.org 4 weeks ago
Neat. I just hope it can be disabled to save power.
rho50@lemmy.nz 4 weeks ago
Power management is going to be a huge emerging issue with the deployment of transformer model inference to the edge.
I foresee some backpedaling from this idea that “one model can do everything”. LLMs have their place, but sometimes a good old LSTM or CNN is a better choice.