Maybe this helps for people stumbling over this thread: A Google Coral device can do classification on images with around 18fps. That is a 2w USB device.

That is the power of a well built DNN.

And you can adapt this this stuff like Monitoring data, network traffic and much more. All “AI”, same basic technology like ChatGPT and Claude but made for specific tasks. And they do their tasks damn fucking well