When do you think there will be an app for android that could identify and store objects on a database in real time from video capture?

Submitted ⁨⁨8⁩ ⁨months⁩ ago⁩ by ⁨PumpkinDrama@reddthat.com⁩ to ⁨[deleted]⁩

In Star Wars, there was an E-XD-series infiltrator droid that could quickly take inventory of everything in a Rebel warehouse. With the advanced object recognition capabilities of modern AI, it’s only a matter of time before an app for Android can accurately and rapidly identify and store objects in real-time from video capture. When do you think such an app will become available? What’s the app that gets closest to it right now?

source

Comments

Sort:hotnew top

over_clox@lemmy.world ⁨8⁩ ⁨months⁩ ago
Modern AI, as you’re seeing it today, is processed by massive data centers online with thousands of processing units running in parallel, not by your local device. Your device would be way too slow to expect any sort of realtime object recognition, at least with the current state of technology.

source
- deegeese@sopuli.xyz ⁨8⁩ ⁨months⁩ ago
  Don’t underestimate the potential for optimization when you can constrain the problem to a narrow range of uses. Model pruning and custom silicon go far.
  
  source
  - over_clox@lemmy.world ⁨8⁩ ⁨months⁩ ago
    Yes, I’ve been testing FUTO Voice Recognition lately. It’s awesome as hell, but it is far from realtime. And this ain’t even object recognition, it’s only voice recognition.
    
    voiceinput.futo.org
    
    play.google.com/store/apps/details?id=org.futo.vo…
    
    source
- qwertyqwertyqwerty@lemmy.world ⁨8⁩ ⁨months⁩ ago
  Honestly, I expect some form of it in the next five years. Tech can move fast when it wants to and there’s 💵 involved.
  
  source
  - over_clox@lemmy.world ⁨8⁩ ⁨months⁩ ago
    Is Moore’s Law Finally Dead?
    
    source
Zarxrax@lemmy.world ⁨8⁩ ⁨months⁩ ago
There is an app called Object Detector which does this. It’s not particularly accurate and can’t recognize a lot of objects though. It does run on phones in realtime though.

source
4am@lemm.ee ⁨8⁩ ⁨months⁩ ago
Frigate does this on a raspberry pi or Intel NUC already. Would be power hungry in a phone but if you are not training ML models and just looking for objects they already know, the tech would be ready today.

source
ryathal@sh.itjust.works ⁨8⁩ ⁨months⁩ ago
An isolated phone, not for a while. A phone with a dedicated 5g connection would be pretty close.

source
fartsparkles@sh.itjust.works ⁨8⁩ ⁨months⁩ ago
Don’t know about an Android app but YOLOv8 Detect and similar models can detect objects in videos and classify them.

source
altima_neo@lemmy.zip ⁨8⁩ ⁨months⁩ ago
Google Goggles used to be able to do that

source
- Kolanaki@yiffit.net ⁨8⁩ ⁨months⁩ ago
  Google Lens still can.
  
  source
QubaXR@lemmy.world ⁨8⁩ ⁨months⁩ ago
GPT 4 with image uploads gets pretty damn close, though it’s not real-time and processed server side

source
adespoton@lemmy.ca ⁨8⁩ ⁨months⁩ ago
Think about what Apple currently has: dedicated ML processing chip with multiple cores, and yet the on-device object recognition is still an “overnight while plugged in” process for a single image, and only detects a limited number of object types.

Real-time mobile offline OR is still the mythical “at least ten years out.” It needs improvements in processors, sample sets, training data and algorithms to get to real-time.

source
DrownedRats@lemmy.world ⁨8⁩ ⁨months⁩ ago
Not likely in the near future, probably not feasible in the long term either. It’s not just about recognising an object. You could write a program that recognises a screw but you’d need far more complicated sensors and algorithms to identify the dimensions, specific characteristics, material composition, design specifications, etc, then apply that to every screw, bolt, washer, small component and assembly, tubes, threaded rods, tyres, pistons, brake pads, resistors, capacitors, diodes, seals, consumables, etc.

For a long time, I think that kind of thing would be wildly inaccurate, hugely expensive, massively complicated, and much less efficient than asking a human to kindly go over there and check all those things manually.

source
breadsmasher@lemmy.world ⁨8⁩ ⁨months⁩ ago
Doesn’t google lens basically do this already?

source
- over_clox@lemmy.world ⁨8⁩ ⁨months⁩ ago
  Yes, but OP is referring to realtime object recognition. Although we don’t have to wait very long for object recognition right now, we still have to wait a bit. That’s not quite realtime.
  
  source
  - dope@lemm.ee ⁨8⁩ ⁨months⁩ ago
    Object recognition.
    
    Then “action recognition”. I mean, what the objects are doing. To each other and such.
    
    Then you have a narration machine. Which could be nice.
    
    source
    -> View More Comments