Is it possible to use an Android device entirely as "black box" (without touching it looking at it)?

Submitted ⁨⁨1⁩ ⁨day⁩ ago⁩ by ⁨SanctimoniousApe@lemmings.world⁩ to ⁨[deleted]⁩

Google’s “Voice Access” is decent for controlling the device through verbal commands, but you have to be looking at the screen to get results - it won’t read anything back to you.

Google’s “TalkBack” will read things on screen to you, but you have to interact with the screen physically (never mind the significant change in how interactions work - which I understand the need for - but it’s still a serious mental PITA to switch between the two interaction methodologies frequently).

Is there no way to just interact with it entirely verbally? A (very) simple example of what I’m looking for:

"What are the current Google News headlines?"
Starts reading each one aloud, along with the names of the sources.
"Read the article about Trump caught making out with Elon from AP News."
Proceeds to load the article & read it aloud.

(Yeah, I know there are podcasts for this - it’s meant to illustrate the basic idea of completely verbal interaction with the device, not be an actual problem I’m looking for someone to provide a solution to.)

It just seems to me that we should be able to do this by now - especially with all the AI blow-up over the past couple of years. Can anybody point me to a usable solution to accomplish this?

TIA.

source

Comments

Sort:hotnew top

Catoblepas@lemmy.blahaj.zone ⁨1⁩ ⁨day⁩ ago
Sorry if I’m overlooking something obvious here, but you’re basically asking about accessibility features, right? Whatever settings and features blind users use should let you navigate without looking at it.

Although I will say you probably would need to get used to listening to text at a very high speed to use it at the speed you read.

source
- SanctimoniousApe@lemmings.world ⁨1⁩ ⁨day⁩ ago
  Imagine someone blind who also has Parkinson’s - they can’t see to use Voice Access, and they can’t control their hands well enough to interact with the screen physically in a reliable manner. You can’t actually use those two accessibility features together - they are mutually exclusive in that they require you either be able to see the screen, OR you must be able to interact with it physically as it reads out what you’re touching. Why is there no way to interact entirely verbally?
  
  source
  - Catoblepas@lemmy.blahaj.zone ⁨1⁩ ⁨day⁩ ago
    Someone who knows more about how to/if you can do this on Android will have to answer the specifics for that; I know on iOS you can use custom voice control actions (along with default voice control phone navigation mode) to do more or less what you’re describing. I’m surprised if Android has no accessibility features that work similarly.
    
    source
    -> View More Comments
Skezlarr@aussie.zone ⁨1⁩ ⁨day⁩ ago
I might be misunderstanding the question, so if you’re looking to make an existing android device you have work like this, please ignore the below.

Maybe a Google Nest Mini would do what you’re looking for? It’s definitely got the ability to be interacted with entirely verbally, but I guess the downside is a smaller selection of apps that do work with it (there is a list on the Google store of which apps it works with)

source
- SanctimoniousApe@lemmings.world ⁨19⁩ ⁨hours⁩ ago
  I have a few Google Home Minis, and so far as I know they are the same thing - just rebranded. It’s basically the same thing as Google Assistant built into every Google-approved/equipped (meaning it has their full suite of apps pre-installed) device. They’re just so limited. I know if no way to get them to read Lemmy posts as I’m my added second example.
  
  I also thought of another use case for what I’m after that might be more universally applicable and easily understood. Imagine someone doing some relatively mindless menial job such as working an assembly line, janitorial work, chauffer - something where your mind is relatively unoccupied, but you’re not free to look at and/or touch your device (whether it be due to practicality, or job rules). While doing that job, I want to be able to have the device read and interact with something of interest to me at that moment, rather than just relying on podcasts with predefined content. Kind of like having someone next to me doing all the interfacing between me and the device.
  
  source