Using a raised eyebrow or smile, people with speech or physical disabilities can now operate their Android-powered smart phones without using their hands, Google said on Thursday.
Two new tools put machine learning and front-facing cameras on smart phones to work, identifying face and eye movements. Users can look at their phone screens and select a task by smiling, raising eyebrows, opening their mouths, or looking to the left, right or up.
The Centers for Disease Control and Prevention states that 61 million adults in the United States live with disabilities, which has pushed Google, Apple and Microsoft to make products and services more accessible to them. "Every day, people use voice instructions, like ‘Hey Google', or their hands to operate their phones," the tech giant Google said in a blog post. "However, that's not always possible for people with serious physical or speech disabilities."
The changes are the result of two new features: One is called "Camera Switches", which lets people use their faces instead of taps to interact with smart phones. The other is Project Activate, a new Android application which allows people to use those gestures to start an action, like having a phone play a recorded phrase, send text, or make a call. The free Activate app is available in Australia, Britain, Canada and the United States at the Google Play Store.
Apple, Google and Microsoft have kept rolling out inventions that make Internet technology more accessible to people with disabilities or who find that age has made some tasks, such as reading, more difficult. Voice-instructed digital assistants built into speakers and smart phones can enable people with sight or movement challenges to tell computers what to do. There is software that identifies text on web pages or in images and then reads it aloud, as well as automatic generation of captions that display what is said in videos. Apple built "Assistive Touch" into the software powering its smart watches. It lets touch screen displays be controlled by sensing movements such as finger pinches or hand clenches.