You open the camera of the phone, take the photo and, as if by art of birlibirloque, artificial intelligence recognizes the objects photographed and, depending on what you see, improves the photo. It is only one of the multiple uses of AI in cell phones. It is clear that this technology greatly facilitates the day of anyone. In the case of people with disabilities or the elderly, it transforms life radically. Dimitri Kanevsky, a Google scientist, deaf since the age of three, knows it well. He has been investigating projects related to applications that make this world more accessible to those who suffer from hearing loss for thirty years.
Live Transcribe is one of those magical applications developed by Kanevsky. Integrated in the mobile, it allows to obtain a transcript of a conversation in real time. We have been able to verify its great utility through the researcher, who has carried out a demonstration of this technology in Google's offices in Madrid. Thus, while counting all the research projects on which he currently works, attendees can instantly read on one screen everything he explained. Thanks to this software, which is available in 70 languages, he can communicate better with his grandchildren.
Now that the podcast They are more fashionable than ever, imagine what applications like Live Caption mean for deaf people: this tool makes it easier to read what you hear. Or what is the same, automatically subtitles what is played on a telephone. But it is not worth any cell phone or works in Spanish. If you want to enjoy this software that is only compatible with English, you should buy a Pixel 4 or a Pixel 3.
The Google scientist also tries to improve the communication of people with speech problems through the Euphonia and Parrotron research projects. The first, which is part of the Google AI for social good program, aims to optimize algorithms based on artificial intelligence so that cell phones and computers more accurately transcribe words spoken by ALS sufferers with speech difficulties. The second converts the words of a speaker with atypical speech patterns directly into fluid synthesized speech. Thus, Kanevsky has made a demonstration of how this technology enables understanding with the Google Home smart speaker.
With a sound recognition algorithm with AI based on TensorFlow software, the startup Visualfy is dedicated to integrating into homes an application for deaf people to realize when the bell rings, the alarm goes off or a baby cries. The system is based on a central device and microphones located in different places that listen to everything that happens in the house and translate these sounds into luminous signals. Our work without artificial intelligence will be unfeasible. With it we can implement this system in a simple and more efficient and economical way, said Manel Alcaide, CEO of Visualfy.
Artificial intelligence has also given eyes to blind people. The Lookout application facilitates your autonomy as never before. Based on the use of the mobile phone's camera, the app informs aloud of everything it recognizes when you focus it. In this way, they can identify everything around them, know where they are, where they are going and be able to interact with the world. With artificial intelligence, I place the device at about my face and with the camera I can know the boarding gates at an airport. Simply with that I can guide myself alone, explained Enhamed Enhamed, Spanish paralympic medalist, who uses the cell phone to know the restaurants near him, to know the letters with the menu or to know with which ticket he will pay the bill. These technologies have greatly facilitated my life because I can find out the content of the emails, the comments of the social networks, the letters that come to your home and the texts of the images.
In the meeting organized by Google, everyone highlighted the importance of technology for people with disabilities. The approach to it arises from a need, and is something that can happen to anyone. Because we are all going to get older and that is when the hearing and visual abilities diminish.