Huawei's AI helps deaf children read through an app
That technology is used for more than leisure or work is good news, especially when it comes to helping those who need it most. In this sense, Huawei's Artificial Intelligence has been used to develop an application that teaches reading to children with hearing problems. This is StorySign, an app capable of to read children's books and convert them into sign language. At the moment, it supports ten sign languages and works on any Android device with version 6.0 or higher.
To create StorySign, Huawei has joined forces with independent companies, as well as the European Deaf Union and the British Association of the Deaf. The idea started in order to help the more than 32 million children with this type of problem to read. The interface of the application is very simple, it has with a selection of children's books, plus a cute avatar designed by Aardman Animations. Huawei's AI's job here is to translate these books into sign language so that children who are unable to hear can learn to read. The mobile camera also plays a very important role, since it is the necessary tool to detect the words.
https://youtu.be/oxqNAivo_p0
To use the application, it will be necessary to have the book in physical format. Then, when opening the app, you will have to choose the same title from the StorySign library.During use it is necessary to hold the phone on the pages of the physical copy at an angle of 45 degrees. Next, the Star avatar will translate it into sign language. AI performance will increase the speed at which the book page loads in the app for a better user experience.
For now, StorySign supports ten languages, including Spanish. Likewise, each language currently has only one book. However, Huawei has ensured that more will be incorporated in the future StorySign is now available on Google Play and is compatible with all phones and tablets that have Android 6.0 or higher.
