Mobile app helps people with visual impairments to recognize emotions

He recognizes the emotions and plays the appropriate sound.

Мобільний додаток допоможе людям з вадами зору розпізнавати емоції

Huawei has developed a smartphone application that can recognize human emotions and to reproduce the corresponding sounds, and display images on the screen. The developers believe that it will help people with vision problems to better understand the emotions of the interlocutors, according to the New Atlas, informs Rus.Media.

The developers of hardware and software give enough attention to technologies that help people with disabilities, including people with visual impairments. For example, in Android and iOS there are programs or system services that read out the elements of the interface, and converted language text. But these technologies are handy when using the devices themselves or the Internet, and poorly are used to interact with the real world.

The developers of Huawei has created an application Facing Emotions, can recognize emotions of people in front of the smartphone camera and report them to the user in a convenient way. During the program operation, the mobile can be hold in hand or put into a special case. The app uses the camera on the rear side of the smartphone, and recognizes them with the help of emotions by facial expressions on the face. The developers taught the algorithm to recognize seven types of emotion: happiness, surprise, sadness, fear, anger, contempt and disgust.

Мобільний додаток допоможе людям з вадами зору розпізнавати емоції

After recognition of facial expressions, the app plays a sound and displays a model of a person with such emotion. The image is displayed on the screen in yellow and black, whereby contrast is improved and it is easier to see for people with low vision. App published in Google Play, but only available for smartphone Huawei Mate 20 Pro. The company claims that this is due to used in this processor. It should be noted that the processor HiSilicon Kirin 980 installed in five models of smartphones, but the app is not working.

Other major technology companies are also developing programs that help people with visual impairments. For example, Microsoft has created a program Navigator that allows the user to follow a given route or search for establishments nearby. While voice prompts from the application are reproduced with headphones so that the user knows the direction in which the one or the other institution. Google introduced in may 2018 application that can recognize everyday objects in the field of view of the camera of the smartphone and read their description. And Instagram at the end of 2018 has implemented a feature describing the contents of pictures by using the synthesis system voice.