13 Surprising Uses For Emotion AI Technology

The concept of emotional artificial intelligence or ‘emotion AI’ conjures up visions of humanoid robots in customer service roles, such as the lifelike ‘receptionist’ welcoming guests at a Tokyo hotel. A number of companies have added emotion recognition to their personal assistant robots so they too can have more humanlike interactions.

But humanoid robotics is just one of many potential uses for emotion AI technology, says Annette Zimmermann, research vice president at Gartner.

“ By 2022, 10% of personal devices will have emotion AI capabilities”

Tech giants, as well as smaller startups, have been investing in emotion AI for over a decade, using either computer vision or voice analysis to recognize human emotions. Many of these companies started with a focus on market research, analyzing and capturing human emotions in response to a product or TV commercial. Commercial deployments are slowly emerging in virtual personal assistants (VPAs), cars, call centers, robotics and smart devices.

Gartner predicts that by 2022, 10% of personal devices will have emotion AI capabilities, either on-device or via cloud services, up from less than 1% in 2018.

“We will continue to find many new and exciting uses for emotion AI technology over the coming year,” Zimmermann says. “However, smaller providers will need to focus their efforts on a limited number of applications and industries, instead of trying to be everything to everyone.”

New uses are evolving quickly

In the past two years, emotion AI vendors have moved into completely new areas and industries, helping organizations to create a better customer experience and unlock real cost savings. These uses include:

1. Video gaming. Using computer vision, the game console/video game detects emotions via facial expressions during the game and adapts to it.
2. Medical diagnosis. Software can help doctors with the diagnosis of diseases such as depression and dementia by using voice analysis.
3. Education. Learning software prototypes have been developed to adapt to kids’ emotions. When the child shows frustration because a task is too difficult or too simple, the program adapts the task so it becomes less or more challenging. Another learning system helps autistic children recognize other people's emotions.
4. Employee safety. Based on Gartner client inquiries, demand for employee safety solutions are on the rise. Emotion AI can help to analyze the stress and anxiety levels of employees who have very demanding jobs such as first responders.
5. Patient care. A ‘nurse bot’ not only reminds older patients on long-term medical programs to take their medication, but also converses with them every day to monitor the their overall wellbeing.
6. Car safety. Automotive vendors can use computer vision technology to monitor the driver's emotional state. An extreme emotional state or drowsiness could trigger an alert for the driver.
7. Autonomous car. In the future, the interior of autonomous cars will have many sensors, including cameras and microphones, to monitor what is happening and to understand how users view the driving experience.
8. Fraud detection. Insurance companies use voice analysis to detect whether a customer is telling the truth when submitting a claim. According to independent surveys, up to 30% of users have admitted to lying to their car insurance company in order to gain coverage.
9. Recruiting. Software is used during job interviews to understand the credibility of a candidate.
10. Call center intelligent routing. An angry customer can be detected from the beginning and can be routed to a well-trained agent who can also monitor in real-time how the conversation is going and adjust.
11. Connected home. A VPA-enabled speaker can recognize the mood of the person interacting with it and respond accordingly.
12. Public service. Partnerships between emotion AI technology vendors and surveillance camera providers have emerged. Cameras in public places in the United Arabic Emirates can detect people's facial expressions and, hence, understand the general mood of the population. This project was initiated by the country's Ministry of Happiness.
13. Retail. Retailers have started looking into installing computer vision emotion AI technology in stores to capture demographic information and visitors' mood and reactions.

However, barriers to adoption remain. A recent Gartner consumer survey revealed that there are still considerable trust issues around emotion AI technologies; that is, users feel less comfortable with emotion AI via camera capture compared to voice analysis.

“Providers need to convince us that our emotion data is safeguarded and only used in an anonymized way to train other systems by implementing transparent data management policies,” cautions Zimmerman.