Multi-modal emotion interaction method, intelligent equipment, system, electronic equipment and medium

Abstract

The invention relates to a multi-modal emotion interaction method, intelligent equipment, a system, electronic equipment and a medium. The multi-modal emotion interaction method comprises the following steps: determining a multi-modal input parameter set for representing the emotion of a user, determining the current emotion state of the user according to the multi-modal input parameter set, and determining behavior performance fed back to the user according to the current emotion state of the user and a preset emotion response library; and feeding back the determined behavior representation to the user by the hardware device or the virtual agent. According to the multi-modal emotion interaction method, multiple modal parameters representing the emotion of the user are collected through multiple channels, and then the current facial emotion of the user is comprehensively and accurately sensed through fusion processing of the collected modal parameters; and the defects of misjudgment and the like when the traditional emotion interaction method only identifies the emotion of the user based on single channels such as vision are avoided.

Description

technical field [0001] The invention relates to the field of human-computer emotional interaction, in particular to a multi-modal emotional interaction method, intelligent equipment, system, electronic equipment and media. Background technique [0002] At present, the globalization trend of population aging is very obvious. With the deepening of population aging, there are more and more "empty nest elderly" families. These elderly people not only face the situation of no one to take care of them in their daily life, but also face the dilemma of no one to talk about their emotions. Seriously affect the physical and mental health of the elderly. [0003] In order to solve the problem that the elderly have no one to take care of them, care robots for the elderly have appeared on the market. Although these nursing robots can provide some care and care for the daily life of the elderly, the price is relatively high and the nursing functions provided are very limited, and it is ...

AI Technical Summary

Problems solved by technology

Although these care robots can provide some care and care for the daily life of the elderly, they are expensive and provide very limited care functions, and it is not convenient for users (such as the elderly) to upgrade and maintain

In addition, these care robots often lack multi-modal emotional interaction capabilities, it is difficult to establish natural emotional communication with users, and they cannot correctly understand the real emotional state of users

Images