A Human-Computer Interaction Recognition System Applied to Remote Information Service

Abstract

The invention belongs to the field of computers, in particular to a human-computer interaction identification system applied to remote information services, characterized in that the service system providing network information services or its client has at least one human-computer interaction identification device; The computer-interactive recognition device includes: an auditory collection module for collecting user voice signals; a visual collection module for collecting user face images; a first preprocessing module, a face feature extraction module, and a face recognition module; a second Preprocessing module, speech feature extraction module, speech recognition module; third preprocessing module, facial expression feature extraction module, facial expression recognition module; fourth preprocessing module, language emotion feature extraction module, language emotion recognition module; The gender recognition fusion module is used to fuse the recognition results of the face recognition module and the voice recognition module to form a recognition result that combines face features and voice features; the implicit recognition fusion module is used to integrate the facial expression recognition module It is fused with the recognition results of the language emotion recognition module to form a recognition result that combines facial expression features and voice emotion features.

Description

technical field [0001] The invention belongs to the field of computers, in particular to a human-computer interaction recognition system using human face, facial expression, voice and voice emotion as instruction input means. Background technique [0002] Currently, human-computer interaction methods include touch screen operations, mouse operations, voice control, and the like. At present, with the development of intelligent control technology, a human-computer interaction method that integrates factors such as face, facial expression, voice, and voice emotion will provide users with a more convenient and humanized operating experience. For example, Chinese patent application 200810169232.4 (human-computer interaction method and system) discloses a human-computer interaction method and system, which divides the process of human-computer interaction into different dialogue states, and each dialogue state corresponds to a processing process; the method includes : According t...

AI Technical Summary

Problems solved by technology

This invention combines graphics, text, and voice factors, but does not propose a solution on how to deal with factors such as human faces, facial expressions, voice, voice emotions, etc., and obtain operating instructions

Images