Human-computer facial expression interaction system based on biological signal

Abstract

The present invention provides a human-computer facial expression interaction system based on a biological signal. The system comprises an electric acquisition instrument worn on the head, and a robot head with the functions of the sense organs and the expression; the robot head has two neck movement freedom degrees, two lip movement freedom degrees and two eye movement freedom degrees, movement of the eyes, the lip and other facial organs can be achieved so that various expressions can be formed, and various channels for interaction between the system and an operator are provided. According to the system, the facial expressions can be interactively obtained by combining the method based on the biological signal with the digital image processing, the limitation that in a traditional expression interaction system, a person must face a camera and light must exist in a using environment is overcome, and the using flexibility is greatly improved. As proved by experiments, the system is feasible, can overcome the using environment limitation which can not be overcome by the traditional expression interaction system, and has very good using flexibility.

Description

technical field [0001] The invention relates to the technical field of human-computer interaction, in particular to a biological signal-based human-computer facial expression interaction system. Background technique [0002] With the development of science and technology, it is inevitable for robots to enter human society. The interaction between robots and people makes it more and more demanding to be humanoid, and the humanoid facial expression technology is especially important in realizing the communication between humanoid robots and people. Daily life is full of face-to-face communication, and the face plays a very important role in expressing a person's personality and emotions. For a robot that enters people's lives, it is required to have a shape and function suitable for people and the environment, and to be able to communicate effectively with people in emotion and information. Therefore, it should be more human-like in appearance and shape, and have facial move...

AI Technical Summary

Problems solved by technology

[0004] However, in the existing technology, the human-computer interaction system still has limitations such as people must face the camera when working, and the use environment must have lighting, etc., and the human-computer interaction system has few functions.

[0005] Chinese invention patent (publication number: CN201088839) robot smile expression muscle action mechanism, its technical solution can only express various smile expressions through the skeleton and rubber skin, but it is not enough to complete the human-computer interaction function

[0006] Chinese invention patent (publication number: CN101458778) is a humanoid avatar robot with facial expressions and multi-sensory functions. Its technical solution shows various expressions by pulling the rubber skin. It also has visual and auditory sensors, but it does not have the same expression as the operator. interactive ability, and does not have the interactive ability to actively speak

[0007] Chinese invention patent (publication number: CN102750555) is an emoticon robot applied to instant messaging tools. In its technical solution, users can only manually input emoticons in the chat window as system input, but cannot directly simulate human expressions in real time. Does not have direct human-computer interaction

[0008] Chinese invention patent (publication number: CN102566474) imitates human facial expression robot interaction system and method and face detection and tracking method. Due to the influence of many external factors such as range of motion and illumination, the operation of the system has great freedom

Images