Man-machine motion interaction system and method based on expression recognition

A human-computer emotional interaction and facial expression recognition technology, applied in the input/output of user/computer interaction, character and pattern recognition, computer parts and other directions, can solve the problems of immaturity and accuracy, achieve simple and effective communication, improve Accuracy and the effect of realizing safe real-time monitoring

Active Publication Date: 2014-01-01
BEIHANG UNIV
View PDF6 Cites 69 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, because the technology of emotional interaction between robots and people is still not mature and accurate, there are still very few studies on human-computer interaction systems (such as robots) designed for patients with mental sub-health or mental illness.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Man-machine motion interaction system and method based on expression recognition
  • Man-machine motion interaction system and method based on expression recognition
  • Man-machine motion interaction system and method based on expression recognition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] The present invention will be further described in detail with reference to the accompanying drawings and embodiments.

[0022] Such as figure 1 As shown, the human-computer emotional interaction system based on expression recognition provided by the present invention includes an image acquisition module 100 , an image processing module 200 , an expression recognition module 300 , a human-computer interaction module 400 , and a statistics and storage module 500 .

[0023] The image acquisition module 100 is used to acquire the face image of the user. The computer reads the collected face image and sends it to the image processing module 200. The image processing module 200 processes the face image, adjusts the size and orientation of the face, and removes noise. The processing includes grayscale, level adjustment and size adjustment of the image. adjust. The expression recognition module 300 performs facial expression recognition on the image processed by the image pr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a man-machine motion interaction system and method based on expression recognition. The system comprises an image acquisition module, an image processing module, an expression recognition module, a man-machine interaction module and a storage module. The image acquisition module acquires a facial image; the image processing module processes the acquired facial image for graying, size adjustment and the like; an expression in the facial image is recognized by means of expression recognition; the man-machine interaction module feeds back to a user according to the facial expression; the statistical and storage module analyzes mental state of the user at this moment and records the mental state; meanwhile, a statistical query function is provided for the user. After applied to intelligent equipment, the system is capable of providing specific humanized responses so that the equipment can be more intelligent; when applied to mental care robots, the system is capable of capturing patients' expressions to allow for simple and effective communication with patients, so that the patients with mental illnesses can be supervised safely in real time, and effective data basis for treatment is provided for doctors.

Description

technical field [0001] The invention relates to the fields of artificial intelligence, computer, human-computer interaction and preliminary psychological analysis, and in particular to a human-computer emotional psychological interaction system and method based on facial expression recognition. Background technique [0002] With the rapid development of emerging technologies such as computer image recognition technology and artificial intelligence technology, computers play an indispensable role in human production and life, but machines and people such as computers, game consoles, and intelligent robots lack emotions based on human expressions communicate with. Although the existing technology has made certain improvements and progress in the automatic recognition of human facial expressions by computers, it lacks quantitative and accurate conception and design of emotional interaction between machines or virtual characters and natural people. [0003] Nowadays, people's w...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06K9/00
Inventor 尚博旸樊洁姚永强叶倩文丁希仑
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products