Intelligent wheelchair man-machine interaction system and method based on facial expression recognition mode

Abstract

The invention provides an intelligent wheelchair man-machine interaction system and method based on facial expression recognition and relates to the field of the biology, the psychology, the computer vision, mode recognition, artificial intelligence and the like. According to the method, a geometric model matching algorithm is used for automatically locating centralized effective eyebrow, eye and mouth areas of facial features, then ASM feature points of the eyebrow, eye and mouth areas are located, and convolution operation is carried out on located feature point pixels and Gabor wavelet kernel functions to extract the facial expression features; an Adaboost algorithm is used for iterating and training the facial features to obtain an expression classifying model; the expression classifying model is adopted for recognizing input expression sequences in a classifying mode, the input expression sequences are compared with a control instruction defined in advance, and therefore interaction control over an intelligent wheelchair from facial expression recognition is achieved. When the facial expression features are extracted, real-time recognition of facial expressions is greatly improved, and real-time reaction with the intelligent wheelchair is greatly improved.

Description

Technical field [0001] The invention belongs to the field of artificial intelligence and computer vision, and specifically relates to an intelligent wheelchair human-computer interaction system and method based on facial expression recognition mode Background technique [0002] The "International Action Plan on Aging" pointed out: The problem of the elderly and aging has become a new challenge for developing countries. As the largest developing country, my country has the largest number of elderly people in the world. The data of the sixth national census shows that the proportion of the elderly population has increased by 2.93%. For the elderly whose physical condition is getting aging, their personal ability is not easy to solve problems such as normal daily activities; and for various reasons, many people are lost every year. One or more abilities such as hands-on and language, and the loss of these abilities greatly affects their self-care and other aspects of life. Therefo...

AI Technical Summary

Problems solved by technology

Especially for people with a higher degree of disabilities, among them, for those with severe pathological tremors in their hands, they cannot accurately control the wheelchair through the joystick; for those with speech disabilities, although they can use voice recognition mode to control The simple movement of smart wheelchairs, but in noisy environments, the recognition rate of voice commands is low, which is not conducive to the control of voice recognition; and when controlling smart wheelchairs with myoelectricity and brain waves, the required sensors (for signal acquisition) are particularly Expensive, which is not conducive to the universality of the control method; in addition, the psychologist Mehrabian proposed that in people's information exchange, facial expressions transmit up to 55% of the information. When using facial expression recognition mode for human-computer interaction of intelligent wheelchairs, It does not require particularly expensive equipment, and its restrictions are small and its degree of freedom is large

Images