Device, operating method and computer-readable recording medium for generating a signal by detecting facial movement

Abstract

Provided are a device, an operating method and a computer-readable recording medium for generating a signal by detecting facial movement. A device for generating signal by detecting facial movement and operating method thereof is provided, which includes: an image capture unit, and a processing unit. The image capture unit for obtaining an image series. The processing unit receives the images series from the image capture unit, wherein the processing unit includes an image background removal module, an image extracting module, and a comparator, wherein the image background removing module processes each of the image series respectively to obtain a facial image, wherein the feature location module determines a location of a pair of nostrils in the facial image, defines a mouth searching frame, and acquires a data of mouth movements through the mouth searching frame, wherein the comparator compares the data of mouth movements with predetermined facial information, and generates a designated signal according to the comparison result.

Description

technical field [0001] The present invention relates to a device and method for detecting facial movements to generate signals, especially to a device that can detect the user's mouth movements to determine what the user wants to express and generate corresponding signals and the device method. Background technique [0002] Human hands have multiple joints and can perform a variety of actions. Therefore, most general machinery or vehicles are designed for manual operation, such as keyboards, steering wheels, buttons, handles, etc. However, some disabled people cannot use them. Most of them are manual operations. and designed appliances, but cannot use tools to solve problems in daily life. On the other hand, even able-bodied users may be unable to use two-handed tools, for example, it is difficult to push open the door handle when carrying heavy objects with both hands, avoiding the use of mobile phones to ensure safety in driving, or when being held hostage or threatened ...

AI Technical Summary

Problems solved by technology

However, the eyes are not as flexible as the hands after all. Their movements are only monotonous up, down, left, and right movements or opening and closing of the eyes, which can express quite limited meanings. When the user is trapped in an accident or is held In other situations, it is necessary to send a signal for help with simple and imperceptible facial movements. As far as the prior art is concerned, the signal can only be generated in the eye-controlled assisted driving system, and it is obviously impossible to convey such a complex message.

The existing technology of detecting facial movements to generate signals has the problem of being difficult to express complex meanings and inconvenient to send messages. For this, the previous technology does not provide an effective way to overcome it

Images