Noncontact type mouse control method based on video sequence recognition

A video sequence, non-contact technology, applied in character and pattern recognition, mechanical mode conversion, input/output of user/computer interaction, etc. The effect of improving the detection rate

Inactive Publication Date: 2011-09-14
DALIAN NATIONALITIES UNIVERSITY
View PDF2 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The detection rate of the existing face detection

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Noncontact type mouse control method based on video sequence recognition
  • Noncontact type mouse control method based on video sequence recognition
  • Noncontact type mouse control method based on video sequence recognition

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0032] The present invention will be further described below in conjunction with the drawings. Such as figure 1 The system operation flow chart of the present invention uses Windows operating system and Visual Studio 2008 as the development platform.

[0033] The system of the present invention can be set to run automatically after booting or to start after booting. For the handicapped, the system can be set to run automatically after the system is installed. After the computer is turned on, the system automatically runs, drives the camera, and starts the camera to collect facial video images. If the operator is not in the camera area, the system does not respond. Only after the face image is detected and the operator action is recognized, the corresponding mouse action will be executed.

[0034] If the system collects a face image and determines that the operator’s mouth movement is "no movement", the mouse has no response, such as figure 2 Shown. If it is determined that th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a noncontact type mouse control method based on video sequence recognition, which comprises the following steps: acquiring a video; detecting a human face; pre-treating a human face image; positioning lips; extracting a tongue action feature vector; recognizing the tongue action; and arousing the mouse operation. According to the method, the mouse operation is controlled by utilizing the lip and tongue action recognition, thereby helping the disabled people who lost the hands to control the mouse. By using the method, the head and eyes of an operator can freely act and are not limited, thereby bringing convenience to the daily use of computers. The traditional face detection method which is realized by using an adaptive enhanced AdaBoost algorithm has an image detection rate being 15 frames per second and cannot meet the real-time demand in the image detection field. By adopting a strategy of adjusting the size of the image acquired by a camera in the method, the face detection is realized on the small image, the detection rate is increased and the detection rate can be increased to 25 frames per second.

Description

technical field [0001] The invention relates to a computer mouse system, in particular to a non-contact mouse control method based on video sequence identification. Background technique [0002] The basic device for computer operation is the mouse. The current hardware mouse system requires manual operation, but for the handicapped, the inability to operate the mouse means that the computer cannot be used. [0003] In order to facilitate the use of computers by handicapped people, people have developed a human-computer interaction method based on face pose estimation. This method constructs a visual mouse device based on face feature point positioning and pose detection. By extracting two corners of the eyes, two A total of 5 feature points of mouth corner and nose tip are used to estimate the 3 deflection angles of the real-time face image, corresponding to the mouse position and operation mode, based on the corresponding feature point positions of a frontal image. And us...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06K9/00G06K9/62
Inventor 刘勇奎王巍王鹏辛慧杰
Owner DALIAN NATIONALITIES UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap