Human-machine interaction method and device based on sight tracing and gesture discriminating

A technology of gesture recognition and gaze tracking, which is applied in the field of human-computer interaction, can solve problems such as long-distance human-computer interaction, and achieve the effect of simple and free operation, small size and convenient use

Inactive Publication Date: 2009-01-14
SOUTH CHINA UNIV OF TECH
View PDF0 Cites 171 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, the traditional human-computer interaction technology based on eye-tracking and gesture recognition has certain defects, and cannot solve the long-distance interaction between man-machine.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human-machine interaction method and device based on sight tracing and gesture discriminating
  • Human-machine interaction method and device based on sight tracing and gesture discriminating
  • Human-machine interaction method and device based on sight tracing and gesture discriminating

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] The specific embodiments of the present invention will be further described below in conjunction with the accompanying drawings.

[0021] The human-computer interaction system based on gaze tracking and gesture recognition is mainly composed of three parts: image acquisition module, image processing module and wireless communication module, such as figure 1 shown. The image acquisition module includes a camera, which is responsible for collecting user's images in real time and transmitting them to the image processing module. The image processing module is composed of a high-performance embedded processor and peripheral devices. It is responsible for controlling the other two modules, running various image processing algorithms to analyze and process the collected user images, and converting the changes of the user's pointing position and gestures on the screen into The computer's logical coordinates and control commands on the screen. The wireless communication modul...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a human-computer interaction method and a device based on vision follow-up and gesture identification. The method comprises the following steps of: facial area detection, hand area detection, eye location, fingertip location, screen location and gesture identification. A straight line is determined between an eye and a fingertip; the position where the straight line intersects with the screen is transformed into the logic coordinate of the mouse on the screen, and simultaneously the clicking operation of the mouse is simulated by judging the pressing action of the finger. The device comprises an image collection module, an image processing module and a wireless transmission module. First, the image of a user is collected at real time by a camera and then analyzed and processed by using an image processing algorithm to transform positions the user points to the screen and gesture changes into logic coordinates and control orders of the computer on the screen; and then the processing results are transmitted to the computer through the wireless transmission module. The invention provides a natural, intuitive and simple human-computer interaction method, which can realize remote operation of computers.

Description

technical field [0001] The invention relates to human-computer interaction technology in a virtual reality system, in particular to a human-computer interaction method and device based on sight tracking and gesture recognition. Background technique [0002] With the rapid development of computer technology, the interaction between human and computer has gradually become an important part of people's daily life. Traditional human-computer interaction devices such as mice and keyboards have certain limitations in terms of naturalness and friendliness in use. Therefore, research on human-computer interaction technologies that meet interpersonal communication habits has become a current development trend. [0003] Human-computer interaction methods based on gaze tracking and gesture recognition are natural, direct and concise. The human-computer interaction technology based on gaze tracking mainly obtains the position of the user's gaze by obtaining the rotation information of ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06K9/00G06K9/62
Inventor 秦华标肖志勇
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap