Human-machine interaction method and device based on sight tracing and gesture discriminating

A technology of gesture recognition and gaze tracking, which is applied in the field of human-computer interaction, can solve problems such as long-distance human-computer interaction, and achieve the effect of simple and free operation, small size and convenient use
CN101344816AInactive Publication Date: 2009-01-14SOUTH CHINA UNIV OF TECH
0 Cites 171 Cited by

Patent Information

Authority / Receiving Office
CN ยท China
Patent Type
Applications(China)
Current Assignee / Owner
SOUTH CHINA UNIV OF TECH
Publication Date
2009-01-14
Estimated Expiration
Not applicable ยท inactive patent

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a human-computer interaction method and a device based on vision follow-up and gesture identification. The method comprises the following steps of: facial area detection, hand area detection, eye location, fingertip location, screen location and gesture identification. A straight line is determined between an eye and a fingertip; the position where the straight line intersects with the screen is transformed into the logic coordinate of the mouse on the screen, and simultaneously the clicking operation of the mouse is simulated by judging the pressing action of the finger. The device comprises an image collection module, an image processing module and a wireless transmission module. First, the image of a user is collected at real time by a camera and then analyzed and processed by using an image processing algorithm to transform positions the user points to the screen and gesture changes into logic coordinates and control orders of the computer on the screen; and then the processing results are transmitted to the computer through the wireless transmission module. The invention provides a natural, intuitive and simple human-computer interaction method, which can realize remote operation of computers.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to human-computer interaction technology in a virtual reality system, in particular to a human-computer interaction method and device based on sight tracking and gesture recognition. Background technique

[0002] With the rapid development of computer technology, the interaction between human and computer has gradually become an important part of people's daily life. Traditional human-computer interaction devices such as mice and keyboards have certain limitations in terms of naturalness and friendliness in use. Therefore, research on human-computer interaction technologies that meet interpersonal communication habits has become a current development trend.

[0003] Human-computer interaction methods based on gaze tracking and gesture recognition are natural, direct and concise. The human-computer interaction technology based on gaze tracking mainly obtains the position of the user's gaze by obtaining the rotation information of ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More