Eye tracking human-machine interaction method and apparatus

An eye-tracking and human-computer interaction technology, applied in the field of human-computer interaction, can solve problems such as increasing the possibility of infectious diseases, reducing interaction efficiency, and prone to misoperation, avoiding the spread of diseases, simple interaction protocols, and improving comfort. degree of effect

Inactive Publication Date: 2008-11-26
HUAWEI TECH CO LTD
View PDF0 Cites 78 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In this way, it cannot be applied to special occasions such as aviation driving where the hand cannot be used for operation, and some disabled people who cannot move their hands cannot use the system.
[0005] (2) When the system is used in public facilities, due to the need to touch the mouse device, the possibility of infectious diseases among the crowd is increased
[0007] It is difficult to choose a more suitable value for the gaze dwell time. If you choose a smaller value, it is easy to cause misoperation, because when the line of sight pauses for a while, a pop-up menu will appear, and the operator does not want to do any action. In this case Especially in some specific actions (such as reading articles, watching videos, etc.)
If you choose a larger value, it will prolong the execution time of the operation command and greatly reduce the efficiency of the interaction
In addition, the pop-up menu will also affect the operator's observation of the screen content in many occasions
In short, such an interaction protocol will lead to the interaction process is not humanized enough, the efficiency is also low, and it is easy to cause misoperation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Eye tracking human-machine interaction method and apparatus
  • Eye tracking human-machine interaction method and apparatus
  • Eye tracking human-machine interaction method and apparatus

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0043] While eye-tracking operation brings convenience to the operator, due to the randomness of the operator's line of sight, if there is no instruction information to start or close the line-of-sight tracking operation, misoperation may occur, such as the operator's line of sight stays on a certain position, when the mouth is open, may not indicate that the command to issue is a right-click action. Therefore, a preset switch action can be set, and when the facial motion is detected as the preset switch action, the gaze tracking operation is started or stopped. Figure 5 Represents the nose to be lifted up and wrinkled, referred to as the facial action D. Embodiment 2 and subsequent embodiments pre-set the facial motion D as a preset switch action. When the facial motion D is detected, the line of sight tracking operation is activated or deactivated. If the facial motion D is not detected, then Detecting whether the facial action is a preset switch action. Taking the operat...

Embodiment 4 ， example ， Embodiment ，。 pic 8 approach Embodiment 4 pic ， and approach Embodiment 3

[0056] In the fourth embodiment, taking the control of the target item on the screen as an example, in this embodiment, the preset sight range is the screen range. Figure 8 It is a flow chart of Embodiment 4 of the eye-sight tracking human-computer interaction method of the present invention. Compared with Embodiment 3 of the eye-sight tracking human-computer interaction method of the present invention, it also includes:

[0057] Step 20. Detect whether the gaze in the gaze tracking information is within the screen range, and if the gaze in the gaze tracking information is within the screen range, execute step 3; otherwise, execute step 1. In this embodiment, by adding the step of detecting whether the line of sight in the line of sight tracking information is within the range of the preset line of sight position, when the line of sight is not within the range of the preset line of sight position, the facial image collection and recognition operations can be stopped, thereby f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a view line tracking man-machine interactive method, including: view line tracking information is collected and a view line focus position is obtained according to the view line tracking information; facial image information is collected and facial action is recognized according to the facial image information; a control command corresponding to the facial action is output according to the view line focus position. the invention also relates to a view line tracking man-machine interactive device which comprises a view line tracing processing unit which is used for the view line tracking operation, a facial action recognition unit for collecting the facial image information and recognizing the facial action according to the facial image information and a control command output unit which is respectively connected with the view line tracking processing unit and the facial action recognition unit and is used for outputting the control command corresponding to the facial action according to the view line focus position. the embodiment of the invention provides a non-contact view line tracking man-machine interactive method and a device with interaction protocols.

Description

technical field [0001] The invention relates to a human-computer interaction method and device, in particular to a sight-tracking human-computer interaction method and device, and belongs to the field of human-computer interaction. Background technique [0002] Devices such as keyboards, mice, and joysticks provide the communication interface between the machine and the operator, realizing human-computer interaction. In recent years, with the development of eye-tracking technology, mouse simulation and keyboard simulation based on eye-tracking have been researched and applied in the field of human-computer interaction, such as assisting disabled people to complete man-machine communication, assisting aviation pilots to operate computers, etc. On a personal computer, the result of gaze tracking can control the movement of the mouse pointer, thereby replacing the mouse to realize the function of human-computer interaction. In some industrial control, aviation application scen...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06K9/00
Inventor 左坤隆
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap