Unlock instant, AI-driven research and patent intelligence for your innovation.

A mouse pointer control method and system based on eye-tracking technology

A mouse pointer and gaze tracking technology, applied in the field of machine vision and human-computer interaction, can solve the problems of disabled people being unable to use a mouse, poor human-computer interaction, etc., and achieve a good control effect.

Active Publication Date: 2017-12-22
KUNMING UNIV OF SCI & TECH
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The present invention provides a mouse pointer control method and system based on eye-tracking technology, which is used to solve the problem that the existing mouse pointer control method mainly relies on both hands, and the human-computer interaction is poor, so that many disabled people cannot use the mouse

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A mouse pointer control method and system based on eye-tracking technology
  • A mouse pointer control method and system based on eye-tracking technology
  • A mouse pointer control method and system based on eye-tracking technology

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0038] Embodiment 1: as Figure 1-6 As shown, a mouse pointer control method based on eye-tracking technology, the specific steps of the method are as follows:

[0039] Step1. Collect image data through the camera to provide data for the next step of image processing;

[0040] Step2. Use the Viola-Jones algorithm to detect the human eye area on the collected image data of the nth frame:

[0041] Adopt a single-eye detection strategy, in the collected images, only detect the left and right eye regions, if the human eye region is detected, record the human eye region as W n ; Then execute step Step3;

[0042] If the human eye area is not detected, then return to step Step1;

[0043] Step3. In the detected human eye area W n Use the Harris corner algorithm to extract the Harris corner, and record the position of the Harris corner as p n 1 ,p n 2 ,p n 3 …p nn ; and calculate the center position from all the corner positions of the nth frame Then execute step Step4;

...

Embodiment 2

[0055] Embodiment 2: as Figure 1-6 As shown, a mouse pointer control method based on eye-tracking technology, the specific steps of the method are as follows:

[0056] Step1. Collect image data through the camera to provide data for the next step of image processing;

[0057] The details are: select the configuration CPU as Intel Core 2 Duo T6670 2.2GHz, 3GB DDR31066 memory, the camera is a notebook computer with an integrated 1.3 million pixel camera (640*480) as the hardware platform, and the operating system is Window7;

[0058] Step2. Use the Viola-Jones algorithm to detect the human eye area on the collected image data of the nth frame:

[0059] Specifically: in view of the fact that the position of the human eye is in the middle of the face and is symmetrical, the movement of a single eye can better reflect the movement trajectory of the human eye. Therefore, in order to ensure the real-time performance of the system, the present invention adopts a single-eye detection...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a mouse pointer control method and system based on eye-tracking technology, and belongs to the technical field of machine vision and human-computer interaction. It includes an image acquisition module, which is used to collect image data through the camera to provide data for the next image processing; a human eye detection module, which is used to detect the human eye area on the collected image data; a feature point extraction module, which is used to Extract the Harris corner points in the detected human eye area, and calculate the center position of the corner points; the feature point matching module is used to match the detected Harris corner points of the front and rear frames; the mouse pointer control module is used to The average displacement of the Harris corner of the human eye in the frame controls the movement of the mouse pointer. The invention enables the handicapped person to control the mouse pointer under the condition that the movement of both hands is restricted, and achieves a good control effect; and realizes the accuracy and real-time performance of the mouse pointer control system.

Description

technical field [0001] The invention relates to a mouse pointer control method and system based on eye-sight tracking technology, and belongs to the technical fields of machine vision and human-computer interaction. Background technique [0002] With the rapid development of computer technology, especially since the birth of the graphical user interface, our interaction with computers has become easier and faster. Functions such as online shopping, information inquiry, auxiliary office, and multimedia entertainment provide convenience and fun to our life and work. However, most of the current interaction methods require manual operation, which creates obstacles to modern information sharing for people with upper limb disabilities or upper limb inconvenience. Only by manually operating the mouse and keyboard to achieve interaction with the computer, many upper limbs who want to enjoy its convenience People with disabilities are turned away. [0003] At present, the mouse po...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/0488
Inventor 王彬翁政魁刘辉王瑞王坤
Owner KUNMING UNIV OF SCI & TECH