Human-computer interaction method based on eye movement control

Abstract

The invention discloses a human-computer interaction method based on eye movement control. The method comprises the following steps of human eye pupil positioning and eye movement characteristic extraction. The step of pupil center positioning based on grey information comprises the following stages that: 1: human eye positioning; 2: pupil edge detection; 3: pupil center positioning. The step of eye movement characteristic information extraction based on visual point movement comprises the following steps that: calculating a fixation point deviation and visual point deviation mapping; on the basis of the displacement difference of two obtained adjacent frames of images, enabling eyes to move back and forth to calibrate points calibrated by coordinates on the screen, and utilizing a least square curve fitting algorithm to solve a mapping function; and after eye movement characteristic information is obtained, on the basis of the obtained eye movement control displacement and angle information, carrying out a corresponding system message response. By use of the human-computer interaction method based on the eye movement control, the energy consumption of the user can be reduced, theuser can be assisted in carrying out direct control, and efficient and natural interaction is realized.

Description

technical field [0001] The invention belongs to the field of computer software, and in particular relates to a human-computer interaction method based on eye movement control for mobile terminal equipment. Background technique [0002] With the development of science and technology, the way of human-computer interaction is gradually transitioning from precise interaction to imprecise interaction. [0003] Precise interaction refers to the user's input of interactive information through precise interactive means, which are more common in daily life: 1) DOS-based operation instruction language input. 2) Precise input through devices with positioning functions such as mouse and keyboard. [0004] Due to the development of multi-channel interactive systems, people no longer focus on how to use one precise interaction technology to replace another precise interaction technology, but try to transform and develop non-precise interaction technologies. [0005] The imprecise intera...

AI Technical Summary

Problems solved by technology

[0009] Although inaccurate interaction methods can achieve the effect of human-mobile interaction to a certain extent, there are also obvious shortcomings.

Voice interaction is the process of realizing action interaction through the recognition of input voice, so it has high requirements for the external environment. When the environment is too noisy or the environment is complex, the clarity of the voice contract and the accuracy of voice recognition will be affected. In addition, gesture-based interaction refers to an action language that expresses wishes and conveys commands through the positions and shapes of people's arms, palms, and fingers. The requirements for gesture control are high, the accuracy of the range of motion is difficult to control, and it increases the burden on the hands

Images