Three-dimensional roaming method using eye-tracking technology and conventional mouse control device

Abstract

The invention discloses a three-dimensional roaming method utilizing eye gaze tracking and a conventional mouse control device. The method needs a computer, a display of the computer, a video acquisition device and the conventional mouse control device. The method includes video acquisition, gaze point estimation, eye gaze roaming parameter calculation, mouse roaming parameter calculation, display feedback and the like. The video acquisition device mounted near the display of the computer acquires a real-time image of a user, an eye gaze direction is calculated according to the image, the eye gazing direction is converted into gaze points on the display, two-dimensional eye gaze parameters are then calculated to control scene motion in the planar direction, the display is divided into multiple areas, corresponding mouse one-dimensional roaming type is judged according to the area where a mouse cursor is, and the corresponding mouse roaming parameters are calculated. By combination of eye gaze and the mouse cursor, three-dimensional roaming experience is achieved in a flexible and visualized manner.

Description

technical field [0001] The invention relates to the technical field of human-computer interaction in a three-dimensional virtual scene, in particular to a three-dimensional roaming method using a sight tracking technology and a conventional mouse control device. Background technique [0002] With the wide application of geographic information in social production and life, spatial information systems based on 3D scenes are becoming more and more popular in various fields, and their development is becoming more and more perfect. However, the three-dimensional scene roaming is not very comfortable on various commonly used computers, so the efficiency is also limited. The reason is that conventional mouse control devices usually only have two degrees of freedom and are not suitable for three-dimensional roaming operations; the common practice is to decompose the roaming operation into several two-dimensional or one-dimensional roaming operations, and through multiple steps succ...

AI Technical Summary

Problems solved by technology

For example: use game control handles, driving simulator handles or similar devices for three-dimensional roaming, and increase the dimension and efficiency of roaming through the cooperation of multiple limbs; this type of solution improves roaming performance, but increases the overall system hardware complexity

In some systems, specially designed enhanced mouse, trackball and other devices are used for three-dimensional roaming; this kind of scheme may achieve better control effect, but the hardware complexity and cost of the system are greatly increased, which hinders the promotion and popularization

Moreover, these methods only use human limbs for three-dimensional interaction, and the human eye only plays a role in perception, but does not fully tap its potential

Images