Sight tracking method of intelligent glasses based on MEMS and optical waveguide lenses

Abstract

The invention belongs to the technical field of sight tracking, and discloses a sight tracking method of intelligent glasses based on MEMS and optical waveguide lenses. Continuous and periodic scanning laser emitted by an MEMS scanning mirror is transmitted to the front of human vision through an optical waveguide element to be coupled out, a specific scanning path is formed on the surface of theeye, and some light enters the retina at a certain moment; reflected light on the retina is received and coupled by the optical coupling element in front of the vision, enters the optical waveguide element and is further transmitted to the photosensitive sensor; and the two-dimensional scanning laser path position information isconverted into one-dimensional time information according to the distribution intensity of the reflected light of the retina and the time period of the scanning light, and the position of the fixation point is calculated. The eye movement tracking method is low in powerconsumption, small in size and high in sampling rate, eye movement calibration is not needed, seamless switching of multiple functions of eyeball tracking, pupil recognition, iris recognition, diopter detection and eye health detection is achieved, and power consumption is reduced.

Description

technical field [0001] The invention belongs to the technical field of line of sight tracking, and in particular relates to a line of sight tracking method for smart glasses based on MEMS and optical waveguide lenses. In particular, it relates to a line-of-sight tracking method based on an optical waveguide lens and a MEMS scanning mirror for a near-eye display device. Background technique [0002] Currently, the closest prior art: Human eye movement can reveal a wealth of information about the neural mechanisms of the brain and vision, as well as an individual's neurological health, eye health, interests, and psychological state. Furthermore, eye tracking can be used to improve / enhance human-computer interaction, enable gaze-based human-machine interfaces, and enhance the way of interacting with wearable technologies. For example, gaze tracking, which relies on eye tracking, enables many augmented alternative communication (AAC) devices to enhance the abilities of individu...

AI Technical Summary

Problems solved by technology

[0016] (1) Traditional eye trackers are slow, cumbersome, intrusive and restrictive for users

[0017] (2) Traditional systems usually require cameras and imaging processing software, which are often expensive, slow to calculate and consume power, and the eyeball sampling rate depends on the frame rate of the camera

[0018] (3) The camera and the infrared light source transmitter are set around the optical imaging element (optical waveguide) of the smart glasses, and need to be set at a position where the camera can shoot the eyeball and the light source can illuminate the eyeball. When the field of view of the smart glasses is sufficient When it is large, the camera and infrared light source will limit the range of field of view, which is not conducive to the lightweight design of smart glasses, resulting in a decline in the overall immersion and experience of smart glasses

[0019] (4) Traditional systems exhibit a significant lag between the actual eye movement and the computationally measured eye position, i.e. low sampling rate, degrading user experience in VR / AR applications

[0020] (5) The electric eye diagram will be affected by blinking artifacts and signal noise, which is relatively inaccurate and unattractive

[0021] (6) The limbus tracking system is cumbersome and difficult to calibrate; and unless used at short distances, the sensitivity is poor; image processing is required and power consumption is high

[0022] (7) Video-based eye trackers are slow, bulky, restrictive, and expensive for the user; wearable systems are bulky and heavy, making them very uncomfortable to use for extended periods of time; easily interrupted during the process; and video capture is difficult to track through glasses due to front surface reflections

[0023] (8) Existing problems with eye movement on smart glasses: the internal space on smart glasses is extremely limited, so try to make the size and weight of smart glasses as small as possible during the design process

[0026] (11) The hardware installed on smart glasses should meet the requirements of small size and low power consumption to achieve a better product experience, but the above-mentioned eye tracking method for camera images is not an ideal eye movement on smart glasses (near-eye display devices) tracking method

Images