Low power consumption eye movement tracking device

Abstract

The utility model discloses low-power-consumption eye movement tracking equipment, which comprises a glasses body, an eyeball image acquisition module, a processing module and a visual stimulation display module, the eyeball image acquisition module is arranged at the front end of the glasses body, and the eyeball image acquisition module comprises a camera and is used for acquiring eyeball images; the processing module is electrically connected with the camera and is used for processing the collected eyeball image to obtain a sight line estimation point; the visual stimulation display module is in electric connection / communication connection with the processing module and comprises a display screen, and the display screen is a front view angle and is used for projecting stimulation points to human eyes and displaying the stimulation points and sight estimation points. According to the utility model, multi-camera acquisition and low-power-consumption transmission can be carried out on eyeball images without influencing the free movement of the head, the accuracy is high, and the endurance is stronger; and the equipment is high in universality, can be transplanted to glasses in different forms according to different use habits of users, and is easy to popularize and apply.

Description

Technical Field

[0001] The utility model relates to the technical field of image acquisition and eye tracking, and in particular to a low-power eye tracking device. Background Art

[0002] Eye tracking technology has become one of the technical means of visual behavior and human behavior in many fields such as psychology, neuromarketing, neurocognition, user experience, basic research and market research. This technology can also be used for medical analysis and screening. From the historical development of eye movement, early invasive eye tracking technology is prone to damage to the human eye. At present, with the development of eye tracking systems, eye trackers have made certain progress in the market, but they still face defects such as low eye tracking accuracy, high power consumption, and high prices. In addition, the existing eye tracking technology requires users to keep their heads fixed, which seriously affects the development of eye tracking devices and the user experience. Therefore, there is an urgent need for a design method for low-power eye tracking devices to improve the actual use of eye trackers. Utility Model Content

[0003] In response to the above problems, the utility model proposes a low-power eye tracking device, which can accurately capture the user's eye image without affecting the wearer's free movement of the head, transmit the eye image to the processor with low power consumption, locate the line of sight, and display the stimulation point and the line of sight estimation point on the screen, thereby achieving high-accuracy and low-power eye tracking.

[0004] A low-power eye tracking device, comprising:

[0005] The glasses body;

[0006] An eyeball image acquisition module is arranged at the front end of the glasses body, and the eyeball image acquisition module includes a camera for acquiring eyeball images;

[0007] A processing module, electrically connected to the camera, for processing the collected eyeball image to obtain a sight line estimation point;

[0008] The visual stimulation display module is electrically / communicatively connected to the processing module, and includes a display screen having a front viewing angle for projecting stimulation points to human eyes and displaying the stimulation points and the sight line estimation points fed back by the processing module.

[0009] In one of the embodiments, the glasses body includes a glasses frame and glasses feet, and the eyeball image acquisition module is arranged at the front end of the glasses frame.

[0010] In one of the embodiments, the eye image acquisition module includes a left eye acquisition unit and a right eye acquisition unit, and the glasses frame includes a left glasses frame and a right glasses frame; the left eye acquisition unit and the right eye acquisition unit are respectively installed on the left glasses frame and the front end of the right glasses frame, and the left eye acquisition unit and the right eye acquisition unit each include two cameras.

[0011] In one embodiment, the eyeball image acquisition module further includes a near-infrared LED, which is arranged on one side of the camera. Furthermore, each camera is equipped with two near-infrared LEDs, which are arranged on the upper and lower / left and right sides of the camera.

[0012] In one embodiment, the eyeglass body is an integrated structure. Further preferably, the eyeglass frame and the eyeglass feet are hollow, and the hollow cavity is used to accommodate the transmission line.

[0013] In one embodiment, the processing module includes:

[0014] A deserializer, electrically connected to the camera, and configured to receive and transmit the eye image;

[0015] A processor, electrically connected to the deserializer, for processing the eyeball image to obtain a sight line estimation point;

[0016] The communication module is electrically connected to the processor and is used to transmit the processed sight line estimation point to the visual stimulation display module for display.

[0017] Optionally, the communication module is Bluetooth; and the processor is an STM32 single-chip microcomputer.

[0018] Compared with the existing eye tracking solutions, the present invention has the following beneficial effects:

[0019] 1. Eye image acquisition can be performed without affecting the free movement of the head. It is easy to wear and operate, which improves the user experience. Single-eye dual-camera sampling is used to take photos of human eyes from multiple angles to obtain a larger acquisition field of view and improve the accuracy of image acquisition. The camera module integrates the camera with the near-infrared LED, which can unify the light source and camera direction for more accurate sampling.

[0020] 2. Low-power transmission of image data is achieved through the deserializer, ensuring high-precision eye movement data collection and transmission under low power conditions, with high accuracy and longer battery life.

[0021] 3. The module is small in size and easy to integrate. Users can transplant the device to different forms of glasses according to their usage habits. It is easy to promote and apply, has broad application prospects, and has the potential to be used in intelligent control of the human eye.

[0022] 4. Before the device is officially used, eye tracking calibration is required; the eye image is transmitted to the processor, which locates the line of sight and obtains the line of sight estimation point. The line of sight estimation point and the stimulation point are then displayed on the display screen. The background performs calibration based on the difference between the two, making the information presentation intuitive and the operation convenient. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 A three-dimensional diagram of the device structure in one embodiment;

[0024] Figure 2 A front view of a device structure in one embodiment;

[0025] Figure 3 A rear view of a device structure in one embodiment;

[0026] Figure 4 A top view of a device structure in one embodiment;

[0027] Figure 5 A schematic diagram of a module configuration of a device in an embodiment;

[0028] Description of the accompanying drawings: 1. Glasses body; 2. Eyeball image acquisition module; 3. Glasses frame; 4. Glasses feet; 5. Camera; 6. Near-infrared LED. DETAILED DESCRIPTION

[0029] The following will be combined with the accompanying drawings to describe the embodiments of the technical solution of the utility model in detail. The following embodiments are only used to more clearly illustrate the technical solution of the utility model, and are therefore only used as examples, and cannot be used to limit the protection scope of the utility model.

[0030] See also Figure 1-5 , a low-power eye tracking device, including a glasses body 1, an eyeball image acquisition module 2, a processing module and a visual stimulation display module. The eyeball image acquisition module 2 is arranged at the front end of the glasses body 1, and the eyeball image acquisition module 2 includes at least one camera for acquiring eyeball images; the processing module is electrically connected to the camera 5, and is used to process the acquired eyeball images to obtain the coordinates of the gaze point, that is, the line of sight estimation point; the visual stimulation display module is electrically connected / communication connected to the processing module, and the visual stimulation display module includes a display screen, which is a front viewing angle, and is used to project stimulation points to the human eye, and display stimulation points and line of sight estimation points. Before the device is officially used, the background can perform eye tracking calibration on the device according to the difference between the line of sight estimation point and the stimulation point to improve the tracking accuracy of the device.

[0031] In one embodiment, the eyeglass body 1 includes an eyeglass frame 3 and an eyeglass foot 4, and the eyeball image acquisition module 2 is arranged at the front end of the eyeglass frame 3. Preferably, the eyeball image acquisition module 2 includes a left eye collector and a right eye collector, which are respectively installed on the left eyeglass frame and the right eyeglass frame, and each collector includes two cameras 5, which can collect multi-angle eyeball images without blocking the line of sight to obtain a wider field of view.

[0032] In one embodiment, the eyeball image acquisition module 2 further includes a driving circuit and a near-infrared LED 6, and the driving circuit and the near-infrared LED are electrically connected to power the near-infrared LED. The near-infrared LED 6 is arranged on one side of the camera 5, and the two constitute a camera module, which can unify the light source and the camera direction, and make the sampling more accurate. Preferably, each camera 5 is configured with two near-infrared LEDs, and the two near-infrared LEDs 6 are located above and below or on the left and right sides of the camera 5.

[0033] In one embodiment, the eyeglass body 1 is an integrated structure, and the eyeglass frame 3 and the eyeglass foot 4 are hollow, so as to facilitate the electrical connection between the eyeball image acquisition module 2 and the processing module. Optionally, a cable is arranged in the eyeglass foot 4, and the eyeball image acquisition module 2 is connected to the processing module through the cable, and the processing module is arranged in an external box.

[0034] In one embodiment, the processing module includes a deserializer, a processor and a communication module; the signal output end of the camera 5 is connected to the deserializer, the signal output end of the deserializer is connected to the processor, and the signal output end of the processor is connected to the communication module. The deserializer can convert the MIPI differential serial link into a parallel bus with a large bit width, and realize low-power point-to-point large-scale data transmission under the condition of ensuring that the data is not compressed in advance, so as to solve the drawback of high power consumption of parallel cameras. Preferably, the deserializer can be connected to the camera through the hollow glasses foot 4. Further optional, the processor adopts an STM32 single-chip microcomputer, and the communication module is Bluetooth. The processing module transmits the collected eyeball image to the processor through the deserializer to reduce power consumption, and then the processor uses the pupil-corneal reflection method to process the collected eyeball image, and obtains the vector of the pupil center position and its relative corneal reflection point, that is, the line of sight vector coordinates can be obtained, thereby estimating the human eye gaze point; the processor communicates with the visual stimulation display module through Bluetooth, and sends the processing result to the visual stimulation display module, and the visual stimulation display module displays the estimated human eye gaze point.

[0035] like Figure 5As shown, in this example, the eyeball image acquisition module 2 includes a left eye acquisition unit and a right eye acquisition unit, the left eye acquisition unit includes a first left eye camera CAM1.L and a second left eye camera CAM2.L; the right eye acquisition unit includes a first right eye camera CAM1.R and a second right eye camera CAM2.R. The processor includes a first deserializer, a second deserializer, a processor, and a communication module, wherein the first deserializer and the second deserializer use STMMIPID02 chips, the processor uses STM32MP157 chips, the communication module uses STM32WB0 chips, and the visual stimulation display module includes a display screen, and uses RK3588 as a processing chip.

[0036] The first left-eye camera CAM1.L and the second left-eye camera CAM2.L transmit the collected left-eye image to the first deserializer. Similarly, the first right-eye camera CAM1.R and the second right-eye camera CAM2.R transmit the collected right-eye image to the second deserializer. The signal output ends of the first deserializer and the second deserializer are connected to the STM32MP157 chip, and the signal output ends of the STM32MP157 chip are connected to the STM32WB0 chip. The STM32WB0 chip is communicated with the processing chip of the visual stimulation display module, and the display screen displays the stimulation point and the line of sight estimation point.

[0037] It should be noted that the working process of this device involves image transmission methods, image processing methods, and calibration methods. Specifically, the processing module uses a deserializer to transmit the collected eyeball images point-to-point, the processing module uses the pupil-corneal reflection method to process the collected eyeball images, and compares and calibrates the stimulation points and the line of sight estimation points. The above-mentioned image transmission methods, image processing methods, and calibration methods are all mature existing technologies and have been disclosed by the prior art. In particular, the process of comparing and calibrating the stimulation points and the line of sight estimation points belongs to the verification and calibration of this device and can be performed by other independent computer systems. Therefore, what this application seeks to protect is the device structure and module connection that are independent of the above-mentioned image transmission, image processing, and calibration methods. Although the above-mentioned method will be used in the implementation of the technical solution of this application, the implementation of this application does not rely on any unknown computer software program or method, and it belongs to the protection object of the utility model.

[0038] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0039] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be construed as limiting the scope of the patent application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent application shall be subject to the attached claims.

Claims

1. A low-power eye tracking device, characterized in that: include: Eyeglass body (1); An eyeball image acquisition module (2) is arranged at the front end of the eyeglass body (1), and the eyeball image acquisition module (2) comprises a camera (5) for acquiring an eyeball image; A processing module, electrically connected to the camera (5), for processing the collected eyeball image to obtain a sight line estimation point; The visual stimulation display module is electrically / communicatively connected to the processing module, and includes a display screen having a front viewing angle for projecting stimulation points to human eyes and displaying the stimulation points and the sight line estimation points fed back by the processing module.

2. The low-power eye tracking device according to claim 1, characterized in that: The spectacles body (1) comprises a spectacles frame (3) and spectacles feet (4), and the eyeball image acquisition module (2) is arranged at the front end of the spectacles frame (3).

3. The low-power eye tracking device according to claim 2, characterized in that: The eyeball image acquisition module (2) comprises a left eye acquisition unit and a right eye acquisition unit, and the eyeglass frame (3) comprises a left eyeglass frame and a right eyeglass frame; the left eye acquisition unit and the right eye acquisition unit are respectively mounted on the left eyeglass frame and on the front end of the right eyeglass frame, and the left eye acquisition unit and the right eye acquisition unit each comprise two cameras (5).

4. The low-power eye tracking device according to claim 1 or 3, characterized in that: The eyeball image acquisition module (2) further comprises a near-infrared LED (6), and the near-infrared LED (6) is arranged on one side of the camera (5).

5. The low-power eye tracking device according to claim 1 or 3, characterized in that: Each camera (5) is provided with two near-infrared LEDs (6) correspondingly, and the two near-infrared LEDs (6) are arranged opposite to each other at the upper and lower sides / left and right sides of the camera (5).

6. The low-power eye tracking device according to claim 1 or 2, characterized in that: The spectacles body (1) is an integrated structure.

7. The low-power eye tracking device according to claim 2, characterized in that: The glasses frame (3) and the glasses feet (4) are hollow, and the hollow cavity is used to accommodate the transmission line.

8. The low-power eye tracking device according to claim 1, characterized in that: The processing module comprises: A deserializer, electrically connected to the camera (5), and used for receiving and transmitting the eyeball image; A processor, electrically connected to the deserializer, for processing the eyeball image to obtain a sight line estimation point; The communication module is electrically connected to the processor and is used to transmit the processed sight line estimation point to the visual stimulation display module for display.

9. The low-power eye tracking device according to claim 8, characterized in that: The communication module is Bluetooth.

10. The low-power eye tracking device according to claim 8, characterized in that: The processor adopts STM32 single chip microcomputer.

Images