Glasses type eye movement tracking device and system

Abstract

The embodiment of the utility model provides a glasses type eye movement tracking device and system, and relates to the technical field of eye movement tracking. The glasses type eye movement tracking device comprises a glasses frame which is provided with a first edge part and a second edge part; the two display screens are mounted on the glasses frame; wherein the first edge part and the second edge part are respectively positioned above and below the display screen; the eye movement collecting assembly is arranged on the second edge part and at least partially exposed out of the surface of the second edge part; and the processor is arranged in the first edge part and is electrically connected with the eye movement acquisition assembly. According to the embodiment of the invention, the miniaturized and lightweight glasses type eye movement tracking device with a brand new design is provided, the application and carrying portability of the eye movement tracking technology can be improved, meanwhile, the glasses type design is adopted, the wearing is comfortable, and the application range and application scene of eye movement tracking are increased.

Description

Technical Field

[0001] This application relates to the field of eye-tracking technology, and more specifically, to a glasses-type eye-tracking device and system. Background Technology

[0002] Traditional eye-tracking technology, as an important human-computer interaction technology, has great potential and application prospects, but it still faces some problems in practical applications:

[0003] 1. Poor portability: The large size and weight of eye trackers make them difficult to carry around, limiting their application in outdoor or mobile scenarios.

[0004] 2. Uncomfortable to wear: For eye trackers that need to be worn on the head, excessive weight may cause discomfort to the subjects and affect the accuracy of the experimental results. Utility Model Content

[0005] This application provides a glasses-type eye-tracking device and system to solve the technical problems of poor portability or uncomfortable wearing in existing glasses-type eye-tracking devices.

[0006] In a first aspect, embodiments of this application provide a glasses-type eye-tracking device, comprising:

[0007] The eyeglass frame has a first edge portion and a second edge portion;

[0008] Two displays are mounted on the eyeglass frame; wherein the first edge portion and the second edge portion are located above and below the displays, respectively;

[0009] An eye-tracking acquisition component is disposed on the second edge portion and at least partially exposed on the surface of the second edge portion;

[0010] The processor is located within the first edge portion and is electrically connected to the eye-tracking acquisition component.

[0011] In one possible implementation, the eye-tracking acquisition component includes:

[0012] At least one light source, with the light-emitting side of the light source positioned corresponding to the cornea of ​​the target object;

[0013] At least one camera module, wherein the shooting area of ​​the camera module is set to correspond to the eye of the target object.

[0014] In one possible implementation, the glasses-type eye-tracking device also includes:

[0015] An integrated sensor module is located at the first edge and is electrically connected to the processor.

[0016] In one possible implementation, the integrated sensor module includes at least one of the following:

[0017] The inertial measurement unit sensor includes an accelerometer, a gyroscope, and a magnetometer, all of which are located within the first edge portion and are electrically connected to the processor.

[0018] A proximity light sensor is located at the first edge and is electrically connected to the processor.

[0019] In one possible implementation, at least one light source is two near-infrared light sources, and at least one camera module is two near-infrared cameras;

[0020] The second edge portion includes two second sub-edge portions respectively located below the two displays;

[0021] A near-infrared light source and a near-infrared camera are set together at a second sub-edge.

[0022] In one possible implementation, the glasses-type eye-tracking device also includes:

[0023] The diopter adjustment button is located on the eyeglass frame and above the display screen.

[0024] In one possible implementation, the glasses-type eye-tracking device further includes at least one of the following:

[0025] A scene camera is mounted on the eyeglasses frame and located in the central area of ​​the frame; the central area is located between two displays.

[0026] At least one speaker and volume control button are located on the temple of the eyeglass frame;

[0027] Two electroluminescent lenses and a light transmission button are provided. Each electroluminescent lens is located on the side of the display screen closest to the target object, and the light transmission button is located on the temple of the eyeglass frame.

[0028] In one possible implementation, the glasses-type eye-tracking device further includes at least one of the following:

[0029] Two nose pads, detachably mounted on the eyeglass frame;

[0030] A light shield, detachably mounted on the eyeglass frame and positioned in front of the display screen.

[0031] In one possible implementation, the glasses-type eye-tracking device also includes:

[0032] The power supply and data interface is located at the end of the temple of the eyeglass frame and is used for electrical connection to an external power source or to a terminal device.

[0033] Secondly, embodiments of this application provide an eye-tracking system, including a terminal device and a glasses-type eye-tracking device as described in the first aspect;

[0034] The glasses-type eye-tracking device is electrically connected to the terminal equipment.

[0035] The beneficial effects of the technical solutions provided in this application are:

[0036] The glasses-type eye-tracking device of this application embodiment has a first edge and a second edge in its eyeglass frame. Two displays are mounted on the eyeglass frame. The eye-tracking acquisition component is located on the second edge below the displays, with at least a portion of the component exposed on the surface of the second edge. This allows the eye-tracking acquisition component to easily acquire eye-tracking data of the target object. A processor is located in the first edge above the displays and is electrically connected to the eye-tracking acquisition component, enabling the processor to acquire eye-tracking data of the target object through the component. Therefore, this application embodiment provides a newly designed miniaturized and lightweight glasses-type eye-tracking device. This device enables eye-tracking, improves the application and portability of eye-tracking technology, and provides comfortable wear due to its glasses-like design. This increases the applicability and scenarios of eye-tracking, reduces the difficulty of device installation and deployment, and makes the auxiliary diagnosis and screening of brain physiological and cognitive functions and neurodegenerative diseases more convenient. Attached Figure Description

[0037] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments of this application will be briefly introduced below.

[0038] Figure 1 This is a schematic diagram of the structure of the first type of glasses-type eye-tracking device provided in the embodiments of this application;

[0039] Figure 2 This is a schematic diagram of the structure of a second type of glasses-type eye-tracking device provided in the embodiments of this application;

[0040] Figure 3 A hardware framework diagram of a glasses-type eye-tracking device provided in an embodiment of this application;

[0041] Figure 4 A schematic diagram of the framework of an eye-tracking system provided in an embodiment of this application;

[0042] Figure label:

[0043] 10-Eye-tracking device with glasses;

[0044] 101-Eyeglasses frame, 102-Display screen, 103-Processor, 104-Eye tracking acquisition component, 1041-Near-infrared light source, 1042-Near-infrared camera, 105-Integrated sensor module, 1051-Inertial measurement unit sensor, 1052-Proximity light sensor, 106-Nose pad, 107-Power supply and data interface, 108-Refractive adjustment button, 109-Scene camera, 110-Speaker, 111-Volume control button, 112-Electroluminescent lens, 113-Light transmission button, 114-Flash module, 115-First edge, 116-Second edge, 1161-Second sub-edge;

[0045] 20-Terminal equipment. Detailed Implementation

[0046] The embodiments of this application are described below with reference to the accompanying drawings. It should be understood that the embodiments described below with reference to the accompanying drawings are exemplary descriptions for explaining the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions of the embodiments of this application.

[0047] Those skilled in the art will understand that, unless otherwise stated, the singular forms “a,” “an,” “the,” and “the” used herein may also include the plural forms. It should be further understood that the terms “comprising” and “including” as used in embodiments of this application mean that the corresponding feature can be implemented as the presented feature, information, data, step, operation, element, and / or component, but do not exclude implementation as other features, information, data, step, operation, element, component, and / or combinations thereof supported by the art. It should be understood that when we say that an element is “connected” or “coupled” to another element, the one element can be directly connected or coupled to the other element, or it can mean that the one element and the other element establish a connection relationship through an intermediate element. Furthermore, “connected” or “coupled” as used herein can include wireless connection or wireless coupling. The term “and / or” as used herein indicates at least one of the items defined by the term; for example, “A and / or B” indicates implementation as “A,” or implementation as “A,” or implementation as “A and B.”

[0048] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0049] Traditional eye-tracking systems are often limited by technological capabilities during design and manufacturing, making it difficult to achieve miniaturization and weight reduction while maintaining performance. This leads to the following three problems:

[0050] 1. Poor portability: The large size and weight of eye trackers make them difficult to carry around, limiting their application in outdoor or mobile scenarios.

[0051] 2. Uncomfortable to wear: For eye trackers that need to be worn on the head, excessive weight may cause discomfort to the subjects and affect the accuracy of the experimental results.

[0052] 3. Limited application scenarios: Due to limitations in size and weight, traditional eye trackers are difficult to apply to some special scenarios, such as virtual reality (VR) and augmented reality (AR).

[0053] Further research revealed that while traditional eye-tracking technology, as an important human-computer interaction technology, has enormous potential and application prospects, it still faces some challenges and problems in practical applications:

[0054] 1. Large Size and Weight: Traditional eye trackers typically employ complex optical systems to achieve high-precision eye movement tracking. These systems include multiple high-quality lenses, mirrors, and other components. For example, to ensure clear capture of eye details at different distances, a lens group with variable focal length is required, resulting in a large optical component. Furthermore, to ensure accurate light transmission and focusing, these optical components require high dimensions and precision. To protect the delicate internal optical and electronic components, traditional eye trackers generally use robust materials such as metal or high-strength plastics for their casings. The casing needs to be sufficiently thick to prevent damage to internal components from external impacts and vibrations. This increases the overall size and weight of the device.

[0055] 2. Complex Structure: Traditional eye trackers require a sturdy mechanical support to accurately position themselves in front of the user's eyes. This support needs to be able to adjust the position and angle of the eye tracker to adapt to different users' facial features and postures. The support is typically made of metal to ensure sufficient strength and stability. This support structure is usually quite thick and heavy, and to achieve flexible adjustment, multiple adjustable joints and knobs are designed, which also increases the size and weight of the device.

[0056] 3. Poor portability: Traditional eye trackers consume a significant amount of power due to the numerous optical and electronic components inside, especially the complex optical system and data processing unit, which have high power consumption during operation. To ensure stable operation over extended periods, either a large-capacity battery or an external power supply is required. Large-capacity batteries themselves have a certain size and weight, while an external power supply further increases the overall weight of the device. Combined with the device's own weight, this significantly limits its portability.

[0057] 4. Complex installation and debugging: Heavier and larger eye trackers are usually more complex to install. For example, they need to be installed on special brackets or fixing devices, which may require multiple people to work together to complete the installation process. Furthermore, precise adjustments to the position and angle are required during installation, which consumes a lot of time and effort.

[0058] 5. Poor comfort: During prolonged experiments or monitoring, the weight of the eye tracker directly affects user comfort. If the eye tracker is too heavy, such as a head-mounted eye tracker, it will put significant pressure on the user's head and face, easily causing fatigue and pain in the head and neck. This may make it difficult for users to concentrate on experiments or normal activities for extended periods, thus affecting the accuracy and reliability of the data.

[0059] 6. High cost: The equipment has many large components and a bulky structural casing. Ultimately, the cost of electronic components and structural parts is difficult to control.

[0060] 7. Eye-tracking scenarios are highly restrictive: It typically requires placement in a fixed location, such as a desktop, and connection to a computer. Subjects must sit in a specific position and distance from the table to accurately record eye movement information. This severely limits the subject's range of motion, preventing them from engaging in natural, free activities and observations, making it difficult to obtain eye-tracking data in real-world situations.

[0061] The eye-tracking device and system provided in this application are intended to solve the above-mentioned technical problems of the prior art.

[0062] The technical solution of this application and how it solves the above-mentioned technical problems are described in detail below with specific embodiments. It should be noted that the following embodiments can be referenced, borrowed, or combined with each other, and the same terms, similar features, and similar implementation steps in different embodiments will not be described again.

[0063] See Figure 1 As shown, this application provides a schematic diagram of the structure of a first type of glasses-type eye-tracking device 10. See also... Figure 2 As shown in the figure, this application provides a structural schematic diagram of a second type of glasses-type eye-tracking device 10.

[0064] Combination Figure 1 and Figure 2 As shown, the eye-tracking device 10 includes: an eyeglass frame 101 with a first edge portion 115 and a second edge portion 116, two displays 102, an eye-tracking acquisition component 104, and a processor 103.

[0065] Two displays 102 are mounted on the eyeglass frame 101. A first edge portion 115 and a second edge portion 116 are located above and below the displays, respectively.

[0066] An eye-tracking acquisition component 104 is disposed on the second edge portion 116 and at least partially exposed on the surface of the second edge portion 116. The eye-tracking acquisition component 104 can acquire eye-tracking data of the target object.

[0067] The processor 103 is located within the first edge portion 115 and is electrically connected to the eye-tracking acquisition component 104. The processor 103 is used to acquire eye-tracking data of the target object through the eye-tracking acquisition component 104.

[0068] As an example, when the processor 103 determines that the target object is wearing glasses frame 101, it controls the two displays 102 to display virtual images and controls the eye-tracking acquisition component 104 to start and acquire the target object's eye-tracking data. The eye-tracking data is eye-tracking information obtained by the target object based on a preset eye-tracking paradigm task corresponding to the virtual image and is used to assess the probability that the target object has a preset brain function disease.

[0069] The eyeglasses frame 10 of this embodiment has a first edge portion 115 and a second edge portion 116. Two displays 102 are mounted on the eyeglasses frame 101. An eye movement acquisition component 104 is disposed on the second edge portion 116 below the displays 102, and the eye movement acquisition component 104 is at least partially exposed on the surface of the second edge portion 116, so that the eye movement acquisition component 104 can easily acquire the eye movement data of the target object. A processor 103 is disposed in the first edge portion 115 above the displays 102 and connected to the eye movement acquisition component 104, so that the processor 103 can acquire the eye movement data of the target object through the eye movement acquisition component 104.

[0070] Therefore, this application provides a newly designed miniaturized and lightweight glasses-type eye-tracking device 10. The glasses-type eye-tracking device 10 can realize eye tracking, improve the application and portability of eye tracking technology, and the glasses-type design makes it comfortable to wear, increases the scope of application and applicable scenarios of eye tracking, reduces the difficulty of device installation and deployment, and makes the auxiliary diagnosis and screening of brain physiological and cognitive functions and neurodegenerative diseases more convenient.

[0071] Optionally, the eyeglass frame 101 primarily uses a specially made high-strength engineering plastic frame, cleverly integrating the core components of eye tracking within the frame. The design of the eyeglass frame 101 ensures sufficient strength to support all components while minimizing weight to enhance wearer comfort.

[0072] Optionally, the preset eye-tracking paradigm task can be a traditional saccade testing task, such as a forward saccade task, a reverse saccade task, and a memory-guided saccade task.

[0073] In some embodiments, the eye-tracking acquisition component 104 includes at least one light source and at least one camera module. The light-emitting side of the light source is configured to correspond to the cornea of ​​the target object, and the imaging area of ​​the camera module is configured to correspond to the eye of the target object. The camera module can acquire eye-tracking data of the target object.

[0074] See Figure 2 As shown, at least one light source consists of two near-infrared light sources 1041, and at least one camera module consists of two near-infrared cameras 1042. The second edge portion 116 includes two second sub-edge portions 1161 respectively disposed below the two displays 102; a near-infrared light source and a near-infrared camera are grouped together and disposed in a second sub-edge portion 1161.

[0075] See Figure 2 As shown, the eye-tracking acquisition component 104 is typically arranged horizontally. The near-infrared light source 1041 uses 940nm invisible light to illuminate the display screen 102, forming a reflective spot. Because it is invisible light, it does not interfere with the eye-tracking process. The near-infrared camera 1042 captures and analyzes the user's eyes from below, recording pupil movement information and changes in the reflective spot of the eyes.

[0076] Optionally, the eye-tracking device 10 can be VR (Virtual Reality) glasses or AR (Augmented Reality) glasses.

[0077] In some embodiments, the glasses-type eye-tracking device 10 further includes an integrated sensor module 105.

[0078] An integrated sensor module 105 is disposed on the first edge portion 115 and electrically connected to the processor 103. The integrated sensor module 105 is used to collect the status information of the target object wearing the eyeglasses frame 101 and send the status information to the processor 103 so that the processor 103 can perform corresponding operations based on the status information.

[0079] Optionally, the processor 103 is used to collect, package, and forward all sensor data camera images, and finally transmit the data to terminal devices such as mobile phones, tablets, and computers for analysis via a data transmission line.

[0080] Optionally, processor 103 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. Processor 103 may also be a combination that implements computational functions, such as including one or more microprocessor combinations, a combination of a DSP and a microprocessor, etc.

[0081] See Figure 3 As shown, this application provides a hardware framework diagram of a glasses-type eye-tracking device 10. Figure 3 As shown, the integrated sensor module 105 includes at least one of the following: an inertial measurement unit sensor 1051 and a proximity light sensor 1052.

[0082] The inertial measurement unit sensor 1051 includes an accelerometer, a gyroscope, and a magnetometer, all of which are located within the first edge portion 115 and electrically connected to the processor 103. The inertial measurement unit sensor 1051 is used to acquire motion information of a target object; the state information includes motion information.

[0083] The proximity light sensor 1052 is located on the first edge portion 115 and is electrically connected to the processor 103.

[0084] Optionally, the proximity sensor 1052 can send a control signal to the processor 103 indicating that the target object is wearing the eyeglasses frame 101. The processor 103 can then control the display screen 102 and the eye-tracking acquisition component 104 to start based on the control signal.

[0085] Optionally, the proximity sensor 1052 is used to generate wearing information and send the wearing information to the processor 103 when it detects that the distance between the target object and the proximity sensor 1052 is not greater than a predetermined distance, so that the processor 103 determines that the target object is wearing the glasses frame 101 based on the wearing information.

[0086] The wearing information is used to instruct the target object to wear the eyeglasses frame 101. The processor 103 is used to determine that the target object is wearing the eyeglasses frame 101 in response to the acquisition of the wearing information, control the two displays 102 to display virtual images, and control the eye movement acquisition component 104 to start and acquire the eye movement data of the target object.

[0087] Optionally, the inertial measurement unit sensor 1051 is used to monitor the movement and orientation adjustments of the user during use of the eye-tracking device 10 while wearing glasses.

[0088] Optionally, the proximity light sensor 1052 uses the reflection of light to estimate the approach distance of an object. When the user connects the glasses-type eye-tracking device 10 to an external device, the proximity light sensor 1052 needs to notify components such as the near-infrared camera 1042, the display screen 102, and the near-infrared light source 1041 to work when it senses an object approaching. That is, some components of the glasses work when the user wears them, and some components enter sleep mode to control power consumption when the user takes them off.

[0089] See Figure 3 As shown, the glasses-type eye-tracking device 10 also includes a refractive adjustment button 108.

[0090] The diopter adjustment button 108 is located on the eyeglass frame 101 and above the display screen 102.

[0091] Optionally, the diopter adjustment button 108 is used to change the distance and / or angle between the optical elements of the display screen 102 when rotated, so as to adjust the diopter.

[0092] See Figure 3 As shown, the glasses-type eye-tracking device 10 also includes at least one of the following: a scene camera 109, at least one speaker 110 and a volume control button 111, two electroluminescent lenses 112 and a light-transmitting button 113.

[0093] See Figure 1 As shown, the scene camera 109 is mounted on the eyeglass frame 101 and located in the central area of ​​the eyeglass frame 101; the central area is located between the two displays 102. The scene camera 109 is used to record environmental scene information when the target object is wearing eyeglasses.

[0094] At least one speaker 110 and a volume control button 111 are located on the temple of the eyeglass frame 101. Each electroluminescent lens 112 is located on the side of the display screen 102 closest to the target object, and a light-transmitting button 113 is located on the temple of the eyeglass frame 101.

[0095] Optionally, at least one speaker 110 includes a left speaker and a right speaker, which are located at the left and right temples of the eyeglass frame 101, respectively, and the volume is adjusted by a volume control button 111 located below the left temple.

[0096] In some embodiments, the glasses-type eye-tracking device 10 further includes at least one of the following: two nose pads 106 and a light shield.

[0097] See Figure 2 As shown, two nose pads 106 are detachably mounted on the eyeglass frame 101. A light shield is detachably mounted on the eyeglass frame 101 and is positioned in front of the display screen 102.

[0098] Optionally, the processor 103 is configured to control the two displays 102 to display virtual images when the eyeglasses frame 101 of the eye-tracking device 10 is equipped with a light shield and the two displays 102 are blocked by the light shield in virtual reality mode; or, when the eyeglasses frame 101 of the eye-tracking device 10 is not equipped with a light shield and the eyeglasses frame 101 is equipped with a scene camera 109, the processor 103 is configured to activate the scene camera 109 and control the two displays 102 to display virtual images in augmented reality mode.

[0099] Optionally, the processor 103 is also used to determine the visual attention points of the target object in different scenarios based on the environmental scene information and eye-tracking data collected by the scene camera 109.

[0100] Optionally, the nose pad 106 is ergonomically optimized to adapt to different facial contours, reducing the pressure of wearing it for a long time. It is compatible with different sizes of nose pad 106 according to different users' facial features and usage habits.

[0101] Optionally, the light shield is a detachable structure, which can be a light shield. The light shield is installed in front of the display screen 102. When the light shield blocks both display screens 102, the display screens 102 are opaque. The light shield can be installed when the user views the stimulus points on the screen for eye tracking to prevent ambient light from interfering with the user's eye tracking process through the screen and display screen 102. The light shield can be removed when performing eye tracking in an open environment.

[0102] Optionally, the electroluminescent lens 112 can precisely adjust the light transmittance and color of the display screen 102 according to different environments and needs. For example, in bright light environments, the lens can be darkened to reduce light entering the eyes; in low light environments, the display screen 102 can be brightened to ensure a clear field of vision, making it suitable for various environments. The electroluminescent lens 112 is located behind the display screen 102, and the light transmittance of the electroluminescent lens 112 is adjusted via the light transmittance button 113 on the temple of the eyeglass frame 101.

[0103] Optionally, the display screen 102 can be a high-definition, low-latency OLED (Organic Light-Emitting Diode) microdisplay, combined with advanced optical projection technology, to clearly present virtual images to the user. It consists of a left screen and a right screen, and the displayed image is transmitted to the external device via a data transmission cable (Type-C) to output signals. The top of the display screen 102 also features a diopter adjustment button 108. Rotating the diopter adjustment button 108 changes the distance or angle between the optical elements, thereby adjusting the diopter.

[0104] See Figure 2 As shown, the glasses-type eye-tracking device 10 also includes a power supply and data interface 107.

[0105] The power supply and data interface 107 is located at the end of the temple of the eyeglass frame 101. The power supply and data interface 107 is used to connect to an external power source or to be electrically connected to the terminal device 20.

[0106] See Figure 3 As shown, the glasses-type eye-tracking device 10 also includes a flash module 114, which is electrically connected to the processor 103.

[0107] Flash module 114 is used to store program data and important data. The combination of the high-speed read / write capability of the processor 103's built-in DDR and the non-volatile storage of the external Flash memory fully leverages their respective advantages to improve the overall performance of the eye-tracking glasses 10. DDR can quickly respond to user operations and process various real-time data, while Flash provides stable program and data storage support for the eye-tracking glasses 10, enabling the eye-tracking glasses 10 to achieve good performance in startup, operation, and data processing.

[0108] The glasses-type eye-tracking device 10 of this application embodiment has brain cognitive and physiological function diagnosis functions based on eye tracking. It supports eye tracking, supports simultaneous acquisition of both eyes, supports eye trajectory tracking and processing, and supports pupil data change acquisition and analysis. It is used for the assessment of neuropsychological diseases such as cognitive impairment, Parkinson's disease, schizophrenia, anxiety, and depression. As an example, the eye-tracking process of the glasses-type eye-tracking device 10 of this application embodiment includes:

[0109] (1) Install a light shield. The application scenario is VR virtual reality mode, providing an immersive experience. The display screen 102 displays different behavioral paradigms according to different indications and provides voice guidance based on the external device program. The user performs eye-tracking tasks as required. Among them, the behavioral paradigms include: forward saccades, reverse saccades, memory saccades, bistep saccades, smooth tracking, working memory capacity, visual acuity, visual field, fusion eye movement, etc. The eyes are illuminated by a near-infrared light source 1041, and the light reflected back from the eyes is captured by a high-precision near-infrared camera 1042 to obtain information such as the position of the eyes, pupil size, and eyeball rotation angle. Advanced image recognition algorithms and deep learning models are used to analyze the collected eye images in real time to achieve accurate tracking of the user's eye movement trajectory.

[0110] (2) By analyzing the eye movement patterns of users when looking at different content, such as fixation point distribution, fixation time, saccade frequency, etc., we can infer the user's attention concentration, cognitive load, ability to understand information, inhibition ability, learning ability, etc., and obtain user scores under each paradigm by referring to the weight of each characteristic parameter under different diseases, and finally evaluate and output the conclusion report.

[0111] (3) Eye-tracking function based on visual field research

[0112] With the light shield removed, the application scenario is AR (Augmented Reality) mode. It can collect data from real-world scenes through scene and sensors, combining the real and virtual worlds. This embodiment of the application analyzes the environmental scene information collected by the scene camera 109 with eye-tracking data to understand the user's visual focus in different scenarios. The device has an automatic real-time calibration function. After the user wears the glasses-type eye-tracking device 10, the system automatically guides the user through simple calibration operations, quickly establishing a model of the user's eye features by focusing on several specific points. During use, the algorithm adaptively adjusts the tracking parameters based on ambient light, the user's eye state, and scene changes, ensuring accurate eye tracking and scene perception in various complex environments.

[0113] In some embodiments, the preset brain functional disorders include at least one of the following: cognitive impairment, Parkinson's disease, schizophrenia, anxiety disorder, and depression.

[0114] The glasses-type eye-tracking device 10 of this application embodiment can achieve the function of eye tracking through the following embodiments.

[0115] Example 1: Structural Design

[0116] Combination Figure 2 and Figure 3As shown, the device structure design of this application embodiment includes an eyeglass frame 101 with a first edge portion 115 and a second edge portion 116, a processor 103, an inertial measurement unit sensor 1051, a proximity light sensor 1052, a flash module 114, a near-infrared camera 1042, a scene camera 109, a near-infrared light source 1041, a speaker 110, a nose pad 106, a light shield, an electroluminescent lens 112, a display screen 102, a diopter adjustment button 108, a volume control button 111, a light transmission button 113, and a data transmission line.

[0117] The eyeglass frame 101 is primarily made of lightweight, high-strength material. This material ensures sufficient strength to support the various components of the eye tracker while significantly reducing the overall weight of the glasses and improving wearing comfort. The shape of the eyeglass frame 101 is designed according to ergonomic principles, accommodating different sizes of nose pads 106 to accommodate various nose bridge and facial features, reducing pressure and increasing the immersive experience of eye tracking. Furthermore, the nose pads 106 support the mounting of refractive lenses, allowing most nearsighted users to achieve eye tracking without wearing refractive lenses.

[0118] On the inner front side of the eyeglass frame 101, a set of miniature infrared light-emitting diode arrays is arranged on each of the left and right sides along the edge of the frame. These LEDs (light-emitting diodes) use low-power, high-brightness near-infrared light emitting chips to emit infrared light. To improve the emission efficiency and uniformity of the infrared light, a small focusing lens is equipped above each LED. These lenses are made of optical plastic and are precision injection molded, enabling them to focus the light emitted by the LED and project it evenly onto the surface of the eyeball, providing clear and stable lighting conditions for subsequent eye tracking. The integrated sensor module 105 uses a miniature near-infrared camera module, which can quickly and accurately capture images of eye movement. The near-infrared camera 1042 is connected to the data processing unit of a computer, mobile phone, or tablet computer via a high-speed data transmission line. Speakers 110 are located on both sides of the temples of the eyeglasses, close to the ears, to provide sound reminders when voice prompts are needed.

[0119] Example 2: Brain Physiology and Cognitive Function and Diagnosis of Neurodegenerative Diseases

[0120] First, the glasses-type eye-tracking device 10 is connected to a supported mobile phone, tablet, or computer. The user wears the glasses-type eye-tracking device 10, ensuring that both eyes can see all the content on the screen. If the entire screen cannot be seen, the nose pads 106 of different sizes are replaced as needed. Then, the glasses-type eye-tracking device 10 is calibrated. After calibration, initial data acquisition begins. The user starts operating or observing stimuli according to a preset eye-tracking paradigm task, and images are acquired by the near-infrared camera 1042.

[0121] External devices precisely record and quantify various eye-movement parameters during user task execution, such as saccade speed, latency, accuracy, smooth tracking gain, and fixation duration. Analysis of these quantitative indicators allows for comparison with eye-movement data from healthy individuals, establishing eye-movement characteristic models for diseases. When a subject's eye-movement data deviates from the normal range, reaching a certain threshold or conforming to specific abnormal patterns, it may indicate a risk of neurodegenerative diseases such as MCI. This data includes fixation point location (X and Y coordinates in screen coordinates), fixation duration (the duration of each fixation point), saccade path (the trajectory of the eyes rapidly moving from one fixation point to another), and pupil size changes (reflecting the subject's cognitive load, emotional state, etc.).

[0122] Finally, the collected raw eye-tracking data undergoes cleaning and preprocessing. This may include removing invalid data points caused by user blinking, head movements, etc.; smoothing the fixation data to reduce noise interference; and standardizing the data from different users to make them comparable, for example, by normalizing fixation time according to the total task duration. This allows researchers to more intuitively understand and interpret the data, discover patterns and trends, and thus draw conclusions about the participants' visual behavior.

[0123] Example 3: Eye Tracking Based on Visual Field Study

[0124] The glasses-type eye-tracking device 10 features a scene camera 109 at its front to collect visual field data, a near-infrared camera 1042 to capture the user's gaze point, and an electroluminescent lens 112 whose transmittance can be adjusted as needed to facilitate the user's observation of the scene. By combining scene photography by the scene camera 109 with eye gaze point capture by the near-infrared camera 1042, the user's gaze on the scene camera 109 can be calculated. This data can be used for scientific research and analysis of human eye-tracking in various fields such as consumption, education, medicine, and aviation.

[0125] The portable glasses-type eye-tracking device 10 provided in this application mainly addresses the following issues: increasing the portability of eye-tracking devices, controlling device size and weight, and further facilitating the auxiliary diagnosis and screening of brain physiological and cognitive functions and neurodegenerative diseases. The problem is mainly solved from two aspects: hardware facilities and supporting software systems.

[0126] This application aims to overcome the numerous drawbacks of traditional eye trackers due to their large size and weight, and provides an innovative eye tracker design to achieve miniaturization and weight reduction. Traditional eye trackers have played a crucial role in the diagnosis of neurological diseases, cognitive impairments, and mental illnesses; a more convenient glasses-style eye tracker can significantly improve its user experience and application scope.

[0127] With the continuous development of modern technology, eye trackers are playing an increasingly important role in many fields such as psychological research, human-computer interaction, and market research. However, traditional eye trackers are bulky and heavy due to their complex and large internal optical systems, data processing units, mechanical structures, and relatively inefficient power supply systems. This not only limits their portability in field research and mobile application scenarios, making it difficult for researchers to work flexibly in diverse environments, but also causes significant pressure on the user's head and face during prolonged use, seriously affecting user comfort. Furthermore, it increases the difficulty and complexity of installation and debugging, reducing work efficiency.

[0128] This application embodiment employs highly integrated micro-optical sensing technology to miniaturize traditional large optical components and optimize their layout, significantly reducing the space occupied by the optical system. In terms of mechanical structure, it innovatively adopts an XR (Extended Reality) glasses-style design, which is lightweight and robust, ensuring both stability and accuracy during use while greatly reducing the size and weight of the support frame. Furthermore, considering different user facial features and usage postures, multiple detachable nose pads 106 are designed for selection. During immersive eye-tracking experiences, ambient light may interfere with eye tracking. This application embodiment allows for the detachable installation of a light shield on the glasses frame 101 to minimize interference from ambient and reflected light.

[0129] Therefore, this application aims to create a compact, lightweight, and high-performance eye tracker that can be widely used in various complex and ever-changing scenarios. Whether it is rigorous research in the laboratory, auxiliary diagnosis of neurological diseases, cognitive disorders, and mental illnesses, or integrated application in outdoor field surveys, it can provide users with convenient, comfortable, and efficient eye-tracking services, promote the popularization and development of eye tracker technology in more fields, and open up new and broad prospects for research and application in related fields.

[0130] The glasses-type eye-tracking device 10 applied in the embodiments of this application can achieve at least the following technical effects:

[0131] 1. High comfort level: Glasses-style eye trackers are more in line with the natural state of humans and will not cause too much discomfort to the subject when worn.

[0132] 2. Low cost: The overall hardware cost is low and it is easy to promote.

[0133] 3. High portability: The glasses-style eye tracker is lightweight and can be carried around like ordinary glasses, making it convenient for flexible use in both fixed and mobile scenarios.

[0134] 4. Low energy efficiency: Glasses-type eye trackers consume less power and are more economical to use.

[0135] 5. Simple installation: Wearing the glasses-style eye tracker is simple and quick, just like wearing ordinary glasses, requiring almost no additional installation steps.

[0136] 6. Based on eye-tracking technology, the brain cognition and physiological function auxiliary diagnosis function provides users with a new, portable, and non-invasive way of health monitoring and cognitive assessment.

[0137] See Figure 4 As shown, this application provides a schematic diagram of the framework of an eye-tracking system. Figure 4 As shown, the eye-tracking system includes a terminal device 20 and a glasses-type eye-tracking device 10 according to an embodiment of this application.

[0138] The eye-tracking glasses 10 is electrically connected to the terminal device 20. The eye-tracking glasses 10 can send eye-tracking data to the terminal device 20.

[0139] Optionally, the terminal device 20 is used to assess the probability that a target subject has a preset brain function disorder based on eye-tracking data.

[0140] See Figure 4 As shown, the terminal device 20, as an external device, can be at least one of a smartphone, a laptop, and a desktop computer. The processor 103 of the glasses-type eye-tracking device 10 is electrically connected to both displays 102 and the eye-tracking acquisition component 104, and can control the displays 102 to display virtual images, activate the eye-tracking acquisition component 104 to collect eye-tracking data, and acquire eye-tracking data.

[0141] In the embodiments of this application, the terms "module" or "unit" refer to a computer program or part of a computer program that has a predetermined function and works with other related parts to achieve a predetermined goal, and can be implemented wholly or partially using software, hardware (such as processing circuitry or memory), or a combination thereof. Similarly, a processor (or multiple processors or memory) can be used to implement one or more modules or units. Furthermore, each module or unit can be part of an overall module or unit that includes the functionality of that module or unit.

[0142] The above description is only an optional implementation method for some implementation scenarios of this application. It should be noted that for those skilled in the art, other similar implementation methods based on the technical concept of this application without departing from the technical concept of this application also fall within the protection scope of the embodiments of this application.

Claims

1. A glasses-type eye-tracking device, characterized in that, include: The eyeglass frame has a first edge portion and a second edge portion; Two displays are mounted on the eyeglass frame; wherein the first edge portion and the second edge portion are located above and below the displays, respectively; An eye-tracking acquisition component is disposed on the second edge portion and at least partially exposed on the surface of the second edge portion; The processor is located within the first edge portion and is electrically connected to the eye-tracking acquisition component.

2. The glasses-type eye-tracking device according to claim 1, characterized in that, The eye-tracking acquisition component includes: At least one light source, wherein the light-emitting side of the light source is configured to correspond to the cornea of ​​the target object; At least one camera module, wherein the shooting area of ​​the camera module is set to correspond to the eye of the target object.

3. The eye-tracking device for glasses according to claim 1, characterized in that, Also includes: An integrated sensor module is located at the first edge and is electrically connected to the processor.

4. The glasses-type eye-tracking device according to claim 3, characterized in that, The integrated sensor module includes at least one of the following: The inertial measurement unit sensor includes an accelerometer, a gyroscope, and a magnetometer, wherein the accelerometer, the gyroscope, and the magnetometer are all disposed within the first edge portion and electrically connected to the processor; A proximity light sensor is disposed on the first edge portion and electrically connected to the processor.

5. The glasses-type eye-tracking device according to claim 2, characterized in that, At least one of the light sources is two near-infrared light sources, and at least one of the camera modules is two near-infrared cameras; The second edge portion includes two second sub-edge portions respectively disposed below the two display screens; One near-infrared light source and one near-infrared camera are arranged as a group on a second sub-edge portion.

6. The eye-tracking device for glasses according to claim 1, characterized in that, Also includes: The refractive adjustment button is located on the eyeglass frame and above the display screen.

7. The glasses-type eye-tracking device according to claim 1, characterized in that, It also includes at least one of the following: A scene camera is mounted on the eyeglasses frame and located in the central region of the eyeglasses frame; the central region is located between the two displays. At least one speaker and volume control button are located on the temple of the eyeglass frame; Two electroluminescent lenses and a light-transmitting button are provided, with each electroluminescent lens located on the side of the display screen closest to the target object, and the light-transmitting button located on the temple of the eyeglass frame.

8. The eye-tracking device for glasses according to claim 1, characterized in that, It also includes at least one of the following: Two nose pads are detachably mounted on the eyeglass frame; A light-shielding element is detachably mounted on the eyeglass frame and positioned in front of the display screen.

9. The glasses-type eye-tracking device according to claim 1, characterized in that, Also includes: A power supply and data interface is located at the end of the temple of the eyeglass frame for electrical connection to an external power source or a terminal device.

10. An eye-tracking system, characterized in that, Includes terminal devices and eye-tracking glasses as described in any one of claims 1-9; The glasses-type eye-tracking device is electrically connected to the terminal device.

Images