Eye health monitoring device, method and system, and storage medium

Abstract

An eye health monitoring device, method and system, and a storage medium, relating to the technical field of eye monitoring. The eye health monitoring device is a sensor frame that can be mounted on glasses, and is used for eye health monitoring and research. The eye health monitoring device has a compact wearable frame, built-in infrared eye cameras (5), individually addressable infrared light emitters (4), an external-facing RGB camera (1), an inertial measurement unit (IMU), a plurality of integrated sensors such as an ambient light sensor (2) and a proximity sensor (3), and a control system. By means of the control system, parameters of the plurality of sensors can be configured in real time, and data output of the sensors can be synchronized, such that the eye health monitoring device can support various eye health applications including gaze estimation, interpupillary distance measurement, diopter estimation, tear meniscus height analysis, and attention monitoring. The solution overcomes limitations of existing systems, and provides a unified platform for advanced eye health diagnosis and research in clinical and real environments.

Description

Eye health monitoring device, method, system and storage medium TECHNICAL FIELD

[0001] The present application relates to the technical field of eye monitoring, in particular to an eye health monitoring device, method, system and storage medium. BACKGROUND

[0002] The field of eye health monitoring is advancing towards non-invasive and continuous monitoring with the development of wearable technology and biomedical sensing. Smart glasses and eye-mounted devices have become a research hotspot, aiming to track eye movements, attention and physiological indicators (such as diopter, interpupillary distance, and ocular surface status) in real time, providing support for clinical diagnosis and visual behavior analysis.

[0003] Existing eye health research devices usually combine infrared cameras, ambient light sensors and inertial measurement units to track local eye movements and are applied to eye movement tracking, augmented reality and visual behavior analysis; while traditional refraction and ocular surface analysis tools, including traditional diopter measurement and interpupillary distance analysis tools, are large in size and require manual operation; ocular surface analysis tools such as slit lamps and tear film height measuring instruments are limited to clinical environments. Some commercial and academic attempts have integrated infrared-based gaze tracking into wearable systems.

[0004] However, existing solutions often lack flexibility, high customizability, modularity and the ability to support diverse research applications. Therefore, there is an urgent need to propose a multifunctional, wearable platform or device that can be flexibly customized in different environments according to specific experimental or clinical needs to adapt to various eye health applications including eye movement tracking, interpupillary distance measurement, diopter estimation and ocular surface diagnosis, thereby overcoming the limitations of current eye movement tracking systems and clinical diagnostic tools. SUMMARY

[0005] In view of the deficiencies of the prior art, the present application provides an eye health monitoring device, method, system and storage medium, which at least solves the problem of lack of flexibility and high customizability of the existing eye health monitoring device or platform.

[0006] To achieve the above purpose, the present application is realized by the following technical scheme:

[0007] In a first aspect, the present application first proposes an eye health monitoring device, which comprises:

[0008] a multi-sensor group and a control system;

[0009] The multi-sensor group is used to collect at least the user's eye and its surrounding field of view, environmental data;

[0010] The control system is configured to configure parameters of the plurality of sensors in the multi-sensor group in real time and synchronize the plurality of sensor data outputs.

[0011] In one embodiment, the multi-sensor group comprises a plurality of eye image capture component, illumination component, outward-facing camera component, head tracking component, ambient light detection component, proximity detection component, wherein:

[0012] an eye image capture component configured to capture eye images of a user;

[0013] an illumination component configured to provide illumination to the eye region;

[0014] an outward-facing camera component configured to capture field of view of the user;

[0015] a head tracking component configured to track comprehensive data of the user’s head, the comprehensive data comprising the user’s head movement, orientation, and stability;

[0016] an ambient light detection component configured to monitor light around the device; and

[0017] a proximity detection component configured to detect near-field objects in proximity to the device.

[0018] In one embodiment, the eye health monitoring device is detachably mountable with eyewear or headwear, or wearable, or seamlessly integrated.

[0019] In one preferred embodiment, the eye image capture component comprises an infrared eye camera.

[0020] In one preferred embodiment, the illumination component comprises an infrared light emitter.

[0021] In one preferred embodiment, the outward-facing camera component comprises an outward-facing RGB camera.

[0022] In one preferred embodiment, the head tracking component comprises an inertial measurement unit.

[0023] In one preferred embodiment, the ambient light detection component comprises an ambient light sensor.

[0024] In one preferred embodiment, the proximity detection component comprises a proximity sensor.

[0025] In a further preferred embodiment, there are multiple infrared light emitters, and the multiple infrared light emitters are configured by the control system to be individually addressable to create custom illumination patterns for eye imaging.

[0026] In a further preferred embodiment, the inertial measurement unit comprises an accelerometer, a gyroscope, and a magnetometer.

[0027] In one embodiment, the control system is configured to adjust camera parameters of the at least one infrared eye camera and the outward-facing RGB camera, and the control system is configured to synchronize data from the at least one IR eye camera, the outward-facing RGB camera, the IMU, and the ambient light sensor and the proximity sensor for performing gaze estimation and eye movement tracking.

[0028] In a second aspect, the present application further provides an eye health monitoring method, which is implemented based on the device of any one of the above aspects, and the method comprises:

[0029] collecting user eye and its surrounding visual field and environmental data based on the multi-sensor group;

[0030] configuring parameters of multiple sensors in the multi-sensor group and synchronizing multiple sensor data output in real time based on the control system.

[0031] In a third aspect, the present application further provides an eye health monitoring system, which comprises the device of any one of the above aspects.

[0032] In a fourth aspect, the present application finally provides a computer readable storage medium, which comprises a stored computer program, wherein when the computer program runs, the device where the computer readable storage medium is located performs the steps of the eye health monitoring method as described above.

[0033] The present application provides an eye health monitoring device, method, system and storage medium. Compared with the prior art, the following beneficial effects are achieved:

[0034] The eye health monitoring device provided by the present application comprises a multi-sensor group and a control system, wherein the multi-sensor group is used to collect at least user eye and its surrounding visual field and environmental data, and the control system is used to configure parameters of multiple sensors in the multi-sensor group in real time and synchronize multiple sensor data output. The device uses the control system to configure parameters of multiple sensors in real time and synchronize multiple sensor data output, so that the device can support various eye health applications including gaze estimation, interpupillary distance measurement, diopter estimation, tear river height analysis and attention monitoring. This technology overcomes the limitations of existing systems and provides a unified platform for advanced eye health diagnosis and research in clinical and real-world environments. BRIEF DESCRIPTION OF DRAWINGS

[0035] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0036] Figure 1 is a schematic block diagram of an eye health monitoring device according to an embodiment of the present invention;

[0037] Figure 2 is a schematic diagram showing the positions of the RGB camera, ambient light sensor, and proximity sensor facing the outside in the eye health monitoring device in an embodiment of the present invention;

[0038] Figure 3 is a schematic diagram showing the positions of the IR light emitter and the IR eye camera in the eye health monitoring device in an embodiment of the present invention;

[0039] Figure 4 is a schematic diagram of the side structure of the eye health monitoring device in an embodiment of the present invention;

[0040] Figure 5 is a hardware stack diagram of the eye health monitoring device in an embodiment of the present invention;

[0041] Figure 6 is a logic diagram of eye health data processing in an embodiment of the present invention;

[0042] Figure 7 is a flowchart of the analysis of gaze and eye tracking using the eye health monitoring method in an embodiment of the present invention;

[0043] Figure 8 is a flowchart of analyzing eye health indicators using an eye health monitoring method in an embodiment of the present invention;

[0044] Figure 9 is a structural diagram of the eye health monitoring system in an embodiment of the present invention;

[0045] Figure 10 is a data flow diagram of the eye health monitoring system in an embodiment of the present invention;

[0046] In the diagram: 1- RGB camera facing outwards; 2- Ambient light sensor; 3- Proximity sensor; 4- IR light emitter; 5- IR eye camera; 6- Eyeglass frame structure; 7- Lens surround structure; 8- Mounting clip. Detailed Implementation

[0047] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention are described clearly and completely. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0048] The embodiment of the present application provides an eye health monitoring device, method, system and storage medium, at least solves the problem that an eye health monitoring device or platform in the prior art lacks flexibility and high customization, and realizes the purpose that various advanced eye health diagnosis and research tasks in clinical and real environments can be flexibly adapted through a unified device or platform.

[0049] The technical solutions in the embodiment of the present application are as follows to solve the above technical problems:

[0050] In order to solve the problems in the prior art, the technical solutions of the present application provide an eye health monitoring device, which first has a compact, wearable and user-friendly shape, can be conveniently and quickly installed on glasses or a head-mounted device of a user, then integrates multiple integrated sensors including an infrared eye camera, an individually addressable infrared light emitter, an RGB camera facing the outside world, an inertial measurement unit (IMU), and an ambient light sensor and a proximity sensor on the glasses or the head-mounted device, and provides a control system for the sensors, so that the device can support various eye health applications including gaze estimation, interpupillary distance measurement, diopter estimation, tear river height analysis and attention monitoring, and provide researchers and clinicians with unprecedented control capabilities of sensor parameters, real-time data integration and adaptation to various eye health applications.

[0051] In order to better understand the above technical solutions, the above technical solutions will be described in detail in combination with the drawings of the specification and specific embodiments. Embodiments

[0052] The multi-sensor group is used for at least collecting eye and surrounding field of view and environment data of a user, and the control system is used for real-time configuration of parameters of multiple sensors in the multi-sensor group and synchronous multiple sensor data output.

[0053] The eye health monitoring device can integrate various types of sensors and light sources according to actual needs to capture a wide range of high-quality eye health indicators. Meanwhile, the device allows real-time configuration of hardware parameters of the multi-sensor group, so that researchers and clinicians can customize data collection for specific eye health applications, and further support various eye health monitoring and research functions (such as gaze tracking, pupil measurement, blink analysis and tear film evaluation), and adapt to various research protocols and clinical requirements in the field of ophthalmology and visual science.

[0054] In some embodiments, the multi-sensor group includes but is not limited to multiple components in the following groups:

[0055] an eye image capture component for capturing images of the user's eyes;

[0056] an illumination component for providing illumination to the eye region;

[0057] an outward-facing camera component for capturing images of the user's field of view;

[0058] a head tracking component for tracking comprehensive data of the user's head, including the user's head motion, orientation, and stability;

[0059] an ambient light detection component for monitoring the light around the device; and

[0060] a proximity detection component for detecting near-field objects in the vicinity of the device.

[0061] In some embodiments, the eye health monitoring device described above is designed to be detachably mounted or worn with or seamlessly integrated with various eyewear or headgear to provide a compact and portable platform for collecting various eye-related data.

[0062] As shown in FIG. 2, in some preferred embodiments, the eye health monitoring device further comprises an eyewear frame structure 6 with the various components described above integrated at key locations of the eyewear frame structure 6. The eyewear frame structure 6 is generally designed as a conventional eyewear with a rectangular lens opening and temples extending from both sides, allowing for long-term comfortable wearing while providing necessary sensor positioning for accurate eye movement tracking and environment monitoring.

[0063] In other preferred embodiments, the eye health monitoring device is adapted to existing eyewear or headgear. As shown in FIG. 3, a front orthogonal view of the eyewear-mounted eye health monitoring device, the device further comprises a lens-surrounding structure 7 that can inlay or accommodate standard prescription or non-prescription lenses around its lens opening. The design of the lens-surrounding structure 7 allows the eye health monitoring device to be adapted to various users with or without vision correction needs.

[0064] The lens-surrounding structure 7 contains mounting points for the various components described above, including the eye image capture component, the illumination component, the outward-facing camera component, the head tracking component, the ambient light detection component, and the proximity detection component, while maintaining an aesthetically pleasing and wearable form factor.

[0065] Preferably, as shown in FIG. 4, the eye health monitoring device further comprises a mounting clip 8 for attaching to the eyewear frame, allowing the eye health monitoring device to be easily integrated with existing eyewear and enhancing the versatility of the device.

[0066] In addition, the overall structure of the eye health monitoring device presents a balanced and ergonomic configuration. As shown in FIG. 3, a streamlined design is demonstrated, which maintains the appearance of a regular pair of glasses while integrating the sensing components. As shown in FIG. 4, the eyeglass frame can also adopt a curved design, following an ergonomic profile suitable for glasses integration. This curved design can enhance the comfort of the user during long periods of wear.

[0067] In some implementations, the eye health monitoring device maintains a slim profile suitable for standard eyeglass frame integration, while accommodating the necessary sensing components. FIG. 4 demonstrates how sensors and other components can be installed on the eyeglass frame at optimal positions relative to the user's eyes when arranged along the frame body. RGB indicator lights use LED light devices in the three primary colors of red, green, and blue. By adjusting the brightness and mixing ratio of the three colors, a variety of different colors can be produced to meet the requirements for light color in different application scenarios.

[0068] Preferably, in some embodiments, the various components involved in the eye health monitoring device, such as the eye image capture component, the illumination component, the outward-facing camera component, the head tracking component, the ambient light detection component, the proximity detection component, etc., are designed to distribute weight evenly on the frame structure. Even weight distribution helps maintain comfort during long periods of use and prevents the frame from shifting or sliding when the user moves. The frame also contains adjustable components, such as nose pads or temples, to ensure safe and comfortable wear for a wide range of users.

[0069] In some embodiments, the eye health monitoring device described above includes an eye image capture component for capturing images of the user's eyes.

[0070] Preferably, the eye image capture component includes, but is not limited to, an infrared (IR) eye camera 5.

[0071] In one embodiment, the eye image capture component is an infrared (IR) eye camera 5, which is used to capture high-contrast images of the eyes. As shown in FIG. 3, two IR eye cameras 5 are located within the frame, near the nose pads of the glasses, with one camera dedicated to each eye. The IR eye cameras 5 are oriented inward toward the eye area to enable eye movement tracking and monitoring functions.

[0072] Preferably, the IR eye cameras 5 are installed at an angle to optimize eye movement capture, while being hidden within the frame structure without affecting the eye image capture function of the IR eye cameras 5, thus combining functionality and aesthetics.

[0073] In addition, in some scenarios, the positioning of the IR eye cameras 5 within the frame allows for continuous monitoring of eye activity without obstructing the user's field of view.

[0074] In practice, the IR eye camera 5 can capture various types of eye-related data depending on the application scenario. For example, the IR eye camera 5 can capture images in the infrared spectrum, which can provide enhanced contrast for detecting eye features such as the pupil, iris, and sclera. This enhanced contrast can aid in more accurate gaze tracking and eye movement analysis. As another example, the camera can record pupil dilation and constriction, which can provide insights into cognitive load or emotional state. In some application scenarios, the IR eye camera 5 can track the movement of the iris to estimate gaze direction and gaze point. The IR eye camera 5 can also support ocular surface imaging. In some application scenarios, the IR eye camera 5 can capture detailed images of the cornea and surrounding tissue, which can aid in assessing eye health indicators such as tear film quality or the presence of dry eye symptoms.

[0075] In some embodiments, the IR eye camera 5 operates at a high frame rate to capture rapid eye movements such as saccades or microsaccades. This high-speed capture capability can enable more detailed eye behavior analysis and can support advanced gaze estimation algorithms.

[0076] Integrating the IR eye camera 5 within an eye health monitoring device enables continuous data collection in real-world environments. This allows researchers and clinicians to gain insights into eye behavior and health beyond traditional clinical settings, potentially revealing patterns or indicators that may not be apparent during brief examinations.

[0077] In some embodiments, the eye health monitoring device described above includes an illumination component for providing illumination to the eye region of the user.

[0078] Preferably, the illumination component includes, but is not limited to, an infrared light emitter.

[0079] In one embodiment, on the eyeglass frame, a plurality of infrared (IR) light emitters are distributed around each lens area, as shown in FIG. 3. The plurality of IR light emitters 4 are used in conjunction with the IR eye camera 5 described above to provide consistent illumination to the eye region, which can enhance the quality and reliability of eye movement tracking data under various lighting conditions.

[0080] In some embodiments, the ocular health monitoring device distributes a plurality of individually addressable IR light emitters 4 around each lens area. As shown in FIG. 3, these IR light sources are arranged in a symmetrical pattern to provide uniform illumination of the ocular region. Each IR light emitter 4 is independently controlled, allowing precise manipulation of the illumination pattern. The individual addressing capability can enable researchers and clinicians to selectively activate specific light sources or create custom combinations of light emitters, which can provide advantages for ocular health monitoring and diagnosis. In practice, researchers can activate only a subset of emitters to create a structured light pattern for specialized imaging techniques. For example, this capability can be used for tear film reflection analysis, where specific illumination angles can enhance the visibility of the tear river.

[0081] The ocular health monitoring device allows dynamic adjustment of the IR illumination configuration during use. For example, in some embodiments, the IR light emitter 4 pattern is automatically modified according to environmental conditions or the specific diagnostic task being performed. Specifically, the ocular health monitoring device can activate additional emitters in low-light environments to maintain consistent illumination for eye movement tracking.

[0082] The individually addressable nature of the IR light emitters 4 can also support advanced gaze estimation techniques. By selectively illuminating different regions around the eye, the device can enhance the contrast of specific ocular features, potentially improving the accuracy of pupil detection and iris tracking algorithms.

[0083] In some embodiments, the IR light emitters 4 in the ocular health monitoring device enable variable illumination patterns. This can be useful for certain diagnostic procedures, such as assessing the pupillary light reflex or conducting specialized ocular surface examinations that require controlled light stimuli.

[0084] As shown in FIG. 3, the arrangement of IR light emitters 4 around the lens area enables comprehensive coverage of the ocular region. This comprehensive distribution pattern ensures adequate illumination in various eye positions and gaze directions, supporting consistent data collection across a wide range of eye movements and user activities.

[0085] In some embodiments, the ocular health monitoring device also includes an outward-facing camera assembly for capturing the user's field of view.

[0086] Preferably, the outward-facing camera assembly includes, but is not limited to, an outward-facing RGB camera 1.

[0087] In one embodiment, as shown in FIG. 2, the outward-facing RGB camera 1 is mounted at the center of the eyewear's upper frame portion, which can closely align the RGB camera with the user's natural line of sight, enabling accurate capture of the visual environment.

[0088] In some application scenarios, the outward-facing RGB camera 1 supports contextual gaze mapping by providing reference images of the user's surroundings. This allows for the association of eye movements and gaze directions with specific objects or regions in the user's field of view. For example, the outward-facing RGB camera 1 is able to capture images of a computer screen or printed text that the user is reading, enabling researchers to analyze reading patterns and gaze points in real-world scenarios.

[0089] Furthermore, the outward-facing RGB camera 1 can also facilitate environmental recording, which can provide valuable context for interpreting eye behavior data. In some implementations, the camera records visual features of the user's environment, such as lighting conditions, color schemes, or the presence of moving objects. These environmental data are used to understand how different visual stimuli affect eye movements and pupil responses.

[0090] Integrating the outward-facing RGB camera 1 with other components in the eyewear frame enables advanced analysis of the user's interaction with the surrounding environment. For example, combining proximity sensor 3 data and panoramic camera images to distinguish between screen-based and real-world visual interactions. This can support screen versus environment interaction recording, providing insights into the user's allocation of visual attention between digital devices and the physical world.

[0091] In some embodiments, the outward-facing RGB camera 1 can operate at different frame rates and resolutions to accommodate different research or diagnostic needs. The camera can be configured to capture high-resolution still images for detailed analysis of specific visual scenes, or it can record video at lower resolution to provide continuous environmental context over a longer period of time.

[0092] In some embodiments, the data collected by the outward-facing RGB camera 1 can be time-synchronized with the eye movement tracking data from the IR eye camera 5, allowing for precise temporal alignment between environmental stimuli and eye responses. This synchronization can enable researchers to study the complex relationship between visual input and eye behavior in natural environments.

[0093] In some embodiments, the eye health monitoring device further comprises a head tracking component for tracking comprehensive data of the user's head.

[0094] Preferably, the head tracking component comprises, but is not limited to, an inertial measurement unit (IMU), and the tracked comprehensive data of the user's head comprises, but is not limited to, the user's head motion, orientation, and stability.

[0095] In one embodiment, as shown in FIG. 5, which is a hardware stack diagram of the device, the IMU is located in the middle right region of the configuration, which can accurately measure the motion and orientation of the eye health monitoring device in three-dimensional space.

[0096] In some preferred embodiments, the IMU can be composed of a combination of accelerometers, gyroscopes, and magnetometers that work together to provide comprehensive data on the linear acceleration, angular velocity, and magnetic field direction of the eye health monitoring device. The integration of these sensors such as accelerometers, gyroscopes, and magnetometers enables precise tracking of head movement and positional changes over time.

[0097] Additionally, the IMU can complement other sensors in the eye health monitoring device to enhance spatial modeling of eye direction. For example, the IMU data can be synchronized with the eye movement tracking camera to compensate for head-induced motion when estimating gaze direction. This integration can improve the accuracy of eye movement tracking by considering the relative motion between the eye and the frame.

[0098] In some embodiments, the IMU can provide real-time information on the user's head posture and movement patterns. These data are valuable for understanding the context of eye movement and gaze behavior. For example, using IMU data to distinguish between eye movements caused by head rotation and those caused by actual gaze shifts.

[0099] Additionally, the IMU helps assess the stability of the eye health monitoring device. By monitoring small movements and vibrations, the IMU can help identify periods of stable wear versus periods of significant motion. This information can be used to flag potential artifacts in eye movement tracking data or trigger adaptive algorithms that consider different levels of head stability.

[0100] In some embodiments, IMU data can be used to improve the accuracy of the outward-facing RGB camera 1 images. By providing information about the eye health monitoring device's orientation and motion, the IMU can enable image stabilization or motion compensation techniques for the outward-facing RGB camera 1, potentially improving the quality of environmental context data.

[0101] The integration of IMU data with other sensor outputs can support more powerful advanced fusion algorithms for eye movement tracking and gaze estimation. For example, combining IMU-derived head posture information with eye position data from the IR eye camera 5 creates a more comprehensive model of the user's visual attention in three-dimensional space.

[0102] In some embodiments, the IMU operates at a high sampling rate to capture rapid head movements or micro-movements. This high-frequency data collection can enable detailed analysis of head-eye coordination and can support applications in areas such as vestibular-ocular reflex evaluation or balance disorder research.

[0103] The eye health monitoring device can allow calibration and adjustment of the IMU to account for individual differences in head movement patterns or to optimize performance for specific research protocols. This flexible performance enhancement system adapts to various eye health monitoring and research applications.

[0104] In some embodiments, the eye health monitoring device further comprises an ambient light detection component and a proximity detection component. The ambient light detection component is used to monitor the light around the device, and the proximity detection component is used to detect near-field objects near the device.

[0105] Preferably, the ambient light detection component includes, but is not limited to, an ambient light sensor 2, and the proximity detection component includes, but is not limited to, a proximity sensor 3.

[0106] In a preferred embodiment, as shown in Figure 2, the ambient light sensor 2 and the proximity sensor 3 are located at the upper frame part of the glasses, and beside the RGB camera 1 facing the outside world. This arrangement makes the sensor capture more accurate environmental readings while being as hidden as possible within the glasses frame structure 6.

[0107] In some embodiments, the ambient light sensor 2 can continuously monitor the light level around the eye health monitoring device, providing valuable data for contextual eye behavior. For example, using this information to understand how pupil dilation responds to changes in environmental lighting in various environments and activities.

[0108] The proximity sensor 3 component can detect the presence of nearby objects or surfaces. As shown in Figure 4, the proximity sensor 3 is integrated into the main body of the eye health monitoring device component and is placed in the best position relative to the user's field of view. This placement can enable the detection of near-field objects such as computer screens, books, or handheld devices.

[0109] In some embodiments, the combination of the ambient light sensor 2 and the proximity sensor 3 can work in conjunction with other sensors in the glasses frame to provide contextual information for eye behavior analysis. For example, using the data from the proximity sensor 3 to determine when the user is interacting with a nearby screen, while monitoring the ambient light level to assess the impact of screen brightness on eye strain.

[0110] The ambient light sensor 2 can support adaptive functions within the eye health monitoring device. In some cases, using ambient light readings to automatically adjust the intensity of infrared illumination used for eye tracking ensures consistent performance under different lighting conditions. The proximity sensing capability enables the eye health monitoring device to distinguish between different types of visual interactions. For example, distinguishing between the user looking at a distant object and focusing on a nearby screen or document. This contextual information is valuable for researchers studying visual attention patterns or developing adaptive display technologies.

[0111] In some embodiments, the ambient light sensor 2 and the proximity sensor 3 can operate at different sampling rates to accommodate different research or diagnostic needs. The sensors can be configured to provide high-frequency data for detailed analysis of rapid environmental changes, or can operate at a lower rate to save power during long-term monitoring.

[0112] The data collected by the ambient light sensor 2 and the proximity sensor 3 are time-synchronized with other sensor outputs such as eye tracking data and outward-facing RGB camera 1 images. This synchronization allows researchers to investigate complex relationships between environmental conditions, user interactions, and eye behaviors in real-world environments.

[0113] In one embodiment, the eye health monitoring device further comprises a complex control system for real-time configuration of multiple sensor parameters in the eye image capture assembly, the illumination assembly, the outward-facing camera assembly, the head tracking assembly, the ambient light detection assembly, and the proximity detection assembly, and synchronization of data outputs from the eye image capture assembly, the illumination assembly, the outward-facing camera assembly, the head tracking assembly, the ambient light detection assembly, and the proximity detection assembly. As shown in FIG. 5, multiple sensors and assemblies are integrated in a distributed configuration, enabling comprehensive data collection and real-time configurability.

[0114] In some embodiments, the control system allows for direct manipulation of camera attributes for various imaging sensors in the framework. This can extend to adjusting brightness, contrast, exposure, frame rate, and resolution settings for the IR eye camera 5 and the outward-facing RGB camera 1. Fine-tuning these parameters can enable researchers and clinicians to optimize image capture for specific lighting conditions or diagnostic requirements.

[0115] In some embodiments, the control system can facilitate real-time adjustment of sensor parameters during operation. For example, the control system can dynamically modify camera exposure settings based on changing ambient light conditions detected by the ambient light sensor 2 as shown in FIG. 5. This adaptive functionality can help maintain consistent image quality across different environments and usage scenarios.

[0116] In some embodiments, the control system can enable synchronized data collection across multiple sensor types. FIG. 5 depicts a configuration where the proximity sensor 3, the ambient light sensor 2, the IR camera, and an inertial measurement unit (IMU) are integrated into a system, and the control system can coordinate the timing and data flow of these different sensors, ensuring that information from different sources can be accurately correlated and analyzed.

[0117] In some embodiments, the eye health monitoring device described above further comprises a processor configured to perform a corresponding analysis function based on data from multiple sensors in the multi-sensor group, and adjust the functionality of the device based on the analysis result. For example, the processor is configured to perform real-time analysis of eye health indicators based on data from at least one IR eye camera 5, the ambient light sensor 2, and the proximity sensor 3. Further, the processor is further configured to adjust the functionality of the device based on the real-time analysis of eye health indicators, for example, including adjusting sensor parameters and illumination patterns.

[0118] The synchronization capabilities of the control system can support advanced data fusion techniques. For example, combining eye tracking data from an infrared camera with head motion information from an IMU creates a more comprehensive model of gaze behavior. This multi-sensor integration can enhance the accuracy and reliability of eye health assessments and research findings.

[0119] In some embodiments, the control system can provide configurable data output formats and sampling rates. Researchers can specify which sensor data streams to include in the output and adjust the temporal resolution of data collection to accommodate different experimental protocols or clinical needs. This flexibility allows for efficient data management and storage, especially during long-term monitoring.

[0120] The control system can provide an interface for real-time data access and visualization. In some implementations, researchers or clinicians can view real-time sensor output and adjust parameters on the fly, enabling interactive experiments and real-time feedback during eye health assessments.

[0121] The control system and data integration capabilities of the eye health monitoring device can support the development and training of machine learning models related to eye health. Collecting synchronized multi-modal data can provide a rich dataset for training algorithms to detect patterns or anomalies in eye behavior. For example, developing a machine learning model to predict fatigue based on a combination of blink rate, pupil dynamics, and head motion patterns captured by integrated sensors.

[0122] In some embodiments, the control system allows for implementing processing algorithms within the device. This can enable real-time analysis of sensor data, potentially supporting immediate feedback or adaptive functionality based on detected eye health indicators.

[0123] The control system can also facilitate integration of the eye health monitoring device with external systems or devices. In some implementations, the eyewear frame can transmit synchronized sensor data to a connected computer or mobile device for further analysis or storage. This connectivity can enhance the versatility of the system in various research and clinical settings.

[0124] The eye health monitoring device can integrate multiple components to enable comprehensive eye health monitoring and research applications. As shown in Figure 5, various sensors and modules are integrated to work together to collect and analyze eye-related data.

[0125] In some embodiments, the IR eye camera 5 can capture high-resolution images of the eye, while the individually addressable IR light emitters 4 provide controlled illumination. This combination enables precise tracking of eye movements and pupil dynamics. The outward-facing RGB camera 1 can simultaneously record the user's visual environment, providing contextual information for gaze estimation and attention analysis.

[0126] An inertial measurement unit (IMU) works in conjunction with the eye tracking assembly to compensate for head movements and improve the accuracy of gaze direction calculations. In some embodiments, data from the IMU and the eye camera are fused to create a more robust three-dimensional model of visual attention.

[0127] Ambient light sensor 2 and proximity sensor 3 provide additional contextual data to enhance the interpretation of eye behavior. For example, using ambient light readings to adjust the illumination level of IR light emitters 4 and camera exposure settings ensures consistency in eye tracking performance under different lighting conditions.

[0128] In some embodiments, the integrated assembly can support advanced applications such as refractive error estimation. Analyzing eye movement patterns and accommodation responses captured by IR eye camera 5 to infer changes in focal length. These data, combined with visual environmental information provided by outward-facing RGB camera 1, can enable the estimation of refractive errors without the use of traditional optometry equipment.

[0129] Eye health monitoring devices facilitate attention and fatigue monitoring through comprehensive analysis of eye behavior.

[0130] In some embodiments, the use of IR eye camera 5 and the illumination system tracks blink frequency, saccadic patterns, and pupil dynamics. These data are correlated with head movement information from the IMU and environmental context from the outward-facing RGB camera 1 to assess user alertness and cognitive load over time.

[0131] For tear river and red eye analysis, eye health monitoring devices leverage their configurable IR illumination system and high-resolution eye camera. In some cases, specific IR light emitters 4 are selectively activated to create optimal lighting conditions for visualizing the tear film. IR eye camera 5 can capture detailed images of the ocular surface while the control system adjusts camera parameters such as exposure and contrast to enhance the visibility of relevant features.

[0132] The integration of multiple sensor types can enable eye health monitoring devices to perform interpupillary distance (IPD) measurements with high precision. In some embodiments, a combination of eye tracking data from IR eye camera 5 and spatial information from outward-facing RGB camera 1 is used to calculate the distance between the pupils. This measurement is refined using head orientation data from the IMU to account for different viewing angles and distances.

[0133] The synchronized data flow of all sensors facilitated by the control system as shown in Figure 5 can support complex analysis of eye health indicators. For example, correlating changes in tear river height with blink patterns and environmental factors such as ambient humidity or air flow provides a more comprehensive assessment of ocular surface health.

[0134] In some embodiments, the eye health monitoring device adjusts its functionality according to real-time analysis of the multi-sensor data. For example, signs of visual fatigue are detected through changes in blink rate and saccade speed, and the frequency of certain measurements or specific diagnostic procedures are automatically adjusted to collect more detailed eye health status data.

[0135] The integration of these components in a wearable form factor can enable continuous monitoring and analysis of eye health indicators in real-world environments. This can support longitudinal studies of eye behavior and health, potentially revealing patterns or indicators that can not be apparent during brief clinical examinations. Embodiments

[0136] In a second aspect, the present application also provides an eye health monitoring method, as shown in FIG. 6, which is implemented based on the device described in any of the above embodiments and preferred embodiments. The method mainly includes:

[0137] S1, collecting eye and its surrounding visual field, environment data of a user based on a multi-sensor group;

[0138] S2, configuring parameters of multiple sensors in the multi-sensor group and synchronizing multiple sensor data output in real time based on a control system.

[0139] In some preferred embodiments, the multi-sensor group includes multiple components of an eye image capture component, an illumination component, an outward-facing camera component, a head tracking component, an ambient light detection component, and a proximity detection component, wherein: the eye image capture component is used to capture images of the user's eyes; the illumination component is used to provide illumination for the eye region; the outward-facing camera component is used to capture the user's visual field; the head tracking component is used to track comprehensive data of the user's head, including the user's head movement, direction, and stability; the ambient light detection component is used to monitor the light around the device; and the proximity detection component is used to detect near-field objects near the device.

[0140] More preferably, the eye image capture component includes an infrared eye camera; the illumination component includes an infrared light emitter; the outward-facing camera component includes an outward-facing RGB camera; the head tracking component includes an inertial measurement unit; the ambient light detection component includes an ambient light sensor; and the proximity detection component includes a proximity sensor.

[0141] The eye health monitoring method proposed in this embodiment can integrate various types of sensors and light sources according to actual needs to capture a wide range of high-quality eye health indicators. At the same time, the method allows real-time configuration of hardware parameters of multiple sensor groups and the like, enabling researchers and clinicians to customize data collection for specific eye health applications and thus support various eye health monitoring and research functions (such as gaze tracking, pupil measurement, blink analysis, and tear film evaluation) to adapt to various research protocols and clinical requirements in the field of ophthalmology and visual science.

[0142] As shown in FIG. 7, a flowchart for analyzing gaze and eye movement tracking using the eye health monitoring method proposed in this embodiment is shown.

[0143] As shown in FIG. 8, a flowchart for analyzing eye health indicators using the eye health monitoring method proposed in this embodiment is shown.

[0144] It can be understood that the eye health monitoring method provided by the embodiments of the present application corresponds to the eye health monitoring device described above, and the explanation, examples, advantages, etc. of the related content can refer to the corresponding content in the eye health monitoring device, which will not be repeated here. Embodiments

[0145] In a third aspect, the present application also provides an eye health monitoring system, as shown in FIGS. 9 and 10, which comprises the device described in any of the above embodiments and preferred embodiments, and the device comprises:

[0146] a multi-sensor group and a control system;

[0147] The multi-sensor group is used to collect at least the user's eye and its surrounding field of view, environmental data;

[0148] The control system is used to real-time configure the parameters of multiple sensors in the multi-sensor group and synchronize multiple sensor data output.

[0149] In some preferred embodiments, the multi-sensor group comprises multiple of an eye image capture component, an illumination component, an outward-facing camera component, a head tracking component, an ambient light detection component, and a proximity detection component, wherein: the eye image capture component is used to capture the user's eye image; the illumination component is used to provide illumination for the eye region; the outward-facing camera component is used to capture the user's field of view; the head tracking component is used to track the user's head comprehensive data, including the user's head movement, direction, and stability; the ambient light detection component is used to monitor the light around the device; and the proximity detection component is used to detect near-field objects near the device.

[0150] More preferably, the eye image capturing component comprises an infrared eye camera; the illumination component comprises an infrared light emitter; the outward-facing camera component comprises an outward-facing RGB camera; the head tracking component comprises an inertial measurement unit; the ambient light detection component comprises an ambient light sensor; and the proximity detection component comprises a proximity sensor.

[0151] The eye health monitoring device according to the embodiment can integrate various types of sensors and light sources according to actual needs to capture a wide range of high-quality eye health indicators. Meanwhile, the method allows real-time configuration of hardware parameters of the multi-sensor group and the like, so that researchers and clinicians can customize data collection for specific eye health applications, thereby supporting various eye health monitoring and research functions (such as gaze tracking, pupil measurement, blink analysis, and tear film evaluation) to adapt to various research protocols and clinical requirements in the field of ophthalmology and visual science.

[0152] It can be understood that the eye health monitoring system provided by the embodiment corresponds to the eye health monitoring device and method described above, and the explanation, examples, advantages, and the like of the related content can refer to the corresponding content in the eye health monitoring device and method, which will not be repeated here. Embodiments

[0153] In a fourth aspect, the present application further provides a computer readable storage medium comprising a stored computer program, wherein the computer program, when executed, controls a device in which the computer readable storage medium is located to perform the steps of the eye health monitoring method according to any one of the above embodiments and preferred embodiments, which mainly comprises:

[0154] S1, acquiring eye and surrounding visual field and environment data of a user based on a multi-sensor group;

[0155] S2, real-time configuration of parameters of a plurality of sensors in the multi-sensor group based on a control system and synchronization of a plurality of sensor data outputs.

[0156] It can be understood that the computer readable storage medium provided by the embodiment corresponds to the eye health monitoring device, system, and method described above, and the explanation, examples, advantages, and the like of the related content can refer to the corresponding content in the eye health monitoring device, system, and method, which will not be repeated here.

[0157] 1. An ocular health monitoring device is proposed in this application, comprising: a multi-sensor suite and a control system; wherein the multi-sensor suite is configured to collect at least user's ocular and its surrounding visual field, environmental data; the control system is configured to configure parameters of multiple sensors in the multi-sensor suite in real-time and synchronize multiple sensor data output. This device utilizes the control system to configure parameters of multiple sensors in real-time and synchronize multiple sensor data output, so that the device can support various ocular health applications including gaze estimation, interpupillary distance measurement, refractive error estimation, tear meniscus height analysis, and attention monitoring. This technology overcomes the limitations of existing systems and provides a unified platform for advanced ocular health diagnosis and research in clinical and real-world environments.

[0158] 2. An ocular health monitoring device is proposed in this application, with highly customizable sensor control, which allows fine control of individual infrared light and infrared ocular camera parameters. Unlike existing fixed configuration devices, this allows researchers to customize the device in different environments according to specific experimental or clinical needs.

[0159] 3. An ocular health monitoring device is proposed in this application, with real-time multi-sensor data synchronization, supporting synchronization of all on-board sensors, time-synchronized data streams, and facilitating advanced sensor fusion for more accurate gaze tracking, spatial localization, and ocular behavior analysis.

[0160] 4. An ocular health monitoring device is proposed in this application, with a compact, wearable form factor, designed to be mounted on glasses, ensuring portability and user comfort for short-term diagnosis and long-term monitoring. This device eliminates the need for bulky, clinic-based equipment while maintaining diagnostic-level performance.

[0161] 5. An ocular health monitoring device is proposed in this application, with multi-purpose functionality. The corresponding sensor framework provides a unified solution for various applications, including eye movement tracking, interpupillary distance measurement, refractive error estimation, and ocular surface diagnosis. This integration reduces hardware redundancy and research costs.

[0162] 6. An ocular health monitoring device is proposed in this application, with scalability to support AI-driven analysis, flexible control of sensors, and access to raw data streams, allowing complete customization of input pipelines for machine learning models in ocular health applications.

[0163] 7. An ocular health monitoring device is proposed in this application, with enhanced environmental awareness. The integration of outward-facing cameras and proximity sensors / environmental light sensors provides environmental context, enabling more intelligent interpretation of ocular behavior. These advantages collectively address the limitations of existing systems and provide a more versatile and powerful platform for ocular health research and diagnosis.

[0164] It is to be noted that the relational terms herein, such as first and second, and the like, are used solely to distinguish one from another entity or action without necessarily requiring or implying any actual relationship or order between such entities or actions. Moreover, the terms "comprises", "comprising", or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by "comprises... a" does not, without more constraints, exclude the existence of additional identical elements in the process, method, article, or apparatus that comprises the element.

[0165] The above embodiments are only used to illustrate the technical solutions of the present application, not limit it; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacements for part of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. An ocular health monitoring device, characterized by, The device comprises: a multi-sensor group and a control system; the multi-sensor group is used to collect at least eye and its surrounding visual field, environmental data of a user; the control system is used to configure parameters of multiple sensors in the multi-sensor group in real time and synchronize multiple sensor data outputs.

2. The ocular health monitoring device of claim 1, wherein, The multi-sensor group comprises multiple of the following components: an eye image capturing component, an illumination component, an outward-facing camera component, a head tracking component, an ambient light detection component, and a proximity detection component, wherein: the eye image capturing component is used to capture images of the user's eyes; the illumination component is used to provide illumination for the eye region; the outward-facing camera component is used to capture the user's visual field; the head tracking component is used to track comprehensive data of the user's head, including the user's head movement, direction, and stability; the ambient light detection component is used to monitor the light around the device; and the proximity detection component is used to detect near-field objects near the device.

3. The ocular health monitoring device of claim 1, wherein, The eye health monitoring device is detachably installed with glasses or a head-mounted device, or is worn, or is seamlessly integrated.

4. The ocular health monitoring device of claim 2, wherein, The eye image capturing component comprises an infrared eye camera; the illumination component comprises an infrared light emitter; the outward-facing camera component comprises an outward-facing RGB camera; the head tracking component comprises an inertial measurement unit; the ambient light detection component comprises an ambient light sensor; and the proximity detection component comprises a proximity sensor.

5. The ocular health monitoring device of claim 4, wherein, There are multiple infrared light emitters, and the multiple infrared light emitters are configured by the control system to be individually addressable to create a custom illumination pattern for eye imaging.

6. The ocular health monitoring device of claim 4, wherein, The inertial measurement unit comprises an accelerometer, a gyroscope, and a magnetometer.

7. The ocular health monitoring device of claim 4, wherein, The control system is configured to adjust camera parameters of at least one infrared eye camera and outward-facing RGB camera, and the control system is configured to synchronize data from at least one IR eye camera, outward-facing RGB camera, IMU, and ambient light sensor and proximity sensor for performing gaze estimation and eye movement tracking.

8. An ocular health monitoring method, characterized by, The method is implemented based on the device of any one of claims 1-7, and the method comprises: collecting eye and its surrounding visual field, environmental data of a user based on the multi-sensor group; configuring parameters of multiple sensors in the multi-sensor group in real time and synchronizing multiple sensor data outputs based on the control system.

9. An ocular health monitoring system, characterized by, The system comprises the device of any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium comprises a stored computer program, wherein when the computer program is running, the device where the computer-readable storage medium is located is controlled to perform the steps of the eye health monitoring method of claim 8.

Images