Eye health monitoring device, method and system and storage medium

Abstract

The invention provides eye health monitoring equipment, method and system and a storage medium, and relates to the technical field of eye monitoring. The eye health monitoring equipment provided by the invention is a sensor frame which can be mounted on glasses and is used for monitoring and researching eye health. The equipment is provided with a compact wearable frame, a built-in infrared eye camera, an independently addressable infrared light emitter, an RGB (Red, Green, Blue) camera facing the outside, an inertial measurement unit (IMU), a plurality of integrated sensors such as an ambient light and proximity sensor, and a control system. Parameters of the plurality of sensors can be configured in real time and data output of the plurality of sensors can be synchronized through a control system, so that the equipment can support various eye health applications including staring estimation, interpupillary distance measurement, diopter estimation, lacrimal river height analysis and attention monitoring. According to the technology, the limitation of an existing system is overcome, and a unified platform is provided for advanced eye health diagnosis and research in clinical and real environments.

Description

Technical Field

[0001] The present invention relates to the field of eye monitoring technology, and in particular to an eye health monitoring device, method, system and storage medium. Background Art

[0002] The field of eye health monitoring is moving towards non-invasive, continuous monitoring, leveraging advances in wearable technology and biomedical sensing. Smart glasses and eye-mounted devices have become a research hotspot, aiming to track eye movements, attention, and physiological indicators (such as refractive power, pupil distance, and ocular surface status) in real time, providing support for clinical diagnosis and visual behavior analysis.

[0003] Existing eye health research equipment typically combines infrared cameras, ambient light sensors, and inertial measurement units to track localized eye movements, with applications in eye tracking, augmented reality, and visual behavior analysis. Traditional optometry and ocular surface analysis tools, including traditional refractive power measurement and pupillary distance analysis, are bulky and require manual operation. Ocular surface analysis tools like slit lamps and tear film height meters are limited to clinical settings. Some commercial and academic efforts have also integrated infrared gaze tracking into wearable systems.

[0004] However, existing solutions often lack flexibility, high customizability, modularity, and the ability to support diverse research applications. Therefore, there is an urgent need to propose a versatile, wearable platform or device that can be flexibly customized in different environments according to specific experimental or clinical needs to adapt to various eye health applications including eye tracking, pupil distance measurement, refractive power estimation, and ocular surface diagnosis, thereby overcoming the limitations of current eye tracking systems and clinical diagnostic tools. Summary of the Invention

[0005] (1) Technical problems solved

[0006] In response to the shortcomings of the existing technology, the present invention provides an eye health monitoring device, method, system and storage medium, which at least solves the problem of lack of flexibility and high customizability of eye health monitoring devices or platforms in the existing technology.

[0007] (2) Technical solution

[0008] To achieve the above objectives, the present invention is implemented through the following technical solutions:

[0009] In a first aspect, the present application first proposes an eye health monitoring device, the device comprising:

[0010] Multi-sensor groups and control systems;

[0011] The multi-sensor group is used to collect at least data of the user's eyes and their surrounding visual field and environment;

[0012] The control system is used to configure the parameters of multiple sensors in the multi-sensor group in real time and synchronize the output of multiple sensor data.

[0013] In one embodiment, the multi-sensor group includes multiple ones of an eye image capture component, an illumination component, an external-facing camera component, a head tracking component, an ambient light detection component, and a proximity detection component, wherein:

[0014] The eye image capture component is used to capture images of the user's eyes;

[0015] The illumination component is used to provide illumination for the eye area;

[0016] The external-facing camera component is used to capture the user's field of view;

[0017] The head tracking component is used to track the comprehensive data of the user's head, and the comprehensive data includes the movement, direction, and stability of the user's head;

[0018] The ambient light detection component is used to monitor the light around the device; and

[0019] The proximity detection component is used to detect near-field objects near the device.

[0020] In one embodiment, the eye health monitoring device is detachably installed with, worn by, or seamlessly integrated with glasses or a head-mounted device.

[0021] In a preferred embodiment, the eye image capture component includes an infrared eye camera.

[0022] In a preferred embodiment, the illumination component includes an infrared light emitter.

[0023] In a preferred embodiment, the external-facing camera component includes an external-facing RGB camera.

[0024] In a preferred embodiment, the head tracking component includes an inertial measurement unit.

[0025] In a preferred embodiment, the ambient light detection component includes an ambient light sensor.

[0026] In a preferred embodiment, the proximity detection component includes a proximity sensor.

[0027] In a further preferred embodiment, there are multiple infrared light emitters, and the multiple infrared light emitters are configured by the control system to be individually addressable to create a custom illumination pattern for eye imaging.

[0028] In a further preferred embodiment, the inertial measurement unit includes an accelerometer, a gyroscope, and a magnetometer.

[0029] In one embodiment, the control system is configured to adjust the camera parameters of at least one infrared eye camera and an RGB camera facing the outside world, and the control system is configured to synchronize data from at least one IR eye camera, an RGB camera facing the outside world, an IMU, and an ambient light sensor and a proximity sensor for performing gaze estimation and eye tracking.

[0030] In a second aspect, the present application further provides an eye health monitoring method, which is implemented based on the device described in any one of the above, and the method includes:

[0031] Collecting user eye and its surrounding visual field and environmental data based on a multi-sensor group;

[0032] Based on the control system, configuring the parameters of multiple sensors in the multi-sensor group in real time and synchronizing the output of multiple sensor data.

[0033] In a third aspect, the present application further provides an eye health monitoring system, which includes the device described in any one of the above.

[0034] In a fourth aspect, the present application finally provides a computer-readable storage medium, which includes a stored computer program, wherein when the computer program runs, it controls the device where the computer-readable storage medium is located to execute the steps of the eye health monitoring method described above.

[0035] (III) Beneficial effects

[0036] The present invention provides an eye health monitoring device, method, system, and storage medium. Compared with the prior art, the following beneficial effects are achieved:

[0037] An eye health monitoring device proposed in the present application includes: a multi-sensor group and a control system; wherein, the multi-sensor group is used to collect at least user eye and its surrounding visual field and environmental data; the control system is used to configure the parameters of multiple sensors in the multi-sensor group in real time and synchronize the output of multiple sensor data. This device uses the control system to configure the parameters of multiple sensors in real time and synchronize the output of multi-sensor data, enabling the device to support various eye health applications including gaze estimation, pupil distance measurement, refractive power estimation, tear meniscus height analysis, and attention monitoring. This technology overcomes the limitations of existing systems and provides a unified platform for advanced eye health diagnosis and research in clinical and real-world environments. Description of the drawings

[0038] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the accompanying drawings required for use in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0039] Figure 1 It is a schematic block diagram of an eye health monitoring device in an embodiment of the present invention;

[0040] Figure 2 It is a schematic position diagram of an RGB camera facing the outside world, an ambient light sensor, and a proximity sensor in the eye health monitoring device in an embodiment of the present invention;

[0041] Figure 3 It is a schematic position diagram of an IR light emitter and an IR eye camera in the eye health monitoring device in an embodiment of the present invention;

[0042] Figure 4 It is a schematic side structure diagram of the eye health monitoring device in an embodiment of the present invention;

[0043] Figure 5 It is a hardware stack diagram of the eye health monitoring device in an embodiment of the present invention;

[0044] Figure 6 It is a logic diagram of eye health data processing in an embodiment of the present invention;

[0045] Figure 7 It is a flowchart for analyzing gaze and eye movement tracking using the eye health monitoring method in an embodiment of the present invention;

[0046] Figure 8 It is a flowchart for analyzing eye health indicators using the eye health monitoring method in an embodiment of the present invention;

[0047] Figure 9 It is a structural diagram of the eye health monitoring system in an embodiment of the present invention;

[0048] Figure 10 It is a data flow diagram in the eye health monitoring system in an embodiment of the present invention;

[0049] In the figure: 1 - RGB camera facing the outside world; 2 - Ambient light sensor; 3 - Proximity sensor; 4 - IR light emitter; 5 - IR eye camera; 6 - Eyeglass frame structure; 7 - Lens surrounding structure; 8 - Mounting clip. Detailed implementation manners

[0050] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0051] By providing an eye health monitoring device, method, system, and storage medium, the embodiments of the present application at least solve the problem that existing eye health monitoring devices or platforms lack flexibility and high customizability, and achieve the purpose of flexibly adapting to various advanced eye health diagnosis and research tasks in clinical and real-world environments through a unified device or platform.

[0052] The general idea of the technical solutions in the embodiments of the present application to solve the above technical problems is as follows:

[0053] To solve the problems existing in the prior art, a technical solution of the present application proposes an eye health monitoring device. First, it has a compact and wearable user-friendly form, which can be conveniently and quickly installed on the user's glasses or head-mounted device. Then, by integrating multiple integrated sensors including an infrared eye camera, individually addressable infrared light emitters, an external-facing RGB camera, an inertial measurement unit (IMU), an ambient light sensor, and a proximity sensor on the glasses or head-mounted device, and equipping these sensors with a control system, the parameters of the above multiple sensors can be configured in real time through the control system and the multi-sensor data output can be synchronized, so that the device can support various eye health applications including gaze estimation, interpupillary distance measurement, refractive power estimation, tear meniscus height analysis, and attention monitoring, providing researchers and clinicians with unprecedented control capabilities over sensor parameters, real-time data integration, and adaptation to various eye health applications.

[0054] To better understand the above technical solutions, the above technical solutions will be described in detail below in conjunction with the accompanying drawings of the specification and specific implementation manners.

[0055] Embodiment 1:

[0056] In the first aspect, the present invention first proposes an eye health monitoring device. Refer to Figure 1 , the device includes:

[0057] A multi-sensor group and a control system. Among them, the multi-sensor group is used to collect at least the user's eyes and the surrounding visual field and environmental data, and the control system is used to configure the parameters of multiple sensors in the multi-sensor group in real time and synchronize the output of multiple sensor data.

[0058] According to actual needs, the above-mentioned eye health monitoring device can integrate various types of sensors and light sources to capture a wide range of high-quality eye health indicators. At the same time, the device allows real-time configuration of hardware parameters such as multi-sensor groups, enabling researchers and clinicians to customize data collection for specific eye health applications, thereby supporting various eye health monitoring and research functions (such as fixation tracking, pupillometry, blink analysis, and tear film assessment), and adapting to various research protocols and clinical requirements in the fields of ophthalmology and vision science.

[0059] In some embodiments, the multi-sensor group includes, but is not limited to, multiple of the following components:

[0060] An eye image capture component for capturing images of the user's eyes;

[0061] An illumination component for providing illumination to the eye area;

[0062] An external-facing camera component for capturing the user's field of view;

[0063] A head tracking component for tracking comprehensive data of the user's head, where the comprehensive data includes the user's head movement, direction, and stability;

[0064] An ambient light detection component for monitoring the light around the device; and

[0065] A proximity detection component for detecting near-field objects near the device.

[0066] In some embodiments, the above-mentioned eye health monitoring device is designed to be detachably mounted, worn, or seamlessly integrated with various glasses or head-mounted devices to provide a compact and portable platform for collecting various eye-related data.

[0067] As Figure 2 shown, in some preferred embodiments, the eye health monitoring device further includes a glasses frame structure 6, and the above-mentioned multiple sensors are integrated at key core positions of the glasses frame structure 6. The glasses frame structure 6 generally adopts a conventional glasses design, having a rectangular lens opening and temple arms extending from both sides, allowing for long-term comfortable wearing while providing necessary sensor positioning for accurate eye movement tracking and environmental monitoring.

[0068] In some other preferred embodiments, the eye health monitoring device is applicable to existing glasses or head-mounted devices. As Figure 3 shown, it is a front orthographic view of a glasses-mounted eye health monitoring device, and the device further includes a lens surround structure 7, which can inlay or accommodate standard prescription or non-prescription lenses around its lens opening. This design of the lens surround structure 7 can make the eye health monitoring device applicable to various users with or without the need for vision correction.

[0069] The lens surrounding structure 7 includes mounting points for various components among the above-mentioned eye image capture component, lighting component, external-facing camera component, head tracking component, ambient light detection component, and proximity detection component, while maintaining an aesthetic and wearable appearance.

[0070] Preferably, as Figure 4 shown, the eye health monitoring device further includes a mounting clip 8 for attaching to a spectacle frame, and this mounting clip 8 enables the easy integration of the eye health monitoring device with existing glasses, enhancing the versatility of the device.

[0071] In addition, the overall structure of the eye health monitoring device presents a balanced and ergonomic configuration. As Figure 3 shown, it demonstrates a streamlined design that maintains the appearance of conventional glasses while integrating the sensing components. As Figure 4 shown, the spectacle frame can also adopt a curved design that follows the ergonomic shape suitable for glasses integration. This curved design enhances the comfort of the user during long-term wearing.

[0072] In some embodiments, the eye health monitoring device maintains a thin profile suitable for integration with a standard spectacle frame while accommodating the necessary sensing components. Figure 4 It demonstrates how to install sensors and the like at the optimal positions relative to the user's eyes on the spectacle frame when arranging the sensors along the frame body. The RGB indicator uses LED lighting devices of three primary colors: Red, Green, and Blue. By adjusting the brightness and mixing ratio of the three colors of red, green, and blue, a variety of different colors can be produced to adapt to the requirements for the lighting color in different application scenarios.

[0073] Preferably, in some embodiments, various components such as the eye image capture component, lighting component, external-facing camera component, head tracking component, ambient light detection component, and proximity detection component involved in the eye health monitoring device are designed to evenly distribute the weight on the frame structure. The even weight distribution helps to maintain comfort during long-term use and prevents the frame from shifting or sliding when the user moves. The frame also includes adjustable components such as nose pads or temple pieces to ensure a secure and comfortable fit for a wide range of users.

[0074] In some embodiments, the above-mentioned eye health monitoring device includes an eye image capture component for capturing the user's eye images.

[0075] Preferably, the eye image capture component includes but is not limited to an infrared (IR) eye camera 5.

[0076] In one embodiment, the eye image capture component selects an infrared (IR) eye camera 5 to capture high-contrast eye images. AsFigure 3 As shown, two IR eye cameras 5 are located within the frame, near the nose pads of the glasses, with one camera dedicated to each eye. The IR eye cameras 5 are oriented inward towards the eye region to enable eye movement tracking and monitoring functions.

[0077] Preferably, the IR eye cameras 5 are mounted at an angle to optimize eye movement capture. At the same time, on the premise of ensuring that it does not affect the IR eye cameras 5 from capturing eye images, they are mounted in a hidden manner within the frame structure, so that both functionality and aesthetics can be achieved.

[0078] In addition, in some scenarios, the positioning of the IR eye cameras 5 within the frame allows for continuous monitoring of eye movements without obstructing the user's field of view.

[0079] In specific implementations, the IR eye cameras 5 can capture various types of eye-related data according to the actual application scenario requirements. For example, the IR eye cameras 5 can capture images in the infrared spectrum, which can provide enhanced contrast for detecting eye features such as the pupil, iris, and sclera. This enhanced contrast helps with more accurate gaze tracking and eye movement analysis. Additionally, the cameras may record pupil dilation and constriction, which can provide insights into cognitive load or emotional state. In some application scenarios, the IR eye cameras 5 may track the movement of the iris to estimate the gaze direction and fixation point. The IR eye cameras 5 can also support ocular surface imaging. In some application scenarios, the IR eye cameras 5 can capture detailed images of the cornea and surrounding tissues, which helps to evaluate eye health metrics such as tear film quality or the presence of dry eye symptoms.

[0080] In some embodiments, the IR eye cameras 5 operate at a high frame rate to capture rapid eye movements such as saccades or microsaccades. This high-speed capture ability may enable more detailed eye behavior analysis and may support advanced gaze estimation algorithms.

[0081] Integrating the IR eye cameras 5 within an eye health monitoring device enables continuous data collection in a real-world environment. This allows researchers and clinicians to gain insights into eye behavior and health outside of traditional clinical settings, potentially revealing patterns or metrics that may not be apparent during a brief examination.

[0082] In some embodiments, the above-mentioned eye health monitoring device includes an illumination component for providing illumination to the user's eye region.

[0083] Preferably, the illumination component includes, but is not limited to, infrared light emitters.

[0084] In one embodiment, on the glasses frame, multiple infrared (IR) light emitters are distributed around each lens area, specifically as Figure 3As shown, multiple IR light emitters 4 are used in conjunction with the aforementioned IR eye camera 5 to provide consistent illumination to the eye area, which can enhance the quality and reliability of eye movement tracking data under various lighting conditions.

[0085] In some embodiments, the eye health monitoring device distributes multiple individually addressable IR light emitters 4 around each lens area. As Figure 3 shown, these IR light sources are arranged in a symmetric pattern to provide uniform illumination to the eye area. Each IR light emitter 4 is independently controlled, allowing precise manipulation of the illumination pattern. The individually addressable capability enables researchers and clinicians to selectively activate specific light sources or create custom combinations of light emitters, which can provide advantages for eye health monitoring and diagnosis. In specific implementation, researchers can activate only a portion of the emitters to create a structured light pattern for specialized imaging techniques. For example, this capability may be used in tear film reflection analysis, where specific illumination angles may enhance the visibility of the tear river.

[0086] The eye health monitoring device allows for dynamic adjustment of the IR illumination configuration during use. For example, in some embodiments, the mode of the IR light emitters 4 is automatically modified according to environmental conditions or specific diagnostic tasks being performed. Specifically, the eye health monitoring device may activate additional emitters in low-light environments to maintain consistent illumination for eye movement tracking.

[0087] The individually addressable characteristic of the IR light emitters 4 can also support advanced gaze estimation techniques. By selectively illuminating different areas around the eye, the device may enhance the contrast of specific eye features, potentially improving the accuracy of pupil detection and iris tracking algorithms.

[0088] In some embodiments, the IR light emitters 4 in the eye health monitoring device can achieve variable illumination patterns. This is useful for certain diagnostic procedures, such as evaluating the pupillary light reflex or performing specialized ocular surface examinations that require controlled light stimulation.

[0089] As Figure 3 shown, the arrangement of the IR light emitters 4 around the lens area can provide comprehensive coverage of the eye area. This form of comprehensive coverage distribution ensures sufficient illumination at various eye positions and gaze directions, supporting consistent data collection during a wide range of eye movements and user activities.

[0090] In some embodiments, the eye health monitoring device further includes an externally facing camera assembly for capturing the user's field of view.

[0091] Preferably, the externally facing camera assembly includes, but is not limited to, the externally facing RGB camera 1.

[0092] In one embodiment, as Figure 2As shown, the outward-facing RGB camera 1 is installed at the center of the upper frame part of the glasses. This setting enables the RGB camera to be closely aligned with the user's natural line of sight, achieving accurate capture of the visual environment.

[0093] In some application scenarios, the outward-facing RGB camera 1 supports context gaze mapping by providing a reference image of the user's surrounding environment. This allows the association of eye movements and gaze directions with specific objects or regions in the user's field of view. For example, the outward-facing RGB camera 1 can capture images of the computer screen or printed text that the user is reading, enabling researchers to analyze reading patterns and fixation points in real-world scenarios.

[0094] In addition, the outward-facing RGB camera 1 may also facilitate environmental recording, which can provide valuable context for interpreting eye behavior data. In some implementations, the camera records visual features of the user's environment, such as lighting conditions, color schemes, or the presence of moving objects. This environmental data is used to understand how different visual stimuli affect eye movements and pupil responses.

[0095] Integrating the outward-facing RGB camera 1 with other components in the glasses frame enables advanced analysis of the user's interaction with the surrounding environment. For example, by combining proximity sensor 3 data and panoramic camera images, visual interactions based on the screen and the real world can be distinguished. This can support screen-to-environment interaction recording, providing insights into how the user allocates visual attention between digital devices and the physical world.

[0096] In some embodiments, the outward-facing RGB camera 1 may operate at different frame rates and resolutions to adapt to different research or diagnostic needs. The camera can be configured to capture high-resolution static images for detailed analysis of specific visual scenes, or to record video at a lower resolution to provide continuous environmental context over a longer period.

[0097] In some embodiments, the data collected by the outward-facing RGB camera 1 may be time-synchronized with the eye movement tracking data of the IR eye camera 5, allowing for precise temporal alignment between environmental stimuli and eye responses. This synchronization can enable researchers to study the complex relationship between visual input and eye behavior in natural environments.

[0098] In some embodiments, the eye health monitoring device further includes a head tracking component for tracking comprehensive user head data.

[0099] Preferably, the head tracking component includes, but is not limited to, an inertial measurement unit (IMU), and the comprehensive user head data tracked includes, but is not limited to, user head movement, direction, and stability.

[0100] In one embodiment, as Figure 5 shownFigure 5 This is a hardware stack diagram of the device. The IMU is located in the upper right area of the configuration and can accurately measure the movement and orientation of the eye health monitoring device in three-dimensional space.

[0101] In some preferred embodiments, the IMU may be composed of a combination of an accelerometer, a gyroscope, and a magnetometer. These components work together to provide comprehensive data on the linear acceleration, angular velocity, and magnetic field direction of the eye health monitoring device. The integration of sensors such as accelerometers, gyroscopes, and magnetometers enables precise tracking of head movement and position changes over time.

[0102] In addition, the IMU can complement the deficiencies of other sensors in the eye health monitoring device to enhance the spatial modeling of eye direction. For example, the data from the IMU may be synchronized with the eye tracking camera to compensate for head-induced movement when estimating the gaze direction. This integration may improve the accuracy of eye tracking by considering the relative movement between the eye and the frame.

[0103] In some embodiments, the IMU can provide real-time information on the user's head pose and movement pattern. This data is valuable for understanding the context of eye movement and gaze behavior. For example, IMU data is used to distinguish eye movements caused by head rotation from those caused by actual gaze shifts.

[0104] In addition, the IMU helps to evaluate the stability of the eye health monitoring device. By monitoring minute movements and vibrations, the IMU may help identify periods of stable wear and periods of significant movement. This information can be used to flag potential artifacts in the eye tracking data or trigger adaptive algorithms that take into account different levels of head stability.

[0105] In some embodiments, IMU data can be used to improve the accuracy of the RGB camera 1 image facing the outside world. By providing information about the orientation and movement of the eye health monitoring device, the IMU may enable image stabilization or motion compensation techniques for the RGB camera 1 facing the outside world, potentially improving the quality of environmental context data.

[0106] The integration of IMU data with the outputs of other sensors may support more powerful advanced fusion algorithms for eye tracking and gaze estimation. For example, combining the head pose information obtained from the IMU with the eye position data of the IR eye camera 5 to create a more comprehensive model of the user's visual attention in three-dimensional space.

[0107] In some embodiments, the IMU operates at a high sampling rate to capture rapid head movements or micro-movements. This high-frequency data collection may enable detailed analysis of head-eye coordination and may support applications in areas such as vestibulo-ocular reflex assessment or balance disorder research.

[0108] An eye health monitoring device may allow calibration and adjustment of the IMU to account for individual differences in head movement patterns or optimize performance for specific research protocols. This flexible performance enhancement system adapts to various eye health monitoring and research applications.

[0109] In some embodiments, the eye health monitoring device further includes an ambient light detection component and a proximity detection component. Among them, the ambient light detection component is used to monitor the light around the device, and the proximity detection component is used to detect near-field objects near the device.

[0110] Preferably, the ambient light detection component includes, but is not limited to, the ambient light sensor 2, and the proximity detection component includes, but is not limited to, the proximity sensor 3.

[0111] In a preferred embodiment, as Figure 2 shown, the ambient light sensor 2 and the proximity sensor 3 are located at the upper frame part of the glasses and beside the RGB camera 1 facing the outside world. This setting enables the sensors to capture ambient readings more accurately while being hidden as much as possible within the glasses frame structure 6.

[0112] In some embodiments, the ambient light sensor 2 can continuously monitor the light level around the eye health monitoring device, providing valuable data for context-aware eye behavior. For example, using this information to understand how pupil dilation responds to changes in ambient lighting in various environments and activities.

[0113] The proximity sensor 3 component can detect the presence of nearby objects or surfaces. As Figure 4 shown, the proximity sensor 3 is integrated into the main body of the eye health monitoring device component and is set at an optimal position relative to the user's field of view. This placement enables the detection of near-field objects such as computer screens, books, or handheld devices.

[0114] In some embodiments, the combination of the ambient light sensor 2 and the proximity sensor 3 may work in tandem with other sensors in the glasses frame to provide context information for eye behavior analysis. For example, using the data from the proximity sensor 3 to determine when the user is interacting with a nearby screen while monitoring the ambient light level to evaluate the impact of screen brightness on eye fatigue.

[0115] The ambient light sensor 2 can support adaptive functions within the eye health monitoring device. In some cases, the ambient light readings are used to automatically adjust the infrared illumination intensity for eye movement tracking, ensuring consistent performance under different lighting conditions. The proximity sensing ability enables the eye health monitoring device to distinguish different types of visual interactions. For example, distinguishing between the user looking at distant objects and focusing on a nearby screen or document. This context information is valuable to researchers studying visual attention patterns or developing adaptive display technologies.

[0116] In some embodiments, the ambient light sensor 2 and the proximity sensor 3 may operate at different sampling rates to accommodate different research or diagnostic needs. The sensors may be configured to provide high-frequency data for detailed analysis of rapid environmental changes, or may operate at a lower rate to conserve power during long-term monitoring.

[0117] The data collected by the ambient light sensor 2 and the proximity sensor 3 is time-synchronized with the outputs of other sensors, such as eye-tracking data and images from the outward-facing RGB camera 1. This synchronization allows researchers to investigate the complex relationships between environmental conditions, user interactions, and eye behavior in a real-world environment.

[0118] In one embodiment, the eye health monitoring device further includes a sophisticated control system for real-time configuration of multiple sensor parameters in the eye image capture component, the lighting component, the outward-facing camera component, the head tracking component, the ambient light detection component, and the proximity detection component, and for synchronizing the data outputs of the eye image capture component, the lighting component, the outward-facing camera component, the head tracking component, the ambient light detection component, and the proximity detection component, etc. As Figure 5 shown, multiple sensors and components are integrated in a distributed configuration to achieve comprehensive data collection and real-time configurability.

[0119] In some embodiments, the control system allows direct manipulation of the camera attributes of various imaging sensors in the frame. This can be extended to adjusting the brightness, contrast, exposure, frame rate, and resolution settings of the IR eye camera 5 and the outward-facing RGB camera 1. Fine-tuning these parameters enables researchers and clinicians to optimize image capture for specific lighting conditions or diagnostic requirements.

[0120] In some embodiments, the control system can facilitate real-time adjustment of sensor parameters during operation. For example, the control system may dynamically modify the camera exposure settings based on Figure 5 the changing ambient light conditions detected by the ambient light sensor 2 as shown. This adaptive function may help maintain consistent image quality in different environments and usage scenarios.

[0121] In some embodiments, the control system may implement synchronized data collection for multiple sensor types. Figure 5 Shown depicts a configuration in which the proximity sensor 3, the ambient light sensor 2, the IR camera, and the inertial measurement unit (IMU) are integrated into a system, and the control system can coordinate the timing and data streams of these different sensors to ensure that information from different sources can be accurately correlated and analyzed.

[0122] In some embodiments, the above-mentioned eye health monitoring device further includes a processor configured to perform corresponding analysis functions based on the data of multiple sensors in the multi-sensor group and adjust the functions of the device based on the analysis results. For example, the processor is configured to perform real-time analysis of eye health metrics based on data from at least one IR eye camera 5, the ambient light sensor 2, and the proximity sensor 3. Further, the processor is also configured to adjust the functions of the device based on the real-time analysis of eye health metrics, for example, including adjusting sensor parameters and lighting modes.

[0123] The synchronization capabilities of the control system can support advanced data fusion techniques. For example, combining eye movement tracking data from an infrared camera with head movement information from an IMU to create a more comprehensive model of fixation behavior. This multi-sensor integration may enhance the accuracy and reliability of eye health assessments and research findings.

[0124] In some embodiments, the control system may provide configurable data output formats and sampling rates. Researchers can specify which sensor data streams to include in the output and adjust the temporal resolution of data collection to suit different experimental protocols or clinical needs. This flexibility allows for efficient data management and storage, especially during long-term monitoring.

[0125] The control system can provide an interface for real-time data access and visualization. In certain implementations, researchers or clinicians can view real-time sensor outputs and adjust parameters instantaneously, enabling interactive experiments and immediate feedback during eye health assessments.

[0126] The control system and data integration capabilities of the eye health monitoring device can support the development and training of machine learning models related to eye health. Collecting synchronized multi-modal data can provide a rich dataset for training algorithms to detect patterns or anomalies in eye behavior. For example, developing a machine learning model to predict fatigue based on a combination of blink rate, pupil dynamics, and head movement patterns captured by the integrated sensors.

[0127] In some embodiments, the control system allows the implementation of processing algorithms within the device. This enables real-time analysis of sensor data, potentially supporting immediate feedback or adaptive functions based on detected eye health metrics.

[0128] The control system can also facilitate the integration of the eye health monitoring device with external systems or devices. In certain implementations, the glasses frame can transmit synchronized sensor data to a connected computer or mobile device for further analysis or storage. This connectivity may enhance the versatility of the system in various research and clinical settings.

[0129] The eye health monitoring device may integrate multiple components to enable comprehensive eye health monitoring and research applications. Such as Figure 5As shown, various sensors and modules are integrated to work together to collect and analyze eye-related data.

[0130] In some embodiments, the IR eye camera 5 can capture high-resolution images of the eye, while the individually addressable IR light emitter 4 provides controlled illumination. This combination enables precise tracking of eye movements and pupil dynamics. The outward-facing RGB camera 1 may simultaneously record the user's visual environment, providing context information for gaze estimation and attention analysis.

[0131] The inertial measurement unit (IMU) works in conjunction with the eye tracking component to compensate for head movements and improve the accuracy of gaze direction calculation. In some embodiments, data from the IMU and the eye camera are fused to create a more powerful three-dimensional spatial visual attention model.

[0132] The ambient light sensor 2 and the proximity sensor 3 provide additional context data to enhance the interpretation of eye behavior. For example, the ambient light readings are used to adjust the illumination level of the IR light emitter 4 and the camera exposure settings, ensuring consistent eye tracking performance under different lighting conditions.

[0133] In some embodiments, the integrated components may support advanced applications such as diopter estimation. The eye movement patterns and accommodation responses captured by the IR eye camera 5 are analyzed to infer changes in focal length. This data, combined with the visual environment information provided by the outward-facing RGB camera 1, may enable the estimation of refractive error without using traditional optometry equipment.

[0134] The eye health monitoring device promotes attention and fatigue monitoring through a comprehensive analysis of eye behavior.

[0135] In some embodiments, the IR eye camera 5 and the lighting system are used to track blink frequency, saccade patterns, and pupil dynamics. This data is correlated with the head movement information from the IMU and the environmental context of the outward-facing RGB camera 1 to evaluate the user's alertness and cognitive load over time.

[0136] For tear meniscus and red eye analysis, the eye health monitoring device utilizes its configurable IR lighting system and high-resolution eye camera. In certain cases, specific IR light emitters 4 are selectively activated to create optimal lighting conditions for visualizing the tear film. The IR eye camera 5 may capture detailed images of the eye surface, while the control system adjusts camera parameters (such as exposure and contrast) to enhance the visibility of relevant features.

[0137] The integration of multiple sensor types may enable an eye health monitoring device to perform interpupillary distance (IPD) measurements with high precision. In some embodiments, a combination of eye movement tracking data from an IR eye camera 5 and spatial information from an RGB camera 1 facing the outside world is used to calculate the distance between the pupils. This measurement is refined using head orientation data from an IMU to account for different viewing angles and distances.

[0138] As Figure 5 shown, the synchronized data streams of all sensors facilitated by the control system may support complex analysis of eye health metrics. For example, correlating changes in the height of the tear meniscus with blink patterns and environmental factors such as ambient humidity or air flow provides a more comprehensive assessment of ocular surface health.

[0139] In some embodiments, the eye health monitoring device adjusts its functions based on real-time analysis of multi-sensor data. For example, detecting signs of visual fatigue through changes in blink frequency and saccade speed, and automatically adjusting the frequency of certain measurements or triggering specific diagnostic procedures to collect more detailed eye health status data.

[0140] The integration of these components in a wearable form may enable continuous monitoring and analysis of eye health metrics in a real-world environment. This can support longitudinal studies of eye behavior and health, potentially revealing patterns or metrics that may not be apparent during brief clinical examinations.

[0141] Embodiment 2:

[0142] In a second aspect, the present invention also provides an eye health monitoring method. Referring to Figure 6 the method is implemented based on the device described in any of the above embodiments and preferred embodiments. The method mainly includes:

[0143] S1. Collect user eye and its surrounding visual field and environmental data based on a multi-sensor group.

[0144] S2. Based on the control system, configure the parameters of multiple sensors in the multi-sensor group in real time and synchronize the output of multiple sensor data.

[0145] In some preferred embodiments, the multi-sensor group includes multiple components such as an eye image capture component, an illumination component, an external-facing camera component, a head tracking component, an ambient light detection component, and a proximity detection component. Among them: the eye image capture component is used to capture user eye images; the illumination component is used to provide illumination for the eye area; the external-facing camera component is used to capture the user's visual field; the head tracking component is used to track the comprehensive data of the user's head, and the comprehensive data includes the user's head movement, direction, and stability; the ambient light detection component is used to monitor the light around the device; and the proximity detection component is used to detect near-field objects near the device.

[0146] More preferably, the eye image capture component includes an infrared eye camera; the illumination component includes an infrared light emitter; the external-facing camera component includes an external-facing RGB camera; the head tracking component includes an inertial measurement unit; the ambient light detection component includes an ambient light sensor; and the proximity detection component includes a proximity sensor.

[0147] The eye health monitoring method proposed in this embodiment can integrate various types of sensors and light sources according to actual needs to capture a wide range of high-quality eye health indicators. At the same time, this method allows real-time configuration of hardware parameters such as multi-sensor groups, enabling researchers and clinicians to customize data collection for specific eye health applications, and further supporting various eye health monitoring and research functions (such as fixation tracking, pupil measurement, blink analysis, and tear film assessment) to meet various research protocols and clinical requirements in the fields of ophthalmology and vision science.

[0148] As Figure 7 shown, it is a flowchart for analyzing gaze and eye movement tracking using the eye health monitoring method proposed in this embodiment.

[0149] As Figure 8 shown, it is a flowchart for analyzing eye health indicators using the eye health monitoring method proposed in this embodiment.

[0150] It can be understood that the eye health monitoring method provided by the embodiments of the present invention corresponds to the above-mentioned eye health monitoring device. For the explanations, examples, beneficial effects, etc. of relevant content, reference can be made to the corresponding content in the eye health monitoring device, and details are not described herein again.

[0151] Embodiment 3:

[0152] Thirdly, the present invention also provides an eye health monitoring system. Referring to Figure 9 and Figure 10 , this system includes the device described in any of the above embodiments and preferred embodiments. The device includes:

[0153] A multi-sensor group and a control system;

[0154] The multi-sensor group is used to collect at least the data of the user's eyes and the surrounding visual field and the environment;

[0155] The control system is used to configure the parameters of multiple sensors in the multi-sensor group in real time and synchronize the output of multiple sensor data.

[0156] In some preferred embodiments, the multi-sensor group includes a plurality of components such as an eye image capture component, an illumination component, an external-facing camera component, a head tracking component, an ambient light detection component, and a proximity detection component, where: The eye image capture component is used to capture images of the user's eyes; The illumination component is used to provide illumination for the eye area; The external-facing camera component is used to capture the user's field of view; The head tracking component is used to track comprehensive data of the user's head, and the comprehensive data includes the user's head movement, direction, and stability; The ambient light detection component is used to monitor the light around the device; and The proximity detection component is used to detect near-field objects near the device.

[0157] More preferably, the eye image capture component includes an infrared eye camera; the illumination component includes an infrared light emitter; the external-facing camera component includes an external-facing RGB camera; the head tracking component includes an inertial measurement unit; the ambient light detection component includes an ambient light sensor; and the proximity detection component includes a proximity sensor.

[0158] The eye health monitoring device proposed in this embodiment can integrate various types of sensors and light sources according to actual needs to capture a wide range of high-quality eye health indicators. At the same time, this method allows real-time configuration of hardware parameters such as the multi-sensor group, enabling researchers and clinicians to customize data collection for specific eye health applications, thereby supporting various eye health monitoring and research functions (such as, gaze tracking, pupillometry, blink analysis, and tear film assessment) to adapt to various research protocols and clinical requirements in the fields of ophthalmology and vision science.

[0159] It can be understood that the eye health monitoring system provided by the embodiments of the present invention corresponds to the above-mentioned eye health monitoring device and method. For the explanations, examples, beneficial effects, etc. of relevant content, reference can be made to the corresponding content in the eye health monitoring device and method, which will not be elaborated here.

[0160] Embodiment 4:

[0161] Fourthly, the present invention also provides a computer-readable storage medium, which includes a stored computer program. When the computer program runs, it controls the device where the computer-readable storage medium is located to execute the steps of the eye health monitoring method described in any of the above embodiments and preferred embodiments. The method mainly includes:

[0162] S1. Collect user eye and its surrounding field of view and environmental data based on the multi-sensor group;

[0163] S2. Based on the control system, real-time configure the parameters of multiple sensors in the multi-sensor group and synchronize the data output of multiple sensors.

[0164] It is understandable that the computer-readable storage medium provided in the embodiments of the present invention corresponds to the above-mentioned eye health monitoring device, system, and method. For the explanations, examples, beneficial effects, etc. of the relevant content, reference can be made to the corresponding content in the eye health monitoring device, system, and method, and will not be elaborated here.

[0165] In summary, compared with the prior art, the following beneficial effects are achieved:

[0166] 1. An eye health monitoring device proposed in this application includes: a multi-sensor group and a control system; wherein, the multi-sensor group is used to collect at least the user's eyes and the surrounding visual field and environmental data; the control system is used to configure the parameters of multiple sensors in the multi-sensor group in real time and synchronize the output of multiple sensor data. This device uses the control system to configure the parameters of multiple sensors in real time and synchronize the multi-sensor data output, enabling the device to support various eye health applications including gaze estimation, pupil distance measurement, refractive power estimation, tear meniscus height analysis, and attention monitoring. This technology overcomes the limitations of existing systems and provides a unified platform for advanced eye health diagnosis and research in clinical and real-world environments.

[0167] 2. An eye health monitoring device proposed in this application has highly customizable sensor control, which allows for fine control of the parameters of individual infrared lights and infrared eye cameras. Different from existing fixed-configuration devices, it enables researchers to customize the device in different environments according to specific experimental or clinical needs.

[0168] 3. An eye health monitoring device proposed in this application has real-time multi-sensor data synchronization, supports the synchronization of all on-board sensors and time-synchronized data streams, and helps to perform advanced sensor fusion to achieve more accurate gaze tracking, spatial positioning, and eye behavior analysis.

[0169] 4. An eye health monitoring device proposed in this application has a compact and wearable form factor. The design of being mounted on glasses ensures the portability and user comfort for short-term diagnosis and long-term monitoring. This device eliminates the need for bulky, clinic-based devices while maintaining diagnostic-level performance.

[0170] 5. An eye health monitoring device proposed in this application has multi-purpose functions. The corresponding sensor framework of this device provides a unified solution for various applications, including eye movement tracking, pupil distance measurement, refractive power estimation, and ocular surface diagnosis. This integration reduces hardware redundancy and research costs.

[0171] 6. An eye health monitoring device proposed in this application has scalability to support AI-driven analysis. The flexible control of sensors and access to the raw data stream allow for full customization of the input pipeline of machine learning models in eye health applications.

[0172] 7. An eye health monitoring device proposed in this application can enhance environmental perception. By integrating a camera facing the outside world and a proximity sensor / ambient light sensor, and by providing environmental context, a more intelligent interpretation of eye behavior is achieved. These advantages together address the limitations of existing systems and provide a more versatile and powerful platform for eye health research and diagnosis.

[0173] It should be noted that in this text, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "comprising one..." does not exclude the existence of additional identical elements in the process, method, article or device comprising the said element.

[0174] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. An eye health monitoring device, characterized in that, The device comprises: Multi-sensor groups and control systems; The multi-sensor group is used to collect at least data of the user's eyes and their surrounding visual field and environment; The control system is used to configure the parameters of multiple sensors in the multi-sensor group in real time and synchronize the data output of multiple sensors.

2. The eye health monitoring device according to claim 1, wherein The multi-sensor group includes multiple components selected from the group consisting of an eye image capture component, an illumination component, an external-facing camera component, a head tracking component, an ambient light detection component, and a proximity detection component, wherein: An eye image capturing component, used for capturing an eye image of a user; a lighting assembly for providing illumination to the eye area; An outward-facing camera component for capturing the user's field of view; A head tracking component for tracking comprehensive data of the user's head, including the movement, direction, and stability of the user's head; an ambient light detection component for monitoring the light surrounding the device; and A proximity detection component is used to detect near-field objects near the device.

3. The eye health monitoring device according to claim 1, characterized in that, The eye health monitoring device can be detachably mounted on glasses or head-mounted devices, or worn, or seamlessly integrated.

4. The eye health monitoring device according to claim 2, wherein, The eye image capture component includes an infrared eye camera; the lighting component includes an infrared light emitter; the external-facing camera component includes an external-facing RGB camera; the head tracking component includes an inertial measurement unit; the ambient light detection component includes an ambient light sensor; and the proximity detection component includes a proximity sensor.

5. The eye health monitoring device according to claim 4, characterized in that, There are a plurality of infrared light emitters, and the plurality of infrared light emitters are configured by a control system to be individually addressable to create a custom illumination pattern for eye imaging.

6. The eye health monitoring device according to claim 4, characterized in that, The inertial measurement unit includes an accelerometer, a gyroscope, and a magnetometer.

7. The eye health monitoring device according to claim 4, wherein, The control system is configured to adjust camera parameters of at least one IR eye camera and an outside-facing RGB camera, and the control system is configured to synchronize data from at least one IR eye camera, the outside-facing RGB camera, the IMU, and the ambient light sensor and proximity sensor to perform gaze estimation and eye tracking.

8. An eye health monitoring method, characterized in that, The method is implemented based on the device according to any one of claims 1 to 7, and the method includes: Collect user's eyes and surrounding visual field and environmental data based on a multi-sensor group; The control system configures the parameters of the multiple sensors in the multi-sensor group in real time and synchronizes the data output of the multiple sensors.

9. An eye health monitoring system, characterized in that, The system comprises the device according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored computer program, wherein when the computer program is executed, the device where the computer-readable storage medium is located is controlled to perform the steps of the eye health monitoring method according to claim 8.

Images