Non-contact pupil state monitoring and physical sign data acquisition system

Abstract

The invention provides a non-contact pupil state monitoring and physical sign data acquisition system. The non-contact pupil state monitoring and physical sign data acquisition system comprises a high-resolution non-contact camera device which is installed within a proper distance and used for capturing high-definition eye images, especially pupil shapes and dynamic changes, when a user opens eyes, the camera device can automatically recognize and track pupil positions of the user, and the camera device is used for monitoring the pupil states of the user. Even if the head of the user slightly moves, the pupil image can still be accurately captured. According to the system, through the high-resolution non-contact camera device and the multi-band infrared light source module, accurate monitoring of the pupil state of the user is achieved, even if the head of the user slightly moves, the camera device can still automatically track the pupil position, and the accuracy of data is ensured.

Description

Technical Field

[0001] The present invention relates to the technical field of non-contact pupil state monitoring, and in particular to a non-contact pupil state monitoring and vital sign data collection system. Background Art

[0002] In the closed-eye state, a non-contact pupil status monitoring and vital sign data acquisition system needs to rely on the monitoring of other biological signals to replace the data collection of pupil status. The basic structure of the system usually includes high-precision biosensors, such as heart rate monitors, respiratory rate sensors, skin galvanic response sensors, and electrooculogram (EOG) sensors. These sensors can collect alternative data related to pupil activity in real time when the user closes his eyes. In particular, the electrooculogram sensor can obtain the user's eye movement information by detecting the electrical activity of the eyelids and eyeballs, thereby inferring the user's eye state and certain nervous system reactions. The data processing module integrates and analyzes these signals to provide an assessment of the user's health status.

[0003] In the closed-eye state, although heart rate and breathing rate can provide certain physiological status information, they cannot accurately reflect pupil changes, which are often an important indicator of nervous system response. In addition, although sensors such as EOG can monitor eye movements in the closed-eye state, their signals are often complex and easily interfered by noise, and the analysis process is also more complicated, which is prone to misjudgment. Summary of the invention

[0004] In view of the shortcomings of the prior art, the present invention provides a non-contact pupil state monitoring and vital sign data acquisition system, which solves the problem that although heart rate and respiratory rate can provide certain physiological state information, they cannot accurately reflect pupil changes; although sensors such as EOG can monitor eye movements in the closed eye state, their signals are often complex and easily interfered by noise.

[0005] To achieve the above objectives, the present invention is implemented through the following technical solutions: a non-contact pupil state monitoring and vital sign data collection system, comprising:

[0006] a high-resolution non-contact camera device, mounted at an appropriate distance, for capturing high-definition eye images, especially the shape and dynamic changes of the pupil, when the user opens his eyes;

[0007] An infrared light source module, used in conjunction with the camera device, uses non-visible light to illuminate the user's eyes under different lighting conditions, so as not to affect the user's visual comfort;

[0008] Multiple contactless biosensors, including:

[0009] a remote heart rate monitor that uses laser or radar technology to measure heart rate;

[0010] a remote respiratory rate sensor that measures respiratory rate via microwaves or ultrasound;

[0011] A remote galvanic skin response sensor that detects skin electrical changes based on high-precision infrared imaging technology;

[0012] an electro-oculogram sensor based on electromagnetic fields or other contactless sensing technology to monitor eye movements with eyes closed;

[0013] A data processing unit, used for receiving and processing multi-dimensional data acquired from the camera device and the biosensor;

[0014] A pupil state recognition algorithm, based on a machine learning model, processes eye images captured by a camera to identify pupil size, shape, dynamic response, and sensitivity to light;

[0015] The bio-signal processing algorithm uses adaptive filtering technology and noise suppression algorithm to process the data obtained from the non-contact biosensor to ensure the accuracy and stability of the data;

[0016] The data enhancement and fusion model aims at the weak correlation between heart rate, respiratory rate and pupil state. By establishing an enhanced correlation correction model, these vital sign data are accurately mapped, and the user's comprehensive physiological state index is calculated by the following formula:

[0017] Among them, is the comprehensive physiological state index, is the pupil data, is the heart rate data after correlation correction, is the respiratory rate data after correlation correction, is the electrooculogram sensor signal data after noise suppression, and is the weight coefficient of each type of data, which is automatically adjusted through the machine learning model to adapt to individual differences.

[0018] Preferably, the camera device can automatically identify and track the user's pupil position, and can still accurately capture the pupil image even when the user's head moves slightly. The infrared light source module uses a multi-band infrared light source to adapt to different skin colors and changes in ambient light, thereby achieving high-precision pupil monitoring.

[0019] Preferably, the remote breathing rate sensor is based on millimeter wave radar technology to monitor the tiny movements of the user's chest in a non-contact manner to detect the breathing rate with high precision, and the remote heart rate monitor uses laser Doppler technology to measure the user's heart rate fluctuations in a non-contact manner to capture heart activity with high precision.

[0020] Preferably, the remote galvanic skin response sensor analyzes the tiny changes in electrical activity under the skin through infrared spectroscopy to provide non-contact galvanic skin response data, and the electrooculogram sensor uses electromagnetic field sensing technology to non-contactly monitor eye movements when the user closes his eyes, and uses the following formula for noise suppression processing:

[0021] Among them, is the EOG sensor signal after noise suppression, is the original EOG sensor signal, is the noise suppression coefficient, and is the detected noise signal.

[0022] Preferably, the data processing unit has computing capabilities, can process multimodal data in real time, and transmit the data to an external device through a wireless transmission module. The pupil state recognition algorithm uses a deep learning network to perform multi-level analysis on slight changes in the pupil, thereby improving the accuracy of pupil state monitoring.

[0023] Preferably, the biosignal processing algorithm can dynamically adjust filter parameters to cope with noise changes in different environments, thereby improving the robustness of signal processing, and the data fusion model optimizes weight coefficients through machine learning of historical data to adapt to the personalized physiological characteristics of different users.

[0024] Preferably, the non-contact pupil status monitoring and vital sign data collection system can trigger an alarm through a preset threshold when an abnormal physiological state is detected, and automatically generate a health report.

[0025] Preferably, the non-contact pupil status monitoring and vital sign data collection system can be connected to a cloud server to achieve remote monitoring and data storage, while supporting algorithm updates and optimizations. The non-contact pupil status monitoring and vital sign data collection system adopts a full range of privacy protection measures, including data encryption transmission, identity authentication and data anonymization processing to ensure the security of the user's biological data.

[0026] The present invention provides a non-contact pupil status monitoring and vital sign data collection system. It has the following beneficial effects:

[0027] The system uses high-resolution non-contact cameras and multi-band infrared light source modules to accurately monitor the user's pupil status. Even if the user's head moves slightly, the camera can automatically track the pupil position to ensure the accuracy of the data. It uses a variety of non-contact biosensors, including remote heart rate monitors, respiratory rate sensors, galvanic skin response sensors and electro-oculogram sensors. These sensors collect the user's physiological data through advanced non-contact technology, thereby reducing interference to the user and improving the comfort and convenience of monitoring.

[0028] Through biological signal processing algorithms and data enhancement and fusion models, the shortcomings of traditional physiological monitoring methods are effectively solved. The correlation correction model and noise suppression algorithm are used to improve the mapping accuracy between heart rate, respiratory rate and pupil state. At the same time, the noise interference in the EOG signal is suppressed, and the reliability of the data is enhanced. The application of deep learning networks further improves the accuracy of pupil state recognition, and the system's high-performance data processing unit ensures real-time processing and remote transmission of multimodal data. Through the integration of these technologies, the system can not only detect the user's physiological abnormalities in a timely manner, but also provide personalized health reports and ensure data security, providing users with comprehensive health monitoring solutions. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 It is a schematic diagram of the structure of the present invention. DETAILED DESCRIPTION

[0030] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0031] like Figure 1 As shown, an embodiment of the present invention provides a non-contact pupil state monitoring and vital sign data acquisition system, including a high-resolution non-contact camera device installed at an appropriate distance, for capturing high-definition eye images when the user opens his eyes, especially the shape and dynamic changes of the pupil. The camera device can automatically identify and track the user's pupil position, and can still accurately capture the pupil image even when the user's head moves slightly.

[0032] An infrared light source module, used in conjunction with a camera device, uses non-visible light to illuminate the user's eyes under different lighting conditions without affecting the user's visual comfort. The infrared light source module uses a multi-band infrared light source to adapt to different skin colors and changes in ambient light to achieve high-precision pupil monitoring.

[0033] Multiple contactless biosensors, including:

[0034] A remote heart rate monitor that uses laser or radar technology to measure heart rate. The remote heart rate monitor uses laser Doppler technology to non-contactly measure the user's heart rate fluctuations to capture heart activity with high accuracy.

[0035] A remote respiratory rate sensor that measures respiratory rate through microwaves or ultrasound. The remote respiratory rate sensor is based on millimeter-wave radar technology and non-contactly monitors the tiny movements of the user's chest to detect respiratory rate with high accuracy.

[0036] A remote galvanic skin response sensor that detects skin electrical changes based on high-precision infrared imaging technology. The remote galvanic skin response sensor analyzes tiny changes in electrical activity under the skin through infrared spectroscopy and provides non-contact galvanic skin response data.

[0037] An electrooculogram sensor based on electromagnetic field or other contactless sensing technology is used to monitor eye movement in the closed eye state. The electrooculogram sensor uses electromagnetic field sensing technology to non-contactly monitor eye movement when the user closes his eyes, and uses the following formula for noise suppression processing:

[0038]

[0039] in, is the EOG sensor signal after noise suppression, E(t) is the original EOG sensor signal, α is the noise suppression coefficient, and N(t) is the detected noise signal.

[0040] The data processing unit is used to receive and process the multi-dimensional data obtained from the camera device and the biosensor. The data processing unit has computing power, can process multi-modal data in real time, and transmit the data to an external device through a wireless transmission module.

[0041] The pupil state recognition algorithm, based on a machine learning model, processes eye images captured by a camera to identify pupil size, shape, dynamic response, and sensitivity to light. The pupil state recognition algorithm utilizes a deep learning network to perform multi-level analysis of minute changes in the pupil to improve the accuracy of pupil state monitoring. The non-contact pupil state monitoring and vital sign data collection system can trigger an alarm through a preset threshold when an abnormal physiological state is detected, and automatically generate a health report. The non-contact pupil state monitoring and vital sign data collection system can be connected to a cloud server to achieve remote monitoring and data storage, and supports algorithm updates and optimizations. The non-contact pupil state monitoring and vital sign data collection system adopts a full range of privacy protection measures, including data encryption transmission, identity authentication, and data anonymization processing to ensure the security of the user's biological data.

[0042] The biosignal processing algorithm uses adaptive filtering technology and noise suppression algorithm to process the data obtained from non-contact biosensors to ensure the accuracy and stability of the data. The biosignal processing algorithm can dynamically adjust the filter parameters to cope with noise changes in different environments, thereby improving the robustness of signal processing. The data fusion model optimizes the weight coefficient through machine learning of historical data to adapt to the personalized physiological characteristics of different users.

[0043] The data enhancement and fusion model aims at the weak correlation between heart rate, respiratory rate and pupil state. By establishing an enhanced correlation correction model, these vital sign data are accurately mapped, and the user's comprehensive physiological state index is calculated by the following formula:

[0044] Among them, S is the comprehensive physiological state index, P is the pupil data, is the heart rate data after correlation correction, is the respiratory rate data after correlation correction, is the EOG sensor signal data after noise suppression, w1, w2, w3, and w4 are the weight coefficients of each type of data, which are automatically adjusted through the machine learning model to adapt to individual differences.

[0045] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A non-contact pupil status monitoring and vital sign data collection system, characterized in that: include: a high-resolution non-contact camera device, mounted at an appropriate distance, for capturing high-definition eye images, especially the shape and dynamic changes of the pupil, when the user opens his eyes; An infrared light source module, used in conjunction with the camera device, uses non-visible light to illuminate the user's eyes under different lighting conditions, so as not to affect the user's visual comfort; Multiple contactless biosensors, including: a remote heart rate monitor that uses laser or radar technology to measure heart rate; a remote respiratory rate sensor that measures respiratory rate via microwaves or ultrasound; A remote galvanic skin response sensor that detects skin electrical changes based on high-precision infrared imaging technology; An electro-oculogram sensor based on electromagnetic fields or other contactless sensing technology for monitoring eye movements with eyes closed; A data processing unit, used for receiving and processing multi-dimensional data acquired from the camera device and the biosensor; A pupil state recognition algorithm, based on a machine learning model, processes eye images captured by a camera to identify pupil size, shape, dynamic response, and sensitivity to light; The bio-signal processing algorithm uses adaptive filtering technology and noise suppression algorithm to process the data obtained from the non-contact biosensor to ensure the accuracy and stability of the data; The data enhancement and fusion model aims at the weak correlation between heart rate, respiratory rate and pupil state. By establishing an enhanced correlation correction model, these vital sign data are accurately mapped, and the user's comprehensive physiological state index is calculated by the following formula: Among them, S is the comprehensive physiological state index, P is the pupil data, is the heart rate data after correlation correction, is the respiratory rate data after correlation correction, is the EOG sensor signal data after noise suppression, w1, w2, w3, and w4 are the weight coefficients of each type of data, which are automatically adjusted through the machine learning model to adapt to individual differences.

2. A non-contact pupil status monitoring and vital sign data acquisition system according to claim 1, characterized in that: The camera device can automatically identify and track the user's pupil position, and can still accurately capture the pupil image even when the user's head moves slightly. The infrared light source module uses a multi-band infrared light source to adapt to different skin colors and changes in ambient light.

3. The non-contact pupil status monitoring and vital sign data acquisition system according to claim 1, characterized in that: The remote respiratory rate sensor monitors the tiny movements of the user's chest in a non-contact manner based on millimeter wave radar technology, and the remote heart rate monitor measures the user's heart rate fluctuation in a non-contact manner through laser Doppler technology.

4. The non-contact pupil status monitoring and vital sign data acquisition system according to claim 1, characterized in that: The remote galvanic skin response sensor analyzes the tiny changes in electrical activity under the skin through infrared spectroscopy to provide non-contact galvanic skin response data. The electrooculogram sensor uses electromagnetic field sensing technology to non-contactly monitor eye movements when the user closes his eyes, and uses the following formula for noise suppression processing: in, is the EOG sensor signal after noise suppression, E(t) is the original EOG sensor signal, α is the noise suppression coefficient, and N(t) is the detected noise signal.

5. The non-contact pupil status monitoring and vital sign data collection system according to claim 1, characterized in that: The data processing unit has computing capabilities, can process multimodal data in real time, and transmit the data to an external device through a wireless transmission module. The pupil state recognition algorithm uses a deep learning network to perform multi-level analysis on slight changes in the pupil.

6. The non-contact pupil status monitoring and vital sign data collection system according to claim 1, characterized in that: The biological signal processing algorithm can dynamically adjust the filter parameters to cope with noise changes in different environments, and the data fusion model optimizes the weight coefficients through machine learning of historical data.

7. The non-contact pupil status monitoring and vital sign data collection system according to claim 1, characterized in that: The non-contact pupil status monitoring and vital sign data collection system can trigger an alarm through a preset threshold value and automatically generate a health report when an abnormal physiological state is found.

8. The non-contact pupil status monitoring and vital sign data collection system according to claim 1, characterized in that: The non-contact pupil status monitoring and vital sign data collection system can be connected to a cloud server to achieve remote monitoring and data storage, and support algorithm updates and optimizations. The non-contact pupil status monitoring and vital sign data collection system adopts all-round privacy protection measures, which include data encryption transmission, identity authentication and data anonymization processing.

Images