Non-contact physiological status rapid screening method, system and medium
By processing facial videos with adaptive gamma correction and a one-dimensional convolutional neural network noise reduction algorithm, combined with the barrel effect model, the error problem of non-contact physiological state detection under complex lighting conditions is solved, realizing efficient and accurate physiological state screening, which is suitable for rapid screening in high-risk industries.
Patent Information
- Application Number
- CN202511496213.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-10-20
- Publication Date
- 2025-11-14
- Estimated Expiration
- 2045-10-20
AI Technical Summary
Existing non-contact physiological state detection technologies have large detection errors under complex lighting conditions and insufficient adaptability to dynamic environments, making it difficult to meet the needs of workers in high-risk industries for rapid and accurate screening.
An adaptive gamma correction algorithm and a one-dimensional convolutional neural network autoencoder denoising algorithm are used to perform illumination correction and noise separation on facial videos. The barrel effect model is combined to calculate physiological indicators and make classification judgments. A 4K high-definition industrial-grade visible light camera and an infrared supplementary light unit are used to adapt to multi-light source scenes.
Reduces physiological signal detection errors in strong light, shadow, or mixed light environments, enables single-person screening within 10 seconds, supports multi-person parallel processing, ensures the accuracy and safety of physiological state assessment, and adapts to the needs of high-concurrency operation scenarios.
Smart Images

Figure CN120938369A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of worker safety management technology, and in particular to a non-contact rapid screening method, system and medium for physiological status. Background Technology
[0002] In high-risk industries such as power operations, mining, and chemicals, the health status of workers directly impacts production safety and life security. Traditional health monitoring methods primarily rely on wearable devices or manual examinations. Wearable devices (such as heart rate monitors, pulse oximeters, and smart bracelets) require direct contact with the body via electrode patches or sensors, making the process complex and prone to causing discomfort. For example, electrocardiogram (ECG) electrodes need to adhere to the skin for extended periods, potentially leading to allergic reactions (such as contact dermatitis) or skin damage, especially in high-temperature and high-humidity environments where the chemical reaction between sweat and electrode materials can further exacerbate skin irritation. Furthermore, sharing equipment among multiple people poses a risk of cross-infection, such as from residual blood or microbial contamination. Studies show that the average installation time for wearable devices is approximately 5-10 minutes per person, significantly reducing work preparation efficiency, and the cost of cleaning and maintenance is high. Traditional manual examinations require sequential testing of heart rate, blood oxygen saturation, etc., with each test taking an average of 2-3 minutes, resulting in a complete examination process of approximately 15-30 minutes per person. In large-scale operations such as power repairs and mine blasting, these methods are insufficient to meet the demands for rapid screening. For example, a substation maintenance project requires the simultaneous screening of 50 workers. Traditional methods would take 2.5-7.5 hours, while the work window typically only allows 1-2 hours. Furthermore, manual operation relies on the expertise of the examiners, and processes such as equipment handling and calibration further slow down the process, leading to delays and even safety hazards. In summary, wearable devices suffer from limitations in contact, cumbersome operation, a risk of skin allergies, cross-infection, and low efficiency. Manual medical examinations are also subject to subjectivity and inefficiency, making it difficult to meet the needs of rapid pre-job screening for large-scale work teams.
[0003] In recent years, non-contact detection technology based on remote photoplethysmography (TPM) has been developed. This technology extracts physiological parameters such as heart rate by analyzing subtle skin color changes caused by variations in blood volume in facial videos. However, traditional remote PPM algorithms suffer from the following problems in practical industrial applications: 1) Light interference problem: Visible light cameras are prone to image distortion, noise or overexposure under strong outdoor light, indoor shadow or different light sources, which leads to increased error in the extraction of pulsation signals from remote photoplethysmography. 2) Insufficient adaptability to dynamic environments: Traditional remote photoplethysmography algorithms are sensitive to motion artifacts and changes in illumination, making it difficult to operate stably in complex work scenarios and failing to meet the needs of rapid and accurate pre-job screening in power operations. Summary of the Invention
[0004] To overcome the aforementioned shortcomings of existing technologies, this invention provides a non-contact rapid screening method, system, and medium for physiological status, aiming to solve the problems of light interference and insufficient adaptability to dynamic environments in existing non-contact detection technologies, and to achieve rapid, accurate, and large-scale pre-employment physiological status screening under complex lighting conditions.
[0005] The technical solution adopted by this invention to solve its technical problem is: a non-contact rapid screening method for physiological states, comprising: S1: Acquire facial video of the examinee and extract RGB three-channel spatiotemporal image sequence of the region of interest on the face from the facial video; S2: An adaptive gamma correction algorithm is used to perform frame-by-frame illumination correction on the RGB three-channel spatiotemporal image sequence to obtain an illumination-corrected image sequence; the adaptive gamma correction uses K-means clustering analysis to analyze the pixel intensity distribution of the image in order to dynamically calculate the optimal γ value; S3: Use a one-dimensional convolutional neural network autoencoder denoising algorithm to perform end-to-end denoising on the illumination-corrected image sequence, and separate the remote photoplethysmography pulsation signal from specular reflection and motion noise. S4: Based on the separated remote photoplethysmography pulse signal, calculate physiological indicators such as heart rate, heart rate variability, and blood oxygen saturation.
[0006] As a further improvement of the present invention, it also includes the following steps: S5: Based on the physiological index grading standard, the calculated physiological index is graded and judged, and the final job suitability judgment level is determined by combining the barrel effect model, and a graded early warning signal is generated.
[0007] As a further improvement of the present invention: the calculation formula of the adaptive gamma correction algorithm is as follows: ; in, Intensity values of the image sequence are corrected for illumination. Intensity values of an overexposed or underexposed RGB three-channel spatiotemporal image sequence; The optimal value obtained by dynamically calculating the pixel intensity distribution of an image through K-means clustering analysis. value.
[0008] As a further improvement of the present invention: the step of dynamically calculating the optimal γ value by analyzing the image pixel intensity distribution through K-means clustering specifically includes: Normalize the image pixel intensity to the range [0,1]; The K-means clustering algorithm is applied to divide the pixels into K clusters, and the mean of each cluster is calculated. Dynamically adjust according to the distribution characteristics of the cluster Values were calculated, with those having a mean greater than 0.9 being overexposed clusters and those having a mean less than 0.1 being underexposed clusters. Optimal values were dynamically calculated for both overexposed and underexposed clusters. value.
[0009] As a further improvement of the present invention: the formula for calculating the heart rate is: HR = 60 / MeanRR; ; Wherein, HR is the heart rate, representing the average heart rate; MeanRR is the average RR interval, representing the average time interval between adjacent heartbeats; Total duration represents the total duration of the electrocardiogram signal; and Number of RR intervals represents the total number of heartbeats.
[0010] As a further improvement of the present invention: the formula for calculating blood oxygen saturation is as follows: ; ; ; in, Blood oxygen saturation, ΔA R The AC / DC ratio of the signal in channel R, ΔA G The AC / DC ratio of the signal in channel G, AC R For the AC component of the R channel, DC R For the DC component of channel R, AC G For the AC component of the G channel, DC G Here, denoted as DC component of channel G, and a and b are experimental calibration coefficients.
[0011] As a further improvement of the present invention: the barrel effect model selects the worst-performing physiological indicator among all physiological indicators as the final job suitability assessment level; the graded early warning signals include green (normal), yellow (warning), and red (prohibited from working).
[0012] This invention also provides a non-contact rapid physiological state screening system for implementing the aforementioned non-contact rapid physiological state screening method, comprising: The perception layer includes a data acquisition module, which is used to acquire RGB three-channel spatiotemporal image sequences of facial regions of interest. The processing layer includes an edge computing module, which runs an adaptive gamma correction algorithm and a one-dimensional convolutional neural network autoencoder denoising algorithm to calculate physiological indicators. The decision-making level is used to run physiological indicator grading standards and the barrel effect model to generate graded early warning signals.
[0013] As a further improvement of the present invention: the sensing layer also includes a 4K high-definition industrial-grade visible light camera, which integrates an infrared fill light unit and an automatic white balance adjustment unit.
[0014] As a further improvement of the present invention: the edge computing module includes an illumination correction unit, a one-dimensional convolutional neural network noise reduction unit, and a physiological index calculation unit; The illumination correction unit dynamically calculates the optimal γ value through K-means clustering and uses an adaptive gamma correction algorithm to perform frame-by-frame illumination correction on the RGB three-channel spatiotemporal image sequence to obtain an illumination-corrected image sequence. The one-dimensional convolutional neural network noise reduction unit is used to perform end-to-end noise reduction processing on the illumination-corrected image sequence using a one-dimensional convolutional neural network autoencoder noise reduction algorithm, separating the remote photoplethysmography pulsation signal from specular reflection and motion noise. The physiological index calculation unit is used to calculate heart rate, heart rate variability and blood oxygen saturation based on the separated remote photoplethysmography pulse signal.
[0015] The present invention also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the aforementioned non-contact rapid screening method for physiological states.
[0016] Compared with the prior art, the beneficial effects of the present invention are: 1. This invention can reduce the detection error of physiological signals in environments with strong light (direct sunlight), shadow (building obstruction) or mixed light sources (LED + incandescent lamp), and improve the robustness of light illumination; it can complete the screening of a single person within 10 seconds, support the rapid detection of operators, significantly shorten the pre-job preparation time, and has real-time and high efficiency.
[0017] 2. This invention enables accurate and rapid assessment of the physiological state of workers in complex environments, comprehensively and objectively considering individual health levels, providing solid and reliable decision support for the rational allocation of positions and efficient personnel deployment, while ensuring individual health and high-quality work progress.
[0018] 3. This invention optimizes the global brightness distribution of the acquired facial video frame by frame using an adaptive gamma correction algorithm, and dynamically calculates the optimal value based on the pixel intensity distribution. The values effectively correct overexposed / underexposed areas and optimize overall brightness uniformity. Subsequently, a one-dimensional convolutional neural network autoencoder denoising algorithm is used to perform end-to-end denoising on the corrected illumination-corrected image sequence, achieving separation of remote photoplethysmography pulsation signals from specular reflection and motion noise.
[0019] 4. This invention utilizes a 4K high-definition industrial-grade visible light camera integrating an infrared fill light unit and an automatic white balance adjustment unit to ensure image quality in multi-light source scenarios; it dynamically eliminates interference from strong light, shadows, and mixed light sources by employing an adaptive gamma correction algorithm and a one-dimensional convolutional neural network autoencoder noise reduction algorithm; through an edge computing module, it achieves single-person screening within 10 seconds, supports multi-person parallel processing and data caching, and adapts to the needs of high-concurrency operation scenarios; it grades the calculated physiological indicators using a physiological indicator grading standard, and quantifies individual health shortcomings using the barrel effect model to determine the final job suitability assessment level, ensuring the scientific and objective nature of the assessment results; and it enables real-time risk intervention and job suitability decision-making through early warning responses via LED screen colors (green / yellow / red) and audible and visual alarms. Attached Figure Description
[0020] Figure 1 This is a flowchart of a non-contact rapid screening method for physiological states.
[0021] Figure 2 This is a structural block diagram of a non-contact rapid physiological state screening system.
[0022] Figure 3 This is a block diagram of the edge computing module. Detailed Implementation
[0023] To make the objectives, technical solutions, and advantages of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention. It should be noted that the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to these processes, methods, products, or devices. The present invention will now be further described in conjunction with the accompanying drawings and embodiments: Please see Figure 1 An embodiment of the present invention provides a non-contact rapid screening method for physiological states, comprising: S1: Acquire RGB three-channel spatiotemporal image sequence data: Acquire facial video of the examinee and extract RGB three-channel spatiotemporal image sequence of the region of interest of the face from the facial video; S2: Illumination correction of the RGB three-channel spatiotemporal image sequence: An adaptive gamma correction algorithm is used to perform frame-by-frame illumination correction on the RGB three-channel spatiotemporal image sequence to eliminate overexposed and underexposed areas, resulting in an illumination-corrected image sequence; the adaptive gamma correction uses K-means clustering analysis to analyze the pixel intensity distribution of the image to dynamically calculate the optimal... value; S3: Denoising the illumination-corrected image sequence: End-to-end denoising of the illumination-corrected image sequence is performed using a one-dimensional convolutional neural network autoencoder denoising algorithm to separate the remote photoplethysmography pulsation signal from specular reflection and motion noise. S4: Physiological index calculation: Based on the separated remote photoplethysmography pulse signal, calculate the physiological indexes of heart rate (HR), heart rate variability (HRV), and blood oxygen saturation (SpO2). S5: Generation of graded early warning signals: Construct a grading standard for physiological indicators, grade the calculated physiological indicators based on the grading standard, determine the final suitability level by combining the barrel effect model, and generate graded early warning signals.
[0024] Data is acquired by using RGB three-channel spatiotemporal image sequences of the facial region of interest. No wearable devices are required, which avoids the risks of skin allergies and cross-infection caused by contact, while also saving on equipment cleaning and maintenance costs and improving the convenience of screening. Secondly, adaptive gamma correction uses K-means clustering to dynamically analyze pixel intensity distribution, accurately calculate the optimal γ value and process it frame by frame. It can specifically eliminate overexposed and underexposed areas, effectively solve the problem of image distortion under complex lighting conditions, reduce the detection error of physiological state signals in strong light (direct sunlight), shadow (building obstruction) or mixed light source (LED + incandescent lamp) environments, and improve lighting robustness.
[0025] One-dimensional convolutional neural network autoencoder end-to-end processing can efficiently separate remote photoplethysmography pulse signals from specular reflection and motion noise, significantly improving the purity of physiological signals, ensuring excellent noise reduction, and guaranteeing the accuracy of index calculation.
[0026] By simultaneously calculating multiple physiological indicators such as heart rate, heart rate variability, and blood oxygen saturation, and combining physiological indicator grading standards with the barrel effect model, the final suitability assessment level is determined and a graded early warning signal is generated. The assessment is comprehensive and the judgment is scientific, thus improving the reliability of screening.
[0027] In some implementations, the calculation formula for the adaptive gamma correction algorithm is as follows: ; in, Intensity values of the image sequence are corrected for illumination. Intensity values of an overexposed or underexposed RGB three-channel spatiotemporal image sequence; The optimal value obtained by dynamically calculating the pixel intensity distribution of an image through K-means clustering analysis. value.
[0028] Optimum values are dynamically calculated using K-means clustering. The value can accurately adapt to overexposure and underexposure under different lighting conditions; compared to a fixed value... Value correction, dynamic This makes illumination correction more intelligent and flexible, effectively improving image quality under complex lighting conditions and enhancing the illumination robustness of non-contact physiological detection.
[0029] In some implementations, the step of dynamically calculating the optimal γ value by analyzing the image pixel intensity distribution through K-means clustering specifically includes: Normalize the image pixel intensity to the range [0,1]; The K-means clustering algorithm is applied to divide the pixels into K clusters, and the mean of each cluster is calculated. Dynamically adjust according to the distribution characteristics of the cluster Values were calculated, with those having a mean greater than 0.9 being overexposed clusters and those having a mean less than 0.1 being underexposed clusters. Optimal values were dynamically calculated for both overexposed and underexposed clusters. value.
[0030] By normalizing image pixel intensity to the [0,1] range, the analysis scale is unified, providing a consistent benchmark for clustering; K-means clustering accurately divides pixel clusters, objectively identifying overexposed (>0.9) and underexposed (<0.1) areas through cluster means, avoiding subjective judgment bias; dynamic calculation is performed for overexposed and underexposed clusters. Values are used to achieve differentiated correction, which is relatively fixed. It is better suited to complex lighting scenarios, can specifically optimize image quality in extreme lighting areas, improve the accuracy and adaptability of lighting correction, and lay a more reliable image foundation for subsequent remote photoplethysmography pulsation signal extraction.
[0031] In some implementations, the heart rate is calculated using the following formula: HR = 60 / MeanRR; ; Wherein, HR is the heart rate, representing the average heart rate; MeanRR is the average RR interval, representing the average time interval between adjacent heartbeats; Total duration represents the total duration of the electrocardiogram signal; and Number of RR intervals represents the total number of heartbeats.
[0032] MeanRR, based on the average of the RR intervals, directly correlates with the actual time interval between adjacent heartbeats in the electrocardiogram signal, accurately reflecting the heartbeat cycle and making the heart rate results more physiologically accurate. Calculating the average by combining the total duration and the total number of heartbeats smooths out instantaneous fluctuations, reduces the interference of accidental abnormalities on the results, and improves the stability and accuracy of heart rate calculation.
[0033] In some embodiments, the formula for calculating the blood oxygen saturation is: ; ; ; in, Blood oxygen saturation, ΔA R The AC / DC ratio of the signal in channel R, ΔA G The AC / DC ratio of the signal in channel G, AC R For the AC component of the R channel, DC R For the DC component of channel R, AC G For the AC component of the G channel, DC G Here, denoted as DC component of channel G, and a and b are experimental calibration coefficients.
[0034] The AC / DC ratio ΔA of the signal through channel R R The AC / DC ratio ΔA of the G channel signal G By combining calculations and utilizing the different sensitivities of the two channels to changes in blood oxygen, the detection dimensionality and accuracy are improved. The introduction of alternating current (AC) and direct current (DC) components can effectively separate blood oxygen-related pulsating signals from the baseline light intensity, reducing interference from non-physiological factors. The coefficients a and b are experimentally calibrated and can be adapted to specific detection scenarios, further ensuring the consistency between the calculation results and the actual blood oxygen level, providing reliable support for the accurate acquisition of blood oxygen saturation in non-contact physiological detection.
[0035] In some implementations, the formula for calculating the AC component is: ; ; Where AC represents the AC component and N is the sample size. This represents the original light intensity signal value at the i-th sampling point. This is the mean of the original light intensity signal values at all sampling points.
[0036] By adopting the standard deviation form and using the mean of the original light intensity signal of all sampling points as the benchmark, the signal fluctuation amplitude can be accurately quantified, the DC component can be effectively separated, and the AC component related to physiological activities can be accurately extracted. Secondly, by introducing the number of samples N to cover the calculation of multiple sampling points, the random error of a single sampling point can be smoothed, the interference of extreme values on the results can be reduced, and the stability and reliability of the AC component calculation can be improved.
[0037] In some implementations, the formula for calculating the DC component is: ; Where DC is the direct current component, N is the number of samples, and z t This is the estimated DC component of the original light intensity signal at time t.
[0038] z is obtained by using the sample size N for multiple time t. t The average value can smooth out individual z-axis values. t This reduces the interference of random errors and instantaneous fluctuations on the results, making the DC component more closely match the stable baseline level of the original light intensity signal, thus improving computational stability; t It directly corresponds to the DC component estimate of the original light intensity signal at time t. During calculation, it can accurately focus on the stationary part of the signal and effectively remove the AC component that changes with physiological activities.
[0039] In some implementations, the barrel effect model selects the worst-performing physiological indicator among all physiological indicators as the final suitability assessment level.
[0040] Based on the "weakest link" principle, this method takes a holistic approach, selecting the higher level of physiological indicators as the key criterion for finalizing job suitability. This comprehensive assessment method can fully and objectively consider an individual's health level, providing solid and reliable decision support for the rational allocation of positions and efficient personnel deployment, while ensuring both individual health and high-quality work performance.
[0041] By directly selecting the worst-performing physiological indicator from all indicators as the final suitability assessment level, the judgment logic is intuitive and objective, eliminating the need for complex multi-indicator weighting or subjective weighing, thus avoiding interference from human factors and ensuring the fairness and consistency of the assessment results. Secondly, it precisely focuses on physiological deficiencies, aligning with the core safety requirements of high-risk operations such as power, where any failure to meet the standard may lead to safety risks. Determining the level based on the worst indicator completely avoids the hidden danger of missing a single indicator, maximizing the physiological suitability of workers before they start their jobs. At the same time, the above rules are simple and easy to understand, allowing for rapid level determination without additional complex calculations, meeting the efficiency requirements of rapid pre-job screening and shortening the screening process time.
[0042] In some implementations, the graded warning signals include green (normal), yellow (warning), and red (prohibition from working).
[0043] By adopting a color-coded system of green, yellow, and red, the system aligns with the public's general understanding of safety warnings, is intuitive and easy to understand, and is suitable for the fast-paced screening scenarios in high-risk work sites such as power plants. This reduces the time spent interpreting information, facilitates rapid decision-making and intervention by management personnel, and ensures the efficiency and safety of pre-job screening. Secondly, the system has clear classifications that cover key scenarios: green corresponds to normal work, yellow to warning and attention, and red to prohibit work. This accurately matches the job suitability requirements under different physiological states, avoiding delays in screening normal personnel while promptly intercepting at-risk individuals and eliminating safety hazards caused by abnormal indicators.
[0044] In some implementations, the graded early warning signals are fed back in real time through an LED screen; if all physiological indicators are normal, the LED screen lights up green; if an indicator is at a critical value, the LED screen lights up yellow and prompts attention; if any indicator exceeds the safe range, the LED screen lights up red and issues an audible and visual alarm, prohibiting the employee from working.
[0045] The screening results are displayed instantly on the LED screen, providing strong real-time feedback without waiting for data transmission or manual summarization. This meets the timeliness requirements of rapid pre-job screening and significantly reduces decision-making time. When the light turns red, an audible and visual alarm is triggered simultaneously. Compared to a single visual prompt, this more strongly reminds managers to intercept unsuitable personnel, avoiding safety hazards caused by information omissions and effectively ensuring the effectiveness and safety of pre-job screening for high-risk operations.
[0046] In some embodiments, the end-to-end denoising processing of the illumination-corrected image sequence using a one-dimensional convolutional neural network autoencoder denoising algorithm specifically includes: Each frame of the face is sliced, and each slice is considered as a sample of a remote photoplethysmography (PPG) signal. Recording for 10 seconds yields the sample track corresponding to each slice. The mathematical model for the average pixel value of each slice is as follows: ; Where I(i, t) is the average pixel value of the i-th slice at time t, m(i, t) is the specular reflection component, s(i, t) is the remote photoplethysmography pulsation signal component, n(i, t) is the motion noise component, and a and b are coefficients; each face slice contains a part of the signal, and different components are separated according to different sample tracks.
[0047] In some implementations, the input dimension of the one-dimensional convolutional neural network autoencoder denoising algorithm is [batch, H×W (total number of slices), 250 (length)]. After convolution and pooling, it is encoded as [batch, N (number of slices), L (encoding dimension)], and then reconstructed as [batch, 1, L] to achieve denoising. During the encoding process, multiple channels are combined and superimposed to form a suitable reconstructed signal. The activation function is a non-linear thresholding process, and noise is eliminated in this part. Finally, only the signal reconstructed based on the encoded vector remains, thus completing the separation and noise reduction of the signal.
[0048] In some implementations, the heart rate variability is calculated as follows: The obtained RR curves were analyzed in the time and frequency domains to extract heart rate variability. 1) Time-domain analysis ①PNN50: The number of times the difference between adjacent RR intervals is greater than 50 milliseconds; ②RR Triangular Index: The ratio of the area of the triangle formed by the RR interval sequence; ; Wherein, Number of RR intervals represents the total number of RR intervals, and Height of the R-Rinterval histogram represents the height of the RR interval histogram; 2) Frequency Domain Analysis The Fourier transform (FFT) model was used for frequency domain analysis. The frequency domain analysis indicators included ultra-low frequency power (VLF), low frequency power (LF), high frequency power (HF), low frequency / high frequency ratio (LF / HF Ratio), normalized low frequency power (NLF), and normalized high frequency power (NHF). ① VLF: ; ② LF: ; ③ HF: ; ④ NLF: Normalized Low-Frequency Power; ; ⑤ NHF: Normalized high-frequency power; ; ⑥ LF / HF Ratio: Low frequency / high frequency ratio, the ratio of low frequency (LF) and high frequency (HF) components, used to reflect the balance between the sympathetic and parasympathetic nervous systems; ; Wherein, LF power represents the power of the low-frequency components, and HF power represents the power of the high-frequency components.
[0049] Please see Figure 2 Another embodiment of the present invention provides a non-contact rapid physiological state screening system for implementing the aforementioned non-contact rapid physiological state screening method, comprising: The perception layer includes a data acquisition module, which is used to acquire RGB three-channel spatiotemporal image sequences of facial regions of interest. The processing layer includes an edge computing module, which runs an adaptive gamma correction algorithm and a one-dimensional convolutional neural network autoencoder denoising algorithm to calculate physiological indicators. The decision-making level is used to run physiological indicator grading standards and the barrel effect model to generate graded early warning signals.
[0050] The data acquisition module of the perception layer focuses on the region of interest on the face to acquire RGB three-channel spatiotemporal image sequences. The non-contact acquisition does not require wearable devices, which can avoid the risks of skin allergies and cross-infection. At the same time, the region of interest is accurately focused on the area with effective physiological information, reducing interference from background irrelevant data. Secondly, the processing layer relies on the edge computing module to run adaptive gamma correction algorithm and one-dimensional convolutional neural network autoencoder denoising algorithm. Edge computing does not rely on cloud transmission and can quickly perform adaptive gamma correction to eliminate light interference and one-dimensional convolutional neural network autoencoder denoising to separate the remote photoplethysmography pulsation signal from specular reflection and motion noise. It also efficiently calculates physiological indicators, greatly shortens data processing time, and meets the timeliness requirements of pre-job rapid screening. It can complete single-person screening within 10 seconds, supports multi-person parallel processing and data caching, and adapts to the needs of high-concurrency operation scenarios. Meanwhile, the decision-making level generates graded early warning signals through physiological indicator grading standards and the barrel effect model. The judgment logic is objective, and the worst indicator is used to determine the grade to accurately avoid safety hazards. Moreover, the output results directly correspond to the screening purpose.
[0051] The three-layer architecture of perception, processing and decision-making ensures that each layer performs its function and connects efficiently, thus guaranteeing the accuracy of data collection, the real-time processing, and the security of decision-making.
[0052] In some embodiments, the sensing layer further includes a 4K high-definition industrial-grade visible light camera, which integrates an infrared fill light unit and an automatic white balance adjustment unit to ensure image quality in multi-light source scenarios.
[0053] The 4K high-definition industrial-grade visible light camera's high resolution can accurately capture subtle image details of facial regions of interest, ensuring high definition and high fidelity of RGB three-channel spatiotemporal image sequences. The integrated infrared illumination unit can supplement light in low-light and dimly lit scenarios, avoiding image blurring and data loss due to insufficient light, and ensuring continuous and stable acquisition in complex lighting environments. The automatic white balance adjustment unit can adapt to different light sources in real time, such as natural light and indoor lighting, correcting color deviations and ensuring accurate reproduction of RGB channel color information. This avoids interference from light source color deviations with remote photoplethysmography pulsation signal extraction, further improving the reliability of data acquisition.
[0054] In some implementations, please refer to Figure 3 The edge computing module includes an illumination correction unit, a one-dimensional convolutional neural network noise reduction unit, and a physiological index calculation unit. The illumination correction unit dynamically calculates the optimal γ value through K-means clustering and uses an adaptive gamma correction algorithm to perform frame-by-frame illumination correction on the RGB three-channel spatiotemporal image sequence to obtain an illumination-corrected image sequence. The one-dimensional convolutional neural network noise reduction unit is used to perform end-to-end noise reduction processing on the illumination-corrected image sequence using a one-dimensional convolutional neural network autoencoder noise reduction algorithm, separating the remote photoplethysmography pulsation signal from specular reflection and motion noise. The physiological index calculation unit is used to calculate heart rate, heart rate variability and blood oxygen saturation based on the separated remote photoplethysmography pulse signal.
[0055] An adaptive gamma correction algorithm and a one-dimensional convolutional neural network autoencoder denoising algorithm are employed to dynamically eliminate interference from strong light, shadows, and mixed light sources. The illumination correction unit dynamically calculates the optimal γ value through K-means clustering, processes the RGB sequence frame by frame, and accurately eliminates overexposed / underexposed areas. The one-dimensional convolutional neural network denoising unit performs end-to-end denoising processing, which can effectively separate the remote photoplethysmography (PPG) pulse signal from specular reflection and motion noise, reduce non-physiological interference, and ensure signal purity. The physiological index calculation unit relies on the purified PPG pulse signal to simultaneously calculate heart rate, heart rate variability, and blood oxygen saturation, covering multi-dimensional physiological information. All units are integrated into the edge computing module, eliminating the need for cloud reliance, enabling fast processing speed, adapting to the needs of rapid pre-job screening, and providing accurate and efficient index data support for subsequent decision-making and early warning.
[0056] Another embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the aforementioned non-contact rapid screening method for physiological states.
[0057] The main functions of this invention are: This invention utilizes a 4K high-definition industrial-grade visible light camera integrating an infrared illumination unit and an automatic white balance adjustment unit to ensure image quality in multi-light source scenarios. The integrated infrared illumination unit provides supplemental lighting in low-light and dimly lit environments, preventing image blurring and data loss due to insufficient light. The automatic white balance adjustment unit adapts to different light sources in real time, correcting color deviations and ensuring accurate reproduction of RGB channel color information. This prevents interference from light source color deviations with remote photoplethysmography (PPG) pulsation signal extraction, further improving the reliability of data acquisition. An adaptive gamma correction algorithm is also employed. With a one-dimensional convolutional neural network autoencoder denoising algorithm, it dynamically eliminates interference from strong light, shadows, and mixed light sources; through an edge computing module, it can complete single-person screening within 10 seconds, supports multi-person parallel processing and data caching, and adapts to the needs of high-concurrency work scenarios; it grades the calculated physiological indicators through a physiological indicator grading standard, and quantifies individual health deficiencies through the barrel effect model to determine the final job suitability assessment level, ensuring the scientific and objective nature of the assessment results; through the early warning response of LED screen colors (green / yellow / red) and audible and visual alarms, it enables real-time risk intervention and job suitability decisions.
[0058] The functions described herein can be implemented in hardware, software executed by a processor, firmware, or any combination thereof. If implemented in software executed by a processor, the functions can be stored as one or more instructions or codes on or transmitted via a computer-readable medium. Other examples and embodiments are within the scope and spirit of this invention and the appended claims. For example, due to the nature of software, the functions described above can be implemented using software executed by a processor, hardware, firmware, hardwired, or any combination thereof. Furthermore, the functional units can be integrated into a single processing unit, or each unit can exist physically separately, or two or more units can be integrated into a single unit.
[0059] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units can be a logical functional division, and in actual implementation, there may be other division methods. For instance, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling, direct coupling, or communication connection may be through some interfaces; the indirect coupling or communication connection between units or modules may be electrical or other forms.
[0060] The units described as separate components may or may not be physically separate. Similarly, the components of the control device may or may not be physical units; they may be located in one place or distributed across multiple units. Some or all of the units can be selected to achieve the purpose of this embodiment, depending on actual needs.
[0061] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.
[0062] The above embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention, and they should all be covered within the scope of the claims and specification of the present invention.
Claims
1. A non-contact rapid screening method for physiological states, characterized in that: include: S1: Acquire facial video of the examinee and extract RGB three-channel spatiotemporal image sequence of the region of interest on the face from the facial video; S2: An adaptive gamma correction algorithm is used to perform frame-by-frame illumination correction on the RGB three-channel spatiotemporal image sequence to obtain an illumination-corrected image sequence; the adaptive gamma correction uses K-means clustering analysis to analyze the pixel intensity distribution of the image in order to dynamically calculate the optimal γ value; S3: Use a one-dimensional convolutional neural network autoencoder denoising algorithm to perform end-to-end denoising on the illumination-corrected image sequence and separate the remote photoplethysmography pulsation signal. S4: Calculate physiological indicators based on the separated remote photoplethysmography pulse signal.
2. The non-contact rapid screening method for physiological states according to claim 1, characterized in that: It also includes the following steps: S5: Based on the physiological indicator grading standard, the calculated physiological indicators are graded and judged, and the final job suitability judgment level is determined by combining the barrel effect model, and a graded early warning signal is generated.
3. The non-contact rapid screening method for physiological states according to claim 1, characterized in that: The calculation formula for the adaptive gamma correction algorithm is as follows: ; in, Intensity values of the image sequence are corrected for illumination. Intensity values of an overexposed or underexposed RGB three-channel spatiotemporal image sequence; The optimal value obtained by dynamically calculating the pixel intensity distribution of an image through K-means clustering analysis. value.
4. The non-contact rapid screening method for physiological states according to claim 1, characterized in that: The optimal value is dynamically calculated by analyzing the pixel intensity distribution of the image using K-means clustering. Values, specifically including: Normalize the image pixel intensity to the range [0,1]; The K-means clustering algorithm is applied to divide the pixels into K clusters, and the mean of each cluster is calculated. Dynamically adjust according to the distribution characteristics of the cluster Values were calculated, with those having a mean greater than 0.9 being overexposed clusters and those having a mean less than 0.1 being underexposed clusters. Optimal values were dynamically calculated for both overexposed and underexposed clusters. value.
5. The non-contact rapid screening method for physiological states according to claim 2, characterized in that: The physiological indicators include heart rate, heart rate variability, and blood oxygen saturation. The formula for calculating heart rate is: HR = 60 / MeanRR; ; Wherein, HR is the heart rate, representing the average heart rate; MeanRR is the average RR interval, representing the average time interval between adjacent heartbeats; Total duration represents the total duration of the electrocardiogram signal; and Number of RR intervals represents the total number of heartbeats.
6. The non-contact rapid screening method for physiological states according to claim 5, characterized in that: The formula for calculating blood oxygen saturation is: ; ; ; in, Blood oxygen saturation, ΔA R The AC / DC ratio of the signal in channel R, ΔA G The AC / DC ratio of the signal in channel G, AC R For the AC component of the R channel, DC R For the DC component of channel R, AC G For the AC component of the G channel, DC G Here, denoted as DC component of channel G, and a and b are experimental calibration coefficients.
7. The non-contact rapid screening method for physiological states according to claim 2, characterized in that: The barrel effect model selects the worst physiological indicator among all indicators as the final suitability assessment level; the graded early warning signals include green (normal), yellow (warning), and red (prohibited from working).
8. A non-contact rapid physiological state screening system, used to implement the non-contact rapid physiological state screening method as described in any one of claims 1-7, characterized in that, include: The perception layer includes a data acquisition module, which is used to acquire RGB three-channel spatiotemporal image sequences of facial regions of interest. The processing layer includes an edge computing module, which runs an adaptive gamma correction algorithm and a one-dimensional convolutional neural network autoencoder denoising algorithm to calculate physiological indicators. The decision-making level is used to run physiological indicator grading standards and the barrel effect model to generate graded early warning signals.
9. A non-contact rapid physiological state screening system according to claim 8, characterized in that: The edge computing module includes an illumination correction unit, a one-dimensional convolutional neural network noise reduction unit, and a physiological indicator calculation unit. The illumination correction unit dynamically calculates the optimal γ value through K-means clustering and uses an adaptive gamma correction algorithm to perform frame-by-frame illumination correction on the RGB three-channel spatiotemporal image sequence to obtain an illumination-corrected image sequence. The one-dimensional convolutional neural network noise reduction unit is used to perform end-to-end noise reduction processing on the illumination-corrected image sequence using a one-dimensional convolutional neural network autoencoder noise reduction algorithm, separating the remote photoplethysmography pulsation signal from specular reflection and motion noise. The physiological index calculation unit is used to calculate heart rate, heart rate variability and blood oxygen saturation based on the separated remote photoplethysmography pulse signal.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements a non-contact rapid screening method for physiological states as described in any one of claims 1-7.
Citation Information
Patent Citations
Method and system for screening health risk of construction site employee before work
CN117292427A
Non-contact blood supply monitoring system
CN118557157A
Multi-physiological parameter measuring system based on IPPG technology
CN118787321A
Non-contact fatigue detection system and method based on rppg
US20240081705A1
Cited By
Target state parameter determination method and device, storage medium and electronic device
CN121937707A
