Seat belt warning system based on driver status

Abstract

The invention discloses a seat belt warning system based on driver status, and relates to the technical field of seat belt warning. The system comprises a signal acquisition module, a status analysis module and a control reminder module, which collects ambient temperature signals, facial status data and physiological status data of the driver, outputs facial feature signals and physiological feature signals, compares and assigns values ​​to the facial feature signals and the physiological feature signals, confirms the driver status according to a total score, outputs fatigue status analysis results, analyzes the physiological status data, outputs the physiological status analysis results, performs seat belt reminder control, monitors the driver's facial status and physiological data in real time, extracts feature signals, calculates a total score according to the weights of these signals, judges the driver's fatigue and health status, performs seat belt reminder control according to different fatigue and health status according to the analysis results, reminds the driver to stay alert, provides personalized safety protection, and improves driving safety and comfort.

Description

Technical Field

[0001] The present invention relates to the technical field of seat belt warnings, and in particular to a seat belt warning system based on driver status. Background Art

[0002] With the rapid development of the automobile industry and the increasing prominence of road traffic safety issues, monitoring of drivers' physiological and fatigue states has become an important issue to ensure driving safety. Long-term driving or bad driving habits can easily lead to driver fatigue, thereby increasing the risk of traffic accidents.

[0003] At present, a Chinese patent with application number CN201811124704.4 discloses a seat belt with a fatigue driving reminder function, which includes a seat belt body; a heart rate sensor, which is arranged on the seat belt body and the heart rate sensor is directly opposite to the driver's heart position, and the heart rate sensor is used to detect the driver's heart rate and output a heart rate signal; a processor, which is connected to the heart rate sensor signal and is used to receive and process the heart rate signal to determine the driver's fatigue level; an alarm device, which is connected to the processor signal and is used to generate a reminder signal when the driver is fatigued. Although the seat belt of this invention can detect whether the driver is in a fatigue state in real time, and suggest the driver to stop and rest when it is determined that the driver is in a fatigue state, it is unable to conduct a comprehensive analysis based on the driver's various physiological states and provide personalized micro-movement reminders based on the driver's state, which affects the driver's driving experience.

[0004] The technical problem solved by the present invention is that the above-mentioned technology cannot perform a comprehensive analysis based on the driver's various physiological states and provide personalized micro-motion reminders based on the driver's state, which affects the driver's driving experience.

[0005] In order to solve the above technical problems, the present invention provides the following technical solutions:

[0006] The seat belt warning system based on the driver's status includes a signal acquisition module, a status analysis module and a control reminder module:

[0007] The signal acquisition module is used to collect the ambient temperature signal, the driver's facial state data and physiological state data, perform feature extraction on the facial state data and physiological state data, and output the facial feature signal and the physiological feature signal;

[0008] The state analysis module is used to compare and assign values ​​to facial feature signals and physiological feature signals, calculate the total score of all facial feature signals and physiological feature signals according to preset weights, confirm the driver's state according to the total score, output fatigue state analysis results, analyze physiological state data, and output physiological state analysis results;

[0009] The control reminder module is used to control the seat belt according to the fatigue state analysis result and the physiological state analysis result;

[0010] The signal acquisition module includes a data collection unit and a data processing unit:

[0011] The data collection unit is used to collect the driver's facial video, skin temperature data and heart rate data;

[0012] The data processing unit is used to extract features based on the facial video, skin temperature data and heart rate data, and output the features as an eye closure duration ratio signal, an eye closure frequency signal, a skin temperature signal and a heart rate signal;

[0013] The state analysis module includes a comparison and assignment unit, a total score calculation unit, a fatigue analysis unit and a physiological analysis unit:

[0014] The comparison and assignment unit is used to assign values ​​to the output eye closure duration ratio signal, eye closure frequency signal, skin temperature signal and heart rate signal according to a preset state threshold, and obtain scores corresponding to the eye closure duration ratio signal, eye closure frequency signal, skin temperature signal and heart rate signal;

[0015] The total score calculation unit is used to perform a total calculation based on the scores corresponding to the eye closure duration ratio signal, the eye closure frequency signal, the skin temperature signal and the heart rate signal and the preset weights corresponding to the eye closure duration ratio signal, the eye closure frequency signal, the skin temperature signal and the heart rate signal, and output the total score of the state;

[0016] The fatigue analysis unit is used to determine the state corresponding to the state total score according to a preset state total score threshold, and output the fatigue state analysis result;

[0017] The physiological analysis unit is used to analyze the driver's physiological state according to the heart rate signal, and output the physiological state analysis result;

[0018] The total score calculation unit compares the ambient temperature signal and the skin temperature signal to calculate the difference between the ambient temperature and the skin temperature. If the difference is ≥ the preset temperature difference, the weight corresponding to each feature is:

[0019] Eye closure duration ratio signal: 0.4, eye closure frequency signal: 0.3, heart rate signal: 0.2, skin temperature signal: 0.1;

[0020] If the difference is less than the preset temperature difference, the weight corresponding to each feature is:

[0021] Eye closure duration ratio signal: 0.4, eye closure frequency signal: 0.25, heart rate signal: 0.2, skin temperature signal: 0.15.

[0022] Preferably, the control reminder module includes a status confirmation unit and a reminder control unit:

[0023] The state confirmation unit is used to select the output control strength signal according to the corresponding relationship between the state signal and the preset control strength;

[0024] The reminder control unit is used to perform reminder control on the driver according to the control strength signal.

[0025] Preferably, the comparison and assignment unit locates the facial area by inputting the facial video into a Haar cascade classifier, locates the eye area using a facial key point detection model, and calculates the aspect ratio of the eye area, and when the eyes are closed, the aspect ratio decreases;

[0026] The eye closure duration ratio is calculated by selecting a fixed time window and accumulating the number of frames of eye closure. The mathematical expression of the eye closure duration ratio is:

[0027]

[0028] in, is the ratio of eye closure time, is the accumulated number of closed frames, is the total number of frames, and outputs the eye closure duration ratio signal;

[0029] The total number of facial video frames in the time window and the number of frames with closed eyes in the same time window are counted. The mathematical expression of eye closure frequency is:

[0030]

[0031] in, is the eye closure frequency, Outputs the eye closure frequency signal as the number of closed frames.

[0032] Preferably, the state threshold of the comparison and assignment unit is:

[0033] Eye closure duration ratio threshold:

[0034] Good spirits: the proportion of eyes closed time < the first proportion threshold;

[0035] Slight fatigue: the first ratio threshold ≤ the ratio of eye closure time < the second ratio threshold;

[0036] Moderate fatigue: the second ratio threshold ≤ the ratio of eye closure time < the third ratio threshold;

[0037] Severe fatigue: the proportion of eye closure time ≥ the third proportion threshold;

[0038] Eye Closure Frequency Signal Threshold:

[0039] Good spirits: eye closure frequency < first frequency threshold;

[0040] Slight fatigue: first frequency threshold ≤ eye closure frequency < second frequency threshold;

[0041] Moderate fatigue: the second frequency threshold ≤ eye closure frequency < the third frequency threshold;

[0042] Severe fatigue: eye closure frequency ≥ the third frequency threshold;

[0043] Heart rate signal threshold:

[0044] Good spirits: the first heart rate threshold ≤ heart rate < the second heart rate threshold, heart rate variability > the first heart rate variability threshold;

[0045] Slight fatigue: the second heart rate threshold ≤ heart rate < the third heart rate threshold, the second heart rate variability threshold < heart rate variability ≤ the first heart rate variability threshold;

[0046] Moderate fatigue: the third heart rate threshold ≤ heart rate < the fourth heart rate threshold, the third heart rate variability threshold < heart rate variability ≤ the second heart rate variability threshold;

[0047] Severe fatigue: heart rate ≥ the fourth heart rate threshold, heart rate variability ≤ the third heart rate variability threshold;

[0048] Skin temperature signal:

[0049] Good spirits: no significant change from the preset baseline temperature;

[0050] Mild fatigue: skin temperature rises or falls within the first temperature relative to the baseline temperature;

[0051] Moderate fatigue: skin temperature increases or decreases from baseline temperature by 1st temperature - 2nd temperature;

[0052] Severe fatigue: skin temperature increases or decreases by more than a second temperature relative to baseline temperature;

[0053] The value corresponding to each state is:

[0054] Good spirits were scored as 1, mild fatigue was scored as 2, moderate fatigue was scored as 3, and severe fatigue was scored as 4.

[0055] Preferably, the total state score threshold in the fatigue analysis unit is:

[0056] Good spirits: total state score is 1.0-1.9;

[0057] Slight fatigue: total state score is 2.0-2.4;

[0058] Moderate fatigue: total state score is 2.5-3.0;

[0059] Severe fatigue: total state score is 3.1-4.0;

[0060] Find the corresponding state according to the total state score and output it as the fatigue state analysis result.

[0061] Preferably, the physiological analysis unit analyzes the driver's physiological state according to the heart rate signal threshold in the state threshold of the comparison assignment unit; if the heart rate ≥ the fourth heart rate threshold and the heart rate variability ≤ the third heart rate variability threshold, the output is a physiological state abnormal signal; if the first heart rate threshold ≤ heart rate < the fourth heart rate threshold and the heart rate variability > the third heart rate variability threshold, the output is a physiological state normal signal; the physiological state analysis result includes a physiological state abnormal signal and a physiological state normal signal.

[0062] Preferably, the state confirmation unit sends a signal output type reminder and collects signal output types, wherein the signal output type includes a vibration signal or a tightening signal. A corresponding search is performed according to the input fatigue state analysis result and the physiological state analysis result and the corresponding relationship with the preset control intensity. If the physiological state analysis result is an abnormal physiological state signal, a progressive vibration signal or a progressive tightening signal is output. If the fatigue state analysis result is a good spirit and the physiological state analysis result is a normal physiological state signal, no control intensity signal is output. If the fatigue state analysis result is slight fatigue and the physiological state analysis result is a normal physiological state signal, a slight vibration signal or a slight tightening signal is output. If the fatigue state analysis result is moderate fatigue and the physiological state analysis result is a normal physiological state signal, a moderate vibration signal or a moderate tightening signal is output. If the fatigue state analysis result is severe fatigue and the physiological state analysis result is a normal physiological state signal, a severe vibration signal or a severe tightening signal is output.

[0063] The control intensity correspondence relationship is:

[0064] The corresponding vibration frequency of the progressive vibration signal includes three vibration stages, each vibration stage lasts for 20 seconds, and the three vibration stages include:

[0065] Initial stage: the vibration frequency is the initial vibration frequency, and the acceleration intensity of the vibration force is the initial acceleration intensity;

[0066] Intermediate stage: the vibration frequency is the intermediate vibration frequency, and the acceleration intensity of the vibration force is the intermediate acceleration intensity;

[0067] Final stage: the vibration frequency is the final vibration frequency, and the acceleration intensity of the vibration force is the final acceleration intensity;

[0068] The initial vibration frequency is less than the intermediate vibration frequency and less than the final vibration frequency, and the initial acceleration intensity is less than the intermediate acceleration intensity and less than the final acceleration intensity;

[0069] The corresponding vibration frequency of the progressive tightening signal includes three tightening stages, each tightening stage lasts for 20 seconds, and the three tightening stages include:

[0070] Initial stage: the tightening force is the initial tightening force value;

[0071] Intermediate stage: the tightening force is the intermediate tightening force value;

[0072] Final stage: the tightening force is the final tightening force value;

[0073] The initial tightening force value < the intermediate tightening force value < the final tightening force value;

[0074] The vibration frequency corresponding to the mild vibration signal is the first vibration frequency, and the acceleration intensity of the vibration intensity is the first acceleration intensity;

[0075] The vibration frequency corresponding to the moderate vibration signal is the second vibration frequency, and the acceleration intensity of the vibration intensity is the second acceleration intensity;

[0076] The vibration frequency corresponding to the severe vibration signal is the third vibration frequency, and the acceleration intensity of the vibration intensity is the third acceleration intensity;

[0077] The first vibration frequency is less than the second vibration frequency and less than the third vibration frequency, and the first acceleration intensity is less than the second acceleration intensity and less than the third acceleration intensity;

[0078] The tightening intensity corresponding to the light tightening signal is the first intensity value;

[0079] The tightening intensity corresponding to the moderate tightening signal is the second intensity value;

[0080] The tightening intensity corresponding to the severe tightening signal is the third intensity value;

[0081] The first force value < the second force value < the third force value;

[0082] The control time of the reminder control unit is 1 minute. If the driver triggers the stop signal, the control will be stopped. If the driver does not trigger the stop signal within 1 minute, the control will continue until the end of 1 minute.

[0083] The beneficial effects of the present invention include: real-time monitoring of the driver's facial state and physiological data, extraction of characteristic signals, calculation of a total score based on the weights of these signals, determination of the driver's fatigue and health status, and based on the analysis results, control of the seat belt reminders for different fatigue and health statuses, reminding the driver to stay alert, providing personalized safety protection, and improving driving safety and comfort. BRIEF DESCRIPTION OF THE DRAWINGS

[0084] Figure 1 A basic flow chart of a seat belt warning system based on driver status provided by one embodiment of the present invention. DETAILED DESCRIPTION

[0085] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are described in detail below in conjunction with the drawings. It is obvious that the described embodiments are only part of the embodiments of the present invention, but not all of the embodiments.

[0086] Example 1, reference Figure 1 , provides a seat belt warning system based on the driver's status, including a signal acquisition module, a status analysis module and a control reminder module:

[0087] The signal acquisition module is used to collect ambient temperature signals, driver's facial state data and physiological state data, perform feature extraction on the facial state data and physiological state data, and output facial feature signals and physiological feature signals.

[0088] The ambient temperature, driver's facial condition and physiological indicators are captured in real time to ensure the comprehensiveness and timeliness of the data. After feature extraction, they are converted into analyzable facial feature signals and physiological feature signals, providing a solid foundation for subsequent status assessment.

[0089] The state analysis module is used to compare and assign values ​​to facial feature signals and physiological feature signals, calculate the total score by adding the scores corresponding to all facial feature signals and physiological feature signals according to preset weights, confirm the driver's state according to the total score, output the fatigue state analysis results, analyze the physiological state data, and output the physiological state analysis results.

[0090] The facial feature signals and physiological feature signals are deeply compared and analyzed, and the total score is scientifically calculated through a preset weight system, so as to accurately determine whether the driver is in a state of fatigue or has other adverse physiological conditions. This is not only fast and accurate, but also able to promptly discover potential safety hazards.

[0091] The control reminder module is used to remind and control the seat belt according to the fatigue state analysis results and the physiological state analysis results.

[0092] According to the output results of the state analysis module, differentiated reminder control strategies are adopted to dynamically adjust the seat belts. For drivers who are fatigued, their attention is awakened in time by tightening the seat belts. For drivers with physiological abnormalities, a gentler reminder method is adopted to avoid aggravating their discomfort. This personalized reminder and intervention mechanism not only effectively ensures driving safety, but also reflects humanistic care for drivers.

[0093] The signal acquisition module includes a data collection unit and a data processing unit:

[0094] The data collection unit is used to collect the driver's facial video, skin temperature data, heart rate data and electromyography signals.

[0095] A high-definition camera is used to point at the driver's face to ensure that the movements in the eye area can be clearly captured. The frame rate and resolution are set to ensure the continuity and clarity of the facial video. The facial video is transmitted in real time for subsequent analysis. A temperature sensor is installed on the seat belt to detect skin temperature and convert the data into an electrical signal. The electrical signal is converted into skin temperature data through an analog-to-digital converter for computer processing. A heart rate monitoring device is used to monitor the electrical signal generated by the heartbeat to measure the heart rate, and the output is heart rate data.

[0096] The data processing unit is used to extract features based on facial video, skin temperature data and heart rate data, and the output is an eye closure duration ratio signal, an eye closure frequency signal, a skin temperature signal and a heart rate signal.

[0097] The received skin temperature data is smoothed to eliminate noise and outliers, and the skin temperature signal is output for subsequent comprehensive analysis. The heart rate data is filtered to remove noise and interference, and the driver's cardiovascular health status is evaluated for subsequent analysis or early warning system use.

[0098] The state analysis module includes a comparison assignment unit, a total score calculation unit, a fatigue analysis unit and a physiological analysis unit.

[0099] The comparison and assignment unit is used to assign values ​​to the output eye closure duration ratio signal, eye closure frequency signal, skin temperature signal and heart rate signal according to a preset state threshold, and obtain the scores corresponding to the eye closure duration ratio signal, eye closure frequency signal, skin temperature signal and heart rate signal.

[0100] Receive the eye closure duration ratio signal, eye closure frequency signal, skin temperature signal and heart rate signal from the data processing unit, set a different threshold range for each signal, compare the actual value of each signal with the corresponding threshold range, assign a corresponding score according to the comparison result, and output the score corresponding to each signal for use by subsequent units.

[0101] The total score calculation unit is used to perform a total calculation based on the scores corresponding to the eye closure duration ratio signal, the eye closure frequency signal, the skin temperature signal and the heart rate signal and the preset weights corresponding to the eye closure duration ratio signal, the eye closure frequency signal, the skin temperature signal and the heart rate signal, and the output is the total score of the state.

[0102] Receive the scores of the eye closure duration ratio signal, eye closure frequency signal, skin temperature signal and heart rate signal from the comparison assignment unit, assign different weights to each signal according to its importance in evaluating the driver's status, multiply the score of each signal by the corresponding weight, and then sum them up to get the total status score, and output the calculated total status score for use by subsequent units.

[0103] The fatigue analysis unit is used to determine the state corresponding to the state total score according to a preset state total score threshold, and outputs the fatigue state analysis result.

[0104] Receive the total status score from the total score calculation unit, set different fatigue status thresholds, compare the total status score with the preset fatigue status threshold, judge the driver's current fatigue status, and output the driver's fatigue status analysis result based on the judgment result.

[0105] The physiological analysis unit is used to analyze the driver's physiological state according to the heart rate signal, and outputs the physiological state analysis result.

[0106] The control reminder module includes a status confirmation unit and a reminder control unit:

[0107] The state confirmation unit is used to select the output control strength signal according to the corresponding relationship between the state signal and the preset control strength.

[0108] According to the state signal received from the state analysis module, combined with the preset control strength correspondence, the appropriate control strength signal is intelligently selected and output. This control strength signal will serve as the basis for subsequent reminder control operations to ensure that the reminder or intervention measures are neither too strong to distract the driver nor too weak to achieve the expected effect. Through this mechanism, the state confirmation unit realizes accurate identification of the driver's state and reasonable matching of the corresponding control strength.

[0109] The reminder control unit is used to perform reminder control on the driver according to the control strength signal.

[0110] The seat belt provides subtle and effective control reminders to the driver based on the control strength signal received from the status confirmation unit, affecting the driver's attention with minimal interference, while effectively conveying the system's attention and reminder intentions to the driver's current status. Through precise reminder control, it can help the driver adjust his status in time to avoid potential dangers or discomfort.

[0111] The contrast assignment unit locates the facial area by inputting the facial video into the Haar cascade classifier, locates the eye area using the facial key point detection model, and calculates the aspect ratio of the eye area. When the eyes are closed, the aspect ratio decreases;

[0112] The eye closure duration ratio is calculated by selecting a fixed time window and accumulating the number of frames of eye closure. The mathematical expression of the eye closure duration ratio is:

[0113]

[0114] in, is the ratio of eye closure time, is the accumulated number of closed frames, is the total number of frames, and outputs the eye closure duration ratio signal;

[0115] The total number of facial video frames in the time window and the number of frames with closed eyes in the same time window are counted. The mathematical expression of eye closure frequency is:

[0116]

[0117] in, is the eye closure frequency, Outputs the eye closure frequency signal as the number of closed frames.

[0118] By locating the facial area through the Haar cascade classifier and the eye area through the facial key point detection model, high-precision recognition of the driver's facial features is achieved. By calculating the aspect ratio of the eye area and monitoring the opening and closing status of the eyes in real time, key data is provided for evaluating the driver's fatigue level. The time window is one minute. The total number of frames of facial video, the number of frames with closed eyes and the accumulated number of closed frames within one minute are counted, and then the proportion of eye closure time and the frequency of eye closure are calculated. This quantitative indicator provides an objective basis for the system to evaluate the driver's fatigue status.

[0119] The status threshold of the comparison assignment unit is:

[0120] Eye closure duration ratio threshold:

[0121] Good mental state: the proportion of eyes closed time < the first proportion threshold.

[0122] Slight fatigue: the first ratio threshold ≤ the ratio of eye closure time < the second ratio threshold.

[0123] Moderate fatigue: the second ratio threshold ≤ the ratio of eyes closed time < the third ratio threshold.

[0124] Severe fatigue: The proportion of time eyes are closed ≥ the third proportion threshold.

[0125] The first ratio threshold is 10%, the second ratio threshold is 20%, and the third ratio threshold is 30%.

[0126] Eye Closure Frequency Signal Threshold:

[0127] Eye Closure Frequency Signal Threshold:

[0128] Good mental state: eye closure frequency < first frequency threshold.

[0129] Mild fatigue: first frequency threshold ≤ eye closure frequency < second frequency threshold.

[0130] Moderate fatigue: second frequency threshold ≤ eye closure frequency < third frequency threshold.

[0131] Severe fatigue: Eye closure frequency ≥ the third frequency threshold.

[0132] The first frequency threshold is 10%, the second frequency threshold is 20%, and the third frequency threshold is 30%.

[0133] Heart rate signal threshold:

[0134] Good spirits: the first heart rate threshold ≤ heart rate < the second heart rate threshold, heart rate variability > the first heart rate variability threshold.

[0135] Mild fatigue: the second heart rate threshold ≤ heart rate < the third heart rate threshold, the second heart rate variability threshold < heart rate variability ≤ the first heart rate variability threshold.

[0136] Moderate fatigue: the third heart rate threshold ≤ heart rate < fourth heart rate threshold, the third heart rate variability threshold < heart rate variability ≤ second heart rate variability threshold.

[0137] Severe fatigue: heart rate ≥ the fourth heart rate threshold, heart rate variability ≤ the third heart rate variability threshold.

[0138] The first heart rate threshold is 60bpm, the first heart rate variability threshold is 50ms, the second heart rate threshold is 80bpm, the second heart rate variability threshold is 40ms, the third heart rate threshold is 90bpm, the third heart rate variability threshold is 30ms, and the fourth heart rate threshold is 100bpm.

[0139] Skin temperature signal:

[0140] Good spirits: No significant change from the preset baseline temperature.

[0141] Mild fatigue: Skin temperature rises or falls within the first temperature relative to baseline temperature.

[0142] Moderate fatigue: Skin temperature increases or decreases relative to baseline temperature by 1st temperature - 2nd temperature.

[0143] Severe fatigue: Skin temperature increases or decreases by more than a second temperature relative to baseline temperature.

[0144] The first temperature is 0.5 degrees Celsius, and the second temperature is 1 degree Celsius.

[0145] The value corresponding to each state is:

[0146] Good spirits were scored as 1, mild fatigue was scored as 2, moderate fatigue was scored as 3, and severe fatigue was scored as 4.

[0147] The total score calculation unit compares the ambient temperature signal and the skin temperature signal, and calculates the difference between the ambient temperature and the skin temperature. If the difference is ≥ the preset temperature difference, the weight corresponding to each feature is:

[0148] Eye closure duration ratio signal: 0.4, eye closure frequency signal: 0.3, heart rate signal: 0.2, skin temperature signal: 0.1.

[0149] If the difference is less than the preset temperature difference, the weight corresponding to each feature is:

[0150] Eye closure duration ratio signal: 0.4, eye closure frequency signal: 0.25, heart rate signal: 0.2, skin temperature signal: 0.15.

[0151] The total status score threshold in the fatigue analysis unit is:

[0152] Good spirits: total status score is 1.0-1.9.

[0153] Mild fatigue: total status score is 2.0-2.4.

[0154] Moderate fatigue: total status score is 2.5-3.0.

[0155] Severe fatigue: total state score is 3.1-4.0.

[0156] Find the corresponding state according to the total state score and output it as the fatigue state analysis result.

[0157] According to the preset state threshold, the eye closure frequency, heart rate, electromyography amplitude and skin temperature signals are analyzed in real time, and each signal is assigned a corresponding fatigue level score, ensuring the accuracy and objectivity of the evaluation. According to the difference between the ambient temperature and the skin temperature, the weight of each physiological signal in the total score calculation is dynamically adjusted. When the difference between the ambient temperature and the skin temperature is large, the weight of the skin temperature signal is reduced to reduce the interference of the external environment on the evaluation result. Conversely, its weight is increased, which improves the flexibility and adaptability of the evaluation. The total state score is calculated by weighted summing the scores of each physiological signal. According to the preset state total score threshold, the total score is mapped to the specific fatigue state, realizing the direct conversion from physiological signal to fatigue state, providing a clear basis for subsequent reminders or intervention measures.

[0158] Based on the results of fatigue status analysis, instant feedback or warning is given to the driver. For high-risk conditions such as severe fatigue, a strong warning signal is output to prompt the driver to take immediate measures. This instant feedback mechanism helps reduce the risk of traffic accidents caused by fatigue driving.

[0159] By continuously monitoring and evaluating the driver's fatigue status, it helps to detect potential fatigue risks in advance and take effective measures to intervene, which can not only improve the driver's safety awareness, but also reduce the occurrence of accidents caused by fatigue driving, thereby improving overall driving safety.

[0160] The physiological analysis unit analyzes the driver's physiological state according to the heart rate signal threshold in the state threshold of the comparison assignment unit. If the heart rate ≥ the fourth heart rate threshold, and the heart rate variability ≤ the third heart rate variability threshold, the output is a physiological state abnormal signal. If the first heart rate threshold ≤ heart rate < the fourth heart rate threshold, and the heart rate variability > the third heart rate variability threshold, the output is a physiological state normal signal. The physiological state analysis result includes a physiological state abnormal signal and a physiological state normal signal.

[0161] The state confirmation unit sends a signal output type reminder and collects signal output types, wherein the signal output types include vibration signals or tightening signals, and the vibration signals and tightening signals can be pre-selected manually, and a corresponding search is performed according to the input fatigue state analysis results and physiological state analysis results and the corresponding relationship with the preset control intensity. If the physiological state analysis result is an abnormal physiological state signal, a progressive vibration signal or a progressive tightening signal is output; if the fatigue state analysis result is a good spirit and the physiological state analysis result is a normal physiological state signal, no control intensity signal is output; if the fatigue state analysis result is slight fatigue and the physiological state analysis result is a normal physiological state signal, a slight vibration signal or a slight tightening signal is output; if the fatigue state analysis result is moderate fatigue and the physiological state analysis result is a normal physiological state signal, a moderate vibration signal or a moderate tightening signal is output; if the fatigue state analysis result is severe fatigue and the physiological state analysis result is a normal physiological state signal, a severe vibration signal or a severe tightening signal is output.

[0162] The corresponding relationship of control intensity is:

[0163] The corresponding vibration frequency of the progressive vibration signal includes three vibration stages, each vibration stage lasts for 20 seconds, and the three vibration stages include:

[0164] Initial stage: the vibration frequency is the initial vibration frequency, and the acceleration intensity of the vibration force is the initial acceleration intensity.

[0165] Intermediate stage: the vibration frequency is the intermediate vibration frequency, and the acceleration intensity of the vibration force is the intermediate acceleration intensity.

[0166] Final stage: the vibration frequency is the final vibration frequency, and the acceleration intensity of the vibration force is the final acceleration intensity.

[0167] The initial vibration frequency is less than the intermediate vibration frequency and less than the final vibration frequency, and the initial acceleration intensity is less than the intermediate acceleration intensity and less than the final acceleration intensity.

[0168] The initial vibration frequency is 1 Hz, the initial acceleration intensity is 0.05 g, the intermediate vibration frequency is 2 Hz, the intermediate acceleration intensity is 0.1 g, the final vibration frequency is 4 Hz, and the final acceleration intensity is 0.3 g.

[0169] The corresponding vibration frequency of the progressive tightening signal includes three tightening stages, each tightening stage lasts for 20 seconds, and the three tightening stages include:

[0170] Initial stage: The tightening force is the initial tightening force value.

[0171] Intermediate stage: the tightening force is the intermediate tightening force value.

[0172] Final stage: The tightening force is the final tightening force value.

[0173] The initial tightening force value is less than the intermediate tightening force value and less than the final tightening force value.

[0174] The initial tightening force value is 200 Newtons, the intermediate tightening force value is 400 Newtons, and the final tightening force value is 600 Newtons.

[0175] The vibration frequency corresponding to the mild vibration signal is the first vibration frequency, and the acceleration intensity of the vibration strength is the first acceleration intensity.

[0176] The vibration frequency corresponding to the moderate vibration signal is the second vibration frequency, and the acceleration intensity of the vibration strength is the second acceleration intensity.

[0177] The vibration frequency corresponding to the severe vibration signal is the third vibration frequency, and the acceleration intensity of the vibration strength is the third acceleration intensity.

[0178] The first vibration frequency is less than the second vibration frequency and less than the third vibration frequency, and the first acceleration intensity is less than the second acceleration intensity and less than the third acceleration intensity.

[0179] The first vibration frequency is 2 Hz, the first acceleration intensity is 0.1 g, the second vibration frequency is 5 Hz, the second acceleration intensity is 0.2 g, the third vibration frequency is 8 Hz, and the third acceleration intensity is 0.4 g.

[0180] The tightening force corresponding to the light tightening signal is the first force value.

[0181] The tightening force corresponding to the moderate tightening signal is the second force value.

[0182] The tightening force corresponding to the severe tightening signal is the third force value.

[0183] The first force value is less than the second force value and less than the third force value.

[0184] The first force value is 300 Newtons, the second force value is 500 Newtons, and the third force value is 700 Newtons.

[0185] The reminder control time of the reminder control unit is 1 minute. If the driver triggers the stop signal, the control will stop. If the driver does not trigger the stop signal within 1 minute, the control will continue until the end of 1 minute.

[0186] When the driver's physiological state becomes abnormal, a progressive vibration signal or a progressive tightening signal is immediately output. Through three stages of gradual enhancement, the driver is effectively reminded to pay attention to his physical condition and may need to rest or seek medical help.

[0187] For the hierarchical management of fatigue status:

[0188] Good mental state and normal physiological state: No control intensity signal is output, indicating that the driver is in good condition and can continue to drive safely.

[0189] Slightly tired but in normal physiological state: Outputs a slight vibration signal or a slight tightening signal to remind the driver to adjust his / her state and avoid fatigue accumulation through gentle vibration or tightening of the seat belt.

[0190] Moderate fatigue and normal physiological state: output moderate vibration signal or moderate tightening signal, the seat belt vibrates or tightens with moderate force, further reminding the driver to rest or take measures to relieve fatigue.

[0191] Severe fatigue and normal physiological state: output severe vibration signal or severe tightening signal. The vibration or tightening force of the seat belt directly and significantly warns the driver to stop driving immediately and rest.

[0192] The control duration is set to 1 minute, giving the driver enough reaction time. If the driver triggers the stop signal during this period, the control will be stopped immediately, reflecting the humanized design of the system.

[0193] Through the preset control intensity correspondence, the system can accurately match different fatigue and physiological states, and output the most suitable vibration feedback or seat belt tightening feedback, which can effectively remind and avoid excessive interference. The high-precision sensor collects the driver's eye closure time ratio, eye closure frequency, heart rate and skin temperature signals in real time, and uses the preset state threshold to perform intelligent analysis on these signals to accurately judge the driver's fatigue level. This precise monitoring capability provides reliable data support for subsequent fatigue state assessment. Taking into account the impact of ambient temperature factors on the driver's physiological state, by comparing the ambient temperature signal and the skin temperature signal, the weight of each physiological signal in the total score calculation is dynamically adjusted, which improves the flexibility and adaptability of the assessment, allowing the system to be able to perform in different environments. To maintain high assessment accuracy, the weighted summation method is used to comprehensively score the scores of each physiological signal to obtain the total state score. According to the preset total state score threshold, the total score is mapped to the specific fatigue state. This process realizes the direct conversion from physiological signals to fatigue states, and provides a clear basis for subsequent reminders or intervention measures. According to the results of fatigue state analysis, feedback or warnings are issued to the driver in real time. For different degrees of fatigue states, the system adopts different feedback methods. The driver's comfort and acceptance are fully considered in the design. The intensity and duration of vibration feedback are carefully adjusted to ensure that it can effectively remind the driver without causing excessive interference. In addition, the system also provides a stop signal function, allowing the driver to manually stop feedback when necessary.

[0194] It should be understood by those skilled in the art that the embodiments of the present invention may be provided as methods, systems or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware aspects. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media containing computer-usable program codes. Among them, the storage medium may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (Static Random Access Memory, referred to as SRAM), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, referred to as EEPROM), erasable programmable read-only memory (Erasable Programmable Read Only Memory, referred to as EPROM), programmable read-only memory (Programmable Red-Only Memory, referred to as PROM), read-only memory (Read-Only Memory, referred to as ROM), magnetic memory, flash memory, magnetic disk or optical disk. These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0195] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.

Claims

1. A seat belt warning system based on driver status, characterized in that: Including signal acquisition module, status analysis module and control reminder module: The signal acquisition module is used to collect the ambient temperature signal, the driver's facial state data and physiological state data, perform feature extraction on the facial state data and physiological state data, and output the facial feature signal and the physiological feature signal; The state analysis module is used to compare and assign values ​​to facial feature signals and physiological feature signals, calculate the total score of all facial feature signals and physiological feature signals according to preset weights, confirm the driver's state according to the total score, output fatigue state analysis results, analyze physiological state data, and output physiological state analysis results; The control reminder module is used to control the seat belt according to the fatigue state analysis result and the physiological state analysis result; The signal acquisition module includes a data collection unit and a data processing unit: The data collection unit is used to collect the driver's facial video, skin temperature data and heart rate data; The data processing unit is used to extract features based on the facial video, skin temperature data and heart rate data, and output the features as an eye closure duration ratio signal, an eye closure frequency signal, a skin temperature signal and a heart rate signal; The state analysis module includes a comparison and assignment unit, a total score calculation unit, a fatigue analysis unit and a physiological analysis unit: The comparison and assignment unit is used to assign values ​​to the output eye closure duration ratio signal, eye closure frequency signal, skin temperature signal and heart rate signal according to a preset state threshold, and obtain scores corresponding to the eye closure duration ratio signal, eye closure frequency signal, skin temperature signal and heart rate signal; The total score calculation unit is used to perform a total calculation based on the scores corresponding to the eye closure duration ratio signal, the eye closure frequency signal, the skin temperature signal and the heart rate signal and the preset weights corresponding to the eye closure duration ratio signal, the eye closure frequency signal, the skin temperature signal and the heart rate signal, and output the total score of the state; The fatigue analysis unit is used to determine the state corresponding to the state total score according to a preset state total score threshold, and output the fatigue state analysis result; The physiological analysis unit is used to analyze the driver's physiological state according to the heart rate signal, and output the physiological state analysis result; The total score calculation unit compares the ambient temperature signal and the skin temperature signal to calculate the difference between the ambient temperature and the skin temperature. If the difference is ≥ the preset temperature difference, the weight corresponding to each feature is: Eye closure duration ratio signal: 0.4, eye closure frequency signal: 0.3, heart rate signal: 0.2, skin temperature signal: 0.1; If the difference is less than the preset temperature difference, the weight corresponding to each feature is: Eye closure duration ratio signal: 0.4, eye closure frequency signal: 0.25, heart rate signal: 0.2, skin temperature signal: 0.

15.

2. The seat belt warning system based on driver status as claimed in claim 1, characterized in that: The control reminder module includes a status confirmation unit and a reminder control unit: The state confirmation unit is used to select the output control strength signal according to the corresponding relationship between the state signal and the preset control strength; The reminder control unit is used to perform reminder control on the driver according to the control strength signal.

3. The seat belt warning system based on driver status as claimed in claim 2, characterized in that: The contrast assignment unit locates the facial area by inputting the facial video into a Haar cascade classifier, locates the eye area using a facial key point detection model, and calculates the aspect ratio of the eye area. When the eyes are closed, the aspect ratio decreases; The eye closure duration ratio is calculated by selecting a fixed time window and accumulating the number of frames of eye closure. The mathematical expression of the eye closure duration ratio is: in, is the ratio of eye closure time, is the accumulated number of closed frames, is the total number of frames, and outputs the eye closure duration ratio signal; The total number of facial video frames in the time window and the number of frames with closed eyes in the same time window are counted. The mathematical expression of eye closure frequency is: in, is the eye closure frequency, Outputs the eye closure frequency signal as the number of closed frames.

4. The seat belt warning system based on driver status as claimed in claim 3, characterized in that: The state threshold of the comparison and assignment unit is: Eye closure duration ratio threshold: Good spirits: the proportion of eyes closed time < the first proportion threshold; Slight fatigue: the first ratio threshold ≤ the ratio of eye closure time < the second ratio threshold; Moderate fatigue: the second ratio threshold ≤ the ratio of eye closure time < the third ratio threshold; Severe fatigue: the proportion of eye closure time ≥ the third proportion threshold; Eye Closure Frequency Signal Threshold: Good spirits: eye closure frequency < first frequency threshold; Slight fatigue: first frequency threshold ≤ eye closure frequency < second frequency threshold; Moderate fatigue: the second frequency threshold ≤ eye closure frequency < the third frequency threshold; Severe fatigue: eye closure frequency ≥ the third frequency threshold; Heart rate signal threshold: Good spirits: the first heart rate threshold ≤ heart rate < the second heart rate threshold, heart rate variability > the first heart rate variability threshold; Slight fatigue: the second heart rate threshold ≤ heart rate < the third heart rate threshold, the second heart rate variability threshold < heart rate variability ≤ the first heart rate variability threshold; Moderate fatigue: the third heart rate threshold ≤ heart rate < the fourth heart rate threshold, the third heart rate variability threshold < heart rate variability ≤ the second heart rate variability threshold; Severe fatigue: heart rate ≥ the fourth heart rate threshold, heart rate variability ≤ the third heart rate variability threshold; Skin temperature signal: Good spirits: no significant change from the preset baseline temperature; Mild fatigue: skin temperature rises or falls within the first temperature relative to the baseline temperature; Moderate fatigue: skin temperature increases or decreases from baseline temperature by 1st temperature - 2nd temperature; Severe fatigue: skin temperature increases or decreases by more than a second temperature relative to baseline temperature; The value corresponding to each state is: Good spirits were scored as 1, mild fatigue was scored as 2, moderate fatigue was scored as 3, and severe fatigue was scored as 4.

5. The seat belt warning system based on driver status as claimed in claim 4, characterized in that: The total state score threshold in the fatigue analysis unit is: Good spirits: total state score is 1.0-1.9; Slight fatigue: total state score is 2.0-2.4; Moderate fatigue: total state score is 2.5-3.0; Severe fatigue: total state score is 3.1-4.0; Find the corresponding state according to the total state score and output it as the fatigue state analysis result.

6. The seat belt warning system based on driver status as claimed in claim 5, characterized in that: The physiological analysis unit analyzes the driver's physiological state according to the heart rate signal threshold in the state threshold of the comparison assignment unit. If the heart rate ≥ the fourth heart rate threshold and the heart rate variability ≤ the third heart rate variability threshold, the output is a physiological state abnormal signal. If the first heart rate threshold ≤ heart rate < the fourth heart rate threshold and the heart rate variability > the third heart rate variability threshold, the output is a physiological state normal signal. The physiological state analysis result includes a physiological state abnormal signal and a physiological state normal signal.

7. The seat belt warning system based on driver status as claimed in claim 6, characterized in that: The state confirmation unit sends a signal output type reminder and collects signal output types, wherein the signal output type includes a vibration signal or a tightening signal. A corresponding search is performed according to the input fatigue state analysis result and the physiological state analysis result and the corresponding relationship between the preset control intensity. If the physiological state analysis result is an abnormal physiological state signal, a progressive vibration signal or a progressive tightening signal is output. If the fatigue state analysis result is a good spirit and the physiological state analysis result is a normal physiological state signal, no control intensity signal is output. If the fatigue state analysis result is slight fatigue and the physiological state analysis result is a normal physiological state signal, a slight vibration signal or a slight tightening signal is output. If the fatigue state analysis result is moderate fatigue and the physiological state analysis result is a normal physiological state signal, a moderate vibration signal or a moderate tightening signal is output. If the fatigue state analysis result is severe fatigue and the physiological state analysis result is a normal physiological state signal, a severe vibration signal or a severe tightening signal is output. The control intensity correspondence relationship is: The corresponding vibration frequency of the progressive vibration signal includes three vibration stages, each vibration stage lasts for 20 seconds, and the three vibration stages include: Initial stage: the vibration frequency is the initial vibration frequency, and the acceleration intensity of the vibration force is the initial acceleration intensity; Intermediate stage: the vibration frequency is the intermediate vibration frequency, and the acceleration intensity of the vibration force is the intermediate acceleration intensity; Final stage: the vibration frequency is the final vibration frequency, and the acceleration intensity of the vibration force is the final acceleration intensity; The initial vibration frequency is less than the intermediate vibration frequency and less than the final vibration frequency, and the initial acceleration intensity is less than the intermediate acceleration intensity and less than the final acceleration intensity; The corresponding vibration frequency of the progressive tightening signal includes three tightening stages, each tightening stage lasts for 20 seconds, and the three tightening stages include: Initial stage: the tightening force is the initial tightening force value; Intermediate stage: the tightening force is the intermediate tightening force value; Final stage: the tightening force is the final tightening force value; The initial tightening force value < the intermediate tightening force value < the final tightening force value; The vibration frequency corresponding to the mild vibration signal is the first vibration frequency, and the acceleration intensity of the vibration intensity is the first acceleration intensity; The vibration frequency corresponding to the moderate vibration signal is the second vibration frequency, and the acceleration intensity of the vibration intensity is the second acceleration intensity; The vibration frequency corresponding to the severe vibration signal is the third vibration frequency, and the acceleration intensity of the vibration intensity is the third acceleration intensity; The first vibration frequency is less than the second vibration frequency and less than the third vibration frequency, and the first acceleration intensity is less than the second acceleration intensity and less than the third acceleration intensity; The tightening intensity corresponding to the light tightening signal is the first intensity value; The tightening intensity corresponding to the moderate tightening signal is the second intensity value; The tightening intensity corresponding to the severe tightening signal is the third intensity value; The first force value < the second force value < the third force value; The control time of the reminder control unit is 1 minute. If the driver triggers the stop signal, the control will be stopped. If the driver does not trigger the stop signal within 1 minute, the control will continue until the end of 1 minute.

Images