Intelligent driving detection method and system based on automobile data recorder
Through an intelligent detection system based on dash recorder, driver, vehicle and road conditions information can be collected and analyzed in real time, and comprehensive safety indexes have been generated, which has solved the shortcomings of driver fatigue detection, vehicle safety monitoring and road conditions in the existing technology, and has achieved many The driving safety assessment and real-time early warning significantly reduce the risk of traffic accidents.
Patent Information
- Application Number
- CN202411194347.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-29
- Publication Date
- 2024-12-06
AI Technical Summary
The existing driving recorders have shortcomings in driver fatigue detection, vehicle driving safety monitoring and road conditions analysis. They rely on simple time calculations or external sensors and lack comprehensive analysis in multiple aspects.
Design an intelligent detection system based on driving recorder, including data acquisition module, data preprocessing module, driving analysis module and real-time feedback module, and collect driver status, vehicle driving status and road conditions information in real time through multiple camera modules and sensors. , calculate the driver's fatigue index, vehicle driving safety index and road condition complex index, and generate a comprehensive safety index for evaluation and feedback.
It has realized a multi-faceted analysis of driver fatigue, vehicle driving status and road conditions, provided real-time early warning, reduced traffic accident risks, and improved driving safety.
Smart Images

Figure CN119091525A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of vehicle driving detection, and in particular to an intelligent vehicle driving detection method and system based on a vehicle driving recorder. Background Art
[0002] In the modern traffic environment, driving safety has become an important issue of global concern. With the increase in the number of vehicles and the complexity of road traffic, how to ensure driving safety has become an important issue. Traditional driving safety methods mainly rely on the driver's experience and reaction ability, but with the development of technology, intelligent detection systems have gradually become an important means to improve driving safety. These systems can provide early warning and intervention in the first time by comprehensively analyzing the driver's status, vehicle driving conditions and road conditions, thereby reducing the occurrence of traffic accidents. In this field, driving recorders, as a common device, can record images and data during driving, playing a more effective role in driving safety monitoring.
[0003] However, current driving recorders still have some shortcomings in these aspects; for example, traditional driver fatigue detection methods may rely on simple time calculations, ignoring the driver's actual state; vehicle driving safety monitoring is often limited to vehicle speed detection, lacking a comprehensive analysis of the driving state; and driving road condition monitoring relies more on external sensors. Summary of the invention
[0004] In view of the deficiencies in the prior art, the present invention provides a driving intelligent detection method and system based on a driving recorder, which solves the problems in the above-mentioned background technology.
[0005] To achieve the above objectives, the present invention is implemented through the following technical solutions: a driving intelligent detection system based on a driving recorder, including a data acquisition module, a data preprocessing module, a driving analysis module, a comprehensive evaluation module and a real-time feedback module;
[0006] The data acquisition module is used to collect the driver's state information, vehicle driving state information and driving road condition information in real time during driving through multiple camera modules and sensors on the driving recorder, and to establish a driver state data set, a vehicle driving state data set and a driving road condition data set;
[0007] The data preprocessing module is used to clean the driver status data set, the vehicle driving status data set and the driving road condition data set to remove noise and invalid data;
[0008] The driving analysis module is used to analyze the driver status data set, the vehicle driving status data set and the driving road condition data set to obtain the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq;
[0009] The comprehensive evaluation module is used to associate the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq, output the driving comprehensive safety index Za, and compare and analyze it with the preset comprehensive evaluation threshold S to obtain feedback results to comprehensively determine the overall safety evaluation of the driving state;
[0010] The real-time feedback module is used to receive feedback results and execute corresponding prompts.
[0011] Preferably, the data acquisition module includes a driver face acquisition unit, a vehicle driving state acquisition unit and a driving environment acquisition unit;
[0012] The driver face acquisition unit is used to collect the driver's facial behavior feature information through the camera module on the driving recorder as a driver state data set, wherein the driver state data set includes the eye closure time Tec, the head down time Thd and the number of yawns Nys in each detection time period;
[0013] The vehicle driving state acquisition unit is used to collect the vehicle driving state information as a vehicle driving state data set through the camera module, acceleration sensor, speed sensor, gyroscope and lane line recognition sensor on the driving recorder, wherein the vehicle driving state data set includes the driving speed Vt, acceleration At and lane departure angle Ld in each detection time period;
[0014] The driving environment acquisition unit is used to collect the road condition information in front of the vehicle through the camera module and the road inclination sensor on the driving recorder to obtain the driving road condition information as a driving road condition data set, wherein the driving road condition data set includes the number of curve driving times Dkj, road vehicle flow Dcl and road slope Ggd in each detection time period.
[0015] Preferably, the driving analysis module includes a driver fatigue analysis unit, a vehicle driving state analysis unit and a driving road condition safety analysis unit;
[0016] The driver fatigue analysis unit includes a fatigue analysis unit and an early warning unit. The fatigue analysis unit is used to analyze the driver fatigue corresponding to the driver status data set during driving to obtain the driver fatigue index Zpl during driving. The driver fatigue index Zpl is obtained by the following formula:
[0017]
[0018] In the formula, Tec i Expressed as the eye closure duration in the i-th monitoring period, Thd iIt is expressed as the head-down time in the i-th monitoring period, Nys i It is represented by the number of yawns in the i-th monitoring period, i=1, 2, 3, ..., n, n is the detection period, α1, α2 and α3 are all represented by preset proportional coefficients, and α1+α2+α3=1.0, and R is represented by the first correction constant.
[0019] Preferably, the warning unit is used to compare and analyze the driver fatigue index Zpl with a preset fatigue threshold to determine whether the driver's driving state is currently in fatigue driving. The specific contents are as follows:
[0020] If the driver fatigue index Zpl is greater than or equal to the fatigue threshold, that is, Zpl≥fatigue threshold, a first feedback result is obtained, indicating that the driver's driving state is currently in fatigue driving, and the first feedback result is sent to the real-time feedback module;
[0021] If the driver fatigue index Zpl is less than the first fatigue threshold, that is, Zpl<fatigue threshold, it means that the driver's driving state is currently in a non-fatigue driving state, and there is no need to send a feedback signal to the real-time feedback module.
[0022] Preferably, the vehicle driving state analysis unit is used to analyze the vehicle driving state corresponding to the vehicle driving state data set during driving to obtain the vehicle driving safety index Zxt during driving, and the vehicle driving safety index Zxt is obtained by the following formula:
[0023]
[0024] Where Vt i Expressed as the driving speed in the ith monitoring period, Vt Max Indicates the maximum speed limit of the road, At i Expressed as the acceleration in the ith monitoring period, At Max Indicates the maximum acceleration that the vehicle power can provide, Ld i It is expressed as the lane departure angle in the i-th monitoring period, Ld Max It represents the preset maximum lane departure angle, i=1, 2, 3, ..., n, n represents the detection period, β1, β2 and β3 all represent preset proportional coefficients, and β1+β2+β3=1.0, and Z represents the second correction constant.
[0025] Preferably, the driving road condition safety analysis unit is used to analyze the driving road condition safety corresponding to the driving road condition data set during driving to obtain the driving road condition complexity index Zaq during driving, and the driving road condition complexity index Zaq is obtained by the following formula:
[0026]
[0027] Where Dkj i It is expressed as the number of curve driving in the i-th monitoring period, Dcl i Expressed as the road vehicle flow rate during the i-th monitoring period, Ggd i It is represented by the road slope in the i-th monitoring period, i=1, 2, 3, ..., n, n is the detection period, ω1, ω2 and ω3 are all represented by preset proportional coefficients, and ω1+ω2+ω3=1.0, and P is represented by the third correction constant.
[0028] Preferably, the comprehensive evaluation module includes a driving safety comprehensive analysis unit and a driving detection unit; the driving safety comprehensive analysis unit is used to obtain a driving comprehensive safety index Za by correlating the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq, and after dimensionless processing, the driving comprehensive safety index Za is obtained by the following formula:
[0029]
[0030] Wherein, λ1, λ2 and λ3 represent the preset proportional coefficients of the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq respectively.
[0031] Preferably, the driving detection unit is used to compare and analyze the driving comprehensive safety index Za with the comprehensive evaluation threshold S to comprehensively determine the overall safety evaluation of the driving state, the comprehensive evaluation threshold S includes a first evaluation threshold S1 and a second evaluation threshold S2> the first evaluation threshold S1, and the driving comprehensive safety index Za is compared to obtain an evaluation result, including:
[0032] When the comprehensive safety index Za> the second evaluation threshold S2, it means that the overall safety of the detected driving state is safe;
[0033] When the first evaluation threshold S1≤comprehensive safety index Za≤second evaluation threshold S2, it indicates that the overall safety of the detected driving state is abnormal, and the second feedback result is obtained and sent to the real-time feedback module;
[0034] When the comprehensive safety index Za is less than the first evaluation threshold S1, it indicates that the overall safety of the detected driving state is abnormal, and the third feedback result is obtained and sent to the real-time feedback module.
[0035] Preferably, the real-time feedback module is used to receive the first feedback result, the second feedback result and the third feedback result, and execute corresponding prompts, the specific contents are as follows:
[0036] If you receive the first feedback result, the prompt will be: "You are driving fatigued. For the safety of you and others, please take a rest."
[0037] If the second feedback result is received, the prompt is that an abnormality is detected in the driving state of your vehicle, please drive carefully; at the same time, an orange warning notification is displayed on the display panel in the vehicle;
[0038] If you receive the third feedback result, the prompt is that your vehicle's driving status is detected to be abnormal, please slow down immediately and keep the lane, reconfirm the driving status, and pay attention to driving safety; at the same time, a red warning notification will be displayed on the display panel in the vehicle, and the vehicle's emergency double flash lights will be turned on;
[0039] If no feedback signal is received, no prompt will be issued at this time.
[0040] A driving intelligent detection method based on a driving recorder comprises the following steps:
[0041] Step 1: First, through multiple camera modules and sensors on the driving recorder, the driver's state information, vehicle driving state information and driving road condition information are collected in real time during driving, and a driver state data set, a vehicle driving state data set and a driving road condition data set are established;
[0042] Step 2: Next, the driver status data set, vehicle driving status data set and driving road condition data set are cleaned to remove noise and invalid data;
[0043] Step 3: Then analyze the driver status data set, the vehicle driving status data set and the driving road condition data set to obtain the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq;
[0044] Step 4: Correlate the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq, output the driving comprehensive safety index Za, and compare and analyze it with the preset comprehensive evaluation threshold S to obtain feedback results to comprehensively determine the overall safety evaluation of the driving state;
[0045] Step 5: Finally, the real-time feedback module receives the feedback result and executes the corresponding prompt.
[0046] The present invention provides a driving intelligent detection method and system based on a driving recorder, which has the following beneficial effects:
[0047] (1) Using multiple camera modules and sensors on the driving recorder, the driver status information, vehicle driving status information and driving road condition information are collected in real time, and the driver status data set, vehicle driving status data set and driving road condition data set are established. This process paves the way for the subsequent analysis of the driving status. According to the driver's driving status, a preliminary analysis is made to determine whether there is any abnormality in the current driver's attention, and corresponding prompts are issued for further analysis. Through the driving status of the vehicle and the complexity of the road conditions, the safety status of the vehicle is comprehensively analyzed. In short, the system conducts multi-faceted analysis of the driving status through preliminary analysis and in-depth analysis, further reducing the possibility of accident risks.
[0048] (2) By correlating the driver fatigue index, vehicle driving safety index and road condition complexity index, a comprehensive driving safety index is generated and compared with the preset threshold value for analysis. This comprehensive evaluation method can not only comprehensively and accurately reflect the driving safety status, but also provide a multi-level risk rating to better understand the driving safety status.
[0049] (3) Through the real-time feedback module, the driver can obtain timely prompts about his or her own fatigue status, vehicle driving status and road condition complexity during driving; this real-time warning function can effectively reduce traffic accidents caused by fatigue driving, vehicle abnormalities or complex road conditions, and improve overall driving safety. BRIEF DESCRIPTION OF THE DRAWINGS
[0050] Figure 1 A block diagram of an intelligent vehicle driving detection system based on a vehicle driving recorder according to the present invention;
[0051] Figure 2 The present invention is a schematic diagram of the steps of an intelligent driving detection method based on a driving recorder. DETAILED DESCRIPTION
[0052] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0053] Example 1
[0054] See also Figure 1 , the present invention provides a driving intelligent detection system based on a driving recorder, including a data acquisition module, a data preprocessing module, a driving analysis module, a comprehensive evaluation module and a real-time feedback module;
[0055] The data acquisition module is used to collect the driver's state information, vehicle driving state information and driving road condition information in real time during driving through multiple camera modules and sensors on the driving recorder, and to establish a driver state data set, a vehicle driving state data set and a driving road condition data set;
[0056] The data preprocessing module is used to clean the driver status data set, the vehicle driving status data set and the driving road condition data set to remove noise and invalid data;
[0057] The driving analysis module is used to analyze the driver status data set, the vehicle driving status data set and the driving road condition data set to obtain the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq;
[0058] The comprehensive evaluation module is used to associate the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq, output the driving comprehensive safety index Za, and compare and analyze it with the preset comprehensive evaluation threshold S to obtain feedback results to comprehensively determine the overall safety evaluation of the driving state;
[0059] The real-time feedback module is used to receive feedback results and execute corresponding prompts.
[0060] During the operation of this system, the data acquisition module collects driver status information, vehicle driving status information and driving road condition information in real time through multiple camera modules and sensors on the driving recorder, and establishes corresponding data sets; the data preprocessing module cleans these data, removes noise and invalid data, and parses them into a processable format to ensure the accuracy and availability of the data; the driving analysis module analyzes the preprocessed data, calculates the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq, and the comprehensive evaluation module comprehensively associates the various indexes, outputs the driving comprehensive safety index Za, and compares and analyzes it with the preset comprehensive evaluation threshold S to obtain feedback results and comprehensively evaluate the overall safety of the driving status; the real-time feedback module compares and analyzes these indexes with the preset thresholds, generates corresponding alarms and feedback information, and provides prompts to the driver in real time, thereby improving the driver's reaction ability and driving safety; this systematic process effectively improves the accuracy, timeliness and comprehensiveness of driving safety monitoring, and significantly reduces the risk of traffic accidents.
[0061] Example 2
[0062] See also Figure 1 ,Specifically: the data acquisition module includes a driver face acquisition unit, a vehicle driving state acquisition unit and a driving environment acquisition unit;
[0063] The driver face acquisition unit is used to collect the driver's facial behavior feature information through the camera module on the driving recorder as a driver state data set, wherein the driver state data set includes the eye closure time Tec, the head down time Thd and the number of yawns Nys in each detection time period;
[0064] The vehicle driving state acquisition unit is used to collect the vehicle driving state information as a vehicle driving state data set through the camera module, acceleration sensor, speed sensor, gyroscope and lane line recognition sensor on the driving recorder, wherein the vehicle driving state data set includes the driving speed Vt, acceleration At and lane departure angle Ld in each detection time period;
[0065] The driving environment acquisition unit is used to collect the road condition information in front of the vehicle through the camera module and the road inclination sensor on the driving recorder to obtain the driving road condition information as a driving road condition data set, wherein the driving road condition data set includes the number of curve driving times Dkj, road vehicle flow Dcl and road slope Ggd in each detection time period.
[0066] In this embodiment, the driver face acquisition unit, the vehicle driving state acquisition unit and the driving environment acquisition unit of the data acquisition module are used; the driver face acquisition unit can instantly capture the driver's facial behavior characteristics through the camera module on the driving recorder. These data not only help to judge the driver's concentration level, but also provide data parameter basis when judging the driver's fatigue or distraction; the vehicle driving state acquisition unit uses a variety of sensors, including acceleration sensors, speed sensors and gyroscopes, etc., to comprehensively monitor the real-time driving status of the vehicle; these data not only include basic driving speed and acceleration information, but also can accurately detect whether the vehicle deviates from the lane, thereby improving driving safety and stability; the driving environment acquisition unit collects road condition data through camera modules and road inclination sensors. These data provide real-time data parameters, realize comprehensive acquisition and precise analysis and optimization management of multi-source data, and improve the reliability and authenticity of the overall driving detection data parameters.
[0067] Example 3
[0068] See also Figure 1 , specifically: the driving analysis module includes a driver fatigue analysis unit, a vehicle driving state analysis unit and a driving road condition safety analysis unit;
[0069] The driver fatigue analysis unit includes a fatigue analysis unit and an early warning unit. The fatigue analysis unit is used to analyze the driver fatigue corresponding to the driver status data set during driving to obtain the driver fatigue index Zpl during driving. The driver fatigue index Zpl is obtained by the following formula:
[0070]
[0071] In the formula, Tec i Expressed as the eye closure duration in the i-th monitoring period, Thd i It is expressed as the head-down time in the i-th monitoring period, Nys i It is represented by the number of yawns in the i-th monitoring period, i=1, 2, 3, ..., n, n is the detection period, α1, α2 and α3 are all represented by preset proportional coefficients, and α1+α2+α3=1.0, and R is represented by the first correction constant.
[0072] Specifically, the warning unit is used to compare and analyze the driver's fatigue index Zpl with a preset fatigue threshold to determine whether the driver's driving state is currently fatigue driving. The specific contents are as follows:
[0073] If the driver fatigue index Zpl is greater than or equal to the fatigue threshold, that is, Zpl≥fatigue threshold, a first feedback result is obtained, indicating that the driver's driving state is currently in fatigue driving, and the first feedback result is sent to the real-time feedback module;
[0074] If the driver fatigue index Zpl is less than the first fatigue threshold, that is, Zpl<fatigue threshold, it means that the driver's driving state is currently in a non-fatigue driving state, and there is no need to send a feedback signal to the real-time feedback module.
[0075] In this embodiment, the driver fatigue analysis unit uses the eye closure time, head bowing time and yawning times in the driver status data set to calculate the driver fatigue index Zpl through a specific formula; the driver fatigue index Zpl reflects the driver's fatigue level during driving, and through detection and analysis, it can provide an accurate assessment of the driver's fatigue state; the early warning unit compares and analyzes the calculated driver fatigue index Zpl with a preset fatigue threshold; when the fatigue index exceeds the threshold, the system sends a first feedback result to the real-time feedback module, prompting the driver that the driver may be in a fatigue driving state, which helps to remind the driver to take necessary rest or adjustments; this real-time fatigue state monitoring and early warning mechanism significantly improves driving safety, effectively reduces the risk of traffic accidents caused by fatigue driving, thereby ensuring the safety of the driver and the vehicle.
[0076] Example 4
[0077] See also Figure 1Specifically: the vehicle driving state analysis unit is used to analyze the vehicle driving state corresponding to the vehicle driving state data set during driving to obtain the vehicle driving safety index Zxt during driving. The vehicle driving safety index Zxt is obtained by the following formula:
[0078]
[0079] Where Vt i Expressed as the driving speed in the ith monitoring period, Vt Max Indicates the maximum speed limit of the road, At i Expressed as the acceleration in the ith monitoring period, At Max Indicates the maximum acceleration that the vehicle power can provide, Ld i It is expressed as the lane departure angle in the i-th monitoring period, Ld Max It represents the preset maximum lane departure angle, i=1, 2, 3, ..., n, n represents the detection period, β1, β2 and β3 all represent preset proportional coefficients, and β1+β2+β3=1.0, and Z represents the second correction constant.
[0080] The driving speed Vt is obtained by the speed sensor, specifically the actual driving speed of the vehicle within the detection period (usually every second or shorter time interval), in kilometers per hour (km / h);
[0081] Maximum speed limit Vt Max The maximum speed limit allowed on the road you are traveling on, in kilometers per hour (km / h), according to the speed limit signs set by the road traffic management department or obtained through map data;
[0082] The acceleration At is obtained by the acceleration sensor to measure the acceleration or deceleration of the vehicle in a specific time, specifically the rate of change of the vehicle speed, in meters per second squared (m / s 2 ) units;
[0083] Maximum acceleration At Max The maximum acceleration capability of a vehicle's engine and transmission system, measured in meters per second squared (m / s 2 ) units;
[0084] The lane departure angle Ld is obtained by a gyroscope or camera system, specifically the angle formed by the vehicle's centerline and the road centerline;
[0085] Preset maximum lane departure angle Ld Max Based on the maximum angle formed by the vehicle's center axis and the road center line within the preset safety range.
[0086] The driving road condition safety analysis unit is used to analyze the driving road condition safety corresponding to the driving road condition data set during driving to obtain the driving road condition complexity index Zaq during driving. The driving road condition complexity index Zaq is obtained by the following formula:
[0087]
[0088] Where Dkj i It is expressed as the number of curve driving in the i-th monitoring period, Dcl i Expressed as the road vehicle flow rate during the i-th monitoring period, Ggd i It is represented by the road slope in the i-th monitoring period, i=1, 2, 3, ..., n, n is the detection period, ω1, ω2 and ω3 are all represented by preset proportional coefficients, and ω1+ω2+ω3=1.0, and P is represented by the third correction constant.
[0089] The number of curves Dkj is obtained through an inertial sensor or a GPS system. The inertial sensor can detect the steering action of the vehicle, and the GPS system can record the movement path of the vehicle on the curve, specifically the number of times the vehicle passes through the curve or the number of curves within a detection period (usually one second or shorter time interval);
[0090] The road vehicle flow Dcl is obtained through the camera, which can detect the density or flow of vehicles on the road, specifically the number of vehicles or traffic flow passing through the road ahead within the detection period, and identify the congestion ahead;
[0091] The road slope Ggd is obtained by a tilt sensor, which can measure the tilt angle of the vehicle relative to the horizontal plane, specifically the slope of the road on which the vehicle is traveling, expressed in degrees or percentage.
[0092] In this embodiment, the driving recorder can not only monitor the driving state of the vehicle and the changes in the surrounding environment in real time, but also comprehensively use the vehicle driving state analysis unit and the driving road condition safety analysis unit to perform in-depth analysis and evaluation of the data through an algorithm formula, and calculate and analyze the vehicle driving state analysis unit and the driving road condition safety analysis unit in combination with the data collected by the driving recorder, and the obtained vehicle driving safety index Zxt and driving road condition complexity index Zaq provide a comprehensive evaluation and analysis of the safety during driving; the vehicle driving safety index Zxt and the driving road condition complexity index Zaq reflect the complexity of the road and the challenging driving environment. According to the vehicle driving safety index Zxt and the driving road condition complexity index Zaq, the system can predict and identify potential driving safety hazards, and make road condition adaptation and response measures in advance, thereby effectively reducing the risk of accidents; this intelligent safety analysis system significantly improves driving safety and driving efficiency, provides drivers with reliable safety protection and auxiliary decision-making, and makes the driving process safer and controllable.
[0093] Example 5
[0094] See also Figure 1 Specifically, the comprehensive evaluation module includes a driving safety comprehensive analysis unit and a driving detection unit; the driving safety comprehensive analysis unit is used to obtain the driving comprehensive safety index Za by correlating the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq, and after dimensionless processing, the driving comprehensive safety index Za is obtained by the following formula:
[0095]
[0096] Wherein, λ1, λ2 and λ3 represent the preset proportional coefficients of the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq respectively.
[0097] It should be noted that the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq are dimensionlessly processed by making a dimensional comparison between the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq to determine whether the dimensional relationship is a physical quantity of the same dimension or a physical quantity of different dimensions, that is, having the same basic unit or different basic units, and using the dimensional relationship, each physical quantity is dimensionless, that is, it is expressed as a unitless ratio or a unitless value.
[0098] Specifically, the driving detection unit is used to compare and analyze the driving comprehensive safety index Za with the comprehensive evaluation threshold S to comprehensively determine the overall safety evaluation of the driving state, the comprehensive evaluation threshold S includes a first evaluation threshold S1 and a second evaluation threshold S2> the first evaluation threshold S1, and the driving comprehensive safety index Za is compared to obtain an evaluation result, including:
[0099] When the comprehensive safety index Za> the second evaluation threshold S2, it means that the overall safety of the detected driving state is safe;
[0100] When the first evaluation threshold S1≤comprehensive safety index Za≤second evaluation threshold S2, it indicates that the overall safety of the detected driving state is abnormal, and the second feedback result is obtained and sent to the real-time feedback module;
[0101] When the comprehensive safety index Za is less than the first evaluation threshold S1, it indicates that the overall safety of the detected driving state is abnormal, and the third feedback result is obtained and sent to the real-time feedback module.
[0102] In this embodiment, the comprehensive evaluation module realizes a comprehensive evaluation and effective early warning of the driving status by combining the comprehensive driving safety analysis unit and the driving detection unit; the comprehensive driving safety analysis unit performs dimensionless processing on the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq, and comprehensively calculates the comprehensive driving safety index Za, thereby providing a comprehensive and accurate driving safety evaluation; the driving detection unit compares and analyzes the comprehensive driving safety index Za with the comprehensive evaluation threshold S, and can determine the overall safety of the driving status in real time; when the comprehensive safety index Za is greater than the second evaluation threshold S2, the system considers that the driving status is safe, and when the comprehensive safety index Za is between the two thresholds, the system detects that there is an abnormality and issues an orange warning; when the comprehensive safety index Za is less than the first evaluation threshold S1, the system detects that it is abnormal and immediately issues a red warning to remind the driver to pay attention to safety; this multi-level safety evaluation and early warning mechanism significantly improves driving safety and reduces the risk of accidents.
[0103] Example 6
[0104] See also Figure 1 Specifically: the real-time feedback module is used to receive the first feedback result, the second feedback result and the third feedback result, and execute corresponding prompts, the specific contents are as follows:
[0105] If you receive the first feedback result, the prompt will be: "You are driving fatigued. For the safety of you and others, please take a rest."
[0106] If the second feedback result is received, the prompt is that an abnormality is detected in the driving state of your vehicle, please drive carefully; at the same time, an orange warning notification is displayed on the display panel in the vehicle;
[0107] If you receive the third feedback result, the prompt is that your vehicle's driving status is detected to be abnormal, please slow down immediately and keep the lane, reconfirm the driving status, and pay attention to driving safety; at the same time, a red warning notification will be displayed on the display panel in the vehicle, and the vehicle's emergency double flash lights will be turned on;
[0108] If no feedback signal is received, no prompt or notification will be issued.
[0109] In this embodiment, the real-time feedback module receives the first, second and third feedback results and executes corresponding prompts, thereby realizing timely and effective driving safety reminders; when the first feedback result is received, the prompt content is that it is detected that you are driving while fatigued. For the safety of you and others, please take a break to prevent accidents caused by fatigue driving; when the second feedback result is received, the prompt content is that it is detected that your vehicle's driving state is abnormal. Please drive carefully; at the same time, an orange warning notification is presented on the display panel in the vehicle to help prevent potential dangers; when the third feedback result is received, the prompt content is that it is detected that your vehicle's driving state is abnormal. Please immediately slow down and keep in the lane, reconfirm the driving state, and pay attention to driving safety; at the same time, a red warning notification is presented on the display panel in the vehicle, the vehicle's emergency double flash lights are turned on, and timely measures are taken to avoid danger; this multi-level prompt mechanism ensures that drivers can receive timely and accurate safety reminders in different risk situations.
[0110] Example 7
[0111] See also Figure 1 and Figure 2 Specifically: A driving intelligent detection method based on a driving recorder comprises the following steps:
[0112] Step 1: First, through multiple camera modules and sensors on the driving recorder, the driver's state information, vehicle driving state information and driving road condition information are collected in real time during driving, and a driver state data set, a vehicle driving state data set and a driving road condition data set are established;
[0113] Step 2: Next, the driver status data set, vehicle driving status data set and driving road condition data set are cleaned to remove noise and invalid data;
[0114] Step 3: Then analyze the driver status data set, the vehicle driving status data set and the driving road condition data set to obtain the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq;
[0115] Step 4: Correlate the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq, output the driving comprehensive safety index Za, and compare and analyze it with the preset comprehensive evaluation threshold S to obtain feedback results to comprehensively determine the overall safety evaluation of the driving state;
[0116] Step 5: Finally, the real-time feedback module receives the feedback result and executes the corresponding prompt.
[0117] In this embodiment, multiple camera modules and sensors are used to collect multi-dimensional data in real time to establish a data set, thereby ensuring the comprehensiveness and accuracy of the data; the data is cleaned and analyzed to remove noise and invalid data, thereby ensuring the efficiency and accuracy of data processing; by analyzing the data set, the driver fatigue index, vehicle driving safety index and driving road condition complexity index are obtained, providing key indicators for subsequent evaluation; the various indexes are associated, the comprehensive driving safety index is output, and a comparative analysis is performed to generate feedback results, providing a comprehensive safety evaluation; the real-time feedback module ensures that the driver can receive safety reminders in a timely manner in different risk situations, thereby effectively improving driving safety.
[0118] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.
Claims
1. A driving intelligent detection system based on a driving recorder, characterized in that: It includes data acquisition module, data preprocessing module, driving analysis module, comprehensive evaluation module and real-time feedback module; The data acquisition module is used to collect the driver's state information, vehicle driving state information and driving road condition information in real time during driving through multiple camera modules and sensors on the driving recorder, and to establish a driver state data set, a vehicle driving state data set and a driving road condition data set; The data preprocessing module is used to clean the driver status data set, the vehicle driving status data set and the driving road condition data set to remove noise and invalid data; The driving analysis module is used to analyze the driver status data set, the vehicle driving status data set and the driving road condition data set to obtain the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq; The comprehensive evaluation module is used to associate the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq, output the driving comprehensive safety index Za, and compare and analyze it with the preset comprehensive evaluation threshold S to obtain feedback results to comprehensively determine the overall safety evaluation of the driving state; The real-time feedback module is used to receive feedback results and execute corresponding prompts.
2. The intelligent driving detection system based on a driving recorder according to claim 1, characterized in that: The data acquisition module includes a driver face acquisition unit, a vehicle driving state acquisition unit and a driving environment acquisition unit; The driver face acquisition unit is used to collect the driver's facial behavior feature information through the camera module on the driving recorder as a driver state data set, wherein the driver state data set includes the eye closure time Tec, the head down time Thd and the number of yawns Nys in each detection time period; The vehicle driving state acquisition unit is used to collect the vehicle driving state information as a vehicle driving state data set through the camera module, acceleration sensor, speed sensor, gyroscope and lane line recognition sensor on the driving recorder, wherein the vehicle driving state data set includes the driving speed Vt, acceleration At and lane departure angle Ld in each detection time period; The driving environment acquisition unit is used to collect the road condition information in front of the vehicle through the camera module and the road inclination sensor on the driving recorder to obtain the driving road condition information as a driving road condition data set, wherein the driving road condition data set includes the number of curve driving times Dkj, road vehicle flow Dcl and road slope Ggd in each detection time period.
3. The intelligent driving detection system based on a driving recorder according to claim 2 is characterized in that: The driving analysis module includes a driver fatigue analysis unit, a vehicle driving state analysis unit and a driving road condition safety analysis unit; The driver fatigue analysis unit includes a fatigue analysis unit and an early warning unit. The fatigue analysis unit is used to analyze the driver fatigue corresponding to the driver status data set during driving to obtain the driver fatigue index Zpl during driving. The driver fatigue index Zpl is obtained by the following formula: In the formula, Tec i It is expressed as the eye closure duration in the i-th monitoring period, Thd i It is expressed as the head-down time in the i-th monitoring period, Nys i It is represented by the number of yawns in the i-th monitoring period, i=1, 2, 3, ..., n, n is the detection period, α1, α2 and α3 are all represented by preset proportional coefficients, and α1+α2+α3=1.0, and R is represented by the first correction constant.
4. The intelligent driving detection system based on a driving recorder according to claim 3 is characterized in that: The warning unit is used to compare and analyze the driver's fatigue index Zpl with a preset fatigue threshold to determine whether the driver's driving state is currently fatigue driving. The specific contents are as follows: If the driver fatigue index Zpl is greater than or equal to the fatigue threshold, that is, Zpl≥fatigue threshold, a first feedback result is obtained, indicating that the driver's driving state is currently in fatigue driving, and the first feedback result is sent to the real-time feedback module; If the driver fatigue index Zpl is less than the first fatigue threshold, that is, Zpl<fatigue threshold, it means that the driver's driving state is currently in a non-fatigue driving state, and there is no need to send a feedback signal to the real-time feedback module.
5. The intelligent driving detection system based on a driving recorder according to claim 3 is characterized in that: The vehicle driving state analysis unit is used to analyze the vehicle driving state corresponding to the vehicle driving state data set during driving to obtain the vehicle driving safety index Zxt during driving. The vehicle driving safety index Zxt is obtained by the following formula: Where Vt i Expressed as the driving speed in the ith monitoring period, Vt Max Indicates the maximum speed limit of the road, At i Expressed as the acceleration in the ith monitoring period, At Max Indicates the maximum acceleration that the vehicle power can provide, Ld i It is expressed as the lane departure angle in the i-th monitoring period, Ld Max It represents the preset maximum lane departure angle, i=1, 2, 3, ..., n, n represents the detection period, β1, β2 and β3 all represent preset proportional coefficients, and β1+β2+β3=1.0, and Z represents the second correction constant.
6. The intelligent driving detection system based on a driving recorder according to claim 3 is characterized in that: The driving road condition safety analysis unit is used to analyze the driving road condition safety corresponding to the driving road condition data set during driving to obtain the driving road condition complexity index Zaq during driving. The driving road condition complexity index Zaq is obtained by the following formula: Where Dkj i It is expressed as the number of curve driving in the i-th monitoring period, Dcl i Expressed as the road vehicle flow rate during the i-th monitoring period, Ggd i It is represented by the road slope in the i-th monitoring period, i=1, 2, 3, ..., n, n is the detection period, ω1, ω2 and ω3 are all represented by preset proportional coefficients, and ω1+ω2+ω3=1.0, and P is represented by the third correction constant.
7. The intelligent driving detection system based on a driving recorder according to claim 1, characterized in that: The comprehensive evaluation module includes a driving safety comprehensive analysis unit and a driving detection unit; the driving safety comprehensive analysis unit is used to obtain the driving comprehensive safety index Za by correlating the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq, and after dimensionless processing, the driving comprehensive safety index Za is obtained by the following formula: Wherein, λ1, λ2 and λ3 represent the preset proportional coefficients of the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq respectively.
8. The intelligent driving detection system based on a driving recorder according to claim 1, characterized in that: The driving detection unit is used to compare and analyze the driving comprehensive safety index Za with the comprehensive evaluation threshold S to comprehensively determine the overall safety evaluation of the driving state, the comprehensive evaluation threshold S includes a first evaluation threshold S1 and a second evaluation threshold S2> the first evaluation threshold S1, and the driving comprehensive safety index Za is compared to obtain an evaluation result, including: When the comprehensive safety index Za> the second evaluation threshold S2, it means that the overall safety of the detected driving state is safe; When the first evaluation threshold S1≤comprehensive safety index Za≤second evaluation threshold S2, it indicates that the overall safety of the detected driving state is abnormal, and the second feedback result is obtained and sent to the real-time feedback module; When the comprehensive safety index Za is less than the first evaluation threshold S1, it indicates that the overall safety of the detected driving state is abnormal, and the third feedback result is obtained and sent to the real-time feedback module.
9. The intelligent driving detection system based on a driving recorder according to claim 8, characterized in that: The real-time feedback module is used to receive the first feedback result, the second feedback result and the third feedback result, and execute corresponding prompts, and the specific contents are as follows: If you receive the first feedback result, the prompt will be: "You are driving fatigued. For the safety of you and others, please take a rest." If the second feedback result is received, the prompt is that an abnormality is detected in the driving state of your vehicle, please drive carefully; at the same time, an orange warning notification is displayed on the display panel in the vehicle; If you receive the third feedback result, the prompt is that your vehicle's driving status is detected to be abnormal, please slow down immediately and keep the lane, reconfirm the driving status, and pay attention to driving safety; at the same time, a red warning notification will be displayed on the display panel in the vehicle, and the vehicle's emergency double flash lights will be turned on; If no feedback signal is received, no prompt will be issued at this time.
10. A driving intelligent detection method based on a driving recorder, used to implement a driving intelligent detection system based on a driving recorder as claimed in any one of claims 1 to 9, characterized in that: The following steps are involved: Step 1: First, through multiple camera modules and sensors on the driving recorder, the driver's state information, vehicle driving state information and driving road condition information are collected in real time during driving, and a driver state data set, a vehicle driving state data set and a driving road condition data set are established; Step 2: Next, the driver status data set, vehicle driving status data set and driving road condition data set are cleaned to remove noise and invalid data; Step 3: Then analyze the driver status data set, the vehicle driving status data set and the driving road condition data set to obtain the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq; Step 4: Correlate the driver fatigue index Zpl, the vehicle driving safety index Zxt and the driving road condition complexity index Zaq, output the driving comprehensive safety index Za, and compare and analyze it with the preset comprehensive evaluation threshold S to obtain feedback results to comprehensively determine the overall safety evaluation of the driving state; Step 5: Finally, the real-time feedback module receives the feedback result and executes the corresponding prompt.
Citation Information
Patent Citations
Remote monitoring method and system based on driving safety
CN104077819A
System and method for calculating driving risks and assisting automobile insurance pricing based on multi-source data
CN105374211A
Automobile data recorder with fatigue driving pre-warning function
CN105788028A
Driving danger coefficient assessment method and device based on multi-modal information
CN107833312A
Driving behavior analysis method and system based on traffic environment
CN110533909A
Cited By
Dangerous driving detection method and system based on big data
CN119293699A
