Fatigue driving early warning method and related equipment

By obtaining and analyzing driving timing information, performing timing prediction and fatigue score calculations, determining the warning level, and early warning solves the problem of timely warning in the existing technology, which significantly improves the safety of road driving.

CN119049221AActive Publication Date: 2024-11-29DONGFENG MOTOR GRP

Patent Information

Application Number
CN202411264763.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-10
Publication Date
2024-11-29
Estimated Expiration
2044-09-10

Smart Images

  • Figure CN119049221A_ABST
    Figure CN119049221A_ABST
Patent Text Reader

Abstract

The invention discloses a fatigue driving early warning method and related equipment, and relates to the technical field of intelligent driving, the method comprises the following steps: obtaining driving time sequence information in a first preset time period, the first preset time period being a preset time period before the current moment; time sequence prediction is carried out based on the driving time sequence information, at least one piece of fatigue driving information in a second preset time period is obtained, the second preset time period is a preset time period after the current moment, and the fatigue driving information comprises a fatigue score and a score time point corresponding to the fatigue score; and based on the fatigue score and the scoring time point, determining a fatigue driving early warning level and performing early warning. According to the invention, the safety of road driving can be effectively improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of intelligent driving technology, and more specifically, to a fatigue driving warning method and related equipment. Background Art

[0002] Fatigue driving is an important cause of traffic accidents. According to statistics in recent years, there are a large number of road traffic accidents directly caused by fatigue driving every year, causing a large number of casualties and property losses. In particular, traffic accidents involving commercial vehicles often cause serious casualties and huge losses.

[0003] Although the fatigue driving warning methods in the related art can monitor the driver's fatigue state to a certain extent and issue a warning when signs of fatigue are found, there is still a limitation that it cannot provide early warning in time; this is mainly because many methods rely on intervention only when the driver has shown obvious fatigue behavior or changes in physiological indicators, and fail to fully capture and predict early signs of fatigue, thus missing the best time for intervention. In other words, there is a technical problem of poor road driving safety in the related art. Summary of the invention

[0004] A series of simplified concepts are introduced in the summary of the invention, which will be further described in detail in the detailed description. The summary of the invention of this application does not mean to attempt to define the key features and essential technical features of the technical solution claimed for protection, nor does it mean to attempt to determine the scope of protection of the technical solution claimed for protection.

[0005] The fatigue driving warning method and related devices provided in this application can effectively improve the safety of road driving.

[0006] In a first aspect, the present application provides a fatigue driving warning method, the method comprising: obtaining driving timing information within a first preset time period, wherein the first preset time period is a preset time period before a current moment; performing timing prediction based on the driving timing information to obtain at least one fatigue driving information within a second preset time period, wherein the second preset time period is a preset time period after the current moment, and the fatigue driving information includes a fatigue score and a scoring time point corresponding to the fatigue score; based on the fatigue score and the scoring time point, determining a fatigue driving warning level and issuing a warning.

[0007] In a feasible implementation manner, the driving timing information includes time series features, as well as physiological state sequence features and in-vehicle environment sequence features corresponding to the time series features; the timing prediction based on the driving timing information to obtain at least one fatigue driving information within a second preset time period includes: feature splicing of the time series features, the physiological state sequence features and the in-vehicle environment sequence features to obtain a fused timing feature; inputting the fused timing feature into a fatigue timing prediction model to obtain a prediction output vector; and extracting and processing the prediction output vector based on the second preset time period to obtain the fatigue driving information.

[0008] In a feasible implementation, the determining of the fatigue driving warning level and issuing a warning based on the fatigue score and the scoring time point includes: calculating a comprehensive score for a time period corresponding to the fatigue driving information based on the fatigue score and the scoring time point, wherein the comprehensive score for the time period is positively correlated with the fatigue score and negatively correlated with the length of time from the scoring time point to the current moment; determining the fatigue driving warning level and issuing a warning based on the comprehensive score for the time period.

[0009] In a feasible implementation manner, the calculating, based on the fatigue score and the scoring time point, a comprehensive score for the time period corresponding to the fatigue driving information includes: substituting the fatigue score and the scoring time point into a comprehensive scoring formula to calculate the comprehensive score for the time period, wherein the comprehensive scoring formula is: In the formula, Y is the comprehensive score of the period, y i is the i-th fatigue score in the second preset period, t i is the i-th scoring time point in the second preset time period, t0 is the current time point, and n is the number of all fatigue driving information in the second preset time period.

[0010] In a feasible implementation, the fatigue driving warning level is determined and a warning is issued based on the comprehensive score of the time period, including: correcting the comprehensive score of the time period according to historical driving time data and current driving time data to obtain a corrected score of the time period; and determining the fatigue driving warning level and issuing a warning based on the corrected score of the time period.

[0011] In a feasible implementation, the fatigue driving warning level is determined and a warning is issued based on the comprehensive score of the time period, including: when the comprehensive score of the time period is greater than or equal to a first scoring threshold and less than a second scoring threshold, the in-vehicle environment is adjusted by an in-vehicle environment adjustment device to reduce the comprehensive score of the time period calculated at the next time point; when the comprehensive score of the time period is greater than or equal to the second scoring threshold, the fatigue driving warning level is determined based on the comprehensive score of the time period and a warning is issued.

[0012] In a feasible implementation manner, the fatigue driving warning level includes a mild fatigue level, a moderate fatigue level and a severe fatigue level; when the comprehensive score of the time period is greater than or equal to the second scoring threshold, the fatigue driving warning level is determined based on the comprehensive score of the time period and a warning is issued, including: when the comprehensive score of the time period is greater than or equal to the second scoring threshold, and based on the comprehensive score of the time period, when the fatigue driving warning level is determined to be a mild fatigue level, a warning reminder message is displayed through an on-board display screen; when the comprehensive score of the time period is greater than or equal to the second scoring threshold, and based on the comprehensive score of the time period, when the fatigue driving warning level is determined to be a moderate fatigue level, a warning reminder message is broadcast through a on-board loudspeaker; when the comprehensive score of the time period is greater than or equal to the second scoring threshold, and based on the comprehensive score of the time period, when the fatigue driving warning level is determined to be a severe fatigue level, the vehicle route destination is planned as a nearby parking lot through the on-board navigation device.

[0013] In the second aspect, the present application also provides a fatigue driving warning device, including: an acquisition unit, used to acquire driving timing information within a first preset time period, wherein the first preset time period is a time period before the current moment; a prediction unit, used to perform timing prediction based on the driving timing information, and obtain at least one fatigue driving information within a second preset time period, wherein the second preset time period is a time period after the current moment, and the fatigue driving information includes a fatigue score and a scoring time point corresponding to the fatigue score; a warning unit, used to determine the fatigue driving warning level and issue a warning based on the fatigue score and the scoring time point.

[0014] In a third aspect, the present application further provides an electronic device, comprising: a memory and a processor, wherein the processor is used to implement the steps of the fatigue driving warning method described in the first aspect when executing a computer program stored in the memory.

[0015] In a fourth aspect, the present application further provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps of the fatigue driving warning method described in the first aspect.

[0016] In a fifth aspect, the present application also provides a computer program product, including a computer program or computer executable instructions, which, when executed by a processor, implements the fatigue driving warning method provided in an embodiment of the present application.

[0017] In summary, this application obtains and analyzes the driving timing information within a certain period of time before the current moment (the first preset period), and then predicts the fatigue driving situation within a period of time in the future (the second preset period). This forward-looking prediction capability enables the system to issue a warning before the driver actually enters a fatigue state, thereby effectively preventing traffic accidents caused by fatigue driving, and can significantly improve the driver's driving safety awareness, prompting the driver to take timely measures to relieve fatigue when feeling tired, thereby effectively improving the safety of road driving. In summary, the fatigue driving warning method provided by this application can effectively improve the safety of road driving. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present specification. Also, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0019] Figure 1 A flowchart of a fatigue driving warning method provided in an embodiment of the present application;

[0020] Figure 2 A schematic diagram of the structure of a fatigue driving warning device provided in an embodiment of the present application;

[0021] Figure 3 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0022] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, rather than to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "is" and "has" and any variations thereof involved in the present application are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0023] The term "module" or "unit" in this application refers to a computer program or a part of a computer program that has a predetermined function and works together with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as processing circuits or memories) or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be part of an overall module or unit that includes the function of the module or unit.

[0024] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. In the following description, it is related to "some embodiments", which describes a subset of all possible embodiments, but it can be understood that "some embodiments" can be the same subset or different subsets of all possible embodiments, and can be combined with each other without conflict.

[0025] See also Figure 1 , Figure 1 1 is a flow chart of a fatigue driving warning method provided in an embodiment of the present application. The method may specifically include the following steps 101 to 103:

[0026] Step 101, obtaining driving timing information within a first preset period, wherein the first preset period is a preset time period before the current moment;

[0027] Specifically, the first preset period is a specified, fixed-length period of time used to collect data from the driver's driving activities, representing a time window from the current moment to the past, and is used to analyze the driver's driving pattern. First, the specific length of the first preset period can be determined according to preset rules or user settings, such as the last hour, two hours or longer period, or the time period with driving records in the last month, half a year or longer period; then, relevant data is collected in real time or regularly from channels such as vehicle sensors, driver monitoring equipment (such as cameras, physiological monitoring equipment), and in-vehicle environmental sensors; finally, the collected data is organized into the format of driving time series information, including but not limited to the vehicle driving status (speed, acceleration, steering, etc.), the driver's physiological status (heart rate, blinking frequency, facial expressions, etc.), and the in-vehicle environmental status (temperature, humidity, noise level, etc.).

[0028] Exemplarily, assuming that the first preset time period is set to the most recent hour, data collection and organization can be performed from the following aspects: For vehicle driving status, information such as vehicle speed, acceleration, brake / throttle operation frequency, etc. is obtained through the vehicle CAN bus interface. These data can reflect the driver's driving behavior and the dynamic state of the vehicle; For the driver's physiological state, the in-vehicle camera is used in combination with face recognition technology and biometric algorithms to monitor the driver's blinking frequency, facial expressions, head posture, etc., so as to assess the degree of fatigue. The driver's heart rate, blood oxygen saturation and other physiological indicators can also be monitored through wearable devices (such as smart watches); For the in-vehicle environment status, real-time data of the in-vehicle environment is obtained through in-vehicle temperature sensors, humidity sensors and noise monitoring equipment. These data help to understand the impact of the in-vehicle environment on the driver's fatigue state.

[0029] By implementing step 101, historical data on the driver's behavior pattern, physiological state and environmental conditions can be obtained, providing necessary data support for subsequent steps, so that the prediction model has a sufficiently rich source of information, thereby improving the accuracy and reliability of the prediction.

[0030] Step 102, performing time series prediction based on the driving time series information to obtain at least one piece of fatigue driving information within a second preset period, wherein the second preset period is a preset time period after the current moment, and the fatigue driving information includes a fatigue score and a scoring time point corresponding to the fatigue score;

[0031] Specifically, the second preset period refers to a time window in the future after the current moment, which is used to predict the driver's fatigue state; similar to the first preset period, the second preset period is also pre-set, and its length depends on many factors, including prediction needs, driving environment, driver habits, etc.; the second preset period is set to provide sufficient time for early warning before the driver shows signs of fatigue. Fatigue driving information refers to a series of data related to the driver's fatigue state obtained through time series prediction, which is used to assess the degree of fatigue that may occur or worsen in the driver during the second preset period. Fatigue driving information includes a quantitative assessment result of the driver's fatigue level (fatigue score), and a specific time point corresponding to the fatigue score (scoring time point). In the specific implementation process of step 102, first, the collected driving time series information can be preprocessed, including but not limited to data cleaning, outlier removal, feature extraction, etc., to ensure the quality and relevance of the input data; then, a suitable time series prediction model is selected or trained, and these models can be based on statistics (such as ARIMA model), machine learning (such as random forest, support vector machine) or deep learning (such as LSTM, GRU and other recurrent neural networks); then, the historical driving time series information is used as training data to train the selected model so that it can learn the complex relationship between driving behavior and fatigue status; finally, the latest driving time series information is input into the trained model, and time series prediction is performed to obtain fatigue driving information within a second preset time period, including fatigue scores and corresponding scoring time points.

[0032] By implementing step 102 and analyzing the historical driving data, the future fatigue state can be predicted before the driver shows obvious fatigue symptoms, thereby issuing an early warning, thereby improving the timeliness of the warning.

[0033] Step 103, based on the fatigue score and the scoring time point, determine the fatigue driving warning level and issue a warning;

[0034] Specifically, the fatigue driving warning level refers to dividing the predicted fatigue score into different levels according to certain standards, and each level represents the different severity of the driver's fatigue. In the specific implementation process of step 102, first, the fatigue driving warning can be divided into different levels according to the range of the fatigue score and the preset threshold, such as low fatigue, moderate fatigue, high fatigue, etc., and each level corresponds to a different risk level and preventive measures to be taken; then, the scoring time point is analyzed, especially the time point that is about to reach or has exceeded the warning threshold, to determine the urgency and importance of the warning; then, according to the warning level and the scoring time point, a specific warning strategy is formulated, which may include sound alarms, visual prompts (such as warning lights or information displays on the dashboard), vibration seats, automatic adjustment of the in-car environment (such as lowering the temperature, playing refreshing music), etc., and possible vehicle control intervention (such as speed limit, automatic driving takeover, etc.); finally, according to the formulated warning strategy, a warning is issued to the driver at an appropriate time, and additional safety measures may be taken to protect the safety of the driver and the vehicle.

[0035] Through the implementation of step 103, the warning level is determined according to the fatigue score and the time point, so that the warning system can take corresponding measures according to different fatigue levels, avoiding a "one-size-fits-all" warning method; through timely and effective warnings, the risk of traffic accidents caused by fatigue driving is reduced, and the overall safety of road traffic is improved.

[0036] In summary, the embodiment of the present application obtains and analyzes the driving timing information within a certain period of time before the current moment (the first preset period), and then predicts the fatigue driving situation within a period of time in the future (the second preset period). This forward-looking prediction capability enables the system to issue a warning before the driver actually enters a fatigue state, thereby effectively preventing traffic accidents caused by fatigue driving, and can significantly improve the driver's driving safety awareness, prompting the driver to take timely measures to relieve fatigue when feeling tired, thereby effectively improving the safety of road driving. In summary, the fatigue driving warning method provided by the embodiment of the present application can effectively improve the safety of road driving.

[0037] In some embodiments, the aforementioned driving timing information may include time series features, as well as physiological state sequence features and in-vehicle environment sequence features corresponding to the time series features; step 102 may include: performing feature splicing on the time series features, physiological state sequence features and in-vehicle environment sequence features to obtain fused timing features; inputting the fused timing features into the fatigue timing prediction model to obtain a predicted output vector; extracting and processing the predicted output vector based on a second preset time period to obtain fatigue driving information.

[0038] Specifically, time series features are a series of time point data arranged in chronological order during driving. Physiological state sequence features refer to a series of data points related to the driver's physiological state, which change over time and reflect the driver's health and fatigue status; physiological state sequence features may include heart rate changes (reflecting the driver's tension or fatigue), eye state (such as blinking frequency, eye closing time, etc.) and breathing pattern (breathing frequency and depth), etc. In-car environment sequence features refer to a series of data points of the in-car environment that change over time, which may affect the driver's comfort and fatigue; in-car environment sequence features may include in-car temperature (temperature changes may affect the driver's comfort and alertness), lighting conditions (the brightness and color of in-car lighting may affect the driver's emotions and visual fatigue) and noise level (the intensity and type of in-car noise may affect the driver's attention and fatigue), etc. In the specific implementation process, first, the collected time series features, physiological state sequence features and in-vehicle environment sequence features are feature spliced ​​to integrate information of different dimensions into a unified feature space so that the subsequent model can comprehensively consider the impact of various factors on the driver's fatigue state; then, the spliced ​​fused time series features are passed as input to the trained fatigue time series prediction model, which is built based on deep learning or other machine learning algorithms, and can learn and understand the complex relationship between input features and fatigue driving status, and then output the corresponding prediction results; finally, according to the second preset time period (usually a specific time period, such as the next 10 minutes, 30 minutes, 1 hour, etc.), the fatigue driving information related to the time period is extracted from the prediction output vector, which may include fatigue level, warning signals, etc., to remind the driver or vehicle system to take corresponding safety measures in real time.

[0039] Through the implementation of the above embodiments, time series features, physiological state sequence features and in-vehicle environment sequence features are combined, and fused time series features are obtained through feature splicing, thereby improving the accuracy and comprehensiveness of fatigue prediction; this comprehensive application of multi-source data can more comprehensively capture the changes in the driver's fatigue state and provide richer input information for the prediction model.

[0040] In some embodiments, the aforementioned step 103 may include: based on the fatigue score and the scoring time point, calculating the comprehensive score of the time period corresponding to the fatigue driving information, wherein the comprehensive score of the time period is positively correlated with the fatigue score, and negatively correlated with the length of time from the scoring time point to the current moment; based on the comprehensive score of the time period, determining the fatigue driving warning level and issuing a warning.

[0041] Specifically, first, based on the fatigue score obtained and the time point corresponding to the score (i.e., the scoring time point), the system executes a comprehensive scoring algorithm, which aims to calculate the comprehensive score of the time period corresponding to the fatigue driving information currently under consideration; in this process, the comprehensive score of the time period is positively correlated with the fatigue score, that is, the higher the fatigue score, the higher the comprehensive score of the time period; at the same time, the comprehensive score of the time period is also negatively correlated with the length of time from the scoring time point to the current moment, that is, the closer the scoring time point is to the current moment, the greater its influence weight, and vice versa; then, based on the calculated comprehensive score of the time period, it is compared with the preset warning level threshold to determine the current fatigue driving warning level; the warning level is usually divided into multiple levels, such as low, medium, high or emergency, each level corresponds to different warning measures and response strategies, once the warning level is determined, the system will trigger the corresponding warning mechanism, such as reminding the driver to pay attention to the risk of fatigue driving through sound, light, vibration or display information, and may also start other safety measures at the same time, such as automatic deceleration, keeping a safe distance or preparing to take over vehicle control.

[0042] Through the implementation of the above embodiment, a comprehensive time period scoring is introduced, and the fatigue score and the distance between the scoring time points are comprehensively considered, so that the warning is more reasonable and timely, and can more accurately reflect the trend of the driver's fatigue level changes in the future period of time, providing a scientific basis for determining the warning level.

[0043] In some embodiments, based on the fatigue score and the scoring time point, calculating the comprehensive score of the time period corresponding to the fatigue driving information may include: substituting the fatigue score and the scoring time point into the comprehensive scoring formula to calculate the comprehensive score of the time period, wherein the comprehensive scoring formula is:

[0044]

[0045] In the formula, Y is the comprehensive score of the time period, y i is the i-th fatigue score in the second preset period, t i is the i-th scoring time point in the second preset period, t0 is the current time point, and n is the number of all fatigue driving information in the second preset period.

[0046] Specifically, first, the ratio of the maximum fatigue score to the time factor is calculated, and the maximum value of the ratio of all fatigue scores in the second preset period to the square root of the difference between each scoring time point and the current moment is taken. This ratio takes into account the severity of the fatigue score and the distance from the current moment. The more severe (large) the score and the closer the time, the greater the ratio; then the average value of the fatigue score is calculated, that is, the average value of all fatigue scores in the second preset period, which reflects the average fatigue level of the driver in the entire period; finally, the results of these two parts are multiplied to obtain the comprehensive score of the period. This comprehensive score of the period takes into account both the severity of fatigue and the time factor, so that the warning system can more accurately determine when and how to issue a warning; the inverse relationship between the square root and the time difference in the formula ensures that the closer the predicted time point is, the greater the impact on the comprehensive score, making the warning more timely and effective.

[0047] Through the implementation of the above embodiments, a specific comprehensive scoring formula is proposed, which takes into account both the absolute value of the fatigue score and the distance between the scoring time point and the current moment. The formula can accurately calculate the comprehensive score of the time period, ensuring the fairness and accuracy of the scoring.

[0048] In some embodiments, the aforementioned determination of the fatigue driving warning level and issuance of a warning based on the comprehensive score of the time period may include: correcting the comprehensive score of the time period according to historical driving time data and current driving time data to obtain a corrected score of the time period; and determining the fatigue driving warning level and issuing a warning based on the corrected score of the time period.

[0049] Specifically, the historical driving time data and the current driving time data can be considered to optimize the initially calculated period comprehensive score to eliminate or reduce the impact of certain factors, such as individual differences of drivers, driving habits, or fatigue patterns under specific driving conditions. In the specific implementation process, the driver's historical driving behavior can be analyzed to understand his fatigue tendency and driving habits; the current driving time can be considered to determine whether the driver has been driving for a long time, which may increase the risk of fatigue; based on these data, the original period comprehensive score is adjusted to make it more consistent with the driver's actual fatigue state.

[0050] For example, assuming that driver A has more than 10 long-distance driving records in the past month and does not have sufficient rest time between two drives, based on these historical data, it is considered that driver A is prone to fatigue; during the current driving process, if the system detects that driver A has been driving for 3 consecutive hours, then even if the preliminary comprehensive score for the period is low, the score will be adjusted upward based on historical data.

[0051] Through the implementation of the above embodiment, historical driving time data and current driving time data are introduced to correct the comprehensive score of the time period, so that the warning is more in line with the actual situation of the driver. This personalized correction can more accurately reflect the driver's fatigue state and improve the pertinence and effectiveness of the warning.

[0052] In some embodiments, the aforementioned determination of the fatigue driving warning level and issuance of a warning based on the comprehensive score of the time period may also include: when the comprehensive score of the time period is greater than or equal to a first scoring threshold and less than a second scoring threshold, adjusting the in-vehicle environment through the in-vehicle environment adjustment device so that the comprehensive score of the time period calculated at the next time point is reduced; when the comprehensive score of the time period is greater than or equal to the second scoring threshold, determining the fatigue driving warning level and issuing a warning based on the comprehensive score of the time period.

[0053] Specifically, the first scoring threshold is a pre-set scoring value, which is used to determine whether the driver's fatigue state has reached the standard that requires certain measures to be taken. When the calculated time period comprehensive score is greater than or equal to this threshold, it indicates that the driver's fatigue level has reached a level that requires attention, but has not yet reached the level that requires an immediate warning. The setting of the first scoring threshold can be set based on the driver's safety margin and the timing of system intervention. The second scoring threshold is another pre-set scoring value, which is higher than the first scoring threshold and is used to determine whether the driver's fatigue state is serious enough to require a warning. When the time period comprehensive score is greater than or equal to the second scoring threshold, it indicates that the driver's fatigue level is very serious. The fatigue driving warning level can be determined based on this score, and corresponding warning measures can be taken. The setting of the second scoring threshold can be set based on the necessity and urgency of the warning. In the specific implementation process, first, the time period comprehensive score can be compared with two preset score thresholds (a first score threshold and a second score threshold); if the time period comprehensive score is greater than or equal to the first score threshold but less than the second score threshold, this indicates that the driver may be in a state of mild or moderate fatigue, but has not yet reached the level of emergency warning; at this time, the in-vehicle environment adjustment equipment (such as air conditioning, audio, seat heating or ventilation, etc.) can be controlled to fine-tune the in-vehicle environment to create a more comfortable driving environment that helps to relieve fatigue, so as to reduce the time period comprehensive score calculated at the next time point; however, if the time period comprehensive score is greater than or equal to the second score threshold, this indicates that the driver is already in a highly fatigued state and there is a significant driving safety risk. In this case, the warning level of fatigue driving can be immediately determined based on the current time period comprehensive score according to the preset algorithm or rule, and the corresponding warning mechanism can be triggered. These warning mechanisms may include but are not limited to sound alarms, visual prompts, vibration feedback, sending emergency rest suggestions to the driver, or automatically taking over vehicle control, etc., to ensure that the driver can promptly realize the risk of fatigue driving and take corresponding safety measures.

[0054] Through the implementation of the above embodiment, different intelligent intervention measures are taken according to different ranges of the comprehensive scores of the time periods, so as to provide effective help and support to the driver at different stages; this hierarchical intervention strategy can effectively prevent the driver from being overly fatigued, and can also reduce the interference caused to the driver by unnecessary alarms.

[0055] In some embodiments, the aforementioned fatigue driving warning level includes a mild fatigue level, a moderate fatigue level and a severe fatigue level; when the aforementioned comprehensive score of the time period is greater than or equal to a second scoring threshold, the fatigue driving warning level is determined based on the comprehensive score of the time period and a warning is issued, including: when the comprehensive score of the time period is greater than or equal to the second scoring threshold, and based on the comprehensive score of the time period, when the fatigue driving warning level is determined to be a mild fatigue level, a warning reminder message is displayed through the vehicle display screen; when the comprehensive score of the time period is greater than or equal to the second scoring threshold, and based on the comprehensive score of the time period, when the fatigue driving warning level is determined to be a moderate fatigue level, the warning reminder message is broadcast through the vehicle loudspeaker; when the comprehensive score of the time period is greater than or equal to the second scoring threshold, and based on the comprehensive score of the time period, when the fatigue driving warning level is determined to be a severe fatigue level, the vehicle route destination is planned as a nearby parking lot through the vehicle navigation device.

[0056] Specifically, first, the comprehensive score of the time period can be compared with the preset score threshold, especially when the score is greater than or equal to the second score threshold, the warning level of fatigue driving can be further determined, and the warning level includes but is not limited to mild fatigue level, moderate fatigue level and severe fatigue level; then, the corresponding warning measures can be executed according to the determined warning level. Specifically, if the comprehensive score of the time period is greater than or equal to the second score threshold, and the warning level determined according to the scoring result is mild fatigue level, the system will display the warning reminder information through the vehicle display screen in the form of text, icon or animation, aiming to gently remind the driver to pay attention to the fatigue state and suggest him to take appropriate rest measures; if the warning level is moderate fatigue level, the system will broadcast the warning reminder information through the vehicle loudspeaker. This sound warning is more direct and difficult to ignore, which helps to quickly attract the driver's attention and emphasize the severity of the current fatigue driving risk; and when the warning level reaches the severe fatigue level, more radical measures can be taken to ensure driving safety. A route can be automatically planned through the vehicle navigation device to change the destination of the vehicle to a nearby parking lot, aiming to immediately free the driver from the driving task and guide him to a safe area for a full rest.

[0057] Through the implementation of the above-mentioned embodiments, different levels of warning measures are adopted for different levels of fatigue driving warnings; from mild warning reminder information, to moderate broadcast warning, to severe planning of parking routes, this multi-level warning mechanism can ensure that under different degrees of fatigue, the driver can get timely and effective reminders and help, thereby further improving driving safety.

[0058] Furthermore, as an implementation of the aforementioned method embodiment, the present application also provides a fatigue driving warning device for implementing the aforementioned method embodiment. The device embodiment corresponds to the aforementioned method embodiment. For ease of reading, the present fatigue driving warning device embodiment will no longer repeat the details of the aforementioned method embodiment one by one, but it should be clear that the device in the embodiment of the present application can correspond to and implement all the contents of the aforementioned method embodiment. Figure 2 As shown, the fatigue driving warning device 20 includes: an acquisition unit 201, a prediction unit 202 and a warning unit 203, wherein the acquisition unit 201 is used to acquire driving timing information within a first preset time period, wherein the first preset time period is a time period before the current moment; the prediction unit 202 is used to perform timing prediction based on the driving timing information to obtain at least one fatigue driving information within a second preset time period, wherein the second preset time period is a time period after the current moment, and the fatigue driving information includes a fatigue score and a scoring time point corresponding to the fatigue score; the warning unit 203 is used to determine the fatigue driving warning level and issue a warning based on the fatigue score and the scoring time point.

[0059] In some embodiments, the driving timing information includes time series features, as well as physiological state sequence features and in-vehicle environment sequence features corresponding to the time series features; the prediction unit 202 is also used to perform feature splicing on the time series features, physiological state sequence features and in-vehicle environment sequence features to obtain fused timing features; the fused timing features are input into the fatigue timing prediction model to obtain a predicted output vector; the predicted output vector is extracted and processed based on a second preset time period to obtain fatigue driving information.

[0060] In some embodiments, the warning unit 203 is also used to calculate a comprehensive score for the time period corresponding to the fatigue driving information based on the fatigue score and the scoring time point, wherein the comprehensive score for the time period is positively correlated with the fatigue score, and negatively correlated with the length of time from the scoring time point to the current moment; based on the comprehensive score for the time period, the fatigue driving warning level is determined and a warning is issued.

[0061] In some embodiments, the early warning unit 203 is further used to substitute the fatigue score and the scoring time point into the comprehensive scoring formula to calculate the comprehensive score of the time period, wherein the comprehensive scoring formula is: In the formula, Y is the comprehensive score of the time period, y iis the i-th fatigue score in the second preset period, t i is the i-th scoring time point in the second preset period, t0 is the current time point, and n is the number of all fatigue driving information in the second preset period.

[0062] In some embodiments, the warning unit 203 is also used to correct the comprehensive score of the time period according to the historical driving time data and the current driving time data to obtain a corrected score of the time period; based on the corrected score of the time period, determine the fatigue driving warning level and issue a warning.

[0063] In some embodiments, the warning unit 203 is also used to adjust the in-vehicle environment through the in-vehicle environment adjustment device when the time period comprehensive score is greater than or equal to the first score threshold and less than the second score threshold, so as to reduce the time period comprehensive score calculated at the next time point; when the time period comprehensive score is greater than or equal to the second score threshold, determine the fatigue driving warning level based on the time period comprehensive score and issue a warning.

[0064] In some embodiments, the fatigue driving warning level includes a mild fatigue level, a moderate fatigue level and a severe fatigue level; the warning unit 203 is also used to display a warning reminder message through the vehicle display screen when the comprehensive score of the time period is greater than or equal to a second scoring threshold, and based on the comprehensive score of the time period, the fatigue driving warning level is determined to be a mild fatigue level; when the comprehensive score of the time period is greater than or equal to the second scoring threshold, and based on the comprehensive score of the time period, the fatigue driving warning level is determined to be a moderate fatigue level, the warning reminder message is broadcast through the vehicle loudspeaker; when the comprehensive score of the time period is greater than or equal to the second scoring threshold, and based on the comprehensive score of the time period, the fatigue driving warning level is determined to be a severe fatigue level, the vehicle route destination is planned as a nearby parking lot through the vehicle navigation device.

[0065] The present application also provides a computer-readable storage medium, which stores computer-executable instructions or computer programs. When the computer-executable instructions or computer programs are executed by a processor, the processor will be caused to execute any step of the fatigue driving warning method provided in the present application.

[0066] In some embodiments, the computer-readable storage medium may be a memory such as RAM, read-only memory (ROM), flash memory, magnetic surface memory, optical disk, or compact disc read-only memory (CD-ROM); or it may be various devices including one or any combination of the above memories.

[0067] In some embodiments, computer executable instructions may be in the form of a program, software, software module, script or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a stand-alone program or as a module, component, subroutine or other unit suitable for use in a computing environment.

[0068] In some embodiments, computer-executable instructions may, but need not, correspond to a file in a file system, may be stored as part of a file storing other programs or data, for example, in one or more scripts in a HyperText Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files storing one or more modules, subroutines, or code portions).

[0069] In some embodiments, computer executable instructions may be deployed to be executed on one electronic device, or on multiple electronic devices located at one site, or on multiple electronic devices distributed at multiple sites and interconnected by a communication network.

[0070] like Figure 3 As shown, the present application also provides an electronic device 30, including a memory 310, a processor 320, and a computer program 311 stored in the memory 310 and executable on the processor, and when the processor 320 executes the computer program 311, any step of the above-mentioned fatigue driving warning method is implemented.

[0071] The present application also provides a computer program product, which includes a computer program or a computer executable instruction, and the computer program or the computer executable instruction is stored in a computer-readable storage medium. The processor of the electronic device reads the computer program or the computer executable instruction from the computer-readable storage medium, and the processor executes the computer program or the computer executable instruction, so that the electronic device performs any step of the fatigue driving warning method described above in the present application.

[0072] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A fatigue driving warning method, characterized in that: include: Acquire driving timing information within a first preset period, wherein the first preset period is a preset time period before the current moment; Performing time series prediction based on the driving time series information to obtain at least one piece of fatigue driving information within a second preset time period, wherein the second preset time period is a preset time period after the current moment, and the fatigue driving information includes a fatigue score and a scoring time point corresponding to the fatigue score; Based on the fatigue score and the scoring time point, a fatigue driving warning level is determined and a warning is issued.

2. The fatigue driving warning method according to claim 1 is characterized in that: The driving time sequence information includes time sequence features, and physiological state sequence features and in-vehicle environment sequence features corresponding to the time sequence features; The performing time series prediction based on the driving time series information to obtain at least one fatigue driving information within a second preset time period includes: Performing feature splicing on the time series features, the physiological state sequence features and the in-vehicle environment sequence features to obtain a fused time series feature; Inputting the fused time series features into a fatigue time series prediction model to obtain a prediction output vector; The predicted output vector is extracted and processed based on the second preset time period to obtain the fatigue driving information.

3. The fatigue driving warning method according to claim 1 is characterized in that: The step of determining a fatigue driving warning level and issuing a warning based on the fatigue score and the scoring time point includes: Based on the fatigue score and the scoring time point, calculating a time period comprehensive score corresponding to the fatigue driving information, wherein the time period comprehensive score is positively correlated with the fatigue score and negatively correlated with the time length from the scoring time point to the current moment; Based on the comprehensive score of the time period, the fatigue driving warning level is determined and a warning is issued.

4. The fatigue driving warning method according to claim 3 is characterized in that: The calculating, based on the fatigue score and the scoring time point, a comprehensive score for the time period corresponding to the fatigue driving information includes: Substitute the fatigue score and the scoring time point into the comprehensive scoring formula to calculate the comprehensive score of the time period, wherein the comprehensive scoring formula is: In the formula, Y is the comprehensive score of the period, y i is the i-th fatigue score in the second preset period, t i is the i-th scoring time point in the second preset time period, t0 is the current time point, and n is the number of all fatigue driving information in the second preset time period.

5. The fatigue driving warning method according to claim 3 is characterized in that: The step of determining the fatigue driving warning level and issuing a warning based on the comprehensive score of the time period includes: According to the historical driving time data and the current driving time data, the comprehensive score of the time period is corrected to obtain a corrected score of the time period; Based on the time period correction score, the fatigue driving warning level is determined and a warning is issued.

6. The fatigue driving warning method according to claim 3 is characterized in that: The step of determining the fatigue driving warning level and issuing a warning based on the comprehensive score of the time period includes: When the comprehensive score of the time period is greater than or equal to the first score threshold and less than the second score threshold, the in-vehicle environment adjustment device is used to adjust the in-vehicle environment so that the comprehensive score of the time period calculated at the next time point is reduced; When the comprehensive score of the time period is greater than or equal to the second score threshold, the fatigue driving warning level is determined based on the comprehensive score of the time period and a warning is issued.

7. The fatigue driving warning method according to claim 3 is characterized in that: The fatigue driving warning levels include mild fatigue level, moderate fatigue level and severe fatigue level; When the time period comprehensive score is greater than or equal to the second score threshold, determining the fatigue driving warning level and issuing a warning based on the time period comprehensive score, includes: When the comprehensive score of the time period is greater than or equal to the second score threshold, and based on the comprehensive score of the time period, it is determined that the fatigue driving warning level is a slight fatigue level, a warning reminder message is displayed on the vehicle display screen; When the comprehensive score of the time period is greater than or equal to the second score threshold, and based on the comprehensive score of the time period, it is determined that the fatigue driving warning level is a moderate fatigue level, a warning reminder message is broadcasted through the vehicle loudspeaker; When the comprehensive score of the time period is greater than or equal to the second score threshold, and based on the comprehensive score of the time period, it is determined that the fatigue driving warning level is a severe fatigue level, the vehicle route destination is planned as a nearby parking lot through the on-board navigation device.

8. A fatigue driving warning device, characterized in that: include: An acquisition unit, configured to acquire driving timing information within a first preset period, wherein the first preset period is a time period before a current moment; a prediction unit, configured to perform a time series prediction based on the driving time series information to obtain at least one piece of fatigue driving information within a second preset time period, wherein the second preset time period is a time period after a current moment, and the fatigue driving information includes a fatigue score and a scoring time point corresponding to the fatigue score; The warning unit is used to determine the fatigue driving warning level and issue a warning based on the fatigue score and the scoring time point.

9. An electronic device, comprising: A memory and a processor, characterized in that the processor is used to implement the steps of the fatigue driving warning method as described in any one of claims 1 to 7 when executing the computer program stored in the memory.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the fatigue driving warning method as described in any one of claims 1 to 7 are implemented.

Citation Information

Patent Citations

  • Fatigue driving prediction method based on GPS data

    CN109493566A

  • Driving state identification method and system

    CN114954488A

  • Multi-source signal fatigue driving detection method and device and storage medium

    CN116013033A

  • Image vision method and system for automatically detecting driver fatigue based on artificial intelligence

    CN118097636A

  • Information processing device, information processing method, and program

    JP2024058481A

Cited By

  • Fatigue driving adjusting method, electronic equipment and vehicle

    CN121425234A