A method and system for alleviating driver fatigue

Abstract

This invention relates to the field of driver assistance technology, and particularly to a method and system for alleviating driver fatigue. The method includes: collecting driving status information of the driver, including facial and body information; judging the driving situation based on the driver's driving status information to determine the type of fatigue; retrieving a corresponding fatigue relief plan based on the fatigue type and providing prompts for plan execution; and controlling the vehicle to complete the tasks included in the fatigue relief plan to alleviate the driver's fatigue. This invention determines whether the user is experiencing driving fatigue by observing the driver's facial expressions and body movements, and further determines the type of driving fatigue. Based on different types of driving fatigue, it retrieves and executes corresponding fatigue relief plans, thus enabling targeted relief of driving fatigue.

Description

Technical Field

[0001] This invention belongs to the field of driver assistance technology, and in particular relates to a method and system for alleviating driver fatigue. Background Technology

[0002] Driver fatigue refers to the physiological and psychological dysfunction that occurs after prolonged continuous driving, resulting in a decline in driving skills. Poor or insufficient sleep quality, coupled with long driving hours, easily leads to fatigue. Driver fatigue affects various aspects of a driver's attention, senses, perception, thinking, judgment, will, decision-making, and motor skills.

[0003] There are many factors that contribute to driver fatigue. Driver fatigue mainly involves the fatigue of the nervous and sensory organs, as well as limb fatigue caused by poor blood circulation due to maintaining a fixed posture for a long time. When drivers sit in a fixed seat for extended periods, their movements are somewhat restricted, their attention is highly concentrated, and they are busy judging external stimuli, resulting in a highly tense mental state. This can lead to symptoms of driver fatigue such as blurred vision, back pain, slow reaction time, and impaired driving agility.

[0004] In existing technologies, playing music is usually used to alleviate driver fatigue, but it does not alleviate physical fatigue in drivers. Summary of the Invention

[0005] The purpose of this invention is to provide a method for alleviating driver fatigue, aiming to solve the problem of the inability to alleviate driver fatigue. This invention analyzes the driver's state to determine the type of fatigue, and then implements different relief solutions according to different types of fatigue.

[0006] The present invention is implemented as follows: a method for alleviating driving fatigue, the method comprising:

[0007] Collect driver status information, including facial information and body status information;

[0008] The driving situation is assessed based on the driver's driving status information to determine the type of fatigue.

[0009] Retrieve the corresponding fatigue relief plan based on the type of fatigue and provide prompts for plan execution;

[0010] The vehicle is controlled according to the fatigue mitigation plan to complete the tasks included in the plan, in order to alleviate the driver's fatigue.

[0011] Preferably, the step of judging the driving situation and determining the type of fatigue based on the driver's driving status information specifically includes:

[0012] Facial information is analyzed to assess the dynamics of the driver's facial features and determine whether fatigue is present. These dynamics include blinking frequency, blinking duration, eye opening ratio, yawning behavior, and nodding behavior.

[0013] Analyze the physical condition information to determine the current physical condition type of the driver;

[0014] The type of fatigue is determined based on the body's physical condition and fatigue characteristics.

[0015] Preferably, the step of retrieving the corresponding fatigue relief plan based on the fatigue type and providing a plan execution prompt specifically includes:

[0016] Based on the type of fatigue, a preset solution database is searched to retrieve a matching fatigue relief solution;

[0017] Vehicle information is collected based on fatigue mitigation plans to obtain vehicle functional information data;

[0018] The fatigue mitigation plan is adjusted based on vehicle function information data, and a prompt voice is issued before execution.

[0019] Preferably, the step of controlling the vehicle to complete the items included in the fatigue mitigation plan to alleviate the driver's fatigue state specifically includes:

[0020] Collect voice confirmation information and determine whether to implement the fatigue relief plan;

[0021] During execution, the fatigue relief scheme is analyzed to generate corresponding control commands and the sequential relationship between the commands;

[0022] Control commands are executed according to the sequential relationship between instructions, and the recording is performed in real time. Upon receiving a stop command, the fatigue relief plan is stopped.

[0023] Preferably, if the voice confirmation message is not received, a voice prompt will be given again.

[0024] Preferably, the fatigue relief solution includes playing music, controlling seat assist functions, and controlling the window status.

[0025] Another objective of this invention is to provide a driver fatigue relief system, the system comprising:

[0026] The status information acquisition module is used to collect the driver's driving status information, which includes facial information and body status information;

[0027] The fatigue type determination module is used to judge the driving situation based on the driver's driving status information and determine the fatigue type;

[0028] The solution selection module is used to retrieve the corresponding fatigue relief solution based on the type of fatigue and provide prompts for solution execution.

[0029] The solution execution module is used to control the vehicle to complete the tasks included in the fatigue relief plan in order to alleviate the driver's fatigue.

[0030] Preferably, the fatigue type determination module includes:

[0031] The feature recognition unit is used to analyze facial information, analyze the dynamics of the driver's facial features, and determine whether there are signs of fatigue. The dynamics of the facial features include blinking frequency, blinking time, the proportion of the eyes open, yawning behavior, and nodding behavior.

[0032] The status recognition unit is used to analyze body status information and determine the current physical status type of the driver;

[0033] The type confirmation unit is used to determine the fatigue type based on the body condition type and fatigue characteristics.

[0034] Preferably, the scheme selection module includes:

[0035] The data retrieval unit is used to search a preset solution database based on the type of fatigue and retrieve the corresponding fatigue relief solution.

[0036] The vehicle information collection unit is used to collect vehicle information according to the fatigue mitigation plan and obtain vehicle functional information data.

[0037] The scheme adjustment unit is used to adjust the fatigue mitigation scheme based on vehicle function information data and issue a prompt voice before execution.

[0038] Preferably, the scheme execution module includes:

[0039] The execution determination unit is used to collect voice confirmation information and determine whether to execute the fatigue relief plan;

[0040] The instruction recognition unit is used to parse the fatigue relief scheme during execution and generate corresponding control instructions and the sequential relationship between the instructions;

[0041] The execution control unit is used to execute control commands according to the sequential relationship between instructions, and records the audio in real time. Upon receiving a stop command, it stops executing the fatigue relief plan.

[0042] The present invention provides a method for alleviating driving fatigue by observing the driver's facial expressions and body movements to determine whether the user is experiencing driving fatigue, and further to determine the type of driving fatigue. Based on different types of driving fatigue, the method retrieves and executes corresponding fatigue relief solutions, thus enabling targeted relief of driving fatigue. Attached Figure Description

[0043] Figure 1 A flowchart of a method for alleviating driving fatigue provided in an embodiment of the present invention;

[0044] Figure 2 The flowchart below shows the steps for judging the driving situation and determining the type of fatigue based on the driver's driving status information, as provided in an embodiment of the present invention.

[0045] Figure 3 This is a flowchart illustrating the steps of retrieving a corresponding fatigue relief plan based on the fatigue type and providing prompts for plan execution, as provided in an embodiment of the present invention.

[0046] Figure 4 A flowchart of the steps for controlling a vehicle to complete the items included in a fatigue relief plan according to a fatigue relief plan, in order to alleviate the driver's fatigue state, provided in an embodiment of the present invention.

[0047] Figure 5 This is an architecture diagram of a driver fatigue mitigation system provided in an embodiment of the present invention;

[0048] Figure 6 An architecture diagram of a fatigue type determination module provided in an embodiment of the present invention is shown below:

[0049] Figure 7 An architecture diagram of a scheme selection module provided in an embodiment of the present invention;

[0050] Figure 8 This is an architecture diagram of a scheme execution module provided in an embodiment of the present invention. Detailed Implementation

[0051] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the invention.

[0052] It is understood that the terms "first," "second," etc., used in this application may be used herein to describe various elements, but unless otherwise specified, these elements are not limited by these terms. These terms are used only to distinguish one element from another. For example, without departing from the scope of this application, a first script may be referred to as a second script, and similarly, a second script may be referred to as a first script.

[0053] The factors contributing to drowsy driving are multifaceted. Driver fatigue primarily stems from the fatigue of the nervous and sensory organs, as well as physical fatigue caused by poor blood circulation due to prolonged static posture. Sitting in a fixed seat for extended periods restricts movement, requires intense concentration, and involves constantly processing external stimuli, leading to a state of high mental tension. This results in symptoms such as blurred vision, back pain, slow reaction time, and impaired driving agility. Current technology typically alleviates driver fatigue by playing music, but it does not address the underlying physical fatigue.

[0054] This invention determines whether a driver is experiencing driving fatigue by observing their facial expressions and body movements, and further identifies the type of driving fatigue. Based on the different types of driving fatigue, it retrieves and executes corresponding fatigue relief solutions, thus enabling targeted relief of driving fatigue.

[0055] like Figure 1 The diagram shows a flowchart of a method for alleviating driver fatigue according to an embodiment of the present invention. The method includes:

[0056] S100, collect the driver's driving status information, which includes facial information and body status information.

[0057] In this step, the driver's driving status information is collected. Specifically, a camera installed inside the vehicle collects information about the driver, including two parts: facial information and body state information. Facial information includes the driver's facial movements, such as blinking, opening the mouth, and head movements, while body state information includes the driver's upper limb movements and body twisting movements.

[0058] The S200 assesses the driving situation based on the driver's driving status information and determines the type of fatigue.

[0059] In this step, the driving situation is assessed based on the driver's driving status information. Specifically, the facial information collected is used to determine if the driver blinks excessively, closes their eyes for longer than a preset time, or shakes their head, indicating possible fatigue or drowsiness. Analysis of the driver's physical condition information is used to determine if the driver is pounding their shoulders or neck, or twisting their back. The presence of these behaviors indicates physical fatigue or discomfort, and therefore requires different relief methods. This determines whether the driver is experiencing drowsiness, fatigue, or both.

[0060] S300 retrieves the corresponding fatigue relief plan based on the type of fatigue and provides prompts for plan execution.

[0061] In this step, the corresponding fatigue relief plan is retrieved based on the type of fatigue. First, the specific type of fatigue experienced by the driver is determined, and then a fatigue relief plan tailored to that type is retrieved. To avoid startling the driver, permission must be obtained before execution, and a prompt must be given, primarily via voice. After the prompt, feedback from the driver should be received, which can be in the form of a recording. Based on the content of the recording, it is determined whether the driver has given permission.

[0062] The S400 controls the vehicle to complete the tasks included in the fatigue mitigation plan in order to alleviate the driver's fatigue.

[0063] In this step, the vehicle is controlled to complete the tasks included in the fatigue mitigation plan. For drowsy driving, the car audio system is automatically turned on to play stimulating music pre-set in the database, which can be recalled and played when needed. Simultaneously, the window opening height is adjusted according to the current driving environment to allow fresh air into the vehicle, helping the driver stay alert. When the outside temperature is low, the windows are periodically opened.

[0064] For types of fatigue and discomfort, such as lower back discomfort, adjust the tilt of the seat back. The adjustment speed should not exceed the preset value, and the tilt angle change should not exceed the preset value. During this process, the pressure on the seat is detected. When the seat pressure is minimal, the tilt position of the seat back is locked, and the ventilation and heating functions of the vehicle seat are turned on simultaneously to promote blood circulation in the driver's buttocks and improve fatigue.

[0065] like Figure 2 As shown, in a preferred embodiment of the present invention, the step of judging the driving situation and determining the type of fatigue based on the driver's driving status information specifically includes:

[0066] S201, analyze facial information, analyze the dynamics of the driver's facial features, and determine whether there are signs of fatigue. The dynamics of the facial features include blinking frequency, blinking time, the proportion of the eyes open, yawning behavior, and nodding behavior.

[0067] In this step, facial information is analyzed. Following a preset analysis sequence, the driver's eye information is first statistically analyzed to determine blink frequency, blink duration, and the proportion of eye opening. Blink duration is the length of time between two instances of the driver closing their eyes, and the proportion of eye opening is the ratio between the current exposed area of ​​the driver's eyeball and its maximum exposed area.

[0068] Next, the user's mouth opening is analyzed to determine if yawning is occurring. Finally, the user's entire head movement is analyzed to determine if nodding is occurring. If there is excessive blinking frequency, excessive blinking duration, insufficient eye opening, or at least two of the following: yawning and nodding, it indicates that the driver is experiencing fatigue.

[0069] In this embodiment, for the first type of fatigue and drowsiness, a first fatigue and drowsiness value can be calculated using the collected eye data. The specific calculation formula is as follows:

[0070]

[0071] Wherein, F1 represents the fatigue and drowsiness value, A represents the base score for the blink frequency item, B represents the base score for the blink time item, C represents the base score for the eye opening ratio item, f represents the blink frequency, f0 represents the standard value of the blink frequency, T represents the blink time, T0 represents the standard value of the blink time, and γ represents the eye opening ratio.

[0072] Furthermore, for the first type of fatigue and drowsiness, the second fatigue and drowsiness value can be calculated by collecting the number of yawns and nods per unit time. The specific calculation formula is as follows:

[0073]

[0074] Where F2 represents the second fatigue and drowsiness value, w1 represents the base score for the yawning item, w2 represents the base score for the nodding item, and n1 represents the number of yawns per unit time. n represents the normal number of yawns per unit time, and n² represents the number of nods per unit time. This indicates the normal number of nods per unit of time.

[0075] It should be noted that if either the first fatigue drowsiness value or the second fatigue drowsiness value exceeds the corresponding preset fatigue drowsiness value, the driver can be considered to be in a state of fatigue drowsiness.

[0076] S202, Analyze the physical condition information to determine the current physical condition type of the driver.

[0077] In this step, the body condition information is analyzed. If the driver is detected hitting their lower back, it indicates that the driver is experiencing fatigue and discomfort. Therefore, it can be determined that the driver is experiencing fatigue and discomfort. However, the two types of fatigue do not conflict and can coexist.

[0078] If, during this step, the driver is detected striking their lower back, it can be determined that the driver is experiencing fatigue or discomfort.

[0079] S203, determine the type of fatigue based on the body condition type and fatigue characteristics.

[0080] In this step, the type of fatigue is determined based on the physical condition and fatigue characteristics. Through analysis, it is determined whether the driver only experiences drowsiness or fatigue discomfort, or both, in order to determine the type of fatigue.

[0081] like Figure 3 As shown, in a preferred embodiment of the present invention, the step of retrieving the corresponding fatigue relief plan according to the fatigue type and providing a plan execution prompt specifically includes:

[0082] S301: Based on the fatigue type, search the preset solution database and retrieve the fatigue relief solution that matches it.

[0083] In this step, a preset solution database is retrieved based on the type of fatigue. For the same type of fatigue, such as drowsiness, there may be multiple fatigue characteristics, such as yawning and blinking. Therefore, there are multiple combinations of fatigue characteristics, so it is necessary to retrieve a fatigue relief solution that matches them.

[0084] S302 collects vehicle information based on the fatigue mitigation plan to obtain vehicle function information data.

[0085] In this step, vehicle information is collected according to the fatigue relief plan. By collecting vehicle information, the driver assistance functions that the vehicle currently has, such as seat ventilation, seat heating, and automatic sunroof opening, are collected to obtain vehicle function information data.

[0086] S303 adjusts the fatigue mitigation plan based on vehicle function information data and issues a prompt voice before execution.

[0087] In this step, the fatigue mitigation plan is adjusted based on vehicle function information data. Since different vehicle configurations have functional differences, functions that the current vehicle does not have need to be removed from the fatigue mitigation plan, and the remaining parts are used for direct execution.

[0088] like Figure 4 As shown, in a preferred embodiment of the present invention, the step of controlling the vehicle to complete the items included in the fatigue mitigation plan to alleviate the driver's fatigue state specifically includes:

[0089] S401: Collect voice confirmation information and determine whether to implement the fatigue relief plan.

[0090] In this step, voice confirmation information is collected. Before execution, the driver's permission is required. Therefore, after the prompt tone is issued, the driver's voice is collected to obtain voice confirmation information. Voice recognition is used to determine whether the driver has given permission. This step can also be confirmed by physical buttons, such as by turning the volume control button. If the voice confirmation information is not received, the voice prompt will be given again.

[0091] When S402 is executed, the fatigue relief scheme is parsed, and corresponding control instructions and the sequential relationship between the instructions are generated.

[0092] S403 executes control commands according to the sequential relationship between instructions and records audio in real time. Upon receiving a stop command, it stops executing the fatigue relief plan.

[0093] In this step, the fatigue relief plan is analyzed during execution, and executable control commands are extracted, such as opening the sunroof, opening the windows, and playing music. These commands can be switched according to a preset pattern, such as opening the windows for 10 minutes and then closing them, then opening the sunroof for 10 minutes, and then playing music for 10 minutes. This stimulates the driver with different content to relieve fatigue. During this process, the driver's stopping command is received through recording. If the driver says to exit the fatigue relief mode, the fatigue relief plan is stopped immediately.

[0094] like Figure 5 As shown, an embodiment of the present invention provides a driver fatigue relief system, the system comprising:

[0095] The status information acquisition module 100 is used to collect the driving status information of the driver, including facial information and body status information.

[0096] In this system, the status information acquisition module 100 collects the driver's driving status information. Specifically, it collects information about the driver through a camera installed in the vehicle. The collected information includes two parts: one part is the driver's facial information, and the other part is the driver's body status information. The facial information is the driver's facial movements, such as blinking, opening the mouth, and head movements. The body status information is the driver's upper limb movements and body twisting movements.

[0097] The fatigue type determination module 200 is used to judge the driving situation based on the driver's driving status information and determine the fatigue type.

[0098] In this system, the fatigue type determination module 200 judges the driving situation based on the driver's driving status information. Specifically, it first judges based on the collected facial information. During the judgment process, it analyzes whether the driver blinks too frequently, closes their eyes for longer than a preset value, or shakes their head. Based on this, it can determine whether the driver is experiencing fatigue or drowsiness. The analysis of the driver's physical condition information is used to judge whether the user is pounding their shoulders and neck or twisting their waist and back. When the above situations occur, it indicates that the driver is experiencing physical fatigue and discomfort. Therefore, the relief methods required for the two are different, that is, to determine whether the driver belongs to the fatigue and drowsiness type, the fatigue and discomfort type, or both types.

[0099] The solution selection module 300 is used to retrieve the corresponding fatigue relief solution based on the type of fatigue and provide prompts for solution execution.

[0100] In this system, the solution selection module 300 retrieves the corresponding fatigue relief solution based on the fatigue type. First, it determines the specific fatigue type of the driver, and then retrieves the corresponding fatigue relief solution. To avoid startling the driver, permission must be obtained from the driver before execution, and a prompt must be given. The prompt is mainly in the form of voice prompts, and after the prompt ends, feedback from the driver can be received, which can be in the form of a recording. Based on the content of the recording, it is determined whether the driver has given permission.

[0101] The scheme execution module 400 is used to control the vehicle to complete the items included in the fatigue relief scheme in order to alleviate the driver's fatigue.

[0102] In this system, the solution execution module 400 controls the vehicle to complete the items included in the fatigue relief plan according to the fatigue relief plan. For drowsy fatigue, the system actively turns on the car audio and plays stimulating music that is preset in the backup database and can be retrieved and played when needed. At the same time, the system adjusts the opening height of the car windows according to the current driving environment to allow fresh air to enter the vehicle and help the driver stay awake. When the outside temperature is low, the windows are opened periodically. For fatigue discomfort, such as lower back discomfort, the system adjusts the tilt of the seat back. The adjustment speed and tilt angle do not exceed the preset value. During this process, the pressure on the seat is detected. When the seat pressure is minimal, the tilt position of the seat back is locked, and the ventilation and heating functions of the vehicle seats are activated simultaneously to promote blood circulation in the driver's buttocks and improve fatigue.

[0103] like Figure 6 As shown, in a preferred embodiment of the present invention, the fatigue type determination module 200 includes:

[0104] The feature recognition unit 201 is used to analyze facial information, analyze the dynamics of the driver's facial features, and determine whether there are fatigue characteristics. The dynamics of the facial features include blinking frequency, blinking time, the proportion of the eyes open, yawning behavior, and nodding behavior.

[0105] In this module, the feature recognition unit 201 analyzes facial information. Following a preset analysis sequence, it first statistically analyzes the driver's eye information to determine the blinking frequency, blinking time, and the proportion of eye opening. Blinking time is the length of time between two eye closures, and the proportion of eye opening is the ratio between the current exposed area of ​​the driver's eyeball and the maximum exposed area. Then, it analyzes the user's mouth opening to determine if there is yawning. Finally, it analyzes the user's entire head movement to determine if there is nodding. If there are at least two of the following: excessively high blinking frequency, excessively long blinking time, excessively low eye opening ratio, yawning, and nodding, it indicates that the driver is experiencing driving fatigue.

[0106] The state recognition unit 202 is used to analyze the body state information and determine the current driver's body state type.

[0107] In this module, the state recognition unit 202 analyzes the body state information. If it detects that the driver is hitting his waist, it means that the driver is experiencing fatigue and discomfort. Therefore, it can be determined that the driver is experiencing fatigue and discomfort. However, the two types of fatigue do not conflict and can coexist.

[0108] Type confirmation unit 203 is used to determine the fatigue type based on the body state type and fatigue characteristics.

[0109] In this module, the type confirmation unit 203 determines the fatigue type based on the physical condition type and fatigue characteristics. Through analysis, it determines whether the driver only experiences drowsiness or fatigue discomfort, or both, in order to determine the fatigue type.

[0110] like Figure 7 As shown, in a preferred embodiment of the present invention, the scheme selection module 300 includes:

[0111] The data retrieval unit 301 is used to retrieve a preset solution database based on the type of fatigue and retrieve a fatigue relief solution that matches it.

[0112] In this module, the data retrieval unit 301 retrieves a preset solution database based on the type of fatigue. For the same type of fatigue, such as drowsiness, it may contain multiple fatigue characteristics, such as yawning and blinking. Therefore, there are multiple combinations of fatigue characteristics, so it is necessary to retrieve a fatigue relief solution that matches them.

[0113] The vehicle information collection unit 302 is used to collect vehicle information according to the fatigue mitigation plan and obtain vehicle function information data.

[0114] In this module, the vehicle information collection unit 302 collects vehicle information according to the fatigue relief plan. By collecting vehicle information, it gathers information on the current vehicle's driver assistance functions, such as seat ventilation, seat heating, and automatic sunroof opening, thereby obtaining vehicle function information data.

[0115] The scheme adjustment unit 303 is used to adjust the fatigue relief scheme according to the vehicle function information data and issue a prompt voice before execution.

[0116] In this module, the scheme adjustment unit 303 adjusts the fatigue mitigation scheme based on vehicle function information data. Since there are functional differences in different vehicle configurations, it is necessary to remove functions that the current vehicle does not have from the fatigue mitigation scheme, and the remaining part is used for direct execution.

[0117] like Figure 8 As shown, in a preferred embodiment of the present invention, the scheme execution module 400 includes:

[0118] The execution determination unit 401 is used to collect voice confirmation information and determine whether to execute the fatigue relief plan.

[0119] In this module, the execution judgment unit 401 collects voice confirmation information. Before execution, permission from the driver is required. Therefore, after issuing a prompt tone, the driver's voice is collected to obtain voice confirmation information. Through voice recognition, it is determined whether the driver has permission. This step can also be confirmed by physical buttons, such as by rotating the volume adjustment button. If the voice confirmation information is not received, the voice prompt is issued again.

[0120] The instruction recognition unit 402 is used to parse the fatigue relief scheme during execution and generate corresponding control instructions and the sequential relationship between the instructions.

[0121] The execution control unit 403 is used to execute control commands according to the sequential relationship between instructions and record the audio in real time. Upon receiving a stop command, it stops executing the fatigue relief plan.

[0122] In this module, during execution, the fatigue relief scheme is analyzed, and executable control commands are extracted, such as opening the sunroof, opening the windows, and playing music. These commands can be switched according to a preset pattern, such as opening the windows for 10 minutes and then closing them, then opening the sunroof for 10 minutes, and then playing music for 10 minutes. This achieves the effect of stimulating the driver with different content to relieve fatigue. During this process, the module receives parking commands from the driver through recording. If the driver says to exit the fatigue relief mode, the fatigue relief scheme is stopped immediately.

[0123] It should be understood that although the steps in the flowcharts of the various embodiments of the present invention are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the various embodiments may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least a portion of the sub-steps or stages of other steps.

[0124] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments described above. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and RAMbus dynamic RAM (RDRAM), etc.

[0125] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0126] The embodiments described above are merely illustrative of several implementations of the present invention, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of the present invention. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of the present invention, and these modifications and improvements all fall within the scope of protection of the present invention. Therefore, the scope of protection of this patent should be determined by the appended claims.

[0127] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A method for alleviating driver fatigue, characterized in that, The method includes: Collect driver status information, including facial information and body status information; The driving situation is assessed based on the driver's driving status information to determine the type of fatigue. Retrieve the corresponding fatigue relief plan based on the type of fatigue and provide prompts for plan execution; The vehicle is controlled to complete the tasks included in the fatigue relief plan in order to alleviate the driver's fatigue. The step of judging the driving situation and determining the type of fatigue based on the driver's driving status information specifically includes: Facial information is analyzed to assess the dynamics of the driver's facial features and determine whether fatigue is present. These dynamics include blinking frequency, blinking duration, eye opening ratio, yawning behavior, and nodding behavior. Analyze the physical condition information to determine the current physical condition type of the driver; The type of fatigue is determined based on the type of physical condition and the characteristics of fatigue. The first fatigue and drowsiness value is calculated using collected eye data, and the specific calculation formula is as follows: ； in, This indicates the fatigue and drowsiness level. This represents the base score for the blink frequency item. This indicates the base score for the blinking time item. This indicates the base score for the item representing the proportion of eyes open. Indicates blink frequency, Standard values ​​representing blink frequency Indicates the blink time. Standard values ​​representing blink time This represents the proportion of eyes that are open. The second fatigue drowsiness value is calculated by collecting the number of yawns and nods per unit time. The specific calculation formula is as follows: ； in, This indicates the second level of fatigue and drowsiness. This indicates the base score for the yawning item. This indicates the base score for the nodding item. This indicates the number of times one yawns per unit of time. This indicates the normal number of yawns per unit of time. This indicates the number of nods per unit of time. This indicates the normal number of nods per unit of time; If either the first fatigue drowsiness value or the second fatigue drowsiness value exceeds the corresponding preset fatigue drowsiness value, the driver is considered to be in a state of fatigue drowsiness. If the system detects the driver striking their lower back, it indicates that the driver is experiencing fatigue or discomfort. To address the type of fatigue or discomfort, such as lower back pain, the system adjusts the seat backrest tilt and simultaneously activates the vehicle's seat ventilation and heating functions to promote blood circulation in the driver's buttocks and alleviate fatigue. For driver fatigue and drowsiness, the system will proactively turn on the car audio system and play stimulating music. The opening height of the windows will be adjusted according to the current driving environment to allow fresh air to enter the vehicle and help the driver stay alert. When the outside temperature is low, the windows will be opened periodically.

2. The method for alleviating driver fatigue according to claim 1, characterized in that, The steps of retrieving the corresponding fatigue relief plan based on the fatigue type and providing prompts for plan execution specifically include: Based on the type of fatigue, a preset solution database is searched to retrieve a matching fatigue relief solution; Vehicle information is collected based on fatigue mitigation plans to obtain vehicle functional information data; The fatigue mitigation plan is adjusted based on vehicle function information data, and a prompt voice is issued before execution.

3. The method for alleviating driving fatigue according to claim 1, characterized in that, The steps of controlling the vehicle to complete the tasks included in the fatigue mitigation plan in order to alleviate the driver's fatigue include: Collect voice confirmation information and determine whether to implement the fatigue relief plan; During execution, the fatigue relief scheme is analyzed to generate corresponding control commands and the sequential relationship between the commands; Control commands are executed according to the sequential relationship between instructions, and the recording is performed in real time. Upon receiving a stop command, the fatigue relief plan is stopped.

4. The method for alleviating driver fatigue according to claim 3, characterized in that, If no voice confirmation is received, a voice prompt will be given again.

5. The method for alleviating driving fatigue according to claim 3, characterized in that, The fatigue relief measures include playing music, controlling seat assist functions, and controlling the window status.

6. A driver fatigue relief system, characterized in that, The system employs the driving fatigue relief method as described in any one of claims 1 to 5, and the system comprises: The status information acquisition module is used to collect the driver's driving status information, which includes facial information and body status information; The fatigue type determination module is used to judge the driving situation based on the driver's driving status information and determine the fatigue type; The solution selection module is used to retrieve the corresponding fatigue relief solution based on the type of fatigue and provide prompts for solution execution. The solution execution module is used to control the vehicle to complete the tasks included in the fatigue relief plan in order to alleviate the driver's fatigue.

7. The driver fatigue relief system according to claim 6, characterized in that, The fatigue type determination module includes: The feature recognition unit is used to analyze facial information, analyze the dynamics of the driver's facial features, and determine whether there are signs of fatigue. The dynamics of the facial features include blinking frequency, blinking time, the proportion of the eyes open, yawning behavior, and nodding behavior. The status recognition unit is used to analyze body status information and determine the current physical status type of the driver; The type confirmation unit is used to determine the fatigue type based on the body condition type and fatigue characteristics.

8. The driver fatigue relief system according to claim 6, characterized in that, The scheme selection module includes: The data retrieval unit is used to search a preset solution database based on the type of fatigue and retrieve the corresponding fatigue relief solution. The vehicle information collection unit is used to collect vehicle information according to the fatigue mitigation plan and obtain vehicle functional information data. The scheme adjustment unit is used to adjust the fatigue mitigation scheme based on vehicle function information data and issue a prompt voice before execution.

9. The driver fatigue relief system according to claim 6, characterized in that, The scheme execution module includes: The execution determination unit is used to collect voice confirmation information and determine whether to execute the fatigue relief plan; The instruction recognition unit is used to parse the fatigue relief scheme during execution and generate corresponding control instructions and the sequential relationship between the instructions; The execution control unit is used to execute control commands according to the sequential relationship between instructions, and records the audio in real time. Upon receiving a stop command, it stops executing the fatigue relief plan.

Images