Method, apparatus, device and storage medium for relieving driving fatigue

Abstract

The application discloses a driving fatigue relieving method, device, equipment and storage medium, the method obtains the personal information of the driver when detecting that the fatigue relieving function is opened, and customizes the driving cognitive task according to the personal information; the driving test question is generated according to the driving cognitive task, the driving test question is displayed on the display device of the current vehicle and is broadcasted by voice; after receiving the feedback information of the driver, the fatigue degree of the driver is determined according to the feedback information, the electric stimulation strategy is determined according to the fatigue degree, the fatigue reminder is carried out on the driver according to the electric stimulation strategy, the driver can be efficiently relieved from driving fatigue without affecting the normal operation of the driver, the applicability is strong, the implementation is easy, the relieving effect is better, the driving safety is improved, the traffic accidents caused by driving fatigue are reduced, and the speed and efficiency of driving fatigue relieving are improved.

Description

Technical Field

[0001] This invention relates to the field of safe driving technology, and in particular to a method, device, equipment and storage medium for alleviating driving fatigue. Background Technology

[0002] Simply detecting driver fatigue cannot directly improve road safety. Researching effective methods to alleviate driver fatigue is essential to fundamentally reduce the probability of traffic accidents caused by driver fatigue. Currently, methods for alleviating driver fatigue are mainly divided into those that address external objective stimuli and those that focus on subjective cognition. External objective stimuli methods primarily utilize auditory, visual, olfactory, and tactile stimuli for relief.

[0003] Current research on objective methods for alleviating driver fatigue has yielded some results, but these methods directly stimulate human senses, significantly impacting driving performance. For example, facial stimulation from low temperatures leads to a poor driving experience; playing music of different rhythms has varying effects on driver fatigue, with slow-paced music even exacerbating it; prolonged olfactory stimulation can lead to olfactory desensitization, greatly reducing fatigue relief. Therefore, objective methods still have limitations. Subjective cognitive methods have poor universality and cannot be implemented in certain special road conditions; the cognitive load of tasks is often poorly distributed, and individual differences are significant. Overall, single-method fatigue relief has certain limitations. Therefore, this invention addresses the shortcomings of the existing technologies by proposing a method for alleviating driver fatigue that integrates objective external stimuli and subjective cognition. Summary of the Invention

[0004] The main objective of this invention is to provide a method, device, equipment, and storage medium for relieving driving fatigue, aiming to solve the technical problems of existing single-stimulus relief methods having limitations, being unable to be implemented in special environments, and having poor universality of fatigue relief effects.

[0005] In a first aspect, the present invention provides a method for alleviating driving fatigue, the method comprising the following steps:

[0006] When the driver's fatigue relief function is detected to be activated, the driver's personal information is obtained, and a driving cognitive task is customized based on the personal information.

[0007] Based on the driving cognitive task, a driving test question is generated, and the driving test question is displayed on the display device of the current vehicle and read aloud via voice.

[0008] After receiving feedback from the driver, the driver's fatigue level is determined based on the feedback, an electrical stimulation strategy is determined based on the fatigue level, and a fatigue reminder is given to the driver based on the electrical stimulation strategy.

[0009] Optionally, when the fatigue relief function is detected to be activated, obtaining the driver's personal information and customizing a driving cognitive task based on the personal information includes:

[0010] The driver's real-time image and the current vehicle's central control unit feedback information are obtained, and the fatigue relief function is determined to be activated based on the central control unit feedback information and the real-time image.

[0011] When the fatigue relief function is detected to be activated, the driver's personal information is obtained;

[0012] Based on the personal information, a driving cognitive task matching the driver is retrieved from a preset database.

[0013] Optionally, the step of acquiring the driver's real-time image and the current vehicle's central control unit feedback information, and determining whether the fatigue relief function is activated based on the central control unit feedback information and the real-time image, includes:

[0014] Acquire real-time images of the driver and feedback information from the vehicle's central control unit;

[0015] When the central control unit provides feedback that the fatigue relief function button has been triggered, and the real-time image shows that the driver is fully wearing the fatigue relief device, it is determined that the fatigue relief function has been activated.

[0016] If the central control unit reports that the fatigue relief function button is not triggered, or if the real-time image shows that the driver is not fully wearing the fatigue relief device, it is determined that the fatigue relief function is not activated.

[0017] Optionally, the step of generating driving test questions based on the driving cognitive task, displaying the driving test questions on the display device of the current vehicle, and broadcasting them via voice includes:

[0018] Based on the driving cognitive task, task type selection information is generated, and the task type selection information is displayed on the display device of the current vehicle and announced by voice.

[0019] After receiving the driver's task type selection information, the system selects a corresponding question from the driving cognition task as a driving test question based on the task type selection information.

[0020] The driving test questions are displayed on the vehicle's display device and announced via voice.

[0021] Optionally, after receiving feedback information from the driver, determining the driver's fatigue level based on the feedback information, determining an electrical stimulation strategy based on the fatigue level, and providing fatigue reminders to the driver based on the electrical stimulation strategy, includes:

[0022] After receiving feedback from the driver, the system extracts the corresponding voice response, calculates the matching degree between the voice response and a preset answer, and determines the driver's fatigue level based on the matching degree.

[0023] If no feedback is received from the driver, the driver's current monitoring image is acquired, and the driver's fatigue level is determined based on the current monitoring image.

[0024] An electrical stimulation strategy is determined based on the degree of fatigue. The number of electrical stimulations and the intensity of electrical stimulation are determined based on the electrical stimulation strategy. The electrical stimulation device is then controlled to provide fatigue reminders to the driver based on the number of electrical stimulations and the intensity of electrical stimulation.

[0025] Optionally, the step of acquiring the driver's current monitoring image and determining the driver's fatigue level based on the current monitoring image when no feedback information is received from the driver includes:

[0026] If no feedback is received from the driver, acquire the driver's current monitoring image;

[0027] The driver's eyelid opening and trunk offset angle are determined from the current monitoring image. The eyelid opening and trunk offset angle are compared with the corresponding preset fatigue judgment thresholds. The driver's fatigue level is determined based on the comparison results.

[0028] Optionally, the step of determining an electrical stimulation strategy based on the degree of fatigue, determining the number of electrical stimulations and the intensity of electrical stimulation based on the electrical stimulation strategy, and controlling the electrical stimulation device to provide fatigue reminders to the driver based on the number of electrical stimulations and the intensity of electrical stimulation includes:

[0029] According to the preset strategy mapping table, the electrical stimulation strategy corresponding to the fatigue level is queried, and the number of electrical stimulations and the intensity of electrical stimulation corresponding to the electrical stimulation strategy are obtained.

[0030] Based on the number of electrical stimulations and the intensity of the electrical stimulation, the pulsed electronic acupuncture and electrotherapy device in the electrical stimulation device outputs a target current through conductive cloth to the driver's acupoint electrical stimulation gloves to complete the fatigue reminder for the driver.

[0031] Secondly, to achieve the above objectives, the present invention also provides a driver fatigue relief device, the driver fatigue relief device comprising:

[0032] The task customization module is used to obtain the driver's personal information when the fatigue relief function is detected to be activated, and to customize driving cognitive tasks based on the personal information.

[0033] The testing module is used to generate driving test questions based on the driving cognitive task, display the driving test questions on the display device of the current vehicle, and broadcast them via voice.

[0034] The fatigue relief module is used to receive feedback information from the driver, determine the driver's fatigue level based on the feedback information, determine an electrical stimulation strategy based on the fatigue level, and provide fatigue reminders to the driver based on the electrical stimulation strategy.

[0035] Thirdly, to achieve the above objectives, the present invention also proposes a driver fatigue relief device, the driver fatigue relief device comprising: a memory, a processor, and a driver fatigue relief program stored in the memory and executable on the processor, the driver fatigue relief program being configured to implement the steps of the driver fatigue relief method as described above.

[0036] Fourthly, to achieve the above objectives, the present invention also proposes a storage medium storing a driving fatigue relief program, wherein the driving fatigue relief program, when executed by a processor, implements the steps of the driving fatigue relief method described above.

[0037] The driving fatigue relief method proposed in this invention obtains the driver's personal information when the fatigue relief function is detected to be activated, and customizes a driving cognitive task based on the personal information; generates driving test questions based on the driving cognitive task, displays the driving test questions on the display device of the current vehicle, and broadcasts them aloud; after receiving feedback information from the driver, determines the driver's fatigue level based on the feedback information, determines an electrical stimulation strategy based on the fatigue level, and provides fatigue reminders to the driver based on the electrical stimulation strategy. This method can efficiently relieve driving fatigue without affecting the driver's normal operation, has strong applicability, is easy to implement, has better relief effect, improves driving safety, reduces traffic accidents caused by driving fatigue, and improves the speed and efficiency of driving fatigue relief. Attached Figure Description

[0038] Figure 1 This is a schematic diagram of the device structure of the hardware operating environment involved in the embodiments of the present invention;

[0039] Figure 2 This is a flowchart illustrating the first embodiment of the driver fatigue relief method of the present invention;

[0040] Figure 3 This is a flowchart illustrating the second embodiment of the driver fatigue relief method of the present invention;

[0041] Figure 4 This is a flowchart illustrating the third embodiment of the driver fatigue relief method of the present invention;

[0042] Figure 5 This is a flowchart illustrating the fourth embodiment of the driver fatigue relief method of the present invention;

[0043] Figure 6 This is a functional block diagram of the first embodiment of the driver fatigue relief device of the present invention.

[0044] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0045] It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

[0046] The solution of this invention mainly involves: acquiring the driver's personal information when the fatigue relief function is detected to be activated, and customizing a driving cognitive task based on the personal information; generating driving test questions based on the driving cognitive task, displaying the driving test questions on the display device of the current vehicle and broadcasting them via voice; receiving feedback information from the driver, determining the driver's fatigue level based on the feedback information, determining an electrical stimulation strategy based on the fatigue level, and providing fatigue reminders to the driver based on the electrical stimulation strategy. This solution can efficiently relieve driver fatigue without affecting the driver's normal operation, has strong applicability, is easy to implement, has better relief effect, improves driving safety, reduces traffic accidents caused by driver fatigue, and improves the speed and efficiency of driver fatigue relief. It solves the technical problems of existing single relief stimulation methods having limitations, being unable to be executed in special environments, and having poor universality of fatigue relief effect.

[0047] Reference Figure 1 , Figure 1 This is a schematic diagram of the device structure of the hardware operating environment involved in the embodiments of the present invention.

[0048] like Figure 1As shown, the device may include: a processor 1001, such as a CPU; a communication bus 1002; a user interface 1003; a network interface 1004; and a memory 1005. The communication bus 1002 is used to enable communication between these components. The user interface 1003 may include a display screen or an input unit such as a keyboard; optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface). The memory 1005 may be high-speed RAM or non-volatile memory, such as a disk drive. Optionally, the memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0049] Those skilled in the art will understand that Figure 1 The device structure shown does not constitute a limitation on the device and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0050] like Figure 1 As shown, the memory 1005, which serves as a storage medium, may include an operating device, a network communication module, a user interface module, and a driver fatigue mitigation program.

[0051] The device of the present invention calls the driver fatigue mitigation program stored in the memory 1005 through the processor 1001 and performs the following operations:

[0052] When the driver's fatigue relief function is detected to be activated, the driver's personal information is obtained, and a driving cognitive task is customized based on the personal information.

[0053] Based on the driving cognitive task, a driving test question is generated, and the driving test question is displayed on the display device of the current vehicle and read aloud via voice.

[0054] After receiving feedback from the driver, the driver's fatigue level is determined based on the feedback, an electrical stimulation strategy is determined based on the fatigue level, and a fatigue reminder is given to the driver based on the electrical stimulation strategy.

[0055] The device of the present invention calls the driver fatigue mitigation program stored in the memory 1005 through the processor 1001, and also performs the following operations:

[0056] The driver's real-time image and the current vehicle's central control unit feedback information are obtained, and the fatigue relief function is determined to be activated based on the central control unit feedback information and the real-time image.

[0057] When the fatigue relief function is detected to be activated, the driver's personal information is obtained;

[0058] Based on the personal information, a driving cognitive task matching the driver is retrieved from a preset database.

[0059] The device of the present invention calls the driver fatigue mitigation program stored in the memory 1005 through the processor 1001, and also performs the following operations:

[0060] Acquire real-time images of the driver and feedback information from the vehicle's central control unit;

[0061] When the central control unit provides feedback that the fatigue relief function button has been triggered, and the real-time image shows that the driver is fully wearing the fatigue relief device, it is determined that the fatigue relief function has been activated.

[0062] If the central control unit reports that the fatigue relief function button is not triggered, or if the real-time image shows that the driver is not fully wearing the fatigue relief device, it is determined that the fatigue relief function is not activated.

[0063] The device of the present invention calls the driver fatigue mitigation program stored in the memory 1005 through the processor 1001, and also performs the following operations:

[0064] Based on the driving cognitive task, task type selection information is generated, and the task type selection information is displayed on the display device of the current vehicle and announced by voice.

[0065] After receiving the driver's task type selection information, the system selects a corresponding question from the driving cognition task as a driving test question based on the task type selection information.

[0066] The driving test questions are displayed on the vehicle's display device and announced via voice.

[0067] The device of the present invention calls the driver fatigue mitigation program stored in the memory 1005 through the processor 1001, and also performs the following operations:

[0068] After receiving feedback from the driver, the system extracts the corresponding voice response, calculates the matching degree between the voice response and a preset answer, and determines the driver's fatigue level based on the matching degree.

[0069] If no feedback is received from the driver, the driver's current monitoring image is acquired, and the driver's fatigue level is determined based on the current monitoring image.

[0070] An electrical stimulation strategy is determined based on the degree of fatigue. The number of electrical stimulations and the intensity of electrical stimulation are determined based on the electrical stimulation strategy. The electrical stimulation device is then controlled to provide fatigue reminders to the driver based on the number of electrical stimulations and the intensity of electrical stimulation.

[0071] The device of the present invention calls the driver fatigue mitigation program stored in the memory 1005 through the processor 1001, and also performs the following operations:

[0072] If no feedback is received from the driver, acquire the driver's current monitoring image;

[0073] The driver's eyelid opening and trunk offset angle are determined from the current monitoring image. The eyelid opening and trunk offset angle are compared with the corresponding preset fatigue judgment thresholds. The driver's fatigue level is determined based on the comparison results.

[0074] The device of the present invention calls the driver fatigue mitigation program stored in the memory 1005 through the processor 1001, and also performs the following operations:

[0075] According to the preset strategy mapping table, the electrical stimulation strategy corresponding to the fatigue level is queried, and the number of electrical stimulations and the intensity of electrical stimulation corresponding to the electrical stimulation strategy are obtained.

[0076] Based on the number of electrical stimulations and the intensity of the electrical stimulation, the pulsed electronic acupuncture and electrotherapy device in the electrical stimulation device outputs a target current through conductive cloth to the driver's acupoint electrical stimulation gloves to complete the fatigue reminder for the driver.

[0077] This embodiment, through the above-described scheme, obtains the driver's personal information when the fatigue relief function is detected to be activated, and customizes a driving cognitive task based on the personal information; generates driving test questions based on the driving cognitive task, displays the driving test questions on the current vehicle's display device, and broadcasts them via voice; after receiving feedback information from the driver, determines the driver's fatigue level based on the feedback information, determines an electrical stimulation strategy based on the fatigue level, and provides fatigue reminders to the driver based on the electrical stimulation strategy. This can efficiently relieve driver fatigue without affecting the driver's normal operation, has strong applicability, is easy to implement, has better relief effect, improves driving safety, reduces traffic accidents caused by driver fatigue, and improves the speed and efficiency of driver fatigue relief.

[0078] Based on the above hardware structure, an embodiment of the driving fatigue relief method of the present invention is proposed.

[0079] Reference Figure 2 , Figure 2 This is a flowchart illustrating the first embodiment of the driver fatigue relief method of the present invention.

[0080] In a first embodiment, the method for alleviating driver fatigue includes the following steps:

[0081] Step S10: When the fatigue relief function is detected to be activated, obtain the driver's personal information and customize a driving cognition task based on the personal information.

[0082] It should be noted that when the fatigue relief function is detected to be activated, the driver's personal information is obtained. The personal information is the personal data that the driver has pre-recorded in the central control unit of the current vehicle. Based on the personal information, a driving cognitive task that matches the driver's knowledge and cultural level and caters to the driver's interests is customized.

[0083] Step S20: Generate driving test questions based on the driving cognition task, and display and announce the driving test questions on the display device of the current vehicle.

[0084] It is understood that driving test questions can be generated based on the driving cognitive task to conduct questioning tests on the driver, and then the driving test questions can be displayed on the display device of the current vehicle and broadcast by voice so that the driver can see and hear the corresponding driving test questions.

[0085] Step S30: After receiving the feedback information from the driver, determine the driver's fatigue level based on the feedback information, determine the electrical stimulation strategy based on the fatigue level, and provide fatigue reminders to the driver based on the electrical stimulation strategy.

[0086] It should be understood that after receiving feedback from the driver regarding driving test issues, the driver's fatigue level can be further analyzed and determined based on the feedback. Different electrical stimulation strategies can be determined based on the different levels of fatigue, and then the driver can be given a fatigue reminder based on the electrical stimulation strategies.

[0087] This embodiment, through the above-described scheme, obtains the driver's personal information when the fatigue relief function is detected to be activated, and customizes a driving cognitive task based on the personal information; generates driving test questions based on the driving cognitive task, displays the driving test questions on the current vehicle's display device, and broadcasts them via voice; after receiving feedback information from the driver, determines the driver's fatigue level based on the feedback information, determines an electrical stimulation strategy based on the fatigue level, and provides fatigue reminders to the driver based on the electrical stimulation strategy. This can efficiently relieve driver fatigue without affecting the driver's normal operation, has strong applicability, is easy to implement, has better relief effect, improves driving safety, reduces traffic accidents caused by driver fatigue, and improves the speed and efficiency of driver fatigue relief.

[0088] Furthermore, Figure 3 This is a flowchart illustrating the second embodiment of the driver fatigue relief method of the present invention, as shown below. Figure 3 As shown, based on the first embodiment, a second embodiment of the driving fatigue relief method of the present invention is proposed. In this embodiment, step S10 specifically includes the following steps:

[0089] Step S11: Obtain the driver's real-time image and the current vehicle's central control unit feedback information, and determine whether the fatigue relief function is activated based on the central control unit feedback information and the real-time image.

[0090] It should be noted that the driver's real-time image is generally obtained through the vehicle's camera, and the feedback information from the vehicle's central control unit is obtained by the central control unit based on relevant operation commands. The driver determines whether the fatigue relief function is activated based on the feedback information from the central control unit and the real-time image.

[0091] Furthermore, step S11 specifically includes the following steps:

[0092] Acquire real-time images of the driver and feedback information from the vehicle's central control unit;

[0093] When the central control unit provides feedback that the fatigue relief function button has been triggered, and the real-time image shows that the driver is fully wearing the fatigue relief device, it is determined that the fatigue relief function has been activated.

[0094] If the central control unit reports that the fatigue relief function button is not triggered, or if the real-time image shows that the driver is not fully wearing the fatigue relief device, it is determined that the fatigue relief function is not activated.

[0095] It should be understood that after obtaining the driver's real-time image and the current vehicle's central control unit feedback information, further analysis can be performed. When the central control unit feedback information indicates that the fatigue relief function button has been triggered and the real-time image shows that the driver has fully worn the fatigue relief device, it can be determined that the fatigue relief function has been activated. Conversely, when the central control unit feedback information indicates that the fatigue relief function button has not been triggered, or when the real-time image shows that the driver has not fully worn the fatigue relief device, it can be determined that the fatigue relief function has not been activated.

[0096] Step S12: When the fatigue relief function is detected to be activated, obtain the driver's personal information.

[0097] It is understandable that when the fatigue relief function is detected to be activated, the driver's personal information stored in advance can be retrieved through the central control unit.

[0098] Step S13: Retrieve a driving cognitive task matching the driver from a preset database based on the personal information.

[0099] It should be understood that, based on the personal information, a driving cognitive task matching the driver's personal information can be retrieved from a pre-set database.

[0100] This embodiment, through the above-described scheme, acquires real-time images of the driver and feedback information from the vehicle's central control unit. Based on the feedback information and the real-time images, it determines whether the fatigue relief function is activated. When the fatigue relief function is detected to be activated, the driver's personal information is acquired. Based on the personal information, a driving cognitive task matching the driver is retrieved from a preset database. This allows for the rapid acquisition of a driving cognitive task matching the current driver, preparing for subsequent precise questioning of the driver, and further improving the speed and efficiency of driving fatigue relief.

[0101] Furthermore, Figure 4 This is a flowchart illustrating the third embodiment of the driver fatigue relief method of the present invention, as shown below. Figure 4 As shown, based on the first embodiment, a third embodiment of the driving fatigue relief method of the present invention is proposed. In this embodiment, step S20 specifically includes the following steps:

[0102] Step S21: Generate task type selection information based on the driving cognition task, display the task type selection information on the display device of the current vehicle, and announce it by voice.

[0103] It should be noted that there are different task types in the driving cognition task. The driving cognition task can generate task type selection information, which is then displayed on the display device of the current vehicle and announced by voice.

[0104] Step S22: After receiving the task type selection information from the driver, select the corresponding question from the driving cognition task as the driving test question according to the task type selection information.

[0105] It is understandable that after receiving the driver's task type selection information, a question of the corresponding type can be selected from the driving cognitive task as a driving test question based on the task type selection information.

[0106] Step S23: Display the driving test question on the display device of the current vehicle and announce it via voice.

[0107] It should be understood that, after obtaining the driving test question, the driving test question can be displayed on the display device of the current vehicle and announced by voice so that the driver can hear and see it.

[0108] In practice, personalized information collection questionnaires can be used to automatically generate driving cognitive tasks that match the driver's knowledge and cultural level and cater to their interests. These customized driving sub-tasks are mainly divided into three types: descriptive cognitive tasks, mental arithmetic cognitive tasks, and memorization cognitive tasks. The content and keywords for descriptive cognitive tasks are shown in Table 1; the content and keywords for mental arithmetic cognitive tasks are shown in Table 2; and the content and keywords for memorization cognitive tasks are shown in Table 3.

[0109] Table 1 Description of Driving Sub-tasks

[0110]

[0111] Table 2. Mental Arithmetic-related Driving Sub-tasks

[0112]

[0113]

[0114] Table 3. Memorization-based driving sub-tasks

[0115]

[0116] The system collects personalized information about drivers' knowledge and cultural level and areas of interest (such as mathematics, Chinese, English, music, biology, geography, history, and sports). It automatically generates driving cognitive tasks that match the driver's knowledge and cultural level and cater to the driver's interests, and helps the driver to rationally plan the order and time of driving sub-tasks.

[0117] The task adjustment module provides drivers with the ability to switch between driving sub-tasks. When a driver determines that the current driving sub-task is causing excessive cognitive load and affecting driving operation, they can directly switch to skip that sub-task, improving driving safety. Furthermore, this adjustment module has a function to return to the previous driving sub-task, allowing drivers to select a wider range of cognitive loads that match their individual capacity. The customized driving sub-task configuration module generates driving sub-task keywords and transmits these keywords to a keyword reminder device. This device then broadcasts the keywords via a speaker, allowing the driver to perform a series of driving sub-tasks based on the keywords.

[0118] This embodiment, through the above-described scheme, generates task type selection information through the driving cognition task, displays the task type selection information on the current vehicle's display device, and broadcasts it via voice. After receiving the driver's task type selection information, it selects a corresponding question from the driving cognition task as a driving test question based on the task type selection information. Displaying the driving test question on the current vehicle's display device and broadcasting it via voice enables the driver to be quickly asked driving test questions, further improving the speed and efficiency of driving fatigue relief.

[0119] Furthermore, Figure 5 This is a flowchart illustrating the fourth embodiment of the driver fatigue relief method of the present invention, as shown below. Figure 5 As shown, based on the first embodiment, a fourth embodiment of the driving fatigue relief method of the present invention is proposed. In this embodiment, step S30 specifically includes the following steps:

[0120] Step S31: After receiving the feedback information from the driver, extract the voice response corresponding to the feedback information, calculate the matching degree between the voice response and the preset answer, and determine the driver's fatigue level based on the matching degree.

[0121] It should be noted that after receiving the feedback information from the driver, the voice response corresponding to the feedback information is extracted, and the matching degree between the voice response and the preset answer is further calculated. The driver's fatigue level is determined based on the matching degree. Different matching degrees correspond to different fatigue levels. The relevant parameters can be adjusted and set according to the actual situation. This embodiment does not impose any restrictions on this.

[0122] Step S32: If no feedback information is received from the driver, obtain the current monitoring image of the driver and determine the driver's fatigue level based on the current monitoring image.

[0123] It should be understood that when no feedback information is received from the driver, i.e., no voice response is received from the driver, it is necessary to further obtain the current monitoring image of the driver and determine the driver's fatigue level based on the current monitoring image.

[0124] Furthermore, step S32 specifically includes the following steps:

[0125] If no feedback is received from the driver, acquire the driver's current monitoring image;

[0126] The driver's eyelid opening and trunk offset angle are determined from the current monitoring image. The eyelid opening and trunk offset angle are compared with the corresponding preset fatigue judgment thresholds. The driver's fatigue level is determined based on the comparison results.

[0127] Understandably, when no feedback is received from the driver, the current monitoring image of the driver can be further obtained. From the current monitoring image, the driver's eyelid opening and closing degree and trunk offset angle can be determined. The eyelid opening and closing degree is compared with the corresponding eye opening and closing degree preset fatigue judgment threshold, and the driver's trunk offset angle is compared with the corresponding trunk offset preset fatigue judgment threshold. The corresponding comparison results can be obtained, thereby determining the driver's fatigue level.

[0128] Step S33: Determine the electrical stimulation strategy based on the fatigue level, determine the number of electrical stimulations and the intensity of electrical stimulation based on the electrical stimulation strategy, and control the electrical stimulation device to provide fatigue reminders to the driver based on the number of electrical stimulations and the intensity of electrical stimulation.

[0129] It is understood that an electrical stimulation strategy can be determined based on the degree of fatigue, with different degrees of fatigue corresponding to different electrical stimulation strategies. The number of electrical stimulations and the intensity of electrical stimulation can be determined based on the electrical stimulation strategy, and the electrical stimulation device can be controlled to provide fatigue reminders to the driver based on the number of electrical stimulations and the intensity of electrical stimulation.

[0130] Furthermore, step S33 specifically includes the following steps:

[0131] According to the preset strategy mapping table, the electrical stimulation strategy corresponding to the fatigue level is queried, and the number of electrical stimulations and the intensity of electrical stimulation corresponding to the electrical stimulation strategy are obtained.

[0132] Based on the number of electrical stimulations and the intensity of the electrical stimulation, the pulsed electronic acupuncture and electrotherapy device in the electrical stimulation device outputs a target current through conductive cloth to the driver's acupoint electrical stimulation gloves to complete the fatigue reminder for the driver.

[0133] It is understood that the preset strategy mapping table reflects the mapping relationship between different fatigue levels and different electrical stimulation strategies. According to the preset strategy mapping table, the electrical stimulation strategy corresponding to the fatigue level is queried. The electrical stimulation device consists of a pulsed electronic acupuncture and electrotherapy instrument, conductive cloth, and acupoint electrical stimulation gloves. According to the number of electrical stimulations and the intensity of electrical stimulation, the pulsed electronic acupuncture and electrotherapy instrument in the electrical stimulation device outputs the target current to the driver's acupoint electrical stimulation gloves through the conductive cloth, which can realize the fatigue reminder for the driver.

[0134] In its implementation, the all-purpose pulse electronic acupuncture and electrotherapy device serves as the source of electrical stimulation. This device is small in size and lightweight, and can adjust the amplitude, frequency, and waveform of the stimulation current according to actual needs. It has advantages such as stable output and convenient operation. The conductive cloth is a conductive fiber made of polyester fiber material that has metallic properties after being electroplated with a metal coating. It has the characteristics of high softness, strong corrosion resistance, and good conductivity. It can be cut to different sizes and is very suitable for application on irregularly shaped surfaces. Therefore, the conductive cloth is used as the current transmission medium. It is wrapped around the steering wheel and connected to the all-purpose pulse electronic acupuncture and electrotherapy device through wires. In addition, a novel electrostimulation glove was designed to overcome the inconvenience of wearing electrodes. The copper plate on the palm side contacts the conductive cloth to receive current stimulation from the electrotherapy device. Then, through wires, it is connected to small copper plates for acupoint stimulation inside the glove to simultaneously stimulate three acupoints (Laogong, Neiguan, and Hegu). The glove's good contractility allows the small copper plates for acupoint stimulation to fit more closely to the driver's skin, enabling more effective acupoint electrostimulation of the palm. The corresponding system can be integrated into a smart tablet, regulating the brain's cognitive load level through diverse cognitive tasks, and stimulating the brain's thinking mechanism through driving sub-tasks to maintain a certain level of brain activity and delay the onset of driving fatigue. At the same time, the external objective multi-acupoint electrostimulation system simultaneously stimulates the three acupoints (Laogong, Neiguan, and Hegu), promoting the excitability of nerves in related organs and tissues, smoothing the flow of Qi and blood in the body, and relieving fatigue in the torso.

[0135] This embodiment, through the above-described scheme, after receiving feedback information from the driver, extracts the corresponding voice response, calculates the matching degree between the voice response and a preset answer, and determines the driver's fatigue level based on the matching degree; when no feedback information is received from the driver, it acquires the driver's current monitoring image and determines the driver's fatigue level based on the current monitoring image; it determines an electrical stimulation strategy based on the fatigue level, determines the number of electrical stimulations and the intensity of electrical stimulation based on the electrical stimulation strategy, and controls the electrical stimulation device to provide fatigue reminders to the driver based on the number of electrical stimulations and the intensity of electrical stimulation. This can efficiently alleviate driver fatigue without affecting the driver's normal operation, has strong applicability, is easy to implement, has better relief effect, improves driving safety, reduces traffic accidents caused by driver fatigue, and improves the speed and efficiency of driver fatigue relief.

[0136] Accordingly, the present invention further provides a driver fatigue relief device.

[0137] Reference Figure 6 , Figure 6 This is a functional block diagram of the first embodiment of the driver fatigue relief device of the present invention.

[0138] In a first embodiment of the driver fatigue relief device of the present invention, the driver fatigue relief device includes:

[0139] The task customization module 10 is used to obtain the driver's personal information when the fatigue relief function is detected to be activated, and to customize driving cognitive tasks based on the personal information.

[0140] The testing module 20 is used to generate driving test questions based on the driving cognitive task, display the driving test questions on the display device of the current vehicle, and broadcast them via voice.

[0141] The fatigue relief module 30 is used to receive feedback information from the driver, determine the driver's fatigue level based on the feedback information, determine an electrical stimulation strategy based on the fatigue level, and provide fatigue reminders to the driver based on the electrical stimulation strategy.

[0142] The task customization module 10 is further configured to acquire real-time images of the driver and feedback information from the central control unit of the current vehicle, and determine whether the fatigue relief function is activated based on the central control unit feedback information and the real-time images; when the fatigue relief function is detected to be activated, acquire the driver's personal information; and retrieve a driving cognitive task matching the driver from a preset database based on the personal information.

[0143] The task customization module 10 is also used to acquire real-time images of the driver and feedback information from the central control unit of the current vehicle; when the feedback information from the central control unit indicates that the fatigue relief function button has been triggered and the real-time image shows that the driver has fully worn the fatigue relief device, it is determined that the fatigue relief function has been activated; when the feedback information from the central control unit indicates that the fatigue relief function button has not been triggered, or the real-time image shows that the driver has not fully worn the fatigue relief device, it is determined that the fatigue relief function has not been activated.

[0144] The testing module 20 is further configured to generate task type selection information based on the driving cognition task, display the task type selection information on the display device of the current vehicle and announce it via voice; after receiving the task type selection information from the driver, select a corresponding question from the driving cognition task as a driving test question based on the task type selection information; and display the driving test question on the display device of the current vehicle and announce it via voice.

[0145] The fatigue relief module 30 is further configured to, upon receiving feedback information from the driver, extract the corresponding voice response, calculate the matching degree between the voice response and a preset answer, and determine the driver's fatigue level based on the matching degree; when no feedback information from the driver is received, acquire the driver's current monitoring image, determine the driver's fatigue level based on the current monitoring image; determine an electrical stimulation strategy based on the fatigue level, determine the number of electrical stimulations and the intensity of electrical stimulation based on the electrical stimulation strategy, and control the electrical stimulation device to provide fatigue reminders to the driver based on the number of electrical stimulations and the intensity of electrical stimulation.

[0146] The fatigue relief module 30 is further configured to acquire the current monitoring image of the driver when no feedback information is received from the driver; determine the driver's eyelid opening and closing degree and trunk offset angle from the current monitoring image; compare the eyelid opening and closing degree and the trunk offset angle with the corresponding preset fatigue judgment thresholds respectively; and determine the driver's fatigue level based on the comparison results.

[0147] The fatigue relief module 30 is further configured to query the electrical stimulation strategy corresponding to the fatigue level according to a preset strategy mapping table, obtain the number of electrical stimulations and the intensity of electrical stimulation corresponding to the electrical stimulation strategy; and control the pulse electronic acupuncture and electrotherapy device in the electrical stimulation device to output the target current to the driver's acupoint electrical stimulation glove through the conductive cloth according to the number of electrical stimulations and the intensity of electrical stimulation, so as to complete the fatigue reminder for the driver.

[0148] The steps for implementing each functional module of the driver fatigue relief device can be referred to in the various embodiments of the driver fatigue relief method of the present invention, and will not be repeated here.

[0149] Furthermore, embodiments of the present invention also propose a storage medium storing a driver fatigue mitigation program, which, when executed by a processor, performs the following operations:

[0150] When the driver's fatigue relief function is detected to be activated, the driver's personal information is obtained, and a driving cognitive task is customized based on the personal information.

[0151] Based on the driving cognitive task, a driving test question is generated, and the driving test question is displayed on the display device of the current vehicle and read aloud via voice.

[0152] After receiving feedback from the driver, the driver's fatigue level is determined based on the feedback, an electrical stimulation strategy is determined based on the fatigue level, and a fatigue reminder is given to the driver based on the electrical stimulation strategy.

[0153] Furthermore, when the driver fatigue mitigation program is executed by the processor, it also performs the following operations:

[0154] The driver's real-time image and the current vehicle's central control unit feedback information are obtained, and the fatigue relief function is determined to be activated based on the central control unit feedback information and the real-time image.

[0155] When the fatigue relief function is detected to be activated, the driver's personal information is obtained;

[0156] Based on the personal information, a driving cognitive task matching the driver is retrieved from a preset database.

[0157] Furthermore, when the driver fatigue mitigation program is executed by the processor, it also performs the following operations:

[0158] Acquire real-time images of the driver and feedback information from the vehicle's central control unit;

[0159] When the central control unit provides feedback that the fatigue relief function button has been triggered, and the real-time image shows that the driver is fully wearing the fatigue relief device, it is determined that the fatigue relief function has been activated.

[0160] If the central control unit reports that the fatigue relief function button is not triggered, or if the real-time image shows that the driver is not fully wearing the fatigue relief device, it is determined that the fatigue relief function is not activated.

[0161] Furthermore, when the driver fatigue mitigation program is executed by the processor, it also performs the following operations:

[0162] Based on the driving cognitive task, task type selection information is generated, and the task type selection information is displayed on the display device of the current vehicle and announced by voice.

[0163] After receiving the driver's task type selection information, the system selects a corresponding question from the driving cognition task as a driving test question based on the task type selection information.

[0164] The driving test questions are displayed on the vehicle's display device and announced via voice.

[0165] Furthermore, when the driver fatigue mitigation program is executed by the processor, it also performs the following operations:

[0166] After receiving feedback from the driver, the system extracts the corresponding voice response, calculates the matching degree between the voice response and a preset answer, and determines the driver's fatigue level based on the matching degree.

[0167] If no feedback is received from the driver, the driver's current monitoring image is acquired, and the driver's fatigue level is determined based on the current monitoring image.

[0168] An electrical stimulation strategy is determined based on the degree of fatigue. The number of electrical stimulations and the intensity of electrical stimulation are determined based on the electrical stimulation strategy. The electrical stimulation device is then controlled to provide fatigue reminders to the driver based on the number of electrical stimulations and the intensity of electrical stimulation.

[0169] Furthermore, when the driver fatigue mitigation program is executed by the processor, it also performs the following operations:

[0170] If no feedback is received from the driver, acquire the driver's current monitoring image;

[0171] The driver's eyelid opening and trunk offset angle are determined from the current monitoring image. The eyelid opening and trunk offset angle are compared with the corresponding preset fatigue judgment thresholds. The driver's fatigue level is determined based on the comparison results.

[0172] Furthermore, when the driver fatigue mitigation program is executed by the processor, it also performs the following operations:

[0173] According to the preset strategy mapping table, the electrical stimulation strategy corresponding to the fatigue level is queried, and the number of electrical stimulations and the intensity of electrical stimulation corresponding to the electrical stimulation strategy are obtained.

[0174] Based on the number of electrical stimulations and the intensity of the electrical stimulation, the pulsed electronic acupuncture and electrotherapy device in the electrical stimulation device outputs a target current through conductive cloth to the driver's acupoint electrical stimulation gloves to complete the fatigue reminder for the driver.

[0175] This embodiment, through the above-described scheme, obtains the driver's personal information when the fatigue relief function is detected to be activated, and customizes a driving cognitive task based on the personal information; generates driving test questions based on the driving cognitive task, displays the driving test questions on the current vehicle's display device, and broadcasts them via voice; after receiving feedback information from the driver, determines the driver's fatigue level based on the feedback information, determines an electrical stimulation strategy based on the fatigue level, and provides fatigue reminders to the driver based on the electrical stimulation strategy. This can efficiently relieve driver fatigue without affecting the driver's normal operation, has strong applicability, is easy to implement, has better relief effect, improves driving safety, reduces traffic accidents caused by driver fatigue, and improves the speed and efficiency of driver fatigue relief.

[0176] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0177] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0178] The above are merely preferred embodiments of the present invention and do not limit the scope of the patent. Any equivalent structural or procedural transformations made based on the description and drawings of the present invention, or direct or indirect applications in other related technical fields, are similarly included within the scope of patent protection of the present invention.

Claims

1. A method for alleviating driver fatigue, characterized in that, The methods for alleviating driver fatigue include: When the driver's fatigue relief function is detected to be activated, the driver's personal information is obtained, and a driving cognitive task is customized based on the personal information. Based on the driving cognitive task, a driving test question is generated, and the driving test question is displayed on the display device of the current vehicle and read aloud via voice. After receiving feedback from the driver, the driver's fatigue level is determined based on the feedback, an electrical stimulation strategy is determined based on the fatigue level, and a fatigue reminder is given to the driver based on the electrical stimulation strategy. The step of obtaining the driver's personal information and customizing driving cognitive tasks based on the fatigue relief function when it is detected that the fatigue relief function is activated includes: The driver's real-time image and the current vehicle's central control unit feedback information are obtained, and the fatigue relief function is determined to be activated based on the central control unit feedback information and the real-time image. When the fatigue relief function is detected to be activated, the driver's personal information is obtained; Based on the personal information, a driving cognitive task matching the driver is retrieved from a preset database; The step of acquiring real-time images of the driver and feedback information from the vehicle's central control unit, and determining whether the fatigue relief function is activated based on the central control unit feedback information and the real-time images, includes: Acquire real-time images of the driver and feedback information from the vehicle's central control unit; When the central control unit provides feedback that the fatigue relief function button has been triggered, and the real-time image shows that the driver is fully wearing the fatigue relief device, it is determined that the fatigue relief function has been activated. If the central control unit reports that the fatigue relief function button is not triggered, or if the real-time image shows that the driver is not fully wearing the fatigue relief device, it is determined that the fatigue relief function is not activated.

2. The method for alleviating driver fatigue as described in claim 1, characterized in that, The step of generating driving test questions based on the driving cognitive task, displaying the driving test questions on the display device of the current vehicle, and broadcasting them via voice includes: Based on the driving cognitive task, task type selection information is generated, and the task type selection information is displayed on the display device of the current vehicle and announced by voice. After receiving the driver's task type selection information, the system selects a corresponding question from the driving cognition task as a driving test question based on the task type selection information. The driving test questions are displayed on the vehicle's display device and announced via voice.

3. The method for alleviating driver fatigue as described in claim 1, characterized in that, After receiving feedback from the driver, the process involves determining the driver's fatigue level based on the feedback, determining an electrical stimulation strategy based on the fatigue level, and providing a fatigue reminder to the driver based on the electrical stimulation strategy, including: After receiving feedback from the driver, the system extracts the corresponding voice response, calculates the matching degree between the voice response and a preset answer, and determines the driver's fatigue level based on the matching degree. If no feedback is received from the driver, the driver's current monitoring image is acquired, and the driver's fatigue level is determined based on the current monitoring image. An electrical stimulation strategy is determined based on the degree of fatigue. The number of electrical stimulations and the intensity of electrical stimulation are determined based on the electrical stimulation strategy. The electrical stimulation device is then controlled to provide fatigue reminders to the driver based on the number of electrical stimulations and the intensity of electrical stimulation.

4. The method for alleviating driver fatigue as described in claim 3, characterized in that, The step of acquiring the driver's current monitoring image when no feedback information is received from the driver, and determining the driver's fatigue level based on the current monitoring image, includes: If no feedback is received from the driver, acquire the driver's current monitoring image; The driver's eyelid opening and trunk offset angle are determined from the current monitoring image. The eyelid opening and trunk offset angle are compared with the corresponding preset fatigue judgment thresholds. The driver's fatigue level is determined based on the comparison results.

5. The method for alleviating driver fatigue as described in claim 3, characterized in that, The step of determining an electrical stimulation strategy based on the degree of fatigue, determining the number of electrical stimulations and the intensity of electrical stimulation based on the electrical stimulation strategy, and controlling the electrical stimulation device to provide fatigue reminders to the driver based on the number of electrical stimulations and the intensity of electrical stimulation includes: According to the preset strategy mapping table, the electrical stimulation strategy corresponding to the fatigue level is queried, and the number of electrical stimulations and the intensity of electrical stimulation corresponding to the electrical stimulation strategy are obtained. Based on the number of electrical stimulations and the intensity of the electrical stimulation, the pulsed electronic acupuncture and electrotherapy device in the electrical stimulation device outputs a target current through conductive cloth to the driver's acupoint electrical stimulation gloves to complete the fatigue reminder for the driver.

6. A driver fatigue relief device, characterized in that, The driver fatigue relief device includes: The task customization module is used to obtain the driver's personal information when the fatigue relief function is detected to be activated, and to customize driving cognitive tasks based on the personal information. The testing module is used to generate driving test questions based on the driving cognitive task, display the driving test questions on the display device of the current vehicle, and broadcast them via voice. The fatigue relief module is used to receive feedback information from the driver, determine the driver's fatigue level based on the feedback information, determine an electrical stimulation strategy based on the fatigue level, and provide fatigue reminders to the driver based on the electrical stimulation strategy. The task customization module is also used to acquire real-time images of the driver and feedback information from the central control unit of the current vehicle, and determine whether the fatigue relief function is enabled based on the feedback information from the central control unit and the real-time images; when the fatigue relief function is detected to be enabled, the module acquires the driver's personal information; and retrieves a driving cognitive task matching the driver from a preset database based on the personal information. The task customization module is also used to acquire real-time images of the driver and feedback information from the central control unit of the current vehicle; when the feedback information from the central control unit indicates that the fatigue relief function button has been triggered and the real-time image shows that the driver has fully worn the fatigue relief device, it is determined that the fatigue relief function has been activated; when the feedback information from the central control unit indicates that the fatigue relief function button has not been triggered, or when the real-time image shows that the driver has not fully worn the fatigue relief device, it is determined that the fatigue relief function has not been activated.

7. A driver fatigue relief device, characterized in that, The driving fatigue relief device includes: a memory, a processor, and a driving fatigue relief program stored in the memory and executable on the processor, the driving fatigue relief program being configured to implement the steps of the driving fatigue relief method as described in any one of claims 1 to 5.

8. A storage medium, characterized in that, The storage medium stores a driver fatigue mitigation program, which, when executed by a processor, implements the steps of the driver fatigue mitigation method as described in any one of claims 1 to 5.

Images