Fatigue driving alarm method and system for expressway

Abstract

The invention provides an expressway fatigue driving alarm method and system, the system comprises an infotainment controller, a driver monitoring module, a map application module and a voice application module, and the method comprises the steps that the driver monitoring module monitors the behavior state of a driver in real time, and when the driver is recognized to be in fatigue driving, the map application module sends an alarm to the map application module; the fatigue driving state is reported to an information entertainment controller; the information entertainment controller calls a map application module to judge whether a map is in a navigation state and a highway section; if the map is in a navigation state and in a highway section, searching a service area through a map application module; the voice application module broadcasts inquiry information and obtains confirmation information replied by the user; the map application module resets the navigation destination as the next nearest service area according to the confirmation information; the fatigue state of the user is accurately monitored, and the danger caused by fatigue driving of the user on the highway is avoided.

Description

Technical Field

[0001] This invention relates to the field of vehicle monitoring technology, and in particular to a fatigue driving alarm method and system for highways. Background Technology

[0002] In the wave of automotive intelligence, the focus of safety technology is gradually shifting from "protecting the vehicle" to "protecting the driver." Among these, the Driver Monitoring System (DMS), acting as an "invisible guardian" within the cockpit, fundamentally prevents accidents caused by human error by monitoring the driver's condition in real time. To address the risk of accidents due to driver fatigue, various driver monitoring methods have emerged. These primarily include using cameras and sensors to collect direct physiological data such as facial features (e.g., frequency of eye closure, yawning), eye movements, and electrocardiogram or electroencephalogram signals for assessment. Alternatively, fatigue levels can be indirectly determined by analyzing driving behavior (e.g., steering wheel frequency, braking force) and vehicle status (e.g., driving time, speed).

[0003] However, existing driver monitoring system technologies fail to integrate map applications with voice applications, thus failing to accurately monitor whether the driver is in a state of fatigue. Summary of the Invention

[0004] In view of this, the purpose of the present invention is to provide a fatigue driving alarm method and system for highways, which can accurately monitor the fatigue state of users and avoid the dangers caused by fatigue driving on highways.

[0005] In a first aspect, embodiments of the present invention provide a fatigue driving alarm method for highways, applied to a fatigue driving alarm system, the system including an infotainment controller, a driver monitoring module, a map application module, and a voice application module, the method including: The driver monitoring module monitors the driver's behavior in real time, and when it detects that the driver is driving while fatigued, it reports the fatigue status to the infotainment controller. The infotainment controller calls the map application module to determine whether the map is in navigation mode and on a highway. If the map is in the navigation state and is located on the highway section, then the service area is searched through the map application module; The voice application module reads out the inquiry information and obtains the user's confirmation reply. The map application module resets the navigation destination to the nearest service area based on the confirmation information.

[0006] Furthermore, when driver fatigue is detected, the fatigue driving status is reported to the infotainment controller, including: When it is detected that the driver is yawning continuously for more than a first time threshold, or closing his eyes for more than a third time threshold within a second time threshold range, it is determined that the driver is in a state of fatigued driving. The fatigue driving status is reported to the infotainment controller; Wherein, the first time threshold is less than the third time threshold.

[0007] Furthermore, the infotainment controller calls the map application module to determine whether the map is in navigation mode and on a highway, and also includes: If the map is not in the navigation state and is not on the highway section, a reminder message will be broadcast through the voice application module.

[0008] Furthermore, the infotainment controller calls the map application module to determine whether the map is in navigation mode and on a highway, and also includes: If the map is in the navigation state and not on the highway section, a reminder message will be broadcast through the voice application module; The warning message states that driver fatigue has been detected; please be careful.

[0009] Secondly, embodiments of the present invention provide a fatigue driving alarm system for highways, the system including an infotainment controller, a driver monitoring module, a map application module, and a voice application module; The driver monitoring module is used to monitor the driver's behavior in real time, and when it detects that the driver is driving while fatigued, it reports the fatigue status to the infotainment controller. The infotainment controller is used to call the map application module to determine whether the map is in navigation mode and on a highway. If the map is in navigation mode and on a highway, the service area is searched through the map application module. The voice application module is used to broadcast the inquiry information and obtain confirmation information from the user's reply; The map application module is used to reset the navigation destination to the nearest service area based on the confirmation information.

[0010] Furthermore, the driver monitoring module is specifically used for: When it is detected that the driver is yawning continuously for more than a first time threshold, or closing his eyes for more than a third time threshold within a second time threshold range, it is determined that the driver is in a state of fatigued driving. The fatigue driving status is reported to the infotainment controller; Wherein, the first time threshold is less than the third time threshold.

[0011] Furthermore, the infotainment controller is specifically used for: If the map is not in the navigation state and is not on the highway section, a reminder message will be broadcast through the voice application module.

[0012] Furthermore, the infotainment controller is specifically used for: If the map is in the navigation state and not on the highway section, a reminder message will be broadcast through the voice application module; The warning message states that driver fatigue has been detected; please be careful.

[0013] Thirdly, embodiments of the present invention provide an electronic device, including a memory and a processor, wherein the memory stores a computer program that can run on the processor, and the processor executes the computer program to implement the method described above.

[0014] Fourthly, embodiments of the present invention provide a computer-readable medium having processor-executable non-volatile program code that causes the processor to perform the method described above.

[0015] This invention provides a method and system for fatigue driving alarm on highways. The system includes an infotainment controller, a driver monitoring module, a map application module, and a voice application module. The method includes: the driver monitoring module monitors the driver's behavior in real time; when fatigue driving is detected, it reports the fatigue driving status to the infotainment controller; the infotainment controller calls the map application module to determine whether the map is in navigation mode and on a highway; if the map is in navigation mode and on a highway, the map application module searches for a service area; the voice application module broadcasts an inquiry and obtains confirmation from the user; the map application module resets the navigation destination to the nearest service area based on the confirmation; this accurately monitors the user's fatigue status and avoids the dangers of fatigue driving on highways.

[0016] Other features and advantages of the invention will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the invention. The objects and other advantages of the invention are realized and obtained in accordance with the structures particularly pointed out in the description, claims and drawings.

[0017] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings. Attached Figure Description

[0018] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0019] Figure 1 This is a flowchart of a fatigue driving alarm method for highways provided in Embodiment 1 of the present invention; Figure 2 This is a schematic diagram of the fatigue driving state monitoring process provided in Embodiment 1 of the present invention; Figure 3 This is a schematic diagram of the fatigue driving alarm process provided in Embodiment 1 of the present invention; Figure 4 This is a schematic diagram of a highway fatigue driving alarm system provided in Embodiment 2 of the present invention. Detailed Implementation

[0020] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0021] To facilitate understanding of this embodiment, the embodiments of the present invention will be described in detail below.

[0022] Example 1: Figure 1 This is a flowchart of a fatigue driving alarm method for highways provided in Embodiment 1 of the present invention.

[0023] Reference Figure 1 This method, applied to a driver fatigue warning system, includes an infotainment controller, a driver monitoring module, a map application module, and a voice application module. The method comprises the following steps: Step S101: The driver monitoring module monitors the driver's behavior in real time. When it detects that the driver is driving while fatigued, it reports the fatigue status to the infotainment controller. In step S102, the infotainment controller calls the map application module to determine whether the map is in navigation mode and on a highway. Step S103: If the map is in navigation mode and is on a highway, then search for service areas through the map application module. Step S104: The voice application module broadcasts the inquiry information and obtains the user's confirmation reply. In step S105, the map application module resets the navigation destination to the nearest service area based on the confirmation information.

[0024] Specifically, the driver monitoring module monitors the driver's behavior in real time. When fatigue is detected, it reports the fatigue status to the infotainment controller. At this point, the map application module is invoked to determine if the driver is on a highway and to locate the next service area. The voice application module proactively asks the user, "We have detected fatigue in your driving. Would you like us to navigate you to the next service area for a rest?" After the voice application module receives a confirmation reply such as "okay," the map application module automatically navigates to the next service area. This method, by monitoring the user's fatigue status, avoids the dangers of fatigued driving on highways.

[0025] Furthermore, step S101 includes the following steps: Step S201: When it is detected that the driver is yawning continuously for more than a first time threshold, or closing his eyes for more than a third time threshold within the second time threshold range, it is determined that the driver is in a state of fatigued driving. Step S202: Report the driver fatigue status to the infotainment controller; Among them, the first time threshold is less than the third time threshold.

[0026] Specifically, refer to Figure 2 The driver monitoring module monitors the driver's condition in real time. If the driver yawns continuously for more than 1.5 seconds or closes their eyes for more than 3 seconds within 10 seconds, it determines that the driver is in a state of fatigue. In this case, the driver fatigue result is output to the map application module. Fatigue states can be seen in Table 1. Table 1

[0027] Furthermore, step S102 also includes: If the map is not in navigation mode and is not on a highway, a reminder message will be broadcast via the voice application module.

[0028] Furthermore, step S102 also includes: If the map is in navigation mode and not on a highway, a reminder message will be broadcast via the voice application module; The warning message states that fatigue driving has been detected; please be careful.

[0029] Specifically, refer to Figure 3 Condition 1: If the map is in navigation mode and is on a highway.

[0030] Step 1: Search for "service areas" along the way.

[0031] 1) If there is a result, execute service1 and continue to step 2; 2) If there is no result, then execute service3.

[0032] Step 2: Listen to the user's response to service1 via voice.

[0033] 1) If a positive response is received, then service2 will be executed; 2) If there is a negative response or a timeout, the entire process will be terminated.

[0034] condition2: If the map is not in navigation mode or the map is in navigation mode but not on a highway, then service3 will be executed.

[0035] Service 1: The voice TTS (Text-to-Speech) system will announce, "Fatigue driving detected. We'll navigate you to the next service area for a rest, okay?" After the announcement, it will listen for user feedback. The feedback window will remain open for 10 seconds; if it exceeds 10 seconds, it will be considered a timeout. Positive feedback words: Okay / Good / Alright / Confirm / OK. Negative feedback words: No / Cancel / Step Back / Not Good.

[0036] service2: Interrupts the existing navigation and resets the navigation destination to the nearest service area.

[0037] service3: Voice TTS broadcast "Fatigue driving detected, please pay attention to safety".

[0038] Example 2: Figure 4 This is a schematic diagram of a highway fatigue driving alarm system provided in Embodiment 2 of the present invention.

[0039] Reference Figure 4 The system includes an infotainment controller, a driver monitoring module, a map application module, and a voice application module; The driver monitoring module is used to monitor the driver's behavior in real time. When driver fatigue is detected, the fatigue status is reported to the infotainment controller. The infotainment controller is used to call the map application module to determine whether the map is in navigation mode and on a highway. If the map is in navigation mode and on a highway, the service area is searched through the map application module. The voice application module is used to broadcast the inquiry information and obtain confirmation information from the user's reply; The map application module is used to reset the navigation destination to the nearest service area based on the confirmation information.

[0040] Here, the infotainment controller integrates the operating system, map application module, and voice application module, undertaking the functions of information analysis, processing, and control; the driver monitoring module includes a driver monitoring camera and algorithm software, undertaking the function of monitoring driver fatigue; the map application module undertakes the functions of judging driver driving on highways and navigating to the next service area; the voice application module undertakes the functions of voice broadcasting and listening to driver responses. Based on driver monitoring, this application guides the driver to the next service area to rest when the driver is fatigued on the highway, avoiding dangers caused by fatigued driving.

[0041] Furthermore, the driver monitoring module is specifically used for: When it is detected that the driver is yawning continuously for more than the first time threshold, or closing his eyes for more than the third time threshold within the second time threshold range, it is determined that the driver is in a state of fatigue driving. Report the driver fatigue status to the infotainment controller; Among them, the first time threshold is less than the third time threshold.

[0042] Furthermore, the infotainment controller is specifically used for: If the map is not in navigation mode and is not on a highway, a reminder message will be broadcast via the voice application module.

[0043] Furthermore, the infotainment controller is specifically used for: If the map is in navigation mode and not on a highway, a reminder message will be broadcast via the voice application module; The warning message states that fatigue driving has been detected; please be careful.

[0044] This invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the steps of the highway fatigue driving alarm method provided in the above embodiments.

[0045] This invention also provides a computer-readable medium having processor-executable non-volatile program code, on which a computer program is stored, and which, when run by a processor, executes the steps of the highway fatigue driving alarm method described above.

[0046] The computer program product provided in this embodiment of the invention includes a computer-readable storage medium storing program code. The instructions included in the program code can be used to execute the methods described in the preceding method embodiments. For specific implementation details, please refer to the method embodiments, which will not be repeated here.

[0047] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the system and apparatus described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0048] Furthermore, in the description of the embodiments of the present invention, unless otherwise explicitly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in the present invention based on the specific circumstances.

[0049] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, essentially, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0050] In the description of this invention, it should be noted that the terms "center," "upper," "lower," "left," "right," "vertical," "horizontal," "inner," and "outer," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing the invention and for simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0051] Finally, it should be noted that the above-described embodiments are merely specific implementations of the present invention, used to illustrate the technical solutions of the present invention, and not to limit it. The scope of protection of the present invention is not limited thereto. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art can still modify or easily conceive of changes to the technical solutions described in the foregoing embodiments within the technical scope disclosed in the present invention, or make equivalent substitutions for some of the technical features; and these modifications, changes, or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be covered within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A fatigue driving alarm method for highways, characterized in that, An application to a driver fatigue warning system, the system comprising an infotainment controller, a driver monitoring module, a map application module, and a voice application module, wherein the method comprises: The driver monitoring module monitors the driver's behavior in real time, and when it detects that the driver is driving while fatigued, it reports the fatigue status to the infotainment controller. The infotainment controller calls the map application module to determine whether the map is in navigation mode and on a highway. If the map is in the navigation state and is located on the highway section, then the service area is searched through the map application module; The voice application module reads out the inquiry information and obtains the user's confirmation reply. The map application module resets the navigation destination to the nearest service area based on the confirmation information.

2. The fatigue driving alarm method for highways according to claim 1, characterized in that, When driver fatigue is detected, the fatigue status is reported to the infotainment controller, including: When it is detected that the driver is yawning continuously for more than a first time threshold, or closing his eyes for more than a third time threshold within a second time threshold range, it is determined that the driver is in the state of fatigued driving. The fatigue driving status is reported to the infotainment controller; Wherein, the first time threshold is less than the third time threshold.

3. The fatigue driving alarm method for highways according to claim 1, characterized in that, The infotainment controller calls the map application module to determine whether the map is in navigation mode and on a highway, and also includes: If the map is not in the navigation state and is not on the highway section, a reminder message will be broadcast through the voice application module.

4. The fatigue driving alarm method for highways according to claim 1, characterized in that, The infotainment controller calls the map application module to determine whether the map is in navigation mode and on a highway, and also includes: If the map is in the navigation state and not on the highway section, a reminder message will be broadcast through the voice application module; The warning message states that driver fatigue has been detected; please be careful.

5. A fatigue driving alarm system for highways, characterized in that, The system includes an infotainment controller, a driver monitoring module, a map application module, and a voice application module; The driver monitoring module is used to monitor the driver's behavior in real time, and when it detects that the driver is driving while fatigued, it reports the fatigue status to the infotainment controller. The infotainment controller is used to call the map application module to determine whether the map is in navigation mode and on a highway. If the map is in navigation mode and on a highway, the service area is searched through the map application module. The voice application module is used to broadcast the inquiry information and obtain confirmation information from the user's reply; The map application module is used to reset the navigation destination to the nearest service area based on the confirmation information.

6. The fatigue driving alarm system for highways according to claim 5, characterized in that, The driver monitoring module is specifically used for: When it is detected that the driver is yawning continuously for more than a first time threshold, or closing his eyes for more than a third time threshold within a second time threshold range, it is determined that the driver is in the state of fatigued driving. The fatigue driving status is reported to the infotainment controller; Wherein, the first time threshold is less than the third time threshold.

7. The fatigue driving alarm system for highways according to claim 5, characterized in that, The infotainment controller is specifically used for: If the map is not in the navigation state and is not on the highway section, a reminder message will be broadcast through the voice application module.

8. The highway fatigue driving alarm system according to claim 5, characterized in that, The infotainment controller is specifically used for: If the map is in the navigation state and not on the highway section, a reminder message will be broadcast through the voice application module; The warning message states that driver fatigue has been detected; please be careful.

9. An electronic device comprising a memory and a processor, wherein the memory stores a computer program executable on the processor, characterized in that, When the processor executes the computer program, it implements the method described in any one of claims 1 to 4.

10. A computer-readable medium having processor-executable non-volatile program code, characterized in that, The program code causes the processor to execute the method described in any one of claims 1 to 4.

Images