A high-speed fatigue driving multi-sensory early warning system based on a multi-level threshold recognition of a vehicle head picture proportion

Abstract

The application discloses a high-speed fatigue driving multi-sensory early warning system based on a multi-stage threshold recognition of a vehicle head picture proportion, and real-time collection of front road images and recognition of lane markings are realized through an image acquisition module, a vehicle head reference area is established in combination with a pre-stored vehicle head reference width, and the overlapping proportion of the vehicle head and the lane markings is calculated; multi-stage early warning thresholds are set, each threshold corresponds to different continuous determination time lengths; when the overlapping proportion reaches any threshold and the continuous time length meets the corresponding determination time length, an early warning trigger signal is generated, and an early warning execution module synchronously outputs audio and light early warning and two types of driver contact tactile vibration perception signals. The application adopts a double determination mechanism of overlapping proportion grading and continuous time length checking to greatly reduce the false alarm rate of high-speed driving, and can wake up the driver through multi-sensory linkage, can be simultaneously adapted to the vehicle original factory front-mounted and vehicle-mounted after-mounted equipment market, and effectively improves the high-speed driving safety.

Description

Technical Field

[0001] This invention relates to the field of vehicle driving safety warning technology, and in particular to a high-speed fatigue driving multi-sensory warning system suitable for high-speed driving scenarios, which can identify lane departure risks based on images of the road in front of the vehicle and provide multi-sensory reminders through sound, vibration and projection. Background Technology

[0002] During high-speed driving, when drivers are fatigued, distracted, or experience a brief decline in attention, they are prone to unintentionally deviating from their lanes, crossing lane lines, or even crossing lanes, thereby increasing the risk of traffic accidents. Current lane departure warning solutions mainly fall into two categories: one is the factory-installed forward-looking ADAS system, which is typically highly integrated and expensive, and is mostly found in new or high-end models, making it difficult to directly cover the aftermarket needs of existing private cars; the other is ordinary aftermarket dashcam-type warning solutions, whose judgment logic is often relatively simple, frequently using a single moment of crossing the line as the alarm condition, lacking a graded identification mechanism for minor, continuous, and severe line crossings, easily leading to frequent false alarms and decreased driver alertness.

[0003] Furthermore, existing warning methods mostly rely on a single buzzer alert. When drivers are driving at high speeds, in noisy environments, or with distracted attention, this single sound alert is easily ignored, limiting its effectiveness. On the other hand, some existing solutions have narrow limitations on communication methods, warning execution methods, and installation platforms, making it difficult to adapt to different aftermarket vehicle devices and vehicle models.

[0004] Therefore, there is an urgent need for an in-vehicle warning solution that can make multi-level threshold judgments based on the proportion of the front view, take into account the duration conditions, and support multi-sensory output, so as to improve the accuracy of lane departure recognition and the effectiveness of warnings in high-speed scenarios without significantly increasing the modification cost. Summary of the Invention

[0005] To address the shortcomings of the existing technology, the purpose of this invention is to provide a high-speed fatigue driving multi-sensory early warning system based on multi-level threshold recognition of the proportion of the vehicle's front view, so as to solve the problems mentioned in the background technology.

[0006] To achieve the above objectives, a specific embodiment of the present invention provides a high-speed fatigue driving multi-sensory warning system based on multi-level threshold recognition of the proportion of the vehicle's front view, including an image acquisition module, a lane marking recognition module, a vehicle front reference modeling module, a proportion calculation module, a threshold storage module, a warning determination module, and a warning execution module. The image acquisition module is used to acquire real-time images of the road ahead of the vehicle; the lane marking recognition module is used to identify lane markings and extract lane boundary information from the road front image; the vehicle front reference modeling module is used to establish a vehicle front reference area based on pre-stored vehicle parameters, including at least a vehicle front width parameter; the proportion calculation module is used to calculate the encroachment overlap proportion between the vehicle front reference area and the lane markings; the threshold storage module is used to store at least two warning thresholds, each corresponding to a different duration of judgment; the warning determination module is used to continuously monitor changes in the encroachment overlap proportion, and when the encroachment overlap proportion meets any warning threshold and the duration meets the corresponding duration of judgment, it generates a warning trigger signal; the warning execution module is used to receive the warning trigger signal and output warning information that can be perceived by the driver.

[0007] In addition, the high-speed fatigue driving multi-sensory warning system based on multi-level threshold recognition of the proportion of the vehicle front view proposed in this application may also have the following additional technical features: In one embodiment of this application, the early warning execution module includes an audio early warning module and a tactile vibration early warning module.

[0008] In one embodiment of this application, the tactile vibration warning module includes a driver human body contact tactile vibration actuator, which is disposed in at least one of the steering wheel, seat cushion, seat back, and leg support.

[0009] In one embodiment of this application, the system further includes a communication module, which is used to transmit road images, warning trigger signals, or warning control signals between the image acquisition module, the warning determination module, the warning execution module, or an external terminal. The communication module includes any one or more of wired communication interfaces, Bluetooth, WiFi, and radio frequency wireless communication.

[0010] In one embodiment of this application, the image acquisition module, lane marking recognition module, vehicle front reference modeling module, proportion calculation module, threshold storage module, and early warning judgment module are integrated into the vehicle dashcam host, which has high-definition image acquisition capability.

[0011] In one embodiment of this application, the multi-level threshold includes different thresholds set for dashed lane markings and solid lane markings, and includes at least two level thresholds corresponding to different encroachment and overlap ratios; wherein, the duration of continuous judgment corresponding to a higher encroachment and overlap ratio is less than the duration of continuous judgment corresponding to a lower encroachment and overlap ratio, and the duration of continuous judgment corresponding to the solid lane marking is less than or equal to the duration of continuous judgment corresponding to the dashed lane marking.

[0012] In one embodiment of this application, an in-vehicle information projection module is also included, which is used to project vehicle operation information and environmental identification information onto the windshield. The vehicle operation information includes at least one of vehicle speed, driving direction, and navigation map information, and the environmental identification information includes at least one of lane marking status, distance to the vehicle in front, identification information of the target vehicle ahead, and license plate recognition information.

[0013] A multi-sensory early warning method for high-speed fatigue driving based on multi-level threshold recognition of the proportion of the vehicle's front view includes the following steps: Capture images of the road ahead of the vehicle and identify lane markings; Acquire vehicle parameters and establish a front reference area; Calculate the percentage of encroachment / overlap between the vehicle front reference area and the lane markings; The encroachment overlap ratio is matched and judged with a preset multi-level threshold, and its duration is judged simultaneously. When the encroachment overlap ratio reaches any threshold and the duration meets the corresponding continuous determination time, an early warning trigger signal is generated; In response to the warning trigger signal, a warning message that can be perceived by the driver is output, the warning message including at least one of sound warning, tactile vibration warning and projection warning.

[0014] In one embodiment of this application, a warning cancellation step is also included: when the proportion of encroachment and overlap between the vehicle front reference area and the lane markings is detected to fall back to a preset safe range and remain there for a preset duration, the warning state is cancelled.

[0015] A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method.

[0016] The advantages of this invention compared to existing technologies are: (1) By combining the "overlapping ratio of the front view of the vehicle and the duration of multiple levels" for joint judgment, compared with the single instantaneous alarm of the line, it can more accurately distinguish between slight line intrusion, continuous line intrusion and severe line intrusion, and reduce the false alarm rate.

[0017] (2) In addition to retaining acoustic warnings such as buzzers, it also introduces tactile vibration actuators for driver contact (steering wheel, seat cushion, backrest, etc.). When the warning is triggered, the driver's hands and torso can receive physical vibration feedback simultaneously, which greatly improves the reliability of wake-up in harsh driving environments.

[0018] (3) The system has a high degree of integration and flexible installation and deployment. It can be integrated into aftermarket equipment such as vehicle dashcams (connecting external vibration components via wired or wireless communication without modifying the original vehicle wiring) or directly integrated into new vehicle pre-installed systems. It covers both the aftermarket for existing vehicles and the original equipment for car manufacturers, with strong commercial viability and broad application prospects.

[0019] Additional aspects and advantages of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description

[0020] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0021] Figure 1 This is a control connection diagram of a high-speed fatigue driving multi-sensory early warning system based on multi-level threshold recognition of the proportion of the vehicle front view in one embodiment of the present invention; Figure 2 This is a flowchart of a high-speed fatigue driving multi-sensory early warning system based on multi-level threshold recognition of the proportion of the vehicle front view in one embodiment of the present invention; Figure 3 This is a data processing flowchart of a high-speed fatigue driving multi-sensory early warning system based on multi-level threshold recognition of the proportion of the vehicle's front view in an embodiment of the present invention. Detailed Implementation

[0022] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0023] Example 1

[0024] This embodiment provides a multi-sensory early warning system for high-speed fatigue driving based on multi-level threshold recognition of the proportion of the vehicle's front view. For example... Figures 1 to 3 As shown, the system mainly includes an image acquisition module, a lane marking recognition module, a vehicle front reference modeling module, a proportion calculation module, a threshold storage module, a warning judgment module, and a warning execution module.

[0025] An image acquisition module is positioned at the front of the vehicle to capture high-definition images of the road ahead in real time. In a preferred embodiment, the image acquisition module is integrated into the main unit of an in-vehicle dashcam, which is preferably a smart dashcam device with 4K high-definition video capture capability. The image acquisition module is positioned directly in front of the vehicle and can continuously capture images of the road ahead at a preset frame rate while the vehicle is traveling at high speed, outputting the captured image data to the processing module at the system's backend in real time.

[0026] The lane marking recognition module is connected to the image acquisition module and is used to receive road images output by the image acquisition module, and to recognize and extract features from the lane markings in the road images. Specifically, the lane marking recognition module uses image processing algorithms to segment and recognize the dashed lane lines, solid lane lines, and lane boundary contours in the road images, and extracts the lane boundary coordinate information, including the positions of the dashed line boundaries and solid line boundaries, providing a data foundation for subsequent calculations of the geometric relationship between the vehicle front and the lane markings.

[0027] The front reference modeling module is used to establish a front reference region based on pre-stored vehicle parameters. These parameters include at least the front width parameter. In practical applications, during the system's initial power-on or initialization process, the front reference modeling module generates a virtual front reference region outline corresponding to the actual front width of the vehicle in the image coordinate system output by the image acquisition module, based on the user-selected vehicle model or manually entered vehicle width parameters. The position of this virtual front reference region in the image dynamically adjusts as the vehicle's driving posture changes, always corresponding to the actual lateral coverage area of ​​the front of the vehicle.

[0028] The proportion calculation module is connected to the lane marking recognition module and the vehicle front reference modeling module. It receives lane marking boundary information output by the lane marking recognition module and the vehicle front reference area contour generated by the vehicle front reference modeling module, and calculates the encroachment overlap ratio between the vehicle front reference area and the lane markings. The encroachment overlap ratio is used to quantitatively characterize the degree of lateral deviation of the vehicle's front from the lane markings. Specifically, it calculates the ratio of the area of ​​the vehicle front reference area encroaching on the lane marking boundary to the total area of ​​the vehicle front reference area, or the ratio of the pixel width of the edge of the vehicle front reference area crossing the lane markings to the total width of the vehicle front reference area. A higher ratio indicates a more severe deviation from the lane.

[0029] The threshold storage module stores at least two warning thresholds, each corresponding to a different duration of judgment. The warning thresholds represent different levels of lane encroachment, and the duration of judgment indicates how long the same encroachment state must persist before triggering a warning. The warning thresholds and their corresponding durations stored in the threshold storage module can be pre-configured by the system based on vehicle type and road conditions, or customized by the user according to their preferences, allowing the system's warning sensitivity to adapt to different driving environments and habits.

[0030] The early warning determination module continuously monitors changes in the encroachment / overlap ratio output by the ratio calculation module. It compares the real-time encroachment / overlap ratio with each level of early warning thresholds in the threshold storage module, and records the duration of the encroachment / overlap ratio after reaching or exceeding a certain threshold. When the encroachment / overlap ratio of the vehicle's front end to the lane markings reaches any threshold level, and the duration of this encroachment meets the corresponding duration of the determination, the early warning determination module generates a warning trigger signal. This mechanism effectively avoids false alarms caused by road bumps, short-term vehicle vibrations, or instantaneous image noise; only after the encroachment reaches a preset duration will it be considered a genuine abnormal lane departure.

[0031] The warning execution module is connected to the warning determination module and is used to receive the warning trigger signal generated by the warning determination module and output warning information that can be perceived by the driver. The warning execution module includes at least an audible warning module, and in a preferred embodiment, it also includes a tactile vibration warning module. The audible warning module is used to output a buzzer or voice prompt, and the tactile vibration warning module is used to output physical vibration at the point of contact with the driver's body. The intensity of the warning information output by the warning execution module is related to the warning level. For different levels of warning trigger signals, the warning execution module can output warning signals of different frequencies, amplitudes, or durations, thereby helping the driver quickly perceive the severity of the alarm and take timely corrective measures.

[0032] In a preferred application of this embodiment, the image acquisition module, lane marking recognition module, vehicle front reference modeling module, proportion calculation module, threshold storage module, and warning determination module are all integrated within the same vehicle dashcam host. The functions of each module are jointly implemented by the host's processor and image processing chip. The sound warning module in the warning execution module is integrated within the dashcam host, while the tactile vibration warning module can be located externally and connected to the host via a communication module, which can be wired or wireless. This integrated design allows the system to be installed and deployed without altering the vehicle's original circuitry, significantly reducing installation costs. It is suitable for retrofitting various ordinary family vehicles and can also be directly integrated into new car pre-installed systems.

[0033] Example 2

[0034] Based on the system architecture of Example 1, this embodiment further describes in detail the setting method of multi-level early warning thresholds and the specific logic of graded early warning judgment.

[0035] In this embodiment, the multi-level thresholds configured in the threshold storage module include different thresholds set for dashed lane markings and solid lane markings respectively. Specifically, the system sets at least two levels of encroachment ratio thresholds for dashed lane markings and a separate encroachment ratio threshold for solid lane markings, with each threshold corresponding to an independent duration of judgment. The duration of judgment corresponding to a higher encroachment overlap ratio is shorter than the duration of judgment corresponding to a lower encroachment overlap ratio, and the duration of judgment corresponding to a solid lane marking is less than or equal to the duration of judgment corresponding to a dashed lane marking.

[0036] In a preferred embodiment, the system specifically employs the following three-level decision logic: The first-level warning is for mild lane departure. When the vehicle is in motion, and the percentage overlap between the vehicle's front reference area and the lane markings (specifically the dashed lines) reaches one-third of the width of the front reference area, and this overlap lasts for at least 5 seconds, the warning determination module determines that the vehicle is slightly deviating from its lane and generates a first-level warning trigger signal. At this time, the warning execution module activates the audible warning module to output a first-level buzzer sound, and simultaneously controls the tactile vibration warning module to output low-frequency intermittent vibrations to gently remind the driver to correct their course.

[0037] The second-level warning corresponds to a moderate lane departure condition. When the encroachment overlap further increases, reaching half the width of the reference area in front of the vehicle, and this encroachment lasts for 3 seconds, the warning determination module determines that the vehicle has significantly deviated from its lane and generates a second-level warning trigger signal. At this time, the warning execution module activates the audible warning module to output a second-level rapid beeping alert, and simultaneously controls the tactile vibration warning module to output high-frequency continuous vibration, using strong sensory stimulation to remind the driver to correct the lane immediately.

[0038] The third-level warning corresponds to high-risk lane departure conditions. When the lane marking recognition module detects that the current vehicle is encroaching on a solid lane line, and the proportion calculation module calculates that the reference area in front of the vehicle overlaps with the solid line, and this encroachment lasts for 1 second, the warning judgment module determines that the current vehicle is in a high-risk lane departure state and generates a third-level warning trigger signal. At this time, the warning execution module activates the audible warning module to output the highest intensity continuous buzzer warning sound, and simultaneously controls the tactile vibration warning module to output high-intensity continuous vibration to trigger the driver's emergency response with the strongest force.

[0039] It should be noted that the specific values ​​of one-third, 5 seconds, half, 3 seconds, and solid line, 1 second mentioned above are merely a set of preferred threshold schemes for specific vehicle models and speed limit conditions. Under different vehicle front width parameters, different road speed limits, and different vehicle postures, those skilled in the art can adaptively calibrate and adjust the above proportions and durations based on the core judgment logic of this invention—namely, multi-level threshold matching different continuous judgment durations, higher intrusion ratios corresponding to shorter judgment durations, and solid line judgment durations being the shortest. Any technical solution obtained by adjusting specific proportion parameters and duration parameters based on this core judgment logic falls within the protection scope of this invention.

[0040] Example 3

[0041] Based on Examples 1 and 2, this embodiment further describes the specific structure of the early warning execution module, its installation method, and the specific implementation process of the sound and tactile linkage early warning.

[0042] The warning execution module includes an audible warning module and a tactile vibration warning module. The audible warning module can be installed inside the vehicle dashcam main unit or separately. Its output is connected to a speaker or buzzer to emit a beeping sound upon receiving a warning trigger signal. The audible warning module can output different frequencies, rhythms, or volumes of sound depending on the warning level to differentiate the urgency of the warning.

[0043] The tactile vibration warning module includes a driver-contact tactile vibration actuator. This actuator is located at at least one of the following: the steering wheel, seat cushion, seat back, and leg support. In a preferred embodiment, the tactile vibration actuator includes at least one miniature vibration motor embedded within a flexible wrapping or support layer. When energized, the motor generates eccentric vibration, which is transmitted to the driver's contact area via the flexible wrapping layer.

[0044] Specifically, when the tactile vibration actuator is installed on the steering wheel, the driver can perceive the vibration through their hands; when installed on the seat cushion, the driver can perceive the vibration through their buttocks or thighs; when installed on the seat back, the driver can perceive the vibration through their back; and when installed on the leg support, the driver can perceive the vibration through their calves or knees. In a more preferred embodiment, the tactile vibration actuator can simultaneously install vibration units in multiple locations, such as a first vibration unit in the steering wheel area, a second vibration unit in the seat cushion area, and a third vibration unit in the seat back area, with multiple vibration units collectively forming a comprehensive tactile perception network for the driver.

[0045] During the warning output process, when the warning execution module receives the warning trigger signal, the sound warning module and the tactile vibration warning module are activated simultaneously, forming a linked auditory and tactile warning. For example, when a level two warning occurs, the sound warning module outputs a continuous buzzing sound, while the vibration units in the tactile vibration warning module vibrate synchronously at the same frequency. The driver hears the alarm sound while simultaneously feeling vibrations in their hands, back, legs, and other areas. This superposition of multiple sensory stimuli effectively increases the driver's probability of perceiving the warning information. This linked warning mechanism is particularly suitable for high-speed driving scenarios where there is significant driving noise, and where the driver is fatigued or distracted, making it easy to overlook a single sound cues.

[0046] In a preferred embodiment, a data connection is established between the warning execution module and the image acquisition module via a communication module, which can be either wired or wireless. The communication module transmits road images, warning trigger signals, or warning control signals between the image acquisition module, the warning determination module, the warning execution module, and external terminals. The communication module includes any one or more of wired communication interfaces, Bluetooth, WiFi, and radio frequency wireless communication. Using wired or wireless connections adapts to different installation environments, facilitating the installation and deployment of aftermarket products while also meeting the reliability requirements of pre-installed integration. For example, during installation, the dashcam main unit can be fixedly installed inside the windshield, and the tactile vibration actuators can be installed on the outer rim of the steering wheel and inside the seat, respectively. Communication between the two is achieved via Bluetooth or a 2.4G radio frequency wireless module. The installation process does not require disassembling the vehicle interior or modifying the original wiring harness, greatly reducing the difficulty of aftermarket implementation.

[0047] Example 4

[0048] This embodiment provides a multi-sensory warning method for high-speed fatigue driving based on multi-level threshold recognition of the proportion of the vehicle's front view. This method can be implemented using the systems described in embodiments 1 to 3 above. Combined with... Figure 2 As shown, the method in this embodiment includes the following steps: S1. Acquire images of the road ahead of the vehicle and identify lane markings. This step is completed by the image acquisition module and the lane marking recognition module working together. The image acquisition module captures images of the road ahead of the vehicle in real time at a preset frame rate, and the lane marking recognition module processes the road images to identify and extract the boundary coordinate information of the dashed and solid lane lines.

[0049] S2. Obtain vehicle parameters and establish a front reference region. This step is completed by the front reference modeling module. During the system initialization phase, based on the vehicle parameters input by the user or the automatically recognized vehicle model information, a virtual front reference region outline corresponding to the actual width of the vehicle's front is generated in the image coordinate system.

[0050] S3, calculate the encroachment overlap ratio between the vehicle front reference area and the lane markings. This step is performed by the ratio calculation module, which compares the spatial position of the lane marking boundary extracted in step S1 with the vehicle front reference area established in step S2, and calculates the encroachment overlap area ratio or pixel width ratio.

[0051] S4. The encroachment overlap ratio is matched and judged with preset multi-level thresholds, and the duration is judged simultaneously. This step is performed by the early warning judgment module. The early warning judgment module compares the real-time calculated encroachment overlap ratio with the early warning thresholds at each level in the threshold storage module, and records the duration of the encroachment state after it exceeds the corresponding threshold.

[0052] S5. When the encroachment overlap ratio reaches any threshold and the duration meets the corresponding continuous judgment duration, a warning trigger signal is generated. This step is executed by the warning judgment module. When the encroachment state simultaneously meets the threshold condition and the duration condition, it is judged as a real lane departure event, and a corresponding warning trigger signal is generated.

[0053] S6, in response to the warning trigger signal, outputs warning information that can be perceived by the driver. The warning information includes at least one of sound warning, tactile vibration warning, and projection warning. This step is executed by the warning execution module. The sound warning module outputs a buzzer, the tactile vibration warning module outputs physical vibration, and if necessary, the vehicle information projection module simultaneously displays the warning information on the windshield, forming a multi-sensory linkage warning.

[0054] In a preferred embodiment, the method further includes a warning cancellation step: when the warning determination module detects that the percentage of encroachment / overlap between the vehicle's front reference area and the lane markings has fallen back to a preset safe range (e.g., below a certain percentage of the first-level warning threshold), and this safe state continues for a preset duration (e.g., 1.5 to 3 seconds), it determines that the vehicle has returned to its normal driving trajectory, the system automatically cancels the warning trigger signal, and stops the output of sound, vibration, and projection warnings. This warning cancellation step prevents the vehicle from being continuously disturbed by warnings due to residual minor deviations after a brief correction of its direction, thus improving the driving experience.

[0055] Example 5

[0056] This embodiment, based on embodiments 1 to 4, further describes the specific configuration of the vehicle information projection module and its augmented reality-assisted display process.

[0057] The system also includes an in-vehicle information projection module, which is connected to the warning judgment module and the image acquisition module to project vehicle operation information and environmental identification information onto the windshield.

[0058] In a preferred embodiment, the vehicle information projection module is integrated into the vehicle dashcam host or set separately in the area above the dashboard. The information is projected directly onto the driver's line of sight area on the windshield through an optical projection system, so that the driver can obtain key driving information without looking down, effectively reducing the risk of distraction caused by shifting gaze.

[0059] Vehicle operation information includes at least one of the following: current speed, driving direction, and navigation map information. Environmental recognition information includes at least one of the following: lane marking status, distance to the vehicle ahead, identification information of the target vehicle ahead, and license plate recognition information. Specifically, the in-vehicle information projection module can project any one or more of the following information onto the windshield based on real-time data during vehicle operation: The vehicle's instantaneous speed can be displayed dynamically in digital or dial form; Lane departure warning indicator: When lane departure occurs, the projection module can display a highlighted warning mark on the side of the lane departure. Target identification of vehicles ahead, including the relative distance to the identified vehicles and their license plate numbers; Navigation map guidance information, including driving direction guidance and route planning information; Real-time altitude and elevation rise trend make it easy for users to know the vehicle's location and status in complex terrain environments.

[0060] When the vehicle information projection module and the warning execution module work together, once the warning judgment module generates a warning trigger signal, the projection module can directly project a conspicuous lane departure warning graphic onto the windshield area directly in front of the driver's field of vision. For example, a bright, flashing red virtual warning line can be superimposed on the lane marking on the deviating side, so that the driver can obtain visual warning information as soon as possible, further improving the response speed of the warning system and the driver's safety perception.

[0061] Those skilled in the art will understand that, without departing from the concept of the present invention, the module division method, threshold setting logic, installation position of execution components, and display content of projection information described in the above embodiments can be appropriately adjusted and replaced according to actual needs. All equivalent transformations and simple modifications made based on the technical concept disclosed in this invention should fall within the protection scope of this invention.

[0062] It should be noted that the control method in the embodiments of this application can be automatically controlled by a controller. The control method of the controller can be implemented by simple programming by those skilled in the art, which is common knowledge in the field. Furthermore, this application is mainly used to protect mechanical structures, so the control method and circuit connection will not be explained in detail here.

[0063] Obviously, the above-described embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention also intends to include these modifications and variations.

Claims

1. A high-speed fatigue driving multi-sensory early warning system based on multi-level threshold recognition of the proportion of the vehicle's front view, characterized in that, It includes an image acquisition module, a road marking recognition module, a vehicle front reference modeling module, a proportion calculation module, a threshold storage module, a warning determination module, and a warning execution module; The image acquisition module is used to acquire images of the road in front of the vehicle in real time. The lane marking recognition module is used to identify lane markings and extract lane boundary information from the road image in front of the vehicle; The vehicle front reference modeling module is used to establish a vehicle front reference area based on pre-stored vehicle parameters, wherein the vehicle parameters include at least the vehicle front width parameter. The percentage calculation module is used to calculate the percentage of encroachment and overlap between the vehicle front reference area and the lane markings. The threshold storage module is used to store at least two warning thresholds, each warning threshold corresponding to a different duration of judgment. The early warning determination module is used to continuously monitor the change of the encroachment overlap ratio, and generate an early warning trigger signal when the encroachment overlap ratio meets any early warning threshold and the duration meets the corresponding duration determination. The warning execution module is used to receive the warning trigger signal and output warning information that can be perceived by the driver.

2. The high-speed fatigue driving multi-sensory early warning system based on multi-level threshold recognition of the proportion of the vehicle front view as described in claim 1, characterized in that, The early warning execution module includes an audio early warning module and a tactile vibration early warning module.

3. A high-speed fatigue driving multi-sensory early warning system based on multi-level threshold recognition of the proportion of the vehicle's front view, as described in claim 2, is characterized in that... The tactile vibration warning module includes a driver human body contact tactile vibration actuator, which is disposed in at least one of the steering wheel, seat cushion, seat back, and leg support.

4. A high-speed fatigue driving multi-sensory early warning system based on multi-level threshold recognition of the proportion of the vehicle's front view, as described in claim 1, is characterized in that... The system also includes a communication module, which is used to transmit road images, warning trigger signals or warning control signals between the image acquisition module, the warning determination module, the warning execution module or an external terminal. The communication module includes any one or more of wired communication interface, Bluetooth, WiFi, and radio frequency wireless communication.

5. A high-speed fatigue driving multi-sensory early warning system based on multi-level threshold recognition of the proportion of the vehicle's front view, as described in claim 1, is characterized in that... The image acquisition module, lane marking recognition module, vehicle front reference modeling module, proportion calculation module, threshold storage module, and early warning judgment module are integrated inside the vehicle dashcam host, which has high-definition image acquisition capabilities.

6. A high-speed fatigue driving multi-sensory early warning system based on multi-level threshold recognition of the proportion of the vehicle's front view, as described in claim 1, is characterized in that... The multi-level thresholds include different thresholds set for dashed lane markings and solid lane markings, and include at least two levels of thresholds corresponding to different encroachment and overlap ratios; wherein, the continuous judgment duration corresponding to a higher encroachment and overlap ratio is less than the continuous judgment duration corresponding to a lower encroachment and overlap ratio, and the continuous judgment duration corresponding to the solid lane marking is less than or equal to the continuous judgment duration corresponding to the dashed lane marking.

7. A high-speed fatigue driving multi-sensory early warning system based on multi-level threshold recognition of the proportion of the vehicle front view as described in claim 1, characterized in that, It also includes an in-vehicle information projection module, used to project vehicle operation information and environmental recognition information onto the windshield. The vehicle operation information includes at least one of vehicle speed, driving direction, and navigation map information. The environmental recognition information includes at least one of lane marking status, distance to the vehicle in front, identification information of the target vehicle ahead, and license plate recognition information.

8. A multi-sensory early warning method for high-speed fatigue driving based on multi-level threshold recognition of the proportion of the vehicle's front view, characterized in that, Includes the following steps: Capture images of the road ahead of the vehicle and identify lane markings; Acquire vehicle parameters and establish a front reference area; Calculate the percentage of encroachment / overlap between the vehicle front reference area and the lane markings; The encroachment overlap ratio is matched and judged with a preset multi-level threshold, and its duration is judged simultaneously. When the encroachment overlap ratio reaches any threshold and the duration meets the corresponding continuous determination time, an early warning trigger signal is generated; In response to the warning trigger signal, a warning message that can be perceived by the driver is output, the warning message including at least one of sound warning, tactile vibration warning and projection warning.

9. The method according to claim 8, characterized in that, It also includes a warning cancellation step, whereby the warning status is cancelled when the proportion of encroachment and overlap between the vehicle front reference area and the lane markings falls back to a preset safe range and remains there for a preset duration.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the method of claim 8 or 9.

Images