A driver fatigue mood prompting window system and method

Abstract

This invention relates to the field of intelligent vehicles and active safety technology, specifically to a driver fatigue alert window system and method. The system includes: a physiological state monitoring module for acquiring driver facial information and fatigue indicators in real time via onboard sensors; a window control module connected to electrochromic window glass; a projection warning module connected to a window projection device; a driving behavior analysis module for acquiring vehicle yaw rate, lane departure data, or steering wheel angle data; and a central processing module for dynamically controlling the transparency of the window glass, making it semi-transparent when the driver is fatigued, or controlling the projection of preset warning icons onto the window edge area. This invention transforms the window from a passive component into an active safety interactive interface, providing intuitive and progressive visual feedback to alert the driver and externalizing the warning information, thereby effectively improving the safety awareness of the driver and other road users.

Description

Technical Field

[0001] This invention relates to the field of intelligent vehicles and active safety technology, specifically to a driver fatigue warning window system and method. Background Technology

[0002] With the continuous growth of car ownership, road traffic safety issues have become increasingly prominent, posing a significant threat to public safety. Relevant statistics clearly show that driver fatigue and distraction are among the core contributing factors to major traffic accidents, resulting in a high incidence and severity of such accidents.

[0003] To address this issue, some high-end models on the market have begun to be equipped with Driver Status Monitoring Systems (DMS). These systems typically use small cameras installed on the steering wheel or dashboard area to monitor the driver's facial features in real time. By analyzing key data such as eyelid closure frequency and head posture, they determine whether the driver is fatigued or distracted. When an abnormality is detected, the system will issue a warning to the driver through flashing dashboard icons, beeping sounds, or seat vibrations, attempting to awaken the driver's attention.

[0004] However, existing warning methods still have significant shortcomings in practical applications, failing to fully meet the needs of road safety protection: First, the visibility of sound or vibration alarms decreases significantly in noisy driving environments (such as high speeds or loud in-car audio), with driver wake-up rates below 30%, and long-term use can lead to adaptation, resulting in diminished warning effectiveness. Second, dashboard icons are located at the edge of the driver's field of vision; when the driver is already fatigued or inattentive, the visibility of these indicators is severely insufficient, making them difficult to detect quickly. Third, all existing warning signals are private information within the vehicle, perceptible only to the driver and unable to communicate the driver's abnormal state to other road users such as surrounding vehicles and pedestrians. This fails to fully utilize external interaction mechanisms to form collaborative protection, hindering the improvement of overall road safety. For example, vehicles behind cannot predict the driver's condition and cannot take preventative measures in advance.

[0005] As the largest visual interface between a vehicle and its external environment, the car window is an indispensable component. However, its current functions are limited to basic lighting, wind protection, and passive display, failing to fully realize its potential value as an information interaction medium. Therefore, upgrading the traditional car window to a proactive, intelligent, and interactive safety information display medium, and compensating for the shortcomings of existing warning methods through innovative interaction methods, has become a technological direction that urgently needs to be explored and solved in this field. Summary of the Invention

[0006] The purpose of this invention is to propose a driver fatigue alert window system and method, transforming the traditional car window into an "emotionally-oriented" interactive interface that dynamically responds to the driver's state. By altering window transparency and projecting warning patterns—two intuitive visual methods—it provides a progressive, in-depth alert to the driver. Compared to existing audible warnings with only 30% recognition rate in high-speed, noisy environments, this invention, through visual alerts directly acting on the driver's core field of vision, can increase driver wake-up rate to 90%, while enabling 80% of drivers in following vehicles to identify risks in advance and take evasive action.

[0007] According to a first aspect of the present disclosure, a driver fatigue alert window system is provided, comprising: The physiological state monitoring module is usually an in-vehicle camera with infrared illumination, which is aimed at the driver's face to capture data such as eyelids, pupils, and head posture in real time, and to calculate key fatigue indicators such as PERCLOS (the percentage of time the eyes are closed per unit of time). The window control module connects to the vehicle's electrochromic window glass, allowing its transparency to be adjusted continuously or in stages by applying voltage. To improve the subtlety and comfort of warnings, the transparency adjustment is positively correlated with fatigue indicators. The projection warning module is connected to the vehicle's window projection device and is used to receive drive commands and control the window projection device to perform projection operations. Driving behavior analysis module: used to acquire vehicle yaw rate, lane departure data, or steering wheel angle data; The central processing module is connected to the physiological state monitoring module, the window control module, the driving behavior analysis module, and the projection warning module, respectively. The central processing module is configured to: receive fatigue indicators transmitted by the physiological state monitoring module; when the fatigue indicators exceed a first preset threshold and remain so for a preset time (e.g., 3 seconds), generate a first control command and send it to the window control module to reduce the transparency of the electrochromic window glass; when the fatigue indicators exceed a second preset threshold, generate a second control command and send it to the projection warning module to drive the window projection device to project warning icons onto the window glass.

[0008] In one embodiment, the physiological state monitoring module includes an infrared camera positioned toward the driver, and the fatigue indicators include at least the eye closure frequency (PERCLOS) per unit time and the duration of gaze deviation from the road ahead, obtained based on the facial image data.

[0009] In one embodiment, the window control module adjusts the transparency of the electrochromic window glass in a progressive manner, and the degree of reduction in the transparency of the electrochromic window glass is positively correlated with the value of the fatigue index.

[0010] In one embodiment, the window projection device is installed inside the window frame or the A-pillar of the vehicle and is configured to project the warning icon onto the edge or corner of the window glass. The warning icon includes a light symbol or text information indicating fatigue. The warning icon must have sufficient brightness and contrast to ensure it is recognizable by road users both day and night.

[0011] In one embodiment, a driving behavior analysis module is also included to acquire vehicle yaw rate, lane departure data, and steering wheel angle data; the central processing module is further configured to receive and fuse the fatigue index with the driving behavior data from the driving behavior analysis module, perform a comprehensive risk assessment of the driver's driving safety status, and generate corresponding first control command and second control command based on the result of the comprehensive risk assessment.

[0012] In one embodiment, the central processing module is further configured to: when it is determined that the driver's state has returned to the normal range, generate a recovery command and send it to the window control module to control the electrochromic window glass to return to its initial transparency, while simultaneously turning off the projection of the window projection device.

[0013] According to a second aspect of the present disclosure, a method for prompting driver fatigue is provided, applied to the aforementioned system, comprising: S1. Real-time facial image data of the driver is collected through the physiological state monitoring module, and real-time fatigue index is obtained based on the facial image data; S2. The real-time fatigue index is compared with a first preset threshold and a second preset threshold, wherein the second preset threshold is higher than the first preset threshold; S3. If the real-time fatigue index exceeds the first preset threshold and continues for a preset time, control the electrochromic window glass to reduce its transparency to a semi-transparent state. S4. If the real-time fatigue index exceeds the second preset threshold, while maintaining the semi-transparent state of the electrochromic window glass, the window projection device is activated to project a warning icon onto a preset area of ​​the window glass.

[0014] In one embodiment, in step S2, a comprehensive risk assessment is also performed by combining real-time driving behavior data from the driving behavior analysis module, the driving behavior data including lane departure warning signals and abnormal steering operation signals.

[0015] In one embodiment, the reduction in transparency of the electrochromic window glass increases either in a stepwise or linear manner as the driver's fatigue level increases.

[0016] In one embodiment, step S5 is further included: when the driver's real-time fatigue index is detected to fall below the safety threshold and the state continues for a preset time period, a recovery control command is generated to control the electrochromic window glass to return to the initial high transparency state and stop the warning icon projection operation of the window projection device.

[0017] The advantages of the above technical solutions adopted in this invention compared with the prior art are as follows: 1. Warnings are achieved by changing the transparency of electrochromic windows, which directly affects the driver's core field of vision. The gentle "visual obstruction" effect is more difficult to ignore than traditional sound and vibration warnings, effectively avoiding the problem of warning attenuation in noisy environments or long-distance driving. At the same time, gradient feedback is achieved based on fatigue index values. The degree of transparency reduction is positively correlated with the fatigue level, which is in line with the principles of ergonomics and the wake-up effect is more in line with the driver's state perception.

[0018] 2. Breaking through the limitations of traditional car windows which only have passive functions of light transmission and wind protection, it upgrades them into a dynamic and responsive safety status interactive interface. Through a combination of gradual transparency changes and warning icon projection, it builds an intuitive and human-centered communication bridge between the vehicle and the driver, making safety warnings more perceptible.

[0019] 3. The warning icons projected on the car windows can be clearly identified by road users on the side and behind (the effect is particularly prominent at night or in tunnels), realizing the "externalization" of driving status and reminding surrounding vehicles to actively maintain a safe distance. This breaks the limitations of traditional private warnings inside the car and forms a full-scenario safety protection system of "in-vehicle warning - external linkage", improving the overall level of public road safety.

[0020] 4. Existing mature hardware such as vehicle-mounted DMS cameras and electrochromic glass can be fully reused without the need to add a large number of complex devices, achieving efficient integration and upgrading of hardware functions, and achieving a significant leap in active safety warning functions with lower R&D and manufacturing costs. Attached Figure Description

[0021] The accompanying drawings, which form part of this application, are used to provide a further understanding of this application. The illustrative embodiments of this application and their descriptions are used to explain this application and do not constitute an undue limitation of this application.

[0022] Figure 1 Schematic diagram of a window system for alerting drivers to fatigue; Figure 2This is a schematic diagram of the electrochromic car window glass under normal conditions according to the present invention; Figure 3 This is a schematic diagram of the electrochromic window glass under the first-level warning (window darkening only) of the present invention; Figure 4 This is a schematic diagram of the electrochromic window glass under the secondary warning (window darkens and projects an icon) of the present invention; Figure 5 This is a schematic diagram of the warning icon effect from the outside of the vehicle (visible range 100 meters) according to the method of the present invention. Detailed Implementation

[0023] The present disclosure will be further described below with reference to the accompanying drawings and embodiments.

[0024] It should be noted that the following detailed descriptions are exemplary and intended to provide further explanation of this application. Unless otherwise specified, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains.

[0025] It should be noted that the flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of methods and systems according to various embodiments of this disclosure. It should be noted that each block in a flowchart or block diagram may represent a module, segment, or portion of code, which may include one or more executable instructions for implementing the logical functions specified in the various embodiments. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than that shown in the drawings. For example, two consecutively represented blocks may actually be executed substantially in parallel, or they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, may be implemented using a dedicated hardware-based system that performs the specified functions or operations, or using a combination of dedicated hardware and computer instructions.

[0026] The core concept of this invention is to upgrade traditional car windows into an active safety interactive interface. By integrating driver status perception and dynamic feedback functions of the car windows, an integrated warning system is built to prevent fatigue and distracted driving, achieving progressive safety protection from the inside out.

[0027] Example 1: The driver fatigue warning window system in this embodiment includes a physiological state monitoring module, a window control module, a projection warning module, a driving behavior analysis module, and a central processing module. These modules work together to monitor and warn of driver fatigue.

[0028] Physiological state monitoring module: It adopts an in-vehicle infrared camera with infrared supplementary light function, which is set towards the driver and aimed at the facial area to capture facial image data such as the driver's eyelid closure state, pupil changes, and head posture in real time. Based on this data, two core fatigue indicators are obtained: eye closure frequency per unit time (PERCLOS) and duration of gaze deviating from the road ahead.

[0029] Window control module: It connects to the vehicle's electrochromic window glass and has the function of progressively adjusting the transparency of the window glass. The adjustment method can be achieved by applying voltage to achieve continuous or graded control, and the degree of reduction in transparency is positively correlated with the value of fatigue index.

[0030] Projection warning module: Connected to a window projection device consisting of a miniature laser or LED projection module. This projection device is concealed in the window frame or A-pillar of the vehicle and is configured to project warning icons onto the edge area or corner of the window glass. The warning icons include light symbols indicating fatigue or text messages such as "Please rest".

[0031] Driving behavior analysis module: Used to acquire vehicle yaw rate, lane departure data and steering wheel angle data through the vehicle CAN bus, providing supplementary basis for fatigue state judgment.

[0032] Central processing module: It establishes communication connections with the physiological state monitoring module, window control module, projection warning module and driving behavior analysis module respectively, and embeds image recognition algorithms and decision-making logic. It has the functions of data reception, fusion analysis and command generation.

[0033] An illustrative description of the system's operation is as follows: In a long-distance highway driving scenario, the driver exhibits signs of drowsiness after driving continuously for a period of time. The infrared camera of the physiological state monitoring module collects facial image data of the driver in real time. After analysis and calculation, it is found that the PERCLOS value continuously exceeds 20% (first preset threshold) within 2 minutes, and no obvious abnormal gaze deviation is detected. This fatigue index data is transmitted to the central processing module in real time.

[0034] The driving behavior analysis module synchronously acquires the vehicle's yaw rate and steering wheel angle data. If no abnormal driving behavior is detected, the driving behavior data is transmitted to the central processing module.

[0035] The central processing module receives and integrates fatigue index data and driving behavior data. After conducting a comprehensive risk assessment, it determines that the driver is in a state of mild fatigue and then generates the first control command and sends it to the window control module.

[0036] The window control module responds to the first control command and drives the electrochromic window glass on the driver's side to start a progressive transparency adjustment. Its transparency gradually decreases from the initial 85% to 40%, forming a semi-transparent state. Through the "visual obstruction" effect, it prompts the driver to notice that his or her condition is abnormal.

[0037] If the driver does not adjust their state in time, drowsiness will continue to worsen, the PERCLOS value calculated by the physiological state monitoring module will rise to 35% (the second preset threshold), and the driving behavior analysis module will detect slight lane departure data and transmit it to the central processing module.

[0038] The central processing module conducts another comprehensive risk assessment and determines that the driver is in a state of moderate fatigue. While maintaining the first control command sent to the window control module and keeping the window semi-transparent, it generates a second control command and sends it to the projection warning module.

[0039] The projection warning module responds to the second control command and drives the window projection device installed in the window frame to project a red warning icon in the form of "fatigue driving warning" in the upper right corner of the driver's side window. The icon is clearly visible inside the vehicle and can also be seen by vehicles behind and to the side outside the vehicle.

[0040] When the central processing module detects through the physiological state monitoring module that the driver's PERCLOS value and the duration of gaze deviation have fallen below the safety threshold, and the driving behavior analysis module no longer collects abnormal driving behavior data, after this normal state lasts for 1 minute, the central processing module generates a recovery command and sends it to the window control module and the projection warning module respectively. This controls the electrochromic window glass to gradually return to its initial high transparency of 85% within a few seconds, while simultaneously turning off the warning icon projection function of the window projection device, and the system returns to the silent monitoring state.

[0041] Example 2: This embodiment provides a method for alerting drivers to fatigue, applied to the aforementioned driver fatigue alert window system, and specifically includes the following steps: Step S1: Collect the driver's facial image data in real time through the physiological state monitoring module, and obtain the real-time fatigue index based on the facial image data; Specifically, an in-vehicle infrared camera (physiological state monitoring module) with infrared illumination capability collects real-time facial image data of the driver, including information such as eyelid closure status, pupil changes, and head posture. Based on this facial image data, two real-time fatigue indicators are calculated: the frequency of eye closure per unit time (PERCLOS) and the duration of gaze deviation from the road ahead. Simultaneously, a driving behavior analysis module acquires real-time driving behavior data such as vehicle yaw rate, lane departure data, and steering wheel angle data.

[0042] Step S2: Compare the real-time fatigue index with the first preset threshold and the second preset threshold respectively, wherein the second preset threshold is higher than the first preset threshold; Specifically, the real-time fatigue index calculated in step S1 is compared with the preset first threshold and second threshold, respectively, where the second threshold is higher than the first threshold; at the same time, combined with the real-time driving behavior data (including lane departure warning signals and abnormal steering operation signals) obtained in step S1, a comprehensive risk assessment is performed through the central processing module to improve the accuracy of fatigue state judgment.

[0043] Step S3: If the real-time fatigue index exceeds the first preset threshold but does not exceed the second preset threshold, then control the electrochromic window glass to reduce its transparency to a semi-transparent state. Specifically, if the comprehensive risk assessment results show that the real-time fatigue index exceeds the first preset threshold (e.g., the PERCLOS value exceeds 20%) but does not exceed the second preset threshold, and the driving behavior data shows no obvious abnormalities, the central processing module generates the first control command to control the electrochromic window glass to gradually reduce its transparency. The reduction rate increases stepwise or linearly with the increase in fatigue level, eventually reaching a semi-transparent state. This adjustment process is achieved by applying voltage through the window control module.

[0044] Step S4: If the real-time fatigue index exceeds the second preset threshold, while maintaining the semi-transparent state of the electrochromic window glass, the window projection device is activated to project a warning icon onto the preset area of ​​the window glass. Specifically, if the comprehensive risk assessment results show that the real-time fatigue index exceeds a higher second preset threshold (such as the PERCLOS value exceeding 35%), and abnormalities such as lane departure occur in the driving behavior data, the central processing module generates a second control command while maintaining the semi-transparent state of the electrochromic window glass. This command activates the window projection device installed in the window frame or A-pillar of the vehicle to project light symbols or text warning icons indicating fatigue onto the edge area or corner of the window glass.

[0045] Step S5: When the driver's real-time fatigue index is detected to fall below the safety threshold and this state continues for a preset time period, a recovery control command is generated to control the electrochromic window glass to return to the initial high transparency state and stop the warning icon projection operation of the window projection device.

[0046] Specifically, when the driver's real-time fatigue index is detected to fall below the safety threshold and this normal state continues for a preset 1-minute period, the central processing module automatically generates a recovery control command. The window control module controls the electrochromic window glass to return to its initial high transparency state, and at the same time, the projection warning module stops the warning icon projection operation of the window projection device, and the system returns to the initial monitoring state.

[0047] The above modules can be deployed on the same device or distributed devices; the division of modules is only a functional logic description and does not limit the specific physical boundaries or implementation order.

[0048] Those skilled in the art will understand that the modules or steps described above can be implemented using general-purpose computer devices. Optionally, they can be implemented using computer-executable program code, which can then be stored in a storage device for execution by a computer device. Alternatively, they can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. This disclosure is not limited to any particular combination of hardware and software.

[0049] The above description is merely a preferred embodiment of this application and is not intended to limit this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

[0050] While the specific embodiments of this disclosure have been described above in conjunction with the accompanying drawings, this is not intended to limit the scope of protection of this disclosure. Those skilled in the art should understand that various modifications or variations that can be made by those skilled in the art without creative effort based on the technical solutions of this disclosure are still within the scope of protection of this disclosure.

Claims

1. A driver fatigue alert window system, characterized in that, include: The physiological state monitoring module is used to collect facial image data of the driver in real time and obtain fatigue indicators based on the data, including the frequency of eye closure and the duration of gaze deviation per unit time. The window control module connects to the vehicle's electrochromic window glass to receive control commands and gradually adjust the transparency of the electrochromic window glass. The projection warning module is connected to the vehicle's window projection device. It is used to receive driving commands and control the window projection device to project warning icons that can be recognized by road users outside the vehicle on the edge area of ​​the window glass. The central processing module is connected to the physiological state monitoring module, the window control module, and the projection warning module, respectively. The central processing module is configured to: receive fatigue indicators transmitted by the physiological state monitoring module; when the fatigue indicators exceed a first preset threshold and remain so for a preset time, generate a first control command and send it to the window control module to reduce the transparency of the electrochromic window glass; when the fatigue indicators exceed a second preset threshold, generate a second control command and send it to the projection warning module to drive the window projection device to project warning icons onto the window glass.

2. The driver fatigue alert window system according to claim 1, characterized in that, The physiological state monitoring module includes an infrared camera positioned towards the driver, and the fatigue indicators include at least the frequency of eye closure and the duration of gaze deviation from the road ahead, obtained based on the facial image data.

3. The driver fatigue alert window system according to claim 1, characterized in that, The window control module adjusts the transparency of the electrochromic window glass in a progressive manner, and the degree of reduction in the transparency of the electrochromic window glass is positively correlated with the value of the fatigue index.

4. The driver fatigue warning window system according to claim 1, characterized in that, The window projection device is installed in the window frame or inside the A-pillar of the vehicle. It is configured to project the warning icon onto the edge area or corner of the window glass. The warning icon includes light symbols or text information to indicate fatigue, and the brightness of the warning icon is automatically adjusted according to the ambient light intensity.

5. The driver fatigue alert window system according to claim 1, characterized in that, It also includes a driving behavior analysis module for acquiring vehicle yaw rate, lane departure data, and steering wheel angle data; the central processing module is further configured to receive and fuse the fatigue index with the driving behavior data from the driving behavior analysis module to conduct a comprehensive risk assessment of the driver's driving safety status, and generate corresponding first and second control commands based on the results of the comprehensive risk assessment only when the fatigue index and the driving behavior data simultaneously trigger their respective abnormal thresholds.

6. The driver fatigue warning window system according to claim 1, characterized in that, The central processing module is also configured to: when it is determined that the driver's state has returned to the normal range and continues for a preset period of time, generate a recovery command and send it to the window control module to control the electrochromic window glass to return to its initial transparency, and at the same time turn off the projection of the window projection device.

7. A method for providing driver fatigue alerts to a system according to any one of claims 1-6, characterized in that, include: S1. Real-time facial image data of the driver is collected through the physiological state monitoring module, and real-time fatigue index is obtained based on the facial image data; S2. The real-time fatigue index is compared with a first preset threshold and a second preset threshold, wherein the second preset threshold is higher than the first preset threshold; S3. If the real-time fatigue index exceeds the first preset threshold and continues for a preset time, control the electrochromic window glass to reduce its transparency to a semi-transparent state. S4. If the real-time fatigue index exceeds the second preset threshold, while maintaining the semi-transparent state of the electrochromic window glass, the window projection device is activated to project a warning icon onto a preset area of ​​the window glass.

8. The method for prompting driver fatigue according to claim 7, characterized in that, In step S2, a comprehensive risk assessment is also performed by combining real-time driving behavior data from the driving behavior analysis module. Subsequent warning steps are only executed when the fatigue index and the driving behavior data simultaneously trigger the abnormal threshold. The driving behavior data includes lane departure warning signals and abnormal steering operation signals.

9. A method for prompting driver fatigue according to claim 7 or 8, characterized in that, The reduction in transparency of the electrochromic window glass increases either in a stepwise or linear manner as the driver's fatigue level increases.

10. The method for prompting driver fatigue according to claim 7, characterized in that, It also includes step S5: when the driver's real-time fatigue index is detected to fall below the safety threshold and this state continues for a preset time period, a recovery control command is generated to control the electrochromic window glass to return to the initial high transparency state and stop the warning icon projection operation of the window projection device.

Images