Warning system for visual display of automobile A column

Abstract

The invention discloses a warning system for visual display of an automobile column A. The warning system comprises a communication module, an environment sensing module, a data processing module, an image processing module, an interaction module, a driving state monitoring module, a warning module and a display module, the environment sensing module is in one-way connection with the data processing module, the data processing module is in one-way connection with the image processing module, the interaction module is in two-way connection with the driving state monitoring module and the image processing module, the interaction module is in one-way connection with the warning module, and the image processing module is in one-way connection with the display module. The system has the beneficial effects that blind area data is collected by adding the camera and the multiple sensors in a fusion manner, real scene visual presentation can be realized in combination with the display module, and the problem that the A column shields the view is solved, so that a driver can master the dynamic state of a blind area target in real time, and the collision risk of scenes such as turning and doubling is remarkably reduced.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of automobile technology, in particular to a warning system for visual display of automobile A column. BACKGROUND

[0002] Among the existing automobiles, an automobile is a land vehicle with four or more wheels, which is powered by an engine or an electric motor and can travel on ordinary roads without rail. It is mainly used for carrying passengers or goods and is one of the most common and important personal and public transportation tools in modern transportation system.

[0003] As one of the most important transportation tools at present, the A column of the automobile is located at the left front and right front connecting column connecting the roof and the front cabin, which will block the driver's view during driving, and thus will cause a blind area. In the prior art, some solutions are to reduce the cross-sectional size of the A column to expand the driving view, which will reduce the structural strength of the vehicle body, or to rely on the rearview mirror or a simple warning light for warning. This can only provide limited information and cannot intuitively present the real scene of the blind area. SUMMARY

[0004] The purpose of the present application is to provide a warning system for visual display of automobile A column, to solve the problem of the A column of the automobile, which is located at the left front and right front connecting column connecting the roof and the front cabin, which will block the driver's view during driving, and thus will cause a blind area. In the prior art, some solutions are to reduce the cross-sectional size of the A column to expand the driving view, which will reduce the structural strength of the vehicle body, or to rely on the rearview mirror or a simple warning light for warning. This can only provide limited information and cannot intuitively present the real scene of the blind area.

[0005] To achieve the above purpose, the present application provides the following technical scheme: a warning system for visual display of automobile A column, comprising: a communication module, an environment perception module, a data processing module, an image processing module, an interaction module, a driving state monitoring module, a warning module and a display module, the communication module is connected with the environment perception module and the interaction module in one direction, the environment perception module is connected with the data processing module in one direction, the data processing module is connected with the image processing module in one direction, the interaction module is connected with the driving state monitoring module and the image processing module in two directions, the interaction module is connected with the warning module in one direction, and the image processing module is connected with the display module in one direction.

[0006] As a preferred scheme of the present application: the communication module includes a body controller (BCM), an ADAS domain controller and a DMS for exchanging data, and is used for receiving signals such as vehicle speed, steering angle and steering light state for context judgment.

[0007] As a preferred scheme of the present application: the environment perception module comprises a camera and a sensor, and the environment perception module is assembled by the camera and the sensor in cooperation; The camera adopts a wide-angle or fisheye camera and is installed at four corners of the automobile, including the front fender, below the outside rearview mirror, and both sides of the front bumper, for real-time collection of a video stream of an A-pillar shielding area. The sensor adopts a millimeter wave radar, a laser radar, or an ultrasonic sensor and is installed at the front of the automobile and the parking space for detection of distance and speed of an object in an A-pillar blind area, to assist the camera in obtaining more accurate object data, especially in bad weather or poor light conditions.

[0008] As a preferred scheme of the present application: the data processing module comprises a data receiving unit and a data sorting unit, the data processing module is used for receiving data perceived by the environment perception module through the data receiving unit, fusing data collected by different sensors, then processing the received data through the data sorting unit, and transmitting the processed data to the image processing module.

[0009] As a preferred scheme of the present application: the image processing module comprises an algorithm processing unit, an image preprocessing unit, and a fusion perception unit, the image processing module is used for geometric correction of image distortion caused by the fisheye lens through the image preprocessing unit, conversion of the camera picture into the driver's perspective, seamless fusion transition through drawing, and cooperation with the algorithm processing unit to judge whether there is a potential danger in the A-pillar blind area according to the results of image processing and data fusion, predict whether the target is likely to collide with the vehicle by analyzing the motion trajectory and speed of the target, and make corresponding decisions according to preset rules and models, such as whether to trigger a warning signal, finally use deep learning or traditional CV methods through the fusion perception unit to identify vehicles, pedestrians, cyclists, etc. in the blind area, output target position, speed, and trajectory prediction, and communicate with the vehicle ADAS system through the communication module, then receive signals from the FCW (forward collision warning), BSD (blind spot monitoring), LKA (lane keeping), and other systems, to realize multi-sensor information fusion and improve the judgment accuracy.

[0010] As a preferred scheme of the present application: the interaction module includes a control unit and a human-computer interaction unit, the interaction module is used for controlling the content displayed by the display module according to the decision information issued by the data processing module, according to a preset control strategy, and adjusting the display content, brightness, contrast, projection parameters of the projection device, etc. through the human-computer interaction unit according to needs, and the display content including the pedestrian walking pattern, the bicycle pattern, the triangular pyramid shelter pattern, etc. can be controlled according to needs, thereby providing the driver with system state information, fault prompt and other feedback, and the warning intensity including color, flashing frequency, duration, etc. can be controlled at the same time.

[0011] As a preferred scheme of the present application: the driving state monitoring module includes a hardware monitoring unit, an eyeball tracking unit and a logic control unit, the driving state monitoring module monitors the driving state and driving time of the driver in real time through the infrared camera installed in the hardware monitoring unit, then analyzes the eye movement of the driver through the eyeball tracking unit to judge the line of sight direction, whether to focus on the front of the road or be distracted by other things, and simultaneously judges whether there is a sign of drowsiness by monitoring the frequency and duration of the driver's blinking, and finally realizes dynamic adjustment of the content display priority on the A-pillar display screen according to the collected data through the logic control unit, so as to ensure that the most important information is always in the position most easily noticed by the driver.

[0012] As a preferred scheme of the present application: the warning module includes a warning generation unit, a multi-mode warning unit and an intensity adjustment unit, the warning module controls the warning generation unit to superimpose and enhance the warning pattern on the A-pillar display screen according to the information fed back by the interaction module, then realizes the warning in multiple modes such as vision and sound through the multi-mode warning unit, so as to warn the driver, and cooperates with the driving state monitoring module to warn the driver who is driving while tired, and finally uses the intensity adjustment unit to customize the warning intensity.

[0013] As a preferred scheme of the present application: the display module includes a display screen and a projection device, the display module is installed in the inner side of the A-pillar, and is used to visually display the processed A-pillar blind area image or warning information to the driver according to the information fed back by the interaction module and the image processing module. The display screen can be a transparent OLED display screen, an LCD display screen or other suitable display device, and is required to have high resolution, high contrast, fast response and other characteristics to ensure that the content can be clearly displayed under different light conditions and does not affect the normal observation of the driver to the front road, and the projection device can be installed and replaced as needed. By adopting the projection technology, the processed image or warning information is projected onto a specific area near the A-pillar, such as the transparent surface on the inner side of the A-pillar, to realize the effect of a "transparent A-pillar", so that the driver can see the blind area scene that is originally blocked by the A-pillar. The projection device needs to have high brightness and high precision projection capability to ensure the clarity and accuracy of the projected image.

[0014] Compared with the prior art, the present application has the following advantages: the present application adds a camera and a multi-sensor fusion to collect blind area data, and combines a display module to realize real scene visualization, and solves the problem of A-pillar blocking the field of view, so that the driver can master the dynamic of the blind area target in real time, and significantly reduce the collision risk in turning, merging and other scenes; by adding multiple types of sensor data such as cameras and millimeter wave radars, the target can be accurately identified and the risk can be predicted in complex environments such as bad weather and insufficient light, avoiding misjudgment or omission of a single sensor; by adding a driving state monitoring module to capture the state of the driver's attention and fatigue in real time, the display content priority and warning intensity are dynamically adjusted, and the warning for the driver who is tired or distracted is intensified, so as to adapt to different driving scene needs; by adding multi-modal warning methods such as vision and sound, and adjusting warning parameters such as color and flashing frequency, the driver can customize the settings according to driving habits, which ensures the prominence of the warning signal and avoids driving interference caused by excessive warning, so as to solve the problems of reducing the cross-sectional size of the A-pillar to expand the driving field of view, which reduces the structural strength of the vehicle body, or relying on the outside rearview mirror or a simple warning light for reminding, which can only provide limited information and cannot directly present the real scene of the blind area, and other problems, so as to improve the warning effect. BRIEF DESCRIPTION OF DRAWINGS

[0015] Fig. 1 The system block diagram of the present application is shown in the figure; Fig. 2 The interaction module schematic diagram of the present application is shown in the figure. DETAILED DESCRIPTION

[0016] With reference to the drawings of the embodiments of the present application, the technical solutions in the embodiments of the present application will be described clearly and completely. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative work fall within the scope of the present application.

[0017] Please refer to Figs. 1-2 The present application provides a technical solution: a warning system for visual display of an A-pillar of an automobile, comprising a communication module, an environment perception module, a data processing module, an image processing module, an interaction module, a driving state monitoring module, a warning module and a display module, the communication module is connected with the environment perception module and the interaction module in one direction, the environment perception module is connected with the data processing module in one direction, the data processing module is connected with the image processing module in one direction, the interaction module is connected with the driving state monitoring module and the image processing module in two directions, the interaction module is connected with the warning module in one direction, and the image processing module is connected with the display module in one direction.

[0018] The communication module comprises a body controller (BCM), an ADAS domain controller and a DMS for exchanging data, and is used for receiving signals such as vehicle speed, steering angle and steering light state, and for context judgment.

[0019] The environment perception module comprises a camera and a sensor, and the environment perception module is assembled by the camera and the sensor; The camera is a wide-angle or fisheye camera, and is installed at four corners of the automobile, including the front fender, below the outside rearview mirror and both sides of the front bumper, for real-time collection of video streams of the A-pillar shielding area; The sensor is a millimeter wave radar, a laser radar or an ultrasonic sensor, and is installed at the front of the automobile and the parking space, for detecting the distance and speed of objects in the A-pillar blind area, assisting the camera to obtain more accurate object data, especially in bad weather or poor light conditions.

[0020] The data processing module comprises a data receiving unit and a data sorting unit, the data processing module receives data perceived by the environment perception module through the data receiving unit, fuses the data collected by different sensors, processes the received data through the data sorting unit, and transmits the processed data to the image processing module.

[0021] The image processing module includes an algorithm processing unit, an image preprocessing unit, and a fusion perception unit. The image processing module is used to perform geometric correction on the image distortion caused by the fisheye lens through the image preprocessing unit, convert the camera image into the driver's perspective, and then draw and seamlessly fuse the images. In conjunction with the algorithm processing unit, based on the results of image processing and data fusion, it determines whether there are potential hazards in the A-pillar blind spot. By analyzing the target's trajectory and speed, it predicts whether it may collide with the vehicle and makes corresponding decisions based on preset rules and models, such as whether to trigger warning signals. Finally, the fusion perception unit uses methods based on deep learning or traditional CV to identify vehicles, pedestrians, cyclists, etc. in the blind spot and outputs the target position, speed, and trajectory prediction. It communicates with the vehicle's ADAS system through the communication module and receives signals from systems such as FCW (Forward Collision Warning), BSD (Blind Spot Detection), and LKA (Lane Keeping Assist) to achieve multi-sensor information fusion and improve the accuracy of judgment.

[0022] The interaction module includes a control unit and a human-machine interaction unit. Based on the decision information issued by the data processing module and according to the preset control strategy, the interaction module controls the content displayed by the display module through the control unit. As needed, the human-machine interaction unit can adjust the display content, brightness, contrast, and control the projection parameters of the projection device. It can also control the display content, including pedestrian walking patterns, bicycle patterns, triangular cone obstruction patterns, etc., to provide the driver with system status information, fault prompts, and other feedback. At the same time, it can control the warning intensity, including color, flashing frequency, and duration.

[0023] The driving state monitoring module includes a hardware monitoring unit, an eye-tracking unit, and a logic control unit. The driving state monitoring module controls an infrared camera installed in the hardware monitoring unit to monitor the driver's driving state and driving time in real time. Then, the eye-tracking unit analyzes the driver's eye movements to determine the direction of their gaze, whether they are focused on the road ahead or distracted by other things. At the same time, it monitors the frequency and duration of the driver's blinks to determine if there are signs of drowsiness. Finally, the logic control unit dynamically adjusts the display priority of the content on the A-pillar display screen based on the collected data to ensure that the most important information is always in the position that the driver can most easily notice.

[0024] The warning module includes a warning generation unit, a multi-mode warning unit, and an intensity adjustment unit. The warning module controls the warning generation unit to overlay enhanced warning graphics on the A-pillar display screen based on the information fed back by the interaction module. Then, the multi-mode warning unit realizes multiple modes of warning, such as visual and audible warnings, to warn the driver. It also works with the driving status monitoring module to warn drivers who are fatigued. Finally, the intensity adjustment unit allows for custom settings of the warning intensity.

[0025] The display module includes a display screen and a projection device. Installed inside the A-pillar, the display module visually displays the processed blind spot image or warning information to the driver based on feedback from the interaction module and image processing module. The display screen can be a transparent OLED screen, LCD screen, or other suitable display device, requiring high resolution, high contrast, and fast response to ensure clear display under different lighting conditions without obstructing the driver's view of the road ahead. The projection device can be replaced as needed. Using projection technology, the processed image or warning information is projected onto a specific area near the A-pillar, such as the transparent surface inside the A-pillar, achieving a "transparent A-pillar" effect, allowing the driver to see the previously obscured blind spot. The projection device needs high brightness and high-precision projection capabilities to ensure the clarity and accuracy of the projected image.

[0026] Specifically, during use, data is exchanged through the Body Control Controller (BCM), ADAS domain controller, and DMS within the communication module. It also receives signals such as vehicle speed, steering angle, and turn signal status for situational judgment. The environmental perception module, assembled from cameras and sensors, is used for this purpose. The cameras are wide-angle or fisheye lenses, installed at the four corners of the vehicle, including the front fenders, below the exterior rearview mirrors, and on both sides of the front bumper, to capture real-time video streams from areas obscured by the A-pillars. The sensors, employing millimeter-wave radar, lidar, or ultrasonic sensors, are installed at the front and rear of the vehicle to detect the distance and speed of objects in the A-pillar blind spot, assisting the cameras in obtaining more accurate object data, especially in adverse weather or poor lighting conditions. The data processing module receives data from the environmental perception module via the data receiving unit, fuses data collected from different sensors, and then processes the received data using the data sorting unit before transmitting the processed data to the image processing module. The image processing module uses the image preprocessing unit to geometrically correct image distortion caused by the fisheye lens, converts the camera view to the driver's perspective, and then performs seamless image fusion. In conjunction with the algorithm processing unit, based on the results of image processing and data fusion, it determines whether there are potential hazards in the A-pillar blind spot, analyzes the target's trajectory and speed to predict the likelihood of a collision, and makes corresponding decisions based on preset rules and models. The system detects whether warning signals are triggered, and then uses a fusion perception unit to identify vehicles, pedestrians, and cyclists in blind spots using methods based on deep learning or traditional computer vision. It outputs target position, speed, and trajectory prediction, and communicates with the vehicle's ADAS system via a communication module. It also receives signals from systems such as FCW (Forward Collision Warning), BSD (Blind Spot Detection), and LKA (Lane Keeping Assist), achieving multi-sensor information fusion to improve judgment accuracy. Based on the decision information from the data processing module and a preset control strategy, the interactive module controls the content displayed on the display module through a control unit. Users can also adjust the display content, brightness, and contrast through the human-machine interface as needed. The projection device's projection parameters can be controlled, and the displayed content can be adjusted as needed, including pedestrian walking patterns, bicycle patterns, and triangular cone obstruction patterns, etc., to provide the driver with system status information, fault prompts, and other feedback. Simultaneously, the intensity of warnings, including color, flashing frequency, and duration, can be controlled. A driver status monitoring module uses an infrared camera installed within the hardware monitoring unit to monitor the driver's driving status and driving time in real time. Then, an eye-tracking unit analyzes the driver's eye movements to determine their gaze direction, whether they are focused on the road ahead or distracted by other objects. Simultaneously, the frequency and duration of the driver's blinks are monitored to determine if there are signs of drowsiness. Finally, the logic control unit processes the collected data...The system dynamically adjusts the content display priority on the A-pillar display screen to ensure that the most important information is always in the position most easily noticed by the driver. The warning module controls the warning generation unit to overlay enhanced warning graphics on the A-pillar display screen based on feedback from the interaction module. Then, a multi-modal warning unit provides visual and audible warnings to the driver. It also works with the driving status monitoring module to warn drivers of fatigue. Finally, the intensity adjustment unit allows for customized warning intensity settings. The display module, installed inside the A-pillar, displays the processed blind spot image or warning information to the driver based on feedback from the interaction and image processing modules. The display screen can be a transparent OLED screen, LCD screen, or other suitable display device, requiring high resolution, high contrast, and fast response to ensure clear display under different lighting conditions without affecting the driver's normal observation of the road ahead. A projection device can be installed as needed to project the processed image or warning information onto a specific area near the A-pillar, such as the transparent surface inside the A-pillar, achieving a "transparent A-pillar" effect, allowing the driver to see the previously obscured blind spot through the A-pillar. Projection devices need to possess high brightness and high-precision projection capabilities to ensure the clarity and accuracy of the projected image.

[0027] Although embodiments of the invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.

Claims

1. A warning system for visual display on the A-pillar of a car, characterized in that, include: The system includes a communication module, an environmental perception module, a data processing module, an image processing module, an interaction module, a driving status monitoring module, a warning module, and a display module. The communication modules are unidirectionally connected to the environmental perception module and the interaction module. The environmental perception module is unidirectionally connected to the data processing module. The data processing module is unidirectionally connected to the image processing module. The interaction modules are bidirectionally connected to the driving status monitoring module and the image processing module. The interaction module is unidirectionally connected to the warning module. The image processing module is unidirectionally connected to the display module.

2. The warning system for visual display of an automobile A-pillar according to claim 1, characterized in that: The communication module includes the Body Control Controller (BCM), ADAS Domain Controller, and DMS for exchanging data, and is used to receive signals such as vehicle speed, steering angle, and turn signal status for situational judgment.

3. The warning system for visual display of an automobile A-pillar according to claim 1, characterized in that: The environmental perception module includes a camera and a sensor, and the environmental perception module is assembled from the camera and the sensor. The cameras are either wide-angle or fisheye cameras and are installed at the four corners of the car, including the front fenders, below the exterior rearview mirrors, and on both sides of the front bumper, to collect video streams of the areas obscured by the A-pillars in real time. The sensor, which uses millimeter-wave radar, lidar, or ultrasonic sensors, is installed at the front and rear of the car to detect the distance and speed of objects in the blind spot of the A-pillar, assisting the camera in obtaining more accurate object data, especially in bad weather or poor lighting conditions.

4. A warning system for visual display on an automotive A-pillar according to claim 1, characterized in that: The data processing module includes a data receiving unit and a data sorting unit. The data receiving unit receives data sensed by the environmental perception module, fuses data collected by different sensors, processes the received data using the data sorting unit, and transmits the processed data to the image processing module.

5. A warning system for visual display on an automotive A-pillar according to claim 1, characterized in that: The image processing module includes an algorithm processing unit, an image preprocessing unit, and a fusion perception unit. The image processing module is used to perform geometric correction on the image distortion caused by the fisheye lens through the image preprocessing unit, convert the camera image into the driver's perspective, and then draw a picture for seamless fusion transition. In conjunction with the algorithm processing unit, based on the results of image processing and data fusion, it determines whether there are potential hazards in the A-pillar blind spot. By analyzing the target's movement trajectory and speed, it predicts whether it may collide with the vehicle and makes corresponding decisions based on preset rules and models, such as whether to trigger warning signals. Finally, the fusion perception unit uses methods such as deep learning or traditional CV to identify vehicles, pedestrians, cyclists, etc. in the blind spot, and outputs the target position, speed, and trajectory prediction. It communicates with the vehicle's ADAS system through the communication module and receives signals from systems such as FCW, BSD, and LKA to achieve multi-sensor information fusion and improve the accuracy of judgment.

6. A warning system for visual display on an automotive A-pillar according to claim 1, characterized in that: The interaction module includes a control unit and a human-machine interaction unit. The interaction module is used to control the content displayed by the display module through the control unit according to the decision information issued by the data processing module and the preset control strategy. It can also adjust the display content, brightness, contrast, and control the projection parameters of the projection device through the human-machine interaction unit as needed. It can also control the display content, including pedestrian walking patterns, bicycle patterns, triangular cone obstruction patterns, etc., to provide the driver with system status information, fault prompts, and other feedback. At the same time, it can control the warning intensity, including color, flashing frequency, duration, etc.

7. A warning system for visual display on an automotive A-pillar according to claim 1, characterized in that: The driving state monitoring module includes a hardware monitoring unit, an eye-tracking unit, and a logic control unit. The driving state monitoring module controls an infrared camera installed in the hardware monitoring unit to monitor the driver's driving state and driving time in real time. Then, the eye-tracking unit analyzes the driver's eye movements to determine the direction of their gaze, whether they are focused on the road ahead or distracted by other things. At the same time, it monitors the frequency and duration of the driver's blinks to determine if there are signs of drowsiness. Finally, the logic control unit dynamically adjusts the display priority of the content on the A-pillar display screen based on the collected data to ensure that the most important information is always in the position that the driver can most easily notice.

8. A warning system for visual display of an automobile A-pillar according to claim 1, characterized in that: The warning module includes a warning generation unit, a multi-mode warning unit, and an intensity adjustment unit. The warning module controls the warning generation unit to overlay enhanced warning graphics on the A-pillar display screen based on the information fed back by the interaction module. Then, the multi-mode warning unit realizes multiple modes of warning, such as visual and audible warnings, to warn the driver. It also works with the driving status monitoring module to warn drivers who are fatigued. Finally, the intensity adjustment unit allows for customized settings of the warning intensity.

9. A warning system for visual display on an automotive A-pillar according to claim 1, characterized in that: The display module includes a display screen and a projection device. The display module is installed inside the A-pillar and is used to visually display the processed A-pillar blind spot image or warning information to the driver based on feedback from the interaction module and image processing module. The display screen can be a transparent OLED display, LCD display, or other suitable display device, requiring high resolution, high contrast, and fast response to ensure clear display under different lighting conditions without affecting the driver's normal observation of the road ahead. The projection device can be replaced as needed. By using projection technology, the processed image or warning information is projected onto a specific area near the A-pillar, such as the transparent surface inside the A-pillar, achieving a "transparent A-pillar" effect, allowing the driver to see the previously obscured blind spot through the A-pillar. The projection device needs to have high brightness and high-precision projection capabilities to ensure the clarity and accuracy of the projected image.

Images