Bus blind area safety early warning system based on external human-computer interface

Abstract

The utility model relates to a kind of bus blind area safety early warning system based on external man-machine interface, belong to intelligent auxiliary driving technical field, the system includes the sensing module for monitoring external environment, the reaction module for driver to obtain information and make decision, signal transmission and processing module etc., through the sensing module formed by high-definition camera and laser radar, the image information of bus front environment can be identified in real time, accurately and distinguish pedestrians and other objects, and pass through in-vehicle loudspeaker to bus driver transmission information, utilize eHMI display interface as interactive carrier, complete information interaction by voice+vision dual channel, assist driver to carry out efficient decision, reduce invalid operation, avoid the risk of blind area misjudgment.

Description

Technical Field

[0001] This utility model belongs to the field of intelligent assisted driving technology, specifically relating to a blind spot safety warning system for buses based on an external human-machine interface. Background Technology

[0002] Public transportation is the primary mode of travel for residents. Currently, communication between pedestrians and buses mainly relies on implicit communication, such as informal gestures. In this traditional interaction mode, drivers and pedestrians need to be in close contact, and pedestrians need to observe a clear signal from the driver before daring to cross the street. This results in a long and inefficient yielding decision-making process, reducing road traffic efficiency. If a bus does not intend to yield and a pedestrian forcibly crosses the street, it can easily cause the bus to brake suddenly, leading to rear-end collisions due to delayed reaction by vehicles behind, threatening road safety.

[0003] Furthermore, buses are large and have significant blind spots to their sides and rear. When a bus is in motion, drivers behind it may lack road experience and be unable to slow down in time due to blind spots, increasing the risk of collision. For example, a typical four-lane urban road is usually 20-30 meters wide. The average adult walks at 1.2 m / s, taking 13-17 seconds to cross the road. Running at 3-4 m / s takes 4-5 seconds. Low-speed vehicles (30 km / h and below) require 2.5-3.5 seconds from the time the driver observes a pedestrian to the time they stop, while high-speed vehicles (60 km / h and above) require more than 4 seconds. If pedestrians are not effectively warned by surrounding vehicles, drivers, affected by blind spots, cannot anticipate whether pedestrians are crossing, increasing road traffic risks.

[0004] To improve the efficiency of interaction between buses, pedestrians, and drivers, and to reduce road traffic risks, explicit communication, such as external human-machine interfaces (eHMIs), has become a hot research topic. Using external interfaces for explicit communication, instead of traditional informal communication, can further reduce the ambiguity of pedestrians' understanding of bus intentions while crossing the street and improve interaction efficiency. Explicit communication between buses and drivers via external interfaces can convey information about blind spots to drivers, thereby informing pedestrians of the bus's yielding intention and preventing traffic accidents caused by drivers' lack of road experience and blind spots. Currently, no related inventions involve an eHMI interface display for buses; therefore, designing an eHMI interaction system and its control device suitable for buses is essential. Summary of the Invention

[0005] The purpose of this invention is to provide a bus blind spot safety warning system based on an external human-machine interface. This system can communicate the pedestrian crossing situation in the blind spot to the driver and provide driving decisions. Based on the bus driver's intention to yield, it can coordinate the display and automatic change of information on the front and rear eHMI display interfaces of the bus. This solves the problem of traffic accidents caused by the driver's blind spot and the ambiguity of pedestrians' intentions when crossing the street, thereby improving pedestrian crossing safety and road traffic efficiency.

[0006] To achieve the above objectives, the present invention adopts the following technical solution: This utility model provides a bus blind spot safety warning system based on an external human-machine interface, including a sensing module for monitoring the external environment, a reaction module for the driver to obtain information and make decisions, and a signal transmission and processing module. The output end of the sensing module is connected to the input end of the reaction module, the output end of the reaction module is connected to the input end of the signal transmission and processing module, the output end of the signal transmission and processing module is connected to a signal conversion module, and the output end of the signal conversion module is connected to the input end of an output control module.

[0007] Furthermore, the perception module includes a camera and a lidar. The camera and lidar are preferably positioned at the top center of the windshield of the vehicle, but can also be positioned at other locations that meet design requirements. The camera is used to collect image information of the environment in front of the bus, and the lidar is used to acquire data such as the three-dimensional space of surrounding objects. The two transmit the collected information to the vehicle's information fusion processing unit, which is connected to the signal transmission and processing module.

[0008] Furthermore, the reaction module includes a decision button, which is located on the driving control panel in front of the driver. The decision button is connected to the input terminal of the signal transmission and processing module via a pressure sensor.

[0009] Furthermore, the signal transmission and processing module includes a central VCU, the input terminal of which is connected to the response module via a CAN bus, and the output terminal of which is connected to the signal conversion module.

[0010] Furthermore, the output control module includes a display controller, a first audio controller, and a second audio controller. The input terminals of the display controller, the first audio controller, and the second audio controller are all connected to the output terminal of the signal conversion module. The output terminal of the display controller is connected to an eHMI display interface, the output terminal of the first audio controller is connected to an in-vehicle speaker, and the output terminal of the second audio controller is connected to an external speaker.

[0011] Furthermore, the display controller includes a front display controller and a rear display controller, and the eHMI display interface includes a front eHMI display interface and a rear eHMI display interface. The front display controller is connected to the front eHMI display interface, and the rear display controller is connected to the rear eHMI display interface.

[0012] Furthermore, the external speakers include a front speaker and a rear speaker, with the front speaker installed at the front of the bus and the rear speaker installed at the rear of the bus.

[0013] Furthermore, the forward-facing eHMI display interface is installed at the center of the upper outer edge of the front windshield, and the rear-facing eHMI display interface is installed at the center of the upper outer edge of the rear windshield.

[0014] Furthermore, both the front and rear eHMI display interfaces are equipped with displays, and the displays use light-emitting diodes (LEDs) as light sources.

[0015] Furthermore, the display screen of the forward-facing eHMI display interface forms an upward-tilted angle with the reference plane of the bus's front windshield, and the display screen of the rear-facing eHMI display interface forms an upward-tilted angle with the reference plane of the rear windshield. β , among them β The optimal angle is 20° to ensure that pedestrians can clearly obtain information in different scenarios.

[0016] Furthermore, the in-vehicle speaker can be mounted on the roof above the driver's seat.

[0017] The technical solution provided by this utility model has the following beneficial effects: (1) Compared with traditional informal communication methods such as gestures and horns, this utility model selects the eHMI display interface as the interaction carrier between the bus and pedestrians and drivers. Combined with the perception module, it can judge the pedestrian's intention to cross the street and complete information interaction through voice + vision dual channels, thereby improving the efficiency of information reception.

[0018] (2) This utility model uses a perception module composed of a high-definition camera and a lidar to identify the bus in real time and accurately obtain image information of the environment in front of the bus and distinguish pedestrians and other objects. It also transmits information to the bus driver through the in-vehicle speaker to assist the driver in making efficient decisions, reduce ineffective operations, and avoid the risk of misjudgment due to blind spots in the driver's field of vision.

[0019] (3) The position design of the front and rear eHMI display interfaces takes into account the angle and the human eye's visible area. They are installed in the center of the upper edge of the front and rear windshields, respectively. The screen display surface forms an inclined angle with the reference surface of the front and rear of the bus, respectively, to adapt to the observation angle in different scenarios.

[0020] (4) This utility model has significant value in improving road traffic safety, optimizing driver decision-making efficiency, and balancing human-machine collaboration by using the execution logic of "perception-prompt-decision" and "perception-processing-release". Attached Figure Description

[0021] The accompanying drawings are incorporated in and form part of this specification, and together with the description, serve to explain the principles of this invention.

[0022] To more clearly illustrate the technical solutions in the embodiments of this utility model or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0023] Figure 1 This is a structural diagram of a bus blind spot safety warning system based on an external human-machine interface according to the present invention. Figure 2 for Figure 1 The diagram shown is a layout for the front-end interface of a bus. Figure 3 for Figure 1 The diagram shown is a layout for the interior interface of a bus. Figure 4 for Figure 1 The diagram shown is a layout for the bus rear-end interface. Figure 5 When pedestrians cross the street Figure 1 The diagram shows the overall workflow of the system. Detailed Implementation

[0024] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. The embodiments described below do not represent all embodiments consistent with this invention. Rather, they are merely examples of apparatuses consistent with some aspects of this invention as detailed in the appended claims.

[0025] To enable those skilled in the art to better understand the technical solution of this utility model, the present utility model will be further described in detail below with reference to the accompanying drawings and embodiments. Example

[0026] refer to Figure 1 This embodiment provides a bus blind spot safety warning system based on an external human-machine interface, including a sensing module, a response module, and a signal transmission and processing module. The output end of the sensing module is connected to the input end of the response module, the output end of the response module is connected to the input end of the signal transmission and processing module, the output end of the signal transmission and processing module is connected to a signal conversion module, and the output end of the signal conversion module is connected to the input end of an output control module.

[0027] Specifically, the perception module can be used to monitor the external environment, and the response module can be used by the driver to obtain information and make decisions.

[0028] Furthermore, the sensing module includes a camera and a lidar, and the information collected by the camera and lidar is transmitted to the signal transmission and processing module through the information fusion processing unit.

[0029] Specifically, refer to Figure 2 The perception module includes a camera and a lidar. Both the camera and lidar are positioned at the top center of the windshield, enabling comprehensive monitoring of the external environment in front of the vehicle. The camera monitors the movement trajectory of pedestrians in front of the bus, while the lidar constructs a three-dimensional point cloud model of the surrounding environment by emitting a laser beam and receiving reflected signals, accurately identifying pedestrians and other objects. The collected information is transmitted to the vehicle's information fusion processing unit, which performs fusion processing on the collected information using a feature layer fusion algorithm to accurately determine whether there are pedestrians in front of the bus. The determination result is then transmitted to the signal transmission and processing module.

[0030] Further, refer to Figure 3 The reaction module includes a decision button, which is located on the driving control panel in front of the driver. The decision button is connected to the input terminal of the signal transmission and processing module via a pressure sensor.

[0031] Further, refer to Figure 1 The signal transmission and processing module includes a central VCU, the input of which is connected to the response module via a CAN bus, and the output of which is connected to the signal conversion module.

[0032] Furthermore, the output control module includes a display controller, a first audio controller, and a second audio controller. The input terminals of the display controller, the first audio controller, and the second audio controller are all connected to the output terminal of the signal conversion module. The output terminal of the display controller is connected to an eHMI display interface, the output terminal of the first audio controller is connected to an in-vehicle speaker, and the output terminal of the second audio controller is connected to an external speaker.

[0033] Specifically, the data collected by the sensing module is transmitted to the central VCU via the CAN bus. The central VCU then transmits the information to the signal conversion module, which analyzes the signal and issues a signal command. The signal command is then transmitted to the first audio controller, which is connected to the in-vehicle speakers to issue a warning. The driver makes a decision based on the warning. A pressure sensor is connected to the end of the decision button. The pressure sensor converts the electrical signal and transmits it to the central VCU via the CAN bus. The central VCU then transmits the information to the signal conversion module, which analyzes the signal and issues a signal command, which is then transmitted to the output control module.

[0034] Further, refer to Figure 2 , Figure 4 The display controller includes a front display controller and a rear display controller, and the eHMI display interface includes a front eHMI display interface and a rear eHMI display interface. The front display controller is connected to the front eHMI display interface, and the rear display controller is connected to the rear eHMI display interface.

[0035] Furthermore, the external speakers include a front speaker and a rear speaker, with the front speaker installed at the front of the bus and the rear speaker installed at the rear of the bus.

[0036] Furthermore, the forward-facing eHMI display interface is installed at the center of the upper outer edge of the front windshield, and the rear-facing eHMI display interface is installed at the center of the upper outer edge of the rear windshield.

[0037] Furthermore, both the front and rear eHMI display interfaces are equipped with displays, and the displays use light-emitting diodes (LEDs) as light sources.

[0038] Considering the clarity of the display screen under different lighting conditions and the height of pedestrians, the front-facing eHMI display screen and the reference plane of the bus's front windshield, as well as the rear-facing eHMI display screen and the rear windshield, all form an upward tilt angle. β , among them β The optimal angle is 20° to ensure that pedestrians can clearly obtain information in different scenarios.

[0039] The in-vehicle speakers can be installed on the roof above the driver's seat.

[0040] refer to Figure 5 In the above embodiments, the working process is as follows: Step 1, Environmental Perception: During the bus's operation, high-definition cameras use image recognition technology to detect pedestrian outlines, postures, and movement trajectories. LiDAR scans the environment ahead by emitting laser point clouds to accurately obtain the three-dimensional coordinates of objects. Point cloud detection can then directly distinguish pedestrians from other objects. The information collected by both is transmitted to the vehicle's information fusion processing unit. The feature layer fusion algorithm fuses the image and radar data to accurately determine the image information of the environment ahead of the bus and distinguish pedestrians from other objects. If a pedestrian is detected ahead, the detection information is transmitted sequentially through the central VCU and signal conversion module to the first audio controller. The first audio controller then controls the in-vehicle speakers to broadcast "Pedestrian ahead, please be careful" to alert the driver. If there is no pedestrian, the speakers will not respond.

[0041] Step 2, Driver Decision: After hearing the speaker's prompt, the driver can make a decision based on their driving intentions by pressing the decision button on the driving control panel. When the driver decides to give way, pressing the green button will activate the eHMI and speaker to execute the give way mode. If the driver decides not to give way, pressing the red button will activate the eHMI and speaker to execute the non-give way mode.

[0042] Step 3: Information Transmission on Display Screens: After receiving the electrical signal from the decision button via the CAN bus, the central VCU transmits the information command to the signal conversion module. The signal conversion module quickly analyzes the signal and generates the corresponding display information command, which is then transmitted simultaneously to the display controllers at the front and rear of the bus via the internal communication bus. After receiving the command, the front and rear display controllers drive their respective eHMI display interfaces to synchronously display the information. Both the front and rear eHMI displays use light-emitting diodes (LEDs) as the light source. In yielding mode, the front display screen displays "Vehicles yield, please proceed" in blue-green light, while the rear display screen synchronously displays "Pedestrians proceed, please give way" in red light. In non-yielding mode, the front display screen displays "Vehicles proceed, please do not proceed" in red light, while the rear display screen remains blank.

[0043] Step 4, Voice Prompt Assistance: While the signal conversion module transmits information commands to the display controller, it also transmits information commands to the audio controller. The audio controller drives the front and rear speakers outside the vehicle to play preset voice prompts according to the information commands.

[0044] Step 5, Interface Display Changes: For yielding mode, the vehicle speed is read directly via the CAN bus. When the speed is 0, the front and rear eHMI displays continuously display a prompt. When the speed is not 0, it indicates that the pedestrian has crossed the street and the vehicle has started moving. After receiving the signal that the vehicle has started moving, the display controller automatically turns off the front and rear prompts. For non-yielding mode, the display time is preset to automatically turn off the display at a set time.

[0045] The above description is merely a specific embodiment of this utility model, enabling those skilled in the art to understand or implement it. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this utility model.

[0046] It should be understood that this utility model is not limited to the content already described above, and various modifications and changes can be made without departing from its scope. The scope of this utility model is limited only by the appended claims.

Claims

1. A bus blind spot safety warning system based on an external human-machine interface, characterized in that, It includes a sensing module, a response module, and a signal transmission and processing module. The output of the sensing module is connected to the input of the response module, the output of the response module is connected to the input of the signal transmission and processing module, the output of the signal transmission and processing module is connected to a signal conversion module, and the output of the signal conversion module is connected to the input of an output control module. The output control module includes a display controller, a first audio controller, and a second audio controller. The input terminals of the display controller, the first audio controller, and the second audio controller are all connected to the output terminal of the signal conversion module. The output terminal of the display controller is connected to an eHMI display interface. The output terminal of the first audio controller is connected to an in-vehicle speaker, and the output terminal of the second audio controller is connected to an external speaker.

2. The bus blind spot safety early warning system based on an external human-machine interface according to claim 1, characterized in that, The sensing module includes a camera and a lidar. The information collected by the camera and lidar is transmitted to the signal transmission and processing module through the information fusion processing unit.

3. The bus blind spot safety early warning system based on an external human-machine interface according to claim 1, characterized in that, The reaction module includes a decision button, which is located on the driving control panel in front of the driver. The decision button is connected to the input terminal of the signal transmission and processing module via a pressure sensor.

4. The bus blind spot safety early warning system based on an external human-machine interface according to claim 1, characterized in that, The signal transmission and processing module includes a central VCU, the input of which is connected to the response module via a CAN bus, and the output of which is connected to the signal conversion module.

5. A bus blind spot safety early warning system based on an external human-machine interface according to claim 1, characterized in that, The display controller includes a front display controller and a rear display controller, and the eHMI display interface includes a front eHMI display interface and a rear eHMI display interface. The front display controller is connected to the front eHMI display interface, and the rear display controller is connected to the rear eHMI display interface.

6. A bus blind spot safety early warning system based on an external human-machine interface according to claim 5, characterized in that, The forward-facing eHMI display interface is installed at the center of the upper outer edge of the front windshield, and the rear-facing eHMI display interface is installed at the center of the upper outer edge of the rear windshield.

7. A bus blind spot safety early warning system based on an external human-machine interface according to claim 5, characterized in that, Both the front and rear eHMI display interfaces are equipped with displays, and the displays use light-emitting diodes as the light source.

8. A bus blind spot safety early warning system based on an external human-machine interface according to claim 1, characterized in that, The external speakers include front speakers and rear speakers. The front speakers are installed at the front of the bus, and the rear speakers are installed at the rear of the bus.

Images