Blind spot monitoring equipment for dump trucks and wide-body dump trucks

Abstract

A blind spot monitoring device for dump trucks and a wide-body dump truck are disclosed. The blind spot monitoring device includes: a sensor assembly comprising multiple cameras, multiple lidar, multiple millimeter-wave radars, and at least one infrared sensor arranged around the dump truck. Each of the cameras, lidar, millimeter-wave radars, and infrared sensor is used to capture and / or monitor blind spot information around the dump truck; a controller for processing and fusing the blind spot information to obtain obstacle information, the obstacle information including obstacle features, location, and distance relative to the dump truck; and a head-up display system electrically connected to the controller, the head-up display system being used to project the obstacle information into the driver's field of vision. This invention's blind spot monitoring device can cover the visual blind spots of the dump truck, which helps improve driving safety and reduce the risk of accidents.

Description

Technical Field

[0001] This utility model relates to the field of mining truck monitoring technology, and in particular to a blind spot monitoring device for dump trucks and a wide-body dump truck. Background Technology

[0002] Due to their unique wide-body design, mining wide-body dump trucks have significant blind spots, posing a major safety hazard to drivers. During busy mining operations, workers, small equipment, and other vehicles are often located in these blind spots. If the driver misjudges or is negligent, it could lead to serious safety accidents, affecting personnel safety and production efficiency.

[0003] To address these issues, the current solution is to install a visual monitoring system on wide-body dump trucks. However, existing monitoring systems have several problems, such as being significantly affected by ambient light and weather, being unable to provide distance information, having high technical costs, limited accuracy in detecting small obstacles, having a limited detection range, and being susceptible to environmental noise interference. Utility Model Content

[0004] In view of this, the present invention provides a blind spot monitoring device for dump trucks, which can cover the visual blind spots of dump trucks, thereby improving driving safety and reducing the risk of accidents.

[0005] A blind spot monitoring device for dump trucks includes: a sensor assembly comprising multiple cameras, multiple lidar, multiple millimeter-wave radars, and at least one infrared sensor arranged around the dump truck, wherein each of the cameras, lidar, millimeter-wave radars, and infrared sensor is used to capture and / or monitor blind spot information around the dump truck; a controller for processing and fusing the blind spot information to obtain obstacle information, wherein the obstacle information includes obstacle features, location, and distance relative to the dump truck; and a head-up display system electrically connected to the controller, wherein the head-up display system is used to project the obstacle information into the driver's field of vision.

[0006] Optionally, the plurality of said cameras include:

[0007] At least one front camera is located in the middle of the front bumper of the dump truck;

[0008] At least one left-side camera is mounted on the left-side rearview mirror bracket of the dump truck;

[0009] At least one right-side camera is mounted on the right-side rearview mirror bracket of the dump truck;

[0010] At least one rear camera is located in the middle of the rear bumper of the dump truck;

[0011] Each of the cameras is used to capture visual information and identify colors, textures, and shapes.

[0012] Optionally, the plurality of said lidars include:

[0013] At least one left-side lidar is located on the left side of the front bumper;

[0014] At least one right-side lidar is located on the right side of the front bumper;

[0015] Each of the aforementioned lidars is used to detect the distance and speed of obstacles.

[0016] Optionally, the plurality of said millimeter-wave radars include:

[0017] At least one left-side millimeter-wave radar is located on the left side of the front bumper;

[0018] At least one right-side millimeter-wave radar is located on the right side of the front bumper;

[0019] At least one rear millimeter-wave radar is located in the middle of the rear bumper;

[0020] Each of the millimeter-wave radars is used for short-range obstacle detection.

[0021] Optionally, the infrared sensor is located in the middle of the front bumper, and the infrared sensor is used to identify obstacles in low-light environments.

[0022] Optionally, the dump truck blind spot monitoring device further includes at least one audible and visual alarm, which is electrically connected to the controller; the audible and visual alarm will sound an alarm when the obstacle information is greater than or equal to a threshold.

[0023] Optionally, the blind spot monitoring device for the dump truck includes two audible and visual alarms, which are respectively installed on the left and right sides of the cab of the dump truck.

[0024] Optionally, the dump truck blind spot monitoring device includes at least one of the following:

[0025] The controller is also electrically connected to the on-board system of the dump truck. The controller performs a risk assessment based on the obstacle information and the status of the dump truck, and outputs a warning signal and / or an auxiliary decision-making signal based on the assessment result.

[0026] The warning signal includes at least one of the following: audible alarm, light warning, and steering wheel vibration;

[0027] The decision support includes at least one of the following: deceleration suggestion, steering suggestion, parking suggestion, and emergency braking;

[0028] The onboard display screen of the dump truck is also used to display a three-dimensional model or bird's-eye view of the obstacle information.

[0029] Optionally, a protective cover is provided on the outer surface of each of the cameras, lidar, millimeter-wave radar and infrared sensor.

[0030] This application also relates to a wide-body dump truck, including the aforementioned dump truck blind spot monitoring device.

[0031] This utility model discloses a blind spot monitoring device for dump trucks. Installed on wide-body dump trucks, and considering the operational needs of wide-body dump trucks in harsh conditions such as mines, multiple cameras, lidar, millimeter-wave radar, and infrared sensors are installed around the dump truck. This covers the truck's blind spots, preventing monitoring failures due to vehicle structure or environmental factors. Furthermore, by fusing blind spot information captured and / or monitored by cameras, lidar, millimeter-wave radar, and infrared sensors, and projecting the processed obstacle information into the driver's field of vision, it provides the driver with intuitive alerts, improving driving safety and reducing the risk of accidents. Attached Figure Description

[0032] Figure 1 This is a front view structural diagram of the blind spot monitoring device for dump trucks installed on a dump truck.

[0033] Figure 2 This is a rear-view structural diagram of the blind spot monitoring device for dump trucks installed on a dump truck.

[0034] Figure 3 This is a schematic diagram of the control strategy for the blind spot monitoring device for dump trucks in this application.

[0035] Figure 4 This is a schematic diagram of the process for integrating blind spot information in the controller of this application. Detailed Implementation

[0036] The following specific embodiments illustrate the implementation of this application. Those skilled in the art can easily understand other advantages and effects of this application from the content disclosed in this specification.

[0037] In the following description, reference is made to the accompanying drawings, which illustrate several embodiments of the present application. It should be understood that other embodiments may also be used, and changes in mechanical composition, structure, electrical and operational aspects may be made without departing from the spirit and scope of the present application. The following detailed description should not be considered limiting, and the terminology used herein is for describing particular embodiments only and is not intended to limit the present application.

[0038] Although the terms first, second, etc., are used in some instances to describe various elements herein, these elements should not be limited by these terms. These terms are only used to distinguish one element from another.

[0039] Furthermore, as used herein, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context indicates otherwise. It should be further understood that the terms “comprising,” “including,” indicate the presence of a feature, step, operation, element, component, item, kind, and / or group, but do not exclude the presence, occurrence, or addition of one or more other features, steps, operations, elements, components, items, kinds, and / or groups. The terms “or” and “and / or” as used herein are interpreted as inclusive, or mean any one or any combination thereof. Thus, “A, B, or C” or “A, B, and / or C” means “any one of: A; B; C; A and B; A and C; B and C; A, B, and C.” Exceptions to this definition arise only when combinations of elements, functions, steps, or operations are inherently mutually exclusive in some way.

[0040] Figure 1 This is a front view schematic diagram of the blind spot monitoring device for dump trucks installed on a dump truck, as per this application. Figure 2 This is a rear-view structural diagram of the blind spot monitoring device for dump trucks as described in this application, installed on the dump truck. Figure 3 This is a schematic diagram of the control strategy for the blind spot monitoring device for dump trucks in this application, as shown below. Figure 1 , Figure 2 and Figure 3 As shown, the blind spot monitoring equipment for dump trucks includes:

[0041] The sensor assembly includes multiple cameras 111, multiple lidar 112, multiple millimeter-wave radars 113, and at least one infrared sensor 114 arranged around the dump truck 20. Each camera 111, each lidar 112, each millimeter-wave radar 113, and the infrared sensor 114 is used to capture and / or monitor blind spot information around the dump truck 20.

[0042] The controller 12 is used to process and fuse blind spot information to obtain obstacle information, which includes obstacle features, location, and distance relative to the dump truck 20.

[0043] The head-up display system 13 is electrically connected to the controller 12 and is used to project obstacle information into the driver's field of vision.

[0044] The blind spot monitoring device for dump trucks in this application is installed on a wide-body dump truck 20. Considering the needs of the wide-body dump truck 20 operating in harsh conditions such as mines, multiple cameras 111, multiple lidar 112, multiple millimeter-wave radars 113, and infrared sensors 114 are installed around the dump truck 20. This covers the visual blind spots of the dump truck 20, avoiding monitoring failures caused by vehicle structure or environmental factors. Furthermore, by fusing the blind spot information captured and / or monitored by the cameras 111, lidar 112, millimeter-wave radar 113, and infrared sensors 114, and projecting the processed obstacle information into the driver's field of vision, the device provides the driver with intuitive reminders, which helps improve driving safety and reduces the risk of accidents.

[0045] Optionally, Figure 4 This is a schematic diagram of the controller fusion blind spot information process in this application, as shown below. Figure 4 As shown, the controller 12 integrates blind spot information in three levels:

[0046] First, data layer fusion, which directly fuses the raw data captured and / or monitored. This is applicable to sensors of the same type. For example, blind zone video information captured by multiple cameras 111 can be fused together, blind zone information monitored by multiple lidars 112 can be fused together, and blind zone information monitored by multiple millimeter-wave radars 113 can be fused together.

[0047] Second, feature layer fusion, which involves extracting features from sensor data and then fusing them, such as edge and distance information.

[0048] Third, decision-making integration: after each sensor processes data independently, the data is combined through voting or weighting methods.

[0049] The controller 12 of this application integrates blind spot information, unifies environmental perception information, and projects the information onto the windshield display or the vehicle display screen.

[0050] The controller 12 of this application is based on deep learning for obstacle recognition: it uses a deep learning algorithm (YOLO) to process multi-sensor data and identify information such as obstacle features, location, and distance relative to the dump truck 20 within the blind spot. Specific steps include:

[0051] Data preprocessing: Normalizing, denoising, and labeling sensor data;

[0052] Feature extraction: Extracting features of obstacles (such as shape, size, and motion state) through neural networks;

[0053] Classification and localization: Identify obstacle types (such as pedestrians and vehicles) and determine their location and distance.

[0054] The blind spot monitoring device for dump trucks in this application is based on enhanced display blind spot visualization: it overlays identified obstacle information onto the driver's field of vision, improving driving experience and safety. The implementation methods include:

[0055] Windshield Display (HUD): The head-up display system 13 projects virtual images onto the windshield to display the position and distance of obstacles; specifically, the controller 12 uses sensors and SLAM (Simultaneous Localization and Mapping) technology to determine the positional relationship between obstacles and the vehicle, thereby achieving spatial positioning.

[0056] In-vehicle display screen: Displays 3D models or bird's-eye views on the screen to intuitively show the blind spot environment; specifically, the controller 12 generates virtual images and seamlessly integrates them with the real scene to achieve image rendering.

[0057] Optionally, the multiple cameras 111 include:

[0058] At least one front camera 111 is located in the middle of the front bumper 21 of the dump truck 20;

[0059] At least one left-side camera 111 is mounted on the left-side rearview mirror bracket 23 of the dump truck 20;

[0060] At least one right-side camera 111 is mounted on the right-side rearview mirror bracket 23 of the dump truck 20;

[0061] At least one rear camera 111 is located in the middle of the rear bumper 22 of the dump truck 20;

[0062] Each camera 111 is used to capture visual information and identify color, texture, and shape. This application arranges millimeter-wave radar 113 and a certain number of cameras 111 in a reasonable manner in front of, behind, and on the left and right sides of the dump truck 20 to achieve 360° all-round coverage around the dump truck 20, accurately detect and identify surrounding stationary or moving obstacles, such as mining trucks, engineering vehicles, pedestrians, etc.

[0063] Optionally, such as Figure 1 As shown, the multiple lidar units 112 include:

[0064] At least one left-side lidar 112 is located on the left side of the front bumper 21;

[0065] At least one right-side lidar 112 is located on the right side of the front bumper 21;

[0066] Each lidar 112 is used to detect the distance and speed of obstacles and is suitable for use in adverse weather conditions.

[0067] Optionally, such as Figure 1 and Figure 2As shown, the multiple millimeter-wave radars 113 include:

[0068] At least one left-side millimeter-wave radar 113 is located on the left side of the front bumper 21;

[0069] At least one right-side millimeter-wave radar 113 is located on the right side of the front bumper 21;

[0070] At least one rear millimeter-wave radar 113 is located in the middle of the rear bumper 22;

[0071] Each millimeter-wave radar 113 is used for short-range obstacle detection and is suitable for low-speed scenarios, such as parking.

[0072] Optionally, such as Figure 1 As shown, the infrared sensor 114 is located in the middle of the front bumper 21. The infrared sensor 114 is used to identify obstacles in low-light environments.

[0073] Multiple cameras 111 in this application provide visual information, while millimeter-wave radar 113, lidar 112, and infrared sensor 114 are used for obstacle recognition, classification, and supplementary perception of the surrounding environment.

[0074] This application rationally arranges multiple cameras 111, multiple lidar 112, multiple millimeter-wave radars 113, and infrared sensors 114 on the wide-body dump truck 20 according to its physical structure and working characteristics, ensuring that each sensor can cover the blind spot of a specific area of ​​the wide-body dump truck 20, and avoiding monitoring failure caused by vehicle structure or environmental factors.

[0075] Optionally, the blind spot monitoring device for dump trucks also includes at least one audible and visual alarm 14, which is electrically connected to the controller 12; the audible and visual alarm 14 will sound an alarm when the obstacle information is greater than or equal to a threshold.

[0076] Optionally, the blind spot monitoring equipment for dump trucks includes two audible and visual alarms 14, which are installed on the left and right sides of the cab of the dump truck 20, respectively.

[0077] Optionally, the controller 12 is also electrically connected to the on-board system of the dump truck 20. The controller 12 performs risk assessment based on obstacle information and the status of the dump truck 20, and outputs warning signals and / or auxiliary decision-making signals based on the assessment results.

[0078] Warning signals include at least one of the following: audible alarm, light warning, or steering wheel vibration, used to alert the driver;

[0079] The decision support includes at least one of the following: deceleration suggestion, steering suggestion, stopping suggestion, and emergency braking. In an emergency, the dump truck 20 can automatically perform some of these operations, such as steering or emergency braking. In this embodiment, the risk assessment is typically based on the following factors:

[0080] First, Time of Collision (TTC): Calculates the time of collision between the vehicle and the obstacle.

[0081] Second, safe distance: Determine the safe distance based on vehicle speed and road conditions.

[0082] It is worth mentioning that the data collected in this application is calculated by the embedded model of the controller 12. When an obstacle exceeds the set threshold (obstacle information is greater than or equal to the threshold) within the monitoring range of the dump truck 20, a warning is triggered and displayed on the vehicle display screen and head-up display system 13 (AR-HUD). At the same time, the driver's cab and external voice warning prompts to pay attention to safe driving or actively connect to the safety system to trigger deceleration.

[0083] Optionally, a protective cover is provided on the outer surface of each camera 111, each lidar 112, each millimeter-wave radar 113, and each infrared sensor 114. In this embodiment, each camera 111, each lidar 112, each millimeter-wave radar 113, and each infrared sensor 114 is hidden or embedded in the protective cover, and a redundant wiring scheme is adopted to avoid the impact of a single point of failure on the entire system, thereby reducing the impact of rain, snow, dust, mud, and mechanical impact in the mining environment on each sensor.

[0084] The lidar 112, millimeter-wave radar 113, and infrared sensor 114 of this application are used for obstacle recognition and tracking, while the camera 111 is used to capture high-definition images of the vehicle's surroundings. The controller 12 fuses the sensor data to improve the accuracy of environmental perception. The controller 12 is also used to perform fusion analysis and processing of radar and camera 111 data and to provide hazard warnings through the vehicle-mounted display screen, AR-HUD head-up display system 13, and audible and visual alarm 14.

[0085] like Figure 3 As shown, the blind spot monitoring device for dump trucks in this application dynamically monitors the blind spots of the dump truck 20. Specifically, the camera 111, lidar 112, millimeter-wave radar 113, and infrared sensor 114 acquire blind spot information. The signal data from the sensor components are sent to the controller 12 (electronic control unit) for analysis and processing. The controller 12's internal control algorithm calculates the target in the monitoring area, analyzes it, and displays it on the screen. When the analysis result exceeds the internally set threshold, an alarm signal is displayed and an audible and visual alarm is triggered, prompting the driver to pay attention to safe driving.

[0086] Optionally, such as Figure 1 and Figure 2 As shown, this application also relates to a wide-body dump truck 20, including the aforementioned dump truck blind spot monitoring device.

[0087] The preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings. However, the present invention is not limited to the specific details of the above embodiments. Within the scope of the technical concept of the present invention, various simple modifications can be made to the technical solution of the present invention, and these simple modifications all fall within the protection scope of the present invention. (The above specific embodiments are not included in the provided text.)

[0088] The specific technical features described herein, without contradiction, can be expressed by any

[0089] A suitable combination method is used. To avoid unnecessary repetition, this utility model addresses various...

[0090] Possible combinations will not be described separately.

Claims

1. A blind spot monitoring device for dump trucks, characterized in that, include: The sensor assembly includes multiple cameras, multiple lidar, multiple millimeter-wave radars, and at least one infrared sensor arranged around the dump truck. Each of the cameras, lidar, millimeter-wave radars, and infrared sensor is used to capture and / or monitor blind spot information around the dump truck. A controller is used to process and fuse the blind spot information to obtain obstacle information, the obstacle information including... Obstacle characteristics, location, and distance relative to the dump truck; A head-up display system, electrically connected to the controller, is used to project obstacle information into the driver's field of vision.

2. The blind spot monitoring device for dump trucks as described in claim 1, characterized in that, The plurality of cameras include: At least one front camera is located in the middle of the front bumper of the dump truck; At least one left-side camera is mounted on the left-side rearview mirror bracket of the dump truck; At least one right-side camera is mounted on the right-side rearview mirror bracket of the dump truck; At least one rear camera is located in the middle of the rear bumper of the dump truck; Each of the cameras is used to capture visual information and identify colors, textures, and shapes.

3. The blind spot monitoring device for dump trucks as described in claim 2, characterized in that, The plurality of said lidars include: At least one left-side lidar is located on the left side of the front bumper; At least one right-side lidar is located on the right side of the front bumper; Each of the aforementioned lidars is used to detect the distance and speed of obstacles.

4. The blind spot monitoring device for dump trucks as described in claim 3, characterized in that, The plurality of millimeter-wave radars include: At least one left-side millimeter-wave radar is located on the left side of the front bumper; At least one right-side millimeter-wave radar is located on the right side of the front bumper; At least one rear millimeter-wave radar is located in the middle of the rear bumper; Each of the millimeter-wave radars is used for short-range obstacle detection.

5. The blind spot monitoring device for dump trucks as described in claim 4, characterized in that, The infrared sensor is located in the middle of the front bumper and is used to identify obstacles in low-light environments.

6. The dump truck blind spot monitoring device as described in any one of claims 1 to 5, characterized in that, The blind spot monitoring device for dump trucks also includes at least one audible and visual alarm, which is electrically connected to the controller; the audible and visual alarm will sound an alarm when the obstacle information is greater than or equal to a threshold.

7. The blind spot monitoring device for dump trucks as described in claim 6, characterized in that, The blind spot monitoring equipment for the dump truck includes two audible and visual alarms, which are respectively installed on the left and right sides of the cab of the dump truck.

8. The dump truck blind spot monitoring device as described in any one of claims 1 to 5, characterized in that, Includes at least one of the following: The controller is also electrically connected to the on-board system of the dump truck. The controller performs a risk assessment based on the obstacle information and the status of the dump truck, and outputs a warning signal and / or an auxiliary decision-making signal based on the assessment result. The warning signal includes at least one of the following: audible alarm, light warning, and steering wheel vibration; The decision support includes at least one of the following: deceleration suggestion, steering suggestion, parking suggestion, and emergency braking; The onboard display screen of the dump truck is also used to display a three-dimensional model or bird's-eye view of the obstacle information.

9. The dump truck blind spot monitoring device as described in any one of claims 1 to 5, characterized in that, Each of the aforementioned cameras, lidar, millimeter-wave radars, and infrared sensors has a protective cover on its outer surface.

10. A wide-body dump truck, characterized in that, Includes the blind spot monitoring device for dump trucks as described in any one of claims 1 to 9.

Images