High-limit guard frame collision alarm system

By setting up over-height and collision monitoring modules at monitoring points, and combining laser detection and video processing technologies, real-time monitoring and alarms for over-height vehicles and collision events are achieved. This solves the problem that existing technologies cannot effectively warn of over-height vehicle collisions and improves the driving safety of railway bridges and culverts.

CN118155453BActive Publication Date: 2025-12-16KUNMING NAIWEI JINEJI CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202410205575.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-02-26
Publication Date
2025-12-16
Estimated Expiration
2044-02-26

AI Technical Summary

Technical Problem

Existing technologies are unable to effectively monitor and provide early warnings of collisions between oversized vehicles and the height restriction protection frames of railway bridges and culverts, leading to frequent accidents and insufficient driving safety.

Method used

By setting up over-height monitoring modules, collision monitoring modules, area determination modules, video acquisition modules, and on-site alarm modules at monitoring points, real-time monitoring and alarms for vehicle over-height and collision events can be achieved. This includes acquiring vehicle height, tilt angle, and vibration intensity using laser beam detection, video information processing, and license plate recognition.

Benefits of technology

It enables timely warnings for oversized vehicles and collision events, reducing the probability of railway bridge and culvert accidents and improving driving safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118155453B_ABST
    Figure CN118155453B_ABST
Patent Text Reader

Abstract

The application provides a height-limiting guard frame collision alarm system, comprising: an overheight monitoring module arranged at each monitoring point and used for monitoring a vehicle overheight event and obtaining vehicle overheight event monitoring information; a collision monitoring module arranged at each monitoring point and used for monitoring a vehicle collision event and obtaining vehicle collision event monitoring information; a region determining module used for determining a target alarm region based on the vehicle overheight event monitoring information or the vehicle collision event monitoring information; a video collecting module used for collecting region video information of the target alarm region; an information processing module used for information processing on the region video information; and a site alarm module used for site alarm in the target alarm region based on an information processing result. The height-limiting guard frame collision alarm system realizes the technical effect of reducing the probability of railway bridge and culvert accidents, avoiding vehicle collision with the height-limiting guard frame, and improving driving safety.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of traffic safety alarm technology, and in particular to a collision alarm system for height restriction guardrails. Background Technology

[0002] In recent years, with the increasing development of transportation, accidents involving vehicles colliding with height restriction guardrails at the entrances of railway bridges and culverts, resulting in casualties and property damage, have become increasingly common.

[0003] Therefore, a method is needed to effectively monitor collisions between vehicles and the height-restricted protective frames of railway bridges and culverts to ensure driving safety.

[0004] In the prior art, application number 202120164901.X discloses a wireless alarm system for collisions with height restriction barriers, comprising: a collision detection device for detecting whether a collision has occurred with the height restriction barrier; the collision detection device is mounted on the height restriction barrier; an attitude detection device for detecting the attitude of the height restriction barrier; the attitude detection device is mounted on the height restriction barrier; a camera device for capturing images of a preset area around the height restriction barrier; the camera device is mounted on the height restriction barrier; a control device for controlling each device; the control device is connected to the collision detection device, the attitude detection device, and the camera device; a central platform for acquiring information sent by the control device; the central platform is connected to the control device; and a display device for displaying information acquired by the central platform; the display device is connected to the central platform. While this technical solution achieves collision warning for height restriction protection, it does not monitor vehicles exceeding the height limit.

[0005] Therefore, how to monitor oversized vehicles on railway bridges and culverts, and how to monitor collisions between vehicles and height restriction frames on railway bridges and culverts, so as to accurately and promptly issue on-site alarms based on the monitoring results, reduce the probability of railway bridge and culvert accidents, avoid collisions between vehicles and height restriction frames, and thus improve driving safety, is one of the urgent problems to be solved in the field of traffic safety alarm technology. Summary of the Invention

[0006] The present invention aims to at least partially solve the technical problems in the aforementioned technologies. Therefore, the objective of the present invention is to provide a collision alarm system for height restriction guardrails. This system uses pre-set monitoring equipment to monitor over-height vehicles and collision events, and issues alarms based on the detection results. This achieves the technical effect of reducing the probability of railway bridge and culvert accidents, preventing vehicles from colliding with height restriction guardrails, and thus improving driving safety.

[0007] This invention provides a collision alarm system for height-limiting protective frames, comprising:

[0008] The over-height monitoring module is set up at various monitoring points to monitor vehicle over-height events and obtain vehicle over-height event monitoring information;

[0009] The collision monitoring module is set up at various monitoring points to monitor vehicle collision events and obtain vehicle collision event monitoring information;

[0010] The area determination module is used to determine the target alarm area based on vehicle height exceeding event monitoring information or vehicle collision event monitoring information.

[0011] The video acquisition module is used to acquire regional video information of the target alarm area;

[0012] The information processing module is used to process regional video information.

[0013] The on-site alarm module is used to trigger an on-site alarm in the target alarm area based on the information processing results.

[0014] Preferably, the height restriction protection frame collision alarm system, including an over-height monitoring module, comprises:

[0015] The first distance determination submodule is used for:

[0016] Vehicle detection is performed based on the laser beam emitted by the first monitoring device set up at the monitoring point;

[0017] When a vehicle is detected, the laser beam returns to the first monitoring device, and the round-trip propagation time of the laser beam is recorded;

[0018] The one-way propagation time of a laser beam is determined based on its round-trip propagation time.

[0019] The first distance between the vehicle and the first monitoring device is determined based on the one-way propagation time and the propagation speed of the laser beam;

[0020] The second distance determination submodule is used to determine the second distance between the first monitoring device and the ground.

[0021] The vehicle height determination submodule is used to determine the vehicle height by the difference between the second distance and the first distance;

[0022] The over-height information determination submodule is used to compare the vehicle height with a preset height threshold and determine the vehicle over-height event monitoring information based on the comparison result.

[0023] Preferably, the collision alarm system for height-limiting protective frames includes a collision monitoring module, comprising:

[0024] The tilt angle acquisition submodule is used to acquire the tilt angle of the height restriction protection frame based on the second monitoring device installed on the height restriction protection frame;

[0025] The vibration intensity acquisition submodule is used to acquire the vibration intensity of the height restriction protection frame based on the third monitoring device installed on the height restriction protection frame;

[0026] The collision intensity determination submodule is used to determine the collision intensity between the vehicle and the height restriction guard based on the tilt angle and vibration intensity of the height restriction guard.

[0027] The collision information determination submodule is used to compare the collision intensity with a preset collision intensity threshold and determine the vehicle collision event monitoring information based on the comparison result.

[0028] Preferably, the collision alarm system for height-limiting protective frames includes a zone determination module, comprising:

[0029] The information determination submodule is used to determine the monitoring point serial number, monitoring point name, and monitoring equipment information based on vehicle height exceeding event monitoring information or vehicle collision event monitoring information.

[0030] The target area determination submodule is used to determine the target alarm area based on the monitoring point serial number, monitoring point name, and monitoring equipment information.

[0031] Preferably, the collision alarm system for height-limiting protective frames includes an information processing module, comprising:

[0032] The video denoising submodule is used to perform video denoising operations on the regional video information of the target alarm area to obtain denoised video information.

[0033] The vehicle identification submodule is used to identify target vehicles in the denoised video information; the target vehicles are either over-height vehicles or vehicles involved in collisions.

[0034] The license plate recognition submodule is used to identify the license plate of the target vehicle and determine the target license plate number.

[0035] Preferably, the collision alarm system for height-limiting protective frames includes a video noise reduction submodule, comprising:

[0036] The filtering submodule is used to perform Gaussian filtering on each frame of video information in the region video information to obtain the filtered video information corresponding to each frame of video information.

[0037] The pixel determination submodule is used to determine any frame of filtered video information as the video information to be processed, determine any pixel in the video information to be processed as the reference pixel, and obtain all associated pixels in the filtered video information of the remaining frames that are at the same position as the reference pixel.

[0038] The curve fitting submodule is used to obtain the original pixel values ​​of the reference pixel and all associated pixels. Based on the number of filtered video frames in which the reference pixel and all associated pixels are located, and the original pixel values ​​of the reference pixel and all associated pixels, curve fitting is performed using the least squares method to obtain the pixel value fitting curve.

[0039] The standard pixel value determination submodule is used to determine the standard pixel value of the reference pixel based on the pixel value fitting curve.

[0040] The comparison submodule is used to calculate the absolute value of the pixel difference between the standard pixel value and the original pixel value of the reference pixel, and compare the absolute value with a preset difference threshold to obtain the comparison result.

[0041] The first noise reduction submodule is used for:

[0042] When the absolute value of the comparison result is less than or equal to the preset difference threshold, the sum of the standard pixel value and the original pixel value of the reference pixel is calculated.

[0043] The average value of the standard pixel value and the original pixel value of the reference pixel is determined based on the sum value. The average value is used as the denoised pixel value of the reference pixel. The original pixel value of the reference pixel is replaced with the denoised pixel value to obtain the denoised pixel corresponding to the reference pixel.

[0044] The second noise reduction submodule is used for:

[0045] When the absolute value of the comparison result is greater than the preset difference threshold, the target region centered on the reference pixel is determined in the video information to be processed; the target region is an N×N pixel matrix.

[0046] Calculate the Euclidean distance between the remaining pixels in the target region and the reference pixel;

[0047] The weight of a pixel is determined based on the Euclidean distance between the pixel and the reference pixel, using a preset weight determination formula.

[0048] The sum of all the weights is used as the first coefficient;

[0049] Calculate the product of the pixel value of each pixel and its corresponding weight, and use the sum of all products as the second coefficient;

[0050] The ratio of the second coefficient to the first coefficient is used as the denoised pixel value of the reference pixel. The original pixel value of the reference pixel is replaced with the denoised pixel value to obtain the denoised pixel corresponding to the reference pixel.

[0051] Perform the above operations on each pixel in the video information to be processed to obtain the denoised pixel corresponding to each pixel in the video information to be processed. Perform the above operations on each frame of filtered video information to obtain the denoised pixel corresponding to each pixel in the filtered video information. All the denoised pixels constitute the denoised video information.

[0052] Preferably, the height restriction protection frame collision alarm system includes a license plate recognition submodule, comprising:

[0053] The image enhancement submodule is used to acquire the target license plate image of the target vehicle, perform image enhancement on the target license plate image, and obtain the enhanced license plate image.

[0054] The first recognition submodule is used to perform a first recognition on the enhanced license plate image using a preset license plate recognition algorithm to obtain a first license plate recognition result.

[0055] The second identification submodule is used for:

[0056] The enhanced license plate image is binarized to obtain a binarized license plate image;

[0057] The binary license plate is segmented using the vertical projection method to obtain several license plate characters;

[0058] Select any license plate character as the target license plate character, calculate the Euclidean distance between the target license plate character and the preset license plate characters in the preset license plate character template library, and take the preset license plate character corresponding to the minimum Euclidean distance as the standard license plate character corresponding to the target license plate character;

[0059] Perform the above operations on all license plate characters to obtain the standard license plate character corresponding to each license plate character;

[0060] The second license plate recognition result of the enhanced license plate image is determined based on the standard license plate character corresponding to each license plate character.

[0061] The third identification submodule is used for:

[0062] Obtain sample augmented license plate images and corresponding sample license plate recognition results, and train the model based on the sample augmented license plate images and corresponding sample license plate recognition results to obtain the license plate recognition model;

[0063] The enhanced license plate image is input into the license plate recognition model to obtain the third license plate recognition result;

[0064] The result determination submodule determines the target license plate number based on the first license plate recognition result and the preset first license plate weight, the second license plate recognition result and the preset second license plate weight, and the third license plate recognition result and the preset third license plate weight.

[0065] Preferably, the collision alarm system for height-limiting protective frames includes an on-site alarm module comprising:

[0066] The first alarm submodule is used to perform on-site audible and visual alarms using a preset audible and visual alarm.

[0067] The second alarm submodule is used for on-site light alarms.

[0068] Preferably, the collision alarm system for height-limiting protective frames includes a second alarm submodule, comprising:

[0069] The first light alarm submodule is used to trigger a first light alarm on site by illuminating a red light.

[0070] The second light alarm submodule is used to illuminate the height restriction sign with spotlights to trigger a second light alarm on site.

[0071] Preferably, the height-limiting protective frame collision alarm system also includes:

[0072] The information receiving module is used to receive on-site alarm information;

[0073] The video viewing module is used to view the area video information of the target alarm area.

[0074] This invention provides a collision alarm system for height restriction barriers, comprising: an over-height monitoring module, installed at various monitoring points, for monitoring vehicle over-height events and obtaining vehicle over-height event monitoring information; a collision monitoring module, installed at various monitoring points, for monitoring vehicle collision events and obtaining vehicle collision event monitoring information; a region determination module, for determining a target alarm region based on vehicle over-height event monitoring information or vehicle collision event monitoring information; a video acquisition module, for acquiring regional video information of the target alarm region; an information processing module, for processing the regional video information; and a field alarm module, for issuing a field alarm in the target alarm region based on the information processing results. This system achieves the technical effect of reducing the probability of railway bridge and culvert accidents, preventing vehicles from colliding with height restriction barriers, and thus improving driving safety.

[0075] Other features and advantages of the invention will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the invention. The objects and other advantages of the invention may be realized and obtained by means of the structures particularly pointed out in this application.

[0076] The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. Attached Figure Description

[0077] The accompanying drawings are provided to further illustrate the invention and form part of the specification. They are used in conjunction with embodiments of the invention to explain the invention and do not constitute a limitation thereof. In the drawings:

[0078] Figure 1 This is a block diagram of a collision alarm system for a height-limiting protective frame according to an embodiment of the present invention;

[0079] Figure 2 This is a schematic diagram of an optional height-limiting protective frame collision alarm system in an embodiment of the present invention;

[0080] Figure 3 This is a schematic diagram of an optional information processing module in an embodiment of the present invention. Detailed Implementation

[0081] The preferred embodiments of the present invention will be described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are for illustration and explanation only and are not intended to limit the present invention.

[0082] Reference Figure 1 and Figure 2 This invention provides a collision alarm system for height-limiting protective frames, comprising:

[0083] The over-height monitoring module 10 is set at each monitoring point to monitor vehicle over-height events and obtain vehicle over-height event monitoring information;

[0084] The collision monitoring module 20 is set at each monitoring point to monitor vehicle collision events and obtain vehicle collision event monitoring information;

[0085] The area determination module 30 is used to determine the target alarm area based on vehicle height exceeding event monitoring information or vehicle collision event monitoring information.

[0086] Video acquisition module 40 is used to acquire regional video information of the target alarm area;

[0087] Information processing module 50 is used for information processing of regional video information;

[0088] The on-site alarm module 60 is used to trigger an on-site alarm in the target alarm area based on the information processing results.

[0089] In this embodiment, the video acquisition module includes 2-3 cameras of two different models, such as... Figure 2 As shown, the camera is adjacent to the information processing box.

[0090] In this embodiment, such as Figure 2 As shown, the height restriction protection frame collision alarm system is installed on both sides of the highway crossing the railway.

[0091] The technical principle and effect of the above technical solution are as follows: Monitoring vehicle height exceeding limits to obtain monitoring information; monitoring vehicle collision events to obtain monitoring information; determining the target alarm area based on the vehicle height exceeding limit monitoring information or vehicle collision event monitoring information; collecting regional video information of the target alarm area; processing the regional video information; and issuing an on-site alarm in the target alarm area based on the information processing results. This achieves the technical effect of reducing the probability of railway bridge and culvert accidents, preventing vehicles from colliding with height restriction barriers, and thus improving driving safety.

[0092] Reference Figure 2 This invention provides a collision alarm system for height-limiting protective frames, including an over-height monitoring module:

[0093] The first distance determination submodule is used for:

[0094] Vehicle detection is performed based on the laser beam emitted by the first monitoring device set up at the monitoring point;

[0095] When a vehicle is detected, the laser beam returns to the first monitoring device, and the round-trip propagation time of the laser beam is recorded;

[0096] The one-way propagation time of a laser beam is determined based on its round-trip propagation time.

[0097] The first distance between the vehicle and the first monitoring device is determined based on the one-way propagation time and the propagation speed of the laser beam;

[0098] The second distance determination submodule is used to determine the second distance between the first monitoring device and the ground.

[0099] The vehicle height determination submodule is used to determine the vehicle height by the difference between the second distance and the first distance;

[0100] The over-height information determination submodule is used to compare the vehicle height with a preset height threshold and determine the vehicle over-height event monitoring information based on the comparison result.

[0101] In this embodiment, such as Figure 2 As shown, the monitoring point is located on the roadside 40-60 meters in front of the height restriction guardrail.

[0102] In this embodiment, such as Figure 2 As shown, the first monitoring device is installed on the equipment pole at the monitoring point. The first monitoring device is either a lidar or a laser beam device. It should be noted that only one lidar needs to be installed, and the effective value of the lidar ranging is determined according to the width of the road (i.e., only vehicles exceeding the height limit within the road width are monitored); while one laser beam device needs to be installed on each side, on two opposite equipment poles at the monitoring point.

[0103] In this embodiment, the first monitoring device emits a laser beam horizontally perpendicular to the road surface.

[0104] In this embodiment, half of the round-trip propagation time of the laser beam is taken as the one-way propagation time of the laser beam.

[0105] In this embodiment, the one-way propagation time of the laser beam is determined to be T, and the propagation speed of the laser beam is determined to be C. Then, the first distance between the vehicle and the first monitoring device is D1 = TC, where D1 is the first distance and C = 3 × 10⁻⁶. 8 m / s.

[0106] In this embodiment, the second distance is determined to be D2, then the vehicle height HC = D2 - D1, where HC is the vehicle height.

[0107] In this embodiment, the preset height threshold can be determined based on the height of the height-limiting protective frame. It should be noted that the preset height threshold is basically the same as the height of the height-limiting protective frame.

[0108] In this embodiment, the vehicle height and the preset height threshold can be as follows: Figure 2 The information is transmitted to the information processing box at the height restriction barrier via LoRa wireless transmission technology. It can also be transmitted wirelessly via Wi-Fi or a bridge, or via wired transmission. The information processing box compares the vehicle height with the preset height threshold to obtain the over-height event monitoring information.

[0109] In this embodiment, when the vehicle height is less than a preset height threshold, the over-height event monitoring information is that no over-height vehicle was detected; when the vehicle height is greater than or equal to the preset height threshold, the over-height event monitoring information is that an over-height vehicle was detected. When an over-height vehicle is detected, monitoring-related information such as monitoring point number, monitoring point name, monitoring equipment, monitoring content, monitoring status, and monitoring time are obtained.

[0110] The technical principle and effect of the above technical solution are as follows: Vehicle detection is performed based on a laser beam emitted by a first monitoring device installed at a monitoring point; when a vehicle is detected, the laser beam returns to the first monitoring device, and the round-trip propagation time of the laser beam is recorded; the one-way propagation time of the laser beam is determined based on the round-trip propagation time; a first distance between the vehicle and the first monitoring device is determined based on the one-way propagation time and the propagation speed of the laser beam; a second distance between the first monitoring device and the ground is determined; the difference between the second distance and the first distance is determined as the vehicle height; the vehicle height is compared with a preset height threshold, and the vehicle exceeding the height limit event monitoring information is determined based on the comparison result. This achieves the technical effect of monitoring vehicles exceeding the height limit, thereby issuing warnings based on the monitoring results, preventing collisions between vehicles exceeding the height limit and height restriction barriers, ensuring driving safety, and avoiding traffic accidents.

[0111] Refer again Figure 2 This invention provides a collision alarm system for height-limiting protective frames, including a collision monitoring module:

[0112] The tilt angle acquisition submodule is used to acquire the tilt angle of the height restriction protection frame based on the second monitoring device installed on the height restriction protection frame;

[0113] The vibration intensity acquisition submodule is used to acquire the vibration intensity of the height restriction protection frame based on the third monitoring device installed on the height restriction protection frame;

[0114] The collision intensity determination submodule is used to determine the collision intensity between the vehicle and the height restriction guard based on the tilt angle and vibration intensity of the height restriction guard.

[0115] The collision information determination submodule is used to compare the collision intensity with a preset collision intensity threshold and determine the vehicle collision event monitoring information based on the comparison result.

[0116] In this embodiment, such as Figure 2 As shown, the second monitoring device is a tilt sensor, and the quantity is 1-2 units.

[0117] In this embodiment, such as Figure 2 As shown, the third monitoring device is a vibration sensor, with a quantity of 1-2 units.

[0118] In this embodiment, the specific implementation method for determining the collision intensity between the vehicle and the height restriction guardrail based on the tilt angle and vibration intensity of the guardrail can be as follows: determine the tilt angle as θ, and determine the vibration intensity as... The collision intensity is calculated as follows: Where E is the collision intensity, w is the tilt weight, and 1-w is the vibration weight. It should be noted that w can be determined based on the design parameters of the height restriction protection frame.

[0119] In this embodiment, the preset collision intensity threshold can be set according to actual conditions. For example, multiple collision experiments can be conducted in advance, and the tilt angle and vibration intensity of each experiment can be recorded. The collision intensity corresponding to each experiment can be determined based on the tilt angle and vibration intensity of each experiment, and the preset collision intensity threshold can be determined based on the collision intensity corresponding to each experiment. For example, the average value of the collision intensity corresponding to each experiment can be used as the preset collision intensity threshold.

[0120] In this embodiment, the tilt sensor and vibration sensor are connected to the information processing box at the height restriction protection frame via a 485 twisted pair cable, thereby transmitting the tilt angle and vibration intensity to the information processing box. The information processing box processes the tilt angle and vibration intensity as described above to obtain the collision intensity, and compares the collision intensity with a preset collision intensity threshold to obtain collision event monitoring information.

[0121] In this embodiment, when the collision intensity is less than a preset collision intensity threshold, the collision event monitoring information indicates that no collision vehicle was detected; when the collision intensity is greater than or equal to the preset collision intensity threshold, the collision event monitoring information indicates that a collision vehicle was detected. When a collision vehicle is detected, monitoring-related information such as monitoring point number, monitoring point name, monitoring equipment, monitoring content, monitoring status, and monitoring time are obtained.

[0122] The technical principle and effect of the above solution are as follows: The tilt angle of the height restriction barrier is obtained using a second monitoring device mounted on it; the vibration intensity of the barrier is obtained using a third monitoring device mounted on it; the collision intensity between the vehicle and the barrier is determined based on the tilt angle and vibration intensity; the collision intensity is compared with a preset collision intensity threshold, and vehicle collision event monitoring information is determined based on the comparison result. This achieves the technical effect of monitoring colliding vehicles, providing collision warnings based on the monitoring results, reducing the traffic accident rate, and thus improving driving safety.

[0123] This invention provides a collision alarm system for height-limiting protective frames, including a zone determination module:

[0124] The information determination submodule is used to determine the monitoring point serial number, monitoring point name, and monitoring equipment information based on vehicle height exceeding event monitoring information or vehicle collision event monitoring information.

[0125] The target area determination submodule is used to determine the target alarm area based on the monitoring point serial number, monitoring point name, and monitoring equipment information.

[0126] In this embodiment, the specific implementation of determining the target alarm area based on the monitoring point serial number information, monitoring point name information, and monitoring equipment information can be as follows: determine the location of the monitoring point based on the monitoring point serial number information and monitoring point name information, take the monitoring equipment located at the monitoring point location and corresponding to the monitoring equipment information as the target monitoring equipment, and take the area that the target monitoring equipment can monitor as the target alarm area.

[0127] The technical principle and effect of the above technical solution are as follows: Based on vehicle height exceeding incident monitoring information or vehicle collision incident monitoring information, the monitoring point sequence number, monitoring point name, and monitoring equipment information are determined; based on the monitoring point sequence number, monitoring point name, and monitoring equipment information, the target alarm area is determined. This achieves the technical effect of determining the target alarm area, thereby identifying the accident vehicle (including height exceeding vehicles and collision vehicles) based on the target alarm area, and thus issuing a timely alarm, reducing the accident rate, and improving traffic safety.

[0128] Reference Figure 2 and Figure 3 This invention provides a collision alarm system for height-limiting protective frames, including an information processing module:

[0129] The video denoising submodule is used to perform video denoising operations on the regional video information of the target alarm area to obtain denoised video information.

[0130] The vehicle identification submodule is used to identify target vehicles in the denoised video information; the target vehicles are either over-height vehicles or vehicles involved in collisions.

[0131] The license plate recognition submodule is used to identify the license plate of the target vehicle and determine the target license plate number.

[0132] In this embodiment, the information processing module is for... Figure 2 Information processing box in the middle, such as Figure 3 As shown, the information processing module includes a centralized processor (the model of the centralized processor can be as follows). Figure 3 The 3399Pro shown (other models are also possible) includes an 8-port switch, 8-channel digital input / output, 8-channel RS-485 server, and a 4G router, with reserved space for LoRa and Wi-Fi devices. All these devices are encapsulated in a single enclosure, providing external network ports, RS-485 interfaces, and digital input / output interfaces to manage various peripherals (e.g., LiDAR and laser beam detectors). The central processor connects to the 8-port switch via a network cable. The 8-port switch connects to the 4G router, the 8-channel digital input / output, the 8-channel RS-485 server, Wi-Fi, and LoRa. The 4G router, Wi-Fi, and LoRa are each connected to an antenna.

[0133] In this embodiment, such as Figure 3 As shown, the camera (i.e., the camera gimbal in the figure) is connected to an 8-port switch, thereby transmitting the collected area video information to the centralized processor of the information processing module for processing.

[0134] In this embodiment, when the ultra-high altitude monitoring module uses a lidar, the lidar is connected to 8 RS-485 ports, and the data is transmitted to the central processor through an 8-port switch; when the ultra-high altitude monitoring module uses a laser beam, the laser beam is connected to 8 digital inputs and the data is transmitted to the central processor through an 8-port switch.

[0135] In this embodiment, such as Figure 3 As shown, Wifi and LoRa are connected to the antenna, and the 4G router is connected to the antenna for communication.

[0136] In this embodiment, the information processing module can be installed on the height restriction protection frame, or the equipment pole can be installed separately near the height restriction protection frame, and the information processing module can be installed separately on the equipment pole.

[0137] In this embodiment, the information processing module is powered by solar energy and a battery.

[0138] In this embodiment, such as Figure 2 As shown, for the installation of the system, both sides are currently installed in the same way, that is, the same system is installed on both sides of the highway; in the future, if the system meets the requirements, in order to reduce costs, only the information processing box equipment (i.e., information processing module) will be installed on one side, and the data from each sensor on the other side (i.e., the monitoring data of the monitoring equipment) will be sent to the signal processing box through a limited or feasible wireless means.

[0139] The technical principle and effect of the above technical solution are as follows: Denoising the video information of the target alarm area to obtain denoised video information; identifying the target vehicle from the denoised video information; wherein the target vehicle is an oversized vehicle or a vehicle involved in a collision; and performing license plate recognition on the target vehicle to determine its license plate number. This achieves the technical effect of accurately identifying the license plate number of accident vehicles (including oversized vehicles and vehicles involved in collisions), thereby providing timely and accurate alarms and reducing the probability of accidents.

[0140] This invention provides a collision alarm system for height-limiting protective frames, including a video noise reduction submodule:

[0141] The filtering submodule is used to perform Gaussian filtering on each frame of video information in the region video information to obtain the filtered video information corresponding to each frame of video information.

[0142] The pixel determination submodule is used to determine any frame of filtered video information as the video information to be processed, determine any pixel in the video information to be processed as the reference pixel, and obtain all associated pixels in the filtered video information of the remaining frames that are at the same position as the reference pixel.

[0143] The curve fitting submodule is used to obtain the original pixel values ​​of the reference pixel and all associated pixels. Based on the number of filtered video frames in which the reference pixel and all associated pixels are located, and the original pixel values ​​of the reference pixel and all associated pixels, curve fitting is performed using the least squares method to obtain the pixel value fitting curve.

[0144] The standard pixel value determination submodule is used to determine the standard pixel value of the reference pixel based on the pixel value fitting curve.

[0145] The comparison submodule is used to calculate the absolute value of the pixel difference between the standard pixel value and the original pixel value of the reference pixel, and compare the absolute value with a preset difference threshold to obtain the comparison result.

[0146] The first noise reduction submodule is used for:

[0147] When the absolute value of the comparison result is less than or equal to the preset difference threshold, the sum of the standard pixel value and the original pixel value of the reference pixel is calculated.

[0148] The average value of the standard pixel value and the original pixel value of the reference pixel is determined based on the sum value. The average value is used as the denoised pixel value of the reference pixel. The original pixel value of the reference pixel is replaced with the denoised pixel value to obtain the denoised pixel corresponding to the reference pixel.

[0149] The second noise reduction submodule is used for:

[0150] When the absolute value of the comparison result is greater than the preset difference threshold, the target region centered on the reference pixel is determined in the video information to be processed; the target region is an N×N pixel matrix.

[0151] Calculate the Euclidean distance between the remaining pixels in the target region and the reference pixel;

[0152] The weight of a pixel is determined based on the Euclidean distance between the pixel and the reference pixel, using a preset weight determination formula.

[0153] The sum of all the weights is used as the first coefficient;

[0154] Calculate the product of the pixel value of each pixel and its corresponding weight, and use the sum of all products as the second coefficient;

[0155] The ratio of the second coefficient to the first coefficient is used as the denoised pixel value of the reference pixel. The original pixel value of the reference pixel is replaced with the denoised pixel value to obtain the denoised pixel corresponding to the reference pixel.

[0156] Perform the above operations on each pixel in the video information to be processed to obtain the denoised pixel corresponding to each pixel in the video information to be processed. Perform the above operations on each frame of filtered video information to obtain the denoised pixel corresponding to each pixel in the filtered video information. All the denoised pixels constitute the denoised video information.

[0157] In this embodiment, the specific implementation of curve fitting using the least squares method based on the number of filtered video frames where the reference pixel and all associated pixels are located, and the original pixel values ​​of the reference pixel and all associated pixels, is as follows: determine a number of coordinate points with the number of filtered video frames as the abscissa and the original pixel values ​​of the pixels corresponding to the number of filtered video frames as the ordinate, and perform curve fitting using the least squares method based on the number of coordinate points.

[0158] In this embodiment, the number of filtered video frames corresponding to the reference pixel is determined, and the corresponding value of the number of filtered video frames on the curve is used as the standard pixel value in the pixel value fitting curve.

[0159] In this embodiment, the standard pixel value corresponding to the reference pixel and all associated pixels on the pixel value fitting curve is determined, the absolute value of the difference between the reference pixel and all associated pixels and the corresponding standard pixel value is calculated, all absolute values ​​are added together to obtain the absolute value sum, and the ratio of the absolute value sum to the number of reference pixels and all associated pixels is used as the preset difference threshold.

[0160] In this embodiment, the specific implementation method for calculating the Euclidean distance between the remaining pixels in the target region and the reference pixel is as follows: determine the position of any remaining pixel in the target region as (x n,y n Let the position of the reference pixel in the target region be (x, y). Then the Euclidean distance between them is... Where ED1 is the Euclidean distance, the above operation is performed on all other pixels to obtain the Euclidean distance between the remaining pixels in the target area and the reference pixel.

[0161] In this embodiment, the specific implementation method for determining the weight corresponding to a pixel based on the Euclidean distance between the pixel and the reference pixel using a preset weight determination formula is as follows: Where weight is the weight of the pixel, and ED1 is the Euclidean distance between the pixel and the reference pixel.

[0162] The technical principle and effect of the above technical solution are as follows: Gaussian filtering is applied to each frame of video information in the region video information to obtain filtered video information; any frame of filtered video information is determined as the video information to be processed, and any pixel in the video information to be processed is determined as the reference pixel; all associated pixels in the filtered video information of the remaining frames that are at the same position as the reference pixel are obtained; the original pixel values ​​of the reference pixel and all associated pixels are obtained; based on the number of filtered video frames in which the reference pixel and all associated pixels are located, and the original pixel values ​​of the reference pixel and all associated pixels, curve fitting is performed using the least squares method to obtain a pixel value fitting curve; the standard pixel value of the reference pixel is determined according to the pixel value fitting curve; the absolute value of the pixel difference between the standard pixel value and the original pixel value of the reference pixel is calculated, and the absolute value is compared with a preset difference threshold to obtain a comparison result; based on the comparison result, the denoised pixel corresponding to each pixel in the filtered video information is obtained using different denoising pixel value determination methods, and all denoised pixel points constitute the denoised video information. This technology enables the denoising of regional video information, thereby enhancing the details of the regional video information, ensuring the accuracy of subsequent license plate recognition results, and thus issuing correct alarms and reducing the accident rate.

[0163] This invention provides a collision alarm system for height restriction guardrails, including a license plate recognition submodule:

[0164] The image enhancement submodule is used to acquire the target license plate image of the target vehicle, perform image enhancement on the target license plate image, and obtain the enhanced license plate image.

[0165] The first recognition submodule is used to perform a first recognition on the enhanced license plate image using a preset license plate recognition algorithm to obtain a first license plate recognition result.

[0166] The second identification submodule is used for:

[0167] The enhanced license plate image is binarized to obtain a binarized license plate image;

[0168] The binary license plate is segmented using the vertical projection method to obtain several license plate characters;

[0169] Select any license plate character as the target license plate character, calculate the Euclidean distance between the target license plate character and the preset license plate characters in the preset license plate character template library, and take the preset license plate character corresponding to the minimum Euclidean distance as the standard license plate character corresponding to the target license plate character;

[0170] Perform the above operations on all license plate characters to obtain the standard license plate character corresponding to each license plate character;

[0171] The second license plate recognition result of the enhanced license plate image is determined based on the standard license plate character corresponding to each license plate character.

[0172] The third identification submodule is used for:

[0173] Obtain sample augmented license plate images and corresponding sample license plate recognition results, and train the model based on the sample augmented license plate images and corresponding sample license plate recognition results to obtain the license plate recognition model;

[0174] The enhanced license plate image is input into the license plate recognition model to obtain the third license plate recognition result;

[0175] The result determination submodule determines the target license plate number based on the first license plate recognition result and the preset first license plate weight, the second license plate recognition result and the preset second license plate weight, and the third license plate recognition result and the preset third license plate weight.

[0176] In this embodiment, the preset license plate recognition algorithm is a license plate recognition algorithm based on digital image processing.

[0177] In this embodiment, the specific implementation method for calculating the Euclidean distance between the target license plate character and the preset license plate character in the preset license plate character template library is as follows: determine any pixel point P in the target license plate character, determine a pixel point Q in the preset license plate character that is at the same position as P, calculate the Euclidean distance between P and Q, and use it as the Euclidean distance between the target license plate character and the preset license plate character in the preset license plate character template library.

[0178] In this embodiment, the specific implementation method for determining the second license plate recognition result of the enhanced license plate image based on the standard license plate character corresponding to each license plate character is as follows: arrange each standard license plate character in the order of the license plate characters to obtain the second license plate recognition result.

[0179] In this embodiment, the specific implementation method for determining the target license plate number based on the first license plate recognition result and the preset first license plate weight, the second license plate recognition result and the preset second license plate weight, and the third license plate recognition result and the preset third license plate weight is as follows: the license plate weights corresponding to the same license plate recognition result are added together, the magnitude of the added weights is compared, and the license plate number corresponding to the license plate recognition result with the larger weight sum is taken as the target license plate number. For example, the weight of the first license plate recognition result is determined to be 25, the weight of the second license plate recognition result is 35, and the weight of the third license plate recognition result is 40. If the first and second license plate recognition results are the same, and the third license plate recognition result is different, since the weights corresponding to the first license plate recognition result and the weights corresponding to the second license plate recognition result are added together, the weights are 60, and 60 > 40, so the license plate number corresponding to the first license plate recognition result is determined as the target license plate number.

[0180] The technical principle and effect of the above technical solution are as follows: An enhanced license plate image is obtained by enhancing the target license plate image; a first recognition is performed on the enhanced license plate image using a preset license plate recognition algorithm to obtain a first license plate recognition result; the enhanced license plate image is binarized to obtain a binarized license plate image; the binarized license plate is segmented using the vertical projection method to obtain several license plate characters; any license plate character is selected as the target license plate character, and the Euclidean distance between the target license plate character and preset license plate characters in the preset license plate character template library is calculated. The preset license plate character corresponding to the minimum Euclidean distance is taken as the standard license plate character corresponding to the target license plate character; the above operations are performed on all license plate characters to obtain the standard license plate character corresponding to each license plate character; a second license plate recognition result is determined based on the standard license plate character corresponding to each license plate character; a third license plate recognition result is obtained based on a pre-trained license plate recognition model; and the target license plate number is determined based on the first license plate recognition result and preset first license plate weights, the second license plate recognition result and preset second license plate weights, and the third license plate recognition result and preset third license plate weights. This technology achieves the effect of accurately identifying the license plate number of the target vehicle, thereby issuing correct and timely alarms and reducing the accident rate.

[0181] Refer again Figure 2 This invention provides a collision alarm system for height-limiting protective frames, including an on-site alarm module comprising:

[0182] The first alarm submodule is used to perform on-site audible and visual alarms using a preset audible and visual alarm.

[0183] The second alarm submodule is used for on-site light alarms.

[0184] In this embodiment, such as Figure 2 As shown, the audible and visual alarm is installed on the height restriction protection frame, and there is one unit.

[0185] In this embodiment, when excessive height or a collision is detected, the central processor controls the audible and visual alarm to sound an alarm within a preset time. If no excessive height or collision is detected within the preset time, the audible and visual alarm shuts off after this alarm is completed. If excessive height or a collision is detected within the preset time, the audible and visual alarm continues to sound. It should be noted that the preset time can be set and adjusted according to the actual situation on site; for example, the preset time can be 30 seconds, 40 seconds, etc.

[0186] The technical principle and effect of the above technical solution are as follows: It utilizes a preset audible and visual alarm to provide on-site audible and visual alarms; it also provides on-site lighting alarms. This achieves multiple alarm methods, thereby increasing driver alertness and ultimately reducing the accident rate.

[0187] Refer again Figure 2 This invention provides a collision alarm system for height-limiting protective frames, including a second alarm submodule comprising:

[0188] The first light alarm submodule is used to trigger a first light alarm on site by illuminating a red light.

[0189] The second light alarm submodule is used to illuminate the height restriction sign with spotlights to trigger a second light alarm on site.

[0190] In this embodiment, such as Figure 2 As shown, the red light is installed on the height restriction protection frame, and there is one unit.

[0191] In this embodiment, such as Figure 2 As shown, one spotlight is placed near the information processing box.

[0192] In this embodiment, when excessive height or a collision is detected, the central processor controls the red light and spotlights to issue an alarm for a preset time. If no excessive height or collision is detected within the preset time, the red light and spotlights turn off after completing this alarm. If excessive height or a collision is detected within the preset time, the red light and spotlights will continue to issue an alarm. It should be noted that the preset time can be set and adjusted according to the actual situation on site; for example, the preset time can be 30 seconds, 40 seconds, etc.

[0193] In this embodiment, such as Figure 2 As shown, an alarm can also be triggered based on an LED display screen installed on the height restriction protection frame. There is one LED display screen.

[0194] The technical principle and effect of the above solution are as follows: a primary on-site light alarm is triggered by illuminating a red light; a secondary on-site light alarm is triggered by illuminating a height restriction sign with a spotlight. This achieves the technical effect of increasing driver alertness, thereby reducing the accident rate and ensuring driving safety.

[0195] Refer again Figure 2 The present invention provides a collision alarm system for height-limiting protective frames, and further includes:

[0196] The information receiving module is used to receive on-site alarm information;

[0197] The video viewing module is used to view the area video information of the target alarm area.

[0198] In this embodiment, such as Figure 2 The client program shown includes an information receiving module and a video viewing module. The information processing box transmits information to the server via a 4G network, and the client program obtains on-site alarm information and area video information from the server via the Internet.

[0199] In this embodiment, the video viewing module is also used to view real-time video information of areas where there is no over-height or collision.

[0200] The technical principle of the above solution is: receiving on-site alarm information; viewing the regional video information of the target alarm area. This achieves the technical effect of timely obtaining accident information, avoiding traffic accidents, and improving driving safety.

[0201] Obviously, those skilled in the art can make various modifications and variations to this invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of the claims of this invention and their equivalents, this invention also intends to include these modifications and variations.

Claims

1. A collision alarm system for height-limiting protective frames, characterized in that, include: The over-height monitoring module is set up at various monitoring points to monitor vehicle over-height events and obtain vehicle over-height event monitoring information; A collision monitoring module, installed at various monitoring points, is used to monitor vehicle collision events and obtain vehicle collision event monitoring information. It includes: a tilt angle acquisition submodule, used to acquire the tilt angle of the height restriction barrier based on a second monitoring device installed on the barrier; a vibration intensity acquisition submodule, used to acquire the vibration intensity of the height restriction barrier based on a third monitoring device installed on the barrier; a collision intensity determination submodule, used to determine the collision intensity between the vehicle and the barrier based on the tilt angle and vibration intensity; and a collision information determination submodule, used to compare the collision intensity with a preset collision intensity threshold and determine vehicle collision event monitoring information based on the comparison result. The area determination module is used to determine the target alarm area based on vehicle height exceeding event monitoring information or vehicle collision event monitoring information; it includes: an information determination submodule, used to determine the monitoring point sequence number information, monitoring point name information, and monitoring equipment information based on vehicle height exceeding event monitoring information or vehicle collision event monitoring information; and a target area determination submodule, used to determine the target alarm area based on the monitoring point sequence number information, monitoring point name information, and monitoring equipment information. The video acquisition module is used to acquire regional video information of the target alarm area; The information processing module is used to process the video information of the area. The information processing module includes a video denoising submodule, a vehicle determination submodule, and a license plate recognition submodule. The license plate recognition submodule includes: an image enhancement submodule, used to acquire a target license plate image of the target vehicle and enhance the target license plate image to obtain an enhanced license plate image; a first recognition submodule, used to perform a first recognition on the enhanced license plate image using a preset license plate recognition algorithm to obtain a first license plate recognition result; a second recognition submodule, used to binarize the enhanced license plate image to obtain a binarized license plate image; segmenting the binarized license plate using a vertical projection method to obtain several license plate characters; selecting any license plate character as the target license plate character, and calculating the Euclidean algorithm between the target license plate character and preset license plate characters in a preset license plate character template library. The distance is determined by using the preset license plate character corresponding to the minimum Euclidean distance as the standard license plate character corresponding to the target license plate character. This process is repeated for all license plate characters to obtain the standard license plate character for each character. The second license plate recognition result of the enhanced license plate image is determined based on the standard license plate character corresponding to each character. A third recognition submodule acquires sample enhanced license plate images and corresponding sample license plate recognition results, trains a model based on these results, and obtains a license plate recognition model. The enhanced license plate image is then input into the license plate recognition model to obtain a third license plate recognition result. A result determination submodule determines the target license plate number based on the first license plate recognition result and preset first license plate weights, the second license plate recognition result and preset second license plate weights, and the third license plate recognition result and preset third license plate weights. The on-site alarm module is used to trigger an on-site alarm in the target alarm area based on the information processing results.

2. The collision alarm system for height-limiting protective frames as described in claim 1, characterized in that, Ultra-high altitude monitoring module, including: The first distance determination submodule is used for: Vehicle detection is performed based on the laser beam emitted by the first monitoring device set up at the monitoring point; When a vehicle is detected, the laser beam returns to the first monitoring device, and the round-trip propagation time of the laser beam is recorded; The one-way propagation time of the laser beam is determined based on the round-trip propagation time of the laser beam. The first distance between the vehicle and the first monitoring device is determined based on the one-way propagation time and the propagation speed of the laser beam; The second distance determination submodule is used to determine the second distance between the first monitoring device and the ground. The vehicle height determination submodule is used to determine the vehicle height by the difference between the second distance and the first distance; The over-height information determination submodule is used to compare the vehicle height with a preset height threshold and determine the vehicle over-height event monitoring information based on the comparison result.

3. The collision alarm system for height-limiting protective frames as described in claim 1, characterized in that, The information processing module includes: The video denoising submodule is used to perform video denoising operations on the regional video information of the target alarm area to obtain denoised video information. The vehicle identification submodule is used to identify target vehicles in the denoised video information; the target vehicles are either over-height vehicles or vehicles involved in collisions. The license plate recognition submodule is used to recognize the license plate of the target vehicle and determine the target license plate number.

4. The collision alarm system for height-limiting protective frames as described in claim 3, characterized in that, The video denoising submodule includes: The filtering submodule is used to perform Gaussian filtering on each frame of video information in the region video information to obtain the filtered video information corresponding to each frame of video information. The pixel determination submodule is used to determine any frame of filtered video information as the video information to be processed, determine any pixel in the video information to be processed as the reference pixel, and obtain all associated pixels in the filtered video information of the remaining frames that are at the same position as the reference pixel. The curve fitting submodule is used to obtain the original pixel values ​​of the reference pixel and all associated pixels. Based on the number of filtered video frames in which the reference pixel and all associated pixels are located, and the original pixel values ​​of the reference pixel and all associated pixels, curve fitting is performed using the least squares method to obtain the pixel value fitting curve. The standard pixel value determination submodule is used to determine the standard pixel value of the reference pixel based on the pixel value fitting curve. The comparison submodule is used to calculate the absolute value of the pixel difference between the standard pixel value and the original pixel value of the reference pixel, and compare the absolute value with a preset difference threshold to obtain the comparison result. The first noise reduction submodule is used for: When the comparison result is that the absolute value is less than or equal to the preset difference threshold, the sum of the standard pixel value and the original pixel value of the reference pixel is calculated. The average value of the standard pixel value and the original pixel value of the reference pixel is determined based on the sum value. The average value is used as the denoised pixel value of the reference pixel. The original pixel value of the reference pixel is replaced with the denoised pixel value to obtain the denoised pixel corresponding to the reference pixel. The second noise reduction submodule is used for: When the absolute value of the comparison result is greater than the preset difference threshold, a target region centered on the reference pixel is determined in the video information to be processed; the target region is an N×N pixel matrix. Calculate the Euclidean distance between the remaining pixels in the target region and the reference pixel; The weight of a pixel is determined based on the Euclidean distance between the pixel and the reference pixel, using a preset weight determination formula. The sum of all the weights is used as the first coefficient; Calculate the product of the pixel value of each pixel and its corresponding weight, and use the sum of all products as the second coefficient; The ratio of the second coefficient to the first coefficient is used as the denoised pixel value of the reference pixel. The original pixel value of the reference pixel is replaced with the denoised pixel value to obtain the denoised pixel corresponding to the reference pixel. Perform the above operations on each pixel in the video information to be processed to obtain the denoised pixel corresponding to each pixel in the video information to be processed. Perform the above operations on each frame of filtered video information to obtain the denoised pixel corresponding to each pixel in the filtered video information. All the denoised pixels constitute the denoised video information.

5. The collision alarm system for height-limiting protective frames as described in claim 1, characterized in that, The on-site alarm module includes: The first alarm submodule is used to perform on-site audible and visual alarms using a preset audible and visual alarm. The second alarm submodule is used for on-site light alarms.

6. The collision alarm system for height-limiting protective frames as described in claim 5, characterized in that, The second alarm submodule includes: The first light alarm submodule is used to trigger a first light alarm on site by illuminating a red light. The second light alarm submodule is used to illuminate the height restriction sign with spotlights to trigger a second light alarm on site.

7. The collision alarm system for height-limiting protective frames as described in claim 1, characterized in that, Also includes: The information receiving module is used to receive on-site alarm information; The video viewing module is used to view the area video information of the target alarm area.

Citation Information

Patent Citations

  • Wireless collision alarm system for height limiting frame

    CN214067977U

  • Height-limiting anti-collision early warning method

    CN111081066A

  • Collision monitoring method and system and storage medium

    CN114267207A