On-site dissuasion and warning system using image big data processing
By applying a on-site dissuasion warning system for image big data processing on the guide bridge, visual analysis and hull detection are carried out, the problem of lack of effective monitoring solutions in the existing technology is solved, and effective monitoring and dissuasion of the hull below the guide bridge is achieved, and safety is improved.
Patent Information
- Application Number
- CN202410466945.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-04-18
- Publication Date
- 2025-04-04
- Estimated Expiration
- 2044-04-18
AI Technical Summary
The prior art lacks an effective monitoring solution for prohibiting the passage of the hull below the guide bridge, resulting in the accident of the hull accidentally entering the guide bridge.
A field dissuasion warning system that applies image big data processing is adopted. Visual analysis and hull detection are performed through a packaged camera, geometric correction equipment, band-stop filtering equipment, direction filtering equipment and content identification devices, hull detection instructions or non-detection instructions are issued, and the return action is performed through the dissuasion warning device.
It effectively improves the safety of the guide bridge and nearby hulls, avoids the hull from accidentally entering the guide bridge, and realizes highly targeted hull monitoring and dissuasion operations.
Smart Images

Figure CN118247933B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of security monitoring, and in particular to an on-site dissuasion and warning system using image big data processing. Background Art
[0002] The approach bridge is a bridge-like structure that connects the dock and the land. When building a bridge over water, in order to allow large ships to pass smoothly under the bridge, sufficient clearance must be left under the bridge hole, so the bridge must be built higher. If the bridge is built higher, the slope between the bridge and the two banks will increase, which will seriously affect the traffic on and off the bridge deck. The approach bridge is the "transition" between the bridge and the road, gradually raising or lowering the road surface so that vehicles can smoothly go up and down the bridge deck.
[0003] In the prior art, it is forbidden for ships to pass under the approach bridge. Once a ship passes, it is easy to damage the bridge body of the approach bridge and cause safety hazards to the passing ship. However, the prior art lacks a targeted monitoring solution for prohibiting ships from passing under the approach bridge, resulting in accidents where ships mistakenly enter the approach bridge. Summary of the invention
[0004] In order to solve the technical problems in the prior art, the present invention provides an on-site dissuasion and warning system using image big data processing, which can use a targeted visual analysis mechanism to perform hull detection to determine whether there is a ship hull that has illegally entered under the approach bridge, and upon receiving a hull detection instruction, execute a dissuasion and warning action corresponding to the request for the hull to retreat on-site, and is also used to terminate the on-site execution of the dissuasion and warning action corresponding to the request for the hull to retreat upon receiving a hull non-detection instruction, thereby improving the safety of the approach bridge and nearby ships.
[0005] According to the present invention, there is provided an on-site dissuasion and warning system using image big data processing, the system comprising:
[0006] A data sensing device is arranged side by side with the packaged camera, and is used to sense surrounding audio signals and analyze the surrounding audio signals to obtain surrounding water sound signals;
[0007] A packaged camera is packaged at a position near the entrance end of the bridge approach of the dock and connected to the data sensing device, and is used to perform a camera action under the bridge approach when the amplitude of the surrounding water sound signal sensed by the data sensing device exceeds a set amplitude limit, so as to obtain and output a corresponding bottom environment image;
[0008] A geometric correction device, connected to the packaged camera, for performing geometric correction processing on the received bottom environment image to obtain and output a corresponding geometric correction image;
[0009] A band-stop filtering device, connected to the geometric correction device, for performing a band-stop filtering process on the received geometric correction image to obtain and output a corresponding band-stop filtered image;
[0010] a directional filtering device, connected to the band-stop filtering device, for performing directional filtering processing on the received band-stop filtered image to obtain and output a corresponding directional filtered image;
[0011] a content identification device connected to the directional filtering device, for detecting image blocks having the same shape as the set standard object pattern from the directional filtering image according to the set standard object pattern corresponding to the hull, performing a process of normalizing the image blocks with the size of the set standard object pattern to obtain corresponding typical image blocks, the typical image blocks having the same size as the set standard object pattern, obtaining respective pixel values corresponding to respective pixel points of the typical image blocks as respective first-category pixel values, obtaining respective pixel values corresponding to respective pixel points of the set standard object pattern as respective first-category pixel values, performing pixel-by-pixel difference processing on the typical image blocks and the set standard object pattern to obtain a difference processing picture, counting the total number of pixel points with a pixel value of 0 in the difference processing picture as a reference statistical number, issuing a hull detection instruction when the reference statistical number exceeds a limit, and issuing a hull non-detection instruction when the reference statistical value does not exceed a limit;
[0012] a dissuasion warning device connected to the content identification device, used to perform a dissuasion warning action corresponding to the request for the hull to be returned on site upon receiving a hull detection instruction, and also used to suspend the on-site execution of the dissuasion warning action corresponding to the request for the hull to be returned upon receiving a hull non-detection instruction;
[0013] Among them, according to the set standard object pattern corresponding to the hull, image blocks with the same shape as the set standard object pattern are detected from the directional filtered image, and the image blocks are normalized with the set standard object pattern to obtain corresponding typical image blocks, and the typical image blocks are consistent with the set standard object pattern in size, including: the set standard object pattern corresponding to the hull is a plurality of set standard object patterns, which respectively correspond to a plurality of different types of hulls.
[0014] It can be seen that the present invention mainly has the following significant technical effects:
[0015] Technical effect 1: according to the set standard object pattern corresponding to the hull, an image block having the same shape as the set standard object pattern is detected from the directional filter image, and the image block is normalized with the set standard object pattern to obtain a corresponding typical image block, the typical image block is consistent with the set standard object pattern in size, and each pixel value corresponding to each pixel point of the typical image block is obtained as each first-category pixel value, and each pixel value corresponding to each pixel point of the set standard object pattern is obtained as each first-category pixel value, and a pixel-by-pixel difference process is performed between the typical image block and the set standard object pattern to obtain a difference processing picture;
[0016] Technical effect 2: the total number of pixel points with a pixel value of 0 in the difference processing picture is counted as a reference statistical number, and when the reference statistical number exceeds the limit, a hull detection instruction is issued, and when the reference statistical value does not exceed the limit, a hull non-detection instruction is issued;
[0017] Technical effect three: The introduction of a dissuasion and warning device is used to execute a dissuasion and warning action corresponding to the request for the hull to return on site when a hull detection instruction is received, and to terminate the on-site execution of the dissuasion and warning action corresponding to the request for the hull to return when a hull non-detection instruction is received, thereby executing an on-site dissuasion operation of requesting the hull to return on the hull entering the entrance end of the dock approach bridge, thereby avoiding various types of hulls passing under the dock approach bridge.
[0018] The on-site dissuasion and warning system using image big data processing of the present invention is intelligent, safe and reliable. Since a targeted visual analysis mechanism can be used to detect whether there is a ship illegally entering under the approach bridge, and when a ship detection instruction is received, a dissuasion and warning action corresponding to the request for the ship to return is performed on-site, thereby improving the safety of the approach bridge and nearby ships. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] The embodiments of the present invention will be described below with reference to the accompanying drawings, wherein:
[0020] Figure 1 Schematic diagram of the internal structure of an on-site dissuasion and warning system using image big data processing according to the first embodiment of the present invention.
[0021] Figure 2 Schematic diagram of the internal structure of an on-site dissuasion and warning system using image big data processing according to a second embodiment of the present invention.
[0022] Figure 3 Schematic diagram of the internal structure of an on-site dissuasion and warning system using image big data processing according to a third embodiment of the present invention. DETAILED DESCRIPTION
[0023] The following will describe in detail an embodiment of the on-site dissuasion and warning system using image big data processing according to the present invention with reference to the accompanying drawings.
[0024] Figure 1 This is a schematic diagram of the internal structure of an on-site dissuasion and warning system using image big data processing according to a first embodiment of the present invention, the system includes:
[0025] A data sensing device is arranged side by side with the packaged camera, and is used to sense surrounding audio signals and analyze the surrounding audio signals to obtain surrounding water sound signals;
[0026] For example, the data sensing device may have a built-in audio receiving unit and a signal analyzing unit, wherein the signal analyzing unit is connected to the audio receiving unit and is used to analyze the surrounding audio signal output by the audio receiving unit to obtain the surrounding water sound signal;
[0027] A packaged camera is packaged at a position near the entrance end of the bridge approach of the dock and connected to the data sensing device, and is used to perform a camera action under the bridge approach when the amplitude of the surrounding water sound signal sensed by the data sensing device exceeds a set amplitude limit, so as to obtain and output a corresponding bottom environment image;
[0028] A geometric correction device, connected to the packaged camera, for performing geometric correction processing on the received bottom environment image to obtain and output a corresponding geometric correction image;
[0029] A band-stop filtering device, connected to the geometric correction device, for performing a band-stop filtering process on the received geometric correction image to obtain and output a corresponding band-stop filtered image;
[0030] a directional filtering device, connected to the band-stop filtering device, for performing directional filtering processing on the received band-stop filtered image to obtain and output a corresponding directional filtered image;
[0031] a content identification device connected to the directional filtering device, for detecting image blocks having the same shape as the set standard object pattern from the directional filtering image according to the set standard object pattern corresponding to the hull, performing a process of normalizing the image blocks with the size of the set standard object pattern to obtain corresponding typical image blocks, the typical image blocks having the same size as the set standard object pattern, obtaining respective pixel values corresponding to respective pixel points of the typical image blocks as respective first-category pixel values, obtaining respective pixel values corresponding to respective pixel points of the set standard object pattern as respective first-category pixel values, performing pixel-by-pixel difference processing on the typical image blocks and the set standard object pattern to obtain a difference processing picture, counting the total number of pixel points with a pixel value of 0 in the difference processing picture as a reference statistical number, issuing a hull detection instruction when the reference statistical number exceeds a limit, and issuing a hull non-detection instruction when the reference statistical value does not exceed a limit;
[0032] a dissuasion warning device connected to the content identification device, used to perform a dissuasion warning action corresponding to the request for the hull to be returned on site upon receiving a hull detection instruction, and also used to suspend the on-site execution of the dissuasion warning action corresponding to the request for the hull to be returned upon receiving a hull non-detection instruction;
[0033] Among them, according to the set standard object pattern corresponding to the hull, an image block having the same shape as the set standard object pattern is detected from the directional filter image, and the image block is normalized with the size of the set standard object pattern to obtain a corresponding typical image block, and the typical image block has the same size as the set standard object pattern, including: the set standard object pattern corresponding to the hull is a plurality of set standard object patterns, which respectively correspond to a plurality of different types of hulls;
[0034] The enclosed camera is also used to suspend the camera action under the approach bridge when the amplitude of the surrounding water acoustic signal sensed by the data sensing device does not exceed the set amplitude limit.
[0035] Figure 2 Schematic diagram of the internal structure of an on-site dissuasion and warning system using image big data processing according to a second embodiment of the present invention.
[0036] Compared to Figure 1 According to the second embodiment of the present invention, the on-site dissuasion and warning system using image big data processing may also include:
[0037] a current detection device, arranged near the geometric correction device, the band-stop filter device, the directional filter device and the content identification device and connected to the geometric correction device, the band-stop filter device, the directional filter device and the content identification device respectively;
[0038] Among them, the current detection device is arranged near the geometric correction device, the band-stop filter device, the directional filter device and the content identification device and is respectively connected to the geometric correction device, the band-stop filter device, the directional filter device and the content identification device, including: the current detection device is used to respectively realize on-site measurement of the current current of the geometric correction device, the band-stop filter device, the directional filter device and the content identification device.
[0039] Figure 3 Schematic diagram of the internal structure of an on-site dissuasion and warning system using image big data processing according to a third embodiment of the present invention.
[0040] Compared to Figure 1 According to the third embodiment of the present invention, the on-site dissuasion and warning system using image big data processing may also include:
[0041] A humidity detection device is arranged near the geometric correction device, the band-stop filter device, the directional filter device and the content identification device and is connected to the geometric correction device, the band-stop filter device, the directional filter device and the content identification device respectively;
[0042] Among them, the humidity detection device is arranged near the geometric correction device, the band-stop filter device, the directional filter device and the content identification device and is respectively connected to the geometric correction device, the band-stop filter device, the directional filter device and the content identification device, including: the humidity detection device is used to respectively realize on-site measurement of the current humidity of the geometric correction device, the band-stop filter device, the directional filter device and the content identification device.
[0043] Next, the specific structure of the on-site dissuasion and warning system using image big data processing of the present invention will be further described.
[0044] In each of the on-site dissuasion and warning systems applying image big data processing according to the embodiments of the present invention:
[0045] An FPGA device is used to perform image data processing on the output data of the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device to obtain output processing data corresponding to the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device respectively.
[0046] In each of the on-site dissuasion and warning systems applying image big data processing according to the embodiments of the present invention:
[0047] Using an FPGA device to perform image data processing on the output data of the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device to obtain the output processing data corresponding to the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device respectively includes: performing guided filtering processing on the output data of the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device to obtain the output processing data corresponding to the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device respectively.
[0048] In each of the on-site dissuasion and warning systems applying image big data processing according to the embodiments of the present invention:
[0049] Using an FPGA device to perform image data processing on the output data of the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device to obtain the output processing data corresponding to the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device respectively includes: performing box filtering processing on the output data of the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device to obtain the output processing data corresponding to the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device respectively.
[0050] In each of the on-site dissuasion and warning systems applying image big data processing according to the embodiments of the present invention:
[0051] Using an FPGA device to perform image data processing on the output data of the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device to obtain the output processing data corresponding to the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device respectively includes: performing wavelet filtering processing on the output data of the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device to obtain the output processing data corresponding to the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device respectively.
[0052] And in each of the on-site dissuasion and warning systems for applying image big data processing according to an embodiment of the present invention:
[0053] Using an FPGA device to perform image data processing on the output data of the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device to obtain the output processing data corresponding to the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device respectively includes: performing bilinear interpolation processing on the output data of the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device to obtain the output processing data corresponding to the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device respectively.
[0054] In addition, in the on-site dissuasion and warning system using image big data processing, each pixel value corresponding to each pixel point of the typical image block is obtained as each first-category pixel value, each pixel value corresponding to each pixel point of the set standard object pattern is obtained as each first-category pixel value, the typical image block and the set standard object pattern are subjected to pixel-by-pixel difference processing to obtain a difference processing picture, and the total number of pixel points with a pixel value of 0 in the difference processing picture is counted as a reference statistical number, and when the reference statistical number exceeds a limit, a hull detection instruction is issued, and when the reference statistical value does not exceed a limit, a hull non-detection instruction is issued, including: the resolutions of the typical image block, the set standard object pattern and the difference processing picture are the same.
[0055] Although the present invention has been described with reference to the structures disclosed herein, it is not limited to the details shown, and this application is intended to cover such modifications or changes as fall within the scope of the following claims.
Claims
1. An on-site dissuasion and warning system using image big data processing, characterized in that: The system comprises: A data sensing device is arranged side by side with the packaged camera, and is used to sense surrounding audio signals and analyze the surrounding audio signals to obtain surrounding water sound signals; A packaged camera is packaged at a position near the entrance end of the bridge approach of the dock and connected to the data sensing device, and is used to perform a camera action under the bridge approach when the amplitude of the surrounding water sound signal sensed by the data sensing device exceeds a set amplitude limit, so as to obtain and output a corresponding bottom environment image; A geometric correction device, connected to the packaged camera, for performing geometric correction processing on the received bottom environment image to obtain and output a corresponding geometric correction image; A band-stop filtering device, connected to the geometric correction device, for performing a band-stop filtering process on the received geometric correction image to obtain and output a corresponding band-stop filtered image; a directional filtering device, connected to the band-stop filtering device, for performing directional filtering processing on the received band-stop filtered image to obtain and output a corresponding directional filtered image; a content identification device connected to the directional filtering device, for detecting image blocks having the same shape as the set standard object pattern from the directional filtering image according to the set standard object pattern corresponding to the hull, performing a process of normalizing the image blocks with the size of the set standard object pattern to obtain corresponding typical image blocks, the typical image blocks having the same size as the set standard object pattern, obtaining respective pixel values corresponding to respective pixel points of the typical image blocks as respective first-category pixel values, obtaining respective pixel values corresponding to respective pixel points of the set standard object pattern as respective first-category pixel values, performing pixel-by-pixel difference processing on the typical image blocks and the set standard object pattern to obtain a difference processing picture, counting the total number of pixel points with a pixel value of 0 in the difference processing picture as a reference statistical number, issuing a hull detection instruction when the reference statistical number exceeds a limit, and issuing a hull non-detection instruction when the reference statistical number does not exceed a limit; a dissuasion warning device connected to the content identification device, used to perform a dissuasion warning action corresponding to the request for the hull to be returned on site upon receiving a hull detection instruction, and also used to suspend the on-site execution of the dissuasion warning action corresponding to the request for the hull to be returned upon receiving a hull non-detection instruction; Among them, according to the set standard object pattern corresponding to the hull, image blocks with the same shape as the set standard object pattern are detected from the directional filtered image, and the image blocks are normalized with the set standard object pattern to obtain corresponding typical image blocks, and the typical image blocks are consistent with the set standard object pattern in size, including: the set standard object pattern corresponding to the hull is a plurality of set standard object patterns, which respectively correspond to a plurality of different types of hulls.
2. The on-site dissuasion and warning system using image big data processing as claimed in claim 1, characterized in that: The packaged camera is also used to suspend the camera action under the approach bridge when the amplitude of the surrounding water acoustic signal sensed by the data sensing device does not exceed the set amplitude limit.
3. The on-site dissuasion and warning system using image big data processing as claimed in claim 2, characterized in that: The system further comprises: a current detection device, arranged near the geometric correction device, the band-stop filter device, the directional filter device and the content identification device and connected to the geometric correction device, the band-stop filter device, the directional filter device and the content identification device respectively; Among them, the current detection device is arranged near the geometric correction device, the band-stop filter device, the directional filter device and the content identification device and is respectively connected to the geometric correction device, the band-stop filter device, the directional filter device and the content identification device, including: the current detection device is used to respectively realize on-site measurement of the current current of the geometric correction device, the band-stop filter device, the directional filter device and the content identification device.
4. The on-site dissuasion and warning system using image big data processing as claimed in claim 2, characterized in that: The system further comprises: A humidity detection device is arranged near the geometric correction device, the band-stop filter device, the directional filter device and the content identification device and is connected to the geometric correction device, the band-stop filter device, the directional filter device and the content identification device respectively; Among them, the humidity detection device is arranged near the geometric correction device, the band-stop filter device, the directional filter device and the content identification device and is respectively connected to the geometric correction device, the band-stop filter device, the directional filter device and the content identification device, including: the humidity detection device is used to respectively realize on-site measurement of the current humidity of the geometric correction device, the band-stop filter device, the directional filter device and the content identification device.
5. The on-site dissuasion and warning system using image big data processing as claimed in any one of claims 2 to 4, characterized in that: An FPGA device is used to perform image data processing on the output data of the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device to obtain output processing data corresponding to the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device respectively.
6. The on-site dissuasion and warning system using image big data processing as claimed in claim 5, characterized in that: Using an FPGA device to perform image data processing on the output data of the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device to obtain the output processing data corresponding to the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device respectively includes: performing guided filtering processing on the output data of the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device to obtain the output processing data corresponding to the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device respectively.
7. The on-site dissuasion and warning system using image big data processing as claimed in claim 5, characterized in that: Using an FPGA device to perform image data processing on the output data of the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device to obtain the output processing data corresponding to the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device respectively includes: performing box filtering processing on the output data of the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device to obtain the output processing data corresponding to the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device respectively.
8. The on-site dissuasion and warning system using image big data processing as claimed in claim 5, characterized in that: Using an FPGA device to perform image data processing on the output data of the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device to obtain the output processing data corresponding to the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device respectively includes: performing wavelet filtering processing on the output data of the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device to obtain the output processing data corresponding to the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device respectively.
9. The on-site dissuasion and warning system using image big data processing as claimed in claim 5, characterized in that: Using an FPGA device to perform image data processing on the output data of the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device to obtain the output processing data corresponding to the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device respectively includes: performing bilinear interpolation processing on the output data of the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device to obtain the output processing data corresponding to the geometric correction device, the band-stop filtering device, the directional filtering device and the content identification device respectively.
Citation Information
Patent Citations
Target object detection method and device, storage medium and electronic device
CN114639076A
Vehicle dynamic tracking device and method based on ETC door frame and road side unit
CN115334094A