Smart city traffic management system
By analyzing the matching degree between the image and the reference contour pattern of the zebra line in the smart city pass management system, identifying and monitoring the existence of the zebra line, the traffic safety hazards caused by the excessive light or missing zebra line are solved, and the traffic intersection status is achieved parallel visual monitoring.
Patent Information
- Application Number
- CN202411590397.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2024-01-09
- Filing Date
- 2024-11-08
- Publication Date
- 2025-02-07
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Due to the long-term use of traffic pavements or the poor printing quality of zebra crossings, the zebra lines are too light or even missing, causing hidden dangers to safety of pedestrians and vehicles.
By using a visual collector, arithmetic mean filtering device, bilateral filtering device, artifact removal device and numerical processing unit in the smart city pass management system, it is possible to analyze whether the received image matches the pre-stored zebra line reference contour pattern and determine whether it exists Zebra lines and when missing undetected signals are transmitted to the traffic management server.
High-precision identification and monitoring of the missing zebra lines is achieved, missing scenes caused by excessive zebra lines are avoided, and traffic safety and management efficiency are improved.
Abstract
Description
Technical Field
[0001] The present invention relates to the field of smart city management, and in particular to a smart city traffic management system. Background Art
[0002] Traffic management is an important aspect of smart city management. Pedestrian crossings, also known as zebra crossings, are composed of white lines and are mainly used by pedestrians to cross the road. In various countries and regions, pedestrians must use crosswalks when crossing the road. This can ensure the safety of life and property, especially at the traffic intersection where the zebra crossing is located. During the green light time period in the direction corresponding to the zebra crossing, the right of vehicles to pass is far less than the right of pedestrians to pass.
[0003] Invention application CN117012020A discloses a smart zebra crossing pedestrian personalized warning system, the system includes a camera, a warning speaker, a main controller and a background database, wherein the camera's lens field of view covers the vehicle lane and the zebra crossing lane and is embedded with a pedestrian detection algorithm and a vehicle detection algorithm. When the main controller receives the pedestrian recognition results and vehicle recognition results from the camera in real time, it can first access the background database and query the corresponding personalized information for the pedestrians to be warned in the risk event of human-vehicle conflict, according to the corresponding human body features in the pedestrian recognition results, and then determine the applicable warning audio signal based on the personalized information, and finally transmit the warning audio signal to the warning speaker for audible warning. In this way, the personalized warning needs of pedestrians can be accurately matched, the warning effect can be improved, and traffic safety can be ensured.
[0004] However, due to the long-term use of traffic roads or the poor quality of zebra crossing printing, the zebra crossings are easily too light or even missing. At this time, pedestrians and vehicles passing through the traffic intersections corresponding to the zebra crossings lack a reference basis for passage, which poses a major hidden danger to the safety of pedestrians and vehicles. Summary of the invention
[0005] In order to solve technical problems in related fields, the present invention provides a smart city traffic management system, which can analyze whether there is a sub-image in the image after targeted optimization of the traffic intersection based on the baseline contour pattern corresponding to the zebra crossing, and if so, it is judged that there are zebra crossings in the received artifact removal image; otherwise, it is judged that there are no zebra crossings; and when it is judged that there are no zebra crossings, the zebra crossing undetected signal and the intersection code corresponding to the associated traffic intersection are packaged and wirelessly transmitted to a remote traffic management server, thereby realizing parallel visual monitoring of the status of traffic intersections at various locations.
[0006] In order to achieve the above technical effects, the system includes: A visual data collector performs visual data collection operations on traffic intersections to obtain the image of the intersection corresponding to the current moment; an arithmetic mean filtering device, connected to the visualization collector, for performing arithmetic mean filtering on the received traffic intersection image to obtain and output a corresponding arithmetic mean filtered image; A bilateral filtering device, connected to the arithmetic mean filtering device, for performing a bilateral filtering process on the received arithmetic mean filtered image to obtain and output a corresponding bilateral filtered image; an artifact removal device, connected to the bilateral filtering device, for performing an artifact removal process on the received bilateral filtered image to obtain and output a corresponding artifact removed image; An information storage unit, used for pre-storing a reference outline pattern of a zebra stripe using a set physical address storage space; a numerical processing unit connected to the information storage unit and configured to perform content matching processing on each sub-image in the received artifact-removed image and the reference contour pattern; a signal analysis unit, connected to the artifact removal device and the numerical processing unit, respectively, for issuing a zebra stripe detection signal when a certain sub-image exists in the artifact removal image and the percentage of content matching with the reference contour pattern exceeds a set percentage limit, and for issuing a zebra stripe non-detection signal when a certain sub-image does not exist in the artifact removal image and the percentage of content matching with the reference contour pattern exceeds a set percentage limit; A wireless reporting unit connected to the signal analysis unit is used to package the zebra crossing non-detection signal with the intersection code corresponding to the traffic intersection and then wirelessly transmit it to a remote traffic management server when the zebra crossing non-detection signal is received; Among them, when the zebra crossing non-detection signal is received, the zebra crossing non-detection signal and the intersection code corresponding to the traffic intersection are packaged and wirelessly transmitted to a remote traffic management server, including: the zebra crossing non-detection signal and the intersection code corresponding to the traffic intersection are packaged based on IP data packets and wirelessly transmitted to a remote traffic management server. DETAILED DESCRIPTION
[0007] The following is a detailed description of the embodiments of the smart city traffic management system of the present invention.
[0008] First embodiment
[0009] According to the first embodiment of the present invention, the smart city traffic management system includes: A visual data collector performs visual data collection operations on traffic intersections to obtain the image of the intersection corresponding to the current moment; an arithmetic mean filtering device, connected to the visualization collector, for performing arithmetic mean filtering on the received traffic intersection image to obtain and output a corresponding arithmetic mean filtered image; For example, an arithmetic mean filtering device is connected to the visualization collector and is used to perform arithmetic mean filtering on the received traffic intersection image to obtain and output a corresponding arithmetic mean filtered image, including: the arithmetic mean filtering device includes an image receiving unit, a filtering execution unit and an image output unit; A bilateral filtering device, connected to the arithmetic mean filtering device, for performing a bilateral filtering process on the received arithmetic mean filtered image to obtain and output a corresponding bilateral filtered image; an artifact removal device, connected to the bilateral filtering device, for performing an artifact removal process on the received bilateral filtered image to obtain and output a corresponding artifact removed image; An information storage unit, used for pre-storing a reference outline pattern of a zebra stripe using a set physical address storage space; a numerical processing unit connected to the information storage unit and configured to perform content matching processing on each sub-image in the received artifact-removed image and the reference contour pattern; a signal analysis unit, connected to the artifact removal device and the numerical processing unit, respectively, for issuing a zebra stripe detection signal when a certain sub-image exists in the artifact removal image and the percentage of content matching with the reference contour pattern exceeds a set percentage limit, and for issuing a zebra stripe non-detection signal when a certain sub-image does not exist in the artifact removal image and the percentage of content matching with the reference contour pattern exceeds a set percentage limit; A wireless reporting unit connected to the signal analysis unit is used to package the zebra crossing non-detection signal with the intersection code corresponding to the traffic intersection and then wirelessly transmit it to a remote traffic management server when the zebra crossing non-detection signal is received; Wherein, when the zebra stripe non-detection signal is received, the zebra stripe non-detection signal is packaged with the intersection code corresponding to the traffic intersection and then wirelessly transmitted to a remote traffic management server, including: the zebra stripe non-detection signal and the intersection code corresponding to the traffic intersection are packaged based on IP data packets and then wirelessly transmitted to a remote traffic management server; Among them, when the zebra crossing non-detection signal is received, the zebra crossing non-detection signal and the intersection code corresponding to the traffic intersection are packaged and wirelessly transmitted to a remote traffic management server, including: the zebra crossing non-detection signal and the intersection code corresponding to the traffic intersection are packaged based on IP data packets and wirelessly transmitted to a remote traffic management server.
[0010] Second embodiment
[0011] The smart city traffic management system shown in the second embodiment of the present invention may include the following components: A visual data collector performs visual data collection operations on traffic intersections to obtain the image of the intersection corresponding to the current moment; an arithmetic mean filtering device, connected to the visualization collector, for performing arithmetic mean filtering on the received traffic intersection image to obtain and output a corresponding arithmetic mean filtered image; A bilateral filtering device, connected to the arithmetic mean filtering device, for performing a bilateral filtering process on the received arithmetic mean filtered image to obtain and output a corresponding bilateral filtered image; an artifact removal device, connected to the bilateral filtering device, for performing an artifact removal process on the received bilateral filtered image to obtain and output a corresponding artifact removed image; An information storage unit, used for pre-storing a reference outline pattern of a zebra stripe using a set physical address storage space; a numerical processing unit connected to the information storage unit and configured to perform content matching processing on each sub-image in the received artifact-removed image and the reference contour pattern; a signal analysis unit, connected to the artifact removal device and the numerical processing unit, respectively, for issuing a zebra stripe detection signal when a certain sub-image exists in the artifact removal image and the percentage of content matching with the reference contour pattern exceeds a set percentage limit, and for issuing a zebra stripe non-detection signal when a certain sub-image does not exist in the artifact removal image and the percentage of content matching with the reference contour pattern exceeds a set percentage limit; A wireless reporting unit connected to the signal analysis unit is used to package the zebra crossing non-detection signal with the intersection code corresponding to the traffic intersection and then wirelessly transmit it to a remote traffic management server when the zebra crossing non-detection signal is received; a current detection device, arranged near the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit and connected to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively; Among them, the current detection device is arranged near the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit and is respectively connected to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit, including: the current detection device is used to respectively realize the on-site measurement of the current of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit.
[0012] Third embodiment
[0013] The smart city traffic management system shown in the third embodiment of the present invention may include the following components: A visual data collector performs visual data collection operations on traffic intersections to obtain the image of the intersection corresponding to the current moment; an arithmetic mean filtering device, connected to the visualization collector, for performing arithmetic mean filtering on the received traffic intersection image to obtain and output a corresponding arithmetic mean filtered image; A bilateral filtering device, connected to the arithmetic mean filtering device, for performing a bilateral filtering process on the received arithmetic mean filtered image to obtain and output a corresponding bilateral filtered image; an artifact removal device, connected to the bilateral filtering device, for performing an artifact removal process on the received bilateral filtered image to obtain and output a corresponding artifact removed image; An information storage unit, used for pre-storing a reference outline pattern of a zebra stripe using a set physical address storage space; a numerical processing unit connected to the information storage unit and configured to perform content matching processing on each sub-image in the received artifact-removed image and the reference contour pattern; a signal analysis unit, connected to the artifact removal device and the numerical processing unit, respectively, for issuing a zebra stripe detection signal when a certain sub-image exists in the artifact removal image and the percentage of content matching with the reference contour pattern exceeds a set percentage limit, and for issuing a zebra stripe non-detection signal when a certain sub-image does not exist in the artifact removal image and the percentage of content matching with the reference contour pattern exceeds a set percentage limit; A wireless reporting unit connected to the signal analysis unit is used to package the zebra crossing non-detection signal with the intersection code corresponding to the traffic intersection and then wirelessly transmit it to a remote traffic management server when the zebra crossing non-detection signal is received; a bandwidth detection device, arranged near the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit and connected to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively; Among them, the bandwidth detection device is arranged near the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit and is respectively connected to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit, including: the bandwidth detection device is used to respectively realize on-site measurement of the current bandwidth of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit.
[0014] Next, the specific structure of the smart city traffic management system of the present invention will be further described.
[0015] In a smart city traffic management system according to any embodiment of the present invention: Using a field programmable gate array to perform image data processing on the output data of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit to obtain output processing data corresponding to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively; Wherein, using a field programmable gate array to perform image data processing on the output data of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit to obtain the output processing data corresponding to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively includes: performing statistical sorting filtering on the output data of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit to obtain the output processing data corresponding to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively; Wherein, using a field programmable gate array to perform image data processing on the output data of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit to obtain the output processing data corresponding to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively includes: performing gradient sharpening filtering on the output data of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit to obtain the output processing data corresponding to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively; Among them, using a field programmable gate array to perform image data processing on the output data of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit to obtain the output processing data corresponding to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively includes: performing Butterworth low-pass filtering on the output data of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit to obtain the output processing data corresponding to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively; And wherein, a field programmable gate array is used to perform image data processing on the output data of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit to obtain the output processing data corresponding to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively, including: performing Gaussian high-pass filtering processing on the output data of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit to obtain the output processing data corresponding to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively.
[0016] In addition, in the smart city traffic management system, when the zebra crossing non-detection signal is received, the zebra crossing non-detection signal is packaged with the intersection code corresponding to the traffic intersection and wirelessly transmitted to a remote traffic management server, which also includes: the remote traffic management server is a cloud computing server, a big data server or a blockchain server.
[0017] The innovations embodied in the technical solution of the present invention are: 1. Analyzing whether there is a sub-image in the received artifact-removed image based on the reference contour pattern corresponding to the zebra stripes, and if there is a sub-image whose content matching percentage with the reference contour pattern exceeds the limit, determining whether there is a zebra stripe in the received artifact-removed image; Second: When a zebra crossing non-detection signal is received, the zebra crossing non-detection signal is packaged with the intersection code corresponding to the associated traffic intersection and wirelessly transmitted to a remote traffic management server, thereby realizing parallel visual monitoring of the status of various traffic intersections and avoiding the occurrence of zebra crossing missing scenes where the zebra crossings are too light.
[0018] The smart city traffic management system of the present invention can address the technical problem in the prior art that the missing state of zebra stripes at traffic intersections is difficult to identify with high precision. It can determine whether the zebra stripes at the scene are missing based on a targeted visual recognition mechanism, and when it is determined that the zebra stripes are missing, the zebra stripe undetected signal and the intersection code corresponding to the associated traffic intersection are packaged and wirelessly transmitted to a remote traffic management server, thereby avoiding the occurrence of a scene where the zebra stripes are too light and the zebra stripes are missing.
[0019] Although the present invention has been described in conjunction with specific embodiments of the present invention, it is obvious to those skilled in the art that various modifications and variations can be made to the present invention without departing from the scope and spirit of the present invention. Therefore, it should be understood that the above embodiments are not restrictive in all aspects, but illustrative.
Claims
1. A smart city traffic management system, characterized in that: The system comprises: A visual data collector performs visual data collection operations on traffic intersections to obtain the image of the intersection corresponding to the current moment; an arithmetic mean filtering device, connected to the visualization collector, for performing arithmetic mean filtering on the received traffic intersection image to obtain and output a corresponding arithmetic mean filtered image; A bilateral filtering device, connected to the arithmetic mean filtering device, for performing a bilateral filtering process on the received arithmetic mean filtered image to obtain and output a corresponding bilateral filtered image; an artifact removal device, connected to the bilateral filtering device, for performing an artifact removal process on the received bilateral filtered image to obtain and output a corresponding artifact removed image; An information storage unit, used for pre-storing a reference outline pattern of a zebra stripe using a set physical address storage space; a numerical processing unit connected to the information storage unit and configured to perform content matching processing on each sub-image in the received artifact-removed image and the reference contour pattern; a signal analysis unit, connected to the artifact removal device and the numerical processing unit, respectively, for issuing a zebra stripe detection signal when a certain sub-image exists in the artifact removal image and the percentage of content matching with the reference contour pattern exceeds a set percentage limit, and for issuing a zebra stripe non-detection signal when a certain sub-image does not exist in the artifact removal image and the percentage of content matching with the reference contour pattern exceeds a set percentage limit; A wireless reporting unit connected to the signal analysis unit is used to package the zebra crossing non-detection signal with the intersection code corresponding to the traffic intersection and then wirelessly transmit it to a remote traffic management server when the zebra crossing non-detection signal is received; Among them, when the zebra crossing non-detection signal is received, the zebra crossing non-detection signal and the intersection code corresponding to the traffic intersection are packaged and wirelessly transmitted to a remote traffic management server, including: the zebra crossing non-detection signal and the intersection code corresponding to the traffic intersection are packaged based on IP data packets and wirelessly transmitted to a remote traffic management server.
2. The smart city traffic management system according to claim 1, characterized in that: When the zebra crossing non-detection signal is received, the zebra crossing non-detection signal is packaged with the intersection code corresponding to the traffic intersection and then wirelessly transmitted to a remote traffic management server, including: the zebra crossing non-detection signal and the intersection code corresponding to the traffic intersection are packaged based on IP data packets and then wirelessly transmitted to a remote traffic management server.
3. The smart city traffic management system according to claim 2, characterized in that: The system further comprises: a current detection device, arranged near the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit and connected to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively; Among them, the current detection device is arranged near the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit and is respectively connected to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit, including: the current detection device is used to respectively realize the on-site measurement of the current of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit.
4. The smart city traffic management system as claimed in claim 2, characterized in that: The system further comprises: a bandwidth detection device, arranged near the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit and connected to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively; Among them, the bandwidth detection device is arranged near the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit and is respectively connected to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit, including: the bandwidth detection device is used to respectively realize on-site measurement of the current bandwidth of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit.
5. The smart city traffic management system according to any one of claims 2 to 4, characterized in that: A field programmable gate array is used to perform image data processing on the output data of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit to obtain output processing data corresponding to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively.
6. The smart city traffic management system according to claim 5, characterized in that: Using a field programmable gate array to perform image data processing on the output data of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit to obtain the output processing data corresponding to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively includes: performing statistical sorting filtering on the output data of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit to obtain the output processing data corresponding to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively.
7. The smart city traffic management system according to claim 5, characterized in that: Using a field programmable gate array to perform image data processing on the output data of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit to obtain the output processing data corresponding to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively includes: performing gradient sharpening filtering on the output data of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit to obtain the output processing data corresponding to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively.
8. The smart city traffic management system as claimed in claim 5, characterized in that: Using a field programmable gate array to perform image data processing on the output data of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit to obtain the output processing data corresponding to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively includes: performing Butterworth low-pass filtering on the output data of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit to obtain the output processing data corresponding to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively.
9. The smart city traffic management system according to claim 5, characterized in that: Using a field programmable gate array to perform image data processing on the output data of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit to obtain the output processing data corresponding to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively includes: performing Gaussian high-pass filtering processing on the output data of the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit to obtain the output processing data corresponding to the bilateral filtering device, the arithmetic mean filtering device, the artifact removal device and the signal analysis unit respectively.