Traffic management auxiliary sensing method and device based on radar image information fusion

By fusing monitoring data with radar image information, calculating traffic density coefficients and update coefficients, the problem of poor traffic data perception effect in the existing technology is solved, accurate and serious warnings for traffic jams are achieved, and traffic management is improved Efficiency and accuracy.

CN118968750AActive Publication Date: 2024-11-15BEIJING RAILROAD INTELLIGENT TECH CO LTD

Patent Information

Application Number
CN202411007341.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-25
Publication Date
2024-11-15
Estimated Expiration
2044-07-25

AI Technical Summary

Technical Problem

In the prior art, state perception alone cannot effectively solve the impact of various road conditions, traffic congestion and traffic accidents on traffic conditions, resulting in a significant reduction in the traffic state perception effect.

Method used

Using a traffic management auxiliary perception method based on radar image information fusion, through the fusion processing of monitoring data and radar image information, we identify and track mobile targets, calculate traffic density coefficients and traffic update coefficients, and set different density coefficient thresholds and update thresholds. Achieve early warning and serious warning of traffic congestion.

Benefits of technology

It realizes comprehensive perception and tracking of traffic scenarios, promptly detects traffic congestion problems, improves the pertinence and efficiency of traffic management, and improves the accuracy and reliability of early warning through multi-dimensional feature matching.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118968750A_ABST
    Figure CN118968750A_ABST
Patent Text Reader

Abstract

The invention discloses a traffic management auxiliary perception method and device based on radar image information fusion, and relates to the technical field of intelligent traffic. According to the traffic management auxiliary perception method based on radar image information fusion, firstly, fusion processing is carried out on monitoring data and radar image information, perception monitoring, identification and tracking are carried out on a moving target, then traffic density coefficient judgment is carried out, traffic update coefficient judgment is carried out, and finally approaching monitoring and jam early warning are carried out. According to the invention, comprehensive perception and real-time monitoring of traffic conditions can be realized, early warning and management can be carried out according to traffic density coefficients and updating conditions, the traffic safety and efficiency can be improved, and the problem that the influence of various road conditions, traffic congestion and traffic accidents on traffic states cannot be solved when state perception is carried out purely through traffic data is solved. Therefore, the traffic state sensing effect is greatly reduced, and the state judgment is influenced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of intelligent transportation technology, and in particular to a traffic management auxiliary perception method and device based on radar image information fusion. Background Art

[0002] With the rapid development of road traffic and the continuous improvement of urban road networks, great progress has been made in reducing damage to transportation infrastructure. Along with the improvement of people's living standards, cars have gradually become a must-have for some families to travel.

[0003] With the increase in the number of motor vehicles, traffic congestion, traffic accidents and traffic violations occur frequently. Traffic information is the available information circulated by motor vehicles in the field of transportation. The driving status and driving data of various motor vehicles are stored in the traffic information. However, in the existing technology, the use of traffic information for traffic status perception mostly uses existing traffic data for clustering, and classifies the clustering results according to a pre-built analysis model to judge the traffic status. However, simply perceiving the status through traffic data cannot solve the impact of various road conditions, traffic congestion and traffic accidents on the traffic status, which greatly reduces the effect of traffic status perception and affects the judgment of the status. Summary of the invention

[0004] In view of the deficiencies in the prior art, the present invention provides a traffic management auxiliary perception method and device based on radar image information fusion, which solves the problem that simply perceiving the status through traffic data cannot resolve the impact of various road conditions, traffic congestion and traffic accidents on the traffic status, thereby greatly reducing the effect of traffic status perception and affecting the judgment of the status.

[0005] To achieve the above objectives, the present invention is implemented through the following technical solutions: a traffic management auxiliary perception method based on radar image information fusion, comprising the following steps: fusing monitoring data with radar image information, perceiving and monitoring moving targets in the monitored lane interval, identifying and tracking moving targets in the monitored lane interval; determining the traffic density coefficient of the monitored lane interval in the current monitoring period based on the identified and tracked moving targets in the monitored lane interval, and judging whether the traffic density coefficient of the monitored lane interval in the current monitoring period is greater than a set first density coefficient threshold, if not, continuing to judge whether the traffic density coefficient of the monitored lane interval in the next monitoring period is greater than the set first density coefficient threshold, if so, issuing a traffic congestion warning; obtaining the traffic update coefficient of the monitored lane interval in the current monitoring period, and judging whether the traffic update coefficient of the current monitoring period is less than the set traffic update threshold coefficient, if so, performing perception monitoring of the adjacent monitored lane interval, if not, in the next monitoring period of the monitored lane interval When the traffic density coefficient is greater than the set first density coefficient threshold, determine whether the traffic update coefficient of the next monitoring cycle is less than the set traffic update threshold coefficient; based on the perception monitoring of the adjacent monitoring lane interval, identify and track the moving target of the adjacent monitoring lane interval, and determine the traffic density coefficient of the adjacent monitoring lane interval of the current monitoring cycle, and determine whether the traffic density coefficient of the adjacent monitoring lane interval of the current monitoring cycle is greater than the set second density coefficient threshold. If so, a first-level serious warning of traffic congestion is issued. If not, determine whether the traffic update coefficient of the adjacent monitoring lane interval of the current monitoring cycle is less than the set traffic update threshold coefficient. If so, a second-level serious warning of traffic congestion is issued. If not, when the traffic density coefficient of the lane interval to be monitored in the next monitoring cycle is greater than the set first density coefficient threshold and the traffic density coefficient of the adjacent monitoring lane interval in the next monitoring cycle is greater than the set second density coefficient threshold, determine whether the traffic update coefficient of the adjacent monitoring lane interval in the next monitoring cycle is less than the set traffic update threshold coefficient.

[0006] Optionally, the moving targets include moving pedestrians and moving vehicles, and the calculation formula of the traffic density coefficient is: ; In the formula, is the traffic density coefficient, is the pedestrian traffic density, which is determined based on the number of pedestrians in the lane section to be monitored or the number of pedestrians in the lane section adjacent to the monitoring lane. is the pedestrian traffic density threshold set, is the vehicle traffic density, is the vehicle traffic density threshold set, is the pedestrian density weight coefficient, is the vehicle density weight coefficient, and .

[0007] Optionally, the first density coefficient threshold includes a first pedestrian density coefficient threshold, a first vehicle density coefficient threshold and a first comprehensive density coefficient threshold, and the traffic congestion warning includes a pedestrian congestion warning, a vehicle congestion warning and a comprehensive congestion warning. The process of judging whether the traffic density coefficient of the monitored lane section is greater than the set first density coefficient threshold is as follows: when the pedestrian traffic density is greater than the set pedestrian traffic density threshold and the vehicle traffic density is less than the set vehicle traffic density threshold, judge whether the traffic density coefficient is greater than the set first pedestrian density coefficient threshold, and if so, perform a pedestrian congestion warning; when the pedestrian traffic density is less than the set pedestrian traffic density threshold and the vehicle traffic density is greater than the set vehicle traffic density threshold, judge whether the traffic density coefficient is greater than the set first vehicle density coefficient threshold, and if so, perform a vehicle congestion warning; when the pedestrian traffic density is greater than the set pedestrian traffic density threshold and the vehicle traffic density is greater than the set vehicle traffic density threshold, judge whether the traffic density coefficient is greater than the set first comprehensive density coefficient threshold, and if so, perform a comprehensive congestion warning.

[0008] Optionally, the second density coefficient threshold includes a second pedestrian density coefficient threshold, a second vehicle density coefficient threshold and a second comprehensive density coefficient threshold, and the traffic congestion warning includes a severe pedestrian congestion warning, a severe vehicle congestion warning and a comprehensive severe congestion warning. The process of judging whether the traffic density coefficient of the monitored lane section is greater than the set second density coefficient threshold is as follows: when the pedestrian traffic density is greater than the set pedestrian traffic density threshold and the vehicle traffic density is less than the set vehicle traffic density threshold, judge whether the traffic density coefficient is greater than the set second pedestrian density coefficient threshold, and if so, issue a severe pedestrian congestion warning; when the pedestrian traffic density is less than the set pedestrian traffic density threshold and the vehicle traffic density is greater than the set vehicle traffic density threshold, judge whether the traffic density coefficient is greater than the set second vehicle density coefficient threshold, and if so, issue a severe vehicle congestion warning; when the pedestrian traffic density is greater than the set pedestrian traffic density threshold and the vehicle traffic density is greater than the set vehicle traffic density threshold, judge whether the traffic density coefficient is greater than the set second comprehensive density coefficient threshold, and if so, issue a comprehensive severe congestion warning.

[0009] Optionally, the calculation formula of the traffic update coefficient is:

[0010] ;

[0011] In the formula, is the traffic update coefficient, is the pedestrian update rate, Update the reference rate for the set pedestrian, is the vehicle renewal rate, Update the reference rate for the set vehicle, is the pedestrian update rate weight coefficient, is the vehicle update rate weight coefficient, and , is a natural constant, is the pedestrian traffic density, which is determined based on the number of pedestrians in the lane section to be monitored or the number of pedestrians in the lane section adjacent to the monitoring lane. is the pedestrian traffic density threshold set, is the vehicle traffic density, is the set vehicle traffic density threshold.

[0012] Optionally, the traffic update threshold coefficient includes a pedestrian update threshold coefficient, a vehicle update threshold coefficient and a comprehensive update threshold coefficient. The process of judging whether the traffic update coefficient is less than the set traffic update threshold coefficient is as follows: when the pedestrian traffic density is greater than the set pedestrian traffic density threshold and the vehicle traffic density is less than the set vehicle traffic density threshold, judge whether the traffic update coefficient is less than the set pedestrian update threshold coefficient. If so, judge whether the traffic density coefficient of the adjacent monitoring lane interval is greater than the set second density coefficient threshold. If not, continue to judge whether the traffic update coefficient is less than the set pedestrian update threshold coefficient. When the pedestrian traffic density is less than the set pedestrian traffic density threshold and the vehicle traffic density is greater than When the vehicle traffic density threshold is set, determine whether the traffic update coefficient is less than the set vehicle update threshold coefficient. If so, determine whether the traffic density coefficient of the adjacent monitoring lane section is greater than the set second density coefficient threshold. If not, continue to determine whether the traffic update coefficient is less than the set vehicle update threshold coefficient. When the pedestrian traffic density is greater than the set pedestrian traffic density threshold and the vehicle traffic density is greater than the set vehicle traffic density threshold, determine whether the traffic update coefficient is less than the set comprehensive update threshold coefficient. If so, determine whether the traffic density coefficient of the adjacent monitoring lane section is greater than the set second density coefficient threshold. If not, continue to determine whether the traffic update coefficient is less than the set comprehensive update threshold coefficient.

[0013] Optionally, the process of sensing, monitoring, identifying and tracking mobile targets is as follows: based on the monitoring data, feature extraction is performed on the mobile targets entering the lane section to be monitored or the adjacent monitoring lane section, and the pedestrian feature matching data set and the vehicle feature matching data set are obtained and stored; based on the set matching cycle, feature extraction is performed on the mobile targets in the lane section to be monitored or the adjacent monitoring lane section, the pedestrian feature data set and the vehicle feature data set are obtained, and the pedestrian feature data set and the vehicle feature data set are matched with the pedestrian feature matching data set and the vehicle feature matching data set; based on the matching results, the mobile targets are identified and tracked, and the moving pedestrians and moving vehicles in the lane section to be monitored or the adjacent monitoring lane section are determined, and the moving pedestrians and moving vehicles in the lane section to be monitored are used as the analysis basis for the traffic density coefficient of the monitoring lane section, and the moving pedestrians and moving vehicles in the adjacent monitoring lane section are used as the analysis basis for the traffic density coefficient of the adjacent monitoring lane section.

[0014] Optionally, the pedestrian feature dataset includes a facial feature dataset, a head feature dataset and a clothing feature dataset, and the pedestrian feature matching dataset includes a facial feature matching dataset, a head feature matching dataset and a clothing feature matching dataset. The pedestrian feature dataset and the pedestrian feature matching dataset are matched to obtain a pedestrian matching coefficient, which is used as a basis for identifying and tracking mobile targets and also as a basis for analyzing traffic update coefficients; the vehicle feature dataset and the vehicle feature matching dataset are matched to obtain a vehicle matching coefficient, which is used as a basis for identifying and tracking mobile targets and also as a basis for analyzing traffic update coefficients.

[0015] Optionally, the facial feature matching data set includes the facial occluder area, occluder curvature and occluder curvature angle, the head feature matching data set includes the brow distance, lip width and upper lip to brow distance, and the clothing feature matching data set includes the top width value and the neckline curvature; the facial feature matching data set includes the facial occluder matching area, occluder matching curvature and occluder matching curvature angle, the head feature matching data set includes the brow matching distance, lip width and upper lip to brow matching distance, and the clothing feature matching data set includes the top width value and the neckline matching curvature; if the facial occluder If the area of ​​the obstruction is smaller than the set facial occlusion area threshold, the pedestrian matching coefficient is obtained based on the head feature data set and the clothing feature data set, as well as the head feature matching data set and the clothing feature matching data set; if the area of ​​the facial occlusion is larger than the set facial occlusion area threshold, the pedestrian matching coefficient is obtained based on the facial feature data set and the clothing feature data set, as well as the facial feature matching data set and the clothing feature matching data set; the vehicle feature data set includes the windshield area and the vehicle HSV value, and the vehicle feature matching data set includes the windshield matching area and the vehicle HSV matching value.

[0016] A traffic management auxiliary perception method device based on radar image information fusion, including a mobile target perception monitoring module, a lane interval monitoring and early warning module to be monitored, a lane interval traffic update monitoring module to be monitored and an adjacent lane interval monitoring and early warning module, wherein: the mobile target perception monitoring module is used to fuse monitoring data with radar image information, perceive and monitor the mobile target in the lane interval to be monitored, and identify and track the mobile target in the lane interval to be monitored; the lane interval monitoring and early warning module to be monitored is used to determine the traffic density coefficient of the lane interval to be monitored in the current monitoring cycle based on the identified and tracked mobile target in the lane interval to be monitored, and judge whether the traffic density coefficient of the lane interval to be monitored in the current monitoring cycle is greater than a set first density coefficient threshold value, if not, continue to judge whether the traffic density coefficient of the lane interval to be monitored in the next monitoring cycle is greater than the set first density coefficient threshold value, if yes, then issue a traffic jam warning; the lane interval traffic update monitoring module to be monitored is used to obtain the traffic update coefficient of the lane interval to be monitored in the current monitoring cycle, and judge whether the traffic update coefficient of the current monitoring cycle is less than the set traffic update threshold coefficient, if yes, then issue a traffic jam warning. Perception monitoring of the adjacent monitoring lane interval, if otherwise, when the traffic density coefficient of the lane interval to be monitored in the next monitoring cycle is greater than the set first density coefficient threshold, it is judged whether the traffic update coefficient of the next monitoring cycle is less than the set traffic update threshold coefficient; the adjacent monitoring lane interval monitoring and early warning module is used to identify and track the moving target of the adjacent monitoring lane interval based on the perception monitoring of the adjacent monitoring lane interval, and determine the traffic density coefficient of the adjacent monitoring lane interval in the current monitoring cycle, and judge whether the traffic density coefficient of the adjacent monitoring lane interval in the current monitoring cycle is greater than the set second density coefficient threshold. If so, a first-level serious warning of traffic congestion is issued; if otherwise, it is judged whether the traffic update coefficient of the adjacent monitoring lane interval in the current monitoring cycle is less than the set traffic update threshold coefficient. If so, a second-level serious warning of traffic congestion is issued; if otherwise, when the traffic density coefficient of the lane interval to be monitored in the next monitoring cycle is greater than the set first density coefficient threshold and the traffic density coefficient of the adjacent monitoring lane interval in the next monitoring cycle is greater than the set second density coefficient threshold, it is judged whether the traffic update coefficient of the adjacent monitoring lane interval in the next monitoring cycle is less than the set traffic update threshold coefficient.

[0017] The technical solution of the present invention has at least the following beneficial effects compared with the prior art:

[0018] In the above scheme, by integrating monitoring data and radar image information, and sensing, monitoring, identifying and tracking mobile targets, comprehensive perception and tracking of traffic scenes are achieved, thereby effectively monitoring traffic conditions. By using information such as pedestrian and vehicle density, combined with relevant calculation formulas and thresholds, real-time analysis and early warning of traffic density are achieved, and problems such as traffic congestion can be discovered in a timely manner.

[0019] By setting different density coefficient thresholds and update thresholds, and comprehensively considering the matching results of different features, accurate early warning of serious congestion of pedestrians and vehicles is achieved, which helps to take traffic management measures in a timely manner. Multi-dimensional feature matching is adopted, such as facial features, head features, clothing features of pedestrians, and windshield area and HSV value of vehicles, which improves the accuracy and reliability of matching. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 This is a flow chart of the traffic management auxiliary perception method based on radar image information fusion of the present invention;

[0021] Figure 2 This is a connection diagram of the traffic management auxiliary perception device based on radar image information fusion of the present invention. DETAILED DESCRIPTION

[0022] The embodiment of the present invention adopts a traffic management auxiliary perception method based on radar image information fusion. By fusing radar image information and combining it with monitoring data, it realizes comprehensive perception and monitoring of traffic conditions, and can make early warnings and adjustments in a timely manner, thereby effectively alleviating traffic congestion, improving road traffic efficiency, and enhancing traffic safety.

[0023] The overall idea of ​​the problem in the embodiment of the present invention is as follows:

[0024] First, the monitoring data is fused with the radar image information. This may involve steps such as data preprocessing, feature extraction, and data fusion to ensure that the information obtained from two different data sources can be effectively combined, and the fused data is used to perceive and monitor mobile targets. This step involves perception algorithms such as target detection and target recognition, which can extract the location information of mobile targets from monitoring data and radar images.

[0025] Based on the identified and tracked moving targets, the traffic density coefficient of the lane section to be monitored is determined. This step can be achieved by statistically analyzing the number of moving targets to reflect the traffic density of the lane section. The traffic state is judged according to the traffic density coefficient, and corresponding warnings are issued. For example, if the traffic density coefficient exceeds the set threshold, a traffic jam warning is issued; if the traffic density coefficient is lower than the set threshold, but the traffic update coefficient is low, perception monitoring of the adjacent monitoring lane section is performed; if the traffic density coefficient of the adjacent monitoring lane section exceeds the second density coefficient threshold, a serious traffic jam warning is issued.

[0026] Monitor the traffic update coefficient to detect changes in traffic conditions in a timely manner. If the traffic update coefficient is lower than the set threshold, the system will conduct perception monitoring of the adjacent monitoring lane section and possible traffic status adjustments.

[0027] like Figure 1 As shown, an embodiment of the present invention provides a traffic management auxiliary perception method based on radar image information fusion, including the following steps: fusing monitoring data with radar image information, perceiving and monitoring moving targets in the monitored lane interval, identifying and tracking moving targets in the monitored lane interval; determining the traffic density coefficient of the monitored lane interval in the current monitoring period based on the identified and tracked moving targets in the monitored lane interval, and judging whether the traffic density coefficient of the monitored lane interval in the current monitoring period is greater than a set first density coefficient threshold, if not, continuing to judge whether the traffic density coefficient of the monitored lane interval in the next monitoring period is greater than the set first density coefficient threshold, if so, issuing a traffic congestion warning; obtaining the traffic update coefficient of the monitored lane interval in the current monitoring period, and judging whether the traffic update coefficient of the current monitoring period is less than the set traffic update threshold coefficient, if so, performing perception monitoring of the adjacent monitored lane interval, if otherwise, determining the traffic density coefficient of the monitored lane interval in the next monitoring period When it is greater than the set first density coefficient threshold, it is judged whether the traffic update coefficient of the next monitoring cycle is less than the set traffic update threshold coefficient; based on the perception monitoring of the adjacent monitoring lane interval, the moving target of the adjacent monitoring lane interval is identified and tracked, and the traffic density coefficient of the adjacent monitoring lane interval of the current monitoring cycle is determined, and it is judged whether the traffic density coefficient of the adjacent monitoring lane interval of the current monitoring cycle is greater than the set second density coefficient threshold. If so, a first-level serious warning of traffic congestion is issued. If not, it is judged whether the traffic update coefficient of the adjacent monitoring lane interval of the current monitoring cycle is less than the set traffic update threshold coefficient. If so, a second-level serious warning of traffic congestion is issued. If not, when the traffic density coefficient of the lane interval to be monitored in the next monitoring cycle is greater than the set first density coefficient threshold and the traffic density coefficient of the adjacent monitoring lane interval in the next monitoring cycle is greater than the set second density coefficient threshold, it is judged whether the traffic update coefficient of the adjacent monitoring lane interval in the next monitoring cycle is less than the set traffic update threshold coefficient.

[0028] The process of fusing monitoring data with radar image information to identify and track moving targets in the lane section to be monitored is to obtain monitoring video data in real time through the camera installed in the lane section to be monitored, obtain the moving target information detected by the radar in real time through the radar system installed in the same section, including the distance, speed, direction and other data of the target, synchronize the video data and radar data in time to ensure that the information of the two data sources is processed on the same time axis, align the space based on the installation position and angle of the monitoring camera and radar, map the video data and radar data to the same coordinate system, match the image features and radar features, associate the targets detected by the radar with the targets in the video, and ensure that the same target has a consistent identification in the two data sources. Use the multi-target tracking algorithm to process the fused data and track each moving target in real time. According to the historical position and motion state of the target, predict the future position of the target, update the tracking trajectory, and use the appearance features (such as shape, color, etc.) and motion features (such as speed, direction, etc.) of the target to ensure the consistency of the identity of the tracked target. The fused monitoring data and radar information are displayed on the monitoring interface, including the real-time position and motion trajectory of each target, and pedestrian and vehicle feature data are obtained through the monitoring data.

[0029] Specifically, moving targets include moving pedestrians and moving vehicles. In addition to being obtained through relevant monitoring equipment or directly expressed using pedestrian and vehicle densities, the traffic density coefficient can also be calculated using the following formula:

[0030] ;

[0031] In the formula, is the traffic density coefficient, is the pedestrian traffic density, which is determined based on the number of pedestrians in the lane section to be monitored or the number of pedestrians in the lane section adjacent to the monitoring lane. is the pedestrian traffic density threshold set, is the vehicle traffic density, is the vehicle traffic density threshold set, is the pedestrian density weight coefficient, is the vehicle density weight coefficient, and .

[0032] In this implementation scheme, the impact of two moving targets, pedestrians and vehicles, on traffic density is taken into account, so that the traffic density coefficient can more comprehensively reflect the traffic conditions on the road. By dynamically adjusting the pedestrian density weight coefficient and the vehicle density weight coefficient, the calculation of the traffic density coefficient is more flexible and can be adjusted according to actual conditions and the characteristics of different traffic scenarios, so as to adapt to different traffic environments, making the calculation of the traffic density coefficient more universal and adaptable.

[0033] Specifically, the first density coefficient threshold includes a first pedestrian density coefficient threshold, a first vehicle density coefficient threshold and a first comprehensive density coefficient threshold. The traffic congestion warning includes a pedestrian congestion warning, a vehicle congestion warning and a comprehensive congestion warning. The process of judging whether the traffic density coefficient of the monitored lane section is greater than the set first density coefficient threshold is as follows: when the pedestrian traffic density is greater than the set pedestrian traffic density threshold and the vehicle traffic density is less than the set vehicle traffic density threshold, judge whether the traffic density coefficient is greater than the set first pedestrian density coefficient threshold, and if so, a pedestrian congestion warning is issued; when the pedestrian traffic density is less than the set pedestrian traffic density threshold and the vehicle traffic density is greater than the set vehicle traffic density threshold, judge whether the traffic density coefficient is greater than the set first vehicle density coefficient threshold, and if so, a vehicle congestion warning is issued; when the pedestrian traffic density is greater than the set pedestrian traffic density threshold and the vehicle traffic density is greater than the set vehicle traffic density threshold, judge whether the traffic density coefficient is greater than the set first comprehensive density coefficient threshold, and if so, a comprehensive congestion warning is issued.

[0034] In this implementation scheme, traffic congestion warnings are divided into pedestrian congestion warnings, vehicle congestion warnings and comprehensive congestion warnings according to the pedestrian traffic density and vehicle traffic density, making the warnings more targeted and effective. By separately judging whether the pedestrian and vehicle traffic densities exceed the thresholds and making corresponding congestion warnings, traffic congestion problems can be discovered more accurately, making the warnings more precise and effective.

[0035] Different types of congestion warnings are issued according to the density of pedestrians and vehicles, which is conducive to the traffic management department to take corresponding measures according to the actual situation, thereby improving the efficiency and pertinence of traffic management.

[0036] Specifically, the second density coefficient threshold includes a second pedestrian density coefficient threshold, a second vehicle density coefficient threshold and a second comprehensive density coefficient threshold. The traffic congestion warning includes a severe pedestrian congestion warning, a severe vehicle congestion warning and a comprehensive severe congestion warning. The process of judging whether the traffic density coefficient of the monitored lane section is greater than the set second density coefficient threshold is as follows: when the pedestrian traffic density is greater than the set pedestrian traffic density threshold and the vehicle traffic density is less than the set vehicle traffic density threshold, judge whether the traffic density coefficient is greater than the set second pedestrian density coefficient threshold, and if so, a severe pedestrian congestion warning is issued; when the pedestrian traffic density is less than the set pedestrian traffic density threshold and the vehicle traffic density is greater than the set vehicle traffic density threshold, judge whether the traffic density coefficient is greater than the set second vehicle density coefficient threshold, and if so, a severe vehicle congestion warning is issued; when the pedestrian traffic density is greater than the set pedestrian traffic density threshold and the vehicle traffic density is greater than the set vehicle traffic density threshold, judge whether the traffic density coefficient is greater than the set second comprehensive density coefficient threshold, and if so, a comprehensive severe congestion warning is issued.

[0037] First, according to the pedestrian traffic density and vehicle traffic density, it is determined whether different conditions are met. These conditions include whether the pedestrian traffic density is greater than the set pedestrian traffic density threshold, whether the vehicle traffic density is less than the set vehicle traffic density threshold, and vice versa. After determining that the specific conditions are met, the traffic density coefficient is calculated based on the obtained pedestrian traffic density and vehicle traffic density. The coefficient can be calculated according to the method given in the formula, taking into account the weight coefficients of pedestrian and vehicle densities, and the comparison with the threshold.

[0038] The calculated traffic density coefficient is compared with the set second density coefficient threshold. If the traffic density coefficient is greater than the set second density coefficient threshold, it means that the traffic density has exceeded the preset severe congestion level and a corresponding severe congestion warning is required. According to the judgment result, determine what type of severe congestion warning to make. If the condition is that the pedestrian density exceeds the threshold but the vehicle density does not exceed the threshold, a pedestrian severe congestion warning is made; otherwise, a vehicle severe congestion warning is made. If both the pedestrian density and the vehicle density exceed the threshold at the same time, a comprehensive severe congestion warning is made.

[0039] By again determining whether the pedestrian and vehicle traffic density exceeds the second density coefficient threshold and issuing corresponding severe congestion warnings, traffic congestion problems can be discovered more accurately, making the warnings more precise and effective.

[0040] The traffic update coefficient can be directly expressed by the pedestrian or vehicle update speed in each determined period, or it can be calculated in the following way. The calculation formula of the traffic update coefficient is:

[0041] ;

[0042] In the formula, is the traffic update coefficient, is the pedestrian update rate, Update the reference rate for the set pedestrian, is the vehicle renewal rate, Update the reference rate for the set vehicle, is the pedestrian update rate weight coefficient, is the vehicle update rate weight coefficient, and , is a natural constant, is the pedestrian traffic density, which is determined based on the number of pedestrians in the lane section to be monitored or the number of pedestrians in the lane section adjacent to the monitoring lane. is the pedestrian traffic density threshold set, is the vehicle traffic density, is the set vehicle traffic density threshold.

[0043] In this implementation scheme, the traffic update rate refers to the rate of change in the number of pedestrians and vehicles within a certain period of time, which can be expressed by the update speed of pedestrians or vehicles in each determined period. The high or low traffic update rate can reflect the change in traffic flow, that is, the speed of change in the number of pedestrians and vehicles on the road. The calculation logic of the traffic update coefficient is based on the comparison and trade-off of pedestrian and vehicle update rates. When the pedestrian or vehicle update rate is higher than the set reference rate, the traffic update coefficient will reflect a relatively high traffic update process. The calculation method of the traffic update coefficient in different situations is different. According to the different combinations of pedestrian and vehicle traffic density, the corresponding calculation formula is selected for calculation to more accurately reflect the changes in traffic conditions.

[0044] The traffic update coefficient is based on the update rate of pedestrians and vehicles, which can reflect the dynamic changes in traffic conditions and enable traffic management to respond more promptly. It comprehensively considers the update rate of pedestrians and vehicles, so that the traffic update coefficient can more comprehensively reflect the overall situation of traffic conditions, which is conducive to improving the comprehensiveness and accuracy of traffic management.

[0045] Specifically, the traffic update threshold coefficient includes a pedestrian update threshold coefficient, a vehicle update threshold coefficient and a comprehensive update threshold coefficient. The process of judging whether the traffic update coefficient is less than the set traffic update threshold coefficient is as follows: when the pedestrian traffic density is greater than the set pedestrian traffic density threshold and the vehicle traffic density is less than the set vehicle traffic density threshold, judge whether the traffic update coefficient is less than the set pedestrian update threshold coefficient. If so, judge whether the traffic density coefficient of the adjacent monitoring lane section is greater than the set second density coefficient threshold. If not, continue to judge whether the traffic update coefficient is less than the set pedestrian update threshold coefficient. When the pedestrian traffic density is less than the set pedestrian traffic density threshold and the vehicle traffic density is greater than the set When the vehicle traffic density threshold is set, determine whether the traffic update coefficient is less than the set vehicle update threshold coefficient. If so, determine whether the traffic density coefficient of the adjacent monitoring lane section is greater than the set second density coefficient threshold. If not, continue to determine whether the traffic update coefficient is less than the set vehicle update threshold coefficient. When the pedestrian traffic density is greater than the set pedestrian traffic density threshold and the vehicle traffic density is greater than the set vehicle traffic density threshold, determine whether the traffic update coefficient is less than the set comprehensive update threshold coefficient. If so, determine whether the traffic density coefficient of the adjacent monitoring lane section is greater than the set second density coefficient threshold. If not, continue to determine whether the traffic update coefficient is less than the set comprehensive update threshold coefficient.

[0046] In this implementation, first, based on the pedestrian traffic density and vehicle traffic density, it is determined whether specific conditions are met, including that the pedestrian density is greater than a set threshold and the vehicle density is less than a set threshold, that the pedestrian density is less than a set threshold and the vehicle density is greater than the set threshold, and that both are greater than the corresponding thresholds. Corresponding processing and judgment are performed according to different situations.

[0047] When certain conditions are met, it is further determined whether the traffic update coefficient is less than the set traffic update threshold coefficient. The traffic update coefficient is compared by comparing the calculated traffic update coefficient with the set pedestrian update threshold coefficient, vehicle update threshold coefficient or comprehensive update threshold coefficient to determine whether the warning conditions are met. If the traffic update coefficient is less than the set traffic update threshold coefficient, subsequent judgments are continued, including determining whether the traffic density coefficient of the adjacent monitoring lane section is greater than the set second density coefficient threshold, and continuing to determine whether the traffic update coefficient is less than the set threshold coefficient. Through continuous judgments, the changing trend and severity of traffic conditions can be determined more accurately, providing more comprehensive data support for traffic management.

[0048] Specifically, the process of sensing, monitoring, identifying and tracking mobile targets is as follows: based on the monitoring data, feature extraction is performed on the mobile targets entering the lane section to be monitored or the adjacent monitoring lane section, and the pedestrian feature matching data set and the vehicle feature matching data set are obtained and stored; based on the set matching cycle, feature extraction is performed on the mobile targets in the lane section to be monitored or the adjacent monitoring lane section, the pedestrian feature data set and the vehicle feature data set are obtained, and the pedestrian feature data set and the vehicle feature data set are matched with the pedestrian feature matching data set and the vehicle feature matching data set; based on the matching results, the mobile targets are identified and tracked, and the moving pedestrians and moving vehicles in the lane section to be monitored or the adjacent monitoring lane section are determined, and the moving pedestrians and moving vehicles in the lane section to be monitored are used as the analysis basis for the traffic density coefficient of the monitoring lane section, and the moving pedestrians and moving vehicles in the adjacent monitoring lane section are used as the analysis basis for the traffic density coefficient of the adjacent monitoring lane section.

[0049] In this implementation scheme, first, based on the monitoring data, feature extraction is performed on the mobile targets that enter the lane section to be monitored or the adjacent lane section to be monitored, and the extracted feature data is stored in the pedestrian feature matching data set and the vehicle feature matching data set for use in the subsequent matching and recognition process. Within the set matching cycle, feature extraction is performed again on the mobile targets in the lane section to be monitored or the adjacent lane section to be monitored, and the pedestrian feature data set and the vehicle feature data set are obtained, and these newly extracted feature data are matched with the previously stored pedestrian feature matching data set and the vehicle feature matching data set to find the corresponding mobile targets.

[0050] Based on the matching results, the moving targets are identified and tracked. By matching the successful feature data, the moving pedestrians and moving vehicles in the lane section to be monitored or the adjacent lane section to be monitored are determined. These identified and tracked moving targets will serve as the basis for subsequent traffic density coefficient analysis.

[0051] Through periodic feature extraction and matching, real-time perception and monitoring of moving targets can be achieved, and changes in traffic conditions in the lane section to be monitored and the adjacent lane section to be monitored can be reflected in a timely manner. Moreover, through feature extraction and matching, moving targets can be accurately identified and tracked, reducing the possibility of misidentification and missed identification, and improving the accuracy of identification and tracking. By extracting and matching the features of pedestrians and vehicles, perception and monitoring of different types of moving targets can be achieved, thereby fully understanding the traffic conditions and providing more comprehensive data support for subsequent traffic density coefficient analysis.

[0052] Specifically, the pedestrian feature data set includes a facial feature data set, a head feature data set and a clothing feature data set, the pedestrian feature matching data set includes a facial feature matching data set, a head feature matching data set and a clothing feature matching data set, the pedestrian feature data set and the pedestrian feature matching data set are matched to obtain a pedestrian matching coefficient, which serves as a basis for identifying and tracking mobile targets, and also as a basis for analyzing traffic update coefficients; the vehicle feature data set and the vehicle feature matching data set are matched to obtain a vehicle matching coefficient, which serves as a basis for identifying and tracking mobile targets, and also as a basis for analyzing traffic update coefficients.

[0053] The pedestrian feature dataset includes a facial feature dataset, a head feature dataset and a clothing feature dataset, while the pedestrian feature matching dataset includes a corresponding matching dataset for storing previously acquired feature data. Similarly, the vehicle feature dataset and the vehicle feature matching dataset also have similar structures for storing vehicle feature data and matching data.

[0054] By matching the pedestrian feature data set with the pedestrian feature matching data set, a pedestrian matching coefficient can be obtained, which reflects the degree of matching between the pedestrian feature data and the previously stored feature data. Similarly, the vehicle feature data set is matched with the vehicle feature matching data set to obtain a vehicle matching coefficient.

[0055] The facial feature matching dataset includes the facial occluder area, occluder curvature and occluder curvature angle, the head feature dataset includes the brow distance, lip width and upper lip to brow distance, and the clothing feature dataset includes the top width value and neckline curvature; the facial feature matching dataset includes the facial occluder matching area, occluder matching curvature and occluder matching curvature angle, the head feature matching dataset includes the brow matching distance, matching lip width and upper lip to brow matching distance, and the clothing feature matching dataset includes the top width value and neckline matching curvature; if the facial occluder area is smaller than the set facial occluder area threshold, the pedestrian matching coefficient is obtained based on the analysis of the head feature dataset and the clothing feature dataset, and the head feature matching dataset and the clothing feature matching dataset; if the facial occluder area is larger than the set facial occluder area threshold, the pedestrian matching coefficient is obtained based on the analysis of the facial feature dataset and the clothing feature dataset, and the facial feature matching dataset and the clothing feature matching dataset.

[0056] According to the description of the facial feature dataset, head feature dataset and clothing feature dataset, the facial, head and clothing feature data related to the human body are extracted, and these feature data are matched with the corresponding feature matching dataset for subsequent analysis of the pedestrian's matching degree. The facial occlusion area is an important feature used to determine whether the face is occluded. If the facial occlusion area is smaller than the set threshold, the head feature and clothing feature are used for matching; if the facial occlusion area is larger than the set threshold, the facial feature and clothing feature are used for matching. According to different matching situations, the head feature dataset and clothing feature dataset or the facial feature dataset and clothing feature dataset are used respectively, combined with the corresponding matching dataset, for matching analysis.

[0057] The impact of facial occlusions on matching is taken into account. The matching is not limited to facial features, but also takes into account head features and clothing features, making the matching analysis more comprehensive. Different matching schemes are adjusted according to the facial occlusion situation, which is more flexible and adaptable, and can meet the needs of human feature matching in various scenarios.

[0058] In addition to being obtained through deep learning algorithms or Siamese networks based on deep learning, pedestrian matching coefficients can also be obtained through the following calculation formula:

[0059] ;

[0060] In the formula, is the number of the pedestrian feature matching dataset, , is the total number of pedestrian feature matching datasets, Pedestrian feature dataset The pedestrian matching coefficient obtained by matching the pedestrian feature matching data set is: is the head feature dataset, For the head feature matching dataset, The head feature dataset is The calculation function for matching the head feature matching dataset in the pedestrian feature matching dataset is: To calculate the function The weight factor of is a clothing feature dataset, For clothing feature matching dataset, The clothing feature dataset is The calculation function for matching the clothing feature matching dataset in the pedestrian feature matching dataset is: To calculate the function The weight factor of is a facial feature dataset, For facial feature matching dataset, The facial feature dataset is The calculation function for matching the facial feature matching dataset in the pedestrian feature matching dataset is: To calculate the function The weight factor of is the face occluder area, is the set facial occlusion area threshold.

[0061] The calculation formula of the matching coefficient uses a variety of feature data sets (head, clothing, face) and their matching functions with the matching data set. The formula is divided into two cases: when the area of ​​the facial occluder is smaller than the set threshold, the head features and clothing features are used for matching; when the area of ​​the facial occluder is larger than the set threshold, the head features and facial features are used for matching. The matching function is used to evaluate the degree of matching between the feature data set and the matching data set. These functions can calculate the similarity between features based on various similarity metrics, such as Euclidean distance, cosine similarity, etc., or they can be calculated in the following way.

[0062] in, , is the distance between eyebrows, For the The head feature matching distance in the pedestrian feature matching dataset and the eyebrow matching distance in the eyebrow matching dataset, For lip width, For the The head features in the pedestrian feature matching dataset match the lip width in the matching dataset, The distance from upper lip to brow. For the The head feature matching distance from the upper lip to the eyebrow in the pedestrian feature matching dataset, is the comprehensive weight factor of the eyebrow distance and lip width, is the weight factor of the distance from upper lip to brow.

[0063] ,

[0064] In the formula, is the width of the top, For the The width value of the top matching in the clothing feature matching data in the pedestrian feature matching dataset, is the weight factor of the shirt width value, is the neckline curvature, For the The neckline matching curvature in the clothing feature matching data in the pedestrian feature matching dataset, is the weight factor of the collar curvature.

[0065] ,

[0066] In the formula, is the face occluder area, For the The facial features in the pedestrian feature matching dataset match the facial occlusion matching area in the facial feature matching dataset, is the weight factor of the facial occluder area, is the curvature of the obstruction, For the The facial features in the pedestrian feature matching dataset match the curvature of the occluder matching dataset, is the bending angle of the obstruction, For the Pedestrian feature matching dataset, facial feature matching dataset, occlusion matching dataset, bending angle matching, is the bending weight factor.

[0067] For each matching parameter in the above pedestrian feature matching data set, the features of each pedestrian in the current cycle are obtained, the features of each pedestrian are extracted and stored in the database, and the matching parameters stored in the previous monitoring cycle are deleted in the next monitoring cycle to achieve update.

[0068] The vehicle feature dataset includes the windshield area and the vehicle HSV value, and the vehicle feature matching dataset includes the windshield matching area and the vehicle HSV matching value.

[0069] In addition to being obtained through deep learning algorithms or Siamese networks based on deep learning, the vehicle matching coefficient can also be obtained through the following calculation formula:

[0070] ;

[0071] In the formula, is the number of the vehicle feature matching dataset, , is the total number of vehicle feature matching datasets, is the windshield area, For the The windshield matching area in the vehicle feature matching dataset, is the windshield area weight factor, is the H value in the vehicle HSV value, For the The H value of the vehicle HSV matching value in the vehicle feature matching dataset, The S value in the vehicle HSV value For the The S value of the vehicle HSV matching value in the vehicle feature matching dataset, is the V value in the vehicle HSV value, For the The V value of the vehicle HSV matching value in the vehicle feature matching dataset, is the HSV value weight factor.

[0072] Similarly, for each matching parameter in the above vehicle feature matching data set, the features of each vehicle in the current cycle are obtained, the features of each vehicle are extracted and stored in the database, and the matching parameters stored in the previous monitoring cycle are deleted in the next monitoring cycle to achieve update.

[0073] In this implementation scheme, the calculation of the vehicle matching coefficient takes two aspects into consideration: windshield area and vehicle HSV value, making the matching process more comprehensive and enabling the vehicle to be identified and tracked from multiple angles. The weight factor can be adjusted according to actual conditions, making the algorithm flexible and adaptable, and can be adjusted according to different scenarios and needs, thereby improving the applicability of the algorithm.

[0074] A traffic management auxiliary perception method device based on radar image information fusion, including a mobile target perception monitoring module, a lane interval monitoring and early warning module to be monitored, a lane interval traffic update monitoring module to be monitored and an adjacent lane interval monitoring and early warning module, wherein: the mobile target perception monitoring module is used to fuse monitoring data with radar image information, perceive and monitor the mobile target in the lane interval to be monitored, and identify and track the mobile target in the lane interval to be monitored; the lane interval monitoring and early warning module to be monitored is used to determine the traffic density coefficient of the lane interval to be monitored in the current monitoring cycle based on the identified and tracked mobile target in the lane interval to be monitored, and judge whether the traffic density coefficient of the lane interval to be monitored in the current monitoring cycle is greater than a set first density coefficient threshold value, if not, continue to judge whether the traffic density coefficient of the lane interval to be monitored in the next monitoring cycle is greater than the set first density coefficient threshold value, if yes, then issue a traffic jam warning; the lane interval traffic update monitoring module to be monitored is used to obtain the traffic update coefficient of the lane interval to be monitored in the current monitoring cycle, and judge whether the traffic update coefficient of the current monitoring cycle is less than the set traffic update threshold coefficient, if yes, then issue a traffic jam warning. Perception monitoring of the adjacent monitoring lane interval, if otherwise, when the traffic density coefficient of the lane interval to be monitored in the next monitoring cycle is greater than the set first density coefficient threshold, it is judged whether the traffic update coefficient of the next monitoring cycle is less than the set traffic update threshold coefficient; the adjacent monitoring lane interval monitoring and early warning module is used to identify and track the moving target of the adjacent monitoring lane interval based on the perception monitoring of the adjacent monitoring lane interval, and determine the traffic density coefficient of the adjacent monitoring lane interval in the current monitoring cycle, and judge whether the traffic density coefficient of the adjacent monitoring lane interval in the current monitoring cycle is greater than the set second density coefficient threshold. If so, a first-level serious warning of traffic congestion is issued; if otherwise, it is judged whether the traffic update coefficient of the adjacent monitoring lane interval in the current monitoring cycle is less than the set traffic update threshold coefficient. If so, a second-level serious warning of traffic congestion is issued; if otherwise, when the traffic density coefficient of the lane interval to be monitored in the next monitoring cycle is greater than the set first density coefficient threshold and the traffic density coefficient of the adjacent monitoring lane interval in the next monitoring cycle is greater than the set second density coefficient threshold, it is judged whether the traffic update coefficient of the adjacent monitoring lane interval in the next monitoring cycle is less than the set traffic update threshold coefficient.

[0075] In this implementation, the monitoring data is integrated with the radar image information through the mobile target perception monitoring module to achieve comprehensive perception, identification and tracking of mobile targets, thereby improving the accuracy and comprehensiveness of traffic conditions. The monitoring and early warning module of the lane section to be monitored determines the traffic density coefficient of the lane section to be monitored based on the identified and tracked mobile targets, and determines in real time whether it exceeds the set first density coefficient threshold. If the threshold is exceeded, traffic updates are performed and traffic congestion warnings are issued, thereby promptly reminding drivers and traffic managers to take measures.

[0076] The traffic update monitoring module of the lane section to be monitored obtains the traffic update coefficient and determines whether it is less than the set traffic update threshold coefficient. If it is less than the threshold, the adjacent monitoring lane section perception monitoring is carried out to achieve continuous monitoring and updating of traffic conditions. The adjacent monitoring lane section monitoring and early warning module determines the traffic density coefficient of the adjacent monitoring lane section based on the identified and tracked mobile targets, and determines whether it exceeds the set second density coefficient threshold. If it does not exceed the threshold, it further determines whether the traffic update coefficient of the lane section to be monitored is less than the set traffic update threshold coefficient. If so, a serious traffic congestion warning is issued, which improves the ability to promptly discover and handle traffic anomalies.

[0077] An electronic device includes: a processor; and a memory, wherein computer program instructions are stored in the memory, and when the computer program instructions are executed by the processor, the processor executes the above-mentioned traffic management auxiliary perception method based on radar image information fusion.

[0078] A computer-readable storage medium is used to store a program, and when the program is executed by a processor, the above-mentioned traffic management auxiliary perception method based on radar image information fusion is implemented.

[0079] The embodiments of the present invention realize comprehensive perception and tracking of traffic scenes by integrating monitoring data and radar image information, and sensing, monitoring, identifying and tracking mobile targets, thereby effectively monitoring traffic conditions, and utilizing information such as pedestrian and vehicle density, combined with relevant calculation formulas and thresholds, to realize real-time analysis and early warning of traffic density, and to promptly discover problems such as traffic congestion.

[0080] By setting different density coefficient thresholds and update thresholds, and comprehensively considering the matching results of different features, accurate early warning of serious congestion of pedestrians and vehicles is achieved, which helps to take traffic management measures in a timely manner. Multi-dimensional feature matching is adopted, such as facial features, head features, clothing features of pedestrians, and windshield area and HSV value of vehicles, which improves the accuracy and reliability of matching.

[0081] It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0082] The present invention is described with reference to flowcharts and / or block diagrams of systems, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0083] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0084] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0085] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0086] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A traffic management auxiliary perception method based on radar image information fusion, characterized in that: The following steps are involved: The monitoring data is integrated with the radar image information to sense and monitor the moving targets in the lane section to be monitored, and the moving targets in the lane section to be monitored are identified and tracked; Determine the traffic density coefficient of the lane section to be monitored in the current monitoring cycle based on the identified and tracked moving target in the lane section to be monitored, and judge whether the traffic density coefficient of the lane section to be monitored in the current monitoring cycle is greater than the set first density coefficient threshold value, if not, continue to judge whether the traffic density coefficient of the lane section to be monitored in the next monitoring cycle is greater than the set first density coefficient threshold value, if yes, issue a traffic jam warning; Obtain the traffic update coefficient of the lane section to be monitored in the current monitoring cycle, and determine whether the traffic update coefficient of the current monitoring cycle is less than the set traffic update threshold coefficient. If so, perform perception monitoring of the adjacent monitoring lane section. Otherwise, when the traffic density coefficient of the lane section to be monitored in the next monitoring cycle is greater than the set first density coefficient threshold, determine whether the traffic update coefficient of the next monitoring cycle is less than the set traffic update threshold coefficient. Based on the perception monitoring of the adjacent monitoring lane interval, the moving target of the adjacent monitoring lane interval is identified and tracked, and the traffic density coefficient of the adjacent monitoring lane interval in the current monitoring cycle is determined, and it is judged whether the traffic density coefficient of the adjacent monitoring lane interval in the current monitoring cycle is greater than the set second density coefficient threshold. If so, a first-level serious warning of traffic congestion is issued. If not, it is judged whether the traffic update coefficient of the adjacent monitoring lane interval in the current monitoring cycle is less than the set traffic update threshold coefficient. If so, a second-level serious warning of traffic congestion is issued. If not, when the traffic density coefficient of the lane interval to be monitored in the next monitoring cycle is greater than the set first density coefficient threshold and the traffic density coefficient of the adjacent monitoring lane interval in the next monitoring cycle is greater than the set second density coefficient threshold, it is judged whether the traffic update coefficient of the adjacent monitoring lane interval in the next monitoring cycle is less than the set traffic update threshold coefficient.

2. The traffic management auxiliary perception method based on radar image information fusion according to claim 1 is characterized in that: The moving targets include moving pedestrians and moving vehicles, and the calculation formula of the traffic density coefficient is: ; In the formula, is the traffic density coefficient, is the pedestrian traffic density, which is determined based on the number of pedestrians in the lane section to be monitored or the number of pedestrians in the lane section adjacent to the monitoring lane. is the pedestrian traffic density threshold set, is the vehicle traffic density, is the vehicle traffic density threshold set, is the pedestrian density weight coefficient, is the vehicle density weight coefficient, and .

3. The traffic management auxiliary perception method based on radar image information fusion according to claim 2 is characterized in that The first density coefficient threshold includes a first pedestrian density coefficient threshold, a first vehicle density coefficient threshold and a first comprehensive density coefficient threshold. The traffic congestion warning includes a pedestrian congestion warning, a vehicle congestion warning and a comprehensive congestion warning. The process of judging whether the traffic density coefficient of the monitored lane interval is greater than the set first density coefficient threshold is as follows: When the pedestrian traffic density is greater than the set pedestrian traffic density threshold and the vehicle traffic density is less than the set vehicle traffic density threshold, it is determined whether the traffic density coefficient is greater than the set first pedestrian density coefficient threshold. If so, a pedestrian congestion warning is issued; When the pedestrian traffic density is less than the set pedestrian traffic density threshold and the vehicle traffic density is greater than the set vehicle traffic density threshold, it is determined whether the traffic density coefficient is greater than the set first vehicle density coefficient threshold, and if so, a vehicle congestion warning is issued; When the pedestrian traffic density is greater than the set pedestrian traffic density threshold and the vehicle traffic density is greater than the set vehicle traffic density threshold, it is determined whether the traffic density coefficient is greater than the set first comprehensive density coefficient threshold. If so, a comprehensive congestion warning is issued.

4. The traffic management auxiliary perception method based on radar image information fusion according to claim 2 is characterized in that: The second density coefficient threshold includes a second pedestrian density coefficient threshold, a second vehicle density coefficient threshold and a second comprehensive density coefficient threshold. The traffic congestion warning includes a pedestrian severe congestion warning, a vehicle severe congestion warning and a comprehensive severe congestion warning. The process of determining whether the traffic density coefficient of the monitored lane section is greater than the set second density coefficient threshold is as follows: When the pedestrian traffic density is greater than the set pedestrian traffic density threshold and the vehicle traffic density is less than the set vehicle traffic density threshold, it is determined whether the traffic density coefficient is greater than the set second pedestrian density coefficient threshold. If so, a serious pedestrian congestion warning is issued; When the pedestrian traffic density is less than the set pedestrian traffic density threshold and the vehicle traffic density is greater than the set vehicle traffic density threshold, it is determined whether the traffic density coefficient is greater than the set second vehicle density coefficient threshold. If so, a serious vehicle congestion warning is issued; When the pedestrian traffic density is greater than the set pedestrian traffic density threshold and the vehicle traffic density is greater than the set vehicle traffic density threshold, it is determined whether the traffic density coefficient is greater than the set second comprehensive density coefficient threshold. If so, a comprehensive severe congestion warning is issued.

5. The traffic management auxiliary perception method based on radar image information fusion according to claim 1 is characterized in that: The calculation formula of the traffic update coefficient is: ; In the formula, is the traffic update coefficient, is the pedestrian update rate, Update the reference rate for the set pedestrian, is the vehicle renewal rate, Update the reference rate for the set vehicle, is the pedestrian update rate weight coefficient, is the vehicle update rate weight coefficient, and , is a natural constant, is the pedestrian traffic density, which is determined based on the number of pedestrians in the lane section to be monitored or the number of pedestrians in the lane section adjacent to the monitoring lane. is the pedestrian traffic density threshold set, is the vehicle traffic density, is the set vehicle traffic density threshold.

6. The traffic management auxiliary perception method based on radar image information fusion according to claim 5 is characterized in that: The traffic update threshold coefficient includes a pedestrian update threshold coefficient, a vehicle update threshold coefficient and a comprehensive update threshold coefficient. The process of judging whether the traffic update coefficient is less than the set traffic update threshold coefficient is as follows: When the pedestrian traffic density is greater than the set pedestrian traffic density threshold and the vehicle traffic density is less than the set vehicle traffic density threshold, determine whether the traffic update coefficient is less than the set pedestrian update threshold coefficient. If so, determine whether the traffic density coefficient of the adjacent monitoring lane interval is greater than the set second density coefficient threshold. If not, continue to determine whether the traffic update coefficient is less than the set pedestrian update threshold coefficient. When the pedestrian traffic density is less than the set pedestrian traffic density threshold and the vehicle traffic density is greater than the set vehicle traffic density threshold, determine whether the traffic update coefficient is less than the set vehicle update threshold coefficient. If so, determine whether the traffic density coefficient of the adjacent monitoring lane interval is greater than the set second density coefficient threshold. If not, continue to determine whether the traffic update coefficient is less than the set vehicle update threshold coefficient. When the pedestrian traffic density is greater than the set pedestrian traffic density threshold and the vehicle traffic density is greater than the set vehicle traffic density threshold, determine whether the traffic update coefficient is less than the set comprehensive update threshold coefficient. If so, determine whether the traffic density coefficient of the adjacent monitoring lane interval is greater than the set second density coefficient threshold. If not, continue to determine whether the traffic update coefficient is less than the set comprehensive update threshold coefficient.

7. The traffic management auxiliary perception method based on radar image information fusion according to claim 1 is characterized in that: The process of sensing, monitoring, identifying and tracking moving targets is as follows: Based on the monitoring data, feature extraction is performed on the moving targets that enter the lane section to be monitored or the lane section adjacent to the monitored lane section, and a pedestrian feature matching data set and a vehicle feature matching data set are obtained and stored; Based on the set matching cycle, feature extraction is performed on the moving target in the monitored lane section or the adjacent monitored lane section, a pedestrian feature data set and a vehicle feature data set are obtained, and the pedestrian feature data set and the vehicle feature data set are matched with the pedestrian feature matching data set and the vehicle feature matching data set; Based on the matching results, the moving targets are identified and tracked, and the moving pedestrians and moving vehicles in the lane section to be monitored or the adjacent monitoring lane section are determined. The moving pedestrians and moving vehicles in the lane section to be monitored are used as the analysis basis for the traffic density coefficient of the monitoring lane section, and the moving pedestrians and moving vehicles in the adjacent monitoring lane section are used as the analysis basis for the traffic density coefficient of the adjacent monitoring lane section.

8. The traffic management auxiliary perception method based on radar image information fusion according to claim 7 is characterized by: The pedestrian feature data set includes a facial feature data set, a head feature data set and a clothing feature data set, the pedestrian feature matching data set includes a facial feature matching data set, a head feature matching data set and a clothing feature matching data set, the pedestrian feature data set and the pedestrian feature matching data set are matched to obtain a pedestrian matching coefficient, the pedestrian matching coefficient is used as a basis for identifying and tracking moving targets, and is also used as a basis for analyzing traffic update coefficients; The vehicle feature data set and the vehicle feature matching data set are matched to obtain a vehicle matching coefficient, which is used as a basis for identifying and tracking moving targets and also as a basis for analyzing traffic update coefficients.

9. The traffic management auxiliary perception method based on radar image information fusion according to claim 8 is characterized in that: The facial feature matching data set includes the facial occluder area, occluder curvature and occluder curvature angle, the head feature data set includes the distance between eyebrows, lip width and the distance from upper lip to eyebrows, and the clothing feature data set includes the width value of tops and the curvature of the neckline; The facial feature matching data set includes facial occluder matching area, occluder matching curvature and occluder matching curvature angle; the head feature matching data set includes glabellar matching distance, matching lip width and upper lip to glabellar matching distance; the clothing feature matching data set includes top matching width value and neckline matching curvature; If the facial occlusion area is smaller than the set facial occlusion area threshold, the pedestrian matching coefficient is obtained based on the head feature data set and the clothing feature data set as well as the head feature matching data set and the clothing feature matching data set. If the facial occlusion area is larger than the set facial occlusion area threshold, the pedestrian matching coefficient is obtained based on the facial feature data set and the clothing feature data set as well as the facial feature matching data set and the clothing feature matching data set. The vehicle feature data set includes a windshield area and a vehicle HSV value, and the vehicle feature matching data set includes a windshield matching area and a vehicle HSV matching value.

10. A traffic management auxiliary perception method and device based on radar image information fusion, characterized in that: It includes a mobile target perception monitoring module, a monitoring and early warning module for the lane interval to be monitored, a traffic update monitoring module for the lane interval to be monitored, and a monitoring and early warning module for the adjacent monitoring lane interval, among which: The mobile target sensing and monitoring module is used to fuse the monitoring data with the radar image information, sense and monitor the mobile targets in the lane section to be monitored, and identify and track the mobile targets in the lane section to be monitored; The monitoring and early warning module for the lane interval to be monitored is used to determine the traffic density coefficient of the lane interval to be monitored in the current monitoring cycle based on the mobile target of the lane interval to be monitored that is identified and tracked, and to judge whether the traffic density coefficient of the lane interval to be monitored in the current monitoring cycle is greater than a set first density coefficient threshold value, if not, to continue to judge whether the traffic density coefficient of the lane interval to be monitored in the next monitoring cycle is greater than the set first density coefficient threshold value, and if so, to issue a traffic jam early warning; The traffic update monitoring module for the lane interval to be monitored is used to obtain the traffic update coefficient of the lane interval to be monitored in the current monitoring cycle, and to determine whether the traffic update coefficient of the current monitoring cycle is less than the set traffic update threshold coefficient. If so, perception monitoring of the adjacent monitoring lane interval is performed. Otherwise, when the traffic density coefficient of the lane interval to be monitored in the next monitoring cycle is greater than the set first density coefficient threshold, it is determined whether the traffic update coefficient of the next monitoring cycle is less than the set traffic update threshold coefficient. The adjacent monitoring lane interval monitoring and early warning module is used to identify and track moving targets in the adjacent monitoring lane interval based on the perception monitoring of the adjacent monitoring lane interval, and determine the traffic density coefficient of the adjacent monitoring lane interval in the current monitoring cycle, and judge whether the traffic density coefficient of the adjacent monitoring lane interval in the current monitoring cycle is greater than the set second density coefficient threshold. If so, a first-level serious warning of traffic congestion is issued. If not, it is judged whether the traffic update coefficient of the adjacent monitoring lane interval in the current monitoring cycle is less than the set traffic update threshold coefficient. If so, a second-level serious warning of traffic congestion is issued. If not, when the traffic density coefficient of the lane interval to be monitored in the next monitoring cycle is greater than the set first density coefficient threshold and the traffic density coefficient of the adjacent monitoring lane interval in the next monitoring cycle is greater than the set second density coefficient threshold, it is judged whether the traffic update coefficient of the adjacent monitoring lane interval in the next monitoring cycle is less than the set traffic update threshold coefficient.

Citation Information

Patent Citations

  • A regional vehicle density estimation method based on a dynamic sampling mechanism and an RBF neural network

    CN109886126A

  • Vehicle queuing length real-time detection method based on millimeter wave radar and camera association

    CN115629385A

  • Dynamic bus lane management and control method and system

    CN117975725A

  • Road traffic information management system for g using camera and radar

    KR1020160062880A

  • Vehicle control device, vehicle control system and traffic control system

    US20130138320A1

Cited By

  • Traffic management auxiliary perception system based on radar image information fusion

    CN120748212A