Road traffic abnormal condition detection system and method

Abstract

The invention relates to the field of road traffic management, and discloses a road traffic abnormal condition detection system and method, and the method comprises the steps: extracting a road monitoring region through semantic segmentation in a road monitoring video image, and obtaining a continuous traffic observation frame sequence; performing cross-frame multi-target tracking on the vehicle targets in the frame sequence, and constructing a corresponding vehicle motion state time sequence vector; based on the time sequence vector, traffic flow evolution characteristics are extracted by adopting a trajectory aggregation algorithm, and an abnormal behavior mode is identified; aiming at the detected abnormal behavior area, constructing a graph neural network model by combining a time-space relationship between vehicles, and analyzing local mutation nodes of a traffic interaction structure; judging whether a macroscopic traffic abnormal event exists or not according to an output result of the graph neural network; and if the traffic abnormal event exists, generating a traffic abnormal distribution thermodynamic diagram on a map according to the type, the duration and the coverage range of the identified traffic abnormal event. The method has the advantage that the intelligent level and the reliability of the detection system are improved.

Description

Technical Field

[0001] The present invention relates to the field of highway traffic management, and particularly to an abnormal condition detection system and method for highway traffic. Background Art

[0002] At present, in the field of highway traffic management, the detection of traffic abnormal conditions is widely applied to multiple links such as traffic control, emergency response, and information release. Traditional abnormal detection methods usually judge based on fixed thresholds of traffic parameters. For example, whether there is congestion or other abnormal conditions is judged by whether the vehicle speed, flow, or density is lower than a certain set value. This method is simple to implement and has a small amount of calculation, and was widely used in traffic monitoring systems in the early stage. However, with the continuous expansion and complexity of the traffic system, the traffic operation characteristics of different sections at different time periods show significant differences. The traditional fixed-threshold judgment method is difficult to dynamically adjust according to the specific traffic environment and has poor adaptability. Especially during the morning and evening rush hours or when emergencies occur, the traffic parameters fluctuate frequently. If static thresholds are still used, problems such as false alarms or missed alarms are likely to occur, seriously affecting the accuracy and practicability of traffic abnormal detection. Therefore, it is necessary to design an abnormal condition detection system and method for highway traffic that improves the intelligent level and reliability of the detection system. Summary of the Invention

[0003] (I) Technical Problems to be Solved Aiming at the deficiencies of the prior art, the present invention provides an abnormal condition detection system and method for highway traffic, which has the advantages of being able to dynamically adjust detection parameters according to different sections and times and adapting to traffic flow changes, and solves the problems in the above background art.

[0004] (II) Technical Solutions To achieve the above object of being able to dynamically adjust detection parameters according to different sections and times and adapting to traffic flow changes, the present invention provides the following technical solutions: An abnormal condition detection method for highway traffic, comprising the following steps: Through semantic segmentation in road monitoring video images, extract the road monitoring area to obtain a continuous traffic observation frame sequence; Perform cross-frame multi-object tracking on vehicle targets in the frame sequence, and combine the motion trajectory, target size, and occlusion situation to construct a corresponding vehicle motion state time series vector; Based on the time series vector, adopt a trajectory aggregation algorithm to extract traffic flow evolution features and identify abnormal behavior patterns; For the detected abnormal behavior area, combine the spatio-temporal relationship between vehicles to construct a graph neural network model and analyze local mutation nodes of the traffic interaction structure; According to the output result of the graph neural network and combined with the change trend of the global structure entropy in the traffic image, judge whether there is a macroscopic traffic abnormal event; If it exists, according to the type, duration, and coverage of the identified traffic anomaly event, generate a traffic anomaly distribution heat map on the map and output event labels for traffic dispatching response.

[0005] Preferably, the process of constructing the corresponding vehicle motion state time series vector is as follows: For each frame of the image after semantic segmentation, apply an object detection algorithm to detect all vehicle targets in the image, extract the bounding box, confidence level, and class label of each vehicle, generate a preliminary vehicle detection result, extract multi-dimensional feature information for each detected vehicle target, and based on the above object features, use a multi-object tracking algorithm to match the targets in the current frame and the previous frame, and assign consistent target IDs.

[0006] Preferably, for each vehicle target with a continuous ID, based on its state changes in consecutive frames, construct the following motion state time series vector, and the formula is: ; In the formula, is the center coordinate of the vehicle at the t-th frame, is the speed estimated based on the position change of adjacent frames, is the acceleration estimated by the speed change rate, is the width and height of the vehicle target, is the occlusion state flag.

[0007] Preferably, the process of identifying abnormal behavior patterns is as follows: Receive the motion state time series vectors of each vehicle in consecutive frames constructed in the previous stage. The vector set of multiple vehicles constitutes a description of the traffic flow state within a time window. Use a trajectory aggregation algorithm to perform pattern extraction and clustering on the time series trajectories of multiple vehicles.

[0008] Preferably, the process of analyzing local mutation nodes of the traffic interaction structure is as follows: In the abnormal behavior area detected in the trajectory aggregation analysis, extract the set of vehicle targets active within a specific time window in this area, denoted as: , each vehicle contains a motion state time series vector and spatial position information. Use the vehicle as a node of the graph, establish an edge connection between each pair of vehicles with potential interaction relationships, construct a spatio-temporal interaction graph, construct a graph neural network model, and perform embedding and analysis on the traffic graph.

[0009] Preferably, the process of determining whether there is a macroscopic traffic anomaly event is as follows: Divide the entire road monitoring area into several sub-regions, extract the structural information of the vehicle distribution in each frame of the image, and based on the extracted image spatial structure features, calculate the structural entropy value reflecting the orderliness and balance of the traffic state.

[0010] Preferably, the process of generating a traffic anomaly distribution heat map on a map is as follows: After completing the macroscopic traffic anomaly recognition, the anomaly event information is structured and sorted, the anomaly events are located in the actual map coordinate system, an anomaly heat map is generated on an electronic map or a traffic road network map, the recognized anomaly event areas are assigned heat values, and color gradients are used to represent different heat areas.

[0011] An abnormal condition detection system for highway traffic includes: A road area extraction module that automatically identifies the monitoring area in a road monitoring video through semantic segmentation and extracts a continuous traffic image frame sequence; A target tracking module that performs multi-target tracking on vehicle targets in the video and generates a time series vector containing motion trajectories and states; An anomaly recognition module that extracts traffic flow evolution features based on vehicle motion time series data and recognizes potential abnormal behaviors; A graph neural network analysis module that establishes a graph structure by combining the spatio-temporal relationships of vehicles and recognizes local mutation nodes in traffic interactions; A scheduling response module that generates a heat map and event labels based on the comprehensive anomaly analysis results to support traffic scheduling and emergency response.

[0012] (III) Beneficial effects Compared with the prior art, the present invention provides an abnormal condition detection system and method for highway traffic, having the following beneficial effects: By combining semantic segmentation, target tracking and a graph neural network model, the present invention realizes multi-level anomaly recognition from microscopic vehicle behaviors to macroscopic traffic structures, significantly improving the accuracy and stability of traffic anomaly detection. Through multi-target tracking and motion state modeling, it effectively addresses complex scenario problems such as occlusion and perspective changes, improving the robustness of the system in the actual road environment. By using the trajectory aggregation and structural entropy analysis method, it can dynamically extract traffic flow evolution features, recognize the behavior patterns during the abnormal change process, and meet the requirements of real-time response. By combining local behavior analysis and global structural change trends, it can not only recognize individual anomalies, but also recognize macroscopic traffic anomaly phenomena such as group congestion and emergencies. Generating a traffic anomaly distribution heat map and event labels can intuitively present the scope of the anomaly impact, providing an efficient and operable basis for traffic management departments for scheduling and guidance. It can continuously adapt to different roads, time periods and traffic states, reduce the dependence on artificially set thresholds, and improve the intelligent level of the system. Description of the drawings

[0013] Figure 1 It is a schematic diagram of the method of the present invention; Figure 2 It is a schematic diagram of the structure of the present invention. Detailed implementation manners

[0014] The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0015] Embodiment 1 Please refer to Figure 1 As shown, an abnormal condition detection method for road traffic according to an embodiment of the present invention includes the following steps: S1: Through semantic segmentation in the road monitoring video image, extract the road monitoring area to obtain a continuous traffic observation frame sequence.

[0016] From the video stream collected by the road monitoring camera, extract video image frames at a fixed frame rate (such as 5 frames per second) to form an original image sequence, which serves as the basic data for subsequent processing. Input each frame of the image into a pre-trained deep semantic segmentation model (such as DeepLabV3+, SegNet or BiSeNet) to classify the pixel-level regions in the image and identify semantic categories such as "lane lines", "motor vehicle lanes", "non-motor vehicle lanes", "pedestrian areas", "background", etc. According to the pixel regions belonging to the "motor vehicle lane" or "lane line" categories in the semantic segmentation results, extract the effective monitoring areas actually used for traffic detection in this frame of the image, and remove the image parts irrelevant to traffic detection (such as sky, buildings, sidewalks, etc.). Generate a road area mask (Mask) of the same size as the original image, and perform pixel-level fusion with the original image, retaining the image content within the road area and setting the remaining areas to black or transparent for subsequent object detection and tracking. Number and timestamp each processed frame of the image, and organize them into a continuous traffic observation frame sequence in chronological order as the input data for traffic target detection and status analysis.

[0017] Precisely extract the road monitoring area through semantic segmentation, effectively exclude the interference of non-traffic-related areas in the image, and significantly improve the accuracy of subsequent vehicle detection and tracking. Adopt semantic segmentation technology to adapt to monitoring scenarios under different weather, lighting conditions and complex backgrounds, ensure that the traffic monitoring area is always accurately identified, and improve the stability and robustness of the system in various road environments. After performing semantic masking on the image, only perform subsequent processing on the effective area of the road, reduce the computational burden of irrelevant areas, and improve the operating efficiency and real-time response ability of the entire system. The generation of consecutive frame sequences provides a complete and continuous time-dimensional input for modeling the motion state of subsequent vehicle targets, helps accurately capture changes in vehicle trajectories, and identify abnormal behavior patterns. Introduce the semantic understanding ability of deep learning into traditional traffic monitoring, realize the upgrade from "pixel-level image perception" to "semantic-level traffic cognition", and provide a higher-level and more refined perception ability for traffic anomaly detection.

[0018] S2: Perform cross-frame multi-object tracking on vehicle targets in the frame sequence, and combine the motion trajectory, target size, and occlusion situation to construct the corresponding temporal vector of the vehicle motion state.

[0019] For each frame image after semantic segmentation processing, apply an object detection algorithm to detect all vehicle targets in the image, extract information such as the bounding box, confidence level, and class label of each vehicle, and generate preliminary vehicle detection results. Extract multi-dimensional feature information for each detected vehicle target, including but not limited to: spatial position (center point coordinates, bounding box size), appearance features (color histogram, texture features), vehicle size and class, detection confidence level. These features are used as the representation of the target in the current frame for subsequent cross-frame association. Based on the above target features, use a multi-object tracking algorithm to match the targets in the current frame and the previous frame, assign consistent target IDs, and achieve continuous tracking of vehicles in the frame sequence. In the case of occlusion, separation, and re-occurrence, combine Kalman filter prediction and Re-ID re-identification module to improve the coherence and robustness of vehicle tracking. For each vehicle target with a continuous ID, based on its state changes in consecutive frames, construct the following temporal vector of the motion state, and the formula is: ; In the formula, is the center coordinate of the vehicle at the t-th frame, is the speed estimated based on the position change between adjacent frames, is the acceleration estimated by the rate of change of speed, is the width and height of the vehicle target, is the occlusion state flag.

[0020] Structurally store the state vectors of each vehicle target within the entire observation window for subsequent traffic behavior modeling, trajectory aggregation, and anomaly recognition analysis.

[0021] Through cross-frame multi-object tracking technology, it is possible to continuously track the identity consistency of each vehicle in a continuous image sequence, avoiding tracking interruptions caused by target loss, occlusion, or re-identification errors between frames, and improving the integrity and stability of tracking. By constructing the temporal vector of the motion state of the vehicle in consecutive frames, the dynamic change characteristics such as its speed, acceleration, and trajectory curvature can be reflected in real time, providing a fine time series basis for subsequent identification of abnormal motion behaviors. Introducing the analysis of target size change and occlusion status effectively improves the tracking accuracy of the system in complex traffic scenarios and reduces the risk of mis-identification or missed-identification caused by occlusion. Using the temporal vectors of multiple vehicles as input, it can be used to construct an evolution trajectory map of the overall traffic flow, realizing group behavior modeling such as abnormal pattern recognition, mutation detection, and traffic flow analysis, and improving the perception ability of the overall traffic operation state. The constructed temporal vector can be used as the feature input of the nodes in the subsequent graph neural network, facilitating the excavation of complex traffic patterns from the interaction relationships between vehicles and promoting the transition of anomaly detection from single-vehicle level to group level and structural level.

[0022] S3: Based on the temporal vector, use the trajectory aggregation algorithm to extract the evolution characteristics of the traffic flow and identify abnormal behavior patterns.

[0023] Receive the temporal vector of the motion state of each vehicle in consecutive frames constructed in the previous stage. The vector set of multiple vehicles constitutes a description of the traffic flow state within a time window. Use the trajectory aggregation algorithm to perform pattern extraction and clustering on the temporal trajectories of multiple vehicles, including: Density-based trajectory clustering: Identify subgroups with different motion patterns but high spatial density; Feature-based trajectory vector embedding and clustering: Embed complex trajectory features into a low-dimensional space and then perform clustering; Trajectory shape matching: Used to compare the consistency of motion paths; Autoencoder / Transformer trajectory compression modeling: Extract implicit traffic flow features.

[0024] These aggregation results can reflect the "typical motion patterns" in the local area.

[0025] Based on trajectory aggregation, calculate the evolution characteristic indicators of traffic flow, including: local trajectory density changes; number of vehicles in the same direction / different directions; average speed and acceleration fluctuations; trajectory characteristics such as sudden stops and reverse driving. Input the above evolution characteristics into anomaly detection models, such as rule bases, anomaly clustering detection, and time series anomaly detection models (such as LSTM-AE, AutoEncoder, Isolation Forest), to identify whether there are abnormal behavior patterns, such as sudden stops, vehicles driving in reverse, local abnormal aggregation / congestion, and irregular lane crossings.

[0026] Using trajectory aggregation algorithm to cluster the time series vectors of a large number of vehicles can effectively identify different types of traffic behavior patterns, such as uniform speed, slow speed, vehicle gathering, emergency stop or U-turn, etc., and improve the ability to understand the overall traffic dynamics. By analyzing the trajectory evolution characteristics (such as sudden changes in speed, abnormal movement direction, and sudden increase in trajectory density), abnormal traffic behaviors can be accurately identified, such as emergency stops caused by traffic accidents, vehicle reversal, and sudden congestion, reducing false alarms and missed reports. Aggregation analysis does not rely on the state of a single vehicle, but reflects the overall traffic trend through group trajectory changes, making the system more adaptable to nonlinear fluctuations in traffic characteristics in complex scenarios such as morning and evening rush hours, holidays or bad weather. Compared with the traditional static threshold judgment method, the trajectory aggregation method is based on dynamic behavior changes for analysis, which can perceive and respond to abnormal behaviors as soon as they occur, greatly improving the system's real-time detection capabilities for emergencies. The aggregated abnormal behavior patterns can not only be used to identify traffic anomalies, but also provide structured and high-value input data for subsequent graph neural network modeling, heat map visualization, and dispatch instruction formulation modules.

[0027] S4: For the detected abnormal behavior areas, a graph neural network model is constructed based on the spatiotemporal relationship between vehicles to analyze the local mutation nodes of the traffic interaction structure.

[0028] In the abnormal behavior area detected in the trajectory aggregation analysis, the vehicle target set active in the area within a specific time window is extracted and recorded as: Each vehicle contains a time series vector of motion state and spatial position information. The vehicles are used as nodes of the graph, and edges are established between each pair of vehicles with potential interaction relationships to construct a spatiotemporal interaction graph. , where node features include vehicle speed, acceleration, direction of movement, trajectory change trend, time series features, etc. Edge construction strategies include those based on spatiotemporal proximity: such as when the distance between vehicles is lower than the set threshold and the time windows overlap; based on relative speed: such as when there are behaviors such as approaching, following, and avoiding between two vehicles; and edge weights are introduced to reflect the intensity of interaction or potential conflict risks. Build graph neural network models, such as GCN, GAT, or ST-GCN, to embed and analyze traffic maps: Node update mechanism: Integrate the vehicle's own characteristics with the information of neighboring vehicles to learn its dynamic role in the group traffic structure; Edge update mechanism: Reflect the evolution of the interaction intensity over time; Temporal modeling: Incorporate the time dimension into models such as ST-GCN to characterize the evolving characteristics of nodes over time.

[0029] Through the intermediate representation output by the graph neural network, perform structural mutation analysis to identify local mutant nodes. For example: vehicle nodes with sudden changes in motion state, such as a vehicle's speed suddenly dropping to zero; key nodes with abnormal interactions with multiple vehicles, such as "bottleneck vehicles" that may cause chain congestion; local density mutation regions in the graph structure, such as congestion cores; Use an anomaly scoring mechanism to label abnormal nodes or edges. Finally, output the following information for the scheduling system to respond or assist in judgment: the ID of the abnormal interaction node and its position in the graph; the type of anomaly, such as local stagnation, reverse conflict, potential collision; the scope of influence or propagation trend of the anomaly; Anomaly level evaluation value.

[0030] By introducing a graph neural network (GNN) to model the spatio-temporal interaction relationships between vehicles, it is no longer limited to single-vehicle characteristics or global statistical indicators, but can deeply explore potential structural anomalies between vehicle groups, improving the ability to identify complex anomaly patterns, such as chain congestion and intersection blockages. GNN can effectively capture the mutual influence between vehicles, such as following behavior, lane-changing avoidance, and intersection conflicts, realizing the inference from individual anomalies to group anomalies, enabling the system to have the ability to explain and discover "synergistic abnormal behaviors". Through graph structure analysis, it can quickly locate mutant nodes in the traffic interaction network, identify potential congestion sources or conflict focal points, avoid global interference caused by the spread of local anomalies, and effectively improve the timeliness and foresight of traffic scheduling. Compared with analysis methods based on rules or traditional models, graph neural networks have stronger modeling flexibility and generalization ability, can adapt to different types of roads, such as multi-lane, high-speed, intersections, and behavior pattern changes under different traffic densities, and improve the environmental adaptability of the model. The graph structure embedding output by GNN can be used to support downstream tasks, such as traffic state prediction, path optimization, signal scheduling, etc., providing richer and more context-semantic input data.

[0031] S5: According to the output results of the graph neural network and combined with the change trend of the global structural entropy in the traffic image, judge whether there is a macroscopic traffic anomaly event.

[0032] The process of judging macroscopic traffic anomaly events by combining the change trend of the global structural entropy in the traffic image is as follows: For each frame of road monitoring image, based on the vehicle detection and tracking results, extract the position distribution, speed direction, and density information of the vehicles in the current frame; Taking vehicles as nodes and the relative distances and speed differences between vehicles as edge weights, a traffic state graph is constructed; The information entropy of the traffic state graph is calculated to obtain the global structure entropy value corresponding to this frame; The structure entropy is used to measure the orderliness of the vehicle flow state. The more uniform the vehicle distribution and the more consistent the movement direction, the higher the structure entropy; conversely, if the vehicles are dense, the movement is chaotic or stagnant, the structure entropy decreases; The global structure entropy values extracted from several consecutive frames form a time series; The rate of change analysis is performed on this entropy value series to calculate the first-order rate of change and the second-order rate of change of the entropy value (i.e., the speed and acceleration of the change); If the entropy value drops sharply and the entropy rate of change exceeds the normal fluctuation range at several consecutive time points, it indicates that there may be an abnormal traffic flow; The process of setting and determining the abnormal judgment threshold is as follows: Based on the historical entropy change data of the target section at different time periods, an entropy change reference curve under normal traffic conditions is established; Set the entropy drop amplitude threshold and the entropy change rate threshold as the abnormal judgment criteria; If the current entropy change meets any of the following conditions, it is determined that there is a macroscopic traffic abnormal event: The current entropy value is lower than a certain proportion of the historical average entropy value (such as lower than 85%); The rate of entropy value drop exceeds the maximum rate of normal fluctuation; The entropy change trend continues to be abnormal for more than the set time threshold (for example, it drops continuously for 5 minutes); The process of comprehensive judgment combined with the results of the graph neural network is as follows: The abnormal nodes in the local traffic area are identified by the graph neural network and fused with the global structure entropy change results; When the number of local graph mutation nodes increases significantly and the global entropy change trend shows an abnormality synchronously, it is finally determined that there is a macroscopic traffic abnormality.

[0033] When judging whether there is a macroscopic traffic abnormal event, if there is no macroscopic traffic abnormal event, it meets one or more of the following conditions: The global structure entropy change is within the normal fluctuation range: the global structure entropy values of the extracted consecutive frame traffic images change smoothly, and the rate of change does not exceed the normal fluctuation threshold set based on historical data; even if the entropy value drops or rises, it is still within the acceptable range of normal traffic flow, without abnormal violent fluctuations.

[0034] There are no mutation nodes in the local traffic interaction structure: In the traffic interaction graph obtained by graph neural network analysis, the spatio-temporal relationship changes between nodes conform to the normal evolution pattern, and no significant local aggregation, breakage, or abnormal path reconstruction phenomena are detected; parameters such as the relative movement and spacing change between vehicles remain continuous and stable, without large-scale mutations.

[0035] Local anomalies do not reach the macroscopic level: Even if individual vehicle anomalies (such as sudden stops, U-turns, etc.) are detected, their influence range is limited to a very small local area and does not cause significant disturbances to the overall traffic flow structure; the change in global structural entropy is minimally affected by local disturbances, and the overall traffic system still maintains a stable operating state.

[0036] The time of abnormal change is not sufficient to constitute a macroscopic event: The entropy value drops or the local structure mutation lasts for a short time (for example, less than the set minimum abnormal duration threshold, such as within 2 minutes), which belongs to instantaneous disturbance or self-recovery phenomena; no persistent congestion, traffic interruption, or long-term traffic flow anomalies occur.

[0037] The entropy change trend and local mutations do not occur synchronously: If the global entropy change and local node mutations do not occur within the same time window, that is, the graph neural network outputs an anomaly but the entropy is stable, or the entropy is abnormal but the graph does not show mutations, it is judged that there is no macroscopic traffic anomaly event.

[0038] In the previous graph neural network model analysis, the abnormal node information and graph structure embedding features in the local area have been output, including the number, distribution, and abnormal score of abnormal nodes; the characteristics of structural mutations in sub-regions of the graph; the time series change trend, such as the continuous growth of abnormal nodes, etc. Based on the traffic observation frame sequence, the entire road monitoring area is divided into several sub-regions, and the structural information of vehicle distribution in each frame of image is extracted, such as: vehicle density and arrangement uniformity in each sub-region; connectivity and breakage of traffic flow between road sections; local graph clustering degree and vehicle aggregation degree. Based on the extracted image spatial structure features, the structural entropy value reflecting the orderliness and balance of traffic states is calculated, including: Shannon entropy: Measures the distribution uncertainty of vehicles between different sub-regions; Clustering entropy: Reflects whether vehicles are concentrated in a certain local area; Entropy change rate: Reflects the speed and degree of structural mutations, and the formula is: ; In the formula, is the probability that a vehicle appears in the i-th sub-region.

[0039] By continuously calculating the structural entropy value for multiple time slices to form an entropy change sequence and analyzing the change trend: a sharp drop in the structural entropy indicates a sudden increase in the degree of vehicle aggregation, which may be severe congestion or an emergency; a drastic fluctuation in the structural entropy may be due to random vehicle driving and disordered distribution, reflecting an unstable traffic state; a high local entropy and a low overall entropy indicate the existence of an abnormal traffic bottleneck in a specific section. The local structural mutation information identified by the graph neural network is fused and analyzed with the change trend of the structural entropy. If sudden node aggregation occurs in a certain area and is accompanied by a sharp drop in the global entropy, it is determined as a macroscopic congestion event; if the abnormal amplitude of the entropy change exceeds the set threshold and is combined with the abnormal structure pattern of the graph neural network, it is determined as a macroscopic traffic anomaly. The determination result is converted into structured abnormal information, including the type of abnormal event, such as large-scale congestion, distribution disorder, traffic break; the covered area and the central section; the start and end times, the duration; the severity score, such as based on the entropy drop rate and the graph anomaly density; and output to the traffic dispatching system or the visualization interface for subsequent response mechanisms to use.

[0040] By combining the high-dimensional expression of local structural anomalies by the graph neural network with the change trend of the global structural entropy, an effective transition from microscopic abnormal features to macroscopic traffic states is achieved, enabling more accurate identification of large-scale traffic abnormal events such as congestion and blockage. As an indicator to measure the order degree of the traffic system, the structural entropy can reflect the real-time change of the spatial distribution of vehicles in the road network. Combining the node anomaly analysis of the graph model helps to quickly discover early signals such as systematic disturbances and local anomaly diffusion, improving the timeliness of response. Compared with traditional methods based on fixed rules or single-parameter judgment, the dynamic analysis combined with the structural entropy can adapt to traffic scenarios with different densities and layouts and still maintain stable detection performance in complex structures such as intersections, main and auxiliary roads, and elevated-ground transitions. The change trend of the entropy value can reflect the evolution process of the traffic state from order to disorder or from disorder to stability. Combining the dynamic characteristics of the graph structure helps to analyze the starting position, diffusion path, and development trend of traffic anomalies, providing a decision-making basis for emergency dispatching and intervention. This process realizes the collaborative modeling of the graph model (structural layer) and the image content (pixel layer), promotes the transformation of image semantic understanding into structured knowledge expression, and lays a foundation for building a higher-level traffic intelligent perception system.

[0041] S6: If it exists, generate a traffic anomaly distribution heat map on the map according to the type, duration, and coverage of the identified traffic anomaly event, and output event labels for traffic dispatching response.

[0042] After completing the identification of macroscopic traffic anomalies, the anomaly event information is structured and organized, including the following fields: anomaly type, such as severe congestion, traffic interruption, suspected accident, traffic disorder, etc.; start time and end time; the area covered by the anomaly event, including the starting and ending road segments, geographical coordinate boundaries, polygon areas or grid cells; anomaly intensity level, based on comprehensive index scores such as graph anomaly density and entropy change amplitude; traffic impact indicators, such as average speed reduction, vehicle detention time, degree of reduction in regional traffic capacity, etc. Locate the anomaly event in the actual map coordinate system. The process includes mapping the pixel-level position information output by the surveillance video or graph neural network into longitude and latitude coordinates; performing spatial projection on the anomaly impact area, such as converting it into the form of GIS grid or polygon; if using multi-source data, perform coordinate alignment processing on the spatial benchmarks of different sources. Based on the above spatial information, generate an anomaly heat map on the electronic map or traffic road network map, assign heat values to the identified anomaly event areas, and use color gradients to represent different heat areas, such as red for severe anomalies and yellow for moderate anomalies. The system automatically generates event tags according to the characteristics of the event and outputs them to the traffic dispatching system. The tags include but are not limited to: Tag name: such as severe congestion on the main road, suspected accident of multiple vehicle rear-end collisions, signal control anomaly at intersections, etc.; Location: Display location marking points and coverage boundaries through the map interface; Level: Divided into mild, moderate, and severe; Emergency suggestions: such as suggesting traffic flow restriction and detour, signal priority control, releasing guidance information, etc.; Unique event ID: Used for subsequent tracking, correlation analysis, or response records.

[0043] Push the above tags and heat map information to the traffic management platform; trigger response mechanisms, such as releasing information on the induction screen, switching signal control strategies, dispatching police resources, pushing early warning information to the user side, etc.; and support comparison with historical events to achieve event archiving and response efficiency evaluation.

[0044] By generating a heat map of traffic anomaly distribution on the map, traffic management personnel can intuitively grasp the distribution, severity, and evolution trend of abnormal events in the geographical space, improving the perception efficiency and understanding depth of complex traffic situations. Combining the type, duration, and coverage of abnormal events to output label information can quickly trigger matching dispatching strategies or emergency mechanisms, such as induced diversion, signal timing adjustment, on-site disposal plans, etc., to achieve rapid intervention and control of traffic anomalies. Different types of traffic anomalies are classified and labeled and layer-managed, which helps to accurately analyze events, prioritize them, and schedule resources, improving the systematic and collaborative efficiency of anomaly management. The label information and spatial distribution results of abnormal events can be stored for a long time for subsequent event comparison, pattern recognition, and traffic policy evaluation, providing data support for intelligent transportation planning and big data decision-making. Pushing the generated heat map and label results to the public information service platform can realize more targeted travel suggestions and route recommendations, optimizing the overall traffic operation efficiency and user experience.

[0045] Embodiment 2 Please refer to Figure 2 As shown, an abnormal condition detection system for highway traffic according to an embodiment of the present invention includes: An abnormal condition detection system for highway traffic includes: A road area extraction module automatically identifies the monitoring area in the road monitoring video through semantic segmentation and extracts a continuous sequence of traffic image frames; A target tracking module performs multi-target tracking on vehicle targets in the video to generate a time series vector containing motion trajectories and states; An anomaly recognition module extracts traffic flow evolution features based on vehicle motion time series data to identify potential abnormal behaviors; A graph neural network analysis module establishes a graph structure by combining the spatio-temporal relationships of vehicles to identify local mutation nodes in traffic interactions; A dispatching response module generates a heat map and event labels based on the comprehensive anomaly analysis results to support traffic dispatching and emergency response.

[0046] It should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not expressly listed, or also includes elements inherent to such process, method, article or device.

[0047] Although embodiments of the present invention have been shown and described, those of ordinary skill in the art will appreciate that various changes, modifications, substitutions and variations can be made to these embodiments without departing from the principles and spirit of the present invention. The scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A method for detecting abnormal conditions of highway traffic, characterized in that: The following steps are involved: Through semantic segmentation in road monitoring video images, the road monitoring area is extracted to obtain a continuous traffic observation frame sequence; Carry out cross-frame multi-target tracking of vehicle targets in the frame sequence, and construct the corresponding vehicle motion state time series vector based on motion trajectory, target size and occlusion; Based on time series vectors, trajectory aggregation algorithm is used to extract traffic flow evolution characteristics and identify abnormal behavior patterns; For the detected abnormal behavior areas, a graph neural network model is constructed by combining the spatiotemporal relationship between vehicles to analyze the local mutation nodes of the traffic interaction structure; According to the output results of the graph neural network and the trend of global structural entropy changes in the traffic image, it is determined whether there are macro traffic anomalies. Among them, the method of judging whether there is a macro traffic abnormal event is: Construct a traffic state diagram and calculate the corresponding global structural entropy; if it is detected that the entropy value drops sharply at multiple consecutive time points and the change rate is abnormal, it is determined that a macro traffic abnormality event has occurred; If any, a traffic anomaly distribution heat map is generated on the map based on the type, duration and coverage of the identified traffic anomaly events, and the event label is output for traffic dispatch response.

2. A method for detecting abnormal conditions of highway traffic according to claim 1, characterized in that: The process of constructing the corresponding vehicle motion state time series vector is: For each frame of image after semantic segmentation processing, the target detection algorithm is applied to detect all vehicle targets in the image, and the bounding box, confidence, and category label of each vehicle are extracted to generate preliminary vehicle detection results. Multi-dimensional feature information is extracted for each detected vehicle target. Based on the above target features, a multi-target tracking algorithm is used to match the targets in the current frame with the previous frame and assign a consistent target ID.

3. A method for detecting abnormal conditions of highway traffic according to claim 2, characterized in that: For each vehicle target with a continuous ID, the following motion state time series vector is constructed based on its state changes in consecutive frames. The formula is: ； In the formula, is the center coordinate of the vehicle in frame t, is the speed estimated based on the position change of adjacent frames, is the acceleration estimated by the rate of change of velocity, are the width and height of the vehicle target, It is the occlusion status indicator.

4. A method for detecting abnormal conditions of highway traffic according to claim 3, characterized in that: The process of identifying abnormal behavior patterns is: The motion state time series vector of each vehicle in continuous frames constructed in the previous stage is received. The vector set of multiple vehicles constitutes a description of the traffic flow state within a time window. The trajectory aggregation algorithm is used to extract and group the time series trajectories of multiple vehicles.

5. A method for detecting abnormal conditions of highway traffic according to claim 4, characterized in that: The process of analyzing the local mutation nodes of the traffic interaction structure is as follows: In the abnormal behavior area detected in the trajectory aggregation analysis, the vehicle target set active in the area within a specific time window is extracted and recorded as: Each vehicle contains a time series vector of motion state and spatial position information. The vehicles are regarded as nodes of the graph. Edge connections are established between each pair of vehicles with potential interaction relationships. A spatiotemporal interaction graph is constructed, and a graph neural network model is built to embed and analyze the traffic graph.

6. A method for detecting abnormal conditions of highway traffic according to claim 5, characterized in that: The process of judging whether there is a macro traffic abnormality event is as follows: The entire road monitoring area is divided into several sub-areas, and the structural information of vehicle distribution in each frame image is extracted. Based on the extracted image spatial structural features, the structural entropy value reflecting the orderliness and balance of the traffic state is calculated.

7. A method for detecting abnormal conditions of highway traffic according to claim 6, characterized in that: The process of generating a heat map of traffic anomaly distribution on a map is as follows: After completing the macro-traffic anomaly identification, the abnormal event information is structured and organized, the abnormal events are located in the actual map coordinate system, an abnormal heat map is generated on the electronic map or traffic network map, the identified abnormal event areas are assigned heat values, and color gradients are used to represent different heat areas.

8. A road traffic abnormality detection system, applied to a road traffic abnormality detection method as claimed in any one of claims 1 to 7, characterized in that: include: The road area extraction module automatically identifies the monitoring area in the road monitoring video through semantic segmentation and extracts a continuous traffic image frame sequence; The target tracking module tracks multiple vehicle targets in the video and generates a time series vector containing motion trajectories and states; The anomaly recognition module extracts traffic flow evolution characteristics based on vehicle movement time series data and identifies potential abnormal behaviors; The graph neural network analysis module combines the spatiotemporal relationship of vehicles to establish a graph structure and identify local mutation nodes in traffic interactions; The dispatch response module generates heat maps and event labels based on the results of abnormal analysis to support traffic dispatch and emergency response.

Images