Computer vision-based park intelligent monitoring system

Abstract

The application discloses a park intelligent monitoring system based on computer vision, relates to the technical field of computer vision and intelligent monitoring, collects multiple camera video image frames, and constructs a cross-camera spatial synchronous video stream graph; through semantic segmentation and optical flow estimation, static structure features and dynamic change features are extracted, and a multi-modal scene structure feature vector is generated; an inter-frame micro-motion evolution path graph is constructed, a micro-change motion set of a target and an abnormal behavior candidate sequence are extracted; micro-motion co-occurrence frequencies are calculated, and a multi-target behavior coupling graph is constructed; abnormal behaviors are identified in stages based on a behavior scoring model, and a linkage response is triggered; the application realizes accurate capture and risk identification of fine-grained behavior changes, and improves the intelligence, real-time performance and safety prevention and control capability of the monitoring system in a complex park environment.

Description

Technical Field

[0001] This invention relates to the field of computer vision and intelligent monitoring technology, specifically to a computer vision-based intelligent monitoring system for industrial parks. Background Technology

[0002] As industrial parks continue to expand, traditional video surveillance systems face numerous challenges in terms of the real-time nature, accuracy, and proactivity of event detection. Current park monitoring primarily relies on a combination of numerous cameras and manual patrols, using target detection and behavior recognition algorithms to identify abnormal behavior. However, this approach has limited ability to capture "micro-movements," "abnormal interactive behaviors," and "precursor states" in emergencies, especially in multi-person scenarios, heavily obstructed environments, or low-light conditions. These systems are prone to false positives or false negatives, leading to delayed emergency response and failing to meet the actual needs of high-security parks.

[0003] In addition, existing systems generally use single-frame image analysis technology, which lacks the ability to model the temporal correlation between multiple frames, making it difficult to accurately predict the evolution trend of target behavior. In terms of target identification, traditional methods rely on facial or body features, which are easily affected by changes in angle and interference from occlusions, and have significant limitations.

[0004] Even more serious is that in high-risk areas such as hazardous chemical storage areas, high-voltage substations, and semi-enclosed underground parking lots, some early warning signs of safety accidents are only reflected in very brief changes in characteristics in individual frames, such as abnormal lingering of personnel, an increase in the frequency of abnormal turning around, or abnormal placement of items. Traditional systems have difficulty in effectively modeling and judging such "weak suspicious behaviors," and thus it is difficult to achieve early warning and source tracing of potential risks.

[0005] Therefore, there is an urgent need for an intelligent monitoring method that can integrate computer vision, multimodal temporal modeling, and micro-motion aggregation analysis to improve the system's ability to identify fine-grained abnormal behaviors and solve the problems of perception blind spots and early warning delays in existing systems in high-security monitoring scenarios in parks. Summary of the Invention

[0006] The purpose of this invention is to provide a computer vision-based intelligent monitoring system for industrial parks to address the shortcomings of the prior art.

[0007] To achieve the above objectives, the present invention provides the following technical solution: a computer vision-based intelligent monitoring system for industrial parks, comprising:

[0008] Video acquisition module: Acquires video image frame sequences from multiple surveillance cameras within the park at different time periods, and constructs a video stream map that is spatially synchronized across cameras;

[0009] Feature extraction module: Based on the video stream graph, a region segmentation algorithm is used to extract static structural features and dynamic change features from each image frame to generate a multimodal scene structural feature vector;

[0010] Micro-motion modeling module: Input the multimodal scene structure feature vector into the temporal graph convolutional network to construct an inter-frame micro-motion evolution path map and extract the target's micro-change action set and abnormal behavior candidate sequence in consecutive frames;

[0011] Frequency map construction module: Based on the inter-frame micro-motion evolution path map, calculate the co-occurrence frequency map of micro-motions of each target within the historical time window, and construct a multi-target behavior coupling map;

[0012] Abnormal Behavior Analysis Module: Based on the multi-target behavior coupling map, construct an abnormal behavior scoring model, perform risk scoring and clustering classification on abnormal interaction behaviors between targets, and identify potential security risk behaviors;

[0013] Intelligent linkage acquisition module: Based on the risk score results, it automatically generates a microscopic observation feature coordinate system in high-risk areas, and controls the camera to adjust its angle and focal length, and performs high-frequency image acquisition and local fine-grained recognition analysis on key targets.

[0014] Response module: Compares the analysis results with the preset security behavior template library, outputs the abnormal behavior level assessment results, and triggers the response strategy.

[0015] Preferably, constructing a cross-camera spatially synchronized video stream atlas includes the following steps:

[0016] The system collects a sequence of video image frames continuously captured by fixed-view surveillance cameras deployed in different areas of the park within a preset time period; timestamps are aligned between different video image frames based on the spatial location information and time synchronization signals of each camera; target correspondence is calculated for image frames within the coverage area of ​​adjacent cameras using a feature point matching algorithm, and a target trajectory association model is constructed between cameras; a video stream map under unified spatial coordinates is generated based on the continuity of the target trajectory and scene structure information.

[0017] Preferably, the method of extracting static structural features and dynamic change features from each image frame using a region segmentation algorithm includes the following steps:

[0018] The image frames in the video stream atlas are processed for region segmentation. A pre-trained semantic segmentation model is used to classify road regions, building structure regions and activity regions at the pixel level to generate a static structural region distribution map.

[0019] Based on the static structural region distribution map, inter-frame difference calculation and optical flow field estimation are performed on continuous image frames to extract pixel motion change information of the target in the active region and generate dynamic change feature map.

[0020] Based on the dynamic change feature map and the static structure region distribution map, the target region is subjected to feature weighted fusion calculation to form a scene structure feature set of unified dimension;

[0021] The scene structure feature set is vectorized and encoded in chronological order to generate a multimodal scene structure feature vector.

[0022] Preferably, constructing the inter-frame micro-motion evolution path map includes the following steps:

[0023] The multimodal scene structure feature vectors are used to construct a node graph structure in chronological order, where each frame of the image corresponds to a graph node, and initial edge connections are established between nodes based on their chronological order.

[0024] Based on the feature similarity and time interval between nodes, a Gaussian kernel function is used to calculate the edge weights and construct a weighted time sequence graph structure.

[0025] The weighted temporal graph is input into a joint temporal graph convolutional network containing graph convolutional layers and gated recurrent units to extract the micro-action state transition features between nodes;

[0026] Based on the difference in feature change rate and action vector direction between nodes, an inter-frame micro-motion evolution path map is generated.

[0027] Preferably, the extraction of the target's micro-change action set and anomalous behavior candidate sequence in consecutive frames includes the following steps:

[0028] The difference is calculated on the target feature vectors corresponding to adjacent graph nodes in the inter-frame micro-motion evolution path map. The changes in the target's spatial position, velocity direction and regional semantics at each moment are extracted to form an inter-frame motion difference vector.

[0029] Based on the inter-frame motion difference vector, a sliding time window clustering algorithm is used to identify micro-motion segments with similar change patterns in a continuous frame sequence, and to construct a set of micro-change motions of the target.

[0030] For each micro-motion segment, calculate its rate of change curve and trajectory direction offset value, and compare the deviation with the historical normal behavior template; if the deviation exceeds the set threshold, mark the corresponding frame sequence as an abnormal behavior candidate sequence.

[0031] Preferably, constructing a multi-objective behavior coupling map includes the following steps:

[0032] Based on the inter-frame micro-motion evolution path map, the micro-change action set of each target in the continuous time series is extracted, and the time overlap interval of different target micro-motion segments is counted within a preset historical time window to calculate the number of micro-motion co-occurrences between targets.

[0033] Based on the co-occurrence frequency and the change in spatial distance between targets, normalization is used to calculate the co-occurrence frequency weight of micro-actions between targets, and a correlation weight matrix between targets is constructed.

[0034] Based on the association weight matrix, targets with co-occurrence frequencies higher than a set threshold are connected to generate a multi-target behavior association graph structure.

[0035] Based on the connection strength and temporal continuity between each objective, a multi-objective behavior coupling map is formed.

[0036] Preferably, the risk scoring and clustering classification of abnormal interactions between targets includes the following steps:

[0037] Extract the temporal continuity, co-occurrence frequency weights, and spatial proximity features of each connection edge in the multi-objective behavior coupling graph, and construct a multi-dimensional behavior interaction feature vector.

[0038] The feature vector is input into the behavior anomaly scoring model trained by supervised learning, and the risk score value of each group of target interaction behaviors is output.

[0039] Based on the risk score, density clustering algorithm is used to cluster and classify behavioral samples, dividing them into low-risk, suspicious and high-risk behavior categories;

[0040] Target pairs in high-risk categories are identified and, combined with their spatiotemporal trajectories and semantic regions, are marked as potential security risk behaviors.

[0041] Preferably, the linkage control of the camera to adjust its angle and focus includes the following steps:

[0042] Based on the location of high-risk targets and their semantic regions output by the abnormal behavior scoring model, a microscopic observation feature coordinate system is constructed, which includes information on target location, movement trend, and surrounding structure. Based on the target's velocity direction vector and regional occlusion conditions in the coordinate system, a camera group with the best field of view coverage is selected. The selected cameras are controlled to adjust their pitch angle, horizontal rotation angle, and focal length parameters in real time so that their main field of view is aligned with the target's movement path.

[0043] The technical effects and advantages provided by the present invention in the above technical solution are as follows:

[0044] 1. This invention effectively improves the ability to identify fine-grained abnormal behaviors in complex park environments by introducing multimodal scene structural feature modeling, inter-frame micro-motion evolution path map construction, and multi-target behavior coupling analysis. Especially in multi-person scenes, occluded environments, or low-dynamic behavior backgrounds, it can accurately extract micro-motion differences, behavior correlation frequency, and temporal continuity features, significantly reducing false alarm and false negative rates, and achieving early warning and evolution trend perception of abnormal behaviors.

[0045] 2. This invention constructs a microscopic observation feature coordinate system based on risk scoring, links camera angle and focal length parameters for automated image acquisition, and combines a behavior template comparison mechanism for hierarchical anomaly assessment and response strategy triggering. This not only improves the system's efficiency in dynamically handling high-risk targets, but also realizes the intelligent transformation of park monitoring from "passive observation" to "active intervention," possessing the advantages of high precision, high timeliness, and scalability. Attached Figure Description

[0046] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this invention. For those skilled in the art, other drawings can be obtained based on these drawings.

[0047] Figure 1 This is a flowchart of the system modules of the present invention. Detailed Implementation

[0048] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0049] For examples, please refer to Figure 1 As shown, the computer vision-based intelligent monitoring system for industrial parks described in this embodiment includes:

[0050] Video acquisition module: Acquires video image frame sequences from multiple surveillance cameras within the park at different time periods, constructing a cross-camera spatially synchronized video stream map. Specifically, it includes the following steps:

[0051] Fixed-angle surveillance cameras deployed at park entrances, corridors, perimeter walls, and key material storage locations collect video data at a rate of 25 frames per second, with each frame measuring 1920×1080 pixels. The cameras connect to a unified control server via a local time synchronization protocol, embedding millisecond-accurate timestamps into each frame. The data acquisition process is continuous for a set time period, such as 2 hours, to cover the entire human activity cycle. All image frames are named with "camera number + timestamp" and cached chronologically on edge computing nodes. The acquired data is in H.264 encoded video stream format, subsequently decoded frame-by-frame into raw RGB image frames for later processing.

[0052] Since there are slight time discrepancies between image frames captured by different cameras, a global time calibration method is used to uniformly synchronize all cameras to ensure the accuracy of subsequent frame-level comparison. The specific method is as follows:

[0053] Using Network Time Protocol (NTP) or GPS clock modules, the time error of all camera systems is controlled within ±10 milliseconds;

[0054] Set the synchronization threshold ΔT to 100 milliseconds, which means aligning all image frames captured by the cameras to the nearest 100-millisecond window according to their timestamps;

[0055] If a camera is missing a frame in the current time window, a fitted frame is generated through inter-frame interpolation (based on linear interpolation between consecutive frames) to maintain temporal continuity.

[0056] The final output is a time-synchronized video frame sequence group for use in cross-camera image matching.

[0057] For time-synchronized image frames, target correspondence calculations are performed between images to establish spatial matching relationships for the same target from different camera perspectives. The implementation steps are as follows:

[0058] The Scale Invariant Feature Transform (SIFT) algorithm was used to extract key feature points in each frame of the image, with an average of more than 500 points extracted per frame;

[0059] Bidirectional feature matching is performed on image pairs with overlapping visual areas. The matching distance is measured using Euclidean distance, and the matching threshold is set to 0.6 times the nearest neighbor ratio (Lowe's ratio test).

[0060] The RANSAC algorithm is used to calculate the homography matrix for candidate matching point pairs to eliminate false matches;

[0061] If the number of valid matches is greater than 50 and the fitting error is less than 3 pixels, then the image pair is determined to have a target correspondence.

[0062] Cluster analysis of the spatial location of the same target in multiple frames (DBSCAN algorithm, distance threshold of 30 pixels, minimum number of samples of 5).

[0063] The spatial correspondence of the target under each camera is identified using the clustering results and recorded in the form of "target number + camera number + image frame number + coordinate point";

[0064] Generate a list of target trajectories across cameras to describe the continuous movement path of the target from different viewpoints.

[0065] To achieve spatial uniformity of data from all cameras, the image coordinate system in each camera is converted into a unified world coordinate system, and the following calculation process is performed:

[0066] Each camera is deployed by measuring its installation height, pitch angle, azimuth angle and offset distance from the origin using a total station or lidar, and establishing an external parameter matrix, including the rotation matrix R and translation vector T.

[0067] For any pixel p in the image, first convert it to three-dimensional coordinates in the camera coordinate system using the intrinsic parameter matrix, and then perform three-dimensional spatial transformation using the extrinsic parameter matrix to map it to a point P in the unified world coordinate system.

[0068] Using the continuous position points of the target in a unified world coordinate system as nodes and the timestamp as an index, a three-dimensional space + time trajectory graph structure is constructed;

[0069] Each trajectory edge contains attributes such as target ID, start and end cameras, start and end times, displacement vector, and velocity change;

[0070] Finally, a video stream atlas with "target-time-space" as the three-dimensional main axis is constructed as the basic input structure for downstream micro-motion modeling and anomaly recognition.

[0071] This implementation plan ensures that the spatial trajectory of the same target is uniformly represented from different perspectives, providing accurate data support for the system to realize behavioral pattern analysis and intelligent response decision-making in non-continuous images across cameras.

[0072] Feature extraction module: Based on the video stream graph, a region segmentation algorithm is used to extract static structural features and dynamic change features from each image frame, generating a multimodal scene structural feature vector.

[0073] To achieve joint modeling of static and dynamic features in park video images, and to extract multimodal scene structural feature vectors with spatial structure and behavioral representation capabilities, the following steps are performed:

[0074] Each frame of the constructed video stream atlas is sequentially input into a semantic segmentation neural network pre-trained on a city scene dataset (such as Cityscapes or ADE20K). The specific model used is the DeepLabV3+ network structure, with ResNet-101 as the backbone encoder. Different dilation rates (such as 6, 12, and 18) are set in each dilated convolutional layer to obtain multi-scale receptive fields.

[0075] After performing convolutional feature extraction, dilated spatial pyramid pooling, and upsampling reconstruction on the input image, the semantic category probability value corresponding to each pixel is output, and the category corresponding to the maximum value is the final classification label of the pixel.

[0076] This embodiment unifies semantic categories into the following categories:

[0077] Building structural area (label number 1).

[0078] Road area (label number 2);

[0079] Green areas (label number 3);

[0080] Activity area (label number 4);

[0081] Other unidentifiable areas (label number 0).

[0082] The output is a two-dimensional matrix with the same dimensions as the original image, called the static structure region distribution map, where each pixel value is the category number mentioned above. This distribution map is used to restrict dynamic analysis to occur only in active regions, thereby improving computational efficiency and data accuracy.

[0083] For any two consecutive frames in the video stream graph (e.g., frame t and frame t+1), perform the following two processes in their active region to extract dynamic change features:

[0084] Convert the image to grayscale; calculate the difference between the grayscale values ​​of the pixel at position (x, y) in the two frames, where the difference is defined as... ;like If the value exceeds a set threshold of 30, the pixel position is considered to have changed significantly and is recorded as a dynamic region pixel. In the above difference map, pixels outside the active region are forcibly set to 0 values ​​to avoid background noise interference.

[0085] Within the dynamic region marked by the aforementioned difference map, sparse optical flow calculation based on the pyramid Lucas-Kanade algorithm is performed. This algorithm selects corner points (e.g., Harris corner points) with feature intensities higher than a threshold (e.g., 30) and stable edge responses on each layer of the image pyramid, and tracks the positional changes of these corner points in the next frame through image window matching.

[0086] Each successfully tracked point outputs a two-dimensional displacement vector (Δx, Δy), representing the direction and magnitude of the pixel's movement. All vectors are combined to form an optical flow field map, called a dynamic change feature map, which is used to express the directionality and continuity of the target's micro-movements.

[0087] To integrate static structural information with dynamic behavioral information, the following operations are performed on the targets in each active region:

[0088] Locating the target region: Perform connected component analysis on regions with a movement amplitude greater than 0.5 pixels in the optical flow field map, and extract bounding boxes as candidate target regions;

[0089] Extract static structural features: Within the target bounding box, count the pixel percentage of each semantic category in the static structural region distribution map to form a set of structural feature values ​​(e.g., activity area accounts for 70%, road area accounts for 20%, and green area accounts for 10%).

[0090] Extracting dynamic feature information: Statistically analyze the average magnitude and direction distribution histogram of all optical flow vectors within the target area to obtain motion intensity and directional features.

[0091] Weighted fusion: This method fuses static structural features and dynamic features using a linear weighting approach. The fusion formula is: Feature vector , where α=0.4 and β=0.6, are used to highlight the dominant role of dynamic features in abnormal behavior identification.

[0092] Each target ultimately generates a scene structure feature sub-vector in a unified format. This vector has a length of 128 dimensions and includes fields such as static semantic proportion, average movement amplitude, and directional statistics.

[0093] All target feature sub-vectors extracted from each frame are arranged chronologically to construct a time-series feature set. To capture the changing trend of target behavior across frames, this time series is input into a bidirectional gated recurrent unit neural network (Bi-GRU) for temporal modeling.

[0094] The network input consists of N feature vectors for each frame;

[0095] The Bi-GRU network consists of two layers, each with 128 units, and the activation function is the hyperbolic tangent function.

[0096] The output is a 256-dimensional global scene structure encoding vector synthesized for each frame.

[0097] Ultimately, all time frame encoded vectors are combined to form a multimodal scene structure feature vector sequence, which is used for subsequent micro-motion recognition and behavior anomaly modeling.

[0098] Micro-motion modeling module: Input the multimodal scene structure feature vector into the temporal graph convolutional network to construct the inter-frame micro-motion evolution path map and extract the set of micro-change actions and abnormal behavior candidate sequences of the target in continuous frames.

[0099] To extract subtle motion evolution patterns of monitored targets in consecutive video frames and achieve early identification of potential abnormal behaviors, a time-dependent graph structure is constructed and graph neural network modeling is performed based on the aforementioned generated multimodal scene structure feature vectors. The specific steps include:

[0100] The multimodal scene structure feature vectors in a continuous time series are mapped to nodes in a graph structure, denoted as . ,in For a set of nodes, This is the set of edges. Each graph node v t The 256-dimensional feature vector generated corresponding to the image of frame t represents the encoding result of the scene state at that time point.

[0101] The graph nodes are arranged in chronological order, and edge connections are only allowed between adjacent time frames. A directed edge e is defined between each frame and the frames before and after it. t,t+1 This forms a linear time sequence graph structure. The initial edges are unweighted connections used to construct the graph topology framework.

[0102] To ensure the graph structure accurately reflects the intensity of action changes and feature similarity between frames, edge weighting is necessary. A Gaussian kernel function is used to calculate the edge weights between adjacent nodes. The specific calculation method is as follows:

[0103] For any adjacent graph node v t With v t+1 Calculate its corresponding eigenvector f t with f t+1 The Euclidean distance between them is denoted as D. t Set the standard deviation parameter σ, usually set to 10; edge weight w t,t+1 The Gaussian kernel function is defined as follows: When the difference in eigenvectors is small, the Euclidean distance D t When the difference is small, the weight is close to 1; when the difference is significant, the weight approaches 0. This method is used to strengthen the representation of edges with small micro-action changes, weaken the influence of discontinuous behavior edges, and form a weighted time sequence graph structure.

[0104] A weighted temporal graph structure is input into a joint temporal graph modeling network combining a graph convolutional network and a gated recurrent unit to extract inter-frame state transition patterns. The specific structure is as follows:

[0105] Graph Convolutional Layer Structure Definition: A two-layer Graph Convolutional Neural Network (GCN) is used, with each layer having 256-dimensional input node features and 128-dimensional output features, employing the ReLU activation function;

[0106] Graph convolution operations are performed according to the following formula: the new feature of each node vt is represented by a weighted sum of the features of its neighboring nodes, where the weights are determined by the edge weights w. t,t+1 The decision was made and normalized.

[0107] Gated recurrent unit modeling: The graph convolution output forms a time series vector set, which is fed into a bidirectional gated recurrent unit network (Bi-GRU). The hidden state dimension of each GRU unit is 128.

[0108] The bidirectional structure can capture the changing trend of the target in the direction before and after time, improving the accuracy of micro-motion evolution recognition.

[0109] After joint modeling, each time frame node outputs a set of feature vectors representing the state transition between itself and the preceding and following frames, which are called micro-action state transition features.

[0110] Based on the inter-frame state transition feature sequence output by the graph neural network, a micro-action evolution path map of the target in the temporal dimension is constructed as follows:

[0111] Calculate the rate of change of features: Calculate the first-order difference between any two adjacent state feature vectors, i.e. , representing the rate of change of micro-motion from frame t to frame t+1;

[0112] Determine the change in direction of motion: Calculate Δf t With Δf t+1 If the angle θ between them is greater than a set threshold (such as 45 degrees), it indicates that there is a sudden change in the direction of the action.

[0113] Generate path graph structure: Put all Δf t The data are connected into a vector sequence, and the rate amplitude and direction changes of each node are recorded, forming a graph data structure composed of node state transitions and changes.

[0114] The final output micro-motion evolution path map can be used for subsequent tasks such as micro-motion clustering, behavior segmentation, and abnormal behavior candidate detection.

[0115] To identify subtle abnormal changes in the behavior of people or targets in surveillance videos, based on the constructed inter-frame micro-motion evolution path map, micro-motion segments of the target in consecutive frames are further extracted and potential abnormal behaviors are determined. This process includes the following steps:

[0116] In the micro-motion evolution path graph, each graph node represents a multimodal scene structure feature vector of a frame of image. Let the feature vector of the t-th frame be f. t The (t+1)th frame is f （t+1） .

[0117] For any two adjacent graph nodes v t With v （t+1） The element-wise difference is calculated on the corresponding feature vector to form the inter-frame difference vector Δf. t The calculation method is as follows: The subdivisions of this difference vector correspond to the changes in the target in the following three aspects:

[0118] Spatial position change: Extract the dimensions in the feature vector that are related to the target position coordinates (such as center point, bounding box);

[0119] Change in velocity direction: Extract the change value of the optical flow estimate or motion vector part;

[0120] Semantic change in region: Extract the change encoding of the semantic region label to which the target belongs, such as changing from "road region" to "inactive region".

[0121] By merging these three parts to form a complete inter-frame motion difference vector sequence, a basic data structure is used to describe the evolution trend of the target's motion in a short period of time.

[0122] Based on the inter-frame motion difference vector sequence, a sliding time window clustering method is used to identify segments with similar micro-motion patterns. The specific steps are as follows:

[0123] Sliding window division: Set a fixed-length sliding time window, with a window size of 5 frames and a step size of 1 frame. That is, frames 1 to 5 are window 1, frames 2 to 6 are window 2, and so on.

[0124] Intra-window clustering: The inter-frame action difference vector within each window is used as the input sample, and K-means clustering is performed, with the initial number of clusters K set to 3. Cosine similarity is chosen as the clustering distance metric.

[0125] Similar segment extraction: For each window, if the samples inside it are mainly concentrated in a certain cluster (accounting for more than 80%), then the window is determined to have a single micro-motion pattern and is marked as a micro-motion segment.

[0126] Action set construction: Multiple consecutive micro-action segments are merged to form a micro-change action set of a target. Each action set contains a start frame, an end frame and a corresponding differential feature sequence.

[0127] This method can effectively isolate short-term consistent micro-behaviors of a target, such as slight but critical behavioral change patterns like pausing, frequent turning back, and slow walking.

[0128] For each set of micro-change actions that has been constructed, further analyze its dynamic characteristics and extract the following two types of indicators:

[0129] Rate of change curve: The magnitude of the difference vector Δft for consecutive frames within the action set is calculated to obtain the rate of change curve. The curve is used to measure the intensity of the behavior; a smooth curve indicates low dynamic behavior, while abrupt changes in the curve indicate large amplitude of movement or drastic changes in posture.

[0130] Trajectory direction offset: Normalize the target motion direction vector in each frame and calculate the angle θ between adjacent vectors. t If θ t A deviation exceeding 30 degrees is considered a significant directional shift. The average directional shift value is calculated as an indicator of the directional change in the entire behavior. These two indicators serve as the core descriptive quantities for behavioral assessment, providing criteria for subsequent comparison with normal behavioral patterns.

[0131] Each set of subtle changes in actions is compared with a pre-set historical normal behavior template in the system to perform deviation calculation and anomaly identification. Specifically:

[0132] Historical template construction method: In the early stage of system deployment or training phase, based on large sample monitoring data, collect typical normal behavior segments of the target, such as normal walking, staying, obstacle avoidance, etc.; construct a template library through the same feature extraction method, and generate 1 to 3 standard template feature sequences for each type of behavior.

[0133] Deviation calculation: Dynamic time warping is performed on the feature sequence of the action set to be analyzed and the sequence of each type of behavior template to calculate the minimum alignment distance. Let the minimum distance be dmin. If dmin exceeds the threshold set for that type of template (e.g., 1.5 times the average training distance), then the action set is considered to deviate from normal behavior.

[0134] Anomaly candidate labeling: For action sets whose deviation exceeds the threshold, record the corresponding time period and target ID, and label them as anomaly behavior candidate sequences; this sequence will be sent to the subsequent anomaly scoring and response module for further classification and response strategy triggering.

[0135] Frequency map construction module: Based on the inter-frame micro-motion evolution path map, calculate the co-occurrence frequency map of micro-motions of each target within the historical time window, and construct a multi-target behavior coupling map.

[0136] To characterize the potential behavioral relationships between different monitoring targets in a park setting, a quantifiable and modelable multi-target behavior coupling map is constructed based on the inter-frame micro-motion evolution path map and micro-change action set information. The specific steps include:

[0137] Within a set historical time window (e.g., 30 seconds corresponding to 750 frames), the micro-change motion sets of all targets are traversed. The motion set of each target includes a start frame, an end frame, and its corresponding differential motion vector sequence.

[0138] For any two targets A and B, if their action sets overlap in time, meaning the time intervals of the two action segments overlap, this is considered a "micro-action co-occurrence event." The definition is as follows:

[0139] Divide the timeline into non-overlapping sub-windows (e.g., one sub-window for every 5 frames).

[0140] If two targets each have at least one valid motion segment within the same sub-window (the inter-frame change amplitude is greater than the set value of 0.3), then the co-occurrence count is incremented by 1;

[0141] The number of times target A and target B co-occur within the entire historical time window is denoted as NAB.

[0142] The number of co-occurrences serves as a preliminary quantitative basis for the potential behavioral associations between targets.

[0143] To comprehensively consider both the spatial proximity and behavioral synchronization between targets, the change in spatial distance needs to be introduced as a weighting correction factor. The specific calculation is as follows:

[0144] Spatial distance change calculation: For each micro-motion co-occurrence event, extract the two-dimensional image coordinates (such as center point coordinates) of targets A and B in that frame; calculate the Euclidean distance d. AB The average spatial distance D is obtained by averaging the distance values ​​of all co-occurring events. AB Normalization: For all target pairs, the co-occurrence count N is calculated separately. AB With average spatial distance D AB Normalize to the [0,1] interval, using the max-min normalization formula: the normalized co-occurrence frequency is: The normalized distance weights are: Weighted Fusion: The two normalized indices are linearly weighted and fused to form the final co-occurrence frequency weights, as shown in the following formula: .

[0145] Through the above calculations, a symmetric inter-target correlation weight matrix W is obtained, where each element W... AB This indicates the coupling strength of micro-actions between targets A and B within this time window.

[0146] Based on the weight matrix W above, the behavioral relationship graph structure between multiple objectives is constructed as follows:

[0147] Set an edge connection threshold: weight the co-occurrence frequency WAB Compare with a set threshold Tconn (e.g., 0.65); if W AB If Tconn is greater than or equal to T, then target A and target B are considered to have a significant behavioral relationship within the current window, and a connection edge e is established. AB .

[0148] Constructing the graph structure: All objectives are treated as nodes in the graph, and each edge that satisfies the connection condition is an undirected weighted edge with an edge weight of W. AB ; Obtain an undirected graph Where V is the target set and E is the behavioral coupling edge set. This graph structure reflects the co-occurrence relationship and spatial proximity of micro-actions among targets within the same time period, and has the ability to express behavioral linkages at high resolution.

[0149] The multi-objective behavior association graph structure is expanded along the time dimension, and the graph structure is repeatedly constructed within different time windows to form a time series graph set. Furthermore, the connection strength and duration between objectives are analyzed to extract stable behavioral coupling relationships, as follows:

[0150] Calculate connectivity persistence: For target A and target B, whether edge e exists continuously across multiple consecutive time windows. AB If the number of consecutive occurrences exceeds 60% of the window size, it is determined to be a stable behavioral coupling relationship.

[0151] Graph construction: Mark all stable coupling relationships in the graph as "long-term edges" and attach edge attributes such as frequency of occurrence, average weight, and duration;

[0152] Ultimately, a multi-target behavior coupling graph with time tags, behavioral relationships, and target identity information is formed, which is used for subsequent abnormal relationship identification and multi-target behavior scoring.

[0153] Abnormal Behavior Analysis Module: Based on the multi-target behavior coupling map, construct an abnormal behavior scoring model, perform risk scoring and clustering classification on abnormal interaction behaviors between targets, and identify potential security risk behaviors.

[0154] To identify target pairs with potential threats or abnormal behavior in the park and improve the accuracy of multi-target interaction behavior analysis, this study models and analyzes the characteristics of target interaction edges based on the constructed multi-target behavior coupling graph. A risk level is output through an anomaly scoring model, followed by clustering classification and high-risk behavior labeling. The specific steps are as follows:

[0155] Based on the connection edges between any two target nodes in the multi-objective behavior coupling graph, multi-dimensional features describing their interaction behavior states are extracted. Each connection edge E... ij (Connecting target i and target j) as a behavioral sample, its features include:

[0156] Temporal continuity characteristics : Calculate the proportion of the connection edge appearing in a continuous time window. Divide the historical time period into N time windows. If the target pair remains connected in M ​​of these windows, the time continuity value is M÷N.

[0157] Co-occurrence frequency weight: W is directly extracted from the aforementioned correlation weight matrix. ij The value represents the combined intensity of the co-occurrence frequency of micro-movements between the two targets.

[0158] Spatial proximity Calculate the average Euclidean distance between target i and target j across all frames in the history of co-occurrence, denoted as Davg, and then use max-min normalization to map it to the interval [0,1]. The smaller the value, the closer they are.

[0159] The above three sub-features are concatenated into a set of three-dimensional behavioral interaction feature vectors with a unified format. This is used to describe the interactive behavior characteristics of the target pair.

[0160] A supervised learning method is used to construct an anomaly scoring model, and behavioral risk is estimated from the above interaction feature vectors. The specific steps are as follows:

[0161] Training sample preparation: Using historical monitoring data and manual annotation results, typical interactive behavior segments of three categories, namely "normal", "minor abnormal" and "serious abnormal", were collected, and the corresponding interactive feature vectors and risk level labels were extracted to construct a training sample set.

[0162] Model Selection and Training: The Gradient Boosting Decision Tree algorithm is adopted as the anomaly scoring model, which has the advantages of strong ability to identify small samples and nonlinear boundaries. The model input is a three-dimensional interactive feature vector, and the output is a risk score R with a continuous value range [0,1]. The higher the score, the more abnormal the behavior.

[0163] Model output explanation: After training, input the behavioral feature vector Fij of any target pair, and the model outputs its risk score Rij, which is used for subsequent cluster analysis and high-risk identification.

[0164] To achieve unsupervised risk level classification, clustering based on scoring results is performed on all interaction samples. The steps are as follows:

[0165] Clustering algorithm selection: Density-Based Spatial Clustering of Applications with Noise (DBSCAN) was used to cluster the scoring results. This algorithm can identify clusters of arbitrary shapes and effectively remove outliers.

[0166] Parameter settings: The minimum number of samples is set to 10; the neighborhood radius ε is set to 0.1, meaning that samples with a score difference within 0.1 are considered neighbors.

[0167] Risk classification results: After clustering, all interaction samples were divided into three categories: those clustered in [0, 0.3] were low-risk behaviors; those clustered in [0.3, 0.6] were suspicious behaviors; and those clustered in [0.6, 1.0] were high-risk behaviors. The clustering results provide a basis for behavioral levels for subsequent action responses.

[0168] Further analysis was performed on target pairs classified as high-risk behaviors in the clustering results, and behavioral semantic recognition was performed by combining their time trajectories and semantic regions:

[0169] Trajectory analysis: Analyze the position sequence of high-risk targets within the historical window. If abnormal trajectory behavior (such as repeated approach, detour, or parallel movement) is found, the risk level is further increased.

[0170] Semantic region cross-judgment: The frame location where the high-risk target behavior occurs is mapped to the static semantic region map. If it occurs in a highly sensitive area (such as a blind spot in the passage, a dangerous goods storage point, or an exit intersection), the behavior is marked as a potential security risk behavior.

[0171] The final output is structured labeled data consisting of "target number + time period + behavior level + area location", which can be used for subsequent monitoring and linkage response or manual intervention.

[0172] To verify the effectiveness of the behavior anomaly scoring model based on multi-objective behavior coupling graph described in this invention in a real-world park monitoring environment, a comparative experiment was conducted using the following methods:

[0173] Experimental environment and dataset settings:

[0174] Monitoring area: A high-security industrial park, with a total area of ​​approximately 15,000 square meters;

[0175] Number of cameras deployed: 24, covering the main passage, entrances and exits, parking lot, and chemical storage area;

[0176] Experiment duration: 72 hours of continuous video data acquisition;

[0177] Data annotation method: The interaction behaviors were annotated frame by frame by 5 security experts, and a total of 674 behavioral events were annotated, including 65 high-risk events, 104 suspicious behaviors, and the rest were normal behaviors;

[0178] Comparison method: Compare with traditional single-target trajectory anomaly detection methods (such as trajectory deviation detection + basic behavior template comparison).

[0179] Key Indicator Comparison:

[0180] The results are analyzed as follows:

[0181] Significantly improved recognition accuracy: This method effectively captures abnormal group behaviors, such as coordinated loitering, linked contact, and abnormal approach, by introducing multi-target coupling relationships and micro-movement co-occurrence modeling, significantly improving the accuracy of high-risk behavior recognition (by about 14 percentage points).

[0182] The false alarm rate is significantly reduced: thanks to the scoring clustering mechanism and spatial semantic constraints, it has a higher fault tolerance for non-abnormal behaviors such as "crossing paths" and "temporary approach", and the false alarm rate is reduced by more than 60%;

[0183] More timely response: The graph structure and feature encoding run in parallel, combined with graph neural networks and lightweight clustering models, to achieve identification within an average of 1.6 seconds, meeting the needs of real-time early warning;

[0184] Highly scalable: This scoring model supports continuous learning and updates, and can be quickly migrated and deployed in different park scenarios by adding labeled samples.

[0185] Intelligent linkage acquisition module: Based on the risk score results, it automatically generates a coordinate system of microscopic observation features in high-risk areas, and controls the camera to adjust its angle and focal length, performing high-frequency image acquisition and local fine-grained recognition analysis on key targets.

[0186] To improve the response accuracy and image recognition quality of high-risk behavioral events in the park, based on the aforementioned abnormal behavior scoring results, microscopic-level image acquisition and recognition analysis are automatically performed in high-risk areas for key targets with scores higher than the threshold.

[0187] When the behavioral anomaly scoring model outputs a risk score value for a target that exceeds a preset threshold (e.g., 0.65), and the target is located in a highly sensitive semantic area (e.g., entrance / exit, closed lane, chemical warehouse, etc.), the micro-observation process is immediately triggered.

[0188] First, a two-dimensional feature coordinate system is constructed with the current position of the target as the origin. The specific steps are as follows:

[0189] Determine the origin coordinates: Extract the image coordinates (x, y) of the target in the current frame from the multimodal scene structure feature vector and convert them into the corresponding world coordinates (X, Y);

[0190] Add a behavior direction axis: Based on the spatial trajectory of the target in the past 5 consecutive frames, fit the trajectory direction vector V using the least squares method. dir Set this direction as the X-axis;

[0191] Establishing regional boundary constraints: combining semantic labels in the regional segmentation map, marking the boundary of the visible area within the region where the target is located, and using it as the effective activity range in the coordinate system.

[0192] Finally, a microscopic observation feature coordinate system including spatial origin, movement trend direction, semantic boundary and visual constraint is formed, which is used to guide the subsequent camera selection and posture adjustment.

[0193] According to the movement trend and spatial position of the target in the microscopic observation feature coordinate system, the camera group with the best coverage capability is selected, and the steps are as follows:

[0194] Constructing camera field of view model: presetting the field of view coverage of each camera as a sector area, including starting angle, ending angle, and the maximum viewing distance corresponding to the maximum focal length, and the spatial imaging area can be calculated in combination with the installation position and pitch angle;

[0195] Judging viewing angle accessibility: for each candidate camera, calculate the included angle θ between its current main viewing direction and the target direction vector, if θ ≤ 45 degrees and the target is within its effective imaging range, it is determined as an accessible viewing angle;

[0196] Optimizing camera group selection: for all cameras with accessible viewing angles, construct a multi-factor scoring function based on the spatial distance to the target, the cosine value of the included angle and the historical imaging clarity score, and select the top 2 cameras with the highest scores to enter the linkage control queue.

[0197] Perform real-time linkage control on the optimized camera group, adjust its angle and focal length parameters, and ensure that the shooting area accurately covers the path prediction range of the target:

[0198] Path prediction method: adopt Kalman filtering algorithm to predict the trajectory of the target in the next 10 frames, obtain the potential moving path area of the target, and output it as a rectangular spatial area R;

[0199] Angle adjustment control: calculate the offset angle between the current shooting direction of the camera and the center of area R, control the pitch motor and the horizontal rotation motor to perform angle adjustment in a proportional manner, with an adjustment accuracy of 1 degree;

[0200] Adaptive focal length adjustment: according to the size of the target in the image and the imaging clarity evaluation value (using the structural similarity index SSIM, and setting the target imaging SSIM ≥ 0.75 as qualified), adjust the parameters of the zoom motor in real time, so that the target image occupies 30% to 50% of the frame height.

[0201] The above control process is executed at a refresh rate of 10 times per second to ensure the continuous capture accuracy of the target during movement.

[0202] When the target stably enters the central area of the microscopic observation area (within a 1-meter radius centered on the coordinate system origin), the system immediately performs high-frequency image acquisition and multi-channel recognition analysis:

[0203] Image acquisition frequency setting: the acquisition frequency is set to 10 frames per second, the continuous acquisition duration is 5 seconds, a total of 50 frames of images are acquired and cached in the high-risk buffer area;

[0204] Local area extraction: extract the target bounding box area from each frame of image and perform the following recognition tasks:

[0205] Face recognition: use the multi-scale face detector MTCNN model to extract face regions and output feature vectors;

[0206] Clothing texture recognition: identify the texture patterns of upper and lower garments through a sub-model combining color histograms and texture direction coding;

[0207] Carried object detection: use the YOLOv5 model to perform object recognition on the area around the target, and identify the type and position information of objects such as backpacks and cartons.

[0208] Recognition result encoding and storage: encode the above recognition results into feature vectors, bind them with the original image frames, and store them in the event database for subsequent behavior confirmation, traceability and linkage response.

[0209] Response module: compare the analysis results with a preset safety behavior template library, output the abnormal behavior level assessment result, and trigger the response strategy.

[0210] In order to realize automatic recognition and rapid response to high-risk target behaviors, based on the behavior recognition results and graph information extracted in the foregoing steps of the present invention, the present invention compares and analyzes them with a preset safety behavior template library, judges the abnormality level, and triggers linkage response strategies of different levels accordingly. The process specifically includes the following content:

[0211] The safety behavior template library is established based on historical behavior data and expert experience rules in typical scenarios of the park, and includes:

[0212] Template classification dimensions: templates are classified according to three dimensions: behavior type, occurrence area, duration, and movement pattern, such as "normal passage template", "short stay template", and "illegal approaching template";

[0213] Feature structure definition: each template includes the following structure:

[0214] Behavior trajectory patterns (such as path direction and speed change);

[0215] Semantic region distribution (sequence of region labels where the behavior occurs);

[0216] Micro-motion feature distribution (statistical features of difference vector sequences, such as average magnitude and rate of change of direction);

[0217] Encoding format: All template behaviors are encoded in a unified multidimensional feature vector format and stored in a local template database, supporting fast lookup and matching.

[0218] The target behavior segment to be evaluated (output by the scoring module or fine-grained recognition module) is compared one by one with the safety behavior template library. The steps are as follows:

[0219] Behavioral feature encoding: Features are extracted from the trajectory, semantic distribution, and micro-motion sequence of the target behavior within the analysis time window and encoded into a behavioral vector B. test It maintains structural consistency with the template behavior vector;

[0220] Similarity calculation method: The Dynamic Time Warping algorithm is used to calculate the similarity between B and B. test Perform a matching operation with each template vector and output the minimum matching distance D. min ;

[0221] Nearest neighbor template determination: If D min The similarity threshold T is lower than the template category. cat (For example, "normal passage" is set to 0.15, and "illegal approach" is set to 0.3), then the target behavior is considered to match the template, and the matching label is output. If B test If the match with any template is lower than the threshold of all categories, it is judged as undefined abnormal behavior.

[0222] Anomaly level assessment is performed by combining the matching results with the original score, according to the following rules:

[0223] Scoring threshold setting: The risk score result R is divided into three levels:

[0224] Low risk: 0 ≤ R < 0.4;

[0225] Medium risk: 0.4 ≤ R < 0.7;

[0226] High risk: R ≥ 0.7;

[0227] Template type determination weight: If the matched template belongs to a highly sensitive behavior type (such as "abnormal return" or "illegal gathering"), its risk level will be automatically increased by one level.

[0228] The final evaluation results are output in a structured format of "target ID + behavior time period + anomaly level + matching template name" for the response module to call.

[0229] Based on the level of abnormal behavior, the following response process will be executed automatically:

[0230] Low-risk behavior response strategy: Record event information, mark and archive it as training samples for subsequent data, without triggering real-time intervention;

[0231] Medium-risk behavior response strategy: Trigger the front-end alert mechanism, such as popping up a prompt box on the monitoring platform and linking it to a voice broadcast warning;

[0232] High-risk behavior response strategy: Link up with cameras for continuous tracking and data collection, and push the target ID and image information to the security control center to achieve real-time early warning;

[0233] If the target location is close to a restricted area, the park's access control system, lighting equipment, or warning lights will be used to implement a preset blocking strategy.

[0234] It can automatically retrieve the target's historical behavior trajectory for retrospective analysis and comparative tracking.

[0235] All response strategies are configurable and can be customized and have permissions set according to the actual scenario of the park.

[0236] This invention effectively improves the semantic accuracy and real-time response of abnormal behavior identification by introducing behavior template comparison and multi-level response logic.

[0237] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application.

Claims

1. A computer vision-based intelligent monitoring system for industrial parks, characterized in that: include: Video acquisition module: Collects video image frame sequences from multiple surveillance cameras within the park at different time periods, and constructs a video stream map that is spatially synchronized across cameras; Feature extraction module: Based on the video stream graph, a region segmentation algorithm is used to extract static structural features and dynamic change features from each image frame to generate a multimodal scene structural feature vector; Micro-motion modeling module: Input the multimodal scene structure feature vector into the temporal graph convolutional network to construct an inter-frame micro-motion evolution path map and extract the target's micro-change action set and abnormal behavior candidate sequence in consecutive frames; Frequency map construction module: Based on the inter-frame micro-motion evolution path map, calculate the co-occurrence frequency map of micro-motions of each target within the historical time window, and construct a multi-target behavior coupling map; Abnormal Behavior Analysis Module: Based on the multi-target behavior coupling map, construct an abnormal behavior scoring model, perform risk scoring and clustering classification on abnormal interaction behaviors between targets, and identify potential security risk behaviors; Intelligent linkage acquisition module: Based on the risk score results, it automatically generates a microscopic observation feature coordinate system in high-risk areas, and controls the camera to adjust its angle and focal length, performing high-frequency image acquisition and local fine-grained recognition analysis on key targets; The microscopic observation feature coordinate system is constructed based on the high-risk target location and its semantic region output by the abnormal behavior scoring model, and includes target location, movement trend and surrounding structure information; Response module: Compares the analysis results with the preset security behavior template library, outputs the abnormal behavior level assessment results, and triggers the response strategy; The construction of the inter-frame micro-motion evolution path map includes the following steps: The multimodal scene structure feature vectors are used to construct a node graph structure in chronological order, where each frame of the image corresponds to a graph node, and initial edge connections are established between nodes based on their chronological order. Based on the feature similarity and time interval between nodes, a Gaussian kernel function is used to calculate the edge weights and construct a weighted time sequence graph structure. The weighted temporal graph is input into a joint temporal graph convolutional network containing graph convolutional layers and gated recurrent units to extract the micro-action state transition features between nodes; Based on the rate of feature change and the difference in action vector direction between nodes, an inter-frame micro-motion evolution path map is generated; The construction of a multi-objective behavior coupling map includes the following steps: Based on the inter-frame micro-motion evolution path map, the micro-change action set of each target in the continuous time series is extracted, and the time overlap interval of different target micro-motion segments is counted within a preset historical time window to calculate the number of micro-motion co-occurrences between targets. Based on the co-occurrence frequency and the change in spatial distance between targets, normalization is used to calculate the co-occurrence frequency weight of micro-actions between targets, and a correlation weight matrix between targets is constructed. Based on the association weight matrix, targets with co-occurrence frequencies higher than a set threshold are connected to generate a multi-target behavior association graph structure. Based on the connection strength and temporal continuity between each objective, a multi-objective behavior coupling map is formed.

2. The intelligent campus monitoring system based on computer vision according to claim 1, characterized in that: The process of constructing a cross-camera spatially synchronized video stream graph includes the following steps: The system collects a sequence of video image frames continuously captured by fixed-view surveillance cameras deployed in different areas of the park within a preset time period; timestamps are aligned between different video image frames based on the spatial location information and time synchronization signals of each camera; target correspondence is calculated for image frames within the coverage area of ​​adjacent cameras using a feature point matching algorithm, and a target trajectory association model is constructed between cameras; a video stream map under unified spatial coordinates is generated based on the continuity of the target trajectory and scene structure information.

3. The intelligent campus monitoring system based on computer vision according to claim 1, characterized in that: The process of extracting static structural features and dynamic change features from each image frame using a region segmentation algorithm includes the following steps: The image frames in the video stream atlas are processed for region segmentation. A pre-trained semantic segmentation model is used to classify road regions, building structure regions and activity regions at the pixel level to generate a static structural region distribution map. Based on the static structural region distribution map, inter-frame difference calculation and optical flow field estimation are performed on continuous image frames to extract pixel motion change information of the target in the active region and generate dynamic change feature map. Based on the dynamic change feature map and the static structure region distribution map, the target region is subjected to feature weighted fusion calculation to form a scene structure feature set of unified dimension; The scene structure feature set is vectorized and encoded in chronological order to generate a multimodal scene structure feature vector.

4. The intelligent campus monitoring system based on computer vision according to claim 3, characterized in that: The extraction of the target's micro-change action set and abnormal behavior candidate sequence in consecutive frames includes the following steps: The difference is calculated on the target feature vectors corresponding to adjacent graph nodes in the inter-frame micro-motion evolution path map. The changes in the target's spatial position, velocity direction and regional semantics at each moment are extracted to form an inter-frame motion difference vector. Based on the inter-frame motion difference vector, a sliding time window clustering algorithm is used to identify micro-motion segments with similar change patterns in a continuous frame sequence, and to construct a set of micro-change motions of the target. For each micro-motion segment, calculate its rate of change curve and trajectory direction offset value, and compare the deviation with the historical normal behavior template; if the deviation exceeds the set threshold, mark the corresponding frame sequence as an abnormal behavior candidate sequence.

5. The intelligent campus monitoring system based on computer vision according to claim 4, characterized in that: The risk scoring and clustering classification of abnormal interactions between targets includes the following steps: Extract the temporal continuity, co-occurrence frequency weights, and spatial proximity features of each connection edge in the multi-objective behavior coupling graph, and construct a multi-dimensional behavior interaction feature vector. The feature vector is input into the behavior anomaly scoring model trained by supervised learning, and the risk score value of each group of target interaction behaviors is output. Based on the risk score, density clustering algorithm is used to cluster and classify behavioral samples, dividing them into low-risk, suspicious and high-risk behavior categories; Target pairs in high-risk categories are identified and, combined with their spatiotemporal trajectories and semantic regions, are marked as potential security risk behaviors.

6. The computer vision-based intelligent monitoring system for industrial parks according to claim 5, characterized in that: The linkage control of the camera to adjust its angle and focus includes the following steps: Based on the target's velocity direction vector and regional occlusion conditions in the microscopic observation feature coordinate system, a camera group with the best field of view coverage is selected; the selected camera is controlled to adjust its pitch angle, horizontal rotation angle, and focal length parameters in real time so that its main field of view is aligned with the target's movement path range.

Images