Incremental track anomaly detection method based on incremental kernel principle component analysis

A nuclear principal component analysis and anomaly detection technology, applied in the fields of instruments, character and pattern recognition, computer parts, etc., can solve the problem of high computational complexity, and achieve the effect of improving efficiency and reducing computational complexity

Active Publication Date: 2016-10-12
CHINA UNIV OF MINING & TECH
2 Cites 6 Cited by

AI-Extracted Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to provide a method for abnormal detection of incremental trajectory based on incremental kernel...
View more

Abstract

The invention provides an incremental track anomaly detection method based on incremental kernel principle component analysis, and belongs to the field of an incremental track anomaly detection method. The method comprises the following steps: to begin with, carrying out model initialization calculation, carrying out initial kernel feature space calculation through conventional Batch KPCA, and when M newly-increased track data comes, carrying out standardization on the M track data first; then, calculating kernel feature space of the newly-increased data through Batch KPCA; calculating average reconstruction error of the newly-increased data and training data, and if the error of the two is larger than a preset threshold value, using a follow-up kernel feature space division-merging method to update kernel feature space; then, carrying out projection on the updated kernel feature space and extracting a principal component; and finally, carrying out unsupervised learning and anomaly detection by utilizing a support vector machine. The advantages are that the method is superior to a conventional kernel principle component analysis method; computing complexity is reduced; and track anomaly detection efficiency is improved.

Application Domain

Character and pattern recognition

Technology Topic

Kernel principal component analysisCharacteristic space +7

Image

  • Incremental track anomaly detection method based on incremental kernel principle component analysis
  • Incremental track anomaly detection method based on incremental kernel principle component analysis
  • Incremental track anomaly detection method based on incremental kernel principle component analysis

Examples

  • Experimental program(3)

Example Embodiment

[0023] Example 1: First perform the initialization calculation of the model, and use the traditional Batch KPCA to perform the initial kernel feature space calculation. Whenever there are M new trajectory data coming, the M trajectory data are first standardized; then the Batch KPCA calculation is used The nuclear feature space of the newly added data. Calculate the average reconstruction error of the newly added data and the training data respectively. If the errors of the two are greater than the given threshold, perform the subsequent kernel feature space segmentation-merging method to update the kernel feature space; then project the updated kernel feature space , Extract the principal components; finally use a type of support vector machine for unsupervised learning and anomaly detection.
[0024] See figure 1 As shown, an incremental trajectory anomaly detection method based on incremental kernel principal component analysis includes the following steps:
[0025] (1) Initial trajectory data, trajectory standardization;
[0026] (2) Determine a fixed-size sliding data window, calculate the initial kernel feature space and reconstruction error;
[0027] (3) Calculate the average reconstruction error ratio between the newly added data and the sliding window. If the errors between the two are greater than the given threshold, execute the kernel feature space split-merge method to update the kernel feature space;
[0028] (4) Calculate the updated sliding window kernel feature space projection, and extract the principal components;
[0029] (5) Use a type of support vector machine for unsupervised learning and anomaly detection;
[0030] The specific method is as follows:
[0031] This incremental trajectory abnormality detection method based on incremental kernel principal component analysis first uses the Min-max method to standardize each trajectory, and sets the size P of the sliding window and the number of trajectories M updated each time. P represents the size of the kernel feature space that needs to be updated each time, and the size of the kernel feature space is fixed during the execution of the algorithm; M represents the size of each increment;
[0032] Then use the traditional Batch KPCA to calculate the initial kernel feature space model of the sliding data window and calculate its average reconstruction error An n-dimensional input vector t is mapped to an l-dimensional vector φ(t) through the kernel function; the reconstruction error ε is Is the squared distance between its projection in the kernel feature space, where Is the centralized mapping vector φ(t); afterwards, the newly added trajectory data vectors are processed in batches in a loop; when processing the newly added trajectory data vectors, the kernel feature space model is first constructed, and the average reconstruction error is calculated Average reconstruction error ratio ε ratio It is the ratio between the average reconstruction error of the newly added M trajectory data and the average reconstruction error of the training data set in the sliding data window. The specific calculation formula is
[0033] ϵ ‾ t r a i n i n g _ s e t = X i = 1 N ϵ ( i ) N , ϵ ‾ u p d a t e = X i = 1 M ϵ ( i ) M , ϵ r a t i o = ϵ ‾ u p d a t e ϵ ‾ t r a i n i n g _ s e t .
[0034] Then calculate the average reconstruction error ratio ε between it and the sliding window kernel feature space ratio When ε ratio When higher than the given threshold v, use the kernel feature space segmentation-merge algorithm to update the sliding window kernel feature space, first use the kernel feature space segmentation method to remove the earliest M trajectory data feature vectors from the sliding data window to reduce the kernel features Space, the kernel feature space segmentation method is the feature space segmentation method based on the original input space. The kernel feature space segmentation method suitable for incremental kernel principal component analysis is obtained by coring it; then the kernel feature space merging method is used to merge the new The M trajectory data vectors are merged into the sliding window kernel feature space. After the kernel feature space is merged, the kernel feature space is split from the sliding data window and the kernel feature space model composed of the remaining trajectories is obtained. Ω=(U ,Φ x ,α,Λ,N), the kernel feature space model formed by the newly added M trajectories is Θ=(V,Φ y ,β,Δ,M), merge Ω and Θ to get the updated kernel feature space model Q=(W,Φ z ,τ,∏,P).
[0035] Simultaneously calculate the feature space projection of the sliding window kernel, obtain the principal component and calculate its feature space projection;
[0036] Finally, a type of support vector machine is used to perform unsupervised learning and anomaly detection on the extracted principal components, traverse the trajectory set, for each trajectory sample in the data set, use the decision function to determine the abnormal trajectory, record the detected abnormal trajectory, and set the corresponding Trajectory label; after detection, the average reconstruction error of the sliding window kernel feature space needs to be recalculated In order to process the next new track data.

Example Embodiment

[0037] Embodiment 2: Comparison between the present invention and the incremental trajectory anomaly detection algorithm based on traditional KPCA (Batch KPCA);
[0038] In order to verify the effectiveness of the present invention, a total of 221 trajectories with 7,270 trajectory points between 1990 and 2006 in the Atlantic hurricane data were selected as the experimental data set for verification. From figure 2 It can be seen that the execution time of the incremental trajectory anomaly detection method based on the traditional KPCA is increasing rapidly with the increase of the sliding data window. The execution time of the incremental trajectory anomaly detection algorithm based on kernel feature space segmentation and merging will also increase with the increase of the sliding data window, but the amplitude is not large. And in the case of the same sliding data window size, the incremental trajectory anomaly detection algorithm based on kernel feature space segmentation and merging takes less calculation time than the incremental trajectory anomaly detection method based on traditional KPCA, and with the sliding data window The increase, this difference will become bigger and bigger.

Example Embodiment

[0039] Embodiment 3: The abnormality detection effect diagram of the present invention;
[0040] Select the detection results of the fourth iteration and the sixth iteration of the method of the present invention on the Atlantic hurricane data set, such as image 3 with Figure 4 Shown. The thicker line in the figure represents the detected abnormal trajectory, and the thinner line represents the normal trajectory. It can be seen from the figure that the anomaly detection effect is very good, and many trajectories with abnormal behavior have been detected. And from the results of the two iterations, it can be seen that with the continuous addition of new trajectories, some new abnormal trajectories are detected, and because the nuclear feature space is constantly updated, some previous abnormal trajectories are ignored.

PUM

no PUM

Description & Claims & Application Information

We can also present the details of the Description, Claims and Application information to help users get a comprehensive understanding of the technical details of the patent, such as background art, summary of invention, brief description of drawings, description of embodiments, and other original content. On the other hand, users can also determine the specific scope of protection of the technology through the list of claims; as well as understand the changes in the life cycle of the technology with the presentation of the patent timeline. Login to view more.

Similar technology patents

Ultrasonic detection method and system

Owner:INST OF ACOUSTICS CHINESE ACAD OF SCI

Detection method based on 3D skeleton modeling

Owner:武汉汇思聚创信息技术有限公司

CNN-Bagging-based fault diagnosis method for UAV bearing

ActiveCN110307983AReduce computational complexityconducive to real-time
Owner:UNIV OF ELECTRONIC SCI & TECH OF CHINA

Classification and recommendation of technical efficacy words

  • Reduce computational complexity
  • Improve efficiency
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products