Abnormal Point Simulation in Time Series Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for anomaly detection in time series data from IoT systems lack effective simulation of abnormal points, which hampers the evaluation and improvement of machine learning models used for system monitoring.

Innovation Solution

A computer-implemented method and system for simulating abnormal points in time series data by analyzing data blocks to determine their traits, clustering, and merging adjacent blocks, followed by simulating appropriate abnormal points based on these traits to enhance model evaluation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If machine learning models are evaluated with existing evaluation data without abnormal point simulation, then the evaluation process is simple, but the evaluation results are inaccurate and cannot effectively reflect model performance in anomaly detection

Engineering Contradiction:
Improveevaluation result accuracyVSAvoiddata processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by simulating abnormal points in advance within the evaluation data before model evaluation. The system identifies normal data blocks, simulates various types of abnormal points (sudden changes, gradual changes, outliers) at appropriate locations, and creates augmented evaluation datasets. This pre-processing ensures that when models are evaluated, they are tested against realistic anomaly scenarios, significantly improving evaluation accuracy without requiring changes to the model architecture itself.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by creating simulated copies of abnormal points based on patterns learned from historical data. Instead of requiring real anomaly data for evaluation, the system generates synthetic abnormal point instances that replicate the statistical characteristics and temporal patterns of actual anomalies. These copied abnormal patterns are inserted into normal evaluation data, providing a scalable solution that improves measurement precision without proportionally increasing data collection complexity.

Inventive Principle:
Principle #26Copying

2Measurement precision

If abnormal points are simulated without analyzing data block traits, then the simulation process is fast, but the simulated abnormal points are not appropriate and do not improve model evaluation

Engineering Contradiction:
Improveabnormal point appropriatenessVSAvoiddata analysis time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies segmentation by dividing the time series evaluation data into discrete data blocks and analyzing the traits of each block individually. The system identifies characteristics such as mean, variance, and temporal patterns for each segment. This segmentation allows the simulation process to tailor abnormal points to the specific characteristics of each data block, ensuring appropriateness. The modular approach also enables parallel processing, reducing the overall time penalty of the analysis.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements local quality by making the abnormal point simulation adaptive to local data block characteristics rather than applying a uniform simulation approach. The system adjusts the type, magnitude, and frequency of simulated abnormal points based on the specific traits of each data block (e.g., high-variance blocks receive different treatment than low-variance blocks). This localized adaptation significantly improves the appropriateness and realism of simulated anomalies, directly enhancing evaluation precision.

Inventive Principle:
Principle #3Local quality

3Adaptability or versatility

If all data blocks are treated uniformly in simulation, then the process is simple, but the simulation does not account for different data block characteristics and reduces evaluation effectiveness

Engineering Contradiction:
Improvesimulation adaptability to different data patternsVSAvoidclustering and merging complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies merging by combining adjacent data blocks that share similar traits into unified simulation units. After clustering data blocks based on their characteristics (variance, trend, seasonality), the system merges blocks within the same cluster to create homogeneous regions for simulation. This merging reduces the number of individual simulation decisions required while maintaining adaptability to different data patterns. The complexity is managed through automated clustering algorithms that group blocks based on statistical similarity, making the process scalable.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent implements parameter changes by dynamically adjusting simulation parameters (abnormal point magnitude, frequency, type distribution) based on the clustered data block characteristics. Different clusters receive different simulation parameter sets tailored to their statistical properties. For example, clusters with high variance receive simulations with larger magnitude abnormalities, while seasonal clusters receive simulations that respect temporal patterns. This parameter adaptation enhances simulation versatility without requiring manual configuration for each data block.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20240427684A1Abnormal point simulation
Publication Date: 2024.12.26 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US20240427684A1 patent drawing
  • US20240427684A1 patent drawing
  • US20240427684A1 patent drawing

AI summary

A computer-implemented method, a system and a computer program product for abnormal point simulation are disclosed. A processor analyzes a plurality of data blocks in first time series data to determine traits of respective data blocks. For the respective data blocks, a processor simulates one or more abnormal points based on the traits of the respective data blocks.