Byte Stream Complexity Anomaly Detection for Malicious Activity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Computer networks face challenges in detecting and preventing malicious software due to its increasingly sophisticated methods of evading detection, such as obfuscation, which makes it difficult to identify potentially malicious data streams.

Innovation Solution

A computing device measures the complexity of byte streams using compressibility and entropy, comparing them to thresholds determined from benign data streams to identify anomalies, triggering security notifications or preventing transmission of anomalous files.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional detection methods are used to identify malicious software, then detection simplicity is maintained, but detection effectiveness deteriorates due to sophisticated obfuscation techniques

Engineering Contradiction:
Improvedetection effectivenessVSAvoiddetection method complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent changes the detection parameter from content-based analysis to complexity-based analysis. Instead of examining file contents directly, the system measures complexity metrics (entropy, compressibility, code density) of the data streams. This parameter transformation allows detection of obfuscated malicious software by identifying abnormal complexity patterns rather than relying on traditional signature matching or heuristic analysis.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If complexity measurement is applied to all data streams, then detection precision is improved, but processing time increases

Engineering Contradiction:
Improveanomaly detection precisionVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system applies complexity measurement selectively rather than uniformly to all data. It first identifies candidate data streams for analysis and then applies complexity metrics only to those candidates. This partial action approach maintains high detection precision for suspicious files while reducing overall processing time by avoiding unnecessary analysis of benign files.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent implements preliminary filtering to identify data streams that warrant complexity analysis. By pre-screening data streams using basic criteria before applying computationally intensive complexity measurements, the system prepares only the necessary subset of files for detailed analysis, thereby reducing total processing time while maintaining detection precision.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11017079B2Identifying malicious activity using data complexity anomalies
Publication Date: 2021.05.25 TREND MICRO INC
  • US11017079B2 patent drawing
  • US11017079B2 patent drawing
  • US11017079B2 patent drawing

AI summary

Examples relate to identifying malicious activity using data complexity anomalies. In one example, a computing device may: receive a byte stream that includes a plurality of bytes; determine, for a least one subset of the byte stream, a measure of complexity of the subset; determine that the measure of complexity meets a predetermined threshold measure of complexity for a context associated with the byte stream; and in response to determining that the measure of complexity meets the threshold, provide an indication that the byte stream complexity is anomalous.