Distributed Bot Detection via Local and Central Analyzers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing malware detection methods are ineffective in identifying polymorphic malware and botnets, as they rely on signature matching that can be evaded by mutation, and often result in delayed detection and false positives, which can lead to significant damage and privacy loss.

Innovation Solution

A distributed system employing local and central analyzers to detect command and control communications (callbacks) using packet header signature matching, deep packet inspection, and machine learning to generate probability scores, thereby identifying malicious activity and updating global signature caches for improved detection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If signature matching is used for malware detection, then known malware can be identified, but polymorphic malware can evade detection through mutation

Engineering Contradiction:
Improvemalware detection accuracyVSAvoidability to detect polymorphic malware
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent segments malware detection into multiple independent analysis components: static signature matching, dynamic behavioral analysis, and callback detection. Each component operates independently and contributes to the overall detection decision, allowing the system to detect both known and polymorphic malware through multiple pathways rather than relying on a single signature-matching approach

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system changes the detection parameters from static signature matching alone to a multi-parameter approach including behavioral metrics, communication patterns, and callback indicators. This allows detection of polymorphic malware by monitoring how the malware behaves and communicates rather than relying solely on its changing code signature

Inventive Principle:
Principle #35Parameter changes

2Reliability

If manual signature library updates are performed, then new malware signatures can be added, but detection is delayed by days or weeks

Engineering Contradiction:
Improvemalware detection capabilityVSAvoiddetection delay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary detection using behavioral analysis and callback detection mechanisms that do not require updated signatures. When suspicious activity is detected, the system proactively monitors and analyzes the malware's communication patterns in real-time, enabling detection before formal signature updates are completed

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback loops where detection results from one system are automatically shared with other systems. Callback detection results feed back into the signature matching system, and behavioral analysis results inform both signature updates and policy adjustments, creating a continuous improvement cycle that reduces detection delays

Inventive Principle:
Principle #23Feedback

3Measurement precision

If antivirus scanning is performed, then malware can be detected, but damage and privacy loss may have already occurred

Engineering Contradiction:
Improvemalware detection capabilityVSAvoidtime to prevent damage
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary detection of callback communications and suspicious behavioral patterns before malware can execute significant damage. By monitoring network traffic and communication patterns in real-time, the system identifies and alerts on potential threats at the earliest stages of malware operation

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements rushed detection through real-time callback monitoring and immediate alert generation. When callback patterns are detected, the system rushes through the analysis process, immediately notifying security personnel and enabling rapid response before the malware can propagate or cause significant harm

Inventive Principle:
Principle #21Skipping (Rushing through)

4Measurement precision

If distributed analysis system is implemented, then detection accuracy improves, but system complexity increases

Engineering Contradiction:
Improvemalware detection accuracyVSAvoidsystem architecture complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The distributed system is segmented into specialized components with clearly defined responsibilities: signature matching modules, behavioral analysis modules, callback detection modules, and coordination components. This segmentation reduces complexity by allowing each component to be developed, maintained, and optimized independently while contributing to the overall detection accuracy

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements universal coordination mechanisms that allow the same communication protocols and data formats to be used across all distributed components. The central coordinator and local analyzers use standardized interfaces and shared data structures, reducing the complexity of integration and maintenance while enabling the system to handle multiple types of malware detection

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10200384B1Distributed systems and methods for automatically detecting unknown bots and botnets
Publication Date: 2019.02.05 MANDIANT LLC
  • US10200384B1 patent drawing
  • US10200384B1 patent drawing
  • US10200384B1 patent drawing

AI summary

A system and method for detecting malicious activity through one or more local analyzers and a central analyzer. The local analyzer captures packets that are part of communications over a network, generates a signature from information obtained from one or more of the captured packets, and determines whether the signature matches any signature of a first plurality of signatures stored in a first storage device that is accessible to the first local analyzer. The central analyzer remotely receives a portion of the information and the signature from the first local analyzer in response to the signature failing to match any of the signatures stored in the first storage device. The central analyzer determines whether the signature matches any global signature stored within a second storage device that is accessible to the central analyzer.