ML Clustering for DGA Malware CnC Endpoint Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for detecting command and control endpoints used by Domain Generation Algorithm (DGA) malware are computationally intensive and limited in detecting various Command and Control (CnC) names, lacking zero-knowledge based solutions.

Innovation Solution

The use of machine learning-based clustering to identify command endpoints by analyzing attributes associated with candidate resolved DNS names, such as IP addresses and name server records, to determine if additional names share similar characteristics with failed DNS lookups, thereby identifying potential CnC endpoints.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If existing methods analyze DNS data or reverse engineer malware code to detect DGA malware, then detection capability is improved, but computational complexity and resource consumption increase significantly

Engineering Contradiction:
Improvedetection capabilityVSAvoidcomputational complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the detection task into two independent phases: (1) clustering DNS names using machine learning to identify potential CnC domains, and (2) validating clusters by checking if they contain both successful resolutions and failed lookups. This segmentation reduces computational complexity by processing data in manageable chunks rather than analyzing all DNS data comprehensively.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system uses the malware's own DGA algorithm behavior against it by leveraging the pseudo-random nature of DGA-generated names. The clustering algorithm automatically identifies patterns in the generated names without requiring external threat intelligence or manual analysis, making the system self-sufficient and reducing computational overhead.

Inventive Principle:
Principle #25Self-service

2Ease of operation

If traditional blacklisting methods are used to block CnC domains, then implementation simplicity is maintained, but detection effectiveness decreases due to DGA randomization

Engineering Contradiction:
Improveimplementation simplicityVSAvoiddetection effectiveness
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent introduces machine learning-based clustering as an intermediary layer between DNS resolution and blacklisting. Instead of directly blacklisting individual domains, the system clusters DNS names and identifies CnC endpoints through cluster characteristics (presence of both successful resolutions and failed lookups). This intermediary approach maintains implementation simplicity while dramatically improving detection effectiveness against DGA randomization.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If comprehensive DNS data analysis is performed to identify all potential CnC names, then detection coverage is improved, but processing time and resource consumption increase

Engineering Contradiction:
Improvedetection coverageVSAvoidprocessing efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system performs preliminary clustering of DNS names using machine learning algorithms before conducting detailed analysis. By pre-grouping names into clusters based on similarity, the system reduces the search space for subsequent validation steps, maintaining comprehensive detection coverage while significantly improving processing efficiency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies partial action by focusing analysis only on clusters that exhibit characteristics of CnC endpoints (containing both successful resolutions and failed lookups). Rather than analyzing every DNS name individually, the system selectively deep-dives into promising clusters, achieving high detection coverage with reduced computational resources.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10841320B2Identifying command and control endpoint used by domain generation algorithm (DGA) malware
Publication Date: 2020.11.17 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10841320B2 patent drawing
  • US10841320B2 patent drawing
  • US10841320B2 patent drawing

AI summary

A command endpoint used by Domain Generation Algorithm (DGA) malware is identified using machine learning-based clustering. According to this technique, at least one attribute associated with a candidate resolved DNS name is identified. The candidate resolved DNS name has associated therewith a set of names that are failed DNS lookups but that cluster with the candidate resolved DNS name. A set of additional names that share the at least one attribute with the candidate resolved DNS name are then identified. For the set of additional names, an extent to which the set of additional names also clusters with the set of names that are failed DNS lookups is then determined. The candidate resolved DNS name is characterized as associated with the command endpoint when the set of additional names cluster with the set of names that are failed DNS lookups to a configurable degree.