LLM Threat Hunting Tree Interface for Context and Skill Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Security operations center (SOC) analysts face challenges in managing complex security investigations due to limited information, evolving threats, and time pressure, exacerbated by the limitations of large language models (LLM systems) in handling large data sets and token budget constraints, making it difficult to track skills and maintain context during investigations.
Innovation Solution
A computing system with a user interface that assists LLM investigations by providing a tree format display of suggested steps, automatically maintaining context, and using references to stored data to manage large data sets within token limits, allowing for efficient skill execution and backtracking.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If LLM systems are used to perform security investigations, then the complexity and effort of manual analysis is reduced, but the system lacks recent public context and private contextual information
Solution Approach 1:
The patent introduces an intermediary layer between the LLM system and the investigation environment. This intermediary consists of a knowledge base that stores recent public context and private contextual information, and a retrieval mechanism that selectively feeds this information back to the LLM. This mediator resolves the contradiction by enabling the LLM to access up-to-date information without requiring direct modification of its training data or architecture.
Solution Approach 2:
The system implements feedback loops where the LLM's investigation outputs are fed back into the knowledge base, which then provides updated context to subsequent LLM queries. This feedback mechanism ensures the system continuously learns from recent investigations and maintains accurate context, resolving the limitation of static training data while preserving the ease of LLM-based operation.
2Adaptability or versatility
If the list of skills is expanded to provide more comprehensive investigation functions, then the system capability is improved, but it becomes difficult for individuals to keep track of the various skills
Solution Approach 1:
The patent implements self-service by having the LLM automatically manage skill selection and execution. Instead of requiring users to manually track and select from extensive skill lists, the system uses the LLM's natural language understanding to automatically identify appropriate skills, retrieve associated code, and execute them. This self-service approach maintains comprehensive system capability while eliminating the complexity of manual skill management.
Solution Approach 2:
The patent replaces the mechanical system of manual skill tracking and selection with an automated LLM-based system. The LLM processes natural language descriptions of investigation needs, automatically maps them to appropriate skills, and manages execution without human intervention. This substitution eliminates the cognitive load of tracking numerous skills while preserving full system capability.
3Loss of information
If large data sets are manipulated in LLM prompts to extract insights, then the analysis depth is improved, but the token limit is exceeded
Solution Approach 1:
The patent extracts only the essential information from large data sets and stores it in a compressed knowledge base format. Instead of feeding entire data sets to the LLM, the system extracts key insights, summaries, and critical data points, then feeds only these condensed representations to the LLM for analysis. This extraction approach maintains information completeness while staying within token limits.
Solution Approach 2:
The patent segments large data sets into manageable portions and organizes them in the knowledge base by relevance and importance. The system processes data in segments, extracting insights from each portion and synthesizing them into a condensed representation. This segmentation allows the LLM to work with manageable data quantities while maintaining comprehensive analysis capability through iterative processing.
Data Source
AI summary
A computing system assists in large language model system assisted investigations. The computing system includes network connection hardware configured to connect to a large language model and configured provide to investigation context and investigation goals to the large language model system. The network connection receives from the large language model system, an indication of suggested steps to perform in an investigation, including specific computer executable code to perform a skill in the first step, the skill comprising a supplemental access, analytic or enrichment function. The computing system includes a user interface with a tree interface that causes display of the indication of the suggested steps in a tree format. The computing system is configured to execute the computer executable code to cause the computer system to perform the supplemental access, analytic or enrichment function.


