Gesture-Based Virtual Interface for Security Incident Investigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional user-input techniques for security management systems are cumbersome and time-consuming, making it difficult for security analysts to investigate and remediate online threats effectively, as they require complex data structure manipulation and query building, which increases the time-to-remediation and risks compromising sensitive computing resources.

Innovation Solution

The system facilitates fast and intuitive data manipulation by tracking and responding to physical gestures performed by security analysts using a Near-Eye-Display device, allowing them to interact with virtual scenes that include graphical control elements representing data sets and analysis operations, enabling quick and effective handling of security incidents.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional user-input techniques (textual code, query building) are used for security analysis, then data manipulation capability is achieved, but time-to-remediation increases and operational efficiency decreases

Engineering Contradiction:
Improvetime-to-remediationVSAvoiduser-input complexity
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent replaces manual text-based query building and data manipulation with voice-based natural language commands. Security analysts speak commands like 'show me failed login attempts' instead of writing complex SQL queries, substituting the mechanical process of code typing with speech recognition and natural language processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system introduces an intermediary layer between the security analyst and the data manipulation system. This intermediary translates natural language voice commands into executable queries and operations, eliminating the need for analysts to directly write or understand complex query languages while maintaining full data manipulation capability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If conventional analytical tools with text-based interfaces are used, then comprehensive data analysis is possible, but learning curve and implementation difficulty increase

Engineering Contradiction:
Improvedata analysis capabilityVSAvoidtraining requirement
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The system enables security analysts to perform complex data analysis operations without requiring training in query languages or data structures. The natural language interface allows analysts to directly express their analytical needs in plain English, and the system automatically executes the appropriate data retrieval and analysis operations, making the tool self-explanatory and immediately usable.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If detailed data structure manipulation is required for security investigation, then analysis precision is improved, but operational time and complexity increase

Engineering Contradiction:
Improveincident investigation accuracyVSAvoidtime-to-remediation
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-compiling and organizing security event data into structured formats that can be quickly accessed and analyzed. When a voice command is given, the system retrieves pre-processed data rather than querying raw logs, significantly reducing the time required to perform detailed analysis while maintaining investigation accuracy.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11327558B2Physical gesture based data manipulation within a virtual scene for investigating a security incident
Publication Date: 2022.05.10 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11327558B2 patent drawing
  • US11327558B2 patent drawing
  • US11327558B2 patent drawing

AI summary

Disclosed herein is a system for facilitating fast and intuitive investigations of security incidents by responding to physical gestures performed by security analysts within a virtual scene. A query triggers an alert for detecting security incidents that occur with respect to computing resources. Following the alert, the security analyst dons a Near-Eye-Display (NED) device and is presented with a virtual scene having control elements representing various data sets and/or data analysis operations relevant to a security incident. The security analyst investigates the security incident by performing hand motions to “grab-and-drag” control elements representing data sets. The security analyst may also perform hand motions to “tap on” control elements that represents a data analysis operation. Responsive to the hand motions, the system performs data analysis operations and displays a result within the virtual scene. Then, the security analyst performs another hand motion to remediate any threat caused by the security incident.