Multimodal Natural User Interface Activation System

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional natural user interface systems are hypersensitive and prone to inaccuracies due to single mode activation methods, leading to unintentional activation of commands.

Innovation Solution

A multimodal natural user interface activation system that evaluates a plurality of signals from a user, including visual and gestural inputs, to determine intended actions and retrieve context for performing agent actions, thereby reducing inaccuracies and enhancing precision.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If single mode activation is used in natural user interface systems, then the system is simple to operate, but the system becomes hypersensitive and prone to unintentional activation

Engineering Contradiction:
Improveactivation simplicityVSAvoidactivation accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent combines multiple input modes (voice commands, gestures, touch inputs) into a unified activation system. The system requires convergence of multiple signal types to trigger activation, merging previously separate activation channels into a coordinated multi-modal framework that reduces false activation while maintaining ease of use.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces signal evaluation and context retrieval mechanisms as intermediaries between user input and command execution. These intermediary layers process and validate multiple signals before activation, acting as a buffer that filters out unintentional inputs while preserving legitimate activation attempts.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Speed

If single mode activation is used, then the system responds quickly, but the system suffers from various types of inaccuracies

Engineering Contradiction:
Improveactivation response timeVSAvoidsignal interpretation accuracy
Core Design Contradiction:
SpeedVSMeasurement precision

Solution Approach 1:

The patent performs preliminary context retrieval and signal evaluation before final activation decision. By preparing context information and evaluating signal patterns in advance, the system reduces the computational burden during actual activation, maintaining fast response times while improving accuracy through pre-processed validation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback mechanisms where the system continuously monitors and evaluates incoming signals against established patterns and contexts. This feedback loop allows real-time adjustment of activation thresholds and provides corrective validation, improving signal interpretation accuracy without significantly increasing response time.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9298287B2Combined activation for natural user interface systems
Publication Date: 2016.03.29 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9298287B2 patent drawing
  • US9298287B2 patent drawing
  • US9298287B2 patent drawing

AI summary

A user interaction activation may be provided. A plurality of signals received from a user may be evaluated to determine whether the plurality of signals are associated with a visual display. If so, the plurality of signals may be translated into an agent action and a context associated with the visual display may be retrieved. The agent action may be performed according to the retrieved context and a result associated with the performed agent action may be displayed to the user.