Gaze Detection Context Routing for Interaction Control

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current user interfaces require active user input to select contexts and options, which can be cumbersome, especially in voice or gesture-controlled systems, as they often necessitate manual selection of commands or contexts before speaking or gesturing.

Innovation Solution

The system determines the appropriate context and user inputs based on the user's gaze, using gaze detection to identify the point of focus and line of sight, thereby selecting the relevant instruction sets, grammars, and recognition actions, allowing for context-appropriate speech, gestures, or touch inputs without explicit user selection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual selection of contexts and options is required, then the system can accurately identify user intent, but the interaction complexity and time required increase significantly

Engineering Contradiction:

Improveuser intent identification accuracyVSAvoidinteraction complexity

Core Design Contradiction:

Measurement precisionVSEase of operation

Solution Approach 1:

The system performs preliminary gaze detection to automatically determine the context and select appropriate instruction sets before the user provides voice or gesture input. This eliminates the need for manual context selection and reduces interaction complexity while maintaining accurate intent identification.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

Gaze detection serves as an intermediary mechanism between the user and the system. By detecting where the user is looking, the system automatically mediates context selection and instruction set activation, removing the need for explicit manual selection while preserving intent accuracy.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Adaptability or versatility

If multiple contexts and instruction sets are made available, then the system becomes more versatile, but the difficulty of detecting and measuring user intent increases

Engineering Contradiction:

Improvecontext availabilityVSAvoiduser intent detection difficulty

Core Design Contradiction:

Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The system continuously monitors user gaze as feedback to automatically determine which context and instruction set should be active. This feedback mechanism simplifies intent detection by using gaze direction as a reliable indicator of user focus, making the system adaptable without increasing detection difficulty.

Inventive Principle:

Principle #23Feedback

3Reliability

If the system waits for explicit user selection of context, then the interaction is more controlled, but the time required for interaction increases

Engineering Contradiction:

Improveinteraction controlVSAvoidinteraction time

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary gaze-based context determination before the user completes their command. This preliminary action establishes the interaction context automatically, reducing the time required for subsequent voice or gesture recognition while maintaining reliable interaction control through gaze validation.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS10845871B2Interaction and management of devices using gaze detection

Publication Date: 2020.11.24 MICROSOFT TECHNOLOGY LICENSING LLC

AI summary

A controller is adapted to recognize an input from a user using an input interface, determine if a user gaze information indicates that the user is gazing at a device, and when the user gaze information indicates that the user is gazing at the device, route response information to the device.