Holographic Display Undo via Gaze Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional VR and AR visualization systems lack the ability to perform precise and flexible undo operations on individual holographic objects within immersive 3D environments, often requiring users to revert all actions taken since the last object interaction, which can be cumbersome and inefficient.

Innovation Solution

The implementation of a display system that uses eye-tracking technology to detect the user's gaze direction and allow for single-object undo operations, enabling users to revert the state of a specific holographic object to a past state without affecting other objects, and also supports partial undo of continuous user actions by recording and displaying a timeline of past states.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional VR and AR visualization systems perform undo operations, then the system can revert actions, but the system reverts all actions taken since the last object interaction rather than allowing selective undo of individual objects

Engineering Contradiction:
Improveselective undo capabilityVSAvoidoperation complexity
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent segments the undo operation by object identity, allowing the system to track and revert actions for individual holographic objects separately. Each object maintains its own action history, enabling selective undo of specific objects while preserving changes to other objects. This segmentation transforms a global undo operation into object-specific revert operations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary mechanism (object identifier and action history tracker) that mediates between the user's undo request and the actual state reversion. When a user performs an undo action, the intermediary identifies the target object through gaze detection, retrieves its specific action history, and applies the revert operation only to that object's state, isolating it from other objects in the scene.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If the system records and displays a timeline of past states for partial undo, then users can revert to specific time points, but the system complexity increases to manage timeline recording and playback

Engineering Contradiction:
Improvepartial undo capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements preliminary action by continuously recording state snapshots at key time points during object manipulation. Before executing a partial undo, the system has already captured and stored intermediate states in a timeline buffer. This allows the user to navigate to and revert to any previously recorded state without requiring complex real-time computation or recalculation of object histories.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by creating and storing duplicate state representations of holographic objects at various time points in the timeline. Instead of maintaining and processing complete action sequences, the system captures snapshots (copies) of object states at key moments, enabling efficient playback and reversion to specific time points by simply restoring these pre-captured copies rather than replaying entire action sequences.

Inventive Principle:
Principle #26Copying

3Ease of operation

If the system uses eye-tracking technology to detect gaze direction for identifying target objects, then the user interface becomes more intuitive, but the device complexity and energy consumption increase

Engineering Contradiction:
Improveinterface intuitivenessVSAvoidenergy consumption
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The patent applies self-service by allowing the user's natural gaze direction to automatically identify the target object for undo operations without requiring additional manual input or selection actions. The eye-tracking system continuously monitors gaze direction, and when combined with an undo gesture or command, the system autonomously determines which object the user intends to revert based on current gaze position, eliminating the need for separate object selection steps.

Inventive Principle:
Principle #25Self-service

4Measurement precision

If the system allows selective manipulation of individual holographic objects without affecting others, then user control precision improves, but the system complexity to track individual object states increases

Engineering Contradiction:
Improvecontrol precisionVSAvoidstate tracking complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the state tracking system by creating independent action history records for each holographic object. Instead of maintaining a single global state that requires complex dependency resolution, each object has its own chronological record of modifications. This segmentation allows precise control of individual objects while simplifying the overall tracking mechanism, as each object's state can be reverted independently without affecting others.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10007352B2Holographic display system with undo functionality
Publication Date: 2018.06.26 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10007352B2 patent drawing
  • US10007352B2 patent drawing
  • US10007352B2 patent drawing

AI summary

Disclosed are techniques for performing undo operations on holographic objects in an immersive 3D visual environment. A display system allows the user to undo a given user operation performed on a particular selected holographic object without affecting any other holographic objects, based on a user's gaze and/or other user input. The technique can be implemented in conjunction with a scrollable visual “timeline” in which multiple past states of the display environment are displayed to the user and are selectable by the user as the target state of the revert operation. Also disclosed is a technique for partially undoing a single continuous user action in a holographic display system.