Intelligent Command Batching in VR Environments

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In augmented and virtual reality environments, reversing, re-executing, and replaying user commands can be complicated, especially when multiple users interact with the same virtual objects, leading to a disjointed user experience due to the need for individual reversal of numerous small, incremental gestures.

Innovation Solution

A method that intelligently batches commands based on temporal windows, operational types, and spatial positions, allowing for the execution of supplementary commands like undo, redo, and replay across batches rather than individual commands, maintaining a fluid user experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If individual commands are reversed or re-executed in VR environment, then command precision is maintained, but device complexity and ease of operation deteriorate due to need to manage numerous small gestures

Engineering Contradiction:
Improvecommand precisionVSAvoidease of command reversal
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent merges multiple individual commands into batches based on temporal proximity and command type similarity. Commands within a time window that share the same operational category (e.g., manipulation, navigation, communication) are grouped together, allowing users to reverse or re-execute entire batches with a single gesture rather than managing each command separately.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent segments the command history into distinct batches using temporal windows and command type classification. This segmentation organizes the continuous stream of commands into manageable groups, where each batch can be independently managed, reversed, or re-executed based on user intent and operational context.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If multiple user commands are processed individually, then command accuracy is maintained, but productivity deteriorates due to excessive user input requirements

Engineering Contradiction:
Improvecommand accuracyVSAvoiduser interaction efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

Multiple commands from different users or sequential user actions are merged into single batches when they occur within a temporal window and share command type characteristics. This merging reduces the number of separate undo/redo operations needed, improving interaction efficiency while preserving the ability to accurately reverse or re-execute specific command groups.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system performs preliminary classification and batching of commands before user reversal or re-execution actions are required. By pre-organizing commands into meaningful batches based on temporal and categorical criteria, the system reduces the cognitive load and input requirements for users managing multiple commands.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If commands are batched by temporal window, then ease of operation improves, but manufacturing precision deteriorates in terms of command grouping accuracy

Engineering Contradiction:
Improvecommand batch managementVSAvoidcommand grouping precision
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent applies local quality by combining temporal window batching with command type classification. Within each temporal window, commands are further differentiated by their operational category (manipulation, navigation, communication, etc.), ensuring that batches contain semantically related commands. This localized refinement maintains grouping precision while preserving the ease of batch-based management.

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP3639116B1Intelligent command batching in an augmented and/or virtual reality environment
Publication Date: 2023.05.24 GOOGLE LLC
  • EP3639116B1 patent drawingFigure 1
  • EP3639116B1 patent drawingFigure 2A~2B
  • EP3639116B1 patent drawingFigure 3

AI summary

In an augmented reality and/or a virtual reality system, detected commands may be intelligently batched to preserve the relative order of the batched commands while maintaining a fluid virtual experience for the user. Commands detected in the virtual environment may be assigned to a batch command, of a plurality of batch commands, based on a temporal window in which the command(s) are detected, based on an operational type associated with the command(s), or based on a spatial position at which the command is detected in the virtual environment. The commands included in a batched set of commands may be executed in response to an un-do command and/or a re-do command and/or a re-play command.