VR Hand Tracking Gesture Rewind

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In virtual reality environments, users lack an effective mechanism for undoing actions, as traditional 2D interface mechanics like 'undo' buttons are undesirable and existing solutions do not provide intuitive temporal manipulation tools for users immersed in virtual worlds.

Innovation Solution

A VR interaction system that uses hand tracking devices to record user actions and provide gesture-based temporal control, allowing users to enter 'record', 'rewind', and 'forward' modes, enabling them to visually review and undo changes by performing specific hand gestures, such as circular motions with handhelds or fingers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional 2D interface mechanics (undo buttons) are projected into VR environment, then users can undo actions, but the interface becomes less immersive and undesirable

Engineering Contradiction:
ImproveUndo functionalityVSAvoidImmersiveness
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent replaces the traditional 2D button-based mechanical interface with a gesture-based interaction system. Hand tracking devices capture user hand movements, and the system translates these gestures into temporal manipulation commands (rewind, forward, pause), eliminating the need for projected buttons while maintaining undo functionality in an immersive VR environment

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent transitions from 2D interface elements to 3D spatial gestures. Instead of pressing a 2D button, users perform hand gestures in three-dimensional space, leveraging the natural degrees of freedom of human hands to control temporal manipulation. This dimensional shift enhances immersion by using the user's own body as the interface

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If gesture-based temporal control is implemented, then users can intuitively undo actions, but the system complexity increases

Engineering Contradiction:
ImproveTemporal manipulationVSAvoidHand tracking system
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The hand tracking system serves multiple functions: it tracks hand position, detects gestures for temporal manipulation (rewind, forward, pause), and provides natural input without requiring additional physical controllers. By making the hand tracking system multi-functional, the patent reduces the need for separate interface devices while maintaining intuitive control

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses the user's own hands as the input device, eliminating the need for external controllers or specialized hardware. The hand tracking technology processes natural hand movements directly, making the user's body the interface itself and reducing dependency on complex external control mechanisms

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9928662B2System and method for temporal manipulation in virtual environments
Publication Date: 2018.03.27 UNITY TECH APS
  • US9928662B2 patent drawing
  • US9928662B2 patent drawing
  • US9928662B2 patent drawing

AI summary

A system includes a first and a second hand tracking device, the first and second hand tracking devices being configured to provide position information associated with hands of a user; hardware processors; a memory; and a temporal manipulation module. The temporal manipulation module is configured to perform operations including recording changes made in a virtual reality (VR) environment involving the user, thereby creating a recorded content, detecting a first revolution gesture performed by the user with the first and second hand tracking devices, the first revolution gesture including the first and second hand tracking devices revolving in a circular motion about a common axis, stopping the recording based on detecting the first revolution gesture, rewinding through the recorded content based on the first revolution gesture and, during the rewinding, displaying the recorded content in the VR environment, the displaying including altering the VR environment based on the recorded content.