Two-Handed VR Object Manipulation via Anchor Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual reality technologies face challenges in providing intuitive and precise manipulation of three-dimensional objects within a VR environment, particularly in scaling, rotating, and modifying objects using two-handed interactions, which affects user perception and interaction efficiency.

Innovation Solution

A computer-implemented method and system that generates a virtual environment within a head-mounted display device, detecting interaction patterns from multiple devices to modify three-dimensional virtual objects, enabling features like uniform scaling, stretching, and twisting through anchor points and snap-to-location functionality, allowing users to manipulate objects with six degrees of freedom.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If object manipulation techniques are configured to operate on a particular object or environment, then the manipulation capability is improved, but the complexity of controlling multiple degrees of freedom increases

Engineering Contradiction:
Improvemanipulation capabilityVSAvoidcontrol complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the object manipulation into two independent interaction patterns: a first interaction pattern for selecting and anchoring a first degree of freedom, and a second interaction pattern for selecting and modifying a second degree of freedom. This segmentation allows complex 6-DOF manipulation to be broken down into manageable, independent control steps, reducing the perceived complexity while maintaining full manipulation capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements preliminary action by requiring the user to first establish an anchor point on the object before performing manipulation. The first interaction pattern pre-positions the control system by selecting and anchoring a reference degree of freedom, which then serves as the basis for subsequent manipulation operations. This preliminary anchoring simplifies the second manipulation step by providing a fixed reference frame.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If multiple interaction patterns are detected for modifying different virtual features, then the precision of object manipulation is improved, but the time required for interaction increases

Engineering Contradiction:
Improvemanipulation precisionVSAvoidinteraction time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent implements dynamic interaction where the system adapts its response based on the detected interaction pattern. The first interaction pattern dynamically establishes anchor points that constrain subsequent manipulation to specific degrees of freedom, while the second interaction pattern dynamically modifies the selected feature. This dynamic adaptation allows precise control without requiring users to pre-plan all manipulation parameters, reducing interaction time while maintaining precision.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system provides visual feedback by displaying the modified version of the three-dimensional virtual object in real-time within the virtual environment. This feedback mechanism allows users to immediately see the effect of their manipulation operations, enabling precise control through iterative adjustment rather than requiring multiple sequential steps, thus reducing overall interaction time while maintaining high precision.

Inventive Principle:
Principle #23Feedback

3Loss of information

If real-time rendering of modified objects is implemented, then the user perception is improved, but the computational load increases

Engineering Contradiction:
Improvevisual feedback qualityVSAvoidcomputational energy
Core Design Contradiction:
Loss of informationVSUse of energy by moving object

Solution Approach 1:

The patent applies local quality by rendering modifications only at the specific anchor points and affected regions rather than re-rendering the entire virtual environment. The system modifies the three-dimensional virtual object locally at the anchored degrees of freedom based on the detected interaction patterns, providing high-quality visual feedback only where changes occur. This localized rendering approach maintains excellent visual feedback quality while significantly reducing the computational energy required compared to full-scene re-rendering.

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP3400499B1Two-handed object manipulations in virtual reality
Publication Date: 2021.02.17 GOOGLE LLC
  • EP3400499B1 patent drawingFigure 1
  • EP3400499B1 patent drawingFigure 2
  • EP3400499B1 patent drawingFigure 3A

AI summary

Systems and methods are described for generating a virtual environment including at least one three-dimensional virtual object within a user interface provided in a head mounted display device, detecting a first interaction pattern and a second interaction pattern. In response to detecting the second interaction pattern, a modified version of the three-dimensional virtual object at the first virtual feature is generated according to the first interaction pattern and at the second virtual feature according to the second interaction pattern. The modified version of the three-dimensional virtual object is provided in the user interface in the head mounted display device.