Augmented Reality 3D Subspace Selection via Gesture Refinement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality systems face challenges in precisely selecting 3D volumes in augmented spaces using bare hand gestures due to physical boundary conditions from real objects, making it difficult for users to interact with objects of interest effectively.

Innovation Solution

A system and method that utilize a targeting unit to acquire a first subspace based on user actions, and a refinement unit to adjust the position and scale of the subspace using two-handed pinch gestures, providing a top view for precise subspace selection and transformation into a desired 3D shape.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If existing indirect pointing techniques are used to select targets in augmented space, then users can interact with objects from a distance, but the precision of 3D volume selection is insufficient

Engineering Contradiction:
Improvedistance interaction capabilityVSAvoid3D volume selection precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The selection process is divided into two distinct phases: a targeting phase that establishes an initial selection volume using indirect pointing, and a refinement phase that allows precise adjustment of the volume boundaries. This segmentation enables users to first select a general region from a distance, then refine the selection precision without requiring direct contact with the target object.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary target acquisition through indirect pointing before the final selection is made. The initial selection volume is established in advance, and then users can adjust and refine this pre-selected volume using hand gestures, separating the coarse selection from fine-tuning operations.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If volumetric selection techniques are applied in augmented space, then 3D objects can be selected, but physical boundary conditions from real objects limit user interaction

Engineering Contradiction:
Improve3D object selection capabilityVSAvoiduser interaction freedom
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system introduces a virtual selection volume as an intermediary between the user and the target object. Users interact with this intermediate volume using hand gestures rather than directly manipulating the target object, which eliminates physical boundary constraints while maintaining precise selection capability.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces direct mechanical interaction with objects by using gesture-based control of virtual selection volumes. Hand gestures in the air substitute for physical contact with objects, allowing users to select and manipulate 3D volumes without being constrained by physical boundaries or requiring direct contact with target objects.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10409447B2System and method for acquiring partial space in augmented space
Publication Date: 2019.09.10 KOREA ADVANCED INST OF SCI & TECH
  • US10409447B2 patent drawing
  • US10409447B2 patent drawing
  • US10409447B2 patent drawing

AI summary

The present invention includes: a targeting unit configured to, when an event by a user's action is generated in a 3D image displayed on a display device, acquire a first subspace of a first three-dimensional (3D) shape corresponding to the user's action; and a refinement unit configured to acquire a second subspace of a second 3D shape, of which position and scale are adjusted according to a user's gesture within a range of the first subspace acquired by the targeting unit.