3D Virtual Environment Interaction Using Planar Reference Frame

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current interaction methods in 3D virtual environments are time-consuming and complex, requiring precise knowledge of interaction locations and involving cumbersome manipulations with two-dimensional cursors, which limits efficient interaction within these environments.

Innovation Solution

A 3D virtual environment interaction system that includes a processing unit, a display unit, and a portable input device with a planar reference frame and position/orientation sensor, allowing users to control the position and orientation of the planar reference frame in real-world space, enabling intuitive interactions such as drawing, selecting, scaling, and moving objects within the 3D environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a two-dimensional cursor controlled by a computer mouse is used for interaction, then the user can indicate interaction locations in the 3D virtual environment, but the user must bring objects within the static workplane which involves complex and time-consuming manipulations such as hiding other objects and modifying the point of view

Engineering Contradiction:
Improveease of interactionVSAvoidtime required for manipulation
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent transitions from a two-dimensional cursor interface to a three-dimensional pointer interface that operates within the 3D virtual environment space. The pointer has position and orientation in 3D space, allowing direct interaction with objects regardless of their spatial location, eliminating the need to manipulate objects into a static 2D workplane.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The pointer is designed to be dynamic in both position and orientation, controlled by six degrees of freedom. This allows the pointer to adapt its orientation to match the orientation of surfaces and objects it interacts with, providing intuitive and efficient interaction without requiring static workplane adjustments.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If a two-dimensional cursor is used for interaction, then the user can select objects, but the user must bring said object within the workplane which requires manipulations within the 3D environment such as hiding other objects and modifying the point of view

Engineering Contradiction:
Improveprecision of interaction locationVSAvoidcomplexity of interaction system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The interaction system moves from 2D cursor coordinates to 3D pointer coordinates, allowing precise indication of interaction locations in three-dimensional space. The pointer's 3D position and orientation provide accurate spatial reference for selecting and manipulating objects without requiring complex workplane adjustments.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Loss of information

If keyboard commands with preprogrammed instructions are used for interaction, then the user can input commands corresponding to certain interactions, but the method is fastidious and time-consuming and requires precise knowledge of the location where the interaction will be performed

Engineering Contradiction:
Improveknowledge required of interaction locationVSAvoidtime required for interaction
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent replaces the mechanical keyboard input system with a spatial pointer system. Instead of requiring users to input commands and coordinates through keyboard keys, the pointer directly indicates interaction locations through its 3D position and orientation, making the interaction more intuitive and less time-consuming.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This system simplifies interactions by allowing users to perform tasks like drawing, selecting, scaling, and moving objects with ease, reducing the complexity and time required for navigation and manipulation within 3D virtual environments.

Implementation Method 1

a position and orientation sensor for monitoring the position and orientation of the planar input surface in a real-world space

Methodology Applied
Scientific EffectPosition and orientation sensing:

Data Source

PatentUS10290155B23D virtual environment interaction system
Publication Date: 2019.05.14 VALORISATION RECHERCHE LIMITED PARTNERSHIP
  • US10290155B2 patent drawing
  • US10290155B2 patent drawing
  • US10290155B2 patent drawing

AI summary

There is provided a 3D virtual environment interaction system comprising: a processing unit for generating a 3D virtual environment comprising a planar reference frame for allowing a user to perform a user interaction with the 3D virtual environment; a display unit for displaying the generated 3D virtual environment; a portable input device for allowing the user to control the position and orientation of the planar reference frame within the generated 3D virtual environment, the portable input device comprising a planar input surface; a position and orientation sensor for monitoring the position and orientation of the planar input surface in a real-world space, the position and orientation sensor allowing the processing unit to modify at least one of the position and the orientation of the planar reference frame in response to a change in a corresponding one of the position and orientation of the planar input surface.