3D User Interface Apparatus for Intuitive Virtual Space Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current three-dimensional user interfaces for operating virtual environments are not intuitive, as they rely on two-dimensional input devices, making it difficult for users to understand and interact with virtual three-dimensional spaces effectively.

Innovation Solution

A three-dimensional user interface system that utilizes a three-dimensional sensor to acquire and process information about a user's movements, allowing for intuitive operations within a virtual three-dimensional space by generating and displaying virtual data corresponding to the user's gestures, enabling direct manipulation of virtual objects within the space.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a two-dimensional input device is used to operate a three-dimensional environment, then the operation can be performed with existing devices, but it becomes difficult to intuitively understand and interact with the virtual three-dimensional space

Engineering Contradiction:
Improvecompatibility with existing devicesVSAvoidintuitiveness of operation
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent transitions from two-dimensional input devices to three-dimensional input methods by capturing the user's actual three-dimensional movements and gestures. The system acquires three-dimensional position information of the user's body parts and maps these movements directly to operations in the virtual three-dimensional space, enabling intuitive interaction that matches the spatial dimensionality of the environment being operated.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If a depth camera is used to detect positional changes for triggering input commands, then three-dimensional interaction can be achieved, but additional equipment is required which complicates the system

Engineering Contradiction:
Improvethree-dimensional interaction capabilityVSAvoidadditional equipment requirements
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent utilizes the imaging unit already present in the information processing device for both display and three-dimensional input detection purposes. By processing the captured images to extract three-dimensional position information of the user's body parts, the system achieves multi-functionality where a single device component serves both visualization and interaction detection roles, reducing the need for additional specialized equipment.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Device complexity

If only movement operation is provided for virtual objects, then the operation method is simple, but comprehensive interaction with the virtual three-dimensional space is limited

Engineering Contradiction:
Improvesimplicity of operation methodVSAvoidcomprehensiveness of interaction
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent dynamically determines the type of operation to be performed based on the user's gestures and the context within the virtual three-dimensional space. The system can perform various operations including movement, selection, manipulation, and other interactions by analyzing the user's three-dimensional movements and the spatial relationships between virtual objects, providing comprehensive interaction capabilities while maintaining intuitive and adaptable operation methods.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9495068B2Three-dimensional user interface apparatus and three-dimensional operation method
Publication Date: 2016.11.15 NEC SOLUTION INNOVATORS LTD
  • US9495068B2 patent drawing
  • US9495068B2 patent drawing
  • US9495068B2 patent drawing

AI summary

A three-dimensional user interface apparatus includes a three-dimensional information acquisition unit acquiring three-dimensional information from a three-dimensional sensor; a position calculation unit calculating three-dimensional position information on a three-dimensional coordinate space regarding a specific part of a target person by using the three-dimensional information; a virtual data generation unit generating virtual three-dimensional space data indicating a virtual three-dimensional space which is disposed in the three-dimensional coordinate space and at least part of which is set in a display region; a space processing unit performing a predetermined process corresponding to a change in the three-dimensional position information regarding the specific part of the target person, on the three-dimensional coordinate space or the virtual three-dimensional space data; and a display processing unit displaying the virtual three-dimensional space within the display region on a display unit on the basis of virtual three-dimensional space data obtained through the predetermined process.