3D User Interface with Spatial Gesture Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The portability of computing devices constrains display size, making it difficult to present increasing amounts of information effectively to users, limiting user interaction and experience.

Innovation Solution

A portable electronic device with a display that conveys stereoscopic 3-D information, utilizing a displacement sensor to capture spatial-position information and control logic to analyze and associate changes in 3-D spatial position with icons, allowing for interactive operations such as modifying icon information, location, or executing applications without direct touch.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If display size is increased to present more information, then information capacity is improved, but device portability deteriorates

Engineering Contradiction:
Improveinformation capacityVSAvoiddevice size
Core Design Contradiction:
Quantity of substanceVSVolume of moving object

Solution Approach 1:

The patent applies dimensionality change by transitioning from a traditional 2-D display interface to a 3-D spatial interface. Multiple 2-D fields are arranged in 3-D space with spatial offsets, allowing users to perceive depth and interact with icons positioned at different distances from the display surface. This enables significantly more information to be displayed within the same physical device dimensions, resolving the contradiction between information capacity and device portability.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If display size is increased to provide more interaction space, then user interaction capability is improved, but device portability deteriorates

Engineering Contradiction:
Improveuser interaction capabilityVSAvoiddevice size
Core Design Contradiction:
Ease of operationVSVolume of moving object

Solution Approach 1:

The patent extends interaction space by utilizing 3-D spatial positioning instead of 2-D screen real estate. Users can interact with icons positioned at various depths and locations in 3-D space, providing more interaction opportunities without increasing the physical device footprint. The displacement sensor enables detection of 3-D gestures, further enhancing interaction capability within compact dimensions.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances user interaction and information management by providing additional spatial degrees of freedom and increasing effective display real estate, improving user experience and satisfaction.

Implementation Method 1

a display that conveys stereoscopic information which allows a viewer to perceive 3-dimensional (3-D) depth

Methodology Applied
Scientific EffectStereoscopic display:

Implementation Method 2

the displacement sensor determines the distance based on time of flight

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentUS9338432B1Mobile device with 3-dimensional user interface
Publication Date: 2016.05.10 INTUIT INC
  • US9338432B1 patent drawing
  • US9338432B1 patent drawing
  • US9338432B1 patent drawing

AI summary

A portable electronic device provides signals corresponding to information to a display that allows a viewer to perceive 3-dimensional (3-D) depth, where the information includes multiple icons in a user interface that are arranged in 2-dimensional (2-D) fields that are spatially offset along a direction orthogonal to the 2-D fields. Then, the portable electronic device captures spatial-position information (such as a distance with respect to a surface of the display) associated with at least a digit of the viewer. The portable electronic device analyzes the spatial-position information to determine a change in a 3-D spatial position of at least the digit, and associates the change in the 3-D spatial position with at least one of the icons. Next, the portable electronic device performs the operation based on the change in the 3-D spatial position and at least the one of the icons.