3D Gesture Interface State Transition via Depth Sensors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current user interfaces rely on tactile methods, which can be limiting in terms of engagement and disengagement, particularly in three-dimensional spaces, and lack efficient non-tactile interaction mechanisms for controlling computer systems.

Innovation Solution

A non-tactile three-dimensional user interface system utilizing 3D sensing technology to recognize gestures, such as push and wave motions, to transition between states, allowing users to engage and disengage control of the interface without physical contact, using 3D sensors and visual feedback to enhance user interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If tactile interface devices (keyboard, mouse, joystick) are used, then reliable input control is achieved, but user engagement and disengagement becomes limiting and less intuitive

Engineering Contradiction:
Improveuser engagement and disengagementVSAvoidinterface interaction mechanism
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces traditional tactile mechanical input devices (keyboard, mouse, joystick) with a depth-perceptive sensing system that detects hand gestures in three-dimensional space. This substitution eliminates the need for physical contact with input devices while maintaining reliable control, allowing users to engage and disengage the interface more naturally through gesture presence and absence.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent transitions from two-dimensional tactile interfaces to three-dimensional gesture-based interaction by utilizing depth perception. The depth-perceptive sensor captures hand position, orientation, and motion in 3D space, enabling more intuitive engagement and disengagement gestures that leverage the additional spatial dimension for natural user interaction.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If traditional tactile interfaces are used, then control reliability is maintained, but interaction efficiency and intuitiveness in three-dimensional spaces deteriorates

Engineering Contradiction:
Improveinteraction efficiencyVSAvoidintuitiveness in three-dimensional spaces
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent replaces mechanical input devices with optical depth-sensing technology that tracks hand gestures in three-dimensional space. This enables more efficient interaction by allowing users to perform multiple gestures sequentially (such as focus, select, and confirm gestures) without physical device manipulation, improving interaction efficiency while maintaining intuitiveness through natural hand movements.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If depth-perceptive sensors are implemented, then gesture recognition capability is improved, but system complexity and cost increases

Engineering Contradiction:
Improvegesture recognition capabilityVSAvoidsensing system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a depth-perceptive sensor system that serves multiple functions: detecting hand presence for engagement/disengagement, tracking hand position and orientation for gesture recognition, and providing spatial information for interface navigation. This multi-functionality increases adaptability and versatility while managing system complexity by consolidating sensing capabilities into a single sensor type.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9829988B2Three dimensional user interface session control using depth sensors
Publication Date: 2017.11.28 APPLE INC
  • US9829988B2 patent drawing
  • US9829988B2 patent drawing
  • US9829988B2 patent drawing

AI summary

A method, including receiving, by a computer executing a non-tactile three dimensional (3D) user interface, a set of multiple 3D coordinates representing a gesture by a hand positioned within a field of view of a sensing device coupled to the computer, the gesture including a first motion in a first direction along a selected axis in space, followed by a second motion in a second direction, opposite to the first direction, along the selected axis. Upon detecting completion of the gesture, the non-tactile 3D user interface is transitioned from a first state to a second state.