3D Interactive Display Using Passive Angled Finger Tracking

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing two-dimensional input devices for electronic devices are limited in providing flexible and efficient user interaction, particularly in small spaces, with high energy consumption and cost.

Innovation Solution

A three-dimensional interactive display system that detects the position of a user or an optical emitter device along three dimensions using a combination of passive devices with angled surfaces, optical emitter devices, depth sensors, and processors, allowing for natural body movements and low-cost, low-energy interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If two-dimensional input devices are used, then device simplicity is maintained, but user interaction flexibility and efficiency deteriorate

Engineering Contradiction:

Improveuser interaction flexibilityVSAvoidinput device complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical input devices (keyboard, mouse) with an optical detection system that uses light emitters, image sensors, and processors to detect hand positions and gestures in three-dimensional space, enabling flexible interaction without physical contact

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system transitions from two-dimensional input device interaction to three-dimensional spatial interaction by detecting hand positions along x, y, and z axes, allowing users to interact with the display from multiple dimensions and perspectives

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

2Productivity

If traditional input devices are used, then device portability is maintained, but interaction efficiency in small spaces deteriorates

Engineering Contradiction:

Improveinteraction efficiencyVSAvoidinteraction space requirement

Core Design Contradiction:

ProductivityVSArea of stationary object

Solution Approach 1:

The patent replaces space-consuming mechanical input devices with an optical gesture recognition system that detects hand movements and positions in three-dimensional space, enabling efficient interaction in limited physical spaces through natural body movements

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If optical detection system is implemented, then user interaction flexibility is improved, but energy consumption increases

Engineering Contradiction:

Improveinput capability flexibilityVSAvoidsystem energy consumption

Core Design Contradiction:

Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The system uses periodic alternation between gesture mode and ranging mode, where the depth sensor emitter is activated only during ranging mode to determine z-coordinates, while gesture mode uses only the passive optical tracking, reducing overall energy consumption through selective activation of high-power components

Inventive Principle:

Principle #19Periodic action

4Measurement precision

If passive device with angled surfaces is used, then finger detection precision is improved, but device complexity increases

Engineering Contradiction:

Improvefinger position detection precisionVSAvoidpassive device structure

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The passive device incorporates angled surfaces that reflect light in specific patterns, using geometric optics principles to enhance the detectability and precision of finger position without requiring active electronic components or complex mechanisms

Inventive Principle:

Principle #14Spheroidality (Curvature)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables flexible and efficient user interaction in small spaces with reduced energy consumption and cost, allowing users to interact with electronic devices using natural body movements.

Implementation Method 1

The depth sensor determines a z-coordinate of the optical emitter device using, for example, time-of-flight techniques

Methodology Applied

Scientific EffectTime of flight: Time of Flight

Implementation Method 2

The passive device includes a plurality of angled surfaces to reflect detection signals emitted by the system

Methodology Applied

Scientific EffectReflection: Reflection

Implementation Method 3

The optical emitter device emits light, such as an infrared light signal; and the system tracks the optical emitting device by detecting the light emitted by the optical emitter device

Methodology Applied

Scientific EffectLight emission: Light

Data Source

PatentUS12282612B2Three-dimensional interactive display

Publication Date: 2025.04.22 STMICROELECTRONICS (RES & DEV) LTD

AI summary

The present disclosure is directed to a three-dimensional interactive display system. The system detects a position of a user (e.g., the user's finger or hand) or an optical emitter device, along three different dimensions. In a case where the system detects a position of a user's finger, the user wears a passive device having angled surfaces on his or her finger to improve detection of the user's finger. In a case where the system detects the optical emitter device, the user holds the optical emitter device or wears the optical emitter device similar to the passive device. The optical emitter device emits light, and the system tracks the optical emitting device by detecting the light emitted by the optical emitter device.