Ultrasonic Gesture Input for Compact Device Miniaturization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current user interfaces for electronic devices face challenges in miniaturization and usability, particularly in mobile and wireless devices, where traditional input methods conflict with the need for compact design while maintaining input capacity and usability.

Innovation Solution

The integration of ultrasonic transducers (USTs) as user input devices, which use high-frequency sound energy to detect finger positions and movements in 3D space, enabling real-time tracking and gesture recognition without the need for physical keyboards or extensive hardware, allowing for miniaturization of input devices while maintaining input capacity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional electromechanical switches (keyboards) are used for user input, then input capacity and usability are maintained, but device size increases and miniaturization is limited

Engineering Contradiction:
Improveinput capacityVSAvoiddevice size
Core Design Contradiction:
Ease of operationVSArea of stationary object

Solution Approach 1:

The patent replaces traditional electromechanical keyboard switches with an optical sensing system that detects finger gestures through optical properties. This substitution eliminates the need for physical mechanical components, enabling device miniaturization while preserving input functionality through gesture-based interaction

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The optical sensor system serves multiple functions: it detects finger presence, tracks finger movement trajectories, recognizes gesture patterns, and determines input commands. This multi-functionality consolidates what would traditionally require separate mechanical components into a single integrated sensing system

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Area of stationary object

If touch screen displays with embedded sensors are used, then device miniaturization is improved, but input capacity and gesture recognition capability are reduced

Engineering Contradiction:
Improvedevice sizeVSAvoidinput capacity
Core Design Contradiction:
Area of stationary objectVSAdaptability or versatility

Solution Approach 1:

The patent introduces an intermediary optical sensor system between the user's finger and the display surface. This intermediary detects optical properties (such as light reflection, absorption, or shadow) caused by finger gestures, enabling sophisticated gesture recognition without requiring direct contact with the display or additional physical input components

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If more sensors are added to increase input capacity, then gesture recognition capability is improved, but device complexity and hardware requirements increase

Engineering Contradiction:
Improvegesture recognition capabilityVSAvoidhardware requirements
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the gesture recognition process into distinct analytical stages: optical signal acquisition, finger position detection, trajectory calculation through vector analysis, gesture pattern matching, and command interpretation. This segmentation allows complex gesture recognition to be achieved through coordinated simple operations rather than requiring complex hardware

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution allows for compact, efficient user input systems that provide real-time feedback and support a wide range of gestures, enhancing usability and design freedom in devices like PDAs, gaming devices, and multimedia systems, while reducing the physical size of input devices and increasing display area.

Implementation Method 1

The integration of ultrasonic transducers (USTs) as user input devices, which use high-frequency sound energy to detect finger positions and movements in 3D space

Methodology Applied
Scientific EffectUltrasonic detection: Ultrasound

Data Source

PatentEP2717120B1Apparatus, methods and computer program products providing finger-based and hand-based gesture commands for portable electronic device applications
Publication Date: 2021.05.19 NOKIA TECHNOLOGIES OY
  • EP2717120B1 patent drawingFigure 1A~1B
  • EP2717120B1 patent drawingFigure 2A~2B
  • EP2717120B1 patent drawingFigure 3A~4D

AI summary

Embodiments provide a method, apparatus and computer program for detecting execution of a gesture performed with two or more user-manipulated physical objects (20A, 20B) in the vicinity of a device (10), said detecting comprising detecting a position of each of two or more user-manipulated physical objects (20A, 20B); displaying a pointer (12A), wherein the location of the displayed pointer is based on the position of one (20A) of the two or more user-manipulated physical objects (20A, 20B); generating data that is descriptive of the positions of the two or more user-manipulated objects (20A, 20B) when executing the gesture; and interpreting the data as pertaining to an object displayed by the device (10).