RF Sensor Array 3D Gesture Recognition Without Screen Obstruction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current touch-enabled devices face limitations in input methods, particularly with small screens where finger obstructions hinder visibility and large screens where interactions can be cumbersome, necessitating a touchless gesture detection solution.

Innovation Solution

A 3D gesture recognition system utilizing a 2D array of radio frequency (RF) sensor cells that detect object proximity by monitoring frequency responses, enabling accurate real-time 3D gesture recognition without line-of-sight and scalable for various device sizes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If touch sensors are used for interaction, then input capability is provided, but screen visibility is obstructed on small devices and interaction becomes cumbersome on large displays

Engineering Contradiction:
Improveinteraction capabilityVSAvoidscreen visibility
Core Design Contradiction:
Ease of operationVSArea of stationary object

Solution Approach 1:

The patent replaces mechanical touch sensors with an RF-based sensing system that detects gestures through electromagnetic fields. The sensor cell array detects changes in RF signals caused by object proximity and movement, enabling touchless gesture recognition that eliminates the need for physical contact with the screen surface.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces RF electromagnetic fields as an intermediary between the user and the device interface. Instead of direct touch, the system uses RF signal modulation caused by proximity objects to detect gestures, creating an indirect sensing mechanism that preserves screen visibility while maintaining interaction capability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If a sensor cell array operates at multiple frequencies, then measurement precision improves, but resource usage and power consumption increase

Engineering Contradiction:
Improvegesture recognition accuracyVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent implements periodic frequency scanning where the sensor cell array cycles through multiple frequencies in a systematic sequence. Instead of continuously operating at all frequencies simultaneously, the system periodically switches between frequencies, reducing instantaneous power consumption while still gathering comprehensive gesture data across the frequency spectrum.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent dynamically adjusts the operating frequency based on gesture detection needs. The system can concentrate measurements at specific frequencies when gestures are detected, rather than uniformly scanning all frequencies at constant intervals, optimizing the balance between measurement precision and power consumption.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables flexible, natural, and efficient touchless interaction by accurately tracking objects in three dimensions, reducing resource consumption and power usage, and allowing embedding behind any surface, thus overcoming the limitations of traditional touch sensors.

Implementation Method 1

a sensor cell array and a controller that can send signals at different frequencies to individual sensor cells of the sensor cell array

Methodology Applied
Scientific EffectRF signal detection: Electromagnetic Induction

Data Source

PatentEP3167355B13D gesture recognition
Publication Date: 2022.01.26 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP3167355B1 patent drawingFigure 1
  • EP3167355B1 patent drawingFigure 2
  • EP3167355B1 patent drawingFigure 3

AI summary

The description relates to 3D gesture recognition. One example gesture recognition system can include a gesture detection assembly. The gesture detection assembly can include a sensor cell array and a controller that can send signals at different frequencies to individual sensor cells of the sensor cell array. The example gesture recognition system can also include a gesture recognition component that can determine parameters of an object proximate the sensor cell array from responses of the individual sensor cells to the signals at the different frequencies, and can identify a gesture performed by the object using the parameters.