3D Gesture Recognition via Coupling Capacitance Z-Axis Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current gesture recognition systems using capacitive touch screens can only determine coordinates on a two-dimensional plane, failing to recognize complex gestures that require three-dimensional coordinate data.

Innovation Solution

A method and system that establish a spatial rectangular coordinate system with a Z-axis perpendicular to the touch screen surface, allowing for the acquisition of X-axis, Y-axis, and Z-axis coordinates by analyzing coupling capacitance changes between sensors and signal lines, enabling the recognition of complex gestures by generating movement trajectories based on these spatial coordinates.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional capacitive touch screen methods are used, then the system can detect touch positions on a two-dimensional plane, but it cannot recognize complex gestures that require three-dimensional coordinate data

Engineering Contradiction:
Improvegesture recognition capabilityVSAvoidspatial coordinate information
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent extends the traditional two-dimensional touch detection by introducing a Z-axis dimension through coupling capacitance measurement. By measuring capacitance changes between sensors and signal lines at different Z-axis positions, the system obtains three-dimensional spatial coordinates (X, Y, Z) of the operating body, enabling recognition of complex gestures that require depth information beyond the flat touch screen surface.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If coupling capacitance measurement is implemented to obtain Z-axis coordinates, then three-dimensional gesture recognition becomes possible, but the system complexity increases

Engineering Contradiction:
Improvespatial coordinate accuracyVSAvoidcapacitance measurement system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent utilizes the existing signal lines and sensors of the capacitive touch screen itself to measure coupling capacitance for Z-axis coordinate detection. The signal lines that are already part of the touch screen structure serve dual purposes: displaying images and acting as capacitance sensors for three-dimensional position detection. This self-service approach avoids adding separate complex measurement hardware, reducing overall system complexity while achieving three-dimensional gesture recognition.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the recognition of complex gestures by determining the Z-axis coordinate of an operating body, allowing for accurate three-dimensional gesture recognition on capacitive touch screens.

Implementation Method 1

acquiring a difference between first coupling capacitance and second coupling capacitance, and determining a Z-axis coordinate of the at least one operating body in the spatial rectangular coordinate system according to the difference, where the first coupling capacitance is coupling capacitance formed between the first sensor and a first signal line of the capacitive touch screen

Methodology Applied
Scientific EffectCoupling capacitance: Capacitance

Data Source

PatentUS12099712B2Gesture recognition method, apparatus and system based on coupling capacitance
Publication Date: 2024.09.24 BEIJING BOE OPTOELECTRONCIS TECH CO LTD
  • US12099712B2 patent drawing
  • US12099712B2 patent drawing
  • US12099712B2 patent drawing

AI summary

A gesture recognition method, apparatus and system based on coupling capacitance, which are configured to solve the technical problem in the prior art of it not being possible to recognize a complex gesture due to the fact that the coordinates of a manipulation body on a three-dimensional plane cannot be determined. The method comprises: establishing a spatial rectangular coordinate system by taking a first position point of a contact face of a capacitive touch screen as an origin; acquiring an X-axis coordinate and a Y-axis coordinate, in the spatial rectangular coordinate system, corresponding to a first sensor; acquiring the difference between a first coupling capacitance value and a second coupling capacitance value, and determining a Z-axis coordinate of at least one manipulation body in the spatial rectangular coordinate system according to the difference; and generating a movement trajectory of the at least one manipulation body according to a change in spatial coordinates of the at least one manipulation body in the spatial rectangular coordinate system, and identifying the movement trajectory to obtain a gesture recognition result.