Vibro-acoustic Touch Type Classification Using Proximity Triggered Buffering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current touch-sensitive technologies fail to reliably distinguish between different touch types, such as finger pads, nails, and instruments, due to sensing latency and processing delays, which results in missed vibro-acoustic data and inaccurate touch type classification.

Innovation Solution

The system predicts the occurrence of a touch event using proximity sensing, allowing for pre-emptive capture and buffering of vibro-acoustic data, ensuring that the most informative part of the signal is captured, even before the touch event trigger is received, and uses this data to determine the touch type and execute specific actions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the system waits for the touch event trigger to be received before capturing vibro-acoustic data, then the system avoids false positives and maintains processing efficiency, but the most informative part of the vibro-acoustic signal is lost due to sensing latency and processing delays

Engineering Contradiction:
Improvetouch type classification accuracyVSAvoidsensing latency
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system continuously captures and buffers vibro-acoustic data before a touch event is officially triggered. This preliminary action ensures that when a touch event occurs, the vibro-acoustic signal has already been captured and is available for immediate analysis, eliminating the loss of critical signal information due to sensing latency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

A buffer is introduced as an intermediary component between the vibro-acoustic sensor and the processing system. This buffer temporarily stores the vibro-acoustic data, allowing the system to retrieve and analyze the complete signal even when there are processing delays or latency in touch event detection.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If the system continuously captures and buffers vibro-acoustic data, then complete touch type information is available for classification, but the system consumes more energy and processing resources

Engineering Contradiction:
Improvetouch type classification accuracyVSAvoidenergy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary capture of vibro-acoustic data at a lower processing level continuously, so that when a touch event is detected, the data is already prepared and buffered. This allows the higher-level processing to focus only on analyzing the pre-captured data rather than continuously processing and analyzing all incoming data in real-time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system captures vibro-acoustic data continuously (excessive action) to ensure complete signal capture, but only processes and analyzes the data when a touch event is actually detected. This partial processing approach balances the need for complete data capture with energy efficiency.

Inventive Principle:
Principle #16Partial or excessive action

3Adaptability or versatility

If the system processes touch events through multiple software layers and the operating system, then comprehensive touch type determination is achieved, but significant processing time and latency are introduced

Engineering Contradiction:
Improvetouch interaction capabilityVSAvoidprocessing delay
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The vibro-acoustic data capture and buffering is performed in advance at the sensor level, before the touch event propagates through multiple software layers. This preliminary capture ensures that the time-critical signal data is already available when higher-level processing begins, reducing the overall processing delay.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The processing architecture is segmented into independent layers: the sensor layer continuously captures and buffers vibro-acoustic data, while the application layer processes this pre-captured data. This segmentation allows each layer to operate independently and efficiently, reducing inter-layer communication overhead and processing latency.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables reliable classification of touch types, allowing for varied actions based on the type of touch, enhancing user interaction with electronic devices by utilizing the full range of finger and hand capabilities.

Implementation Method 1

an acoustic sensor captures a vibro-acoustic signal generated by the physical touch event

Methodology Applied
Scientific EffectVibro-acoustic sensing: Acoustic Emission

Data Source

PatentEP3028125B1Capture of vibro-acoustic data used to determine touch types
Publication Date: 2023.04.05 QEEXO
  • EP3028125B1 patent drawingFigure 1~2A
  • EP3028125B1 patent drawingFigure 2B~2C
  • EP3028125B1 patent drawingFigure 3A~3B

AI summary

An electronic device includes a touch-sensitive surface, for example a touch pad or touch screen. The user physically interacts with the touch-sensitive surface, producing touch events. The resulting interface actions taken depend at least in part on the touch type. The type of touch is determined in part based on vibro-acoustic data and touch data produced by the touch event.