Vibro-acoustic Touch Classification for Multi-layer Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current touch screens do not distinguish between different types of finger contacts, treating all finger touches as the same, which limits the complexity of interactions possible on a single point in space and does not utilize the diverse motor capabilities and anatomical composition of fingers effectively.
Innovation Solution
A system that uses vibro-acoustic sensors to classify touch events based on the finger part used, allowing for activation of functions in different interactive layers, such as traditional application layers or gesture layers, by distinguishing between fingertip, knuckle, and fingernail contacts.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If all finger touches are treated as a single class of input, then the system is simple to implement, but the interactive capabilities are limited
Solution Approach 1:
The patent segments finger touches into multiple classes based on the anatomical part of the finger used (tip, pad, side, knuckle, nail). This segmentation allows the system to distinguish between different types of contacts and activate different functions accordingly, thereby enhancing interactive capabilities without requiring invasive instrumentation
Solution Approach 2:
The patent changes the parameter of touch classification from a single unified category to multiple categories based on anatomical characteristics. By analyzing vibro-acoustic signals and contact properties, the system identifies which part of the finger is touching the screen and routes the input to appropriate interaction layers, thus improving versatility while maintaining system simplicity
2Adaptability or versatility
If finger overloading is used to perform different operations at a single point, then additional functions can be accessed, but the input method becomes more complex and less intuitive
Solution Approach 1:
The patent applies local quality by associating specific anatomical regions of the finger with specific functions. Different parts of the finger (tip, pad, side, knuckle, nail) are mapped to different interaction layers and functions, allowing users to access diverse operations through natural variations in their touching behavior rather than through complex multi-step input sequences
3Adaptability or versatility
If buttons are added to separate functions, then interaction complexity increases, but screen real estate is reduced
Solution Approach 1:
The patent makes the touch screen universally responsive to multiple types of finger contacts at the same spatial location. Instead of requiring separate buttons for different functions, the system allows a single point on the screen to trigger different functions based on which part of the finger touches it, thereby maintaining full screen real estate while providing access to multiple interaction layers
4Measurement precision
If invasive instrumentation is used to enhance finger input capabilities, then more detailed input classification is possible, but user comfort and simplicity are reduced
Solution Approach 1:
The patent employs self-service by using the finger's own anatomical characteristics and naturally produced vibro-acoustic signals as the identification marker. The system analyzes the inherent properties of different finger parts (shape, material, vibration characteristics) to classify touches, eliminating the need for external sensors or invasive instrumentation while maintaining high detection precision
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables more nuanced and complex interactions by allowing specific finger parts to trigger different functions, enhancing the interactive capabilities of touch screens without requiring invasive instrumentation or overloading of finger inputs.
Implementation Method 1
one or more vibro-acoustic sensors (i.e., mechanical vibrations and/or sound) operating inside a computing device
Implementation Method 2
one or more vibro-acoustic sensors and to capture, save and/or buffer vibro-acoustic signals sensed
Data Source
AI summary
A system for classifying touch events of different interaction layers includes a touch screen configured to display an interactive element, one or more vibro-acoustic sensors coupled to the touch screen, a touch event detector configured to monitor the one or more vibro-acoustic sensors and to save vibro-acoustic signals sensed by the one or more vibro acoustic sensors, wherein the touch event detector is further configured to detect touch events in which the interactive element is touched by a first or a second finger part of a user, and wherein the touch events result in generating the vibro-acoustic signals, and a vibro-acoustic classifier is configured to classify the vibro-acoustic signals and activate corresponding functions in the different layers dependent upon which finger part is used.