Electromyographic Signal Processing for Multi-User Touch Identification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing touch interaction technologies struggle to accurately identify and differentiate between single users performing multi-touch operations with two hands or multiple users interacting in the same region, leading to confusing touch instructions.

Innovation Solution

A method and system that utilize electromyographic signal collection devices and location capturing devices to receive and process information about hand gestures, touch points, and operating forces, generating touch instructions based on synchronized start times and coordinate information to distinguish between different users and hands, thereby preventing confusing touch instructions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional touch detection methods are used to identify touch points, then the system can detect touch locations, but it cannot differentiate between different users or hands performing touches

Engineering Contradiction:
Improvetouch point identification accuracyVSAvoiduser and hand identification information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent segments the touch interaction by assigning different device identifiers to electromyographic signal collection devices worn on different hands or by different users. Each device independently collects and transmits touch information, enabling the system to distinguish between multiple sources of touch input without losing identification information.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces electromyographic signal collection devices as intermediary components between the user's hand and the touch screen. These devices detect muscle signals and transmit them to the processing device, serving as a mediator that captures and preserves information about which hand or user is performing the touch gesture.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Device complexity

If the system only tracks touch points without hand gesture recognition, then the processing is simple, but touch instructions become confusing when multiple hands or users are involved

Engineering Contradiction:
Improveprocessing complexityVSAvoidtouch instruction accuracy
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent performs preliminary classification of hand gestures by the electromyographic signal collection device before transmitting data to the processing device. The device identifies whether a touch is performed by the left hand, right hand, or specific fingers, and includes this classification in the transmitted information, enabling accurate touch instruction generation without overwhelming the processing device.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback by continuously receiving updated hand gesture information and touch point data from the electromyographic signal collection device. The processing device uses this feedback to dynamically generate and update touch instructions, ensuring accuracy even when multiple hands or users interact with the screen simultaneously.

Inventive Principle:
Principle #23Feedback

3Device complexity

If the system uses only location capturing devices, then the setup is simple, but it cannot identify hand gestures or distinguish between different touch operations

Engineering Contradiction:
Improvedevice configuration simplicityVSAvoidhand gesture recognition capability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The electromyographic signal collection device serves multiple functions: it detects muscle signals, identifies hand gestures, determines which hand is being used, and tracks touch points. This multi-functional device replaces the need for separate sensors for each function, maintaining relatively simple device configuration while significantly enhancing adaptability and gesture recognition capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate identification and execution of touch instructions for single users using two hands or multiple users in the same region, enhancing the precision and clarity of touch interactions.

Implementation Method 1

receiving first information sent by an electromyographic signal collection device, where the first information includes a device identifier of the electromyographic signal collection device, a hand gesture in which a user performs a touch, and a first touch start time

Methodology Applied
Scientific EffectElectromyographic signal: Electromagnetic Induction

Data Source

PatentUS10372325B2Electromyographic based touch interaction processing method, device, and system
Publication Date: 2019.08.06 HUAWEI TECH CO LTD
  • US10372325B2 patent drawing
  • US10372325B2 patent drawing
  • US10372325B2 patent drawing

AI summary

A touch interaction processing method, device, and system. The touch interaction processing method includes: receiving first information sent by an electromyographic signal collection device and second information sent by a location capturing device (101); if it is determined that a time gap between a first touch start time and a second touch start time is less than a preset threshold, and a quantity of touch points that is corresponding to a hand gesture is the same as a quantity of touch points that is included in the second information, generating a touch instruction, where the touch instruction includes a device identifier of the electromyographic signal collection device, the hand gesture, and coordinate information of each touch point (103); and performing an interaction operation corresponding to the touch instruction (105).