Multi-Sensor Gesture Recognition With Adaptive Sampling Cycles

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional inertial measurement unit-based systems struggle to accurately recognize finger or hand joint movements due to small acceleration variations and environmental factors, leading to inaccurate gesture recognition.

Innovation Solution

An electronic device equipped with a sensor unit comprising a first and second sensor, and a processor that controls the sensors to sense signals at different cycles based on a given condition, using a combination of acceleration and biometric signals to enhance gesture recognition accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If acceleration sensor is used to recognize gestures, then the system can detect forearm movements, but it fails to accurately recognize fine finger or hand joint movements due to small acceleration variations

Engineering Contradiction:
Improvegesture recognition accuracyVSAvoiddetection sensitivity for fine movements
Core Design Contradiction:
Measurement precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The patent combines multiple sensor types (acceleration sensor, gyro sensor, and optionally other sensors like PPG or ECG) to create a multi-sensor fusion system. This merging allows the system to detect both large-scale forearm movements and fine finger movements by leveraging the complementary strengths of different sensors, thereby improving gesture recognition accuracy without being limited by the small acceleration variations of fine movements alone.

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If the sensor sampling cycle is shortened to improve gesture recognition accuracy, then recognition precision improves, but battery consumption increases

Engineering Contradiction:
Improvegesture recognition accuracyVSAvoidbattery consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent implements dynamic sampling cycle adjustment where the sensor sampling rate is adaptively changed based on the detected movement state. During periods of no or minimal movement, the sampling cycle is extended to reduce power consumption. When movement is detected (indicating potential gesture activity), the sampling cycle is shortened to improve recognition accuracy. This dynamic adjustment resolves the contradiction between precision and energy consumption.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system employs periodic sampling with variable periods, switching between long sampling cycles (for power saving) and short sampling cycles (for accurate detection). This periodic action with adaptive period length allows the system to maintain gesture recognition capability while significantly reducing average power consumption during idle periods.

Inventive Principle:
Principle #19Periodic action

3Measurement precision

If multiple sensors operate at high sampling rates to improve gesture recognition, then recognition accuracy improves, but power consumption and device complexity increase

Engineering Contradiction:
Improvegesture recognition accuracyVSAvoidsensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the sensing function across multiple sensor types, each optimized for specific detection tasks. The acceleration sensor handles large-scale movements, the gyro sensor captures rotational movements, and optional biometric sensors detect fine finger movements. This segmentation allows the system to achieve high recognition accuracy without requiring all sensors to operate at maximum capacity simultaneously, thereby managing complexity more effectively.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically changes operational parameters (sampling rates, activation states) of different sensors based on the current context and detected movement patterns. Not all sensors operate at full capacity continuously; instead, their parameters are adjusted to provide necessary data while minimizing power consumption and effective complexity. This parameter optimization resolves the contradiction between accuracy and complexity.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11790698B2Electronic device for recognizing gesture of user using a plurality of sensor signals
Publication Date: 2023.10.17 SAMSUNG ELECTRONICS CO LTD
  • US11790698B2 patent drawing
  • US11790698B2 patent drawing
  • US11790698B2 patent drawing

AI summary

Disclosed is an electronic device. The electronic device includes a sensor unit that includes a first sensor and a second sensor, and a processor that is operatively connected with the sensor unit. The processor determines whether a given condition is satisfied, by using a first sensor signal of a user sensed by the first sensor, controls the first sensor to sense the first sensor signal every first cycle and controls the second sensor to sense a second sensor signal from the user every second cycle longer than the first cycle when the given condition is not satisfied, controls the second sensor to sense the second sensor signal every third cycle shorter than the second cycle when the given condition is satisfied, and recognize a gesture of the user by using the first sensor signal sensed every first cycle and the second sensor signal sensed every third cycle.