Multi-Sensor Gesture Recognition With Adaptive Sampling Cycles
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional inertial measurement unit-based systems struggle to accurately recognize finger or hand joint movements due to small acceleration variations and environmental factors, leading to inaccurate gesture recognition.
Innovation Solution
An electronic device equipped with a sensor unit comprising a first and second sensor, and a processor that controls the sensors to sense signals at different cycles based on a given condition, using a combination of acceleration and biometric signals to enhance gesture recognition accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If acceleration sensor is used to recognize gestures, then the system can detect forearm movements, but it fails to accurately recognize fine finger or hand joint movements due to small acceleration variations
Solution Approach 1:
The patent combines multiple sensor types (acceleration sensor, gyro sensor, and optionally other sensors like PPG or ECG) to create a multi-sensor fusion system. This merging allows the system to detect both large-scale forearm movements and fine finger movements by leveraging the complementary strengths of different sensors, thereby improving gesture recognition accuracy without being limited by the small acceleration variations of fine movements alone.
2Measurement precision
If the sensor sampling cycle is shortened to improve gesture recognition accuracy, then recognition precision improves, but battery consumption increases
Solution Approach 1:
The patent implements dynamic sampling cycle adjustment where the sensor sampling rate is adaptively changed based on the detected movement state. During periods of no or minimal movement, the sampling cycle is extended to reduce power consumption. When movement is detected (indicating potential gesture activity), the sampling cycle is shortened to improve recognition accuracy. This dynamic adjustment resolves the contradiction between precision and energy consumption.
Solution Approach 2:
The system employs periodic sampling with variable periods, switching between long sampling cycles (for power saving) and short sampling cycles (for accurate detection). This periodic action with adaptive period length allows the system to maintain gesture recognition capability while significantly reducing average power consumption during idle periods.
3Measurement precision
If multiple sensors operate at high sampling rates to improve gesture recognition, then recognition accuracy improves, but power consumption and device complexity increase
Solution Approach 1:
The patent segments the sensing function across multiple sensor types, each optimized for specific detection tasks. The acceleration sensor handles large-scale movements, the gyro sensor captures rotational movements, and optional biometric sensors detect fine finger movements. This segmentation allows the system to achieve high recognition accuracy without requiring all sensors to operate at maximum capacity simultaneously, thereby managing complexity more effectively.
Solution Approach 2:
The system dynamically changes operational parameters (sampling rates, activation states) of different sensors based on the current context and detected movement patterns. Not all sensors operate at full capacity continuously; instead, their parameters are adjusted to provide necessary data while minimizing power consumption and effective complexity. This parameter optimization resolves the contradiction between accuracy and complexity.
Data Source
AI summary
Disclosed is an electronic device. The electronic device includes a sensor unit that includes a first sensor and a second sensor, and a processor that is operatively connected with the sensor unit. The processor determines whether a given condition is satisfied, by using a first sensor signal of a user sensed by the first sensor, controls the first sensor to sense the first sensor signal every first cycle and controls the second sensor to sense a second sensor signal from the user every second cycle longer than the first cycle when the given condition is not satisfied, controls the second sensor to sense the second sensor signal every third cycle shorter than the second cycle when the given condition is satisfied, and recognize a gesture of the user by using the first sensor signal sensed every first cycle and the second sensor signal sensed every third cycle.


