Multi-Factor Touch Gesture Recognition With IMU Intent Validation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing gesture recognition devices, such as toy electronic wands, require an external camera for gesture detection, leading to false positives and high power consumption due to frequent touch sensing, limiting their effectiveness and efficiency in controlling electronic devices.
Innovation Solution
A gesture-recognition (GR) device that includes an inertial measurement unit (IMU) for 3D motion sensing, capable of recognizing gestures with up to six degrees of freedom, and a capacitive touch sensor panel for multi-factor touch assertion, allowing local or remote gesture recognition and control of connected devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If an external camera is used for gesture detection, then gesture recognition capability is provided, but false positives increase and power consumption rises
Solution Approach 1:
The patent introduces an inertial measurement unit (IMU) as an intermediary sensor to detect gestures through motion data. The IMU serves as a mediator between the user's physical gestures and the control system, providing more reliable gesture detection compared to external camera-based systems. The IMU data is processed to identify gesture patterns, reducing false positives while maintaining gesture recognition capability.
Solution Approach 2:
The patent replaces the optical/mechanical camera-based gesture detection system with an inertial sensing system. Instead of using external cameras to track motion visually, the system uses an IMU to directly measure acceleration, gravity, and orientation changes. This substitution provides more accurate and reliable gesture detection with lower false positive rates.
2Measurement precision
If frequent touch sensing is performed for gesture detection, then gesture recognition accuracy is improved, but power consumption increases
Solution Approach 1:
The patent implements periodic sampling of IMU data at optimized intervals rather than continuous monitoring. The system periodically reads acceleration, gravity, and orientation data from the IMU, processes this data to detect gesture patterns, and updates the gesture state. This periodic action maintains gesture detection accuracy while significantly reducing power consumption compared to continuous sensing.
Solution Approach 2:
The patent dynamically adjusts the sensing frequency and processing intensity based on device state and detected motion levels. When the device is stationary or in low-power mode, sensing frequency is reduced. When motion is detected or the device is active, sensing frequency increases to maintain accurate gesture recognition. This dynamic adjustment optimizes the balance between detection accuracy and power consumption.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables efficient and accurate gesture-based control of various electronic devices with reduced power consumption by integrating IMU and capacitive touch sensors, facilitating personalized experiences and enhanced interaction with IoT devices and virtual reality environments.
Implementation Method 1
the GR device is capable of sensing 3-dimensional motion with up to six degrees of freedom (three linear axes, and three rotational axes), plus three axes of geospatial orientation if desired, using the movement sensor (e.g., an inertial measurement unit (IMU))
Implementation Method 2
A first capacitive touch sensor panel includes a plurality of sensing pads arranged in a cylindrical pattern inside a handle of the GR device
Data Source
AI summary
A gesture-recognition (GR) device is disclosed that includes a capacitive touch sensor panel and a controller. The capacitive touch sensor panel comprises a plurality of sensing pads arranged in a cylindrical pattern inside a handle of the GR device and detects a multi-factor touch assertion at a set of sensing pads of the plurality of sensing pads. The controller transmits a driving signal to each of the plurality of sensing pads for the detection of the multi-factor touch assertion, generates an assertion signal, determines a signal sequence based on the assertion signal, and converts a current inactive state of the GR device to an active state based on a validation of the determined signal sequence corresponding to the multi-factor touch assertion and an inferred user intent.