IMU Gesture Detection for Assistive Communication
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems for patients with physical disabilities are unable to detect and utilize a wide range of intentional gestures, limiting their interaction with electronic communication systems.
Innovation Solution
A sensor system utilizing an inertial measurement unit (IMU) and electrocardiogram (ECG) electrodes, capable of detecting movements along any axis and learning the characteristics of individual gestures, such as speed and magnitude, to provide input into communication systems.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional sensors (microphone, touch sensor, camera) are used to detect patient gestures, then the system can detect specific types of intentional gestures, but the scope of detectable gestures remains limited and many patients cannot perform the required gestures
Solution Approach 1:
The IMU sensor serves multiple functions: it detects gestures from any body part, determines gesture direction through axis analysis, and identifies intentional movements by analyzing motion patterns. This single sensor replaces multiple specialized sensors (microphone, touch sensor, camera) and expands gesture detection capability to any body part while maintaining manageable system complexity through sensor consolidation
Solution Approach 2:
The system transitions from detecting gestures in specific predetermined locations to detecting gestures in three-dimensional space using the IMU's x, y, z axes. By analyzing motion along multiple dimensions and determining the primary axis of movement, the system can recognize gestures from any body part regardless of orientation, significantly expanding the scope of detectable gestures
2Adaptability or versatility
If the system requires specific predetermined gestures at specific body parts, then the detection algorithm is simpler, but fewer patients can successfully interact with the system
Solution Approach 1:
The system performs preliminary learning during a calibration phase where it records and analyzes the patient's natural gestures. The IMU captures motion data along all three axes, and the system identifies the primary axis of movement and gesture characteristics before actual communication begins. This preliminary action enables the system to adapt to individual patient capabilities without requiring complex real-time analysis
Solution Approach 2:
The system uses feedback from the learned gesture patterns to dynamically adjust detection thresholds and recognition criteria. By continuously comparing actual IMU readings against the learned gesture profiles, the system can accurately distinguish intentional gestures from natural movements, accommodating variations in patient ability while maintaining reliable detection
Data Source
AI summary
A method and system for detecting and using intentional gestures utilizing a six-axis inertial measurement unit (IMU) provides individuals with limited motor abilities the ability to control multiple devices. The system responds to small intentional gestures produced by any part of the user's body. Unlike existing game controllers and adapted mouse devices, the system has the ability to learn the unique kinematic characteristics of the user's gestures.