Wearable Gesture Controller with Sensor Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing human-to-machine interaction systems face limitations in gesture recognition, particularly with hardware-based controllers that require active handling and do not support finger tracking or reliable hand gesture recognition, and full-body natural gesture recognition systems that struggle with precise actions like clicks, often requiring specific movements and not allowing simultaneous hand movement and click actions.
Innovation Solution
A wireless control device with an adjustable band incorporating control buttons, accelerometers, and a gyroscope, designed for use with three-dimensional imaging systems, allowing for bi-directional communication and providing contextual feedback, enabling enhanced gesture recognition and interaction by tracking hand movements and providing additional data to resolve ambiguities in imaging system information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a hardware-based controller is used for interaction, then control signals can be provided to the computerised system, but the user cannot perform free natural movements including finger movements for gesture recognition
Solution Approach 1:
The patent combines a wearable controller device with natural gesture recognition technology into a unified system. The controller includes sensors (accelerometers, gyroscopes, magnetometers) that detect both deliberate control inputs and natural hand/finger movements, merging traditional remote control functionality with gesture-based interaction in a single wearable device.
Solution Approach 2:
The wearable controller is designed to perform multiple functions: it can detect deliberate button presses or analog stick movements for traditional control, simultaneously track natural hand and finger movements for gesture recognition, and provide haptic feedback. This multi-functional design eliminates the need for separate gesture recognition systems.
2Ease of operation
If the user grips the device for operation, then the device can be controlled, but free movement of hands and fingers is not allowed for gesture recognition
Solution Approach 1:
The patent uses an intermediary processing system that receives data from multiple sensors (accelerometers, gyroscopes, magnetometers) and distinguishes between deliberate control inputs and natural hand movements. The processing system filters and interprets sensor data to differentiate between intentional user actions (like pressing a button) and unintentional movements (like hand tremors or gestures), ensuring accurate control signal recognition without requiring the user to grip the device tightly.
3Measurement precision
If full-body natural gesture recognition is used, then free movement is allowed, but precise actions like clicks cannot be reliably detected
Solution Approach 1:
The patent segments the control device into multiple independent sensing zones corresponding to different fingers and hand regions. Each zone contains sensors that independently detect movements and pressures. This segmentation allows the system to simultaneously track overall hand movement for gesture recognition while detecting precise localized inputs (like a thumb click or finger tap) as separate control signals, enabling both gesture and click actions to occur simultaneously without interference.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables free movement of hands and fingers while performing gestures, allowing for simultaneous control signals and feedback, enhancing user experience by providing refined information on hand position, orientation, and actions, and improving the accuracy of gesture recognition in virtual environments.
Implementation Method 1
a three-dimensional imaging system, such as, but not exclusively, a Kinect system, for providing three-dimensional information of at least one part of a user present within a frustum
Implementation Method 2
The wearable device includes sensors, such as, but not exclusively, accelerometers
Implementation Method 3
The wearable device includes sensors, such as, but not exclusively, accelerometers, gyroscopes
Data Source
AI summary
Described herein is a wireless remote control device (100) which can be used on the hand (150) of a user to provide both hardware-based control signals which can be associated with gesture-based control signals for enhanced gesture recognition systems. The device (100) comprises a housing (110) having a sensing unit having at least one control button (120, 130, 140) which is capable of generating a control signal for an associated computerized system. A computerized system utilizes information obtained from the control device (100) together with information obtained from a gesture recognition system to resolve any ambiguities due to, for example, occlusion of the hand performing the gesture or the hand being outside the field of view of an imaging system associated with the computerized system, and to trigger interactions within the gesture based interaction system.