Wearable Gesture Control System with Low Latency MIDI Translation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing wearable devices are limited in their use cases and functionality, primarily focused on sensor data collection, and lack interactivity and the ability to communicate commands among devices and users, resulting in high latency and limited gesture recognition.
Innovation Solution
The system enables communication and processing of data from wearable devices to control media outputs and trigger events, allowing multiple users to generate gestures that are detected by sensors and translated into MIDI commands, enabling real-time audio and visual feedback with low latency and accurate gesture recognition.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If wearable devices are used for sensor data collection, then data collection capability is improved, but interactivity and functionality are limited
Solution Approach 1:
The wearable device is enhanced to perform multiple functions beyond sensor data collection. The device can detect gestures, communicate with other devices, control media outputs, and trigger events, transforming it from a single-function data collector to a multi-functional interactive platform that bridges physical gestures and digital responses
2Loss of information
If wearable devices communicate data to paired computing device, then data processing capability is improved, but latency increases
Solution Approach 1:
The system pre-establishes communication channels and protocols between wearable devices and computing devices. By preparing the data transmission pathway in advance and implementing efficient data formatting, the system reduces processing delays and enables faster response times for gesture recognition and media control operations
3Device complexity
If wearable devices are limited to sensor data collection, then device complexity is reduced, but gesture recognition capability is limited
Solution Approach 1:
The patent introduces an intermediary processing layer that enhances gesture recognition without significantly increasing wearable device complexity. This intermediary system processes sensor data more effectively and coordinates communication between devices, enabling accurate gesture recognition while maintaining relative simplicity of the wearable form factor
Data Source
AI summary
Processing techniques and device configurations for performing and controlling output effects at a plurality of wearable devices are generally described herein. In an example, a processing technique may include receiving, at a computing device, an indication of a triggering gesture that occurs at a first wearable device, determining an output effect corresponding to the indication of the triggering gesture, and in response to determining the output effect, transmitting commands to computing devices that are respectively associated with a plurality of wearable devices, the commands causing the plurality of wearable devices to generate the output effect at the plurality of wearable devices. In further examples, output effects such as haptic feedback, light output, or sound output, may be performed by the plurality of wearable devices, associated computing devices, or other controllable equipment.