Wearable Motion Sensing for Audio-Visual Media Creation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing musical composition methods lack performance attributes and fail to incorporate real-time physical movements as a form of creative expression.
Innovation Solution
A system that converts a user's real-time motion, sensed by electronic articles of footwear or apparel, into audio and/or visual compositions using motion-sensing circuits and communication protocols to trigger audio samples and visual effects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If discrete audio samples are triggered by MIDI controller, then creative expression is achieved, but performance attributes are lost
Solution Approach 1:
The patent replaces the mechanical MIDI controller interface with a motion-sensing system that captures physical movements. Motion sensors detect body movements and convert them into digital signals that trigger audio samples, thereby substituting the mechanical interaction model with a motion-based interaction model that preserves performance attributes while maintaining creative expression capabilities.
Solution Approach 2:
The patent introduces motion sensors and a processing system as intermediaries between physical movement and audio output. These intermediaries capture motion data, interpret it according to mapping rules, and trigger corresponding audio samples, thereby bridging the gap between physical performance and digital audio while preserving performance characteristics.
2Reliability
If motion sensors are integrated into footwear or apparel, then performance attributes are captured, but device complexity increases
Solution Approach 1:
The patent makes the motion-sensing system universal by integrating sensors into footwear or apparel that can be worn by any user. The same hardware platform supports multiple functions: capturing motion data, transmitting it wirelessly, and triggering audio samples. This multi-functionality reduces the need for separate specialized devices, thereby managing complexity while maintaining performance capture capabilities.
Solution Approach 2:
The motion sensors integrated into footwear or apparel are self-contained units that autonomously detect motion, process data locally, and transmit information wirelessly without requiring external processing equipment. This self-service capability reduces system complexity by distributing intelligence across the wearable devices rather than requiring a centralized complex processing system.
3Ease of operation
If motion data is transmitted in real-time, then performance expression is enhanced, but energy consumption increases
Solution Approach 1:
The patent implements periodic transmission of motion data rather than continuous transmission. The motion sensors capture movement data and transmit it at specific intervals or when threshold movements are detected. This periodic action maintains real-time performance expression capability while significantly reducing energy consumption compared to continuous data streaming.
Solution Approach 2:
The system transmits only the necessary portion of motion data required for performance expression. By filtering and selecting only relevant motion parameters and transmission events, the system achieves adequate performance capture with minimal energy expenditure, avoiding the excessive energy consumption that would result from transmitting all raw sensor data continuously.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A system for motion-based media creation includes an article of footwear or apparel having at least one accelerometer or inertial measurement unit operative to monitor spatial motion of at least a portion of the article of footwear or apparel and generate a data stream indicative of the monitored spatial motion. The system further includes a processor in networked wireless communication with the article of footwear or apparel. The processor is configured to receive the data stream from the article of footwear or apparel; identify at least one motion primitive from the received data stream; and trigger the playback of an audio sample or a visual effect in response to the identified at least one motion primitive.