Interactive Sound Processing Using Motion-Triggered Audio Effects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current smart terminals lack the ability to process audio interactively, preventing users from engaging with the audio in a meaningful way.
Innovation Solution
An electronic device detects user actions through connected devices like headsets or smartwatches, matches them to pre-configured audio materials, and adds interactive effects to the audio playback, enhancing the experience with three-dimensional surround sound.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the terminal device simply performs audio playback, then the device complexity is low, but the user cannot interact with the audio and the audio experience is poor
Solution Approach 1:
The terminal device integrates multiple functions including audio playback, action detection through connected devices, and interactive audio processing. The system uses a unified audio processing pipeline that handles both standard playback and interactive effects through the same hardware resources, allowing one device to serve multiple purposes without proportionally increasing complexity
Solution Approach 2:
The patent introduces an intermediary processing layer that receives action detection results and translates them into audio processing parameters. This mediator component bridges the gap between simple playback hardware and complex interactive requirements, enabling audio interaction capabilities through software-mediated processing rather than requiring complex dedicated hardware
2Adaptability or versatility
If the terminal device adds interactive audio processing, then the audio experience is enhanced, but the processing complexity increases
Solution Approach 1:
The audio processing system is divided into distinct functional modules: action detection module, audio material matching module, and audio processing module. Each module performs a specific function and can be independently optimized or configured. This segmentation allows the system to handle complex interactive processing through coordinated simple modules rather than a monolithic complex processor
Solution Approach 2:
The system pre-configures associations between actions and audio materials, and pre-processes audio effects parameters based on detected actions. By preparing audio processing configurations in advance based on detected user actions, the system reduces real-time processing complexity while maintaining high interactive audio processing capability
Data Source
AI summary
This application provides a sound processing method and apparatus thereof. When the method is implemented, an electronic device such as a mobile phone may learn a device action and a music material matching the action. In this way, a user may drive the electronic device to perform an action through his own action (such as shaking his head, shaking his hands, or the like) when playing audio. The electronic device may recognize the actions through movement detection, and determine a music material matching the action according to a preset association relationship, so as to add an entertaining interactive effect to the audio being played, increase fun of an audio playing process, and meet a requirement of the user interacting with the audio being played.