Wireless Earphone Independent Rendering for Low-Latency Spatial Audio
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing wireless earphones face challenges in achieving high-quality sound effects due to data interaction delays and rendering imbalances between earpieces, particularly when processing high-quality surround sound or three-dimensional panoramic sound.
Innovation Solution
The method involves independent rendering processing by each wireless earphone, utilizing decoding and rendering metadata to generate audio signals, and synchronizing metadata to ensure coordinated playback, reducing reliance on the playing device for real-time sound rendering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If the wireless earphone transmits head motion information to the playing device for processing, then the playing device can perform rendering processing, but data transmission delay increases and real-time rendering effects deteriorate
Solution Approach 1:
The patent divides the rendering processing function into two parts: the playing device performs initial rendering processing on audio signals, and the wireless earphone performs secondary rendering processing based on head motion information. This segmentation allows the earphone to handle real-time motion compensation locally while the playing device handles complex audio rendering, resolving the contradiction between rendering capability and transmission delay.
Solution Approach 2:
The playing device performs preliminary rendering processing on audio signals before transmission to the wireless earphone. This preliminary action reduces the processing burden on the earphone and enables faster real-time response to head motion information, as the earphone only needs to perform additional rendering based on motion data rather than complete rendering from scratch.
2Device complexity
If the wireless earphone transmits head motion information to the playing device for processing, then rendering can be performed centrally, but rendering imbalance between two earphones occurs and sound quality deteriorates
Solution Approach 1:
The patent implements a feedback mechanism where the wireless earphone transmits head motion information to the playing device, and the playing device sends back rendering processing results. This feedback loop enables the playing device to adjust rendering parameters based on actual head motion, ensuring synchronized and balanced rendering between left and right earphones while maintaining high sound quality.
Solution Approach 2:
The playing device acts as an intermediary that receives head motion information from the wireless earphone, performs rendering processing, and sends the processed audio signals back to the earphone. This intermediary role ensures centralized control over rendering quality while maintaining synchronization between dual earphones, resolving the rendering imbalance issue.
3Power
If the wireless earphone relies on the playing device for rendering processing, then processing power requirements are reduced at the earphone, but data interaction efficiency and sound quality deteriorate
Solution Approach 1:
The playing device performs preliminary rendering processing on audio signals before transmission to the wireless earphone. This preliminary action reduces the processing burden on the earphone, allowing it to use lower processing power while still achieving high-quality sound output. The earphone only needs to perform additional rendering based on motion data, maintaining efficiency in data interaction.
Data Source
AI summary
The present application provides an audio processing method and apparatus, a wireless earphone, and a storage medium. A first wireless earphone receives a first to-be-presented audio signal sent by a playing device, and a second wireless earphone receives a second to-be-presented audio signal sent by the playing device; then, the first wireless earphone performs rendering processing on the first to-be-presented audio signal to obtain a first audio playing signal, and the second wireless earphone performs rendering processing on the second to-be-presented audio signal to obtain a second audio playing signal; and finally the first wireless earphone plays the first audio playing signal, and the second wireless earphone plays the second audio playing signal. Therefore, it is possible to achieve technical effects of greatly reducing the delay and improving the sound quality of the earphone since the wireless earphone can render the audio signals independently of the playing device.