Content-Adaptive Surround Sound Virtualization for Audio Fidelity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional surround sound virtualization systems require multiple speakers and lack adaptability to different audio content types, leading to an inconsistent user experience and potential distortion of audio effects, especially when switching between content types like music and movies.
Innovation Solution
A content-adaptive surround sound virtualization method that determines the virtualization amount based on the probability of input audio signals belonging to predefined content categories, allowing for continuous adjustment of the surround sound effect to suit various audio types, thereby avoiding abrupt changes and maintaining an optimal listening experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a virtualizer is configured at the playback end to fully work on all input audio contents, then surround sound effect is achieved, but audio distortion occurs for certain content types
Solution Approach 1:
The virtualizer's operation is made dynamic by continuously adjusting the virtualization amount based on real-time audio content analysis. The system transitions from a static fully-on approach to a dynamic adaptive approach where the virtualization degree changes with content type, resolving the contradiction between adaptability and audio accuracy.
Solution Approach 2:
The system changes the virtualization amount parameter based on detected audio content characteristics. By monitoring audio signals and adjusting the virtualization parameter in response to content type changes, the system achieves both adaptability to different content and maintains audio fidelity for each specific content type.
2Ease of operation
If surround sound virtualization is applied to all audio content, then consistent surround effect is provided, but user experience deteriorates for inappropriate content types
Solution Approach 1:
The virtualizer system performs self-service by automatically detecting audio content type and adjusting its virtualization operation accordingly. The system monitors its own input signals, identifies content characteristics, and autonomously optimizes its performance without user intervention, achieving both ease of operation and reliable quality.
Solution Approach 2:
The system implements feedback by continuously analyzing the input audio content and using this information to adjust the virtualization amount. This closed-loop approach ensures the listening experience quality is maintained by adapting to content changes while requiring no manual user configuration.
3Adaptability or versatility
If the virtualizer switches between different content types, then adaptability is improved, but audio artifacts increase due to abrupt transitions
Solution Approach 1:
The system applies periodic action by using smooth transition functions when changing virtualization amounts between different content types. Rather than abrupt switching, the virtualization parameter changes gradually over time, eliminating audio artifacts while maintaining adaptability to content type changes.
Solution Approach 2:
The system prepares for content type transitions by implementing smooth transition functions in advance. When a content type change is detected, the virtualization amount adjusts gradually through predefined transition curves, cushioning against abrupt changes that would create audio artifacts and ensuring seamless adaptability.
Data Source
AI summary
Example embodiments disclosed herein relate to content-adaptive surround sound virtualization. A method of virtualizing surround sound is disclosed. The method includes receiving a set of input audio signals, each of the input audio signals being indicative of sound from one of different sound sources, and determining a probability of the set of input audio signals belonging to a predefined audio content category. The method also includes determining a virtualization amount based on the determined probability, the virtualization amount indicating to which extent the set of input audio signals is virtualized as surround sound. The method further includes performing surround sound virtualization on two or more input audio signals in the set based on the determined virtualization amount and generating output audio signals based on the virtualized input audio signals and other input audio signals in the set. Corresponding system and computer program product for virtualizing surround sound are also disclosed.