Spatial Audio Transmission via Local Link for Echo Mitigation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current multi-user communication systems fail to effectively provide immersive and spatially accurate audio experiences in virtual environments, especially when multiple users join or leave a communication session, leading to issues with audio positioning and potential echoes due to crosstalk.
Innovation Solution
The system employs an IVAS codec and headset-based spatial audio technology, using head-tracking for 3DoF or 6DoF audio reproduction, and Bluetooth links for seamless integration of additional users, ensuring accurate audio positioning and mitigating echoes through audio processing and separate data streams.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If network-based audio transmission is used for multi-user communication, then users can communicate remotely via the Internet, but audio positioning accuracy deteriorates and echoes occur due to crosstalk
Solution Approach 1:
The patent segments audio transmission into two distinct paths: a local link for spatial audio data between headsets and a network link for control data. This segmentation allows the local link to maintain high-precision audio positioning while the network link handles user management, eliminating crosstalk-induced echoes and positioning errors.
2Adaptability or versatility
If network-based audio transmission is used, then users can join and leave sessions dynamically, but audio object placement and echo control deteriorate
Solution Approach 1:
The patent separates control functions (user joining/leaving) from audio transmission functions by using distinct communication links. The network link manages session dynamics while the local link maintains stable audio object placement, preventing disruptions to spatial audio when users join or leave.
Solution Approach 2:
The patent introduces a controller as an intermediary that manages user sessions and coordinates audio transmission. The controller receives control data over the network and manages local link connections, acting as a mediator that maintains audio object placement stability while enabling dynamic user management.
3Device complexity
If standard audio transmission protocols are used, then system complexity is reduced, but immersive spatial audio experience deteriorates
Solution Approach 1:
The patent segments the audio system into specialized components: a local link for high-precision spatial audio transmission between headsets and a network link for control data. This segmentation enables implementation of sophisticated spatial audio protocols without overwhelming system complexity, as each link handles specific functions with appropriate protocol complexity.
Data Source
Figure 1~3
Figure 4~5
Figure 6~7
AI summary
A method, apparatus and computer program is described comprising: enabling a first user having a first user device to communicate with one or more second users having one or more second user devices via a network, wherein each user has a spatial position within a virtual space, such that, for each user within the virtual space, all other users within the virtual space have a relative spatial position; providing spatial audio data from the first user device to the one or more second user devices and receiving spatial audio data at the first user device from the one or more second user devices, such that each user is provided with audio from the other users in the respective relative spatial positions of the other users; and enabling a third user having a third user device to communicate with the first user and the one or more second users via the first user device, wherein the means for enabling the third user to communicate comprises a local link between the first and third user devices.