Virtual Scene Audio Modes for 6DoF and Legacy Compatibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual reality systems face challenges in providing immersive and compatible audio experiences, particularly with legacy content, as they often require specifically spatially arranged content for 6DoF consumption, which is not compatible with legacy audio formats.
Innovation Solution
A system that dynamically adjusts audio modes based on user location and movement, allowing for both 6DoF and 3DoF experiences by fixing or moving audio sources relative to the user, enabling compatibility with legacy content through a user-centric audio mode.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If specifically spatially arranged content is used for 6DoF consumption, then immersive audio experience is improved, but compatibility with legacy audio formats deteriorates
Solution Approach 1:
The system dynamically switches between two audio modes (first mode with fixed audio sources for 6DoF immersion, second mode with user-centric audio sources for legacy compatibility) based on user location within the virtual scene, allowing the audio rendering behavior to adapt in real-time rather than being static
Solution Approach 2:
The patent changes the rendering parameter (audio source behavior) based on the user's virtual location, transitioning between world-centric and user-centric audio modes to resolve the contradiction between immersion and compatibility
2Reliability
If world-centric audio mode is used, then 6DoF audio experience is improved, but user experience during movement deteriorates
Solution Approach 1:
The audio rendering mode dynamically transitions from world-centric to user-centric based on user movement and location, ensuring the audio experience adapts to user actions rather than remaining static
Solution Approach 2:
The system monitors user location and movement within the virtual scene and uses this feedback to automatically switch between audio modes, creating a responsive audio experience that adapts to user behavior
Data Source
Figure 1~3
Figure 4~5
Figure 6~7
AI summary
An apparatus, method and computer program is described comprising: determining one of a plurality of audio modes for presentation of first audio to a user based on a location and/or movement of the user within a virtual scene, wherein the first audio comprises a plurality of audio tracks located at different locations within the virtual scene; and rendering the first audio to the user in the determined audio mode, wherein: in a first audio mode of the plurality of audio modes, the locations of the audio tracks within the virtual scene are fixed and in a second audio mode of the plurality of audio modes, the locations of the audio tracks within the virtual scene move with the user.