Mixed Reality Audio Spatial Positioning via Environmental Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mixed reality devices face challenges in providing audio quality and effects that are immersive and suitable for mixed reality experiences, which can detract from the user's enjoyment and immersion.
Innovation Solution
A system and method that determine a mixed reality device position and a virtual source position for audio elements within an environment, using a processor circuit to direct audio devices to generate audio that simulates the source position, creating a more immersive experience by synchronizing audio with visual content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If existing mixed reality devices use their built-in audio capabilities, then the device complexity is low, but the audio quality and immersion are insufficient
Solution Approach 1:
The patent introduces an intermediary system comprising a server and environmental audio devices that act as mediators between the mixed reality device and the user's auditory experience. The server receives audio data, determines optimal audio device positions based on the user's location and environment, and coordinates multiple environmental audio devices to play audio content from appropriate virtual source positions. This intermediary architecture enables high-fidelity spatial audio without requiring complex audio processing within the mixed reality device itself.
2Reliability
If multiple audio devices are coordinated to provide spatial audio, then the immersion is improved, but the device complexity and coordination requirements increase
Solution Approach 1:
The system dynamically changes parameters including audio device selection, virtual source position coordinates, and audio playback timing based on the user's real-time location and orientation. The server calculates optimal configurations by adjusting multiple parameters simultaneously - selecting which environmental audio devices should activate, determining the virtual source position relative to the user's viewpoint, and synchronizing playback timing. This parameter-based coordination approach enables adaptive spatial audio that maintains immersion while managing system complexity through centralized control.
3Reliability
If audio is positioned to match visual content in mixed reality, then the realism is improved, but the processing requirements and time increase
Solution Approach 1:
The system performs preliminary actions by pre-determining audio device positions and virtual source positions based on the user's location before audio playback occurs. The server calculates the optimal audio configuration in advance, considering the user's position relative to multiple environmental audio devices and the virtual scene geometry. This preliminary positioning enables rapid audio playback with minimal real-time processing delay, as the complex spatial calculations are performed beforehand rather than during audio reproduction.
Data Source
AI summary
Systems, devices, and methods provide mixed reality audio with environmental audio devices. A mixed reality device providing mixed reality content to a user has a mixed reality device position in an environment that includes a plurality of audio devices. A mixed reality audio element is determined, which is associated with the mixed reality content and which has a virtual source position with respect to the mixed reality device position within the environment. An audio device position of a particular audio device of the plurality of audio devices is determined, with respect to the mixed reality device position and the virtual source position within the environment. The particular audio device generates the mixed reality audio element to cause the user of the mixed reality device to perceive the mixed reality audio element as originating from the virtual source position within the environment.