Extended Reality Audio Positioning for Spatial Integration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing extended reality technologies lack the ability to seamlessly integrate real-world audio into virtual environments, limiting the immersive experience for users.
Innovation Solution
A controlling method and apparatus that allow users to select and position audio sources within an extended reality space by determining audio in a real space and positioning it accordingly in the extended reality space, enhancing the spatial audio experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If extended reality technologies present virtual scenarios in real space, then virtual reality experience is enhanced, but the integration of real-world audio into virtual environments is lacking
Solution Approach 1:
The patent merges real-world audio sources with virtual reality environments by capturing audio from the real space and integrating it into the extended reality space. The audio processing unit captures audio signals from the real environment and the processing unit integrates these real audio sources with virtual audio sources, allowing both real and virtual audio to coexist and interact within the same spatial framework, thereby enhancing the immersive experience.
Solution Approach 2:
The patent introduces an audio processing unit as an intermediary component that captures audio from the real space and transforms it into a format suitable for integration into the extended reality environment. This intermediary processing enables the seamless blending of real-world audio with virtual audio sources, resolving the contradiction between maintaining virtual scenario integrity and incorporating real-world audio elements.
2Ease of operation
If users can select and position audio sources in extended reality space, then spatial audio experience is enhanced, but system complexity increases
Solution Approach 1:
The system employs automatic audio source selection and positioning functionality that operates without requiring complex manual configuration by users. The processing unit automatically identifies audio sources in the real space and determines their positions in the extended reality space based on spatial relationships, reducing the operational burden on users while maintaining enhanced spatial audio capabilities.
Solution Approach 2:
The patent implements preliminary setup mechanisms where audio source positions and characteristics are pre-configured or automatically determined during initial system operation. This preliminary action reduces the need for complex real-time adjustments by users, simplifying operation while maintaining the ability to provide enhanced spatial audio experiences through pre-established audio positioning frameworks.
Data Source
AI summary
The disclosure provides a controlling method and apparatus based on extended reality, an electronic device, and a storage medium. The controlling method based on extended reality includes: determining a first audio in a real space in response to a first operation event of a current user; determining a first position in an extended reality space in response to a second operation event of the current user; and playing the first audio by taking the first position as a sound source position of the first audio in the extended reality space.