Virtual Speaker Positioning in AR Audio Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional virtual and augmented reality sound source systems face challenges in accurately determining the position of sound sources, leading to discomfort due to the weight and design of head-mounted displays when multiple speakers are used within them.
Innovation Solution
A sound source reproducing device that communicates with electronic devices to generate virtual speaker position information, converting original sounds into signals for multiple external speakers to simulate sound sources at specific virtual positions, thereby enhancing user experience without the need for separate operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If speakers are mounted within the HMD to reproduce sound sources, then sound reproduction capability is improved, but the HMD becomes heavier and user comfort deteriorates
Solution Approach 1:
The patent extracts the speakers from the HMD structure and places them in external devices (smartphone, tablet, or separate speaker system). The HMD retains only the display and tracking functions, while sound reproduction is handled by external devices that communicate with the HMD via wireless or wired connections. This resolves the weight issue while maintaining sound reproduction capability through spatial audio processing that simulates sound source positions in 3D space.
Solution Approach 2:
The patent enables universal sound reproduction across multiple device configurations - the same HMD can work with smartphones, tablets, or dedicated speaker systems. The sound reproduction system is not tied to a specific hardware configuration but rather uses software-based spatial audio processing that adapts to various external audio devices, providing multi-functional flexibility.
2Ease of manufacture
If conventional sound source systems are used in virtual reality, then basic sound playback is achieved, but accurate determination of sound source position becomes difficult
Solution Approach 1:
The patent implements feedback by continuously tracking the user's head position and orientation using sensors in the HMD, and using this information to dynamically adjust the spatial audio rendering. The system also tracks the position of virtual objects in the augmented reality scene and adjusts sound source positions accordingly, creating a closed-loop system that maintains accurate sound positioning despite user movement.
Solution Approach 2:
The patent employs dynamic spatial audio rendering that adapts in real-time to changing conditions - user head movements, virtual object positions, and camera angles. The sound source positions are not fixed but are dynamically calculated based on the relative positions of the user and virtual objects, ensuring accurate sound localization throughout the interactive experience.
3Ease of operation
If multiple speakers are used outside the HMD to avoid weight issues, then user comfort is improved, but the system complexity increases
Solution Approach 1:
The patent designs a universal interface that works with multiple types of external devices (smartphones, tablets, dedicated speakers) through standard audio output connections and wireless protocols. The HMD includes automatic device detection and configuration capabilities that simplify setup, reducing the perceived complexity for users while maintaining flexibility in device choices.
Solution Approach 2:
The patent implements automatic device pairing and configuration where the HMD automatically detects available external audio devices, selects the appropriate connection mode, and configures the spatial audio parameters without requiring manual user input. The system self-adjusts based on the detected device type and capabilities, minimizing the burden on users while managing system complexity.
Data Source
AI summary
A sound source reproducing device which communicates with an electronic device providing images and original sound may be provided. The sound source reproducing device includes: an interface which receives position information of at least one virtual object included in the image and the original sound from the electronic device; and a controller which generates virtual speaker position information corresponding to the position information of the at least one virtual object received from the interface, and converts the original sound received from the interface into a sound source signal for a plurality of speakers on the basis of the virtual speaker position information.