Sound Image Localization for Immersive Audio Without Visual Screens
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing entertainment systems, such as those described in PTL 1, cannot be effectively enjoyed while walking or running due to the need to watch a screen, and they do not allow for prolonged user engagement.
Innovation Solution
An information processing apparatus that calculates the relative position of a virtual object's sound source to a user using sound image localization, allowing the user to perceive the virtual object as existing in real space, with a neckband-type device equipped with sensors and speakers that adjust sound positioning based on user movement, enabling immersive entertainment without visual screen reliance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a character image is displayed on a display screen, then the user can interact with the character, but the entertainment cannot be enjoyed while walking or running because the user must watch the screen
Solution Approach 1:
The patent replaces the visual display screen with an auditory output system (speaker). Instead of presenting character interactions through visual images on a screen, the system outputs sound images that represent character voices and movements. This substitution allows users to engage with the entertainment content through hearing rather than seeing, enabling enjoyment during physical activities like walking or running when visual attention is occupied.
2Duration of action of moving object
If the user watches a screen image during movement, then interaction is possible, but the entertainment duration is limited because the user cannot focus on both movement and screen
Solution Approach 1:
The system substitutes visual information delivery with auditory information delivery. By outputting sound images through speakers rather than displaying visual images on a screen, the system frees the user's visual attention for movement-related tasks while maintaining engagement through auditory channels. This enables prolonged entertainment duration as users can simultaneously attend to their physical activity and the audio-based character interactions without the cognitive load of dividing visual attention.
Solution Approach 2:
The patent transitions the information delivery medium from the visual dimension (screen display) to the auditory dimension (sound output). This dimensional shift allows users to process entertainment content through a different sensory channel that does not compete with visual attention required for movement, thereby extending the duration of engaging entertainment activities.
3Measurement precision
If sound image position is recalculated from scratch for each sound changeover, then localization accuracy is maintained, but processing time increases
Solution Approach 1:
The system performs preliminary calculations of sound image positions and stores them in advance for multiple sound sources. When a sound changeover occurs, instead of calculating positions from scratch, the system retrieves pre-calculated position data that corresponds to the new sound source. This preliminary preparation maintains localization accuracy while significantly reducing the real-time processing time required during sound transitions.
Solution Approach 2:
The patent prepares sound image position data in advance to cushion against the time-consuming nature of real-time calculations during sound changeovers. By having pre-computed position information ready before actual sound transitions occur, the system ensures that localization accuracy is maintained without introducing noticeable delays or processing bottlenecks during dynamic sound playback scenarios.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables users to enjoy immersive entertainment experiences while moving by localizing sound images relative to the user's position, enhancing the realism and duration of engagement with virtual characters in real-world environments.
Implementation Method 1
a sound image localization section that performs a sound signal process of the sound source such that the sound image is localized at the calculated localization position
Data Source
AI summary
An information processing apparatus includes a calculation section that calculates a relative position of a sound source of a virtual object to a user, the virtual object allowing a user to perceive that the virtual object exists in a real space by sound image localization, on the basis of a position of a sound image of the virtual object and a position of the user, a sound image localization section that performs a sound signal process of the sound source such that the sound image is localized at the calculated localization position, and a sound image position holding section that holds the position of the sound image. When sound to be emitted from the virtual object is to be changed over, the calculation section may refer to the position of the sound image held in the sound image position holding section to calculate the position of the sound image.