Audio Object Localization via Listening Space GUI Panning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio content creation tools lack intuitive methods for accurately specifying the localization position of sound images, particularly in object-based audio and two-channel stereo, making it difficult for creators to align sound positions with visual elements accurately.
Innovation Solution
A signal processing apparatus and method that utilizes a graphical user interface simulating a listening space, allowing creators to specify sound image localization positions visually and intuitively through a point of view shot, with calculations determining gain values for left and right channels based on marked positions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If object-based audio or two-channel stereo techniques are used to specify sound image localization, then the audio content can be created with directional sound positioning, but it becomes difficult to intuitively determine and accurately specify the localization position relative to the actual listening position
Solution Approach 1:
The patent creates a visual copy of the listening space as a 2D overhead view on the display screen, where positions can be directly specified by marking locations on the visual representation. This allows creators to intuitively specify sound image localization positions by visually marking positions on the displayed listening space, eliminating the need to mentally map abstract coordinates to physical speaker positions.
Solution Approach 2:
The patent introduces an overhead view display of the listening space as an intermediary between the creator and the actual sound positioning. This visual intermediary allows creators to specify positions by marking on the displayed 2D representation, which is then translated into actual sound image localization positions in the 3D space, making the process intuitive and accurate.
2Measurement precision
If repeated adjustments and listening tests are performed to determine final localization position, then accurate sound positioning can be achieved, but the process becomes time-consuming and requires experienced operators
Solution Approach 1:
The patent performs preliminary visualization of the listening space and allows creators to directly specify localization positions by marking on the displayed overhead view. This preliminary visual specification eliminates the need for repeated adjustments and listening tests, as the position is determined intuitively in advance based on the visual representation.
Solution Approach 2:
The system allows creators to independently and intuitively determine localization positions by visually marking on the displayed listening space overhead view, without requiring experienced operators or repeated trial-and-error adjustments. The visual interface serves itself by providing all necessary spatial information directly to the creator.
3Ease of operation
If proportion ratios are used to control sound image position in two-channel stereo, then basic panning control is achieved, but the relationship between proportion ratio and actual localization position becomes difficult to grasp intuitively
Solution Approach 1:
The patent transforms the abstract one-dimensional proportion ratio control into a two-dimensional visual overhead view of the listening space. Instead of adjusting numerical ratios, creators can directly mark positions on the 2D displayed space, providing intuitive spatial relationship information and eliminating the loss of spatial understanding.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present technology relates to a signal processing apparatus and method, and a program that can easily determine a localization position of a sound image. A signal processing apparatus includes: an acquisition unit configured to acquire information associated with a localization position of a sound image of an audio object in a listening space specified in a state where the listening space viewed from a listening position is displayed; and a generation unit configured to generate a bit stream on the basis of the information associated with the localization position. The present technology can be applied to the signal processing apparatus.