Multiview Audio Presentation with Location-Based Spatial Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Spatial desynchronization between audio and video components in media presentations can be jarring, especially in multiview scenarios, making it difficult for users to determine the source of audio when multiple segments are presented simultaneously.
Innovation Solution
The audio component is modified using an audio processor to synchronize its spatial perception with the spatial location of the video component, employing techniques such as head-related transfer functions and machine-learning models to ensure the audio is perceived as originating from the correct location on the display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If multiple media segments are presented simultaneously at different locations, then the quantity of information presented is improved, but the difficulty of determining audio source location worsens
Solution Approach 1:
The patent applies local quality by modifying the audio component based on the specific location of the selected media segment. Different spatial audio characteristics are applied to different segments, making the audio perception match the visual location of each segment. This resolves the contradiction by providing localized audio identification that helps users determine the audio source even when multiple segments are presented simultaneously.
2Adaptability or versatility
If audio component is separated from video component, then the versatility of media presentation is improved, but the spatial desynchronization worsens
Solution Approach 1:
The patent applies dynamics by making the audio spatial characteristics adjustable and adaptive. The audio component is dynamically modified based on the location of the selected media segment, allowing the system to maintain spatial synchronization while presenting multiple segments simultaneously. This resolves the contradiction by enabling versatile presentation while maintaining reliability through dynamic audio adaptation.
Data Source
AI summary
A display device may define a multivew media presentation including two or more media segments presented simultaneously. The two or more media segments may be presented in a grid pattern with a first media segment presented at a first location of the display device. The display device may receive a selection of the first media segment of the two or more media segments. In response, the display device may modify the audio component of the first media segment based on the first location of the first media segment. The modification to the audio component may cause the modified audio component to be perceived by a user as originating at the first location of the display device. The display device may then present modified audio component of the first media segment.