Audio Object Position Correction in Multi-View Content
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In multi-view content, viewpoint switching often results in a mismatch of audio object positions, causing a feeling of strangeness in users due to the lack of accurate angle-of-view and direction information, especially when switching between 360° all-around and 2D images.
Innovation Solution
An information processing device and method that store viewpoint switching information in the header of a content file to correct audio object positions during viewpoint switching, using multi-view zoom switching information to maintain consistent sizes and positions of photographic subjects across different viewpoints.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If viewpoint switching is implemented in multi-view content, then users can switch among multiple viewpoints, but audio object positions become mismatched causing user discomfort
Solution Approach 1:
The patent applies preliminary action by pre-calculating and storing viewpoint switching information (including audio object position corrections) in the content file header before reproduction. This allows the reproduction device to quickly retrieve and apply the correct position adjustments when switching viewpoints, avoiding real-time calculation delays and ensuring accurate audio positioning from the moment of viewpoint switching.
Solution Approach 2:
The patent introduces viewpoint switching information as an intermediary data structure that mediates between the audio objects and the reproduction device. This intermediary contains pre-computed position correction data that enables smooth transitions between viewpoints without direct complex calculations during playback, acting as a buffer that resolves the conflict between viewpoint flexibility and position accuracy.
2Reliability
If audio object positions are corrected during viewpoint switching, then user comfort is improved, but additional information processing is required
Solution Approach 1:
The patent shifts the computational burden to the content generation phase by pre-calculating viewpoint switching information including audio object position corrections. The reproduction device only needs to retrieve and apply this pre-computed data, significantly reducing the processing complexity during playback while maintaining high position accuracy.
Solution Approach 2:
The content file structure is designed to be self-sufficient by embedding viewpoint switching information directly in the header. This allows the reproduction device to perform autonomous position corrections without requiring external processing or complex real-time calculations, simplifying the device architecture while ensuring accurate audio positioning during viewpoint transitions.
Data Source
AI summary
To propose an information processing device and an information processing method to correct positions of audio objects during viewpoint switching. Provided is the information processing device which includes a content file generating unit that stores viewpoint switching information, which is to be used in correcting the positions of audio objects during viewpoint switching among a plurality of viewpoints, in the header of a content file and generates the content file.