Free-Viewpoint Video Decapsulation With Viewpoint Dependency Signaling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current encapsulation methods for free viewpoint video bitstreams do not allow servers or clients to determine whether media files corresponding to specific viewpoints can be decoded, leading to low decoding efficiency.
Innovation Solution
Incorporate codec independence indication information in the video track to indicate whether video data of a single viewpoint depends on other viewpoints during codec, enabling clients to determine partial decoding and servers to re-encapsulate media files efficiently.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If single-track encapsulation mode is used for free viewpoint video bitstream, then file structure is simplified, but decoding efficiency deteriorates because server/client cannot determine whether media files of specific viewpoints can be decoded
Solution Approach 1:
The video track is segmented into multiple viewpoint units, each representing a specific viewpoint's video data. This segmentation allows the server and client to identify and process individual viewpoint media files independently, enabling efficient partial decoding without requiring full track processing.
Solution Approach 2:
Codec independence indication information is introduced as an intermediary element within the video track. This indication information acts as a mediator that communicates the decodability status of each viewpoint's media file, enabling the server and client to make informed decisions about which viewpoint files can be decoded without trial-and-error approaches.
2Productivity
If codec independence indication information is added to video track, then decoding efficiency is improved by enabling partial decoding determination, but data structure complexity increases
Solution Approach 1:
Codec independence indication information is applied locally to each viewpoint unit within the video track, rather than globally to the entire track. This local application allows the system to maintain a unified data structure while providing viewpoint-specific decodability information, minimizing the increase in overall data structure complexity.
Solution Approach 2:
The indication information provides more decodability information than strictly necessary for basic decoding, enabling advanced functions such as selective viewpoint rendering and efficient resource allocation. This partial information approach allows the system to achieve decoding efficiency improvements without requiring complete information about all possible decoding scenarios.
Data Source
AI summary
A file decapsulation method for a free viewpoint video includes receiving a media file of free viewpoint video data. The media file includes a video track, the free viewpoint video data includes video data of N viewpoints, and the video track includes codec independence indication information and video bitstreams of M viewpoints. The codec independence indication information indicates whether video data of one of the M viewpoints in the video track depends on video data of other viewpoints during codec. The method further includes decapsulating the media file according to the codec independence indication information, to obtain a video bitstream corresponding to at least one of the M viewpoints, and decoding the video bitstream corresponding to the at least one of the M viewpoints, to obtain reconstructed video data of the at least one of the M viewpoints.