Free-Viewpoint Video Track Encapsulation for Real-Time View Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in efficiently processing and transmitting media data for flexible viewpoint switching and scene displaying, limiting immersive experiences in video playing and virtual games.
Innovation Solution
The method involves encapsulating texture maps and depth maps in media tracks, utilizing the ISO BMFF format, and processing free-viewpoint video data according to target-viewpoint information to enable efficient data encapsulation, transmission, and flexible viewpoint switching.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional media data processing methods are used, then data transmission is straightforward, but data processing efficiency is low and flexible viewpoint switching is difficult to implement
Solution Approach 1:
The patent segments media data into multiple independent media tracks, where each track can carry different types of data (texture maps, depth maps, viewpoint information). This segmentation allows parallel processing of different data types, improving overall data processing efficiency while maintaining organized data structures for flexible viewpoint switching.
Solution Approach 2:
The patent introduces a new dimension to traditional media data processing by adding viewpoint-related dimensions (viewpoint identifiers, depth information, texture map coordinates). This enables the system to process not only temporal and spatial dimensions but also viewpoint dimensions, allowing efficient flexible viewpoint switching through multi-dimensional data organization and processing.
2Adaptability or versatility
If free-viewpoint video data is processed to enable flexible viewpoint switching, then user immersive experience is improved, but data processing complexity increases
Solution Approach 1:
The patent creates a universal media track structure that can handle multiple data types (texture maps, depth maps, viewpoint information) within a unified framework. This multi-functional track design allows the same processing pipeline to support various viewpoint switching operations without requiring separate specialized processing systems for each data type, reducing overall system complexity.
Solution Approach 2:
The patent introduces viewpoint information as an intermediary element that mediates between raw media data and final rendered output. This intermediary layer organizes viewpoint-related data (viewpoint identifiers, transformation parameters, depth information) in a standardized format, simplifying the complexity of viewpoint switching by providing a clear interface between data input and rendering output.
Data Source
AI summary
A data processing method, apparatus and device, a storage medium, and a program product are disclosed. The method may include: acquiring free-viewpoint video data, the free-viewpoint video data comprises at least one texture map and/or at least one depth map; encapsulating the at least one texture map and/or the at least one depth map in at least one media track; and processing the free-viewpoint video data according to target-viewpoint information.