Free-View Video Boundary Metadata for Scene Edge Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current file encapsulation technologies for free-view videos only provide basic metadata, leading to reduced video rendering quality at scene boundaries.
Innovation Solution
Generate a spliced texture map and depth map from multiple camera images, obtain boundary metadata information, and add it to a file encapsulation data box to create an extended data box, enabling improved video rendering at scene boundaries by identifying boundary cameras and rendering video content accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If only basic metadata information is provided in file encapsulation, then the file structure remains simple, but video rendering quality at scene boundaries deteriorates
Solution Approach 1:
The metadata is segmented into different types: basic metadata (camera quantity, identifiers, positions) and boundary metadata (scene boundary coordinates, boundary camera identifiers). This segmentation allows the system to provide detailed information where needed (at boundaries) while keeping the overall structure organized and manageable.
Solution Approach 2:
The patent adds a new dimension to the metadata structure by introducing boundary metadata that operates alongside basic metadata. This creates a multi-layered information structure where boundary-specific information (coordinates, boundary camera IDs) is added without completely redesigning the existing metadata framework.
2Manufacturing precision
If detailed boundary metadata is added to improve rendering quality, then video rendering quality improves, but information processing complexity increases
Solution Approach 1:
Detailed boundary metadata (boundary coordinates, boundary camera identifiers) is applied specifically to boundary regions rather than uniformly across the entire video. This local quality approach ensures high rendering precision where it is most needed (at scene boundaries) while avoiding unnecessary complexity in regions where basic metadata suffices.
Solution Approach 2:
The video client automatically detects boundary cameras and retrieves relevant boundary metadata from the extended data box without requiring complex external processing. The system self-organizes the rendering process by using the boundary metadata to identify and render boundary camera content appropriately.
3Measurement precision
If boundary camera identification is implemented, then scene boundary rendering accuracy improves, but client-side processing requirements increase
Solution Approach 1:
Boundary metadata including boundary camera identifiers and scene boundary coordinates is pre-calculated and embedded in the video file's extended data box during encoding. This preliminary action shifts the computational burden to the encoding stage, allowing the video client to simply retrieve and use the pre-processed boundary information without performing complex real-time calculations.
Solution Approach 2:
The boundary metadata acts as an intermediary between the encoded video content and the rendering process. It provides the video client with ready-to-use boundary information (coordinates, camera identifiers) that mediates between the raw video data and the final rendered output, simplifying the client's processing requirements while maintaining high accuracy.
Data Source
AI summary
A video data processing method includes generating, based on a spliced texture map and depth map, an encoded video bitstream of a free-view video based on multiple images collected by an ith camera in a camera array. The method further includes obtaining boundary metadata information indicating a scene boundary of the free-view video, and adding the boundary metadata information to a file encapsulation data box, to obtain an extended data box. The method further includes performing encapsulation on the encoded video bitstream and the extended data box to obtain a video media file of the free-view video including the boundary metadata information. The method further includes delivering the video media file to a video client, enabling the video client to determine that the ith camera is a boundary camera, and to render video content in the scene boundary indicated by the boundary metadata information.