V3C Scene Description for Immersive Video Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current multimedia technologies lack detailed mechanisms for listing V3C components and grouping V3C atlas tracks and component tracks, which are essential for effective visual volumetric video-based coding (V3C) in immersive scene descriptions, leading to inefficiencies in media stream management and rendering.

Innovation Solution

The implementation of a communication interface and processor system that receives and renders scene descriptions for V3C content, including media streams for V3C atlases and components, using a buffer to manage and deliver decoded data for 3D reconstruction, aligning with ISO/IEC 23090 standards to ensure integrity and reuse of existing technologies.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If detailed mechanisms for listing and grouping V3C components are implemented, then the completeness and accuracy of scene description is improved, but the complexity of the scene description format increases

Engineering Contradiction:
Improvecompleteness of V3C component listingVSAvoidcomplexity of scene description format
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The scene description is segmented into distinct components: V3C atlas tracks and V3C component tracks. Each track type is independently defined and referenced, allowing detailed component listing without creating a monolithic complex structure. The segmentation enables modular organization where each component can be described separately while maintaining overall scene integrity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a new dimensional layer to the scene description by adding explicit grouping mechanisms and referencing structures. Instead of flattening all V3C components into a single list, the solution creates a hierarchical dimension with tracks, groups, and references, allowing comprehensive description while managing complexity through structured organization.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Stability of the object's composition

If V3C atlas tracks and component tracks are grouped together, then the integration and coherence of V3C content is improved, but the difficulty of managing and referencing media streams increases

Engineering Contradiction:
Improvecoherence of V3C contentVSAvoidease of managing media streams
Core Design Contradiction:
Stability of the object's compositionVSEase of operation

Solution Approach 1:

The patent applies preliminary action by pre-defining track groups and establishing reference relationships before media stream processing. The scene description format includes pre-configured groupings of V3C atlas tracks and component tracks, with explicit references defined in advance. This allows the rendering system to efficiently manage streams without complex real-time decisions, as the organizational structure is predetermined.

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If mechanisms for referencing V3C atlas tracks to component tracks are added, then the accuracy of content composition is improved, but the processing overhead for rendering increases

Engineering Contradiction:
Improveaccuracy of content compositionVSAvoidprocessing time for rendering
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent uses copying by creating reference pointers to track definitions rather than duplicating full track data throughout the scene description. Each V3C component track reference points to its corresponding atlas track definition, allowing accurate composition through efficient referencing. This eliminates redundant data storage and reduces processing overhead while maintaining precise composition accuracy.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS20230334710A1Support of visual volumetric video-based coding (V3C) in immersive scene description
Publication Date: 2023.10.19 SAMSUNG ELECTRONICS CO LTD
  • US20230334710A1 patent drawing
  • US20230334710A1 patent drawing
  • US20230334710A1 patent drawing

AI summary

An apparatus includes a communication interface and a processor operably coupled to the communication interface. The communication interface includes a buffer. The processor is configured to receive, via the communication interface, a scene description for visual volumetric video-based coding (V3C) content, wherein the scene description indicates a media stream for a V3C atlas and media streams for V3C components. The processor is also configured to receive, via the communication interface, a plurality of media streams of the V3C content. The processor is further configured to render the plurality of media streams based on the scene description for the V3C content.