3D Video Compression via 2D Frame Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods lack an efficient way to compress and transmit three-dimensional video content, particularly point cloud data, due to its large memory and processor resource requirements.

Innovation Solution

A method is developed to generate a media file containing three-dimensional video content by compressing it into a two-dimensional video frame and encapsulating it within an ISO base media file format (ISOBMFF), along with necessary metadata, allowing for efficient transmission and reconstruction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If point cloud data is transmitted in its original three-dimensional format, then the data完整性 (completeness) is preserved, but the memory and processor resource requirements become excessively large

Engineering Contradiction:
Improvedata completenessVSAvoiddata volume
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent transforms three-dimensional point cloud data into a two-dimensional video frame format for compression and transmission. This dimensional conversion allows the use of efficient 2D video compression standards while preserving the essential 3D information through metadata, thereby reducing data volume while maintaining data completeness for reconstruction

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent changes the representation parameters of 3D data by encoding point cloud information as 2D video frames with associated metadata containing spatial position information. This parameter transformation enables standard video compression techniques to be applied, significantly reducing the quantity of data while maintaining the ability to reconstruct the original 3D content

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If a new point cloud format is defined to carry three-dimensional data, then the data representation accuracy is improved, but the device complexity increases

Engineering Contradiction:
Improvedata representation accuracyVSAvoidformat complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent makes the media file format universal by using the widely adopted ISOBMFF container format that can carry both 2D video frames and 3D metadata. This multi-functional approach allows the same format structure to handle both compressed video data and spatial information, reducing device complexity while maintaining high data representation accuracy

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces metadata as an intermediary element that bridges the 2D video frame representation and the original 3D point cloud data. This metadata layer contains the spatial position information needed to reconstruct 3D content from 2D frames, achieving accurate data representation without requiring a completely new complex 3D file format

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If three-dimensional video content is compressed into two-dimensional video frames, then the transmission efficiency is improved, but the reconstruction complexity increases

Engineering Contradiction:
Improvetransmission efficiencyVSAvoidreconstruction complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent performs preliminary organization of 3D point cloud data into structured 2D video frames with embedded metadata during the encoding phase. By pre-organizing the data with spatial position information and entry point markers, the reconstruction process at the receiving end is simplified, reducing reconstruction complexity while maintaining high transmission efficiency

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11606576B2Method and apparatus for generating media file comprising 3-dimensional video content, and method and apparatus for replaying 3-dimensional video content
Publication Date: 2023.03.14 SAMSUNG ELECTRONICS CO LTD
  • US11606576B2 patent drawing
  • US11606576B2 patent drawing
  • US11606576B2 patent drawing

AI summary

The present disclosure relates to a method and a device for generating and transmitting a media file containing three-dimensional (3D) video content. The present disclosure also relates to a method and a device for reconstructing and reproducing three-dimensional video content from a received media file. According to an aspect of an embodiment of the present disclosure, a method of generating a media file containing three-dimensional video content may include inserting, into a media data box in the media file, a plurality of components contained in a two-dimensional video frame in which the three-dimensional video content is compressed; inserting, into a metadata box in the media file, first tracks respectively corresponding to the components and a second track containing metadata; and inserting, into the second track, information about an entry point for each of the plurality of components.