360-Degree Video Region Metadata for Efficient Sub-Picture Transmission

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for processing and transmitting 360-degree video data are inefficient, lacking effective solutions for independent processing and transmission of region information, which hinders the delivery of high-quality virtual reality experiences.

Innovation Solution

A method and device for processing 360-degree video data that involves acquiring, processing, and transmitting 360-degree video data by converting it into 2D pictures, dividing them into sub-pictures, generating metadata with positional information, encoding the sub-pictures, and transmitting the encoded data along with metadata, enabling efficient storage and transmission.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If 360-degree video data is processed as a whole, then the completeness of the video content is maintained, but the processing and transmission efficiency deteriorates

Engineering Contradiction:
Improveprocessing efficiencyVSAvoiddata structure complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent divides the 360-degree video data into multiple sub-pictures based on region information, allowing independent processing of each sub-picture. This segmentation enables parallel processing and reduces the computational complexity of handling the entire video data as a single unit, thereby improving processing efficiency while maintaining data completeness through proper reconstruction.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If region information is transmitted independently, then the flexibility and adaptability of video processing is improved, but the data transmission volume increases

Engineering Contradiction:
Improveregion processing flexibilityVSAvoiddata volume
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential region information (positional coordinates and dimensions) from the complete video data structure. By taking out only the necessary metadata required for sub-picture identification and reconstruction, the system achieves region-level processing flexibility without transmitting redundant data, thus avoiding excessive data volume increase.

Inventive Principle:
Principle #2Taking out (Extraction)

3Productivity

If the entire 2D picture is transmitted as a single unit, then the simplicity of transmission is maintained, but the rendering efficiency and user experience deteriorates

Engineering Contradiction:
Improverendering efficiencyVSAvoidtransmission simplicity
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent segments the 2D picture into multiple sub-pictures with associated region information, enabling the receiving device to render only the relevant sub-pictures based on user viewport or priority. This segmentation improves rendering efficiency by avoiding unnecessary processing of the entire picture, while the transmission mechanism maintains simplicity through standardized metadata inclusion.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11363248B2Method and device for transmitting region information of 360-degree video
Publication Date: 2022.06.14 LG ELECTRONICS INC
  • US11363248B2 patent drawing
  • US11363248B2 patent drawing
  • US11363248B2 patent drawing

AI summary

A 360-degree video data processing method performed by a 360-degree video transmission device, according to the present invention, comprises the steps of: acquiring 360-degree video data; processing the 360-degree video data so as to acquire a 2D picture; dividing the 2D picture so as to derive sub-pictures; generating metadata for the 360-degree video data; encoding at least one of the sub-pictures; and performing processing for storing or transmitting the encoded at least one sub-picture and the metadata, wherein the metadata includes position information of the sub-picture on the 2D picture.