Depth Parameter Set Segmentation for Video Encoding Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing encoding methods do not effectively reduce the encoding amount of the encoded stream when depth image information is included, leading to inefficiencies in data transmission and processing.

Innovation Solution

An encoding device and method that set depth image information as a parameter set different from the sequence and picture parameter sets, perform differential encoding, and transmit the encoded stream, allowing for efficient data reduction by sharing depth image information between slices and maintaining compatibility with existing encoded streams.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If depth image information is included in the encoded stream using existing encoding methods, then the encoded stream contains complete 3D image data, but the encoding amount increases without optimization

Engineering Contradiction:
Improveencoding amountVSAvoiddata completeness
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The encoding device segments depth image information into a separate parameter set distinct from sequence parameter sets and picture parameter sets. This segmentation allows depth image data to be organized independently, enabling efficient encoding and transmission while maintaining data completeness through structured parameter organization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The parameter set structure is designed to be universal, accommodating both color image and depth image information within the same encoding framework. This multi-functionality allows the encoding system to handle different image types without requiring separate encoding pathways, reducing overall encoding complexity and data volume.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Device complexity

If depth image information is encoded separately from color image, then encoding complexity increases, but data organization improves

Engineering Contradiction:
Improveencoding complexityVSAvoiddata organization
Core Design Contradiction:
Device complexityVSStability of the object's composition

Solution Approach 1:

The encoding device merges the encoding processes for color images and depth images into a unified parameter set structure. By combining these separate encoding streams into a single organized framework with shared syntax elements, the system reduces encoding complexity while maintaining stable and systematic data organization.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The parameter sets are structured in a nested hierarchy where depth image parameter sets are integrated within the overall encoding framework alongside sequence and picture parameter sets. This nesting allows depth image data to be organized systematically within the existing encoding structure without creating separate complex systems.

Inventive Principle:
Principle #7Nested doll (Nesting)

3Productivity

If a new parameter set structure is created for depth images, then compatibility with existing systems may be compromised, but encoding efficiency improves

Engineering Contradiction:
Improveencoding efficiencyVSAvoidsystem compatibility
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The encoding device introduces parameter changes by adding depth image-specific parameters to the existing parameter set structure. Rather than creating a completely new encoding framework, the system modifies existing parameters and adds complementary elements, allowing efficient depth image encoding while maintaining compatibility with conventional decoding systems that can ignore or selectively process these new parameters.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10085007B2Encoding device and encoding method, and decoding device and decoding method
Publication Date: 2018.09.25 SONY GROUP CORP
  • US10085007B2 patent drawing
  • US10085007B2 patent drawing
  • US10085007B2 patent drawing

AI summary

An encoding device and an encoding method, and a decoding device and a decoding method configured to reduce an encoding amount of the encoded stream when information regarding a depth is included in the encoded stream. A DPS encoding unit sets depth image information, which is information regarding a depth image, as a DPS different from a sequence parameter set and a picture parameter set. Slice encoding circuitry encodes the depth image to generate encoded data. Further, the slice encoding circuitry transmits an encoded stream including the DPS and the encoded data. The present technology can be applied to, for example, a multi-view image encoding device.