Video Frame Portion Encoding with Independent Headers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current HEVC mechanisms are not designed to efficiently handle scenarios involving the streaming of individual tiles or sets of tiles, or the combination of different tiles to compose a new video sequence, requiring additional encoding constraints and rewriting processes.

Innovation Solution

The method involves defining frame portions and signaling them in the bitstream, allowing for the extraction and recombination of these frame portions at decoding while minimizing rewriting processes. This includes encoding frame portions into encoded units, signaling frame portion identifiers, and providing frame portion arrangement information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If HEVC tiles are used for parallel encoding, then encoding efficiency is improved, but flexibility for streaming individual tiles or recombining tiles is reduced

Engineering Contradiction:
Improveencoding efficiencyVSAvoidflexibility for streaming and recombining
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The video frame is divided into multiple independent frame portions, each with its own header containing identification and arrangement information. This segmentation allows individual portions to be extracted, streamed, or recombined independently while maintaining encoding efficiency through parallel processing of separate portions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The frame portion structure is designed to serve multiple functions: it enables parallel encoding like HEVC tiles, allows independent streaming of any portion, supports recombination of different portions, and maintains compression efficiency. The universal header format and independent structure make the system adaptable to various应用场景.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If individual tiles are streamed or recombined, then flexibility is improved, but encoding constraints and rewriting processes are increased

Engineering Contradiction:
Improveflexibility for streaming and recombiningVSAvoidencoding constraints and rewriting processes
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

During the encoding phase, each frame portion is pre-equipped with a header containing its identification information and arrangement data. This preliminary action ensures that when portions need to be streamed or recombined, no additional rewriting or manipulation of headers is required, significantly reducing decoding complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Each frame portion is designed to be self-contained with all necessary information (identification, arrangement, encoding parameters) embedded in its own header. This self-service design allows portions to be independently processed, extracted, and recombined without requiring external rewriting processes or dependency on other portions' data structures.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If frame portions are independently encoded, then flexibility for extraction is improved, but compression efficiency may be reduced

Engineering Contradiction:
Improveflexibility for extractionVSAvoidcompression efficiency
Core Design Contradiction:
Adaptability or versatilityVSLoss of energy

Solution Approach 1:

The encoding approach applies different quality levels and encoding parameters to different frame portions based on their importance and usage requirements. Critical portions can be encoded with higher quality and more robust parameters, while less critical portions use more aggressive compression, optimizing the overall balance between extraction flexibility and compression efficiency.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

Each frame portion can have its own encoding parameters (quantization, resolution, compression level) independently adjusted. This allows the system to optimize compression efficiency by varying parameters across different portions while maintaining the ability to extract and stream any portion independently with appropriate quality characteristics.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12212749B2Method and apparatus for encoding or decoding video data with frame portions
Publication Date: 2025.01.28 CANON KK
  • US12212749B2 patent drawing
  • US12212749B2 patent drawing
  • US12212749B2 patent drawing

AI summary

The present invention concerns a method of encoding video data comprising frames into a bitstream, frames being spatially divided into frame portions, the method comprising:encoding at least one frame portion into one or more first encoded units;wherein the method further comprises:signalling into said first encoded units, at least one frame portion identifier, a frame portion identifier identifying one encoded frame portion; andproviding frame portion arrangement information comprising the frame portion identifier and spatial information about the frame portion.