Tile Coding Dependency Levels for Video ROI Encoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video encoding technologies face inefficiencies in encoding and decoding Region Of Interest (ROI) in videos, particularly in Dynamic Adaptive Streaming over HTTP (DASH) using H265/HEVC, as they require restrictive encoding dependencies that limit the flexibility and efficiency of combining different regions of interest.

Innovation Solution

The method defines Tile Coding Dependency Levels (TCDL) to adapt encoding constraints based on desired usage scenarios, allowing for minimal restrictions in encoding spatial parts of a video sequence, enabling efficient encoding and decoding of ROIs by signaling specific encoding constraints and dependencies.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If restrictive encoding dependencies are applied to ensure independent decoding of tiles, then decoding independence is improved, but encoding efficiency and flexibility deteriorate

Engineering Contradiction:
Improvedecoding independenceVSAvoidencoding efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent introduces Tile Coding Dependency Levels (TCDL) as a parameter that can be configured to adjust the degree of encoding constraints. By changing the TCDL parameter, the system can adapt between fully independent decoding (higher reliability) and more efficient encoding (higher productivity), resolving the contradiction through parameter adjustment rather than fixed constraints

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent makes the encoding dependencies dynamic by allowing different TCDL configurations for different tiles and different usage scenarios. Instead of static restrictive rules, the system dynamically adjusts encoding constraints based on whether independent decoding is actually needed, thus improving encoding efficiency while maintaining reliability when required

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If minimal encoding restrictions are applied to allow flexible combinations of ROIs, then adaptability is improved, but decoding independence deteriorates

Engineering Contradiction:
Improveflexibility in combining ROIsVSAvoiddecoding independence
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The TCDL parameter enables the system to switch between adaptive modes (minimal restrictions for flexibility) and independent decoding modes (stricter constraints). By adjusting this parameter, the system can adapt to different usage scenarios, resolving the contradiction between adaptability and reliability

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent creates a universal encoding framework that can serve multiple functions: it supports both independent decoding scenarios and flexible ROI combination scenarios through the same TCDL mechanism. This multi-functionality allows the system to achieve adaptability without permanently sacrificing decoding independence, as the latter can be restored by adjusting the TCDL parameter

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Productivity

If tile-based encoding is applied to enable parallel processing, then productivity is improved, but device complexity increases due to dependency management

Engineering Contradiction:
Improveparallel encoding and decodingVSAvoidencoding constraint management
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

By introducing the TCDL parameter, the patent simplifies dependency management into a configurable parameter rather than complex inter-dependent rules. This parameterization reduces device complexity while maintaining the ability to support parallel processing, as the TCDL can be set once per tile without requiring complex runtime dependency resolution

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11533350B2Method and apparatus for encoding and transmitting at least a spatial part of a video sequence
Publication Date: 2022.12.20 CANON KK
  • US11533350B2 patent drawing
  • US11533350B2 patent drawing
  • US11533350B2 patent drawing

AI summary

When encoding and transmitting video data comprising regions of interest, different usages of the regions of interest implicate different kinds of combination of region of interest at decoding. By studying the different impacts of the encoding mechanisms depending on other set of tiles data on the different kind of combination, it is possible to define a plurality of tile set coding dependency levels. Each tile set coding dependency level is linked to a set of constraints on encoding. These set of constraints have different impacts on the possibilities allowed when combining the different regions of interest. It is therefore possible, based on a desired usage, to select an encoding with minimal restrictions, as defined by a given tile coding dependency level, compatible with the desired usage. Accordingly, the encoding efficiency is improved, for a given usage, compared to a solution where a complete tile independency solution is used.