Image Conversion Apparatus Slice Brick Boundary Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current parallel processing tools in video coding standards like HEVC and VVC face inefficiencies in processing, particularly in managing the relationship between slice and rectangular area boundaries for loop filter application, which affects processing efficiency.

Innovation Solution

The solution involves an image conversion and decoding apparatus that reconfigures the relationship between slices and rectangular areas within a coded picture, determining whether to apply a loop filter based on the equality of slice and rectangular area boundaries, and includes a mechanism to decode entry points for starting byte positions of subsequent rectangular areas, enabling efficient parallel processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the coded picture is reconfigured to align slice boundaries with rectangular area boundaries for loop filter application, then processing efficiency is improved, but device complexity increases due to the need for boundary comparison and conditional reconfiguration logic

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidboundary comparison and conditional reconfiguration logic
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The invention performs preliminary reconfiguration of the coded picture structure before loop filter application. By pre-aligning slice boundaries with rectangular area (brick) boundaries and pre-calculating entry points for parallel processing, the system eliminates the need for complex runtime boundary comparisons and conditional logic during filtering operations. This advance preparation simplifies the actual processing pipeline while maintaining high processing efficiency.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If entry points for subsequent rectangular areas are decoded from a further NAL unit, then parallel processing capability is enhanced, but loss of time occurs due to additional decoding operations from separate NAL units

Engineering Contradiction:
Improveparallel processing capabilityVSAvoiddecoding time from further NAL unit
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The invention introduces an intermediary conversion process that translates the bitstream structure into a format where entry points for rectangular areas are efficiently accessible. The image conversion apparatus acts as an intermediary that restructures the coded picture and associated data, allowing parallel processing units to access starting byte positions without requiring complex decoding from separate NAL units. This intermediary representation maintains parallel processing capability while reducing decoding overhead.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If the relationship between slice and rectangular areas is changed to optimize loop filter application, then manufacturing precision of the coded picture is improved, but device complexity increases due to reconfiguration requirements

Engineering Contradiction:
Improvecoded picture structure accuracyVSAvoidreconfiguration mechanism
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The invention implements a dynamic reconfiguration mechanism that adapts the relationship between slices and rectangular areas based on the specific characteristics of the coded picture. Rather than using a fixed rigid structure, the system dynamically adjusts boundaries and entry points to optimize loop filter application while maintaining structural integrity. This dynamic approach achieves high manufacturing precision without requiring overly complex static reconfiguration mechanisms.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12096007B2Image conversion apparatus and image decoding apparatus
Publication Date: 2024.09.17 JVC KENWOOD CORP
  • US12096007B2 patent drawing
  • US12096007B2 patent drawing
  • US12096007B2 patent drawing

AI summary

An image conversion apparatus adapted to convert a coded picture that includes a slice including an integer number of rectangular areas each including a collection of one or more rows of blocks, the blocks being derived from dividing an image into blocks of a predetermined size, is provided. The apparatus converts the coded picture so as to reconfigure a relationship between the slice and the rectangular areas included in the coded picture, when a slice boundary and a rectangular area boundary in the coded picture are equal in terms of whether to apply a loop filter and converts the coded picture so as not to change the relationship between the slice and the rectangular areas included in the coded picture when the slice boundary and the rectangular area boundary in the coded picture are not equal in terms of whether to apply a loop filter.