SAO Signaling Decoupling for HEVC CABAC Throughput

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current high-efficiency video coding (HEVC) systems face inefficiencies in Sample Adaptive Offset (SAO) signaling due to limitations in syntax and binarization, leading to reduced throughput and suboptimal performance in video compression.

Innovation Solution

The proposed solution involves decoupling SAO type coding, introducing new context modeling, and reordering the interleaving of context-coded and bypass-coded bins to enhance SAO parameter signaling, specifically through joint encoding of SAO on/off flags, using truncated unary binarization, and separate signaling for SAO types and side information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If context-coded bins and bypass-coded bins are interleaved in SAO signaling, then coding flexibility is improved, but CABAC engine throughput deteriorates

Engineering Contradiction:
Improvecoding flexibilityVSAvoidCABAC engine throughput
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent segments the SAO signaling process into distinct phases: first all context-coded bins are transmitted, then all bypass-coded bins are transmitted. This segmentation separates the two coding methods that were previously interleaved, allowing the CABAC engine to process context-coded bins continuously without interruption from bypass-coded bins, thereby improving throughput while maintaining coding flexibility through the preserved choice of coding methods.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If complex syntax and binarization methods are used for SAO signaling, then coding precision is improved, but signaling efficiency deteriorates

Engineering Contradiction:
Improvecoding precisionVSAvoidsignaling efficiency
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent extracts the bypass-coded bins from the interleaved structure and separates them into a distinct transmission phase. By taking out the bypass-coded bins and transmitting them after all context-coded bins, the patent reduces the overhead and complexity of the signaling structure while preserving the precision benefits of both coding methods. This extraction eliminates the inefficiencies of interleaving while maintaining the high precision required for accurate SAO parameter signaling.

Inventive Principle:
Principle #2Taking out (Extraction)

3Manufacturing precision

If multiple SAO types and offset values are signaled, then reconstruction accuracy is improved, but bitstream complexity increases

Engineering Contradiction:
Improvereconstruction accuracyVSAvoidbitstream complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by transmitting all context-coded bins first, establishing the SAO type and parameters before transmitting the bypass-coded bins. This preliminary transmission of the more complex context-coded information allows the decoder to prepare appropriate processing structures in advance, simplifying the overall bitstream structure while maintaining the ability to signal multiple SAO types and offset values for high reconstruction accuracy.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10750197B2Enhancements in sample adaptive offset (SAO) for high efficiency video encoder (HEVC)
Publication Date: 2020.08.18 SONY GROUP CORP
  • US10750197B2 patent drawing
  • US10750197B2 patent drawing
  • US10750197B2 patent drawing

AI summary

An encoder/decoder is described using enhanced signaling mechanisms SAO parameters. The various parameters are signaled in various ways according to different embodiments of the invention. In a first embodiment (embodiment A), SAO on/off is decoupled form SAO type coding, with SAO on/off flags being jointly encoded for all color components. The second embodiment (embodiment B), is similar to embodiment A, but modified for application to JCTVC-J0268. In a third embodiment separate signaling is provided for SAO on/off, SAO types BO and EO, and for BO and EO side information (classes or band position). Each of these enhanced SAO signaling mechanisms provide enhanced coding efficiency.