Video Encoder Background Picture Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video encoding/decoding solutions experience decoding and playback freezes, as well as frame drops, due to the background picture bitstream not being received in real time, leading to poor user experience in applications with limited transmission bandwidth.

Innovation Solution

A method and apparatus for synchronizing the usage of a background picture as a reference picture between the encoder and decoder sides, where the background picture is encoded and transmitted as a reference picture, with indication information ensuring timely reception and usage, allowing for efficient inter-frame prediction coding without overwhelming the transmission channel.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If the background picture is encoded and transmitted as a reference picture with high quality, then coding efficiency is improved, but transmission bandwidth is exceeded causing decoding freezes and frame drops

Engineering Contradiction:
Improvecoding efficiencyVSAvoiddecoding stability
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The patent segments the background picture transmission by dividing it into multiple picture blocks that are transmitted separately. Each block is encoded and transmitted independently, allowing the system to manage bandwidth consumption in a controlled manner while maintaining overall coding efficiency. This segmentation prevents any single large background picture transmission from overwhelming the channel capacity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary encoding and segmentation of the background picture before transmission. By preparing the background picture data in advance and dividing it into manageable blocks, the system ensures that transmission can proceed smoothly without causing decoding freezes, while still providing high-quality reference material for improved coding efficiency.

Inventive Principle:
Principle #10Preliminary action

2Loss of time

If the background picture bitstream is transmitted in real time, then user experience is improved, but transmission channel capacity is exceeded

Engineering Contradiction:
Improvereal-time receptionVSAvoidtransmission bandwidth
Core Design Contradiction:
Loss of timeVSQuantity of substance

Solution Approach 1:

The background picture bitstream is segmented into multiple smaller picture block bitstreams that can be transmitted sequentially or in parallel within the available bandwidth. This segmentation allows real-time transmission to proceed without overwhelming the channel capacity, as each block requires less bandwidth than the complete background picture would demand.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transmits partial information (individual picture blocks) rather than the complete background picture at once. This partial action approach enables real-time transmission within bandwidth constraints, as the system transmits only the necessary portions of the background picture that fit within the available channel capacity at any given time.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If multiple reference pictures are used for motion search, then coding performance is improved, but complexity of reference picture management increases

Engineering Contradiction:
Improvecoding performanceVSAvoidreference picture management
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the reference picture management by treating each picture block as an independent unit with its own motion search and reference picture selection. This segmentation simplifies management complexity by breaking down the large-scale problem of managing multiple complete reference pictures into smaller, more manageable problems of managing reference blocks, while still achieving improved coding performance through multiple reference blocks.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP3448021B1Video encoding and decoding method and device
Publication Date: 2021.11.10 HUAWEI TECH CO LTD
  • EP3448021B1 patent drawingFigure 1
  • EP3448021B1 patent drawingFigure 2~3
  • EP3448021B1 patent drawingFigure 4~5

AI summary

The present invention provides a video encoding/decoding method and apparatus, so that usage of a background picture is synchronized on an encoder side and a decoder side. In this solution, a background picture that is to be used as a reference picture is determined, background-picture indication information is used to indicate a time point from which the background picture is used as the reference picture, the encoder side encodes to-be-coded video pictures by using the background picture as the reference picture from the time point indicated by the background-picture indication information, to generate a primary bitstream, and the encoder side transmits a background-picture bitstream, the background-picture indication information, and the primary bitstream to the decoder side. The background-picture indication information is used to indicate the time point from which the background picture is used as the reference picture, so that time points at which the encoder side and the decoder side use the reference picture can be synchronized.