Panoramic Video Boundary Fill Adaptation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Panoramic videos require efficient compression techniques due to their large data volume and high distortion, which is not adequately addressed by traditional video encoding methods, leading to difficulties in transmission and storage.

Innovation Solution

The method employs multi-mode boundary fill techniques during inter-frame prediction in panoramic video encoding and decoding, adaptively selecting boundary fill methods based on reference sample coordinates to optimize image boundary fill and improve compression efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If traditional video encoding methods are used for panoramic videos, then the encoding process is simple, but the compression efficiency is insufficient due to large data volume and high distortion

Engineering Contradiction:
Improveencoding simplicityVSAvoidcompression efficiency
Core Design Contradiction:
Ease of manufactureVSLoss of information

Solution Approach 1:

The patent segments the panoramic video encoding process into multiple modes (intra-mode and inter-mode boundary fill methods). The image is divided into current image blocks that are processed using different encoding strategies based on their position and characteristics, allowing optimized compression for each segment while maintaining overall simplicity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different boundary fill methods locally based on the position of reference samples. When reference samples are within the reference image, one method is used; when they extend beyond boundaries, another method is applied. This local differentiation improves compression efficiency without significantly increasing overall system complexity

Inventive Principle:
Principle #3Local quality

2Quantity of substance

If block encoding is used to reduce transmission area, then transmission requirements are reduced, but encoding efficiency decreases

Engineering Contradiction:
Improvetransmission data volumeVSAvoidencoding efficiency
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The patent dynamically adapts the boundary fill method based on the coordinates of reference samples. The encoding process automatically switches between different fill methods (horizontal, vertical, or planar) depending on the specific block position and reference sample locations, optimizing the balance between transmission data volume and encoding efficiency for each block

Inventive Principle:
Principle #15Dynamics

3Productivity

If encoding block size is increased to improve encoding efficiency, then encoding efficiency improves, but transmission area increases leading to larger data volume

Engineering Contradiction:
Improveencoding efficiencyVSAvoidtransmission data volume
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent changes the boundary fill parameters adaptively based on reference sample coordinates. By adjusting the fill method parameter (选择不同的边界填充方法) according to the specific block characteristics, the system achieves better compression ratios for larger blocks without proportionally increasing transmission data volume

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10341682B2Methods and devices for panoramic video coding and decoding based on multi-mode boundary fill
Publication Date: 2019.07.02 PEKING UNIV SHENZHEN GRADUATE SCHOOL
  • US10341682B2 patent drawing
  • US10341682B2 patent drawing
  • US10341682B2 patent drawing

AI summary

Methods and devices are disclosed for panoramic video coding and decoding based on multi-mode boundary fill. If a predicted image block of a current image block is obtained by inter-frame prediction. The inter-frame prediction includes a boundary fill step of adaptively selecting a boundary fill method according to coordinates of a reference sample when the reference sample of a pixel in the current image block is outside the boundary of a corresponding reference image, to obtain a sample value of the reference sample. The panoramic video encoding and decoding method and device based on multi-mode boundary fill in the present invention make full use of the characteristic that horizontal image contents in a panoramic video are cyclically connected to optimize an image boundary fill method, such that the encoding can adaptively select a more reasonable boundary fill method according to the coordinates of a reference sample, thereby improving compression efficiency.