Video Encoder Segmentation for Bandwidth and Quality Trade-offs

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Scalable video codecs are not suited for large screens with limited bandwidth, as they result in blurry video due to low frequency components, which does not align with human perception of quality, and existing encoders face challenges in compressing video signals without introducing visually disturbing artifacts.

Innovation Solution

An encoder comprising a video modelling module, segmentation module, and vectorisation module that determines video modelling parameters and segments the video signal into spatiotemporal regions, encoding based on vectorised surfaces and a subset of these parameters to reduce storage and transmission requirements, prioritizing Mean Opinion Score (MOS) over Peak Signal-to-Noise Ratio (PSNR), allowing for efficient compression and reduced artifact likelihood.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If scalable video codecs use base layers with low frequency components for small screens, then bandwidth requirements are reduced, but video quality becomes blurry and unsuitable for large screens

Engineering Contradiction:
Improvebandwidth consumptionVSAvoidvideo quality
Core Design Contradiction:
Loss of energyVSManufacturing precision

Solution Approach 1:

The video signal is segmented into multiple quality layers, where each layer represents a different level of detail. The base layer contains essential low-frequency information suitable for small screens, while additional layers contain high-frequency details for larger screens. This segmentation allows receivers to select appropriate layers based on their capabilities and network conditions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the video signal are treated with different quality levels based on their importance. Critical regions such as object boundaries and high-contrast areas receive enhanced encoding priority to preserve sharp edges, while less important regions can be compressed more aggressively. This ensures that perceptually important features maintain quality even under compression.

Inventive Principle:
Principle #3Local quality

2Loss of energy

If video encoders compress video signals more substantially to reduce storage and transmission requirements, then bandwidth consumption is reduced, but visually disturbing artifacts become more frequent

Engineering Contradiction:
Improvetransmission bandwidthVSAvoidvisual quality without artifacts
Core Design Contradiction:
Loss of energyVSReliability

Solution Approach 1:

The encoder dynamically adjusts encoding parameters such as quantization step size, transform block size, and prediction mode based on local video characteristics and available bandwidth. In regions with complex textures or motion, parameters are adjusted to prevent artifacts, while in simpler regions, more aggressive compression is applied. This adaptive parameter adjustment maintains visual quality while optimizing bandwidth usage.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The encoding process incorporates feedback mechanisms where the encoder evaluates the quality impact of compression decisions in real-time. Quality metrics are used to guide further encoding decisions, ensuring that compression does not exceed perceptual thresholds where artifacts become noticeable. This feedback loop allows the system to maintain acceptable visual quality while achieving high compression ratios.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10194157B2Encoder, decoder, system and methods for video coding
Publication Date: 2019.01.29 ALCATEL LUCENT SA
  • US10194157B2 patent drawing

AI summary

An encoder for encoding a video signal, comprising a video modelling module configured for determining a plurality of video modelling parameters for a plurality of video locations on a spatiotemporal grid of said video signal, said spatiotemporal grid comprising at least two spatial dimensions and a time dimension, each video modelling parameter being adapted for allowing a pre-determined video model to at least approximately reconstruct its video location, a video segmentation module configured for segmenting said video signal into a plurality of spatiotemporal video regions, based on said video modelling parameters and a vectorisation module configured for vectorising spatiotemporal surfaces of said spatiotemporal video regions; and wherein said encoder is configured for encoding said video signal based on at least a subset of said determined plurality of video modelling parameters and based on said vectorised spatiotemporal surfaces, wherein said subset is determined taking into account said spatiotemporal video regions.