Weighted Downsampling and Transformations for Video Signal Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing signal encoding and decoding technologies face challenges in providing flexible, high-quality video output that is backward compatible with existing technologies and decoder hardware, particularly in efficiently encoding and decoding video sequences.

Innovation Solution

A method involving a down-sampler, baseline encoder and decoder, and enhancement encoder and decoder, where the input signal is down-sampled and encoded into two portions: a baseline encoded data stream and an enhancement encoded data stream, allowing for efficient transmission and decoding, with the enhancement encoder processing residual signals to improve video quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If video signals are encoded using conventional single-level encoding, then the encoding process is simple, but the video quality is limited and bitrate requirements are high

Engineering Contradiction:
Improvevideo qualityVSAvoidencoding complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The encoding process is divided into two independent levels: baseline encoding and enhancement encoding. The baseline encoder processes the down-sampled signal to produce a base layer, while the enhancement encoder processes the original signal to produce an enhancement layer. This segmentation allows each encoder to be optimized for its specific purpose, improving overall video quality while managing complexity through functional division.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The enhancement layer is nested within the baseline layer structure, where the enhancement encoder receives both the original signal and the down-sampled signal as inputs. The enhancement layer encodes the residual information that complements the baseline layer, creating a nested encoding structure where the enhancement layer depends on but adds value to the baseline layer.

Inventive Principle:
Principle #7Nested doll (Nesting)

2Manufacturing precision

If video signals are transmitted at high quality, then viewers receive better video output, but the bitrate requirements increase and compatibility with legacy hardware becomes difficult

Engineering Contradiction:
Improvevideo qualityVSAvoidbitrate
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The video signal is segmented into two quality layers: a baseline layer sufficient for legacy hardware playback and an enhancement layer that provides additional quality. This allows the system to transmit high-quality video while enabling legacy devices to decode only the baseline layer at lower bitrate requirements.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different quality levels are provided for different decoder capabilities. The baseline encoder produces output optimized for legacy hardware with limited processing capability, while the enhancement encoder produces output optimized for modern decoders. Each layer is locally optimized for its target platform, allowing high overall quality while managing bitrate for each specific use case.

Inventive Principle:
Principle #3Local quality

3Manufacturing precision

If video signals are transmitted at high quality, then viewers receive better video output, but the transmission bandwidth requirements increase

Engineering Contradiction:
Improvevideo qualityVSAvoidbandwidth
Core Design Contradiction:
Manufacturing precisionVSArea of stationary object

Solution Approach 1:

The video stream is segmented into baseline and enhancement layers that can be transmitted separately or combined. This segmentation allows flexible bandwidth allocation where legacy devices receive only the baseline layer requiring less bandwidth, while modern devices can receive both layers for high-quality output.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The dual-layer encoding structure provides universal compatibility across different device types. The same encoded stream can serve both legacy hardware (using only baseline layer) and modern hardware (using both layers), making the transmission system multi-functional and adaptable to various bandwidth conditions without requiring separate encoding paths.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Adaptability or versatility

If conventional encoding schemes are used, then backward compatibility with existing decoder hardware is maintained, but flexibility in encoding schemes is limited

Engineering Contradiction:
Improveencoding flexibilityVSAvoidbackward compatibility
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The encoding system is segmented into independent baseline and enhancement components. The baseline encoder uses conventional encoding schemes that are guaranteed to be compatible with existing decoder hardware, while the enhancement encoder introduces flexible, modern encoding techniques. This segmentation allows the system to maintain backward compatibility through the baseline layer while gaining encoding flexibility through the enhancement layer.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The down-sampled signal acts as an intermediary between the original high-resolution signal and the baseline encoder. This intermediary representation allows the baseline encoder to work with a simplified version of the signal using conventional methods, while the enhancement encoder processes the full-resolution signal to add flexibility and modern encoding capabilities to the overall system.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12126839B2Weighted downsampling and weighted transformations for signal coding
Publication Date: 2024.10.22 V NOVA INT LTD
  • US12126839B2 patent drawing
  • US12126839B2 patent drawing
  • US12126839B2 patent drawing

AI summary

Techniques for encoding a signal are described. A signal is down-sampled to generate a version of the signal. This version of the signal is then encoded to produce a first encoded signal. The first encoded signal is then decoded to produce a first decoded signal. The second decoded signal is up-sampled to obtain a first up-sampled decoded signal. A first residual signal is obtained by taking a difference between the first up-sampled decoded signal and a first reference signal. The first reference signal corresponds to the signal prior to down-sampling. The first residual signal is encoded to produce a first encoded residual signal. The first encoded residual signal and the first encoded signal may be received and decoded by a decoder to reconstruct the signal. The signal may comprise a set of frames of video.