Adaptive Video Stream Processing with Reduced Color Resolution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video compression codecs require full chroma resolution for encoding, which adds computational complexity and delay when processing video streams with reduced color resolution, such as 4:2:0 subsampling ratio, as they need to convert these streams to full 4:4:4 resolution before encoding.
Innovation Solution
A solution that preprocesses a video frame with reduced color resolution by remapping luma and chroma components onto three input channels of a compression encoder, allowing the codec to adaptively encode without converting to full color resolution, and post-processes the encoded frame to reconstruct the original reduced color resolution.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If chroma subsampling is used to reduce data rate, then transmission efficiency is improved, but computational complexity increases due to required conversion to full resolution
Solution Approach 1:
The video frame is divided into multiple subpictures, and within each subpicture, luma and chroma components are segmented and remapped onto separate data channels. This segmentation allows the encoder to process reduced-color-resolution data directly without requiring conversion to full 4:4:4 resolution, thereby reducing computational complexity while maintaining transmission efficiency.
2Loss of energy
If chroma subsampling is used to reduce data rate, then transmission efficiency is improved, but processing delay increases due to conversion requirements
Solution Approach 1:
The pre-process module performs remapping of luma and chroma components onto encoder data channels before the encoding process begins. This preliminary action prepares the reduced-color-resolution data in the correct format for the encoder, eliminating the need for time-consuming conversion to full resolution during encoding and thereby reducing processing delay.
3Adaptability or versatility
If video data is encoded at full chroma resolution, then encoding compatibility is improved, but data transmission efficiency deteriorates
Solution Approach 1:
The solution enables the encoder to universally accept both full-resolution (4:4:4) and reduced-color-resolution (4:2:0, 4:2:2) video data without requiring separate processing paths. The pre-process module adapts the input data format to match the encoder's expected input, allowing the same encoding infrastructure to handle multiple chroma sampling ratios efficiently.
Data Source
AI summary
A solution for adaptively processing a digital image with reduced color resolution is described herein. A source device pre-processes a video frame with reduce color resolution by remapping luma components and chroma components of the video frame, and encodes the pre-processed video frame. The source device remaps a half of luma components on a scan line of the video frame onto a data channel of a source line to an encoder and remaps the other half of the luma components on the scan line to another data channel of the source line. The source device remaps the corresponding chroma components onto a third data channel of a source line. By using a data channel conventionally configured to transmit chroma components, the solution enables a video codec to adaptively encode a digital image with reduced color resolution without converting the digital image to full color resolution before the encoding.