Intra-coding Image Frame Pipeline with Pixel Adjustment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing intra-coding methods for image frames result in larger I-frames due to exploitation of only spatial redundancies, leading to increased bitstream size and potential loss of image information, especially in surveillance applications, and require pre-processed images for comparison and threshold adjustments, causing delays and inefficiencies.
Innovation Solution
A method involving an image pipeline that adjusts pixel values within blocks by a predefined amount to reduce residuals, allowing for more efficient intra-prediction mode selection and reducing the size of I-frames, while maintaining image quality by focusing on regions of non-interest and using multiple intra-prediction modes supported by encoding standards like AVC, HEVC, or AV1.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If intra-coding is used to compress image frames, then spatial redundancy is exploited for compression, but the resulting I-frames have larger size compared to inter-coded P-frames
Solution Approach 1:
The patent applies preliminary action by performing pixel value adjustment before the main intra-coding process. The processing part modifies pixel values in the image frame prior to encoding, which prepares the data to reduce residuals during encoding, ultimately decreasing the bitstream size of I-frames while maintaining image quality.
2Quantity of substance
If adaptive pre-processing is used to reduce I-frame size by replicating reference blocks, then bitstream size is reduced, but image information is lost in replicated blocks
Solution Approach 1:
The patent applies local quality by selectively adjusting pixel values only in specific blocks of the image frame based on their characteristics, rather than uniformly processing the entire frame. This targeted approach allows the method to reduce residuals and bitstream size in suitable blocks while preserving image information in blocks where adjustment is not applied, thus avoiding the information loss problem of full-frame replication.
3Productivity
If multiple intra-prediction modes are supported to reduce residuals, then compression efficiency is improved, but device complexity increases
Solution Approach 1:
The patent applies preliminary action by pre-adjusting pixel values before the encoding stage, which simplifies the subsequent encoding process. By preparing the pixel data in advance to have smaller residuals, the encoding part can more efficiently select and apply intra-prediction modes, improving compression efficiency without proportionally increasing device complexity.
Data Source
AI summary
There is provided an image pipeline and a method therein for intra-coding an image frame. The image pipeline comprises a processing part followed by an encoding part supporting a plurality of intra-prediction modes used for intra-coding image frames. The method comprises receiving an image frame and for at least one block of pixel values in the image frame: predicting pixel values of the at least one block of pixel values using an intra-prediction mode supported by the encoding part and updating the image frame by adjusting at least one pixel value within the at least one block of pixel values so as to reduce a residual between the at least one pixel value and a corresponding predicted pixel value. Further, the method comprises intra-coding the updated image frame using at least one out of the plurality of intra-prediction modes.