In-Loop Sub-Image-Level Noise Modeling for Realistic Video Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video compression algorithms either remove noise in the compression and decompression process or fail to realistically recreate noise in a decompressed image, using one-size-fits-all frame-level noise models that do not account for varying noise characteristics within an image frame.
Innovation Solution
Implement in-loop noise estimation and generation at a sub-image portion level of granularity, allowing for different noise patterns to be applied to different portions of an image frame, and include optional denoising filters to improve compression efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If frame-level noise models are used in video compression, then compression efficiency is improved, but noise characteristics are lost or unrealistic noise is generated
Solution Approach 1:
The patent divides the image frame into multiple regions (e.g., foreground, background, different depth zones) and applies different noise models to each region. This segmentation allows the system to maintain compression efficiency through structured processing while preserving realistic noise characteristics in each specific region, resolving the contradiction between compression efficiency and noise accuracy.
Solution Approach 2:
The patent implements location-dependent noise modeling where different noise parameters (variance, correlation, temporal characteristics) are applied to different spatial locations within the frame. This local quality approach ensures that noise characteristics match the specific content of each region, maintaining both compression efficiency through systematic processing and realistic noise reproduction through localized adaptation.
2Manufacturing precision
If in-loop noise generation is implemented, then noise realism is improved, but device complexity increases
Solution Approach 1:
The patent performs noise parameter estimation and region classification in advance during the encoding process, storing these parameters for use during decoding. By preparing noise models beforehand based on content analysis, the system achieves realistic noise generation without adding significant complexity to the main compression loop, as the heavy lifting is done during the initial pass.
Solution Approach 2:
The patent implements self-adaptive noise modeling where the system automatically estimates noise parameters from the video content itself and generates appropriate noise models without requiring external input or manual configuration. This self-service capability reduces operational complexity while maintaining high noise realism through content-driven adaptation.
Data Source
AI summary
A system comprises an encoder configured to compress video data using an in-loop noise generation process that generates noise in the compression loop at a sub-image portion level of granularity, such as at a block level. The encoder includes noise model and/or noise model input parameter information in an encoded bit stream. Also, a system includes a decoder configured to receive such a bit stream and decompress the video using an in-loop noise generation process that generates noise in the decompression loop at a sub-image portion level of granularity.


