In-Loop Sub-Image-Level Noise Modeling for Realistic Video Compression

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video compression algorithms either remove noise in the compression and decompression process or fail to realistically recreate noise in a decompressed image, using one-size-fits-all frame-level noise models that do not account for varying noise characteristics within an image frame.

Innovation Solution

Implement in-loop noise estimation and generation at a sub-image portion level of granularity, allowing for different noise patterns to be applied to different portions of an image frame, and include optional denoising filters to improve compression efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If frame-level noise models are used in video compression, then compression efficiency is improved, but noise characteristics are lost or unrealistic noise is generated

Engineering Contradiction:
Improvecompression efficiencyVSAvoidnoise characteristic accuracy
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent divides the image frame into multiple regions (e.g., foreground, background, different depth zones) and applies different noise models to each region. This segmentation allows the system to maintain compression efficiency through structured processing while preserving realistic noise characteristics in each specific region, resolving the contradiction between compression efficiency and noise accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements location-dependent noise modeling where different noise parameters (variance, correlation, temporal characteristics) are applied to different spatial locations within the frame. This local quality approach ensures that noise characteristics match the specific content of each region, maintaining both compression efficiency through systematic processing and realistic noise reproduction through localized adaptation.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If in-loop noise generation is implemented, then noise realism is improved, but device complexity increases

Engineering Contradiction:
Improvenoise pattern accuracyVSAvoidcompression loop complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent performs noise parameter estimation and region classification in advance during the encoding process, storing these parameters for use during decoding. By preparing noise models beforehand based on content analysis, the system achieves realistic noise generation without adding significant complexity to the main compression loop, as the heavy lifting is done during the initial pass.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements self-adaptive noise modeling where the system automatically estimates noise parameters from the video content itself and generates appropriate noise models without requiring external input or manual configuration. This self-service capability reduces operational complexity while maintaining high noise realism through content-driven adaptation.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20250240459A1Video Compression with In-Loop Sub-Image Level Controllable Noise Generation
Publication Date: 2025.07.24 APPLE INC
  • US20250240459A1 patent drawing
  • US20250240459A1 patent drawing
  • US20250240459A1 patent drawing

AI summary

A system comprises an encoder configured to compress video data using an in-loop noise generation process that generates noise in the compression loop at a sub-image portion level of granularity, such as at a block level. The encoder includes noise model and/or noise model input parameter information in an encoded bit stream. Also, a system includes a decoder configured to receive such a bit stream and decompress the video using an in-loop noise generation process that generates noise in the decompression loop at a sub-image portion level of granularity.