Dynamic Video Denoising With Temporal Consistency Loss

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional AI image denoising models struggle to maintain stability when processing dynamic videos, leading to ghosting or shaking, which affects the clarity and stability of the video.

Innovation Solution

A method and device using deep neural networks trained with consistency loss to optimize consecutive image frames, employing a Siamese mode and visual geometry group features to enhance stability, combined with a recovery loss to align frames with real images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional AI image denoising models are used to process dynamic videos, then denoising capability is improved, but video stability deteriorates causing ghosting or shaking

Engineering Contradiction:
Improvedenoising capabilityVSAvoidvideo stability
Core Design Contradiction:
ReliabilityVSStability of the object's composition

Solution Approach 1:

The patent applies dynamics by transitioning from static image denoising to dynamic video denoising. The model processes multiple consecutive frames rather than single images, allowing the system to adapt to temporal variations and maintain stability across moving objects. This dynamic approach enables the denoising algorithm to distinguish between actual motion and artifacts, eliminating ghosting and shaking while preserving denoising effectiveness.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements continuity of useful action by processing consecutive video frames sequentially and maintaining temporal consistency. The model uses multiple adjacent frames to preserve temporal coherence, ensuring that denoised content remains stable across time. This continuous processing approach allows the system to maintain object identity and position across frames while removing noise, directly addressing the stability issue in dynamic videos.

Inventive Principle:
Principle #20Continuity of useful action

2Reliability

If AI algorithms are applied to denoise video frames, then noise reduction is improved, but frame stability and clarity deteriorate due to ghosting effects

Engineering Contradiction:
Improvenoise reductionVSAvoidframe clarity
Core Design Contradiction:
ReliabilityVSManufacturing precision

Solution Approach 1:

The patent applies feedback by using consistency loss that compares denoised frames with their temporal neighbors. The model continuously adjusts its denoising output based on the consistency of surrounding frames, creating a feedback loop that refines clarity. This feedback mechanism ensures that denoised frames maintain high clarity by penalizing inconsistencies with adjacent frames, thereby eliminating ghosting effects while preserving noise reduction benefits.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent implements parameter changes by modifying the loss function parameters to include temporal consistency terms. The consistency loss incorporates parameters that measure temporal coherence between frames, allowing the model to adjust denoising strength and clarity preservation dynamically. This parameter adjustment enables the system to optimize both noise reduction and frame clarity simultaneously, preventing the ghosting artifacts that occur with traditional single-frame denoising.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20250307998A1Method and device for denoising dynamic video
Publication Date: 2025.10.02 LITE ON TECH CORP
  • US20250307998A1 patent drawing
  • US20250307998A1 patent drawing
  • US20250307998A1 patent drawing

AI summary

A method for denoising dynamic video is provided. The method is implemented by a device. The method includes obtaining a first image frame and a second image frame. The method includes inputting the first image frame and the second image frame to a first neural network model and a second neural network model, respectively, to generate a first optimized image frame and a second optimized image frame, wherein the first neural network model and the second neural network model are trained using a consistency loss.