Temporal Denoiser Switching for Dynamic Scene Lag Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Computer-generated graphics with rapidly changing pixel values suffer from noise and lag due to the use of exponential moving averages (EMA) when objects move quickly, while simple moving averages (SMA) are computationally expensive.
Innovation Solution
A hybrid approach combining SMA and EMA is used to calculate pixel values, switching to SMA-only when dynamic events are detected to reduce lag and resource consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If exponential moving average (EMA) is used to calculate pixel values, then computational cost is reduced, but temporal lag increases when pixel values change rapidly
Solution Approach 1:
The patent implements a dynamic switching mechanism that adapts the moving average method based on scene conditions. A detector monitors pixel value changes and switches between EMA and SMA calculations in real-time, allowing the system to optimize between computational efficiency and temporal responsiveness depending on whether the scene is static or dynamic
Solution Approach 2:
The system changes the calculation parameter (averaging method) based on detected scene conditions. When rapid pixel changes are detected, the system switches from EMA to SMA, effectively changing the temporal smoothing parameter to reduce lag. When scene activity is low, it reverts to EMA for efficiency
2Loss of time
If simple moving average (SMA) is used to calculate pixel values, then temporal lag is reduced, but computational cost increases
Solution Approach 1:
The patent applies different quality levels of calculation to different spatial regions. Instead of uniformly applying SMA across the entire image, it only applies SMA to specific regions where dynamic events are detected (such as moving objects or changing lighting), while using the more efficient EMA for static regions
Solution Approach 2:
The system uses SMA only partially - specifically only when and where dynamic changes are detected - rather than continuously applying it throughout the entire rendering process. This partial application reduces overall computational cost while maintaining responsiveness where needed
3Loss of time
If hybrid moving average is used to calculate pixel values, then temporal lag is reduced, but device complexity increases
Solution Approach 1:
The patent introduces a detector as an intermediary component that monitors pixel value changes and triggers appropriate calculations. This mediator layer simplifies the overall system by centralizing the decision logic - the detector observes conditions and signals whether EMA or SMA should be used, separating the monitoring function from the calculation function
Data Source
AI summary
Apparatuses, systems, and techniques are presented to reduce temporal lag when a dynamic event is occurring in computer generated video. In one embodiment, a first averaging algorithm is utilized to determine a display value for a pixel based at least in part on previous pixel values. Once a dynamic event is detected, a set of the previous pixel values is averaged using a second averaging algorithm. The pixel value is updated based on the first averaging of the pixel values and the second averaging of the pixel values to determine a current pixel value.