Noise Synthesis Parameterization for Video Banding Removal
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cloud gaming platforms experience visible banding and other graphical artifacts in video streams due to video encoding processes, which deter users and require high bitrates that are unsuitable for interactive gaming.
Innovation Solution
Implement real-time noise parameterization techniques to generate synthetic noise parameters based on quantization parameters, allowing client devices to add noise to encoded video frames, mitigating or eliminating banding and other artifacts without increasing bitrate.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If video encoding processes are used in cloud gaming, then video content can be transmitted over networks, but banding and graphical artifacts become visible in the output video stream
Solution Approach 1:
The patent applies dithering noise to the encoded video frames to convert the harmful banding artifacts into beneficial randomization that masks the artifacts. The noise synthesis parameters are derived from the quantization parameters used during encoding, allowing the decoder to generate matching noise that compensates for the quantization effects and eliminates visible banding in the reconstructed video.
2Loss of information
If higher bitrates are used to reduce graphical artifacts, then video quality improves, but bandwidth consumption increases which is unsuitable for interactive gaming
Solution Approach 1:
The patent changes the parameter representation by deriving noise synthesis parameters from quantization parameters. Instead of transmitting additional noise data or increasing video bitrate, the system uses the existing quantization parameter information to control noise synthesis at the decoder, achieving artifact reduction without increasing bandwidth consumption.
3Object-generated harmful factors
If noise is added to encoded video frames at the client device, then banding artifacts are mitigated, but the system complexity increases
Solution Approach 1:
The patent introduces noise synthesis parameters as an intermediary that bridges the encoder and decoder. These parameters are derived from quantization information and transmitted to the client device, where they control a simple noise synthesis process that adds dithering noise to mask banding artifacts without requiring complex processing.
Data Source
AI summary
Pre-encoding noise parameterization techniques mitigate or eliminate banding and other graphical artifacts in video frames for decoding and presentation by a client device. For one or more input video frames, a quantization parameter associated with the input video frames is identified. Noise synthesis parameters are determined based on the identified quantization parameter, and the input video frames are encoded for transmission. The encoded video frames are transmitted to the client device along with the determined noise synthesis parameters, for use by the client device in generating synthetic noise to add to resulting video frames decoded by the client device.