Video Encoder Temporal Noise Injection for Frozen Frame Prevention
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding methods that adjust frame rate or compression based on motion levels in a scene can result in unnatural, frozen video when there is low motion, leading to potential user concerns about hardware or software malfunctions.
Innovation Solution
A method that determines a motion level threshold for image data and encodes frames as intra- or inter-frame encoded frames, with empty frames referencing different reference frames to introduce temporal noise and reduce artificial stillness, maintaining a consistent frame rate while optimizing bit rate.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If a low frame rate is used in the encoded video stream to reduce bit rate, then bandwidth efficiency is improved, but the video appears unnatural and frozen due to absence of temporal noise
Solution Approach 1:
The encoder proactively introduces temporal noise into the encoded video stream by deliberately varying the encoding of empty blocks across frames, even when no motion is detected. This preliminary action prevents the artificial stillness problem before it occurs, allowing the use of low frame rates for bandwidth efficiency while maintaining natural video appearance.
2Loss of energy
If empty blocks are used to encode portions of video frames with no motion to reduce compression, then bandwidth efficiency is improved, but the video appears unnatural and frozen due to artificial stillness
Solution Approach 1:
The encoder dynamically varies the encoding of empty blocks across different frames by applying different offset values and selection criteria, even when the scene is static. This dynamic approach introduces temporal noise that prevents artificial stillness, allowing empty blocks to be used for bandwidth efficiency while maintaining natural video appearance.
Solution Approach 2:
The encoder changes parameters such as offset values and reference frame selections for empty blocks across different frames. By varying these parameters even when no motion is detected, the encoder introduces temporal noise that prevents artificial stillness while maintaining the bandwidth efficiency benefits of using empty blocks.
3Loss of energy
If high compression is applied to video frames with no motion to reduce bit rate, then bandwidth efficiency is improved, but the video appears unnatural and frozen
Solution Approach 1:
The encoder changes encoding parameters such as offset values and reference frame selections for empty blocks across different frames. This parameter variation introduces temporal noise that prevents artificial stillness, allowing high compression to be applied to static scenes while maintaining natural video appearance.
Data Source
AI summary
The present teachings relate to the field of video encoding. In particular, the present teachings relate to a method, device, and system for encoding a sequence of frames wherein a motion level of image data of an initial frame in the sequence of frames is determined to be below a motion level threshold. The encoding method described herein may reduce the bit rate for the encoded sequence of frames, while avoiding that the encoded video stream looks unnatural or frozen when decoded and displayed.