Skip Coding Noise Management in Video Conferencing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Skip coding in video conferencing is inefficient due to temporal noise in video frames, especially under poor lighting conditions, leading to incorrect identification of stationary macroblocks and increased bandwidth usage.
Innovation Solution
A method that involves creating a skip-reference video image, generating histograms to represent variation statistics between frames, and determining macroblocks to be skipped based on noise levels, reducing computational complexity and bandwidth consumption by minimizing encoded data transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If skip coding is used to reduce bandwidth usage, then bandwidth consumption decreases, but temporal noise causes incorrect identification of stationary macroblocks, reducing coding efficiency
Solution Approach 1:
The system performs preliminary actions by creating a skip-reference video image before actual encoding. This reference image is generated by copying decoded data from previous frames and is used to pre-determine which macroblocks can be skipped, allowing the encoder to make more accurate skip decisions before processing the current frame, thereby reducing temporal noise impact on identification accuracy
Solution Approach 2:
The skip-reference video image acts as an intermediary between the current video frame and the encoding decision. Instead of directly comparing the current frame to previous frames (which is affected by temporal noise), the system uses the skip-reference image as a mediator that represents the expected stationary content, enabling more reliable macroblock skip identification
2Productivity
If frame difference metrics are used to determine skip coding, then encoding efficiency improves, but temporal noise from image sensors increases under poor lighting conditions
Solution Approach 1:
The system converts the harmful temporal noise into a beneficial signal by using it to identify and exclude problematic macroblocks from skip coding decisions. By analyzing the noise characteristics and using them to adjust the skip reference image, the system transforms the noise problem into an opportunity to improve coding decisions in noisy regions
Solution Approach 2:
The system changes the parameter used for skip coding decisions from direct frame difference metrics to a noise-aware reference image. This parameter change allows the encoder to distinguish between actual content changes and sensor noise, maintaining encoding efficiency while reducing the harmful effects of temporal noise under poor lighting conditions
3Reliability
If more macroblocks are coded due to temporal noise, then video quality is maintained, but processing power and bandwidth usage increase
Solution Approach 1:
The system applies local quality by treating different macroblocks differently based on their specific characteristics. Instead of uniformly coding all macroblocks, the system identifies which macroblocks are truly stationary and can be skipped, and which require full encoding to maintain quality, thereby optimizing processing power usage while preserving video quality in critical regions
Data Source
AI summary
A method is provided in one example and includes receiving an input video, and identifying values of pixels from noise associated with a current video image within the video input. The method also includes creating a skip-reference video image associated with the identified pixel values, and comparing a portion of the current video image to the skip-reference video image. The method also includes determining a macroblock associated with the current video image to be skipped before an encoding operation occurs.