Video Conferencing Frame Buffering for Bandwidth Artifact Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Video conferencing experiences visual and audio artifacts due to bandwidth fluctuations, particularly when static content is shared, leading to difficulties in reading presentations and maintaining quality during network disruptions.
Innovation Solution
Implementing a decoded picture buffer system that stores high-quality pictures and continues to display previous frames when current frames fall below a threshold, using metadata for text rendering and alternate streams for higher resolution portions during zooming.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If video conferencing data is transmitted over network with bandwidth fluctuations, then network coverage and accessibility are improved, but visual artifacts and quality degradation occur
Solution Approach 1:
The system performs preliminary actions by decoding and storing high-quality pictures in a buffer before bandwidth degradation occurs. When bandwidth fluctuations happen, these pre-stored high-quality pictures are used to maintain visual quality, preventing artifacts before they can degrade the viewing experience.
Solution Approach 2:
A picture buffer is introduced as an intermediary between the network stream and the display output. This buffer decouples the unstable network input from the display requirement, allowing the system to smooth out bandwidth fluctuations and maintain consistent visual quality regardless of network conditions.
2Loss of energy
If compression is applied to reduce bandwidth requirements, then network bandwidth consumption is reduced, but visual artifacts increase
Solution Approach 1:
High-quality pictures are decoded and stored in the buffer in advance, before bandwidth compression becomes necessary. When bandwidth is limited, the system can output these pre-decoded high-quality pictures from the buffer rather than displaying compressed low-quality pictures, thus avoiding visual artifacts while maintaining low bandwidth consumption.
3Loss of energy
If static content is displayed during bandwidth fluctuations, then bandwidth requirements are reduced, but readability of text deteriorates due to artifacts
Solution Approach 1:
The system pre-decodes and buffers high-quality pictures containing static content such as presentation slides with text. When bandwidth fluctuations occur during static content display, the buffered high-quality pictures are output, ensuring text remains readable while maintaining reduced bandwidth consumption for the ongoing stream.
4Reliability
If previous pictures are reused to maintain quality, then visual quality is maintained, but loss of information increases
Solution Approach 1:
The system dynamically adjusts its behavior based on content type. For static content, it reuses buffered pictures to maintain quality. When motion detection indicates dynamic content, the system switches to displaying new decoded pictures, ensuring content updates are not lost. This dynamic adaptation resolves the contradiction between maintaining quality and preserving information updates.
Data Source
AI summary
Systems and methods are provided for enabling improved video conferencing. A stream comprising a plurality of pictures is received at a computing device. For each picture in the plurality of pictures, the picture is decoded, the decoded picture is stored in a decoded pictures buffer and it is identified that the decoded picture is below a threshold quality. For a first decoded picture that is not below the threshold quality, the decoded picture is stored in a display buffer, accessed from the display buffer, and output for display. For a second decoded pictured that is below threshold quality, a previously output picture is continued to be output for display.