Unified Full-Frame Buffer for Low-Latency Video Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Low-latency video communication systems face challenges in concealing visible video artifacts under poor wireless-link conditions, wireless-link outages, and video-format changes, particularly due to the inefficiencies in traditional frame and network buffering methods.
Innovation Solution
Implementing a small full-frame buffer memory in low-latency video communication receiver systems that stores a full frame worth of video content in a coding format matching the received data, allowing for intelligent and dynamic determination of data storage and output based on link conditions, using a combined network streaming and history buffer configuration.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If traditional separate network buffer and frame buffer are used, then video data can be buffered and displayed, but memory size and system complexity increase
Solution Approach 1:
The patent combines the network buffer and frame buffer into a single unified buffer structure. The buffer is configured to store video data in a coding format that matches the received data format, eliminating the need for separate buffering stages. This merging reduces memory size and system complexity while maintaining the ability to handle video data through different buffer modes (network buffer mode for storing received video data and frame buffer mode for storing uncompressed video pixels).
Solution Approach 2:
The unified buffer is designed to perform multiple functions: it can operate as a network buffer to store compressed video data received over the link, and as a frame buffer to store uncompressed video pixels for display. The buffer can dynamically switch between these modes based on system needs, providing multi-functionality without requiring separate dedicated buffers for each purpose.
2Device complexity
If large separate buffers are implemented, then video buffering and display are achieved, but device complexity and external memory requirements increase
Solution Approach 1:
The patent merges the network buffer and frame buffer into a single unified buffer structure, reducing device complexity. The buffer is configured to store video data in a coding format that matches the received data format, eliminating the need for separate buffering stages and reducing overall system complexity.
Solution Approach 2:
The unified buffer is configured to pre-process and store video data in the appropriate format before display is needed. By maintaining video data in a coding format that matches the received data, the system prepares data for potential retransmission or error correction without requiring complex external memory subsystems, thereby reducing latency.
3Use of energy by moving object
If video data is buffered in uncompressed format, then display is facilitated, but bandwidth around memory subsystem increases
Solution Approach 1:
The unified buffer implements local quality by storing video data in different formats depending on the specific operational need. When acting as a network buffer, it stores data in the received coding format to reduce bandwidth consumption. When acting as a frame buffer, it stores uncompressed pixels for efficient display. This localized format selection optimizes both bandwidth usage and decompression efficiency.
Solution Approach 2:
The buffer dynamically adjusts its operation mode based on system requirements. It can switch between storing compressed video data (network buffer mode) and uncompressed video pixels (frame buffer mode), providing dynamic adaptability that optimizes memory bandwidth consumption while maintaining video decompression efficiency when needed.
Data Source
AI summary
Embodiments of apparatuses and methods to decrease a size of a memory in a low-latency video communication system are described. A control unit is configured to monitor a condition associated with at the communication link. The control unit is configured to receive the video content over a link based on monitoring. A memory comprising a full-frame buffer is coupled to the control unit. The full-frame buffer is configured as a history buffer to store a full frame of the video in a coding format that matches the coding format of the video content received over the link. A display unit is coupled to the history buffer. A portion of the full-frame buffer is configured as a network streaming buffer.