Compressed Video Graphics Overlay System for Multi-Display OSD
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional graphics overlay systems are inefficient for layering multiple graphics planes on compressed digital video, requiring significant memory and hardware resources, and are not well-suited for providing output to multiple playback devices with different graphic overlays.
Innovation Solution
A system that processes compressed video and graphics in real-time by layering multiple graphics planes on a macroblock basis, using a shared On Screen Display (OSD) device to communicate with multiple set-top boxes and screens, eliminating the need for separate graphics engines for each screen and reducing hardware costs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional graphics overlay systems process compressed video by fully decoding and storing frames before blending, then blend operations can be performed on uncompressed video, but significant memory is required and processing cannot operate on streaming compressed video
Solution Approach 1:
The patent divides the video frame into macroblocks, which are the basic units of compressed video processing. By operating on individual macroblocks rather than entire frames, the system processes video in small segments that can be handled in real-time without requiring full frame buffering. This segmentation enables the blender to work directly with compressed video data streams.
Solution Approach 2:
The patent performs preliminary decompression of individual macroblocks before blending operations, but only for the specific macroblocks that need to be processed. This selective preliminary action allows the system to prepare only the necessary data portions in advance, rather than decompressing and storing entire frames, thereby reducing memory requirements while enabling blend operations.
2Adaptability or versatility
If conventional graphics overlay systems use separate blender hardware for each graphics layer, then each layer can be blended independently, but cost and physical size increase significantly
Solution Approach 1:
The patent merges multiple blend operations into a single blender hardware unit. The unified blender can process multiple graphics layers sequentially by accepting different layer inputs and applying blend operations in a predetermined sequence. This consolidation reduces the number of hardware components needed while maintaining the ability to layer multiple graphics planes on the video input.
Solution Approach 2:
The patent makes the blender dynamically configurable to handle different numbers and types of graphics layers. The single blender unit can adapt its operation mode based on the specific rendering requirements, switching between different blend sequences and layer configurations as needed. This dynamic flexibility allows one hardware unit to replace multiple dedicated blenders.
3Ease of operation
If conventional systems fully decode video frames before overlay operations, then blend operations can be performed on uncompressed video, but real-time processing of streaming compressed video is not possible
Solution Approach 1:
The patent segments the video processing into macroblock-level operations, allowing the system to decompress and process only the specific macroblocks needed for the current frame's blend operations. This segmentation enables real-time processing of compressed video streams by avoiding the need to fully decode entire frames before processing, thus maintaining both uncompressed video quality and real-time productivity.
Data Source
AI summary
Systems and methods for providing compressed video with layered graphics to at least one screen are described herein. An On Screen Display (OSD) system receives a command from a remote set top box coupled to a screen. The command instructs the OSD system to process the input video stream according to various processing functions including layering at least one graphics plane on top of the video stream. The OSD system processes the input video stream to generate an output video stream with the layered graphics planes and outputs, in a compressed format, the output video stream to the screen. The system advantageously provides a central OSD processing unit that can output video with layered graphics in a compressed format to multiple displays.