Video Processing System Multi-Resolution Reference Frame Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video processing systems face inefficiencies in memory usage and processing speed due to the need to store and retrieve full-resolution reference frames for differential encoding, which can lead to increased memory access and compression challenges.
Innovation Solution
Generating and storing pixel data for reference frames at multiple resolutions, including a full resolution and at least one lower resolution, allows for efficient decoding and processing by providing multiple resolution versions simultaneously, reducing memory access and facilitating more efficient compression and scaling operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If full-resolution reference frames are stored in memory for differential encoding, then decoding accuracy is improved, but memory usage and memory access time increase
Solution Approach 1:
The reference frame is segmented into multiple resolution versions (full resolution and reduced resolutions). Different segments (resolution levels) are stored separately in memory, allowing the system to access only the necessary resolution level for each decoding operation, thereby reducing overall memory usage while maintaining decoding accuracy when full resolution is needed.
Solution Approach 2:
Different parts of the reference frame data are stored at different quality levels (resolutions). The full-resolution data is stored only where absolutely necessary for accurate decoding, while reduced-resolution versions are stored for less critical operations, optimizing the balance between memory usage and decoding accuracy.
2Manufacturing precision
If full-resolution reference frames are stored and accessed during decoding, then frame quality is maintained, but processing speed decreases due to increased memory access
Solution Approach 1:
Multiple resolution versions of the reference frame are pre-generated and stored in memory before the decoding process begins. This preliminary preparation allows the decoding operation to quickly access the appropriate resolution level without performing time-consuming real-time scaling operations, thereby improving processing speed while maintaining frame quality.
Solution Approach 2:
The system dynamically selects which resolution version of the reference frame to use during decoding, based on the specific requirements of each frame being processed. This dynamic adaptation allows the system to optimize between quality and speed in real-time, using full resolution when quality is critical and reduced resolution when processing speed is more important.
3Device complexity
If single-resolution reference frames are used, then memory storage is simplified, but compression efficiency and scaling operations are reduced
Solution Approach 1:
The reference frame is stored in multiple versions with different resolution parameters. This parameter variation (different sizes) enables more efficient compression by allowing the encoder to select the appropriate resolution level for each block being encoded, improving compression efficiency without significantly increasing overall system complexity.
Data Source
AI summary
A video processing system includes a video processing unit (VPU) and one or more display processing units, all having access to external memory. Video data representing frames to be displayed is generated. The VPU generates pixel data representing the frames and stores it in memory. The display processing units then read the pixel data to display the frames. The VPU is configured to generate and store in memory pixel data representing reference frames for the sequence of video frames at the full resolution of the reference frame and also at at least one lower resolution to the full resolution.