Patchbook Video Coding for Screen Content Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing volume of video data due to higher picture sizes, resolutions, and frame rates necessitates more efficient encoding and decoding techniques, particularly for screen content videos like animation and computer graphics, as existing methods are inefficient and require substantial hardware resources.
Innovation Solution
A patchbook-based encoding and decoding method that utilizes texture similarity within video frames by mapping frequently occurring block textures to indices, allowing for predictive reconstruction of pixel subsets using patchbook lists, optionally with residual value encoding or reconstruction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional compression techniques are used for video data, then the video data can be stored or transmitted, but the encoding efficiency is insufficient and image quality deteriorates with increasing picture size, resolution, and frame rate
Solution Approach 1:
The patent applies the copying principle by creating a patchbook that stores representative patch data from previously decoded blocks. Instead of encoding each block independently with full residual information, the encoder copies relevant texture information from the patchbook and transmits only differential data (residuals). This allows efficient reproduction of similar patches while maintaining image quality, directly resolving the contradiction between encoding efficiency and image quality.
2Productivity
If existing compression methods are applied to screen content videos, then the videos can be encoded, but the encoding and decoding processes require substantial hardware resources and are inefficient
Solution Approach 1:
The patent implements preliminary action by pre-decoding and analyzing blocks to create the patchbook before encoding subsequent blocks. The patchbook is prepared in advance with representative patch data, allowing the encoder to quickly find and reuse matching patches without performing complex analysis during the main encoding process. This preliminary preparation significantly reduces real-time encoding complexity and hardware resource requirements.
Solution Approach 2:
By copying patch data from the pre-prepared patchbook, the encoder avoids re-analyzing and re-encoding identical or similar content. This copying mechanism dramatically reduces computational complexity and hardware resource usage while maintaining encoding speed, directly addressing the contradiction between encoding efficiency and device complexity.
3Manufacturing precision
If full residual encoding is performed for all blocks, then accurate reconstruction is achieved, but memory usage increases and decoder complexity rises
Solution Approach 1:
The decoder copies patch data from the patchbook for blocks that match existing patches, requiring minimal processing. Only when patches do not match does the decoder need to process residual data. This selective copying approach maintains reconstruction accuracy for matching patches while dramatically reducing decoder complexity and memory usage compared to processing all blocks with full residual encoding.
Data Source
AI summary
Disclosed are a method and an apparatus for patch book-based encoding and decoding of video data. A video data decoding method comprises the steps of: determining a patch book list for a block of video data; and determining one or more index values for the block. Each of the index values indicates a patch book entry having color values corresponding to a subset of pixels in the block, among patch book entries of the patch book list. The decoding method further comprises a step of reconstructing subsets of the pixels on the basis of the patch book list and the index values for the block.