Graphics Processing Block Matching for Video Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video codecs require significant processing resources for interframe and intraframe encoding due to the large number of comparisons needed to identify repeating blocks of pixels, which is particularly problematic for real-time video streaming and cannot be easily applied to older graphics hardware without increasing costs.
Innovation Solution
A software-based approach that uses interframe and intraframe encoding techniques leveraging graphics processing information to identify repeating blocks of pixels without relying on dedicated compression circuitry, by analyzing transformations and texture coordinates to generate vectors indicating the locations of repeated pixels, thereby reducing the need for extensive comparisons.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of substance
If conventional interframe and intraframe encoding techniques are used to identify repeating blocks of pixels, then compression is achieved, but significant processing resources and time are required due to the large number of comparisons needed
Solution Approach 1:
The patent applies preliminary action by using graphics processing information (transformations and texture coordinates) to pre-identify the locations of repeating pixel blocks before the actual encoding process. This allows the system to predict where repeated blocks will occur based on the graphics commands that generated the frame, rather than performing exhaustive comparisons during encoding. The method calculates expected repeat locations using transformation matrices and texture coordinate data, thereby preparing the compression structure in advance and significantly reducing the computational burden during the encoding phase.
2Measurement precision
If the number of available block dimensions and vector directions is expanded to improve matching accuracy, then more repeating blocks can be identified, but the number of comparisons and processing resources required increases vastly
Solution Approach 1:
The patent introduces an intermediary approach by using graphics processing information (transformation matrices and texture coordinates) as a mediator between the source and target blocks. Instead of directly comparing blocks across multiple dimensions and directions, the system uses the graphics command data as an intermediary to predict repeat locations. This intermediary layer provides accurate matching information without requiring exhaustive comparisons, thereby maintaining high matching accuracy while significantly reducing processing resources.
3Productivity
If specialized compression circuitry is added to graphics hardware to expedite video encoding, then encoding speed improves, but the cost of graphics hardware increases
Solution Approach 1:
The patent applies self-service by enabling existing graphics hardware to perform compression-related computations using its existing capabilities. The system leverages the graphics processor's ability to handle transformation matrices and texture coordinates - data structures it already processes during rendering - to identify repeating blocks. This allows the graphics hardware to serve its own compression needs without requiring specialized compression circuitry, thereby improving encoding speed while avoiding increased hardware costs.
Data Source
AI summary
A set of software applications configured to perform interframe and/or intraframe encoding operations based on data communicated between a graphics application and a graphics processor. The graphics application transmits a 3D model to the graphics processor to be rendered into a 2D frame of video data. The graphics application also transmits graphics commands to the graphics processor indicating specific transformations to be applied to the 3D model as well as textures that should be mapped onto portions of the 3D model. Based on these transformations, an interframe module can determine blocks of pixels that repeat across sequential frames. Based on the mapped textures, an intraframe module can determine blocks of pixels that repeat within an individual frame. A codec encodes the frames of video data into compressed form based on blocks of pixels that repeat across frames or within frames.