Tile-Based Frame Rendering with Motion Vector Pixel Reuse

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

High-resolution display processing on mobile devices requires significant computational resources and energy, with existing methods like upscaling and tile-based rendering failing to efficiently reduce processing power and energy consumption while maintaining image quality.

Innovation Solution

A method and apparatus for producing frames by generating a tile representation of the frame, eliminating predetermined portions of each tile, rendering retained portions, transforming the rendered tiles, and constructing the frame, which includes using checker board rendering and motion vectors to reduce computational power and resources.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If a GPU renders a lower-resolution version of a frame and upscaling is used to present it on a higher resolution display, then the processing power and energy requirements are reduced, but the image quality deteriorates

Engineering Contradiction:
Improveenergy requirementsVSAvoidimage quality
Core Design Contradiction:
Use of energy by moving objectVSManufacturing precision

Solution Approach 1:

The frame is divided into multiple tiles, and each tile is further divided into blocks. This segmentation allows the GPU to process only specific blocks within tiles rather than rendering all pixels at full resolution, thereby reducing computational load while maintaining the ability to produce high-quality output through selective rendering and motion vector-based pixel generation.

Inventive Principle:
Principle #1Segmentation

2Manufacturing precision

If the resolution of displays is increased to provide higher quality imagery, then the image quality is improved, but the processing power and computational resources required increase significantly

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing power
Core Design Contradiction:
Manufacturing precisionVSPower

Solution Approach 1:

Instead of rendering all pixels at full resolution, the system renders only a portion of the pixels (specific blocks within tiles) at full resolution while generating other pixels using motion vectors from previous frames. This partial action approach maintains perceived image quality while significantly reducing the processing power required.

Inventive Principle:
Principle #16Partial or excessive action

3Manufacturing precision

If a device uses a graphics processing unit to render information within a frame at high resolution, then the image quality is improved, but the energy consumption and processing time increase

Engineering Contradiction:
Improveimage qualityVSAvoidenergy consumption
Core Design Contradiction:
Manufacturing precisionVSUse of energy by stationary object

Solution Approach 1:

The frame is divided into multiple tiles, and each tile is further divided into blocks. This segmentation allows the GPU to process only specific blocks within tiles rather than rendering all pixels at full resolution, thereby reducing computational load while maintaining the ability to produce high-quality output through selective rendering and motion vector-based pixel generation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of rendering all pixels at full resolution, the system renders only a portion of the pixels (specific blocks within tiles) at full resolution while generating other pixels using motion vectors from previous frames. This partial action approach maintains perceived image quality while significantly reducing the processing power required.

Inventive Principle:
Principle #16Partial or excessive action

4Use of energy by moving object

If tile-based rendering is used to reduce external memory bandwidth and energy requirements, then the energy efficiency is improved, but the processing power required to render high-resolution frames is not reduced

Engineering Contradiction:
Improveenergy requirementsVSAvoidprocessing power
Core Design Contradiction:
Use of energy by moving objectVSPower

Solution Approach 1:

The frame is divided into multiple tiles, and each tile is further divided into blocks. This segmentation allows the GPU to process only specific blocks within tiles rather than rendering all pixels at full resolution, thereby reducing computational load while maintaining the ability to produce high-quality output through selective rendering and motion vector-based pixel generation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of rendering all pixels at full resolution, the system renders only a portion of the pixels (specific blocks within tiles) at full resolution while generating other pixels using motion vectors from previous frames. This partial action approach maintains perceived image quality while significantly reducing the processing power required.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11055820B2Methods, apparatus and processor for producing a higher resolution frame
Publication Date: 2021.07.06 ARM LTD
  • US11055820B2 patent drawing
  • US11055820B2 patent drawing
  • US11055820B2 patent drawing

AI summary

A method of producing a full resolution frame, comprising generating a tile representation of the frame. The tile representation comprises a plurality of tiles each associated with an area of the frame. The method also includes eliminating one or more predetermined portions of each tile and rendering retained portions of each tile to produce rendered tiles. The method also transforms the rendered tiles into processed tiles. The full resolution frame is then constructed from the processed tiles.