Cache Memory Pixel Prefetching for Image Conversion Latency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing apparatuses experience reduced cache memory efficiency and increased external memory access latency due to inefficient use of cache memory, as only part of the necessary unconverted pixels are stored in the cache during image conversion, leading to frequent fetch requests from external memory.

Innovation Solution

The image processing apparatus includes a counter, coordinate calculator, tag checker, pixel referring module, and outputting module to determine converted coordinates, calculate unconverted coordinates, check cache storage, and issue fetch requests to ensure that unconverted pixels are stored in the cache memory before calculating converted pixel values, thereby optimizing cache usage and reducing external memory access.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If the image processing apparatus uses a cache memory to store unconverted pixels, then the access speed to unconverted pixels is improved, but the cache memory usage efficiency deteriorates because only part of the stored unconverted pixels are actually referred to in calculating converted pixel values

Engineering Contradiction:
Improveaccess speed to unconverted pixelsVSAvoidcache memory usage efficiency
Core Design Contradiction:
SpeedVSLoss of energy

Solution Approach 1:

The patent applies preliminary action by determining and storing in the cache memory the specific unconverted pixels that will be needed for calculating converted pixel values, rather than storing all unconverted pixels. The coordinate calculation unit calculates which unconverted pixels are required in advance, and the cache control unit loads only those specific pixels into the cache memory before the conversion process begins. This ensures that the cache memory contains exactly the pixels that will be used, improving both access speed and usage efficiency.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If the image processing apparatus fetches unconverted pixels from external memory when they are not in cache, then the completeness of pixel data is improved, but the access latency increases due to frequent fetch requests

Engineering Contradiction:
Improvecompleteness of pixel dataVSAvoidaccess latency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by predicting and loading the required unconverted pixels into the cache memory before they are needed for conversion. The coordinate calculation unit determines which unconverted pixels will be needed based on the conversion parameters, and the cache control unit fetches these pixels from external memory in advance and stores them in the cache memory. This eliminates or reduces the need for frequent fetch requests during the actual conversion process, thereby reducing access latency while ensuring all necessary pixel data is available.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If the image processing apparatus reads the entire unconverted image from external memory to the cache, then the availability of all unconverted pixels is improved, but the memory bandwidth consumption and processing time increase

Engineering Contradiction:
Improveavailability of unconverted pixelsVSAvoidimage processing efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies the extraction principle by selectively extracting only the necessary unconverted pixels from the entire unconverted image and loading them into the cache memory. Instead of reading the whole image, the coordinate calculation unit identifies which specific pixels are needed for the conversion operation, and the cache control unit extracts and loads only those pixels. This reduces the amount of data transferred between external memory and cache memory, decreasing memory bandwidth consumption and processing time while ensuring all required pixels are available for conversion.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS8417063B2Image processing apparatus and image processing system
Publication Date: 2013.04.09 KK TOSHIBA
  • US8417063B2 patent drawing
  • US8417063B2 patent drawing
  • US8417063B2 patent drawing

AI summary

According to one embodiment, an image processing apparatus connected to an external memory and a cache memory. The apparatus includes a counter, a coordinate calculator, a tag checker, a pixel referring module, a pixel value calculator and an outputting module. The counter determines a converted coordinate according to a predetermined execution sequence. The coordinate calculator calculates a unconverted coordinate used to calculate a converted pixel value located at the converted coordinate. The tag checker generates a conversion request to calculate the converted pixel value with reference to an unconverted pixel located at the unconverted coordinate. The pixel referring module reads the unconverted pixel from the cache memory based on the conversion request when the unconverted pixel is stored in the cache memory. The pixel value calculator calculates the converted pixel value with reference to the read unconverted pixel. The outputting module writes the converted pixel having the calculated converted pixel value into the external memory.