Cache Memory Pixel Prefetching for Image Conversion Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image processing apparatuses experience reduced cache memory efficiency and increased external memory access latency due to inefficient use of cache memory, as only part of the necessary unconverted pixels are stored in the cache during image conversion, leading to frequent fetch requests from external memory.
Innovation Solution
The image processing apparatus includes a counter, coordinate calculator, tag checker, pixel referring module, and outputting module to determine converted coordinates, calculate unconverted coordinates, check cache storage, and issue fetch requests to ensure that unconverted pixels are stored in the cache memory before calculating converted pixel values, thereby optimizing cache usage and reducing external memory access.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If the image processing apparatus uses a cache memory to store unconverted pixels, then the access speed to unconverted pixels is improved, but the cache memory usage efficiency deteriorates because only part of the stored unconverted pixels are actually referred to in calculating converted pixel values
Solution Approach 1:
The patent applies preliminary action by determining and storing in the cache memory the specific unconverted pixels that will be needed for calculating converted pixel values, rather than storing all unconverted pixels. The coordinate calculation unit calculates which unconverted pixels are required in advance, and the cache control unit loads only those specific pixels into the cache memory before the conversion process begins. This ensures that the cache memory contains exactly the pixels that will be used, improving both access speed and usage efficiency.
2Reliability
If the image processing apparatus fetches unconverted pixels from external memory when they are not in cache, then the completeness of pixel data is improved, but the access latency increases due to frequent fetch requests
Solution Approach 1:
The patent applies preliminary action by predicting and loading the required unconverted pixels into the cache memory before they are needed for conversion. The coordinate calculation unit determines which unconverted pixels will be needed based on the conversion parameters, and the cache control unit fetches these pixels from external memory in advance and stores them in the cache memory. This eliminates or reduces the need for frequent fetch requests during the actual conversion process, thereby reducing access latency while ensuring all necessary pixel data is available.
3Reliability
If the image processing apparatus reads the entire unconverted image from external memory to the cache, then the availability of all unconverted pixels is improved, but the memory bandwidth consumption and processing time increase
Solution Approach 1:
The patent applies the extraction principle by selectively extracting only the necessary unconverted pixels from the entire unconverted image and loading them into the cache memory. Instead of reading the whole image, the coordinate calculation unit identifies which specific pixels are needed for the conversion operation, and the cache control unit extracts and loads only those pixels. This reduces the amount of data transferred between external memory and cache memory, decreasing memory bandwidth consumption and processing time while ensuring all required pixels are available for conversion.
Data Source
AI summary
According to one embodiment, an image processing apparatus connected to an external memory and a cache memory. The apparatus includes a counter, a coordinate calculator, a tag checker, a pixel referring module, a pixel value calculator and an outputting module. The counter determines a converted coordinate according to a predetermined execution sequence. The coordinate calculator calculates a unconverted coordinate used to calculate a converted pixel value located at the converted coordinate. The tag checker generates a conversion request to calculate the converted pixel value with reference to an unconverted pixel located at the unconverted coordinate. The pixel referring module reads the unconverted pixel from the cache memory based on the conversion request when the unconverted pixel is stored in the cache memory. The pixel value calculator calculates the converted pixel value with reference to the read unconverted pixel. The outputting module writes the converted pixel having the calculated converted pixel value into the external memory.


