Local Memory for Perspective Transform Engine
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The use of external Double Data Rate (DDR) memory for Perspective Transform Engine (PTE) operations in image processing systems leads to high power consumption, increased latency, and higher costs due to significant DDR read and write bandwidth consumption.
Innovation Solution
Implementing an integrated circuit with local memory that performs image processing operations, reducing the reliance on external DDR memory by using local memory for PTE input operations and other image processing tasks, thereby optimizing memory allocation and bandwidth usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If external DDR memory is used for PTE operations, then image processing can be performed, but power consumption increases and latency increases
Solution Approach 1:
The memory system is segmented into local memory (on-chip) and external DDR memory (off-chip). The local memory is dedicated to storing PTE input blocks, separating the storage function for frequently accessed data from general-purpose external memory. This segmentation allows the PTE to access data from local memory with lower power consumption and latency, while external memory handles less frequently accessed data.
Solution Approach 2:
Local memory acts as an intermediary buffer between the PTE and external DDR memory. Instead of the PTE directly accessing external memory for all operations, data is first loaded into local memory, which then serves as a fast, low-power storage location for active processing. This intermediary layer reduces the frequency of high-power external memory accesses.
2Quantity of substance
If external DDR memory is used for PTE operations, then image data can be stored, but DDR bandwidth consumption increases
Solution Approach 1:
The storage system is divided into local memory for PTE input blocks and external DDR memory for other image data. By segmenting the storage functions, the patent reduces the bandwidth demand on external DDR memory, allowing other image processing operations to utilize the freed bandwidth without contention.
Solution Approach 2:
The patent introduces a new dimension of storage hierarchy by adding local memory between the PTE and external DDR memory. This creates a two-level memory architecture where the local memory handles high-frequency access patterns for PTE operations, thereby reducing the access burden on external memory and improving overall system bandwidth utilization.
3Productivity
If external DDR memory is used for PTE operations, then image processing can be performed, but system cost increases
Solution Approach 1:
The memory architecture is segmented into local memory and external DDR memory with distinct functional roles. The local memory is optimized for PTE operations, while external memory handles general storage. This segmentation allows for more efficient memory utilization and reduces the total memory capacity required from expensive high-speed external memory, thereby lowering system cost.
Data Source
AI summary
An integrated circuit includes: a local memory; and a first processing circuit coupled to the local memory. The first processing component is configured to: receive a first set of image data; perform a first image processing operation on the first set of image data to produce a second set of image data; and store at least some of the second set of image data into the local memory. The integrated circuit also includes a second processing circuit coupled to the local memory and configured to: receive at least some of the second set of image data from the local memory; and perform a second image processing operation on the second set of image data to produce a third set of image data.