Convolution Circuit Shared Memory Sum Register
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data processing systems for neural networks face challenges with high power consumption, longer processing times, and increased space usage due to large amounts of data during convolution computation.
Innovation Solution
A data processing method and circuit that efficiently configures convolution computations by utilizing a sum register to store results and optimizing memory usage through batch processing and shared memory structures, allowing multiple convolution kernel groups to be processed in batches.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Power
If large amounts of data are processed using existing convolution computation structures, then computation capability is maintained, but power consumption increases
Solution Approach 1:
The patent divides the convolution computation process into multiple stages using separate buffer regions. The input buffer stores input data, the weight buffer stores convolution weights, and the output buffer stores results. This segmentation allows efficient data flow management and reduces redundant memory access, thereby lowering power consumption while maintaining computation capability.
Solution Approach 2:
The patent introduces a time dimension by implementing a pipeline architecture where multiple convolution operations can be executed concurrently at different stages. The sum register accumulates partial results over time, enabling parallel processing of multiple input pixels through the same convolution kernel, thus maintaining high computation capability while reducing per-operation power consumption.
2Productivity
If large amounts of data are processed using existing convolution computation structures, then computation capability is maintained, but processing time increases
Solution Approach 1:
The patent pre-loads input data into the input buffer and convolution weights into the weight buffer before computation begins. This preliminary data preparation ensures that during the actual convolution operation, the computation unit can access all required data immediately without waiting for memory access, thereby reducing processing time while maintaining full computation capability.
Solution Approach 2:
The sum register continuously accumulates partial convolution results as each input pixel is processed. The pipeline architecture ensures that the computation unit operates continuously without idle cycles, processing multiple input pixels through the same convolution kernel in sequence. This continuous operation maximizes computation capability while minimizing processing time.
3Productivity
If large amounts of data are processed using existing convolution computation structures, then computation capability is maintained, but space usage increases
Solution Approach 1:
The patent implements a universal buffer structure where the same memory regions (input buffer, weight buffer, output buffer) are reused across multiple convolution operations. The sum register serves as a universal accumulator that can hold partial results for any convolution operation. This multi-functionality allows the system to maintain high computation capability while using a fixed, limited amount of space.
Solution Approach 2:
The patent implements a sliding window approach where the sum register accumulates partial results and then discards completed results to make space for new computations. The buffer regions are continuously reused and recovered for new convolution operations after their data is processed. This dynamic allocation and recovery of space allows efficient processing of large data volumes with limited physical memory.
Data Source
AI summary
A data processing method and circuit based on convolution computation are provided. In the data processing method, a shared memory structure is provided, convolution computation of data in batches or duplicated data is provided, an allocation mechanism for storing data into multiple memories is provided, and a signed padding mechanism is provided. Therefore, a flexible and efficient convolution computation mechanism and structure are provided.


