Convolution Circuit Shared Memory Sum Register

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing data processing systems for neural networks face challenges with high power consumption, longer processing times, and increased space usage due to large amounts of data during convolution computation.

Innovation Solution

A data processing method and circuit that efficiently configures convolution computations by utilizing a sum register to store results and optimizing memory usage through batch processing and shared memory structures, allowing multiple convolution kernel groups to be processed in batches.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Power

If large amounts of data are processed using existing convolution computation structures, then computation capability is maintained, but power consumption increases

Engineering Contradiction:
Improvepower consumptionVSAvoidcomputation capability
Core Design Contradiction:
PowerVSProductivity

Solution Approach 1:

The patent divides the convolution computation process into multiple stages using separate buffer regions. The input buffer stores input data, the weight buffer stores convolution weights, and the output buffer stores results. This segmentation allows efficient data flow management and reduces redundant memory access, thereby lowering power consumption while maintaining computation capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a time dimension by implementing a pipeline architecture where multiple convolution operations can be executed concurrently at different stages. The sum register accumulates partial results over time, enabling parallel processing of multiple input pixels through the same convolution kernel, thus maintaining high computation capability while reducing per-operation power consumption.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If large amounts of data are processed using existing convolution computation structures, then computation capability is maintained, but processing time increases

Engineering Contradiction:
Improvecomputation capabilityVSAvoidprocessing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent pre-loads input data into the input buffer and convolution weights into the weight buffer before computation begins. This preliminary data preparation ensures that during the actual convolution operation, the computation unit can access all required data immediately without waiting for memory access, thereby reducing processing time while maintaining full computation capability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The sum register continuously accumulates partial convolution results as each input pixel is processed. The pipeline architecture ensures that the computation unit operates continuously without idle cycles, processing multiple input pixels through the same convolution kernel in sequence. This continuous operation maximizes computation capability while minimizing processing time.

Inventive Principle:
Principle #20Continuity of useful action

3Productivity

If large amounts of data are processed using existing convolution computation structures, then computation capability is maintained, but space usage increases

Engineering Contradiction:
Improvecomputation capabilityVSAvoidspace usage
Core Design Contradiction:
ProductivityVSVolume of stationary object

Solution Approach 1:

The patent implements a universal buffer structure where the same memory regions (input buffer, weight buffer, output buffer) are reused across multiple convolution operations. The sum register serves as a universal accumulator that can hold partial results for any convolution operation. This multi-functionality allows the system to maintain high computation capability while using a fixed, limited amount of space.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent implements a sliding window approach where the sum register accumulates partial results and then discards completed results to make space for new computations. The buffer regions are continuously reused and recovered for new convolution operations after their data is processed. This dynamic allocation and recovery of space allows efficient processing of large data volumes with limited physical memory.

Inventive Principle:
Principle #34Discarding and recovering

Data Source

PatentUS20220374494A1Data processing method and circuit based on convolution computation
Publication Date: 2022.11.24 EGIS TECH
  • US20220374494A1 patent drawing
  • US20220374494A1 patent drawing
  • US20220374494A1 patent drawing

AI summary

A data processing method and circuit based on convolution computation are provided. In the data processing method, a shared memory structure is provided, convolution computation of data in batches or duplicated data is provided, an allocation mechanism for storing data into multiple memories is provided, and a signed padding mechanism is provided. Therefore, a flexible and efficient convolution computation mechanism and structure are provided.