Buffer Device Remapping Unit for CNN Data Stream Bottlenecks

The buffer device pre-fetches and stores data from memory into its buffer before the convolution operation module needs it. This preliminary action ensures that when the convolution operation module requests data, it is already available in the buffer, eliminating waiting time and preventing the performance bottleneck caused by slow memory access.

The buffer device acts as an intermediary component between the memory and the convolution operation module. It receives data from memory, processes it through remapping units, and provides data to the convolution operation module at the required rate. This intermediary buffer decouples the slow memory access from the faster convolution operations, allowing the latter to proceed at optimal speed without being bottlenecked by the former.

The buffer device is designed to serve multiple functions: it acts as a data storage buffer, a remapping unit for data reorganization, and a provider of reusable data for subsequent convolution operations. By consolidating these multiple functions into a single integrated device, the patent avoids the need for separate components for each function, thereby reducing overall device complexity while maintaining high processing efficiency.

The buffer device retains data from previous convolution operations and makes it available for reuse in subsequent operations. Instead of allowing this data to be discarded after each operation, the buffer recovers and preserves it, enabling the convolution operation module to efficiently process multiple operations using the same input data without requiring repeated memory accesses.