Reconfigurable Interconnect for DCNN Power Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Deep convolutional neural networks (DCNNs) require significant computational resources and power, making them unsuitable for implementation in mobile devices due to their large size and high bandwidth, power, and computing resource demands.
Innovation Solution
A hardware-accelerated DCNN processor with an energy-efficient set of convolution accelerators, a reconfigurable data transfer fabric, and a power-efficient array of digital signal processors (DSPs) that supports kernel decompression, fast data throughput, and efficient mathematical operations, along with an on-chip memory system to reduce memory traffic and power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Use of energy by moving object
If deep convolutional neural networks are implemented using conventional fully programmable solutions, then computational flexibility is maintained, but power consumption and device size become unacceptable for mobile devices
Solution Approach 1:
The DCNN processor is divided into multiple independent convolution accelerators (CA0-CA7) that can be individually configured and activated. Each accelerator handles specific convolution operations with dedicated resources (multipliers, accumulators, buffers), allowing the system to segment computational tasks across multiple specialized units rather than using a single general-purpose processor, thereby reducing overall power consumption while maintaining computational capability.
Solution Approach 2:
The system employs dynamic reconfiguration capabilities where the convolution accelerators can be programmed at runtime to adapt to different DCNN architectures and computational requirements. The reconfigurable interconnect and control logic allow the hardware architecture to dynamically adjust its data flow paths and operational modes based on the specific neural network being executed, maintaining computational flexibility while optimizing power efficiency for each task.
2Loss of energy
If DCNN processors use large on-chip memory to reduce memory traffic, then power consumption decreases, but device area and cost increase
Solution Approach 1:
Each convolution accelerator is equipped with locally dedicated buffers (input buffers, weight buffers, output buffers) that are optimally sized for its specific function. Rather than providing all accelerators with uniformly large memory, the system allocates memory resources locally where they are most needed for each computational unit, reducing total memory area while maintaining the power efficiency benefits of reduced memory traffic.
Solution Approach 2:
The memory hierarchy is organized with small, fast, locally dedicated buffers nested within each convolution accelerator, which are in turn nested within the larger processor architecture that includes shared memory resources. This nested structure allows data to be cached locally at the accelerator level for frequently accessed operands, eliminating the need for large centralized memory while minimizing trips to external memory and reducing overall power consumption.
3Productivity
If the processor is designed for high-speed data throughput, then processing performance improves, but power consumption and hardware complexity increase
Solution Approach 1:
Multiple convolution accelerators are merged into a single integrated processor unit with shared control logic, clock distribution, and interconnect resources. The consolidating of common functions at the processor level while maintaining independent acceleration units allows high-throughput parallel processing without proportionally increasing hardware complexity, as shared resources serve multiple accelerators simultaneously.
Solution Approach 2:
The convolution accelerators are designed with universal, reconfigurable components that can handle multiple DCNN operations and data formats. The multipliers and accumulators can be configured for different precision requirements (e.g., 8-bit, 16-bit operations), and the interconnect can dynamically route data between different accelerator combinations, allowing a single hardware design to achieve high performance across various DCNN architectures without requiring separate specialized hardware for each case.
Data Source
Figure 1A
Figure 1B
Figure 1C
AI summary
Embodiments are directed towards a reconfigurable stream switch (500) formed in an integrated circuit. The stream switch includes a plurality of output ports (516), a plurality of input ports (504), and a plurality of selection circuits. The output ports (516) each have an output port architectural composition, and each is arranged to unidirectionally pass output data and output control information. The input ports (504) each have an input port architectural composition, and each is arranged to unidirectionally receive first input data and first input control information. Each one of the selection circuits is coupled to an associated one of the output ports (516). Each selection circuit is further coupled to all of the input ports (504) such that each selection circuit is arranged to reconfigurably couple its associated output port (516) to no more than one input port (504) at any given time.