Reconfigurable Interconnect for DCNN Power Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Deep convolutional neural networks (DCNNs) require significant computational resources and power, making them unsuitable for implementation in mobile devices due to their large size and high bandwidth, power, and computing resource demands.

Innovation Solution

A hardware-accelerated DCNN processor with an energy-efficient set of convolution accelerators, a reconfigurable data transfer fabric, and a power-efficient array of digital signal processors (DSPs) that supports kernel decompression, fast data throughput, and efficient mathematical operations, along with an on-chip memory system to reduce memory traffic and power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If deep convolutional neural networks are implemented using conventional fully programmable solutions, then computational flexibility is maintained, but power consumption and device size become unacceptable for mobile devices

Engineering Contradiction:
Improvepower consumptionVSAvoidcomputational flexibility
Core Design Contradiction:
Use of energy by moving objectVSAdaptability or versatility

Solution Approach 1:

The DCNN processor is divided into multiple independent convolution accelerators (CA0-CA7) that can be individually configured and activated. Each accelerator handles specific convolution operations with dedicated resources (multipliers, accumulators, buffers), allowing the system to segment computational tasks across multiple specialized units rather than using a single general-purpose processor, thereby reducing overall power consumption while maintaining computational capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system employs dynamic reconfiguration capabilities where the convolution accelerators can be programmed at runtime to adapt to different DCNN architectures and computational requirements. The reconfigurable interconnect and control logic allow the hardware architecture to dynamically adjust its data flow paths and operational modes based on the specific neural network being executed, maintaining computational flexibility while optimizing power efficiency for each task.

Inventive Principle:
Principle #15Dynamics

2Loss of energy

If DCNN processors use large on-chip memory to reduce memory traffic, then power consumption decreases, but device area and cost increase

Engineering Contradiction:
Improvememory traffic powerVSAvoidon-chip memory area
Core Design Contradiction:
Loss of energyVSArea of stationary object

Solution Approach 1:

Each convolution accelerator is equipped with locally dedicated buffers (input buffers, weight buffers, output buffers) that are optimally sized for its specific function. Rather than providing all accelerators with uniformly large memory, the system allocates memory resources locally where they are most needed for each computational unit, reducing total memory area while maintaining the power efficiency benefits of reduced memory traffic.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The memory hierarchy is organized with small, fast, locally dedicated buffers nested within each convolution accelerator, which are in turn nested within the larger processor architecture that includes shared memory resources. This nested structure allows data to be cached locally at the accelerator level for frequently accessed operands, eliminating the need for large centralized memory while minimizing trips to external memory and reducing overall power consumption.

Inventive Principle:
Principle #7Nested doll (Nesting)

3Productivity

If the processor is designed for high-speed data throughput, then processing performance improves, but power consumption and hardware complexity increase

Engineering Contradiction:
Improveprocessing performanceVSAvoidhardware complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

Multiple convolution accelerators are merged into a single integrated processor unit with shared control logic, clock distribution, and interconnect resources. The consolidating of common functions at the processor level while maintaining independent acceleration units allows high-throughput parallel processing without proportionally increasing hardware complexity, as shared resources serve multiple accelerators simultaneously.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The convolution accelerators are designed with universal, reconfigurable components that can handle multiple DCNN operations and data formats. The multipliers and accumulators can be configured for different precision requirements (e.g., 8-bit, 16-bit operations), and the interconnect can dynamically route data between different accelerator combinations, allowing a single hardware design to achieve high performance across various DCNN architectures without requiring separate specialized hardware for each case.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP3346426B1Reconfigurable interconnect, corresponding system and method
Publication Date: 2023.12.27 STMICROELECTRONICS SRL
  • EP3346426B1 patent drawingFigure 1A
  • EP3346426B1 patent drawingFigure 1B
  • EP3346426B1 patent drawingFigure 1C

AI summary

Embodiments are directed towards a reconfigurable stream switch (500) formed in an integrated circuit. The stream switch includes a plurality of output ports (516), a plurality of input ports (504), and a plurality of selection circuits. The output ports (516) each have an output port architectural composition, and each is arranged to unidirectionally pass output data and output control information. The input ports (504) each have an input port architectural composition, and each is arranged to unidirectionally receive first input data and first input control information. Each one of the selection circuits is coupled to an associated one of the output ports (516). Each selection circuit is further coupled to all of the input ports (504) such that each selection circuit is arranged to reconfigurably couple its associated output port (516) to no more than one input port (504) at any given time.