Neural Network Accelerator Array for Low-Power Parallel Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing artificial neural networks face challenges in providing efficient, timely processing with reduced power and hardware needs, especially in applications requiring real-time data integration and minimal energy consumption, such as sensor fusion in smart wearable devices and automotive systems.
Innovation Solution
A neural network accelerator with a hardware circuit designed for dynamic neural network processing, featuring a computing element array with control, storage, and operation circuits, capable of reconfiguration through firmware, and an in-memory matrix multiplier architecture for reduced power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If modern neural networks are implemented with large hardware systems, then processing power and speed are improved, but power consumption and hardware requirements increase significantly
Solution Approach 1:
The neural network hardware is segmented into multiple computing elements arranged in an array, where each computing element processes a portion of the neural network computations. This segmentation allows the system to achieve high processing throughput through parallel execution while keeping individual computing element power consumption low, thereby resolving the contradiction between processing speed and power consumption.
Solution Approach 2:
Each computing element in the array is designed to be reconfigurable and can perform multiple types of neural network operations (e.g., matrix multiplication, convolution, activation functions). This multi-functionality allows a fixed hardware architecture to efficiently handle diverse neural network workloads without requiring separate dedicated hardware for each operation, reducing overall hardware requirements while maintaining high processing capability.
2Adaptability or versatility
If neural network hardware is made reconfigurable to adapt to different applications, then adaptability is improved, but device complexity increases
Solution Approach 1:
The computing elements are designed with dynamic reconfiguration capabilities through firmware or software control, allowing the hardware to adapt to different neural network architectures and workloads. The reconfiguration is achieved by modifying operational parameters and data flow patterns rather than physically rearranging hardware components, which maintains relatively simple hardware structure while providing high adaptability.
Solution Approach 2:
Instead of creating physically different hardware for each neural network application, the system uses software-based configuration to create virtual copies of computing element behaviors. Each computing element can be programmed to emulate different neural network layer types through firmware, achieving application-specific optimization without increasing physical hardware complexity.
Data Source
AI summary
A computing element array system includes an array of computing elements connected by connections. Each computing element has a control circuit, a storage circuit, and an operation circuit and the connections each connect two computing elements. The storage circuit can input and store a data packet comprising a data value and a target-tag from one of the connections. The operation circuit can perform an operation on the data value to form a processed data value. The target-tag specifies a computing element to perform the operation on the data value. The control circuit can identify a computing element from the target-tag, enable the operation circuit to process the data value if the identified computing element matches the computing element, modify the data packet to comprise the processed data value, and enable the output of the modified data packet on one of the connections.


