Matrix Multiplication Device Dynamic Output Mode
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing matrix multiplication devices require additional hardware to process matrix transpose operations, which increases hardware costs and reduces efficiency in neural networks and other calculation techniques.
Innovation Solution
A matrix multiplication device with a multiplication accumulation array comprising unit circuits that include multiplying-adding circuits and registers, allowing for temporary storage and feedback of multiplication accumulation results, enabling output in either column or row direction without the need for additional hardware to handle matrix transpose.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If additional hardware is used to process matrix transpose operations, then the matrix multiplication device can handle both row and column outputs, but the hardware cost increases
Solution Approach 1:
The patent makes the output direction dynamic by allowing the system to switch between row direction and column direction output modes based on computational needs. The second registers can selectively output multiplication accumulation results in either row direction or column direction, eliminating the need for fixed transpose hardware while maintaining versatility
Solution Approach 2:
The second registers serve multiple functions: they temporarily store multiplication accumulation results, enable selective output in row or column direction, and support both standard matrix multiplication and transpose operations. This multi-functionality replaces dedicated transpose hardware with a universal storage and output mechanism
2Adaptability or versatility
If additional hardware is used to process matrix transpose operations, then the device can output in both row and column directions, but the efficiency of matrix multiplication operation decreases
Solution Approach 1:
The patent enables continuous computation by allowing the unit circuits to immediately start the next batch of multiplication accumulation operations after completing one batch. The second registers hold results while enabling seamless transition to the next computational batch, maintaining continuous useful action without efficiency loss from additional hardware
Solution Approach 2:
The second registers self-manage the output direction selection between row and column modes, enabling the system to serve different output requirements without external transpose processing hardware. This self-service capability maintains efficiency by eliminating additional processing steps
3Ease of operation
If multi-bank memory and alignment hardware are used to arrange input data in specific structure, then the systolic array can perform matrix multiplication, but the hardware cost increases
Solution Approach 1:
The first register feeds back multiplication accumulation results to the multiplying-adding circuit, enabling the unit circuits to perform complete multiplication accumulation operations with internal feedback. This feedback mechanism allows the system to manage data arrangement internally without requiring external multi-bank memory and alignment hardware
Data Source
AI summary
A matrix multiplication device and an operation method thereof are provided. The matrix multiplication device includes a plurality of unit circuits. Each of the unit circuits includes a multiplying-adding circuit, a first register, and a second register. A first input terminal and a second input terminal of the multiplying-adding circuit are respectively coupled to a corresponding first input line and a corresponding second input line. An input terminal and an output terminal of the first register are respectively coupled to an output terminal and a third input terminal of the multiplying-adding circuit. The second register is coupled to the first register to receive and temporarily store a multiplication accumulation result. Wherein, the second registers of the unit circuits output the multiplication accumulation results in a column direction in a first output mode, and output the multiplication accumulation results in a row direction in a second output mode.