Hardware accelerator for lookup table-based general matrix operations

Abstract

This provides a hardware accelerator for lookup table-based general matrix operations. [Solution] The hardware accelerator 100 includes a weight buffer that stores a weight matrix in which the weights of the target model have been quantized, an input buffer that stores an input matrix including floating-point-based input activation values ​​for the target model, and a matrix processing unit 130 that performs matrix operations between the weight matrix and the input matrix. The matrix processing unit includes a lookup table generator that calculates each calculation result value corresponding to all possible cases between the quantum weights and input activation values ​​that can occur during matrix operations and generates a lookup table containing the calculation result values, and a plurality of processing elements that extract calculation result values ​​corresponding to the quantum weights from the lookup table during matrix operations and generate a partial sum.

Images