1results about How to "Solve the complex calculation process" patented technology

The application discloses a low-bit matrix calculation device with a floating-point scaling factor and a calculation method thereof. The device comprises a scaling factor processing module, an input module, a matrix calculation module, a floating-point accumulation module and an output module. The method first groups and quantizes weight and eigenvalue matrices to obtain quantization values and floating-point scaling factors; then, the scaling factor product is calculated in advance with a single accumulation length as a grouping unit; then, matrix multiplication and accumulation operation is performed, the result is multiplied by the scaling factor product after being converted into an fp16 or bfp16 format, and then accumulated into a final result; and finally, the result is output after being dequantized. The application simplifies the group-wise calculation process, saves hardware resources, guarantees calculation accuracy, meets different scene requirements and improves calculation efficiency by sharing the scaling factor product and using fp16 or bfp16 as an accumulator.