Lookup table access for quantization and dequantization operations

By representing quantized floating-point numbers as integer indices in a LUT and using a multiplexer hierarchy, the computational overhead of ML operations is minimized, enhancing efficiency in processing large datasets.

WO2026142888A1PCT designated stage Publication Date: 2026-07-02ADVANCED MICRO DEVICES INC

Patent Information

Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
ADVANCED MICRO DEVICES INC
Filing Date
2025-12-16
Publication Date
2026-07-02

AI Technical Summary

Technical Problem

Conventional quantization and dequantization algorithms for machine learning (ML) operations consume significant computational resources due to the use of mathematical functions, especially when processing large datasets in different number formats, leading to increased processing overhead.

Method used

Represent quantized floating-point numbers as integer indices in a lookup table (LUT) to reduce computational overhead, using a hierarchy of multiplexers to access cache lines based on these indices, allowing conversions to be performed with a single instruction.

Benefits of technology

Reduces storage and bandwidth requirements while minimizing computational overhead by converting or dequantizing data using a LUT, enabling efficient matrix operations with reduced resource consumption.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure US2025059834_02072026_PF_FP_ABST
    Figure US2025059834_02072026_PF_FP_ABST
Patent Text Reader

Abstract

One or more cache lines are configured to store a lookup table (LUT) having a plurality of floating-point numbers that are represented by a first number of bits. One or more multiplexers are connected to the cache line(s). The multiplexer(s) is / are configured to select one of the floating-point numbers based on an integer index having a second number of bits that is less than the first number of bits. The integer index is a quantized representation of the selected one of the floating-point numbers. In some cases, a memory is configured to store a matrix of integer indices that are generated by quantizing floating-point numbers that represent data associated with a machine learning algorithm. The integer index is provided by the matrix of the integer indices.
Need to check novelty before this filing date? Find Prior Art