Floating Point MAC Unit Pipeline Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current arithmetic logic circuits, particularly floating-point multiply-and-accumulate units in high-speed processors, face challenges in achieving fast pipeline speeds due to the complexity of floating-point operations and the difficulty in dividing these operations into discrete circuit units effectively.

Innovation Solution

A three-mode Floating Point Carry-Save MAC (FP-CS-MAC) unit is implemented with a pipeline configuration that includes a BF16 Multiplier, Carry-Save Accumulate stage, and normalization/rounding stages, utilizing 2's complement and sign-magnitude formats to efficiently perform floating-point multiply-and-accumulate operations, allowing for faster execution and higher clock speeds.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If floating-point operations are implemented in high-speed processors, then computational capability is improved, but circuit complexity increases

Engineering Contradiction:
Improvecomputational capabilityVSAvoidcircuit complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The floating-point operation is divided into discrete pipeline stages: multiplication stage, alignment stage, and addition stage. Each stage performs a specific function and passes intermediate results to the next stage, enabling parallel processing and improving computational throughput while managing circuit complexity through modular design

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The alignment operation is performed in advance before the addition operation. The significand of the second operand is shifted to align with the first operand's exponent, and the exponent difference is calculated beforehand. This preliminary alignment prepares the operands for addition without blocking the multiplication stage, improving pipeline efficiency

Inventive Principle:
Principle #10Preliminary action

2Speed

If floating-point operations are divided into discrete circuit units for pipeline stages, then operation speed is improved, but difficulty in effective division increases

Engineering Contradiction:
Improvepipeline speedVSAvoiddifficulty in dividing operations
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The floating-point MAC operation is segmented into three distinct pipeline stages: (1) multiplication of significands and addition of exponents, (2) alignment of the second operand based on exponent difference, and (3) addition of aligned operands. This segmentation enables each stage to be implemented as a discrete circuit unit with well-defined inputs and outputs, facilitating effective pipeline design

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The exponent comparison and alignment amount determination are performed in the multiplication stage, before the addition stage. This preliminary calculation of the alignment shift amount allows the alignment circuit to be properly configured in advance, enabling the addition stage to proceed without waiting for exponent analysis, thus improving pipeline throughput

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11366638B1Floating point multiply-add, accumulate unit with combined alignment circuits
Publication Date: 2022.06.21 SAMBANOVA SYSTEMS INC
  • US11366638B1 patent drawing
  • US11366638B1 patent drawing
  • US11366638B1 patent drawing

AI summary

Floating point Multiply-Add, Accumulate Unit, supporting BF16 format for Multiply-Accumulate operations, and FP32 Single-Precision Addition complying with the IEEE 754 Standard. The Multiply-Accumulate unit uses higher radix and longer internal 2's complement significand representation to facilitate precision as well as comparison and operation with negative numbers. The addition can be performed using Carry-Save format to avoid long carry propagation and speed up the operation. The circuit uses early exponent comparison to shorten the accumulate pipeline stage. Operations including overflow detection, zero detection and sign extension are adopted for 2s complement and Carry-Save format.