MAC Unit Direct Group BF Processing and Shared Exponent Logic

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional MAC units require conversion of Group BF encoded values to conventional floating point encoded values for processing, leading to increased processing latency and energy consumption.

Innovation Solution

Configuring MAC units to directly load and process Group BF encoded values, utilizing shared exponent processing, shared alignment logic, and delayed normalization to reduce buffer sizes and computational overhead.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If Group BF encoded values are converted to conventional floating point encoded values for processing by MAC units, then compatibility with existing MAC units is maintained, but processing latency and energy consumption increase

Engineering Contradiction:

Improvecompatibility with existing MAC unitsVSAvoidprocessing latency

Core Design Contradiction:

Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent segments the MAC unit into separate functional components: a first plurality of buffers for storing Group BF encoded values, a second plurality of buffers for conventional floating point values, multiplication units, and accumulation units. This segmentation allows the system to handle both encoding formats simultaneously, enabling direct processing of Group BF values while maintaining compatibility with conventional floating point operations through the shared multiplication and accumulation units.

Inventive Principle:

Principle #1Segmentation

2Adaptability or versatility

If Group BF encoded values are converted to conventional floating point encoded values for processing, then existing MAC unit architecture is maintained, but energy consumption increases

Engineering Contradiction:

Improvecompatibility with existing MAC unitsVSAvoidenergy consumption

Core Design Contradiction:

Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent implements preliminary action by having the first plurality of buffers store Group BF encoded values directly in their native format before processing. The conversion to conventional floating point format is performed only when necessary by the multiplication units, rather than requiring all data to be converted in advance. This reduces the overall energy consumption by minimizing unnecessary conversion operations while maintaining the ability to process Group BF values efficiently.

Inventive Principle:

Principle #10Preliminary action

3Device complexity

If conventional floating point MAC units are used for Group BF data, then hardware simplicity is maintained, but processing efficiency decreases

Engineering Contradiction:

Improvehardware simplicityVSAvoidprocessing efficiency

Core Design Contradiction:

Device complexityVSProductivity

Solution Approach 1:

The patent creates a universal MAC unit architecture where the multiplication units and accumulation units can process both Group BF encoded values and conventional floating point values. The first plurality of buffers store Group BF values, the second plurality of buffers store conventional floating point values, and the multiplication/accumulation units can operate on either format. This multi-functionality allows the system to maintain hardware simplicity while significantly improving processing efficiency by eliminating conversion overhead for Group BF data.

Inventive Principle:

Principle #6Universality (Multi-functionality)

4Quantity of substance

If data is stored in Group BF format to reduce storage amount, then storage efficiency is improved, but processing complexity increases due to conversion requirements

Engineering Contradiction:

Improvestorage amountVSAvoidprocessing complexity

Core Design Contradiction:

Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent introduces intermediary buffers and conversion logic as mediators between the Group BF storage format and the processing units. The first plurality of buffers store Group BF encoded values, and the multiplication units include conversion capability that acts as an intermediary, transforming Group BF values to conventional floating point format only when needed for multiplication operations. This intermediary layer allows the system to maintain storage efficiency while managing processing complexity through selective conversion rather than requiring all processing to occur in the native Group BF format.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS20250138783A1Multiply and accumulate units and methods

Publication Date: 2025.05.01 MEMRYX INC

AI summary

A multiply and accumulate (MAC) unit can directly load group brain float encoded values into the MAC. The MAC unit can also include shared exponent processing. The MAC unit can also include a plurality of multiply units with shared alignment logic, and a plurality of accumulation units with shared normalization logic. The MAC unit can also implement delayed normalization.