Floating-Point Mantissa Shifting for Low-Latency Integer Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing algorithms for converting integers to floating point values and vice versa overwhelm processing capabilities with high latency and low throughput, impacting performance in hardware systems, particularly in networks.

Innovation Solution

Modifying floating point numbers by shifting mantissa bits to align with integer representations, allowing for direct processing on integer hardware without mathematical conversions, and converting back using specific integer additions to maintain data integrity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional conversion algorithms are used to convert between integer and floating point values, then data type conversion is achieved, but processing throughput decreases and latency increases

Engineering Contradiction:
Improvedata type conversion accuracyVSAvoidprocessing throughput
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent extracts only the necessary mantissa bits from the floating point representation to perform integer operations, rather than converting the entire floating point value. This selective extraction of critical bits enables integer hardware to process floating point data directly, achieving both accuracy and high throughput without full conversion overhead

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces a bit-shifting operation as an intermediary step between floating point representation and integer processing. By shifting the mantissa bits to align with integer formats, the system creates a compatible intermediate representation that can be processed by integer hardware while maintaining the original floating point precision requirements

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If conventional conversion algorithms are used to convert between integer and floating point values, then data type conversion is achieved, but processing latency increases

Engineering Contradiction:
Improvedata type conversion accuracyVSAvoidprocessing latency
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the floating point conversion process into distinct bit-manipulation operations (extracting sign, exponent, and mantissa bits; shifting mantissa; reconstructing integer representation) that can be executed in parallel on hardware. This segmentation eliminates sequential conversion overhead and reduces latency while maintaining accuracy

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent replaces the mechanical/mathematical conversion system with a direct bit-manipulation system. Instead of performing arithmetic conversions between data types, the system uses bitwise operations and shifts to directly map floating point bits to integer representations, dramatically reducing conversion time and latency

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If full mathematical conversions are performed between data types, then conversion accuracy is maintained, but processing power requirements increase

Engineering Contradiction:
Improveconversion accuracyVSAvoidprocessing power
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent uses simple, low-cost bit-shifting and masking operations instead of expensive mathematical conversion functions. These lightweight operations consume minimal processing power and can be discarded after use, enabling high-volume conversions without significant energy expenditure while maintaining necessary accuracy

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The patent changes the representation parameters of floating point numbers by interpreting the mantissa bits directly as integer values with appropriate scaling. This parameter transformation allows the same data to be processed in both floating point and integer domains without full conversion, reducing processing power requirements while maintaining accuracy

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20210064338A1Processor and system to manipulate floating point and integer values in computations
Publication Date: 2021.03.04 NVIDIA CORP
  • US20210064338A1 patent drawing
  • US20210064338A1 patent drawing
  • US20210064338A1 patent drawing

AI summary

Systems and techniques to convert data value types. In at least one embodiment, data value types are converted by adjusting data floating point numbers to identify integer values and adjusting integer values to identify floating point numbers without applying mathematical operations with respect to conversions.