Matrix Pair Zeroing via Tile Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Handling large matrices in mainstream processors is instruction intensive and inefficient, particularly when dealing with operations that require loading and storing data across multiple packed data registers, which becomes cumbersome with larger matrices.

Innovation Solution

The implementation of tile-based matrix operations in computer hardware, where matrices are divided into smaller 2-D data structures called 'tiles' that can be independently operated on, allowing for efficient configuration and zeroing of tile pairs using specialized instructions like TZPAIR, facilitating improved memory management and processing efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If matrices are processed using traditional packed data registers in mainstream processors, then the processing can be performed using standard instruction sets, but the instruction intensity increases and processing efficiency deteriorates for large matrices

Engineering Contradiction:
Improvematrix operation efficiencyVSAvoidinstruction intensity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent divides large matrices into smaller sub-matrices or tiles that can be processed independently. This segmentation allows the processor to handle manageable portions of data at each instruction cycle, reducing the instruction intensity per operation while maintaining overall processing capability for large matrices through multiple sequential operations on the segmented portions.

Inventive Principle:
Principle #1Segmentation

2Quantity of substance

If data is loaded and stored across multiple packed data registers for large matrices, then the data can be accommodated, but the operation becomes cumbersome and memory management complexity increases

Engineering Contradiction:
Improvedata capacityVSAvoidmemory management ease
Core Design Contradiction:
Quantity of substanceVSEase of operation

Solution Approach 1:

By dividing the matrix data into smaller tiles that fit within standard packed data registers, the patent eliminates the need for complex multi-register data shuffling. Each tile can be loaded, processed, and stored using standard single-register operations, significantly simplifying memory management while maintaining the ability to handle large matrices through iterative processing of segmented data.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11645077B2Systems and methods to zero a tile register pair
Publication Date: 2023.05.09 INTEL CORP
  • US11645077B2 patent drawing
  • US11645077B2 patent drawing
  • US11645077B2 patent drawing

AI summary

Embodiments detailed herein relate to systems and methods to zero a tile register pair. In one example, a processor includes decode circuitry to decode a matrix pair zeroing instruction having fields for an opcode and an identifier to identify a destination matrix having a PAIR parameter equal to TRUE; and execution circuitry to execute the decoded matrix pair zeroing instruction to zero every element of a left matrix and a right matrix of the identified destination matrix.