Processor Operation Mask Consolidation for SIMD Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current SIMD architectures face challenges in efficiently managing operation masks for packed data operations, leading to suboptimal processing speed and complexity in executing masked packed data instructions.

Innovation Solution

The introduction of operation mask consolidation instructions and processors capable of executing these instructions, which allow for the generation and storage of consolidated operation masks, simplifying the management of operation masks by consolidating unmasked elements and eliminating masked elements between them.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If operation masks are managed using traditional SIMD architectures, then packed data operations can be performed in parallel, but the management complexity of operation masks increases and processing speed decreases

Engineering Contradiction:
Improveprocessing speedVSAvoidmanagement complexity of operation masks
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent merges multiple operation mask elements into a consolidated operation mask. The execution unit consolidates unmasked elements from multiple operation masks into a single consolidated operation mask, reducing the number of separate mask management operations and simplifying the overall mask management process while maintaining parallel processing capabilities

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent extracts unmasked elements from operation masks and consolidates them separately from masked elements. By taking out only the relevant unmasked elements and consolidating them, the system reduces complexity by eliminating the need to manage all mask elements individually, focusing only on the active unmasked portions

Inventive Principle:
Principle #2Taking out (Extraction)

2Adaptability or versatility

If multiple operation masks are used for packed data operations, then selective masking of data elements is enabled, but the number of operations and time required to execute instructions increases

Engineering Contradiction:
Improveselective masking capabilityVSAvoidexecution time of instructions
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent performs preliminary consolidation of operation masks before executing packed data instructions. The execution unit consolidates unmasked elements from multiple operation masks in advance, creating a simplified consolidated mask that can be used directly during instruction execution, thereby reducing the time required during the actual computation phase

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent combines multiple operation mask management operations into a single consolidation operation. By merging the functionality of multiple separate mask operations into one consolidated operation, the system maintains selective masking capability while reducing the total number of operations and execution time

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS9411593B2Processors, methods, systems, and instructions to consolidate unmasked elements of operation masks
Publication Date: 2016.08.09 INTEL CORP
  • US9411593B2 patent drawing
  • US9411593B2 patent drawing
  • US9411593B2 patent drawing

AI summary

An instruction processing apparatus of an aspect includes a plurality of operation mask registers. The apparatus also includes a decode unit to receive an operation mask consolidation instruction. The operation mask consolidation instruction is to indicate a source operation mask register, of the plurality of operation mask registers, and a destination storage location. The source operation mask register is to include a source operation mask that is to include a plurality of masked elements that are to be disposed within a plurality of unmasked elements. An execution unit is coupled with the decode unit. The execution unit, in response to the operation mask consolidation instruction, is to store a consolidated operation mask in the destination storage location. The consolidated operation mask is to include the unmasked elements from the source operation mask consolidated together. Other apparatus, methods, systems, and instructions are also disclosed.