Predicated Compare-Exchange-Shuffle Instruction for Parallel Sorting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing sorting techniques in computing devices, such as neural network processing, become performance bottlenecks due to sequential execution of operations, limiting processing speed for ranking or sorting data arrays.

Innovation Solution

A single predicated compare-exchange-shuffle instruction is introduced for execution on a parallel processing device, combining Boolean operations with permutation operations to output a sub-sorted list, reducing the number of registers and improving processing speed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If existing sorting techniques are used sequentially, then operations can be executed in a straightforward manner, but processing speed becomes a performance bottleneck

Engineering Contradiction:
Improveprocessing speedVSAvoidsorting operation efficiency
Core Design Contradiction:
SpeedVSProductivity

Solution Approach 1:

The patent combines multiple operations (compare, exchange, and shuffle) into a single integrated instruction. This merging of operations eliminates the sequential execution bottleneck by allowing all three operations to occur in one atomic step, directly improving processing speed and sorting efficiency simultaneously

Inventive Principle:
Principle #5Merging (Combining)

2Device complexity

If multiple separate instructions are used for sorting operations, then each operation can be optimized independently, but the number of registers and memory footprint increase

Engineering Contradiction:
Improvenumber of registersVSAvoidinstruction set complexity
Core Design Contradiction:
Device complexityVSEase of manufacture

Solution Approach 1:

The patent merges compare, exchange, and shuffle operations into a single instruction that uses a unified register set. This consolidation reduces the total number of registers required and minimizes memory footprint while maintaining operational flexibility through the integrated design

Inventive Principle:
Principle #5Merging (Combining)

3Loss of time

If sequential sorting operations are executed, then implementation is simple, but latency increases and power consumption rises

Engineering Contradiction:
ImprovelatencyVSAvoidpower consumption
Core Design Contradiction:
Loss of timeVSUse of energy by moving object

Solution Approach 1:

The patent enables continuous useful action by executing compare, exchange, and shuffle operations simultaneously in a single atomic step rather than sequentially. This eliminates idle time between operations, reducing latency and the energy consumed during operation execution

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS20240319997A1Predicated compare-exchange-shuffle instruction for parallel processor
Publication Date: 2024.09.26 QUALCOMM INC
  • US20240319997A1 patent drawing
  • US20240319997A1 patent drawing
  • US20240319997A1 patent drawing

AI summary

A processor-implemented method for executing a hardware intrinsic programming instruction, includes performing one or more Boolean operations in combination with one or more permutation operations in response to the hardware intrinsic programming instruction being a single predicated compare-exchange-shuffle programming instruction. The method also includes outputting a sub-sorted list after the performing of the one or more Boolean operation in combination with the one or more permutation operation.