Mixed-Element Vector Arithmetic Processing Circuitry

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional data processing systems lack support for mixed-element-sized vector arithmetic instructions, where vectors with different bit sizes are used as operands, limiting parallel computation efficiency and requiring unnecessary operand copying between scalar and vector registers.

Innovation Solution

The system includes processing circuitry and decoder circuitry that can handle mixed-element-sized vector arithmetic instructions, allowing operations between vectors of different bit sizes, thereby enabling efficient parallel processing without the need for frequent operand copying.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional data processing systems use uniform vector element sizes for all operations, then the system architecture remains simple and implementation is straightforward, but parallel computation efficiency is limited and requires unnecessary operand copying between scalar and vector registers

Engineering Contradiction:
Improveparallel computation efficiencyVSAvoidsystem architecture complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system dynamically adapts vector element sizes based on the specific operation requirements. The processing circuitry is designed to handle variable element widths (e.g., 8-bit, 16-bit, 32-bit, 64-bit) within the same vector register, allowing the architecture to flexibly match the data granularity needed for each parallel computation task without requiring separate hardware for each element size

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The vector processing unit is designed with universal capability to perform arithmetic operations on vectors regardless of element size. A single vector instruction can operate on elements of different bit widths, eliminating the need for separate scalar and vector processing paths and reducing the complexity of having multiple specialized units

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If the system requires operand copying between scalar and vector registers for mixed-size operations, then processing accuracy is maintained, but processing overhead increases and performance deteriorates

Engineering Contradiction:
Improveprocessing accuracyVSAvoidprocessing overhead
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system introduces a conversion mechanism within the vector processing unit that acts as an intermediary between different element sizes. When operations involve mixed element widths, the circuitry automatically performs size conversion directly in the vector register without requiring intermediate copying to scalar registers, thus maintaining precision while avoiding the time penalty of repeated copying operations

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs element size conversion preliminarily within the vector register before the actual arithmetic operation. This preliminary conversion ensures that operands are in the correct format for the operation, eliminating the need for post-conversion copying and ensuring processing accuracy is maintained from the outset

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If the system supports multiple vector element sizes simultaneously, then operational versatility is improved and parallel processing efficiency is enhanced, but decoder complexity and instruction decoding overhead increase

Engineering Contradiction:
Improveoperational versatilityVSAvoiddecoder complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The decoder is designed with localized specialization for different element size specifications. Rather than requiring complex logic to handle all possible size combinations, the decoder uses targeted fields in the instruction format to specify element sizes, with dedicated decoding paths for common cases (e.g., 8-bit, 16-bit, 32-bit, 64-bit elements), reducing overall decoder complexity while maintaining versatility

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11003447B2Vector arithmetic and logical instructions performing operations on different first and second data element widths from corresponding first and second vector registers
Publication Date: 2021.05.11 ARM LTD
  • US11003447B2 patent drawing
  • US11003447B2 patent drawing
  • US11003447B2 patent drawing

AI summary

A data processing system (2) supports vector processing operations performed upon vector operands comprising a plurality of vector operand elements. The data processing system includes a processor (4) having an instruction decoder (14) which decodes mixed-element-sized vector arithmetic instructions to generate control signals (16) which control processing circuitry (18) to perform arithmetic operations upon a first vector of first source operand elements ai of a first bit size A, and a second vector of second source operand elements bj of a second bit size B. The second bit size B is greater than the first bit size A.