Vector Scan Operation Step Reduction via Parallel Combination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing vector scan operations in data processing systems require additional steps when combining an extra data element with vector elements, leading to inefficiencies, especially when not all data elements are of interest, as they either combine the extra element initially or perform all combinations sequentially, which can slow down performance.

Innovation Solution

The proposed solution involves performing vector scan operations in multiple steps, where the extra data element is combined at multiple stages, allowing earlier availability of result data elements and reducing the number of steps required, especially when fewer than all data elements are needed, by incorporating parallel combination operations and flexible scheduling of combination steps.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the additional data element S is combined with all vector data elements in an initial step before performing scan combinations, then the scan operation can be completed, but an extra processing step is required which reduces performance

Engineering Contradiction:
Improvevector scan operation throughputVSAvoidnumber of processing steps
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by combining the additional data element S with select vector data elements at strategic intermediate steps rather than waiting until the end or combining all elements initially. This allows the scan operation to progress with partial results available earlier, reducing the total number of processing steps required while maintaining correctness of the final result.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If the vector scan operation is performed sequentially step-by-step combining all elements, then correctness is maintained, but performance is reduced due to inability to parallelize operations

Engineering Contradiction:
Improvecorrectness of scan resultsVSAvoidexecution speed of vector scan
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent segments the vector scan operation into multiple independent parallel steps where different combination operations can be performed simultaneously on different data elements. By dividing the computation into stages that can execute in parallel while maintaining data dependencies, the patent achieves both correctness through proper ordering and improved performance through parallelization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs dynamic scheduling where the combination of the additional data element S with vector elements occurs at different steps depending on data availability and computation progress. This dynamic approach allows the system to adapt the timing of S combinations to maximize parallelization opportunities while ensuring correctness, rather than following a fixed sequential pattern.

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If all M data elements of the source vector are processed to generate M result data elements, then complete results are available, but unnecessary processing occurs when fewer than M elements are needed

Engineering Contradiction:
Improveflexibility to handle partial resultsVSAvoidefficiency when only some results needed
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent applies partial action by allowing the vector scan operation to generate only the necessary number of result data elements rather than always processing all M elements. When fewer than M result elements are required, the computation can be terminated early or selectively applied, avoiding unnecessary processing steps and improving efficiency while maintaining adaptability to different result requirements.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10001994B2Data processing apparatus and method for performing scan operations omitting a further step
Publication Date: 2018.06.19 ARM LTD
  • US10001994B2 patent drawing
  • US10001994B2 patent drawing
  • US10001994B2 patent drawing

AI summary

A vector scan operation is performed to generate M data elements of a result vector, where each result data element corresponds to a combination of an additional data element S with at least some of the data elements of a source vector operand V. The vector scan operation is performed using a plurality of steps, each step comprising one or more combination operations for combining data elements. At least one of the steps includes two or more combination operations performed in parallel. At least two of the steps comprise a combination operation for combining a data element with the additional data element S. This approach enables the vector scan operation to be performed in fewer steps in the case where fewer than M data elements are active, so that the vector scan operation can be performed more quickly.