Vector Processor Parallel Data Stream Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Serial or sequential processing of heterogeneous data streams is inefficient and slow, particularly in high-bandwidth communication systems like 4G, 5G, and mmWave, where data streams with different formats and compression schemes need to be re-formed or combined, leading to insufficient performance in handling increased data rates.

Innovation Solution

A vector processor with multiple parallel processing units and grouping memory that writes and reads data streams in parallel, using a bit-level Benes network to align and rearrange data samples into homogeneous streams, reducing the overhead of multiple loops and enhancing processing efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If serial or sequential processing is used to re-form homogeneous streams from heterogeneous data streams, then processing accuracy is maintained, but processing speed and efficiency deteriorate

Engineering Contradiction:
Improveprocessing speedVSAvoidprocessing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The processing system is segmented into multiple parallel processing units, each capable of independently handling different data streams. This segmentation allows simultaneous processing of multiple homogeneous streams from heterogeneous input, dramatically improving processing speed while maintaining accuracy through dedicated processing paths for each stream type

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from one-dimensional sequential processing to multi-dimensional parallel processing by introducing multiple processing units operating simultaneously. This dimensional change enables the system to handle heterogeneous data streams with different formats and compression schemes in parallel, resolving the contradiction between speed and complexity

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If multiple loops are used to process different data streams with different formats and compression schemes, then processing completeness is ensured, but processing overhead increases

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidprocessing overhead
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

Multiple processing loops are merged into a unified parallel processing architecture where multiple processing units operate simultaneously on different data streams. This merging eliminates the sequential overhead of multiple loops while ensuring complete processing of all stream types through coordinated parallel execution

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The parallel processing architecture enables continuous useful action by eliminating idle time between processing different data streams. All processing units operate continuously and simultaneously, removing the gaps and overhead associated with sequential loop execution while maintaining complete processing coverage

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS11126430B2Vector processor for heterogeneous data streams
Publication Date: 2021.09.21 INTEL CORP
  • US11126430B2 patent drawing
  • US11126430B2 patent drawing
  • US11126430B2 patent drawing

AI summary

A vector processor includes a grouping memory functional unit coupled to grouping memory having multiple bins. The vector processor also includes a bitformatting functional unit that performs bit-level data arrangements using any suitable technique or network, such as a Benes network. The vector processor receives and reads an input vector of data that includes portions (e.g., bits) of multiple data streams, and writes each portion corresponding to a respective data stream to a respective bin in parallel using the bitformatting functional unit to align the data. The vector processor also or alternatively receives and reads multiple outgoing data streams, writes portions of the data streams in respective bins of the grouping memory, and intersperses the portions in an outgoing vector of data in parallel, using the bitformatting functional unit to align the data.