Data Storage Structure Parallel Prioritization Circuitry

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing data processing systems face latency issues when selecting a data item from a data storage structure, particularly when multiple hitting data items are identified, as the prioritization process depends on the outcome of a tag match, leading to increased processing time.

Innovation Solution

The proposed solution involves a data processing apparatus with a data storage structure that tags data items with respective tag values and assigns a tag group identifier to each data item to identify others with the same tag value. The apparatus includes tag match circuitry, prioritization circuitry, and data item selection circuitry, where prioritization is performed independently of the tag match, allowing for the selection of candidate data items before the identification of hitting data items is available.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If prioritization is performed after tag match identification, then accurate selection among hitting data items is achieved, but processing latency increases

Engineering Contradiction:
Improveprocessing latencyVSAvoidcircuit complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by performing prioritization on data items before the tag match operation completes. The prioritization circuitry selects candidate data items based on ordering criteria (such as least recently used) independently and in parallel with the tag match circuitry, so that when the tag match result becomes available, the prioritization is already done, reducing overall latency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the data selection process into independent parallel operations: tag match circuitry identifies hitting data items based on tag comparison, while prioritization circuitry separately selects candidate data items based on ordering criteria. These segmented operations occur in parallel rather than sequentially, reducing total processing time while maintaining accuracy through the final selection circuitry that combines both results.

Inventive Principle:
Principle #1Segmentation

2Productivity

If prioritization is performed independently before tag match, then processing speed increases, but selection accuracy may be compromised

Engineering Contradiction:
Improvedata item selection speedVSAvoidselection accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent uses an intermediary selection circuitry that acts as a mediator between the independent prioritization operation and the tag match operation. This intermediary combines the results from both parallel operations, ensuring that the final selected data item satisfies both the prioritization criteria and the tag match criteria, thereby maintaining selection accuracy while achieving parallel processing speedup.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The prioritization circuitry performs preliminary selection of candidate data items based on ordering criteria before the tag match result is available. This preliminary action narrows down the search space, and the final selection circuitry then verifies the tag match condition on the pre-selected candidates, maintaining accuracy while improving speed.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If multiple hitting data items are identified, then comprehensive search capability is achieved, but processing time increases due to sequential prioritization

Engineering Contradiction:
Improvehandling multiple hitsVSAvoidprocessing time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent segments the handling of multiple hitting data items by separating the identification of hitting items (tag match circuitry) from the selection of the final item (prioritization circuitry). When multiple hits are identified, the prioritization circuitry independently applies ordering criteria to select among them in parallel, rather than sequentially processing each hit, thereby reducing processing time while maintaining comprehensive search capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The prioritization circuitry performs preliminary ordering and selection among potential hitting data items before the tag match operation completes. This preliminary action prepares the selection in advance, so when multiple hits are confirmed, the system can quickly determine which one to return based on pre-computed prioritization, reducing the time penalty associated with handling multiple hits.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12204562B2Data storage structure
Publication Date: 2025.01.21 ARM LTD
  • US12204562B2 patent drawing
  • US12204562B2 patent drawing
  • US12204562B2 patent drawing

AI summary

An apparatus has a data storage structure to store data items tagged by respective tag values and stores, in association with each data item, a respective tag group identifier to identify other data items having a same tag value within a collection of data items. The apparatus also has tag match circuitry to identify one or more hitting data items. Prioritisation circuitry is provided to select candidate data items which, relative to any other data items in the particular collection of data items having the same tag group identifier as the selected candidate data item is favoured according to an ordering of the data items. The prioritisation circuitry selects the one or more candidate data items before the identification of the hitting data items is available from the tag match circuitry. Data item selection circuitry selects a candidate data item for which the tag match circuitry detected a match.