Datacache Parallelism Architecture for Non-Power-of-Two Sectioning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing datapath architectures are inefficient due to the power-of-two parallelism paradigm, which leads to resource wastage and performance bottlenecks when trying to achieve non-power-of-two datacache section processing, resulting in larger device footprints and suboptimal operation speeds.

Innovation Solution

Implementing a generalized parallelism paradigm that allows the datapath architecture to divide datacache into any positive integer number of sections, using translation functions to address discontinuities in column address mapping, enabling efficient resource utilization and faster operation speeds with a smaller device footprint.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If power-of-two parallelism paradigm is used, then datapath architecture is simplified, but resource wastage occurs and device footprint increases

Engineering Contradiction:
Improvedatapath architecture complexityVSAvoidresource wastage
Core Design Contradiction:
Device complexityVSLoss of substance

Solution Approach 1:

The patent changes the fundamental parameter of parallelism from power-of-two constraints to any positive integer division. By allowing datacache to be divided into N sections where N can be any positive integer (not limited to powers of two), the system achieves optimal resource utilization for specific performance requirements while avoiding the resource wastage inherent in power-of-two paradigms when N is not a power of two.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent introduces dynamic flexibility in the parallelism paradigm by enabling the datacache to be divided into any positive integer number of sections based on operational requirements. This dynamic adaptability allows the system to optimize resource allocation for specific workloads rather than being constrained by fixed power-of-two architecture, thereby reducing resource wastage while maintaining architectural manageability.

Inventive Principle:
Principle #15Dynamics

2Device complexity

If power-of-two parallelism paradigm is used, then datapath architecture is simplified, but operation speed is reduced

Engineering Contradiction:
Improvedatapath architecture complexityVSAvoidoperation speed
Core Design Contradiction:
Device complexityVSSpeed

Solution Approach 1:

The patent changes the parallelism parameter from fixed power-of-two to flexible positive integer division. This parameter change enables the system to achieve higher operation speeds by dividing datacache into optimal numbers of sections (N) that match specific performance requirements, allowing for better resource utilization and faster data processing without the speed limitations imposed by power-of-two constraints.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent enables dynamic optimization of operation speed by allowing the datacache to be divided into any positive integer number of sections based on workload requirements. This dynamic flexibility permits the system to achieve higher speeds for specific operations by selecting optimal division factors, rather than being constrained by the slower performance characteristics of fixed power-of-two architectures.

Inventive Principle:
Principle #15Dynamics

3Loss of substance

If non-power-of-two sections are processed, then resource efficiency improves, but discontinuities in column address mapping occur

Engineering Contradiction:
Improveresource efficiencyVSAvoidaddress mapping continuity
Core Design Contradiction:
Loss of substanceVSReliability

Solution Approach 1:

The patent introduces translation functions as intermediary mechanisms that map logical addresses to physical addresses in the datacache. These translation functions act as mediators between the logical address space and the physical datacache sections, resolving discontinuities in column address mapping while enabling efficient non-power-of-two section division. The translation layer ensures continuous and reliable address mapping regardless of the number of sections.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent segments the datacache into N sections where N can be any positive integer, and introduces translation functions to manage the address mapping between segments. This segmentation approach, combined with translation functions, allows efficient resource utilization across non-power-of-two sections while maintaining reliable and continuous address mapping through the translation layer.

Inventive Principle:
Principle #1Segmentation

4Productivity

If larger device footprint is used, then parallelism capability increases, but manufacturing cost increases

Engineering Contradiction:
Improveparallelism capabilityVSAvoiddevice footprint
Core Design Contradiction:
ProductivityVSArea of stationary object

Solution Approach 1:

The patent changes the parallelism parameter from power-of-two constraints to flexible positive integer division. This parameter change enables the system to achieve high parallelism capability with smaller device footprints by dividing datacache into optimal numbers of sections (N) that match specific performance requirements, avoiding the need for larger architectures solely to achieve power-of-two parallelism levels.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent introduces dynamic flexibility in parallelism configuration, allowing the datacache to be divided into any positive integer number of sections based on operational needs. This dynamic adaptability enables the system to achieve high parallelism capability with minimized device footprint by selecting optimal division factors for each specific workload, rather than over-provisioning for fixed power-of-two requirements.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20250348437A1Datapath architectures with a generalized parallelism paradigm
Publication Date: 2025.11.13 MICRON TECHNOLOGY INC
  • US20250348437A1 patent drawing
  • US20250348437A1 patent drawing
  • US20250348437A1 patent drawing

AI summary

A method includes identifying a logical address of a logical address space, translating the logical address to a set of physical addresses of a physical address space by using a set of translation functions, the set of translation functions including a position address translation function that translates the logical address to a position address of the set of physical addresses based on a cardinality of a set of datacache sections, and a section address translation function that translates the logical address to a section address of the set of physical addresses based on the cardinality of the set of datacache sections, and causing, using the position address and the section address, the set of datacache sections to process a set of media access operations in parallel, each media access operation of the set of media access operations corresponding to a respective datacache section of the set of datacache sections.