Memory Alignment for Processing-In-Memory Power Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing memory devices struggle with efficient data processing and alignment, particularly in processing-in-memory (PIM) devices, where byte-based alignment can limit processing performance and increase power consumption.

Innovation Solution

The method involves aligning byte-based memory elements using a series of arithmetic, shift, and rotate operations to achieve non-byte-based alignment, allowing for improved parallelism, reduced power consumption, and enhanced processing efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If byte-based alignment is used in memory devices, then data access simplicity is maintained, but processing performance is limited and power consumption increases

Engineering Contradiction:
Improveprocessing performanceVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent implements dynamic alignment conversion that transforms data between byte-based and non-byte-based alignments based on processing requirements. The system dynamically adjusts alignment modes during operation, allowing optimal performance for different computational tasks while managing power consumption adaptively.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The invention changes the alignment parameter from fixed byte-based to flexible non-byte-based alignment. By modifying the data organization parameter within the memory device, the system achieves improved processing performance for specific operations without requiring external processing resources.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If byte-based alignment is used in memory devices, then compatibility with standard interfaces is maintained, but processing efficiency and parallelism are reduced

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidalignment conversion complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the memory device into multiple banks, each capable of independent alignment operations. This segmentation allows parallel processing of multiple data sets with different alignment requirements, improving overall processing efficiency while distributing the alignment conversion complexity across multiple independent units.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The memory device is designed with universal alignment conversion capability that can handle both byte-based and non-byte-based alignments within the same device. This multi-functionality allows the device to maintain compatibility with standard interfaces while simultaneously supporting optimized non-byte-based operations.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If data movement between memory arrays is increased, then processing-in-memory capabilities are enhanced, but power consumption and processing time increase

Engineering Contradiction:
Improveprocessing-in-memory capabilityVSAvoidprocessing time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent merges multiple memory banks into a unified processing-in-memory system where data can be processed in place within the memory array. By combining storage and processing functions within the same memory structure, the system enhances adaptability for complex operations while minimizing data movement time through local processing capabilities.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS12293105B2Apparatuses and methods for memory alignment
Publication Date: 2025.05.06 LODESTAR LICENSING GROUP LLC
  • US12293105B2 patent drawing
  • US12293105B2 patent drawing
  • US12293105B2 patent drawing

AI summary

The present disclosure includes apparatuses and methods related to memory alignment. An example method comprises performing an alignment operation on a first byte-based memory element and a second byte-based memory element such that a padding bit of the first byte-based memory element is logically adjacent to a padding bit of the second byte-based memory element and a data bit of the first byte-based memory element is logically adjacent to a data bit of the second byte-based memory element.