CXL Memory Write-X Encoding to Free FLIT Slots

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing CXL memory systems face inefficiencies due to high bandwidth demand from write requests composed of consecutive '0's or '1's, leading to increased latency and saturation of the CPU-to-DRAM link, as these requests consume multiple slots in FLITs, leaving little space for read requests.

Innovation Solution

Implementing a Write-X feature that uses two bits in the FLIT header to indicate consecutive '0's or '1's, allowing the CXL drive to reconstruct the data without actual transmission, freeing slots for other requests.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If write requests with consecutive '0's or '1's are transmitted using standard FLIT format, then data integrity is ensured, but bandwidth is wasted and link saturation occurs

Engineering Contradiction:
Improvebandwidth utilizationVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

Instead of transmitting actual consecutive '0' or '1' data patterns, the system transmits a compact representation (copy indicator) that instructs the receiving end to generate the data locally. This copying approach reduces transmission bandwidth consumption and power usage while maintaining data integrity, directly addressing the bandwidth waste and energy loss from transmitting redundant write patterns.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system changes the parameter representation of write data by introducing a compact encoding scheme that detects and represents consecutive identical bits using fewer bits. By transforming the data from full-bit transmission to parameter-based representation (indicating start position and pattern type), the system achieves significant bandwidth savings and reduced power consumption.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If multiple slots in FLIT are allocated for write data, then data transmission is reliable, but space for read requests is reduced

Engineering Contradiction:
Improverequest throughputVSAvoidread latency
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system uses compact representation for consecutive identical bit patterns, freeing up FLIT slots that would otherwise be occupied by transmitting redundant data. These freed slots can then be allocated to read requests or other data transmissions, increasing overall request throughput and reducing read latency by preventing link saturation.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

Instead of transmitting the complete consecutive bit pattern, the system transmits only the essential information needed to reconstruct it (partial action). This approach uses minimal slots to represent what would otherwise require multiple slots, allowing better utilization of available bandwidth for mixed read/write workloads.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If all write data is transmitted explicitly, then data accuracy is maintained, but transmission efficiency decreases

Engineering Contradiction:
Improvetransmission efficiencyVSAvoiddata compression ratio
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The system transforms the representation of write data by changing from explicit bit-by-bit transmission to parameter-based encoding. When consecutive identical patterns are detected, the system transmits parameters indicating the pattern type and position rather than the actual bits, achieving high compression ratios while maintaining complete data accuracy through lossless reconstruction at the receiving end.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12373129B2Encoding and compressing bits with Write-X feature in memory system
Publication Date: 2025.07.29 MICRON TECHNOLOGY INC
  • US12373129B2 patent drawing
  • US12373129B2 patent drawing
  • US12373129B2 patent drawing

AI summary

In a computer host system, a system and method to compress the transmission between the central processing unit (CPU) and the dynamic random access memory (DRAM) of either of an extended consecutive series of ‘0’ bits or an extended consecutive series of ‘1’ bits. The CPU or a Compute Express Link (CXL) Initiator associated with the CPU identifies the consecutive strings of ‘0’ bits or ‘1’ bits. The CPU or the CXL Initiator sets data flags in a FLIT data structure, using just two bits or four bits to indicate the strings. The data structure is sent to a CXL memory, which interprets the flags and constructs the extended series of ‘0’ bits or extended series of ‘1’ bits.