Host Controller Cache Set Availability Check

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In memory systems, the set associative cache architecture often leads to performance degradation due to interruptions in data transmission when all blocks in a set are filled, causing bottlenecks in data transfer between the host and the cache memory.

Innovation Solution

A memory system with a host queue and cache controller that transmits status information about each set in the cache memory, allowing the host controller to determine whether to transmit host data based on availability, thereby avoiding interruptions and optimizing data transfer.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a set associative cache architecture is employed, then data transmission can be interrupted when all blocks in a set are filled, but this leads to performance degradation

Engineering Contradiction:
Improvedata transmission integrityVSAvoidmemory system performance
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The host controller checks the availability status of cache sets before transmitting host data. By performing this check in advance, the system avoids interruptions and ensures smooth data transmission, resolving the contradiction between data integrity and performance

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The cache controller provides availability status information about each set to the host controller. This feedback mechanism enables the host controller to make informed decisions about data transmission, preventing interruptions while maintaining data integrity

Inventive Principle:
Principle #23Feedback

2Reliability

If data transmission is interrupted when sets are full, then data integrity is maintained, but data transfer efficiency decreases

Engineering Contradiction:
Improvedata transmission integrityVSAvoiddata transfer time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system checks set availability before data transmission begins. This preliminary action prevents interruptions during transmission, ensuring data integrity while minimizing data transfer time by avoiding pauses

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Real-time feedback on set availability status allows the host controller to continuously monitor and adapt transmission operations, maintaining both data integrity and efficient transfer by preventing interruptions

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11200171B2Memory systems having a cache system and a host controller having a host queue
Publication Date: 2021.12.14 SK HYNIX INC
  • US11200171B2 patent drawing
  • US11200171B2 patent drawing
  • US11200171B2 patent drawing

AI summary

A memory system includes a host controller and a cache system. The host controller includes a host queue in which host data including a command outputted from a host are stored. The cache system includes a cache memory having a plurality of sets and a cache controller controlling an operation of the cache memory. The cache controller transmits status information on a certain set to which the host data are to be transmitted among the plurality of sets to the host controller. The host controller receives the status information from the cache controller to determine transmission or non-transmission of the host data stored in the host queue to the cache system.