Server Switch Circuit Routing Data Chunks to Memory Modules

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current data center systems face limitations in operating speed due to the response times of cache and database servers, which affect overall data center performance.

Innovation Solution

A server device is designed with multiple interface circuits for network communication, independent memory modules, and a switch circuit that selects the appropriate memory module based on data chunk attributes, enabling efficient data processing and management through a data plane and control plane circuit configuration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If multiple memory modules are used to increase data processing capacity, then productivity is improved, but device complexity increases due to the need for switch circuit and routing management

Engineering Contradiction:
Improvedata processing capacityVSAvoidswitch circuit and routing management
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system segments memory management by dividing memory modules into different types (first memory modules for hot data, second memory modules for cold data) and uses a switch circuit to route data chunks to appropriate memory modules based on their access patterns and attributes, thereby managing complexity through structured segmentation

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The switch circuit acts as an intermediary component that receives data chunks from interface circuits and intelligently routes them to the most appropriate memory module based on attributes such as access frequency and data type, thereby managing the complexity of multiple memory modules through a centralized routing mechanism

Inventive Principle:
Principle #24Intermediary (Mediator)

2Speed

If data is stored in cache server to improve response speed, then speed is improved, but loss of time occurs due to cache miss and data retrieval from database server

Engineering Contradiction:
Improveresponse speedVSAvoidcache miss retrieval time
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The system applies local quality by storing different types of data in different memory modules based on their access characteristics - hot data (frequently accessed) is stored in first memory modules for fast access, while cold data (infrequently accessed) is stored in second memory modules, thereby optimizing response speed for different data access patterns

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system performs preliminary action by proactively caching frequently accessed data in the cache server's memory modules before it is actually needed, based on access pattern analysis and prediction, thereby reducing cache miss rates and avoiding time-consuming data retrieval from database servers

Inventive Principle:
Principle #10Preliminary action

3Reliability

If database server processes all data requests to ensure data accuracy, then reliability is improved, but productivity decreases due to processing bottleneck

Engineering Contradiction:
Improvedata accuracyVSAvoidrequest processing throughput
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system segments data into hot data and cold data categories, and segments processing responsibilities between cache server (for hot data) and database server (for cold data), thereby maintaining data accuracy through proper data classification while improving overall processing throughput by distributing workloads appropriately

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10440112B2Server device including interface circuits, memory modules and switch circuit connecting interface circuits and memory modules
Publication Date: 2019.10.08 SAMSUNG ELECTRONICS CO LTD
  • US10440112B2 patent drawing
  • US10440112B2 patent drawing
  • US10440112B2 patent drawing

AI summary

A server device includes a plurality of interface circuits configured to connect with a network, and perform format conversion between network packets and data chunks, the network packets being packets communicated with the network, the data chunks complying with an internal format; a plurality of memory modules operating independently of each other; and a switch circuit connected between the plurality of interface circuits and the plurality of memory modules, the switch circuit being configured to select at least one memory module from among the plurality of memory modules based on an attribute of a first data chunk transmitted from the plurality of interface circuits and, send the first data chunk to the selected memory module, wherein the selected at least one memory module is configured to, decode the first data chunk, and perform a read or write operation associated with the first data chunk based on the decoding result.