Server Cold Data Segmentation for Storage Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing web page server architecture is inefficient due to the need to transfer cold data from a high-capacity but slow storage device, leading to prolonged preparation times and potential request timeouts when accessing infrequently used data.
Innovation Solution
A server system that divides data into a high-speed first portion stored on a solid state disk and a low-speed second portion stored on a hard disk drive, where the first portion is transmitted slowly to avoid request timeouts while the second portion is retrieved from the slower storage device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If cold data is moved to external storage device to prevent occupying internal storage space, then storage capacity utilization is improved, but data access preparation time increases
Solution Approach 1:
The patent divides cold data into two portions: a first portion stored in the internal storage device and a second portion stored in the external storage device. This segmentation allows the system to maintain a small amount of frequently accessed data in fast internal storage while moving the bulk of cold data to external storage, thereby improving storage capacity utilization without completely sacrificing access speed.
Solution Approach 2:
The patent applies different storage locations to different portions of cold data based on their access characteristics. The first portion with higher access frequency remains in the internal storage device with higher access speed, while the second portion with lower access frequency is moved to the external storage device. This local quality differentiation optimizes both storage capacity and access performance.
2Quantity of substance
If cold data is moved to external storage device, then internal storage space is freed, but request timeout risk increases
Solution Approach 1:
The patent performs preliminary action by pre-loading the first portion of cold data into the internal storage device before it is actually needed. This preliminary loading ensures that when a request comes in, the critical portion of the data is already available in fast storage, preventing request timeouts while still utilizing external storage for the majority of cold data.
3Productivity
If first portion of cold data is transmitted at high speed, then data transmission efficiency is improved, but request timeout risk increases
Solution Approach 1:
The patent applies dynamic transmission speed control based on the data portion being transmitted. The first portion of cold data is transmitted at a reduced speed to prevent request timeouts, while the second portion can be transmitted at higher speed once retrieved from external storage. This dynamic adjustment optimizes both transmission efficiency and reliability.
Data Source
AI summary
The present invention provides a sever which includes a network interface, a processor and a first storage device, wherein the processor is arranged for communicating with an electronic device via the network interface, and the first storage device stores data. In the operations of the server, the processor determines whether the data is cold data; and when the data is determined as the cold data, the processor moves a second portion of the data to a second storage device, and a first portion of the data is remained in the first storage device, wherein the data amount of the first portion is less than data amount of the second portion, and the access speed of the first storage device is higher than the access speed of the second storage device.