System and method for layered storage of supercomputer operation data

A supercomputer and hierarchical storage technology, applied in computing, digital data processing, data processing input/output process, etc., to solve storage system performance bottlenecks, improve stability, increase total available space and storage service IO performance effect

Active Publication Date: 2022-05-13
天津市天河计算机技术有限公司
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to overcome the deficiencies of the prior art, and propose a supercomputer job data layered storage system and method, which can solve the problem of the bottleneck of the supercomputer system’s operation and storage performance under the premise of controlling the overall equipment cost of the storage system, and Improve the operation stability of the storage system and even the entire supercomputer

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method for layered storage of supercomputer operation data
  • System and method for layered storage of supercomputer operation data
  • System and method for layered storage of supercomputer operation data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The present invention will be described in further detail below in conjunction with the accompanying drawings.

[0032] A hierarchical storage system for supercomputer operation data includes a three-tier storage system set in the supercomputer, and the three-tier storage system is respectively a high-speed storage layer, an online storage layer and a near-line storage layer. like figure 2 As shown, since supercomputer users generally manage job data through login nodes, and job tasks run through computing nodes, the high-speed storage layer mounts general computing nodes; the online storage layer mounts login nodes and small and micro job computing nodes. The user's job data is stored in the online storage layer, and the user can manage the job data by logging in to the node; when a job needs to be run, the job data is copied from the online storage layer to the high-speed storage layer through the "job copy return mechanism". . At the same time, for smaller job tas...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a hierarchical storage system and method for supercomputer operation data. By dividing the storage layer into a three-layer storage system including a high-speed storage layer, an online storage layer and a near-line storage layer, the three-layer storage system is respectively constructed. The operation data copy and return mechanism, the original data retention time calculation mechanism and the operation data automatic archiving and exchange mechanism, and the integration of the supercomputer system and the three-tier storage system realize the solution under the premise of controlling the overall equipment cost of the storage system. It solves the contradiction between user operation data storage space, access performance and equipment cost of the supercomputer system. While maintaining the low cost of storage equipment, it improves the total available space of the storage system and the IO performance of storage services, increases the total available storage space of data, and reduces The average cost of storage system equipment.

Description

technical field [0001] The invention belongs to the field of supercomputer storage, in particular to a system and method for layered storage of supercomputer operation data. Background technique [0002] With the continuous development of high-performance computing technology, the computing performance that supercomputers can provide is getting stronger and stronger. More and more researchers are using supercomputers to run their own operations to reduce operation time and improve scientific research work. efficiency. However, during the same period, the development speed of the underlying storage system of the supercomputer was relatively flat. With the continuous improvement of the computing performance of the supercomputer, the supporting storage system began to be unable to cope with it. When running high IO computing jobs, the storage system began to become a The bottleneck of the entire high-performance computing system restricts the further improvement of the perform...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/0685G06F3/0602G06F3/061G06F3/0608
Inventor 庞晓磊李长松张婷刘嘉琦赵欣婷徐斌夏梓峻张健孙福兴贾子傲王普杨晶
Owner 天津市天河计算机技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap