Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A crush-based data storage optimization method and device

A technology of data storage and optimization method, which is applied in the direction of electrical digital data processing, input/output process of data processing, instruments, etc. It can solve the problem of low disk I/O utilization, improve writing speed, optimize I/O O operation, reduce the effect of frequent thread switching and memory copy

Active Publication Date: 2021-06-29
SHENZHEN MASLONG INFORMATION TECH
View PDF12 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The present invention aims at the defects that the existing Ceph-based distributed storage requires frequent log recording and the crush algorithm strategy leads to low disk I / O utilization, and provides a CRUSH-based data storage optimization method and device to achieve a more balanced distribution of data , so as to reduce frequent thread switching and memory copy operations on the client side in the process of storing objects, so as to optimize I / O operations and greatly improve the disk writing speed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A crush-based data storage optimization method and device
  • A crush-based data storage optimization method and device
  • A crush-based data storage optimization method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is an embodiment of a part of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

[0028] The terms "first", "second", "third" and "fourth" in the specification and claims of the present invention and the above drawings are used to distinguish different objects, rather than to describe a specific order. Furthermore, the terms "include" and "have", as well as any variations thereof, are intended to cover a non-exclusive inclusi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a CRUSH-based data storage optimization method, comprising: classifying and storing multiple target data according to data characteristics; adjusting the CRUSH strategy and optimizing the write operation mapping relationship according to the type of the target data; The CRUSH strategy and the optimized write operation mapping relationship store multiple target data to the corresponding disk; thus, a more balanced distribution of data can be achieved, thereby reducing frequent thread switching and memory copying in the process of storing objects on the client side Operation, so as to achieve the purpose of optimizing I / O operation and greatly improving the disk writing speed.

Description

technical field [0001] The invention relates to the technical field of computer storage, in particular to a CRUSH-based data storage optimization method and device. Background technique [0002] Nowadays, the mobile Internet is in its heyday, driving the rapid development of cloud computing, Internet of Things (IoT), artificial intelligence (AI) and other emerging industries, followed by the generation of massive unstructured data, and in Explosive growth. For example, currently people frequently visit shopping websites, video websites, and instant messaging tools, etc., and the back-end storage stores a large number of video, image resources, and user access records, etc. The traditional technical solution is usually that multiple servers are connected to FC fiber storage (shared storage type, not distributed) through the SAN switching network at the same time, and then provide external services. There are many disadvantages in adopting traditional technical solutions, su...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/0638G06F3/0676
Inventor 陈希陈俊雄杨世登吴志力
Owner SHENZHEN MASLONG INFORMATION TECH
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More