Data storage method, device and system, electronic equipment and readable storage medium

A technology of data storage and storage medium, applied in the field of storage, can solve the problems of ineffective utilization of storage resources in distributed storage systems, and achieve the effects of reducing the risk of important data loss, easy data recovery, and improving space utilization.

Pending Publication Date: 2021-05-11
BEIJING KUANGSHI TECH
View PDF9 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0011] The purpose of the embodiment of the present application is to provide a data storage method, device, system, electronic equipment and r

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method, device and system, electronic equipment and readable storage medium
  • Data storage method, device and system, electronic equipment and readable storage medium
  • Data storage method, device and system, electronic equipment and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0046] The embodiment of this application provides a data storage method, which can be found in figure 1 As shown, the data storage method provided in the embodiment of this application includes:

[0047] S101: Obtain data to be stored.

[0048] In this embodiment of the application, the data to be stored may be, for example, data captured by a camera, data accessed by other systems, data uploaded by a client, and the like.

[0049] In this embodiment of the application, data types are classified. The division method may be based on the importance of the data. Exemplarily, the importance of data can be classified according to data source, data access frequency, data confidentiality level, and content contained in data. For example, in the field of public security, the reference library data used for comparison can be divided into one category, the camera capture data within the preset period before and after the prompt information for the captured data is generated can be d...

Embodiment 2

[0087] In this embodiment, on the basis of Embodiment 1, a specific data storage process is used to illustrate the solution of the present application.

[0088] The logical architecture of a distributed storage system usually includes an application layer, a device layer, a software layer, and a business layer. The device layer is the layer that provides storage devices, mainly composed of storage nodes. The storage node Server service is running on each storage node; the business layer implements functions such as unified scheduling of storage system resources, virtualization management, load balancing, and dynamic expansion of storage space; the software layer implements functions such as data protection, data recovery, and physical device management. By adopting data protection mechanisms such as copy and N+M erasure code, the integrity and reliability of data are guaranteed; the application layer can seamlessly connect with the storage system through the storage system sta...

Embodiment 3

[0096] Based on the same inventive concept, an embodiment of the present application also provides a data storage device. see Figure 5 as shown, Figure 5 A data storage device 100 corresponding to the method shown in Embodiment 1 is shown. It should be understood that for specific functions of the data storage device 100, reference may be made to the above description, and to avoid repetition, detailed descriptions are appropriately omitted here. The data storage device 100 includes at least one software function module that can be stored in a memory in the form of software or firmware or solidified in an operating system of the data storage device 100 . specifically:

[0097] see Figure 5 As shown, the data storage device 100 includes: an acquisition module 101 , a determination module 102 and a storage module 103 . in:

[0098] An acquisition module 101, configured to acquire data to be stored;

[0099]A determining module 102, configured to determine a target disk...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data storage method, device and system, electronic equipment and a readable storage medium. The method comprises the steps of obtaining to-be-stored data; determining a target disk pack corresponding to the to-be-stored data in preset disk packs according to the type of the to-be-stored data, wherein the disk pack comprises a first disk pack and a second disk pack which have different storage strategies; and storing the to-be-stored data into the target disk pack according to the storage strategy corresponding to the target disk pack. Therefore, different storage strategies are set for the disk groups in advance, so that in practical application, data with different importance can be stored in different disk groups in a targeted manner by adopting different disk group storage according to the importance of different types of data, and on-demand storage of different data can be realized; and the effective utilization rate of storage resources of the distributed storage system is improved. And meanwhile, due to the fact that data of the corresponding type is correspondingly stored in each disk pack, storage management can be conveniently carried out on the distributed storage system.

Description

technical field [0001] The present application relates to the field of storage technologies, and in particular, to a data storage method, device, system, electronic equipment, and readable storage medium. Background technique [0002] Currently, in a distributed storage system, one of the following storage methods is usually used: [0003] 1. Use the copy method for storage: the original data is copied and backed up on different physical devices to achieve the effect of data storage protection. [0004] 2. Use real-time EC (erasure coding, erasure code) method for storage: the received data will be cached in the memory in real time, and the data cached in the memory will be divided into blocks after a certain amount of data is reached. According to the configured N+ The M erasure model uses an erasure algorithm to perform erasure coding on N original data blocks to generate M redundant data blocks, and finally stores N original data blocks and M redundant data blocks on dif...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06
CPCG06F3/0614G06F3/0631G06F3/067
Inventor 夏华丽
Owner BEIJING KUANGSHI TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products