Object storage method and device, electronic equipment and storage medium

An object storage and backup technology, which is applied in the direction of electrical digital data processing, response error generation, instruments, etc., can solve the problems of affecting the efficiency of backup, increasing the burden of object storage, object storage does not support write operations, etc., to improve efficiency, The effect of reducing the number of scans and visits

Pending Publication Date: 2022-03-04
INFORMATION2 SOFTWARE SHANGHAI
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Object storage provides an interface based on the HTTP / HTTPS protocol, and uploads and downloads data through PUT and GET operations. However, because object storage does not support random position write operations, if you want to update an object, you can only upload the entire file with PUT and overwrite the previous object. , and during the scheduled backup process, if the source file changes a lot, the entire file needs to be uploaded again each time, corresponding to the corresponding increase in CPU, memory and network bandwidth requirements, and frequent interaction with the object storage will also increase the object storage burden, thus affecting the efficiency of backup

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Object storage method and device, electronic equipment and storage medium
  • Object storage method and device, electronic equipment and storage medium
  • Object storage method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] Figure 1A It is a flow chart of the object storage method provided by the embodiment of the present invention. This embodiment is applicable to the case where the source file performs object storage backup. The method can be executed by the object storage device in the embodiment of the present invention. The device can use software and / or hardware implementation. Such as Figure 1A As shown, the method specifically includes the following operations:

[0031] Step S101, acquiring current attribute information and file name of a file.

[0032] Among them, such as Figure 1B Shown is a schematic diagram of the application scenario of this embodiment, that is, the source end files in the file system are backed up in the form of objects in the object storage. Specifically, the file system can be a storage area network (StorageArea Network, SAN), network storage (Network Attached Storage, NAS) or Network File System (Network File System, NFS), etc., of course, this embodi...

Embodiment 2

[0048] figure 2 It is a flow chart of the object storage method provided by the embodiment of the present invention. This embodiment is based on the above embodiment, and specifically describes the process of uploading the changed blocks to the object storage for backup in the above step S104. The method steps Specifically include the following operations:

[0049] Step S201, obtaining the current number of blocks of the file and the number of historical blocks stored in the local database.

[0050] It should be noted that since the previous backup record information is stored in the local database, and the previous backup record information contains the historical block data of each file, the query is performed from the local database according to the file name. The number of historical blocks corresponding to the file name can be obtained directly.

[0051] Step S202, judging whether the current number of blocks is the same as the number of historical blocks, if they are ...

Embodiment 3

[0062] image 3 A schematic structural diagram of an object storage device provided by an embodiment of the present invention, the device includes: an attribute information and file name acquisition module 310 , an attribute information status determination module 320 , a block module 330 and an object storage module 340 .

[0063] Attribute information and file name obtaining module 310, for obtaining the current attribute information and file name of the file;

[0064] Attribute information state determination module 320, for querying the local database according to the file name, and determining the update state of the current attribute information of the file;

[0065] The block module 330 is used to block the file and determine the index of each block when it is determined that the current attribute information changes according to the update status;

[0066] The object storage module 340 is configured to query the local database according to the index of each block, and...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Embodiments of the invention disclose an object storage method and apparatus, an electronic device and a storage medium. The method comprises the steps of obtaining current attribute information and a file name of a file; querying a local database according to the file name, and determining an update state of current attribute information of the file; when it is determined that the current attribute information changes according to the updating state, the file is partitioned, and the index of each partition is determined; and querying a local database according to the index of each block, and uploading the changed blocks to an object storage for backup. When it is determined that the file attribute information changes, the file is divided into blocks, and only the changed blocks are uploaded to the object storage for backup, so that the scanning and access times of the object storage are reduced, bandwidth waste and resource occupation for transmitting repeated data are reduced, and the backup efficiency is improved.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of object storage, and in particular, to an object storage method, device, electronic device, and storage medium. Background technique [0002] With the rapid development of cloud technology and big data, petabyte-level capacity units have become more common in many enterprises, and object storage, as a network architecture in the field of cloud computing storage services, has become more and more widely used. It is more concise than file storage, and it is more in line with popular ideas in terms of use, expansion, and maintenance. File system data backup or migration to object storage has become a relatively common method in the backup field. Generally, the more common backup method is to scan the file attribute information on the file system, obtain the metadata information of the target object on the object storage, compare whether the source file has changed, and then upload the e...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/14
CPCG06F11/1451G06F11/1464
Inventor 杨杰
Owner INFORMATION2 SOFTWARE SHANGHAI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap