Object aggregation method, device and equipment and readable storage medium

An aggregation method and object technology, applied in the direction of instruments, electrical digital data processing, input/output to record carriers, etc., can solve the problems of inconvenience and low performance of cluster data reading

Active Publication Date: 2020-05-19
LANGCHAO ELECTRONIC INFORMATION IND CO LTD
View PDF7 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the object of the present invention is to provide an object aggregation method, an object aggregation device, an object aggregation device, and a computer-readable storage medium, which solve the inconvenience caused by the existing object aggregation method to subsequent operations and the data reading performance of the cluster. Raise smaller issues

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Object aggregation method, device and equipment and readable storage medium
  • Object aggregation method, device and equipment and readable storage medium
  • Object aggregation method, device and equipment and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is only some embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0051] Please refer to figure 1 , figure 1 It is a flowchart of an object aggregation method provided by an embodiment of the present invention. The method includes:

[0052] S101: Obtain a target object, and calculate a correlation index corresponding to the target object; wherein, the target object is an object file whose file size is sm...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an object aggregation method, which comprises the steps of: acquiring a target object, and calculating a correlation index corresponding to the target object, wherein the target object is an object file of which the file volume is smaller than a preset threshold value; generating aggregation task by utilizing the correlation index, and putting the aggregation tasks into anaggregation task queue; and acquiring target aggregation tasks from the aggregation task queue according to a preset correlation sequence, constructing an aggregation object by utilizing first targetobjects corresponding to the target aggregation tasks, and storing the aggregation object into a storage system. According to the object aggregation method, the target aggregation tasks are acquired from the aggregation task queue according to the preset correlation sequence, and the aggregation object is constructed by utilizing the first target objects corresponding to the target aggregation tasks and stored in the storage system, thus aggregation storage of the objects is completed, cluster IO is reduced during data reading and writing, and cluster data reading performance is enhanced; in addition, the invention further provides an object aggregation device, object aggregation equipment and a computer readable storage medium, which further have the above beneficial effects.

Description

technical field [0001] The present invention relates to the technical field of distributed storage, and in particular to an object aggregation method, an object aggregation device, an object aggregation device, and a computer-readable storage medium. Background technique [0002] A distributed object storage system refers to a distributed storage system for unstructured data. At this stage, more and more business scenarios require the use of distributed object storage systems. With the increasing amount of data in the storage cluster, a large number of read and write requests and other operations bring a lot of disk IO consumption. Since the IO and throughput of the cluster are limited, it is necessary to improve the limited use of data. , to improve the data reading performance of the cluster. [0003] In a traditional distributed object storage cluster, data reading performance is improved through object aggregation. The aggregation process is to traverse all the small ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/0643G06F3/067
Inventor 李治鹏胡永刚
Owner LANGCHAO ELECTRONIC INFORMATION IND CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products