A method and system for cloud storage of massive vector slice data
A vector and slicing technology, which is applied in the field of massive vector slice data cloud storage method and system, can solve the problems of no small file data storage and reading, slow storage speed, unable to meet the storage requirements of a large number of small file data, etc., and achieve faster access speed effect
Active Publication Date: 2022-04-01
CHINA ELECTRIC POWER RES INST +2
View PDF9 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
However, for a large number of small file data based on the distributed file system, due to the slow storage speed, it cannot meet the storage requirements of a large number of small file data.
At present, there is no technical solution for storing and reading a large number of small file data based on a distributed file system
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0036] Exemplary embodiments of the present invention will now be described with reference to the drawings; however, the present invention may be embodied in many different forms and are not limited to the embodiments described herein, which are provided for the purpose of exhaustively and completely disclosing the present invention. invention and fully convey the scope of the invention to those skilled in the art. The terms used in the exemplary embodiments shown in the drawings do not limit the present invention. In the figures, the same units / elements are given the same reference numerals.
[0037] Unless otherwise specified, the terms (including scientific and technical terms) used herein have the commonly understood meanings to those skilled in the art. In addition, it can be understood that terms defined by commonly used dictionaries should be understood to have consistent meanings in the context of their related fields, and should not be understood as idealized or over...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a cloud storage method for massive vector slice data. The method includes: establishing a distributed file system directory tree file; establishing all metadata nodes corresponding to the distributed file system directory tree; Aggregating the massive vector slice data under the same directory in the system to generate a massive vector slice data package; storing the massive vector slice data package in the metadata node; establishing an index for the massive vector slice data, the The massive vector slice data is associated through an index to form a data index table of the massive vector slice data in a network structure; the index table is used to record the path of the massive vector slice data in the massive vector slice data packet; through the The massive vector slice data package index table provides the massive vector slice data indexing service.
Description
technical field [0001] The present invention relates to the field of massive data storage, and more specifically, to a method and system for cloud storage of massive vector slice data. Background technique [0002] With the continuous development of science and technology, the era of massive data has arrived. Therefore, how to optimize the load of the file system and improve the balance of the load has become an important requirement at present. When the size of a data set exceeds the storage capacity of a single physical computer, it becomes necessary to partition it and store it on several separate computers. Large international companies such as Google, Amazon, IBM, and Microsoft have invested a lot of scientific research in this field and proposed a variety of innovative massive data management technologies. The current research work mainly focuses on the three levels of storage layer, computing layer and interface layer. The Hadoop project in the prior art has realiz...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/182G06F16/172G06F16/13
CPCG06F16/134G06F16/182
Inventor 马潇王景朝费香泽王宪
Owner CHINA ELECTRIC POWER RES INST