Unlock instant, AI-driven research and patent intelligence for your innovation.

Data storage system, method, device, equipment and storage medium

A data storage system and file technology, applied in the computer field, can solve the problems of rough compression granularity, difficult to control data amplification, and high operation and maintenance costs, and achieve the effects of fewer reading and writing dependent components, low resource costs, and low operation and maintenance costs

Active Publication Date: 2022-03-25
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Use column-type non-relational database Hbase as storage, rely on multiple modules such as master, regionserver, and zk, and the operation and maintenance costs are high
In addition, the columnar non-relational database Hbase, in the scenario of continuous data arrival, has rough compression granularity, obvious data amplification and is difficult to control, which ultimately leads to insufficient read and write performance and cannot meet the needs of massive search data storage

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage system, method, device, equipment and storage medium
  • Data storage system, method, device, equipment and storage medium
  • Data storage system, method, device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] The application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain related inventions, rather than to limit the invention. It should also be noted that, for the convenience of description, only the parts related to the related invention are shown in the drawings.

[0022] It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and embodiments.

[0023] figure 1 A schematic structural diagram of related modules of an HBase system belonging to the prior art is shown.

[0024] Such as figure 1 As shown, the HBase system includes a manager (master), a partition server (Region Server), a partition (Region), an applicat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the present application discloses a data storage system, method, device, device, and storage medium, and relates to technical fields such as data storage and search. A specific embodiment of the data storage system includes: a user terminal configured to: when writing a file, write the file sequentially to the distributed file system, and register the meta information of the file to the meta information server; , obtain the meta information of the file to be read from the meta information server, and read the file to be read from the distributed file system according to the obtained meta information of the file to be read; the meta information server is configured to store the meta information of the file information, wherein the meta information of the file includes the key value range of the file; the distributed file system is configured to store the files written by the user terminal. The embodiment of this application adopts the de-partitioning design, the user terminal directly interacts with the distributed file system, the reading and writing of data depends on fewer components, the architecture is simple, and the operation and maintenance cost and resource cost are low.

Description

technical field [0001] The present application relates to the field of computer technology, specifically to data storage, search and other technical fields, and especially to data storage methods, devices, equipment and storage media. Background technique [0002] New media forms such as self-media and small videos have enriched the forms and carriers of information on the Internet. These massive structured data are provided to search engines by webmasters. After the engines capture and process them, they need to be stored and then indexed. The growth of data brings about a crazy increase in storage machine costs and operation and maintenance costs. [0003] Mass structured data storage is currently stored in column-type non-relational database Hbase. Using columnar non-relational database Hbase as storage, relying on multiple modules such as master, regionserver, and zk, the operation and maintenance costs are high. In addition, the columnar non-relational database Hbase,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/182G06F16/172G06F16/16
CPCG06F16/182G06F16/172G06F16/16
Inventor 滕岩松曲晶莹张安站刘伟刘桐仁
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD