Data storage method and device based on big data, storage medium and processor

A data storage and database technology, applied in the field of big data, can solve the problem of low data storage efficiency, and achieve the effects of large data throughput, fast retrieval, and fast storage

Active Publication Date: 2020-05-15
BEIJING INTERNETWARE LTD
View PDF9 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The main purpose of this application is to provide a data storage method, device, storage medium and processor based on big data to solve the problem of low data storage efficiency in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method and device based on big data, storage medium and processor
  • Data storage method and device based on big data, storage medium and processor
  • Data storage method and device based on big data, storage medium and processor

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and embodiments.

[0020] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiment of the application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiment of the application. Obviously, the described embodiment is only It is an embodiment of a part of the application, but not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the scope of protection of this application.

[0021] It should be noted that the terms "first" and "second...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data storage method and device based on big data, a storage medium and a processor. The method comprises the steps: establishing a basic storage database through a distributedcolumn storage database and a distributed retrieval engine, wherein the distributed column storage database is used for storing original data, and the distributed retrieval engine is used for storingindex information of the original data; constructing a data table according to a data storage structure and a data storage format in the basic storage database; dynamically managing the data table ina configuration library mode; and performing data storage based on the data table. According to the method, a basic storage database is established by adopting a distributed column storage database and a distributed retrieval engine, the rapid retrieval of data and large data throughput are achieved, a data table is constructed by using a standard data storage structure and a standard data storage format, then the dynamic management data table is managed in a configuration library mode, and the rapid storage of the data is achieved.

Description

technical field [0001] The present application relates to the field of big data, and in particular, relates to a data storage method, device, storage medium and processor based on big data. Background technique [0002] The existing distributed column storage database (Hbase) and distributed data retrieval engine (ElasticSearch) in the existing big data environment have no restrictions on the data table structure, resulting in the inability to standardize the data storage structure, and the data types generated by automatic identification are not accurate enough, basically The dynamically generated storage table cannot be used. When the two work together, there are multiple copies of the data in the search engine and the database, wasting storage resources. [0003] The above information disclosed in the Background section is only to enhance the understanding of the background of the technology described herein, therefore, the Background may contain certain information which...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22G06F16/27
CPCG06F16/221G06F16/2282G06F16/27Y02D10/00
Inventor 张炎红贠瑞峰刘彬彬彭翔刘粉香贺喆
Owner BEIJING INTERNETWARE LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap