Data storage method, apparatus and system

A technology of data storage and storage mode, applied in the Internet field, can solve the problems of the overall performance of the database and the slow query speed.

Active Publication Date: 2017-08-25
BEIJING XIAODU INFORMATION TECH CO LTD
View PDF8 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For the business side using the database, the ideal way is to maintain a data table, which does not affect the business logic, but as time goes by and the amount

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method, apparatus and system
  • Data storage method, apparatus and system
  • Data storage method, apparatus and system

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0135] Further, such as Figure 1d As shown, an implementation manner of step 14 includes:

[0136] 141. Export at least one data record segment from the to-be-processed data table to at least one file.

[0137] 142. Import data record segments in at least one file into corresponding storage nodes that support columnar storage.

[0138] 143. In at least one storage node that supports a columnar storage mode, store corresponding data record segments in columns.

[0139] In the above steps 141-143, considering that the data record dump process spans storage nodes, the data record segment to be dumped is first exported to an external file, and then imported from the external file to the corresponding supporting columnar storage In the storage node.

[0140] Wherein, the data record segment divided in step 13 can be exported to at least one file. For example, the data record segments divided in step 13 can be exported to the same file, or the data record segments divided in step 13 can be...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Embodiments of the present application provide a data storage method, apparatus and system. The data storage method comprises: obtaining a to-be-processed data table from a storage node that supports a row storage mode, wherein the to-be-processed data table contains at least one data record stored in the row storage mode; selecting a to-be-dumped data record from the at least one data record; and in a column storage mode, dumping the to-be-dumped data record to the at least one storage node that supports the column storage mode. According to the technical scheme provided by the embodiments of the present application, combination of the row storage mode and the column storage mode can be realized, so that on one hand, the advantages that the row storage supports the high concurrent query are made full use to ensure the query efficiency of the non-dumped data, and on the other hand, complicated query on the dumped data is facilitated based on the column storage to ensure the query efficiency of the dumped data.

Description

Technical field [0001] This application relates to the field of Internet technology, and in particular to a data storage method, device and system. Background technique [0002] Relational databases are stored in record units, and are generally used to store transactional data. For the business side using the database, the ideal way is to maintain a data table, which does not affect the business logic, but as time goes by and the amount of data grows, the data table will become larger and larger, resulting in increasing query speed Slow, the overall performance of the database will gradually decline. [0003] The prior art solves the above-mentioned problems by adopting a partition table or a sub-database sub-table method. A commonly used method of sub-database sub-table: use time or primary key as the basis for sub-table, divide the data table into multiple data tables, and each data table stores part of the data. In this way, the data query efficiency of the thermal data table...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/2282G06F16/2471G06F16/27
Inventor 曾春罗哲杜洪先
Owner BEIJING XIAODU INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap