Data storage method, querying method and device

A data storage and data query technology, applied in the database field, can solve the problems of low query performance and occupation of disk resources, and achieve the effect of improving query speed and reducing occupation

Inactive Publication Date: 2011-02-09
TIANJIN NANKAI UNIV GENERAL DATA TECH
View PDF2 Cites 35 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the embodiment of the present application is to provide a data storage method, query method and device to solve the problems in the prior art that data storage and query using the row-storage model occupy disk resources and the query performance is not high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method, querying method and device
  • Data storage method, querying method and device
  • Data storage method, querying method and device

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0065] see figure 1 , is the flow chart of the first embodiment of the data storage method of the present application:

[0066] Step 101: Obtain a source data table.

[0067] Step 102: Split the source data table according to the column structure.

[0068] Step 103: Group each column of data to obtain multiple data packets, and mark knowledge information for each data packet.

[0069] Specifically, the data values ​​of each column of data are acquired sequentially; it is judged whether the number of acquired data values ​​satisfies the preset total count value, and if the preset total count value is met, the acquired data values ​​are generated into a data packet and returned to execute The aforementioned sequence acquires the data value of each column of data; if the preset total count value is not met, then judge whether the data value of the current column data has been acquired, and if so, generate a data packet from the acquired data value, otherwise, return to execute ...

no. 1 example

[0139] see Figure 6 , which is a block diagram of the first embodiment of the data storage device of the present application:

[0140] The data storage device includes: an acquiring unit 610 , a splitting unit 620 , a grouping unit 630 and a saving unit 640 .

[0141] Wherein, the obtaining unit 610 is used to obtain the source data table;

[0142] A splitting unit 620, configured to split the source data table according to the column structure;

[0143] A grouping unit 630, configured to group each column of data, obtain multiple data packets, and mark knowledge information for each of the data packets;

[0144] The saving unit 640 is configured to save the plurality of data packages and the knowledge information of each data package.

no. 2 example

[0145] see Figure 7 , which is a block diagram of the second embodiment of the data storage device of the present application:

[0146] The data storage device includes: an acquisition unit 710 , a split unit 720 , a grouping unit 730 , a compression unit 740 and a storage unit 750 .

[0147] Wherein, the obtaining unit 710 is used to obtain the source data table;

[0148] A splitting unit 720, configured to split the source data table according to the column structure;

[0149] A grouping unit 730, configured to group each column of data to obtain multiple data packets, and mark knowledge information for each of the data packets;

[0150] A compression unit 740, configured to compress the data packet according to a preset compression algorithm according to the type of the data packet;

[0151] The saving unit 750 is configured to save the compressed data packets and the knowledge information of each data packet.

[0152] Specifically, the grouping unit 730 may include ( ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the application discloses a data storage method, a querying method and a device, the data storage method includes the following steps: obtaining a source data table, and splitting the source data table according to a column structure; grouping data of each column to obtain a plurality of data packets, and marking knowledge information for each one of the data packets; storing a plurality of data packets and the knowledge information of each data packet. In the embodiment of the application, the column data is stored with granularity of the data packet, and a local bitmap associated index is built with granularity of the data packet, the data packet is considered as a minimum I/O unit, so disk space can be saved while storing data, and data querying speed is correspondingly improved.

Description

technical field [0001] The present application relates to the technical field of databases, in particular to a data storage method, query method and device. Background technique [0002] A database is a data warehouse that organizes, stores, and manages data according to its data structure. Database-based applications include data storage, analysis, and query. In the prior art, the row-storage model can be used for analytical applications. When the row-storage model is established, the database logically stores information into several data tables, and the data tables are two-dimensional lists, each row of which is a complete piece of data. Called a record or a tuple, each record consists of several attributes, and each attribute is called a field or a column. In order to support the operation of each piece of data, the existing row storage database stores each row of data as the smallest storage unit on the disk, and each smallest storage unit is an I / O (Input / Output, inpu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 武新
Owner TIANJIN NANKAI UNIV GENERAL DATA TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap