Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and equipment for compression and searching of index data

A technology for indexing data and data, which is applied in electrical digital data processing, special data processing applications, instruments, etc., and can solve problems such as reducing the data capacity of index information lists.

Active Publication Date: 2015-05-20
BEIJING OCEANBASE TECH CO LTD
View PDF4 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0012] This application provides a method and device for index data compression and index data search, which are used to solve the problem of how to reduce the data capacity of the index information list on the premise of ensuring the efficiency and accuracy of searching data information

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and equipment for compression and searching of index data
  • Method and equipment for compression and searching of index data
  • Method and equipment for compression and searching of index data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0081] Such as figure 1 As shown in FIG. 1 , it is a schematic flowchart of a method for compressing index data provided in Embodiment 1 of the present application. The methods include:

[0082] Step 101: After obtaining the index information list of a data file, according to the arrangement order of the column index data in the index information list, sequentially compare whether the column index data of the same column in two adjacent rows are the same.

[0083]In step 101, since the amount of data contained in the data file is relatively large, in order to facilitate the search of the data in the data file, the data in the data file is usually stored in a certain order, and the index of the data file is generated according to the storage order of the data database.

[0084] Wherein, the index information base may be in the form of an array, a list, or a tree structure and so on.

[0085] For an index information base in the form of a list, column index data in an index i...

Embodiment 2

[0164] Such as figure 2 As shown, it is a schematic flowchart of an index data search method provided by Embodiment 2 of the present application. Embodiment 2 of the present application is an invention under the same inventive concept as Embodiment 1 of the present application. The methods include:

[0165] Step 201: Receive a search request message.

[0166] Wherein, the search request message includes at least one search keyword and a column label corresponding to the search keyword.

[0167] In step 201, a search request message is received from a user or other device, and the search request message is used to indicate the column label corresponding to the row index data to be searched and the search keyword.

[0168] For example: {4, 10, 30, 2} is carried in the received search request message.

[0169] Among them, the column label corresponding to keyword 4 is 0; the column label corresponding to keyword 10 is 1; the column label corresponding to keyword 30 is 2; the co...

Embodiment 3

[0182] Such as image 3 As shown, it is a schematic structural diagram of an index data compression device provided by Embodiment 3 of this application. Embodiment 3 of this application is an invention under the same inventive concept as Embodiment 1 and Embodiment 2 of this application. The device includes: a comparison module 11, a compression module 12 and an index array generation module 13, wherein:

[0183] The comparison module 11 is used to compare whether the column index data of the same column in two adjacent rows are the same according to the arrangement order of the column index data in the index information list after obtaining the index information list of a data file;

[0184] The compression module 12 is used to compress the same column index data when the column index data of the same column in two adjacent rows are the same; when the column index data of the same column in the two adjacent rows are not the same, record the The column index data of the same ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and equipment for compression and searching of index data. The method includes the steps that after an index information list is obtained, whether the column index data in every two adjacent lines and in the same column are the same is sequentially compared according to the sequence of column index data in the index information list; when the column index data in every two adjacent lines and in the same column are the same, the same column index data are compressed; when the column index data in every two adjacent lines and in the same column are different, the column index data with different comparison results in the every two adjacent lines and in the same column and corresponding position information are recorded, and the column index data in every two adjacent lines and in other columns after the same column where the column index data with different comparison results are located are compressed; after the column index data of each line in the index information list are compressed, an index array for the index information list is generated according to the compressed column index data, the memory capacity of the index array is reduced, the data amount is small, and the searching efficiency of the column index data is guaranteed.

Description

technical field [0001] The present application relates to the field of data information processing, in particular to a method and device for index data compression and index data search. Background technique [0002] With the continuous development of Internet technology and computer technology, the amount of information contained in a data file is increasing, resulting in an increase in the storage capacity stored in the database. [0003] In order to facilitate the search of data information in a data file, the data stored in each data file will be stored in a set storage order. In addition, when the amount of data in the data file reaches 1TB, the data in the data file is usually divided into data blocks of the same size, and a primary key index is determined for each data block obtained by dividing (for example, the last A row of data information is used as the index information of the data block), and finally the determined primary key index of each data block is combi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/583
Inventor 黄贵乘羽阳振坤
Owner BEIJING OCEANBASE TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products