Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Method and device for creating sparse indexes, sparse index and query method and device

A technology of sparse index and establishment method, applied in the field of data processing, can solve the problems of complex and slow establishment of sparse index, and achieve the effect of speeding up establishment.

Inactive Publication Date: 2013-05-08
CHINA MOBILE COMM GRP CO LTD
View PDF2 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] However, the above method has certain problems in practical application, that is, since each data record needs to be sorted before subsequent processing, and the sorting process is very complicated to implement, it will lead to a very slow establishment of the sparse index. slow

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for creating sparse indexes, sparse index and query method and device
  • Method and device for creating sparse indexes, sparse index and query method and device
  • Method and device for creating sparse indexes, sparse index and query method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] Aiming at the problems existing in the prior art, the present invention proposes an improved sparse index establishment scheme, which does not need to sort the data records to be processed, thereby speeding up the establishment speed of the sparse index.

[0038] In order to make the technical solution of the present invention clearer and clearer, the solution of the present invention will be further described in detail below with reference to the accompanying drawings and examples.

[0039] figure 2 It is a flowchart of an embodiment of a method for establishing a sparse index in the present invention. Such as figure 2 shown, including the following steps:

[0040] Step 21: For each data record to be processed, use the same hash function to calculate the hash value of its key value, and save the data record to the corresponding partition according to the calculated hash value, and save it to the same partition Data records in have the same hash value.

[0041] Ge...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and a device for creating sparse indexes. For data records to be processed, a same hash function is used for calculating hashed values of key values, the data records are saved into corresponding subareas according to the calculated hashed values, and the data records saved into the same subarea have same hashed values; for any subarea, in the initial phase, the content in the subarea is empty, the saved data records are used for forming a file block when the saved data records reach preset requirements, and the data records not forming the file block are used for forming another file block when the saved data blocks not forming the file block reach preset requirements again, and so on; and an index entry is created for every formed file block. According to the method and the device, the creating speed of sparse indexes can be fastened. The invention discloses a sparse index and a query method and device based on the sparse index simultaneously.

Description

technical field [0001] The invention relates to data processing technology, in particular to a sparse index establishment method and device, a sparse index, and a query method and device based on the sparse index. Background technique [0002] When data is loaded, in order to facilitate subsequent queries, an index is usually established for the data records, and the index may be a dense index or a sparse index. [0003] Among them, the dense index needs to establish an index item for each data record, while the sparse index only needs to establish an index item for each group, and each group includes several data records. [0004] In the prior art, the sparse index is usually established in the following manner: sort the data records to be processed, that is, the data records to be loaded, according to certain rules, such as the order of key values ​​from small to large; Records are segmented to obtain several groups; for each group, an index item is established, each inde...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 周大钱岭郭磊涛齐骥
Owner CHINA MOBILE COMM GRP CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com