Supercharge Your Innovation With Domain-Expert AI Agents!

Increment-distributed index system and method

An index system, distributed technology, applied in special data processing applications, instruments, electrical digital data processing, etc., to achieve the effect of improving the effect

Inactive Publication Date: 2017-05-31
百融云创科技股份有限公司
View PDF7 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In view of the obvious defects in Lucene and HBase solutions in the prior art, the purpose of the embodiments of the present invention is to provide an effective and efficient incremental distributed indexing system and method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Increment-distributed index system and method
  • Increment-distributed index system and method
  • Increment-distributed index system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] In order to make the technical problems, technical solutions and advantages to be solved by the present invention clearer, the following will describe in detail with reference to the drawings and specific embodiments.

[0045] For databases with large data volumes, complex query conditions, and incremental data updates, the existing Lucene and HBase solutions cannot well meet the needs. The embodiment of the present invention adopts the HBase+secondary index+sql solution.

[0046] The embodiment of the present invention proposes an incremental distributed indexing method, including:

[0047]Step 1. Obtain the data stored in the HBase database, as well as the primary index value and attribute value of each data; for each data, generate a secondary index Key by the following method;

[0048] {Start Key value}_{Original property value}_{Original Key value};

[0049] The starting Key value is the starting value of all data first-level index values; the original attribute v...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

An embodiment of the invention provides an increment-distributed index system and method. The method includes: acquiring data stored in an HBase database and primary index value and attribute value of each datum; generating a secondary index Key for each datum; generating a secondary index table according to the secondary index Key of each datum to retrieve the secondary index table in a section dividing manner during inquiring, wherein section dividing is performed according to secondary index Key values.

Description

technical field [0001] The invention belongs to the technical field of computer software, in particular to an incremental distributed indexing system and method. Background technique [0002] With the development of society, the data increases exponentially, and a lot of useful information can be obtained by analyzing massive data, so the data mining technology for massive data has become a recent hot technology. In order to query data that meets the conditions faster under the condition of big data, the current common method is to preprocess the data and create an index for the data, and query according to the index when querying. [0003] An index is a logical list that links a set of one or several column values ​​in a table and corresponding data pages that physically identify these values ​​in the table. When indexing a value, you search the index to find the specific value, then follow the pointer to the row that contains that value. Assuming that in such figure 1 I...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 张韶峰陈浪仙陈贺巍邹迎春
Owner 百融云创科技股份有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com