Secondary index establishment method and device

A secondary index and establishment method technology, applied in the database field, can solve the problem of low support capacity of large-scale data, and achieve the effect of avoiding data inconsistency, avoiding inefficiency, and having a wide range of applications

Active Publication Date: 2015-08-12
BEIJING QIYI CENTURY SCI & TECH CO LTD
View PDF5 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the above method of establishing a secondary index has low support for large-scale data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Secondary index establishment method and device
  • Secondary index establishment method and device
  • Secondary index establishment method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] In order to make the above objectives, features and advantages of the present invention more obvious and understandable, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0050] Reference figure 1 , Shows a step flow chart of an embodiment of a method for establishing a secondary index of the present invention, which may specifically include the following steps:

[0051] Step 101: Index initialization includes: scanning the entire table of the database, and establishing an index for each row of data.

[0052] In the embodiment of the present invention, the secondary index establishment device can be set independently or in a search server, such as an elasticsearch server. The device can interact with a database that establishes a secondary index.

[0053] Taking the HBase database as an example, when establishing the Hbase secondary index, the index is initialized first, that is, the entire HB...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a secondary index establishment method and device. The secondary index establishment method comprises the following steps: carrying out index initialization: scanning a full table of a database, and establishing an index for each line of data; scanning a flag bit of line data in the database, wherein the flag bit is used for marking the change situation of the corresponding line data of the flag bit; and according to the flag bit of the line data, processing the index of the data. The embodiment of the invention establishes a secondary index for each piece of line data in the database, especially, elasticsearch and the flag bit are used, the secondary index of Hbase is realized on the premise that HBase performance is not affected and ah HBase kernel is not revised, and the support of large-scale data is realized.

Description

Technical field [0001] The invention relates to the technical field of databases, in particular to a method for establishing a secondary index and a device for establishing a secondary index. Background technique [0002] HBase is a distributed, column-oriented open source database. HBase is very efficient in finding data based on rowkey, but searching for eligible rows based on column content generally uses a full table scan, which is very inefficient. Therefore, it is necessary to establish a secondary index for HBase to speed up the search. [0003] An existing method for establishing a secondary index on HBase is to implement an index on the client. The method for establishing an index includes using open source tools such as solr / nutch / lucene, or creating an index table in HBase. The establishment and use of the index in this method is accompanied by the client creating the index and writing the actual data. When data is updated in HBase, such as inserting new data into HBas...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 王亚洲李雄锋谭建南王天兴郑程
Owner BEIJING QIYI CENTURY SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap