Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Full-text database architecture, bitmap index creation method, data query method, server and medium

A database and index technology, applied in the field of big data retrieval, can solve problems such as in the collection (may be wrong, not in the collection (absolutely not in the collection), etc., to improve the efficiency of data loading

Active Publication Date: 2017-12-19
INST OF INFORMATION ENG CAS
View PDF4 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0017] BloomFilter is an efficient random data structure, which is generated on the basis of bitmap, and is used to detect whether an element is an element in a collection. This detection will only misjudge the data in the collection, and No misjudgment will be made for data that is not in the collection, so that each detection request returns two situations: "in the collection (may be wrong)" and "not in the collection (absolutely not in the collection)", that is, if it judges that the element is not in In the collection, this element must not be an element in the collection. If it is judged that the element is in the collection, there may be a certain error rate

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Full-text database architecture, bitmap index creation method, data query method, server and medium
  • Full-text database architecture, bitmap index creation method, data query method, server and medium
  • Full-text database architecture, bitmap index creation method, data query method, server and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] In order to be able to understand the technical means of the present invention more clearly, it can be implemented according to the contents of the description, and in order to make the above-mentioned and other purposes, features and advantages of the present invention more obvious and understandable, the following special examples of preferred implementation are given together with Accompanying drawing, detailed description is as follows.

[0057] The invention realizes creation and reading of a bitmap index in a full-text database, and relates to a metadata module, a data loading module, an index creation module and a query module.

[0058] figure 1 A full-text database architecture diagram is given, such as figure 1 As shown, it mainly includes the following core modules:

[0059] (1) Metadata module, which records metadata information such as tables, fields, and indexes of the database.

[0060] (2) Load the module, extract information from the original data acc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a full-text database architecture, a bitmap index creating method, a data query method, a server and a medium. The full-text database architecture of the invention comprises: a data module, which is used for recording database table names of a full-text database and index field information thereof; a storage module, which includes a plurality of independent data blocks, and used for storing data and index information of database tables; a loading module, which is used for loading the data of all the database tables into the data blocks according to the index information in the metadata module, and when one of the data blocks is written fully, marking the data block as a steady state; an index creation module, which is used for generating an index of the data block marked as the steady state; and a query module, which is used for carrying out searching in the metadata module according to a query statement, searching indexes of all the data blocks if a matching index field is found, and then determining, according to the index of the data block, whether the data block meets query conditions. The architecture greatly increases the query speed and database throughput.

Description

technical field [0001] The invention relates to a full-text database architecture and its bitmap index creation method, data query method, server and medium, in particular to a lucene-based full-text index system, which adopts metadata unified identification, uses bitmap indexes to improve data filtering efficiency, and improves Query speed, the key technology to improve database throughput, belongs to the field of big data retrieval. Background technique [0002] Database technology was born in the late 1960s and early 1970s. Its main purpose is to effectively manage and access large amounts of data resources. Database technology mainly studies how to store, use and manage data. Over the past few years, the data stored in the database has grown from GB to TB. In the near future, the data that many enterprises will store will reach the PB level. The amount of data is getting larger and larger, requiring a larger database for support. With the growth of data volume, simple...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/2237G06F16/2452G06F16/2453
Inventor 李斌斌王振宇丁煜
Owner INST OF INFORMATION ENG CAS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products