Method, device and system for establishing column storage indexes

A column storage and indexing technology, which is applied in the field of computer data processing, can solve the problems of high dynamic data update frequency, long update cycle of the full-text index update process, and system resource consumption, so as to shorten the update cycle, reduce consumption, and reduce system resources. Effect

Active Publication Date: 2014-03-12
北京趣拿信息技术有限公司
View PDF4 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0011] Aiming at the problem in the related art that due to the high frequency of dynamic data update, the update process of the full-text index has a long update cycle and consumes a lot of system resources, no effective solution has been proposed so far. Therefore, the main purpose of the present invention is to provide a construction Method, device and system for column storage index, so as to solve the above problems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, device and system for establishing column storage indexes
  • Method, device and system for establishing column storage indexes
  • Method, device and system for establishing column storage indexes

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 2

[0074] Before describing further details of various embodiments of the invention, reference will be made to image 3 A suitable computing architecture that can be used to implement the principles of the invention is described. In the following description, unless indicated otherwise, embodiments of the invention are described with reference to acts and symbolic representations of operations that are performed by one or more computers. It will thus be appreciated that such acts and operations, which are sometimes referred to as computer-implemented, include the manipulation of electrical signals representing data in a structured form by the processing unit of a computer. This manipulation transforms the data or maintains it at a location in the computer's memory system, which reconfigures or changes the operation of the computer in a manner well understood by those skilled in the art. A data structure that maintains data is a physical location in memory that has specific pr...

Embodiment 3

[0103] Figure 4 is a schematic structural diagram of an apparatus for constructing a column store index according to an embodiment of the present invention. Such as Figure 4 As shown, the apparatus for constructing a column store index includes: an obtaining module 102 , a creating module 104 and a saving module 106 .

[0104] Among them, the acquisition module 102 is used to acquire the document with immediate effect, and the document with immediate effect includes: identification data and dynamic data associated with the identification data; the creation module 104 is used to create a column-stored index structure document in memory according to the document with immediate effect , generate a columnar index file, the columnar index file includes an identification column and a data storage column, wherein the identification column is used to store identification data, and the data storage column is used to store dynamic data associated with the identification data; t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method, a device and a system for establishing column storage indexes. The method comprises the steps of obtaining immediately effective files which comprise identification data and dynamic data associated with the identification data, creating files with a column storage index structure in a memory according to the immediately effective files, and generating columnar index files which comprise identification columns and data storage columns, and saving the columnar index files in the memory, wherein the identification columns are used for saving the identification data, and the data storage columns are used for saving the dynamic data associated with the identification data. When the dynamic data is changed, updated dynamic data is updated to the columnar index files in the memory. By adopting the method, the device and the system, the update period of the dynamic data can be shortened, and consumed system resources can be reduced.

Description

technical field [0001] The present invention relates to the field of computer data processing, in particular to a method, device and system for constructing column storage indexes. Background technique [0002] At present, the data update in the search engine provided by the prior art is a row-type update index, which is used to represent the update of a field index of a document, and the entire document needs to be updated, not just a certain field to update. In the process of updating the index using the row method, the entire document needs to be parsed. Therefore, the process of updating the index requires a long update cycle, and when updating the index, disk IO and CPU bandwidth will become the bottleneck of the system. [0003] In the process of using the row-based update function to complete the daily full-text index update function in the system, there are usually some data with short field effects, but high update frequency and large update volume, which can be ca...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/31
Inventor 朱翔李理李庚何伟平
Owner 北京趣拿信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap