Unlock instant, AI-driven research and patent intelligence for your innovation.

Mass data index building system and method

A technology for data indexing and building methods, applied in file systems, other database indexes, other database retrievals, etc. Problems such as indexing multiple data at the same time

Active Publication Date: 2017-01-25
BEIJING HUACAI REASONABLE ACCOUNT CONSULTANTS
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, with traditional indexing methods, it is impossible to start multiple indexing programs to simultaneously create indexes for multiple records, and it is impossible to flexibly arrange the priority of indexing, and it is also impossible to dynamically adjust indexing according to the available computing resources of the current computer system speed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mass data index building system and method
  • Mass data index building system and method
  • Mass data index building system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] Such as figure 1 As shown, it is a structure diagram of a preferred embodiment of the massive data index building system 10 of the present invention. In this embodiment, the data index building system 10 is installed and run in the computing device 100, which can monitor multiple index building processes at the same time, flexibly arrange the priority of index building, and can also be based on the available calculations of the current system. The number of resources to dynamically adjust the speed of building data index. In this embodiment, the computing device 100 further includes, but not limited to, a storage device 11 and a processor 12 . The computing device 100 may be a personal computer or a server.

[0022] The storage device 11 can be a disk or a network storage device, which is used to store data list pools, data queues and massive data. The data list pool includes multiple data lists, refer to image 3 The data lists List0, List1, List2, ..., ListN are s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a massive source index building system and method. The system is installed and operates in a calculation device comprising storage equipment and comprises a source distribution module, an index building module, a priority processing module and an index merging module. The source distribution module is used for acquiring source lists from a source list pool, building a plurality of source queues in the storage equipment and distributing the source lists to the source queues. The index building module is used for building a source sub-index corresponding to source lists in each source queue and removing the source lists from the corresponding source queue. The priority processing module is used for transferring the source list with the highest priority to the source queue to be processed in a prior mode when the source lists need processing in a prior mode. The index merging module is used for merging the source sub-indexes to form a source root index of the source list pool. By adopting the massive source index building system and method, a plurality of index building processes can be monitored simultaneously, the priority of building the indexes can be arranged, and the index building speed can be dynamically adjusted according to the number of available computing resources of the current system.

Description

technical field [0001] The present invention relates to a data index management system and method, in particular to a massive data index establishment system and method. Background technique [0002] In the process of data processing, building data index is a common management data requirement. When the data has a considerable scale of massive data, how to build an index for the massive data is a relatively difficult topic. However, using the traditional indexing method, it is impossible to start multiple indexing programs to simultaneously create indexes for multiple records, and it is impossible to flexibly arrange the priority of indexing, and it is also impossible to dynamically adjust the indexing according to the available computing resources of the current computer system speed. Contents of the invention [0003] In view of the above, it is necessary to provide a massive data indexing system and method, which can monitor multiple indexing processes at the same tim...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
CPCG06F16/10G06F16/2228G06F16/316G06F16/901
Inventor 王久立潘瑜青张煦曹麒
Owner BEIJING HUACAI REASONABLE ACCOUNT CONSULTANTS