Intelligent index establishing, inquiring and maintaining method supporting mass data classification and counting

A massive data, grouping technology, applied in the field of big data processing, can solve problems such as occupation and statistical efficiency difficult to meet business needs, achieve broad application prospects, reduce disk I/O and computing time, strong practicability and application scope Effect

Active Publication Date: 2016-06-01
BEIJING SCISTOR TECH
View PDF4 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The main feature of these methods is to scan the entire data involved, which will greatly occupy system resources, especially I / O, which will put a huge pressure on the entire storage system, and its statistical efficiency is difficult to meet business needs.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent index establishing, inquiring and maintaining method supporting mass data classification and counting
  • Intelligent index establishing, inquiring and maintaining method supporting mass data classification and counting
  • Intelligent index establishing, inquiring and maintaining method supporting mass data classification and counting

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] In order to make the purpose, technical solution and advantages of the present invention clearer, the hierarchical and segmented backup data organization and management method according to an embodiment of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0020] The intelligent index construction, query and maintenance method supporting massive data grouping statistics of the present invention includes four implementation aspects: (1) establishing the data organization structure of the intelligent index supporting massive data grouping statistics; (2) intelligent index creation operation; 3) The operation of grouping statistics by using the intelligent index; (4) Realizing the delete operation of the intelligent index. Through the method of the invention, the disk I / O and system computing resources during statistics can be effectively reduced, and the efficiency of group statistics of large data can be improv...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an intelligent index establishing, inquiring and maintaining method supporting mass data classification and counting, and belongs to the technical field of big data processing. The method includes the step of establishing a data organization structure of intelligent indexes to make the intelligent indexes support mass data classification and counting, wherein the data organization structure of the intelligent indexes includes index metadata and index data, the index metadata is the basis for establishing the indexes and include classification column clusters and counting column clusters, and the index data is indexes for establishing original data. By means of the method, when data is written in, the intelligent indexes are established in real time in a memory, classification and counting are conducted through the intelligent indexes, and the intelligent indexes can be rapidly deleted. The indexes are automatically established for mass data in real time; when mass data is classified and counted, the I/O and calculating time of a magnetic disk is greatly shortened, and therefore classification and counting efficiency is improved greatly, and the full life cycle of index data is automatically managed.

Description

technical field [0001] The invention relates to an intelligent index construction, query and maintenance method supporting mass data group statistics, and belongs to the technical field of big data processing. Background technique [0002] With the continuous development of computer technology and the continuous improvement of informatization, the amount of data has grown rapidly, and the storage and application of massive data has also flourished, and the application of big data has become more and more extensive. For example, in terms of network security, big data technology is used to analyze network attack behavior; in e-commerce, big data technology is used to analyze user shopping preferences or the most popular products; in urban construction, big data technology is used to build smart cities, which is convenient People travel. And so on, big data technology has played a positive role in promoting the construction of a conservation-oriented society and improving prod...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/21G06F16/2228G06F16/245
Inventor 李斌斌周游
Owner BEIJING SCISTOR TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap