Data mining based massive data query system

A technology of data mining and mass data, applied in the field of query system, can solve the problems of not being able to process mass data efficiently, increasing costs, increasing hardware costs, etc., to achieve the effect of enhancing the convenience of use, simplifying the query method, and improving the query speed

Inactive Publication Date: 2017-01-04
CHENGDU CALABAR INFORMATION TECH
View PDF7 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The above strategies to solve the efficiency of massive data processing often require huge capital investment, either increasing the cost of hardware, or commissioning the developer's own quality, all of which need to increase costs, and cannot fundamentally solve the problem of processing efficiency of massive data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data mining based massive data query system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0021] like figure 1 As shown, the present invention is based on the massive data query system of data mining technology, and the massive data query system based on data mining technology includes:

[0022] Data collection module: collect data from various data sources to the data processing center, and perform preliminary processing on the collected data, that is, format inspection and standardization;

[0023] Data processing module: perform decoding and format conversion on the preliminarily processed data collected in the data acquisition module, generate standard format data products, set quality control codes for each data, and generate standard formats with quality control codes Data products; select, integrate and statistically process some real-time and non-real-time massive data to generate processed data;

[0024] Data storage management module: store and manage the data processed by the data processing module;

[0025] Data mining module: including data source in...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data mining based massive data query system. The system comprises a data acquisition module, a data processing module, a data storage management module, a data mining module, a data service module and a data monitoring module. The data acquisition module is used for acquiring data to a data processing center from various data sources; the data processing module is used for decoding and format conversion of preliminarily processed data acquired by the data acquisition module; the data storage management module is used for storage management of data processed by the data processing module; the data mining module comprises a data source integration submodule, an associated word storage submodule, a mining submodule, an output submodule and a feedback submodule; the data service module is used for realizing interaction between the data stored in the data storage management module and users in various ways to meet data access demands of the users. The data mining based massive data query system has advantages of increase of massive data query speed, simplification of query ways, reduction of query cost and improvement of convenience in use of massive data.

Description

technical field [0001] The invention relates to a query system, in particular to a massive data query system based on data mining technology. Background technique [0002] With the rapid development of computer and network technology, the growth of information volume far exceeds the growth of people's ability to obtain information. The orderly storage and utilization of massive information resources has attracted more and more attention from all over the world. In the real world, in the field of mobile e-commerce, there is often a demand for querying, displaying and browsing transactions of massive data. However, in the face of massive data, the first thing we need to consider is how to improve the operational performance and processing efficiency of massive data. At present, the main measures taken by people to process massive data include: selecting excellent database tools, optimizing query statements, increasing virtual memory, partitioning data, establishing extensive...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/21G06F16/215G06F16/22G06F16/2465G06F16/254G06F2216/03
Inventor 朱焰冰
Owner CHENGDU CALABAR INFORMATION TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap