Interactive large data analysis query processing method

A processing method and technology of big data, applied in the fields of electronic digital data processing, special data processing applications, instruments, etc., can solve the problems of non-interactive query mode, unusable database, slow data query process, etc., and achieve high query efficiency. Effect

Inactive Publication Date: 2016-01-27
陕西艾特智慧信息技术有限公司
View PDF3 Cites 93 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In the case of fixed conditions such as server hardware and database configuration, the query efficiency of traditional query methods will continue to decrease as the amount of data increases, the response time of user queries will become slower and slowe

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Interactive large data analysis query processing method
  • Interactive large data analysis query processing method
  • Interactive large data analysis query processing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The present invention will be described in detail below with reference to the accompanying drawings; the following detailed description of the present invention does not limit the present invention; on the contrary, the scope of the present invention is determined by the appended claims.

[0032] The present invention is an interactive big data analysis query processing method, its core architecture diagram is as follows figure 1 shown.

[0033] The core architecture of the present invention includes RPC terminal, SQL parser, optimizer, execution engine, storage engine interface, distributed cache and other modules.

[0034] RPC terminal: The RPC terminal or remote access module is implemented through the RPC communication protocol; it is used for the client to interact with the system; before submitting a query request, the client can directly communicate with a specific node or discover available nodes through Zookeeper; usually The client is used to maintain complex...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an interactive large data analysis query processing method. The interactive large data analysis query processing method comprises steps that, 1), a query request generated by a user or a machine is submitted to an SQL query analyzer; 2), the query quest is analyzed by the SQL query analyzer into a logic plan; 3), the logic plan is read by an optimizer and is converted into a physical plan, and interaction between a storage engine and a specific data source is realized; and 4), the physical plan is performed by a performing engine, and meta-data information is provided based on a meta-database query performing framework. For real-time interactive large data set analysis blank, P-byte data is processed under the condition of low delay response through the method according to design, multiple functions of other SQL-on-Hadoop engines are integrated, the query speed is greatly improved, and thereby Hadoop data query and enterprise-level large data analysis can be rapidly and efficiently carried out for enterprise users.

Description

technical field [0001] The invention relates to the technical field of big data information retrieval, in particular to an interactive big data analysis query processing method. Background technique [0002] Big data refers to data sets that cannot be acquired, managed and processed within a certain period of time using traditional and commonly used software technologies or tools; now the focus of the term "big data" not only represents the definition of data scale, but also represents It marks the entry of information technology into a new era, represents the technical challenges and difficulties brought by explosive data information to traditional computing technology and information technology, represents the new technologies and methods required for big data processing, and also represents the big data analysis and New inventions, new services and new development opportunities brought about by applications. [0003] With the rapid development and popularization of compu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/2438G06F16/24542G06F16/2471
Inventor 朱志祥肖跃雷张振李聪颖
Owner 陕西艾特智慧信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap