Mass data based query method and device

A mass data and query method technology, applied in the field of data query

Inactive Publication Date: 2017-05-17
RUN TECH CO LTD BEIJING
View PDF1 Cites 38 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the embodiments of the present invention is to propose a query method and device based on massive data, aiming t

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mass data based query method and device
  • Mass data based query method and device
  • Mass data based query method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] The embodiments of the present invention will be further described in detail below in conjunction with the drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the embodiments of the present invention, rather than to limit the embodiments of the present invention. In addition, it should be noted that, for the convenience of description, the drawings only show some but not all structures related to the embodiments of the present invention.

[0050] refer to figure 1 , figure 1 It is a schematic flowchart of a massive data-based query method provided by an embodiment of the present invention.

[0051] Such as figure 1 As shown, the query method based on massive data includes:

[0052] Step 101, receiving the SQL input by the user through the system query page;

[0053] Specifically, the user can input Structured Query Language (Structured Query Language, SQL) through the system query page, click the q...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a mass data based query method and device. The mass data based query method includes: receiving an SQL which is input by a user via a system query page; performing logic analysis and physical analysis on the SQL; converting a query field required by user query into a code defined in metadata, and acquiring a query result according to a table, a storage type, and a storage physical surface in the SQL; and gathering the query results, converting the query result into a preset format, and displaying the query results in the query page. A semantic analysis technique based mass data query system can solve the problem that SQL query cannot supported while big data storage techniques such as haoop and solr are used; and a data pre-fetching technique and a Hash query technique are adopted in a system design, the query performance of the mass data query system can be optimized, and the query real-time performance of mass data can be improved.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of data query, in particular to a massive data-based query method and device. Background technique [0002] With the rapid development of information technology, Internet information data is increasing day by day, and there are more and more needs for storing and mining massive data. Massive data analysis technology is also developing rapidly, and some open source massive data processing technologies have been rapidly developed. Development and popularization, such as: HADOOP, SOLR, STORM, SPARK and other big data storage and computing open source frameworks. [0003] At the same time, the current development technicians of enterprises are not familiar with these technologies, and it takes a lot of effort and cost to learn these technologies. How to use traditional SQL and big data technology to query massive data without mastering big data technology is always a difficult problem ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/2453G06F16/2433
Inventor 常志顺
Owner RUN TECH CO LTD BEIJING
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap