Method and system for implementing data query
A data query and data technology, applied in the field of data processing, can solve the problems of not reflecting the operation efficiency well, affecting the query efficiency, and unable to meet the requirements of big data processing, etc., and achieve the effect of improving query efficiency, query speed, and fast search
Active Publication Date: 2015-11-04
深圳市东方博雅科技有限公司
View PDF5 Cites 12 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0002] With the continuous growth of data volume and data value, traditional data warehouse technology has encountered huge obstacles in various aspects and cannot meet the needs of big data processing
[0003] Hive is currently the most commonly used open source framework for building data warehouses and processing massive data in Internet companies. However, because data storage is not optimized, it cannot reflect its operating efficiency well in many scenarios, especially Greatly affected the later query efficiency
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0053] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.
[0054] Unless the context clearly states otherwise, the number of elements and components in the present invention can exist in a single form or in multiple forms, and the present invention is not limited thereto. Although the steps in the present invention are arranged with labels, they are not used to limit the order of the steps. Unless the order of the steps is clearly stated or the execution of a certain step requires other steps as a basis, the relative order of the steps can be adjusted. It can be understood that the term "and / or" used herein refers to and covers any and all possible combina...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The present invention provides a method and system for implementing data query. The method for implementing data query comprises the following steps of: acquiring a query request; positioning a bucket corresponding to the query request in a data file partition based on Hive and a column in the bucket; and reading data corresponding to the column in the positioned bucket. The system comprises: a request acquisition module, used for acquiring a query request; a positioning module, used for positioning the bucket corresponding to the query request in the data file partition based on the Hive and the column in the bucket; and a reading module, used for reading the data corresponding to the column in the positioned bucket. By adopting the method and system for implementing the data query, the query efficiency of the data can be improved.
Description
technical field [0001] The invention relates to data processing technology, in particular to a method and system for realizing data query. Background technique [0002] With the continuous growth of data volume and data value, traditional data warehouse technology has encountered huge obstacles in various aspects and cannot meet the needs of big data processing. [0003] Hive is currently the most commonly used open source framework for building data warehouses and processing massive data in Internet companies. However, because data storage is not optimized, it cannot reflect its operating efficiency well in many scenarios, especially It greatly affects the later query efficiency. Contents of the invention [0004] Based on this, it is necessary to provide a method for realizing data query that can improve query efficiency. [0005] In addition, it is also necessary to provide a system for realizing data query that can improve query efficiency. [0006] A method for rea...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 郑壮杰
Owner 深圳市东方博雅科技有限公司