Real-time query method and system of cluster data

A query method and query system technology, applied in the field of cluster data real-time query method and system, can solve problems such as not being able to meet the real-time query requirements of cluster data, increasing data query time, and low-efficiency platform users are difficult to respond quickly and in a timely manner , to achieve the effect of ensuring integrity and security, improving efficiency, and realizing real-time query

Active Publication Date: 2017-01-04
BEIJING VRV SOFTWARE CO LTD
View PDF5 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the era of big data, the amount of data has shown a T-level growth, which meets people's needs for various data; but on the other hand, the dramatic increase in the amount of data has led to an increase in data query time. Traditional data query methods It can no longer meet people's real-time query requirements for cluster data, and the low-efficiency data query method makes it difficult for platform users to make quick and timely responses based on real-time and effective platform data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time query method and system of cluster data
  • Real-time query method and system of cluster data
  • Real-time query method and system of cluster data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only It is a part of embodiments of the present invention, but not all embodiments. Accordingly, the following detailed description of the embodiments of the invention provided in the accompanying drawings is not intended to limit the scope of the claimed invention, but merely represents selected embodiments of the invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making creative efforts belong to the protection scope of the present invention.

[0044] The current query methods for cluster data cannot meet people's needs for real-time query of clu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a real-time query method and system of cluster data. The real-time query method and system of the cluster data comprises the following steps: acquiring a query request of a client side, wherein the query request carries address content of the query data; sending the query request to an Hbase database interface of a Hadoop cluster data platform and reading the query data; writing the query data into a temporary file, wherein the temporary file is located in caches of a query server; sending the temporary file to the client side. According to the embodiment of the invention, through the setting of the caches, the database query times and the data transmission speed with the client side are reduced, so that the query time of the cluster data is changed from the minute level to the second level, and the real-time query of the cluster data is realized.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a method and system for real-time query of cluster data. Background technique [0002] With the popularization of large-scale Internet applications and the massive increase of network information data, big data has quietly had a huge impact on all aspects of people's lives. Hadoop has gradually become the main platform for massive data collection, storage and analysis in various industries due to its low cost, stability and versatility; HBase is a distributed, column-oriented open source database that uses Hadoop HDFS as its file storage system. [0003] In the era of big data, the amount of data has shown a T-level growth, which meets people's needs for various data; but on the other hand, the dramatic increase in the amount of data has led to an increase in data query time. Traditional data query methods It can no longer meet people's real-time query requirements for c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/245G06F16/27
Inventor 孙肇华高洪涛蒙进财唐兵兵白志凌
Owner BEIJING VRV SOFTWARE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap