Network transmission data retrieval system based on ElasticSearch and Hbase technologies

A network transmission and data retrieval technology, applied in the field of network data analysis, can solve the problems of inability to quickly retrieve metadata and binary message data, reduce the efficiency of system query and retrieval, etc., and achieve the effect of fast and efficient retrieval

Inactive Publication Date: 2019-05-21
SPACE STAR TECH CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The problem to be solved by the invention is: the current data transmission system cannot combine ElasticSearch and Hbase technology, cannot perform fast retrieval of metadata and binary message data, and reduces the query and retrieval efficiency of the system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Network transmission data retrieval system based on ElasticSearch and Hbase technologies
  • Network transmission data retrieval system based on ElasticSearch and Hbase technologies
  • Network transmission data retrieval system based on ElasticSearch and Hbase technologies

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] Hereinafter, the present invention will be described in detail based on the drawings.

[0026] Such as figure 1 As shown, the present invention has designed a network transmission data retrieval system based on ElasticSearch and Hbase technology, mainly including a data storage module and a data query module, wherein the data storage module: this module provides data storage support for the network data retrieval system, and is a network data retrieval system. The basis of the network through which the processed network data is stored in the database. The data query module mainly includes: metadata query unit, binary message data query unit, metadata and binary message data query unit, query task management unit, which provides a Rest interface for querying ElasticSearch and Hbase data. It can reach 200 million pieces of data and return query results within 3 seconds. This module provides an entry for data retrieval, and can satisfy queries with different combinations ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a network transmission data retrieval system based on ElasticSearch and Hbase technologies. The system comprises a data storage module used for storing metadata and binary message data into ElasticSearch and Hbase databases; a data query module comprising a metadata query unit which is used for acquiring metadata of the network data from the ElasticSearch storage library; abinary message data query unit used for storing the obtained binary message data into a result table of the Hbase database according to an input query condition; a metadata and binary message data query unit used for storing the obtained binary message data into a result table of the Hbase database according to an input query condition; meanwhile, obtaining metadata of the network data, combiningthe metadata and returning the combined metadata to an external system; and a query task management unit used for displaying the list and ending the process operation. According to the method, quick retrieval of metadata and binary message data can be met, and related data concerned by a user can be accurately and quickly extracted from mass network data.

Description

technical field [0001] The invention belongs to the technical field of network data analysis, and relates to a network transmission data retrieval system based on ElasticSearch and Hbase technology. Background technique [0002] With the continuous integration of technologies such as the Internet of Things, social networks, and cloud computing into our lives and the rapid development of existing computing power, storage space, and network bandwidth, the network data accumulated by humans has become increasingly popular in many fields such as the Internet, communications, finance, commerce, and medical care. constantly growing and accumulating. [0003] However, with the rapid development of information technology, massive network data information makes it difficult for people to quickly and accurately retrieve the relevant information they need. [0004] However, the current data transmission system cannot combine ElasticSearch and Hbase technologies, which makes it impossi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2458G06F16/25G06F16/953
Inventor 邱祥吉王永程夏延钊刘明明杨家红龚虹瑞
Owner SPACE STAR TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap