Aggregating sorting TopK inquiry processing method and system

A processing method and centralized processing technology, applied in the network field, can solve problems such as low query efficiency and inability to solve aggregation sorting queries, and achieve the effects of good distributed adaptability, high query efficiency, and efficient processing logic

Active Publication Date: 2014-01-29
NAT COMP NETWORK & INFORMATION SECURITY MANAGEMENT CENT +1
View PDF8 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For example, the query efficiency is extremely low, the aggregation and sorting query of ar

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Aggregating sorting TopK inquiry processing method and system
  • Aggregating sorting TopK inquiry processing method and system
  • Aggregating sorting TopK inquiry processing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] The principles and features of the present invention are described below in conjunction with the accompanying drawings, and the examples given are only used to explain the present invention, and are not intended to limit the scope of the present invention.

[0057] figure 1 It is a flow chart of a method for grouping, gathering, sorting, and TopK query processing in an embodiment of the present invention, and the process is applied to a distributed data storage system. Such as figure 1 As shown, in this embodiment, the flow of the grouping aggregation sorting TopK query processing method may include the following steps:

[0058] Step S101, receiving a packet aggregation and sorting TopK query request;

[0059] Step S102, each distributed data node performs local data packet aggregation according to the query request, and asynchronously transmits its own packet aggregation data to the centralized processing node;

[0060] Here, "local data group aggregation" refers to...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an aggregating sorting TopK inquiry processing method and system. The method includes: receiving an aggregating sorting TopK inquiry request; by each distributed data node, performing local data aggregating according to the inquiry request, and asynchronously transmitting self aggregated data to a central processing node; by the central processing node, using a data structure combined by a hash table and a binary balancing tree to perform data combination on the aggregated data of the distributed data nodes, and using an approximate high frequency item statistical algorithm to count so as to obtain a high frequency item table after aggregating and sorting; outputting the high frequency item table. The method and system is good in flexibility, high in inquiry efficiency, and good in distribution adaptability.

Description

technical field [0001] The present invention relates to the field of network technology, in particular to a method and system for group aggregation and sorting TopK query processing. Background technique [0002] According to IDC Internet Data Center, research over the past five years has found that the amount of data worldwide is doubling approximately every two years. In 2010, the global data volume entered the ZB era, and it is estimated that by 2020, the global data volume will reach a terrifying 35ZB. As netizens become more and more involved in Internet products and applications, the Internet will become more intelligent, and the amount of data on the Internet will grow explosively. The era of big data has arrived. Such a huge amount of data has brought great challenges to the data storage system. The traditional stand-alone data storage system is no longer feasible, and the distributed storage system has become an inevitable trend of future data storage development....

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/24578
Inventor 云晓春徐小琳王明华高胜李高超常为领王勇王树鹏张永铮
Owner NAT COMP NETWORK & INFORMATION SECURITY MANAGEMENT CENT
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap