Distributed transmission method for query data stream

A data stream transmission and distributed query technology, applied in transmission systems, electrical digital data processing, special data processing applications, etc., can solve the problems of reducing the amount of communication, redundant communication, etc., and achieve the effect of reducing the amount of data transmission

Inactive Publication Date: 2011-08-17
PEKING UNIV
View PDF0 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In order to overcome the shortcomings of excessive redundant traffic caused by the independent transmission of distributed data streams in the existing network, the present invention proposes a data stream sharing method, which can fully discover the inclusion and overlap of distributed data streams relationship, thereby reducing the amount of traffic transmitted in the network

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed transmission method for query data stream
  • Distributed transmission method for query data stream
  • Distributed transmission method for query data stream

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] Below in conjunction with accompanying drawing and specific embodiment the present invention is described in further detail:

[0034] Such as figure 1 As shown in the tree structure diagram in the distributed data stream query, the network node structure is shown in the figure during the distributed query. If a new query 1 is generated at node 4, node 4 is the registration node of the newly arrived query , for the convenience of data transmission, the query is placed on the network node 5 closest to the data source for query.

[0035] Such as figure 2 As shown in , it is a structure diagram of a single network node in the network node structure diagram. The root node stores the original data, and the remaining nodes are child nodes. Wherein, the network node 10 includes metadata 11 and cache data 12, including remaining space 8 and sending view cache (SVC) 9 in the cache data 12, and sending view cache (SVC) 9 includes receiving view cache (RVC) 6, query cache ( QC)...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed transmission method for a query data stream, which comprises the following steps of: 1) storing the data stream passing through each network node or the latest query result to form a view; 2) when a new query is generated in the network node, adopting the stored data stream passing through the network node or the latest query result in the transmission path as a new query data source, and adopting the network node including the new query data with least cost as a query execution node; and 3) querying the query data stream from a query generation node to the query execution node. The application of the method can realize shared transmission among a plurality of data streams as much as possible during distributed data stream query processing so that the data transmission quantity in the network is reduced.

Description

technical field [0001] The invention relates to a method for effectively reducing the amount of communication data when performing distributed real-time transmission of flow data on the network. Background technique [0002] The current distributed data stream query processing considers the optimal placement of each query operator separately in order to reduce the amount of data communication, and does not take into account the sharing of various data streams. In actual situations, multiple data streams exist between any two network nodes at the same time, and there is an overlapping or inclusion relationship between them. If these data streams are transmitted independently, it will obviously increase the amount of data transmitted by the network. However, the current typical data stream sharing method StreamGlobe only considers the inclusion of queries, and cannot make full use of the overlap between data streams, and does not have the ability to dynamically adjust. Cont...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08G06F17/30
Inventor 陈立军汪罕卢阳王潇
Owner PEKING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products