Unlock instant, AI-driven research and patent intelligence for your innovation.

Stream processing method and distributed system for realizing stream processing

A distributed system and stream processing technology, applied in the field of stream processing, can solve problems such as network congestion and transaction delay, and achieve the effect of reducing a large amount of data and saving network bandwidth resources.

Inactive Publication Date: 2015-05-20
INT BUSINESS MASCH CORP
View PDF1 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, in the case of limited network bandwidth, frequent data transmission between computing nodes will inevitably cause network congestion and transaction delays

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Stream processing method and distributed system for realizing stream processing
  • Stream processing method and distributed system for realizing stream processing
  • Stream processing method and distributed system for realizing stream processing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0015] The purpose and advantages of the present invention will be better understood by describing the method and system for managing work tasks based on communication messages according to the embodiments of the present invention with reference to the accompanying drawings.

[0016] The core idea of ​​the present invention: For the application of stream processing where data calculation has a dependency relationship, in order to avoid a large amount of data transmission between computing nodes, only the calculation result of the previous data block that the next data block calculation depends on is used in the calculation The multiple computing steps required to complete stream processing for each data block are completed on a single computing node, and the parallel stream processing method is implemented on multiple computing nodes, so that from the local memory of the computing node and A large amount of data required to implement each calculation step of stream processing c...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a stream processing method and a distributed system for realizing stream processing. The invention discloses a stream processing method for the distributed system. The distributed system comprises a distributor and a plurality of calculation nodes. The method comprises the following steps: in response to a received data block distributed by the distributor, each calculation node calls a corresponding calculation logic to calculate the data block and generates a calculation result; and the calculation node only transmits the part of the calculation result related to the calculation of the next data block to a calculation node in which the next data block is positioned.

Description

technical field [0001] The present invention relates to stream processing, in particular to a stream processing method for distributed systems and a distributed system for realizing stream processing. Background technique [0002] Stream processing technology is widely used in real-time processing systems in various fields to process sequences of consecutive events that are logically and / or time-related, such as stock securities trading centers, network monitoring, Web applications, communication data management, The common characteristics of such applications are: strong real-time data, huge data volume, high burstiness, continuous occurrence and constant change. Stream processing technology requires real-time monitoring of continuous data streams, real-time data analysis in the process of data changes, capture of information that may be useful to users, rapid response to emergency situations, and real-time processing. [0003] At present, stream processing technology main...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08H04L29/06
Inventor 藤启明李影刘之育王海川
Owner INT BUSINESS MASCH CORP
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com