Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data processing method and control node in stream computation system and stream computation system

A control node and data processing technology, which is applied in the computer field, can solve the problems of waste of resources in stream computing systems, inability of stream data processing models to adapt to real-time changes in the system, and limitations of data processing capabilities.

Active Publication Date: 2014-06-18
HUAWEI TECH CO LTD
View PDF5 Cites 36 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In view of real-time changes, the initial concurrency set by the user is often not optimal, so the streaming data processing model generated according to the initial user-set concurrency cannot adapt to the real-time changes of the system, which will lead to the flow computing system. Waste of resources, data processing capacity is greatly limited

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and control node in stream computation system and stream computation system
  • Data processing method and control node in stream computation system and stream computation system
  • Data processing method and control node in stream computation system and stream computation system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] In order to make the purpose, technical solution, and advantages of the present invention clearer, the technical solution provided by the present invention will be further described in detail below with reference to the accompanying drawings and examples. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0057] The main realization principles, specific implementation methods and corresponding beneficial effects that can be achieved of the technical solutions of the embodiments of the present application will be described in detail below in conjunction with the accompanying drawings.

[0058] like figure 2 As shown, the embodiment of the present invention provides a data processing method in t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data processing method and a control node in a stream computation system and the stream computation system. The method includes the following steps: the data traffic information between each working node and other working nodes and the processing speed information of each working node are collected; according to the collected data traffic information and processing speed information, the optimization concurrence of each working node is determined; according to the optimization concurrences of the working nodes, the concurrences of the working nodes are adjusted. The method and the device which are disclosed by the invention can adjust the concurrences of the working nodes according to the real-time data in the stream computation system, so that the processing capability of the working nodes can meet the requirement for the real-timeness of business processing.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a data processing method in a stream computing system, a control node and the stream computing system. Background technique [0002] Currently, data-intensive services have been widely used. Typical data-intensive services include financial services, network monitoring, telecom data management, and Web applications. In data-intensive business, the data has the characteristics of large amount, fast and time-varying, so the data should not be modeled by persistent and stable relations, but by transient data flow modeling, which leads to the research of data flow computing. Data flow computing is a pipeline-like data processing mode. Data flow computing comes from a concept: the value of data decreases with the passage of time, so it must be processed as soon as possible after the data is generated by an event trigger. It is best When the data is generated, it is processe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCG06F9/5083G06F9/5005H04L43/045H04L47/828H04L65/4015
Inventor 史云龙夏命榛何诚
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com