Check patentability & draft patents in minutes with Patsnap Eureka AI!

A resource scheduling method and device for a streaming computing system

A streaming computing and resource scheduling technology, applied in the direction of resource allocation, multi-programming devices, etc., can solve the problem of not considering the disaster tolerance capability and system performance, and achieve the effect of improving the disaster tolerance capability and reducing the impact.

Active Publication Date: 2019-11-26
ALIBABA GRP HLDG LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, whether it is JStorm or Storm, the scheduling method used is the principle of equal distribution. Although the resource utilization rate is improved, it does not consider the disaster recovery capability and system performance.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A resource scheduling method and device for a streaming computing system
  • A resource scheduling method and device for a streaming computing system
  • A resource scheduling method and device for a streaming computing system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0079] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0080] figure 2 The main method flowchart provided for the embodiment of the present invention, such as figure 2 As shown in , the method may include the following steps:

[0081] In 201, the input Job information is acquired.

[0082] In the embodiment of the present invention, when it is necessary to run a computing job in the streaming computing system, usually the computing job is a real-time computing job, and Job information will be input to the streaming computing system. In JStorm or Storm, a real-time computing job The logic is encapsulated in a Topology object. In this Topology, a directed ring graph composed of the number of Workers, Tasks, and the execution relationship between each Task is defined. The directed ring graph defines...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method and device for resource dispatching of a stream-type computation system. The method comprises the steps that (S1) input computation working information is acquired; (S2) according to a process quantity determined by the computation working information, processes of the corresponding quantity are distributed to working nodes; and (S3) each tread in a thread list which is determined according to the computation working information is distributed according to at least one of the following principles: the threads belonging to the same processing unit are preferentially distributed to the different processes; and the threads with a communication relation are preferentially distributed to the same process. According to the invention, the disaster recovery capability of the stream-type computation system or the system performance can be enhanced.

Description

【Technical field】 [0001] The present invention relates to the technical field of computer applications, in particular to a resource scheduling method and device for a streaming computing system. 【Background technique】 [0002] JStorm is a real-time streaming computing framework based on Storm. It has made continuous improvements in network IO, threading model, resource scheduling, availability and stability, and has been used by more and more enterprises. A JStorm cluster consists of a scheduling node and multiple working nodes. The scheduling node is mainly responsible for task scheduling and sending the scheduling results to zookeeper. The working nodes monitor zookeeper respectively, obtain the tasks assigned to them and execute the tasks. The main structure is as follows figure 1 shown in . There are certain Slot resources on each working node. Each Job (job) can be regarded as a Topology (computing topology), which contains multi-level processing units, and the inst...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/50
Inventor 陈昱刘键封仲淹
Owner ALIBABA GRP HLDG LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com