A method and device for adjusting the number of processing nodes
A technology for processing nodes and adjusting methods, which is applied in the direction of multi-programming devices and resource allocation, and can solve problems such as inability to be processed and low resource utilization of processing nodes, and achieve the effect of reducing idle time and improving resource utilization
Active Publication Date: 2019-10-15
BEIJING QIYI CENTURY SCI & TECH CO LTD
View PDF5 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0004] In a real-time computing system, the management node can only adjust the number of processing nodes based on the estimated maximum load when the real-time processing program is not running. In order to prevent the task from being processed due to program failure, the generally estimated The maximum load is greater than the maximum load in actual use, and the load is proportional to the number of processing nodes, then the existing method makes the number of processing nodes managed by the management node more than the number of processing nodes actually required
Therefore, in actual operation, the time spent processing tasks will be less than the preset time interval, so that every time a task is processed, all processing nodes are idle for a period of time, which causes processing nodes to be idle. low resource utilization
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0045] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.
[0046] In order to solve the problems in the prior art, the embodiments of the present invention provide a method and device for adjusting the number of processing nodes. The following first introduces a method for adjusting the number of processing nodes provided by an embodiment of the present invention.
[0047] It should be noted that the embodiments of the present invention are preferentially applied to management nodes in a real-time...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The embodiment of the invention discloses a method and a device for adjusting quantity of processing nodes, applied to a management node in a real-time computation system. The method comprises the steps of detecting whether task processing completion messages sent by the processing nodes managed by the management node are received; if yes, determining target load rates corresponding to the processing nodes managed by the management node according to a preset maximal load rate and a preset minimal load rate of the processing nodes managed by the management node; determining a target quantity after the quantity of the processing nodes is adjusted according to the target load rates, a basic load rate and current quantity of the processing nodes managed by the management node, wherein the basic load rate is an average value of the recorded load rates; determining whether the quantity of the processing nodes need to be adjusted according to the current quantity and the target quantity; and if yes, adjusting the quantity of the processing nodes managed by the management node according to the target quantity. With the application of the method and the device provided by the embodiment of the invention, a resource utilization rate of the processing nodes is improved.
Description
Technical field [0001] The invention relates to the field of real-time computing technology, in particular to a method and device for adjusting the number of processing nodes. Background technique [0002] Real-time computing is a technology that has emerged in recent years. Compared with batch processing, real-time computing can quickly return calculation results, and the minimum processing delay can reach the second level. Therefore, real-time computing systems are widely used in report statistics, real-time recommendations, ETL ( Extraction Transformation Loading, data extraction, transformation and loading) and other fields. [0003] The existing real-time computing system includes a management node and a processing node. The management node divides the acquired real-time data of the user into multiple tasks, and dispatches the same task to all processing nodes for processing, and the processing node pairs the received data Perform processing and feed back the processing resul...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/50
Inventor 马元文
Owner BEIJING QIYI CENTURY SCI & TECH CO LTD