A streaming computing job processing method and device
A streaming computing and job processing technology, applied in the field of data processing, can solve the problems of inaccurate resource adjustment, high cost, affecting job stability, etc., and achieve the effect of improving user experience, efficiency and accuracy
Active Publication Date: 2021-12-28
中电云计算技术有限公司
View PDF5 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
This method of manually adjusting resources has the following problems: (1) Additional monitoring procedures are required; (2) Based on the personal experience of developers, the adjustment of resources is inaccurate; (3) It affects the stability of the job; (4) Manual Configuration is difficult; (5) manual adjustment costs are high
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0065] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Apparently, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.
[0066] At present, most jobs are adjusted by manually monitoring the source rate, manually configuring parallelism, deploying and testing performance to adjust resources. This method of manually adjusting resources has the following problems: (1) Additional monitoring procedures are required; (2) Based on the personal experience of developers, the adjustment of resources is ina...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The present application discloses a stream computing job processing method. The method includes: obtaining a stream computing job; if it is detected that there is an abnormality in at least one target configuration parameter among the several configuration parameters, and the target configuration parameter satisfies the stated According to the preset expansion and contraction conditions corresponding to the target configuration parameters, the expansion and contraction adjustment mode is determined according to the target configuration parameters; according to the expansion and contraction adjustment mode, the configuration parameters of the stream computing job are adjusted to obtain Adjusted configuration parameters; based on the adjusted configuration parameters, execute the streaming computing job. It can be seen that the present application improves the efficiency and accuracy of stream computing job processing, thereby improving user experience.
Description
technical field [0001] The present application relates to the field of data processing, and in particular to a stream computing job processing method and device. Background technique [0002] In the future, streaming computing jobs will inevitably have resource oversupply or undersupply. When and how to adjust are the problems that plague most big data developers. At present, most jobs are adjusted by manually monitoring the source rate, manually configuring parallelism, deploying and testing performance to adjust resources. This method of manually adjusting resources has the following problems: (1) Additional monitoring procedures are required; (2) Based on the personal experience of developers, the adjustment of resources is inaccurate; (3) It affects the stability of the job; (4) Manual The configuration is difficult; (5) Manual adjustment costs are high. Contents of the invention [0003] The present application provides a stream computing job processing method, so a...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/50
Inventor 闵何招
Owner 中电云计算技术有限公司