Supercharge Your Innovation With Domain-Expert AI Agents!

A streaming computing job processing method and device

A streaming computing and job processing technology, applied in the field of data processing, can solve the problems of inaccurate resource adjustment, high cost, affecting job stability, etc., and achieve the effect of improving user experience, efficiency and accuracy

Active Publication Date: 2021-12-28
中电云计算技术有限公司
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method of manually adjusting resources has the following problems: (1) Additional monitoring procedures are required; (2) Based on the personal experience of developers, the adjustment of resources is inaccurate; (3) It affects the stability of the job; (4) Manual Configuration is difficult; (5) manual adjustment costs are high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A streaming computing job processing method and device
  • A streaming computing job processing method and device
  • A streaming computing job processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0065] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Apparently, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0066] At present, most jobs are adjusted by manually monitoring the source rate, manually configuring parallelism, deploying and testing performance to adjust resources. This method of manually adjusting resources has the following problems: (1) Additional monitoring procedures are required; (2) Based on the personal experience of developers, the adjustment of resources is ina...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present application discloses a stream computing job processing method. The method includes: obtaining a stream computing job; if it is detected that there is an abnormality in at least one target configuration parameter among the several configuration parameters, and the target configuration parameter satisfies the stated According to the preset expansion and contraction conditions corresponding to the target configuration parameters, the expansion and contraction adjustment mode is determined according to the target configuration parameters; according to the expansion and contraction adjustment mode, the configuration parameters of the stream computing job are adjusted to obtain Adjusted configuration parameters; based on the adjusted configuration parameters, execute the streaming computing job. It can be seen that the present application improves the efficiency and accuracy of stream computing job processing, thereby improving user experience.

Description

technical field [0001] The present application relates to the field of data processing, and in particular to a stream computing job processing method and device. Background technique [0002] In the future, streaming computing jobs will inevitably have resource oversupply or undersupply. When and how to adjust are the problems that plague most big data developers. At present, most jobs are adjusted by manually monitoring the source rate, manually configuring parallelism, deploying and testing performance to adjust resources. This method of manually adjusting resources has the following problems: (1) Additional monitoring procedures are required; (2) Based on the personal experience of developers, the adjustment of resources is inaccurate; (3) It affects the stability of the job; (4) Manual The configuration is difficult; (5) Manual adjustment costs are high. Contents of the invention [0003] The present application provides a stream computing job processing method, so a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/50
Inventor 闵何招
Owner 中电云计算技术有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More