Task congestion processing method and device and electronic equipment
A processing method and task technology, applied in the fields of electronic equipment and computer-readable media, devices, and task congestion processing methods, can solve problems such as time-consuming, slow manual intervention analysis and processing, and achieve the effect of eliminating task congestion.
Pending Publication Date: 2021-06-11
北京淇瑀信息科技有限公司
View PDF10 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Jobs based on the Yarn computing platform are also growing and becoming more complex with the increase in enterprise analysis needs and personnel, and the problem of platform job scheduling and resource management is becoming more and more prominent. When the job platform is congested, manual intervention in the analysis process is slow and time-consuming, and it is urgent New technical means are needed to deal with this contradiction between resource requirements
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0032] Exemplary embodiments of the present invention will now be described more fully with reference to the accompanying drawings, and although the exemplary embodiments may be embodied in many specific forms, these should not be construed as limited to the embodiments set forth herein. On the contrary, these exemplary embodiments are provided in order to make the content of the present invention more complete and more convenient to fully convey the inventive concept to those skilled in the art.
[0033]On the premise of complying with the technical concept of the present invention, the structure, performance, effect or other features described in a specific embodiment can be combined in any suitable way into one or more other embodiments.
[0034] During the introduction of specific embodiments, detailed descriptions of structures, performances, effects or other features are intended to enable those skilled in the art to fully understand the embodiments. However, it does not...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a task congestion processing method and device and electronic equipment, and the method comprises the steps: monitoring a task platform and / or real-time operation data of a plurality of tasks on the task platform, and the task platform is used for providing resources needed by the operation of the plurality of tasks; according to the operation data of the task platform and / or the plurality of tasks, judging whether the task platform has a task congestion condition, and when the task congestion condition occurs, analyzing a congestion reason; and querying a target task related to the congestion reason, and releasing resources occupied by the target task to eliminate a task congestion condition. The task platform and the tasks running on the platform are monitored in real time, the task congestion condition can be found in time through the abnormal condition of the monitoring data, the congestion reason is analyzed at the moment, the target task related to the congestion reason is positioned, the resources occupied by the target task are released in time, and the task congestion problem is solved. Therefore, the platform has enough resources to allocate to other tasks, and the task congestion condition is eliminated.
Description
technical field [0001] The present invention relates to the field of computer information processing, in particular to a task congestion processing method, device, electronic equipment and computer readable medium. Background technique [0002] With the development of Internet technology, enterprises have gradually accumulated a large amount of data computing needs. Data storage and computing platforms based on Hadoop (a distributed system infrastructure, Hadoop has become synonymous with big data and the technical standard of big data in the industry) are gradually It has developed into a big data standard platform for many Internet companies. For the large-scale Yarn (full name is Yet Another Resource Negotiator, which means "another resource scheduler", which is a resource management system based on the Hadoop platform), there are tens of thousands or even hundreds of thousands of jobs running on the platform every day ( Jobs or tasks are usually users using the Yarn pla...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4881G06F9/5038
Inventor 陈常超曾勇平王安滨
Owner 北京淇瑀信息科技有限公司