Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Resource availability early warning method and apparatus

A resource estimation and resource technology, applied in the direction of resource allocation, multi-program device, program control design, etc., can solve the problems of resource adjustment, insufficient resources, and inability to issue early warnings by users, and achieve the effect of improving deficiencies.

Active Publication Date: 2017-11-03
HANDAN BRANCH OF CHINA MOBILE GRP HEBEI COMPANYLIMITED
View PDF5 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0011] Although Hadoop's existing YARN architecture provides good support for resource management and task scheduling monitoring, it can only monitor task status at present, and cannot issue early warnings to users when resources are insufficient, so resource adjustments cannot be made in advance, which may lead to If the task progress is close to completion but there is a serious shortage of resources, then the task may only be restarted and resources are redistributed, which will cause a waste of time and resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Resource availability early warning method and apparatus
  • Resource availability early warning method and apparatus
  • Resource availability early warning method and apparatus

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] In the embodiment of the present invention, the resource usage estimation model is established first, and then the resource usage of the next time period is estimated through the resource usage estimation model, when the estimated resource usage of the next period When the preset threshold is exceeded, a resource availability warning is issued.

[0044] Under normal circumstances, the normal operation of Hadoop is inseparable from the support of sufficient resources such as CPU and memory. The availability of various resources has different impacts on the operation of Hadoop tasks. For example, if the CPU resources are not enough, it may not directly cause If the task fails, the overall running speed and processing efficiency will drop significantly, and a large number of tasks will be queued up; if the memory resources are not enough, it will often be fatal, memory overflow will occur, task execution will be interrupted, and many tasks will fail. Therefore, it is neces...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a resource availability early warning method. The method comprises the steps of building a resource consumption pre-estimation model; through the resource consumption pre-estimation model, pre-estimating resource consumption of a next time cycle; and when the pre-estimated resource consumption of the next cycle exceeds a preset threshold, sending out a resource availability early warning. The invention furthermore provides a resource availability early warning apparatus.

Description

technical field [0001] The invention relates to the technical field of business support, in particular to a method and device for early warning of Hadoop resource availability. Background technique [0002] Hadoop is one of the mainstream software of the current big data platform, which provides a distributed massive data storage (HDFS, Hadoop Distributed File System), distributed large-scale computing (MapReduce) and a general resource management system (YARN, Yet Another Resource The basic framework of Negotiator) has the advantages of high fault tolerance, ease of use and scalability, and is widely used in data mining, online analytical processing (OLAP, Online Analytical Processing), business analysis, etc. It can discover potential customer groups, help Carry out market segmentation and customer relationship management, predict future market trends, etc., provide decision support for business leaders, and realize the purpose of realizing value-added data. At present, H...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCG06F9/5038G06F2209/5021G06F2209/504
Inventor 李湛
Owner HANDAN BRANCH OF CHINA MOBILE GRP HEBEI COMPANYLIMITED
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com