Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Hadoop cluster-oriented distributed monitoring and management system

A distributed monitoring and management system technology, applied in hardware monitoring, electrical digital data processing, instruments, etc., can solve the problem that Ambari cannot run the Linux operating system well, and achieve the effect of simplifying configuration operations and optimizing performance

Active Publication Date: 2016-06-29
北京小笨鸟信息技术有限公司
View PDF3 Cites 51 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For different operating systems, installation often encounters unsolvable problems, that is to say, Ambari does not run well on various Linux operating systems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hadoop cluster-oriented distributed monitoring and management system
  • Hadoop cluster-oriented distributed monitoring and management system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0070] like figure 1 As shown, the distributed monitoring and management system includes:

[0071] 1. The performance monitoring module is used to monitor the performance of the distributed cluster system: the monitored data includes server resources, HadoopMetrics, Hadoop component logs and other component logs. The performance monitoring module includes a collection module and an aggregation module. The collection module is used to read the monitoring data of the monitored node, including server resources (basic information of the server includes CPU, memory, hard disk, network IO, process, etc.), HadoopMetrics (including HDFS information, MapReduce information, JVM information and other Hadoop Component information (Hbase, etc.), Hadoop component logs, and other component logs. The collection module transmits the monitoring data collected to the aggregation module, and the monitoring information is uniformly collected by the aggregation module and stored in a data storage...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a Hadoop cluster-oriented distributed monitoring and management system. A monitoring and management system which is relatively suitable for actual requirements of people mainly comprises a performance monitoring module, a fault alarm module, a comprehensive analysis and query module, a comprehensive display module, a data storage module, a configuration management module and a system management module. Resource distribution of a server can be known through the system; the Hadoop operation condition is tracked; the abnormal condition is alarmed; the Hadoop platform configuration operation is simplified; the system resource bottleneck is found on this basis; and the performance is optimized. The system can also be applied to monitoring and management of distributed clusters in other requirement environments.

Description

technical field [0001] The invention relates to a Hadoop cluster-oriented distributed monitoring and management system, which is more suitable for actual needs. Through this system, it is possible to understand server resource allocation, track Hadoop running status, alarm abnormal conditions, simplify Hadoop platform configuration operations, discover system resource bottlenecks on this basis, and optimize performance. This system can also be used for monitoring and management of distributed clusters in other demanding environments. Background technique [0002] Different from ordinary computer network environment or data center, the cloud computing environment based on Hadoop has the characteristics of large number of nodes, complex components and applications. Hadoop is designed to run on low-cost computers, and regards faults as normal, and Hadoop covers It has a wide range of functions and uses a complex distributed parallel computing architecture, which also brings gr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F11/30G06F11/32
CPCG06F11/3006G06F11/3055G06F11/327
Inventor 许丹霞刘寅汪伟郑宇
Owner 北京小笨鸟信息技术有限公司
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com