Fault detection method and device for big data cluster

A fault detection and big data technology, applied in the computer field, can solve problems such as difficult fault root detection and high operation and maintenance costs

Pending Publication Date: 2020-11-24
CHINA CONSTRUCTION BANK
View PDF0 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0015] In view of this, the embodiment of the present invention provides a fault detection method and device for a large

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Fault detection method and device for big data cluster
  • Fault detection method and device for big data cluster
  • Fault detection method and device for big data cluster

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0110] Exemplary embodiments of the present invention are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present invention to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0111] The technical field that the present invention relates to is to realize the fault detection of big data cluster, so as to realize the fault detection and management of big data products such as multiple MPP parallel database clusters and multiple Hadoop big data clusters.

[0112] figure 1 is a schematic diagram of the main flow of a fault detection method for a la...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a fault detection method and device for a big data cluster, and relates to the technical field of computers. A specific embodiment of the method comprises the steps of collecting index data and log data of a big data cluster; determining abnormal information and a corresponding processing scheme according to the index data and the log data; performing machine learning on the abnormal information and the corresponding processing scheme, and storing a learning result into an operation and maintenance library; and performing fault detection on the big data cluster based ona learning result in the operation and maintenance library. According to the embodiment, the technical problems of difficult fault source detection and high operation and maintenance cost can be solved.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a fault detection method and device for a large data cluster. Background technique [0002] With the development of business, the operation and management of big data clusters present the following pain points: [0003] (1) "Slow": The business operating environment is becoming more and more complex, fault detection is slow, there are more and more various business systems and big data systems, and the system is highly dependent on IT resources. Once any problems occur in the system, they need to be eliminated one by one , fault detection is difficult. [0004] (2) "Complicated": The operation and maintenance work is heavy, and there is a lack of automated tools and means. The operation and maintenance personnel are faced with a large number of repetitive and manual troubleshooting tasks every day, which is time-consuming, labor-intensive, error-prone, and inefficient. [000...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F11/30G06F11/34G06N20/00
CPCG06F11/3006G06F11/3065G06F11/3476G06N20/00
Inventor 洪毅清吕文栋蔡淑莲钟文杰
Owner CHINA CONSTRUCTION BANK
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap