Log debugging method and device for in distributed hadoop environment

A debugging method and distributed technology, applied in digital transmission systems, electrical components, transmission systems, etc., can solve the problems of low node communication security, chaotic log management, scattered nodes, etc., and achieve the effect of scalability and flexibility

Inactive Publication Date: 2018-02-23
济南双瑞软件有限公司
View PDF6 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Although there are already a series of methods for log management of ordinary devices, there is currently a lack of log management configuration methods for popular distributed systems such as Hadoop, which are used to solve the problem of scattered nodes, chaotic log management, and node communication security in a distributed environment. The problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log debugging method and device for in distributed hadoop environment
  • Log debugging method and device for in distributed hadoop environment
  • Log debugging method and device for in distributed hadoop environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The advantages and features of the present invention and the method for achieving the stated objects will be apparent from the accompanying drawings and the following detailed description.

[0032] The present invention first relates to a log debugging method in a distributed hadoop environment, referring to the appendix figure 2 , the work flow diagram of the present invention is characterized in that:

[0033] Step 1: The distributed hadoop system performs authentication and verification on the user's login identity, mainly including system concurrency management, distributed intrusion detection option configuration, distributed intrusion detection custom rule configuration, distributed intrusion detection system rule configuration and distributed intrusion detection start and end;

[0034] Step 2: Verify whether the resource usage status, user communication status, and firewall security status of the current distributed hadoop system are in good condition, and deci...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a log debugging method and device for use in a distributed hadoop environment, and aims to solve the problems of dispersed nodes, disordered log management and poor node communication safety in a distributed environment specific to a log management and configuration method for current popular distributed system, such as a hadoop system. The log debugging method comprises the following steps: verifying a user login identity; authenticating a using state of a distributed system; performing a warning intrusion detection operation when the using state of the system is good;acquiring and analyzing logs to be collected; performing cluster analysis processing on node logs; converting the logs by an XML (X Extensible Markup Language) format; and lastly, updating database log data. According to the log debugging method and device, a high-security protection measure is provided for the distributed system through interruption of illegal access and intrusion detection protection. The method and the device have important practical significance and high popularization value for solving of the security problem of the distributed system.

Description

technical field [0001] The invention belongs to the technical field of network log management based on a distributed platform, in particular to a log debugging method and device in a distributed hadoop environment. Background technique [0002] With the continuous expansion of distributed platform applications such as hadoop, in order to maintain the information security of the distributed platform, people have taken many measures, such as firewall technology, security key encryption technology, vulnerability scanning technology, distributed intrusion detection technology and so on. These measures have played a certain role. However, with the emergence of malicious attacks, such as distributed denial of service attacks against distributed platforms, the methods are becoming more and more sophisticated, and various protection methods are becoming more and more complex and increasingly sophisticated. The more difficult it is to resist the endless attack methods, and even affec...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/06H04L12/24H04L12/26
CPCH04L41/069H04L43/045H04L63/0815H04L63/1425
Inventor 吴晓光
Owner 济南双瑞软件有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap