Log debugging method and device for in distributed hadoop environment

Abstract

The invention discloses a log debugging method and device for use in a distributed hadoop environment, and aims to solve the problems of dispersed nodes, disordered log management and poor node communication safety in a distributed environment specific to a log management and configuration method for current popular distributed system, such as a hadoop system. The log debugging method comprises the following steps: verifying a user login identity; authenticating a using state of a distributed system; performing a warning intrusion detection operation when the using state of the system is good;acquiring and analyzing logs to be collected; performing cluster analysis processing on node logs; converting the logs by an XML (X Extensible Markup Language) format; and lastly, updating database log data. According to the log debugging method and device, a high-security protection measure is provided for the distributed system through interruption of illegal access and intrusion detection protection. The method and the device have important practical significance and high popularization value for solving of the security problem of the distributed system.

Description

technical field [0001] The invention belongs to the technical field of network log management based on a distributed platform, in particular to a log debugging method and device in a distributed hadoop environment. Background technique [0002] With the continuous expansion of distributed platform applications such as hadoop, in order to maintain the information security of the distributed platform, people have taken many measures, such as firewall technology, security key encryption technology, vulnerability scanning technology, distributed intrusion detection technology and so on. These measures have played a certain role. However, with the emergence of malicious attacks, such as distributed denial of service attacks against distributed platforms, the methods are becoming more and more sophisticated, and various protection methods are becoming more and more complex and increasingly sophisticated. The more difficult it is to resist the endless attack methods, and even affec...

AI Technical Summary

Problems solved by technology

[0005] Although there are already a series of methods for log management of ordinary devices, there is currently a lack of log management configuration methods for popular distributed systems such as Hadoop, which are used to solve the problem of scattered nodes, chaotic log management, and node communication security in a distributed environment. The problem

Images