Hadoop-based network security event analyzing method

A technology for network security and analysis methods, applied in electrical components, transmission systems, etc., can solve the problems of network security management platform applicability, availability, reliability impact, increased labor maintenance costs, etc., to simplify data consistency problems, realize Visualize the effect of monitoring and configuration, saving network security human resources

Inactive Publication Date: 2015-02-18
LANGCHAO ELECTRONIC INFORMATION IND CO LTD
View PDF2 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

If the data processing efficiency cannot cope with the increasing data size requirements, it will have an impact on the applicability, availability, reliability, etc. of the network security management platform, and the cost of manual maintenance may also greatly increase

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hadoop-based network security event analyzing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] Below according to accompanying drawing of description, in conjunction with specific embodiment, the present invention is further described:

[0022] Use three machines, all installed Ubuntu 11.04. One is the Name Node (192.168.1.1) of the distributed file system HDFS and the JobTracker node of MapReduce, and the other two machines (192.168.1.2, 192.168.1.3) are used as the Data Node of HDFS and the Task Tracker node of MapReduce. In the experimental environment, the Name Node starts and stops various processes on the Data Node through SSH.

[0023] The distributed storage of HDFS combines the characteristics of the parallel distributed computing idea of ​​MapReduce to build a security event analysis prototype platform based on Hadoop. The process of the method is as follows:

[0024] 1) The data acquisition system collects network security event information from various network security devices and generates data files, and uses API or commands to store them in HDFS, ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a Hadoop-based network security event analyzing method. The method includes that by utilizing the characteristic that hadoop is high in efficiency, fault tolerance, expandability and reliability and open in source during mass data processing and adopting the advantage that an HDFS (hadoop distributed file system) is high in fault tolerance and extensibility, a user is allowed to arrange Hadoop on common and low-price hardware to form a distributed-type system; MapReduce provides a development parallel application program and realizes distributed-type calculating and parallel task processing on a cluster; the HDFS provides support like file operation and storage in the process when the MapReduce processes tasks, a data collecting system collects network security event information from each network security device, generates data files and stores the data files in the HDFS by using an API or an instruction, data are stored on nodes of multiple common hardware resources in a distributed manner, the MapReduce is used to analyze the event information and output analyzing results to demonstrate that the MapReduce realizes distribution, tracking, execution and the like on the basis of the HDFS, the results are collected, and major tasks of the Hadoop distributed-type cluster are completed through interaction.

Description

technical field [0001] The invention relates to the field of network security, in particular to a method for analyzing network security events based on Hadoop. Background technique [0002] The application of the network security management platform can realize the visual monitoring and configuration of the overall network security status, simplify the complexity of manual analysis and management, save human resources for network security, and provide technical basis for rapid emergency response. However, with the increasing scale of informatization, the scope of network security protection is becoming wider and wider, and the complexity of security management is also increasing. The more application systems are used, the greater the amount of secure data, and the requirements for data processing on the network security management platform are getting higher and higher, and the massive data processed may reach TB or even PB level. If the data processing efficiency cannot co...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/06
CPCH04L63/1416H04L63/1433
Inventor 黄敏
Owner LANGCHAO ELECTRONIC INFORMATION IND CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap