Method and system for realizing data acquisition platform based on big data

A technology of data collection and implementation method, which is applied in the field of big data applications and information security, can solve the problems of poor scalability, poor performance, and high cost of data collection, and achieve the effect of improving real-time performance and scalability

Active Publication Date: 2018-02-23
NANJING LIANCHENG TECH DEV
View PDF3 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0014] The present invention provides a method and system for realizing a data collection platform based on big data, s

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for realizing data acquisition platform based on big data
  • Method and system for realizing data acquisition platform based on big data
  • Method and system for realizing data acquisition platform based on big data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] Below is further detailed description of the present invention according to accompanying drawing and example:

[0029] figure 1 It is a schematic diagram of an implementation method and system of a data acquisition platform based on big data according to the present invention, and it has the following functions:

[0030] 1. Receive information

[0031] 2. Forward to the corresponding application agent for preprocessing, and standardize the message format

[0032] 3. Output messages to database storage based on big data

[0033] Managed devices include security devices and network devices. Security equipment such as Sangfor, NSFOCUS, Trend Micro, etc., network equipment (routers, switches, etc.) such as ZTE, Huawei, etc., and servers such as Inspur. It collects data from managed devices such as:

[0034] 10.1.62.90:IDS[29036]: [1:974:2] WEB-IIS .access

[0035] [Classification: Attempted Information Leak] [Priority: 3]: {TCP}

[0036] 10.1.21.186:4597 / 10.1.62.90:8...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a system for realizing a data acquisition platform based on big data. The data acquisition platform comprises protocol agents, application agents, real-time message exchange centers and a database. According to the method and the system, through various different protocol agents and application agent modules of the data acquisition platform, and loose couplingand plug-and-play between the real-time message exchange centers, real-time acquisition, real-time preprocessing and real-time storage of information, such as vulnerabilities, configurations, safety events and network faults of safety equipment, network equipment, the database, middleware and the like, are realized, and the real-time performance and the expandability of a safe operation and maintenance service platform are improved.

Description

technical field [0001] The invention relates to the technical fields of information security and big data application, and in particular to an implementation method of a data collection platform based on big data. Background technique [0002] The English abbreviation included in the present invention is as follows: [0003] SOC: Security Operation Center Security Management Center [0004] IDS: Intrusion Detection Systems intrusion detection system [0005] SNMP: Simple Network Management Protocol Simple Network Management Protocol [0006] CLF: Common Log Format common log format [0007] JSON: JavaScript Object Notation JAVA Script Object Notation [0008] HDFS: Hadoop Distribute File System Hadoop Distributed File System. [0009] Safe production has always been the prerequisite for ensuring the orderly development of various tasks, and it is also a veto indicator for evaluating leading cadres at all levels. The network and information security operation and mainte...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08
CPCH04L67/562H04L67/567H04L67/56
Inventor 李木金凌飞
Owner NANJING LIANCHENG TECH DEV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap