Unlock instant, AI-driven research and patent intelligence for your innovation.

A log access analysis method and system for a big data platform

A big data platform and log technology, applied in the field of big data analysis, can solve the problems of destroying original log information, failure to guarantee the accuracy and integrity of log data, lack of original log device information, etc., and achieve the effect of ensuring integrity

Active Publication Date: 2021-09-07
HANGZHOU ANHENG INFORMATION TECH CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, most of the current big data analysis platform products cannot guarantee the accuracy and integrity of the log data forwarded by the log storage server. Some of the log data forwarded by the log storage server lack the original log device information, and some destroy the original log data. log information

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A log access analysis method and system for a big data platform
  • A log access analysis method and system for a big data platform
  • A log access analysis method and system for a big data platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] According to an embodiment of the present invention, an embodiment of a log access analysis method of a big data platform is provided. It should be noted that the steps shown in the flow chart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions , and, although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that shown or described herein.

[0031] figure 1 It is a log access analysis method of a big data platform according to an embodiment of the present invention, such as figure 1 As shown, the method includes the following steps:

[0032] Step S102, receiving the log information sent by the log sending device, and confirming the device attribute information of the log sending device. The device attribute information includes: the original log device and / or the log storage server, and the original log device is the one that...

specific Embodiment approach

[0049] First, use the system equipped with the big data platform log access analysis method in the above embodiment to receive the log information directly sent by the original log device, for example, the log information sent by the original log device of the system equipped with the Web application firewall of a certain manufacturer, The specific content of the log information is:

[0050] "Nov 27 15:25:10 localhost waf:tag:waf_log_wafstat stat_time:2017-11-27 15:24:00cpu:1mem:31".

[0051] Wherein, the IP address of the original log device sending this log information is: 1.1.1.1.

[0052] The log information is parsed through the big data platform. When parsing the log information, the log information can be parsed through the list of log parsing rules. The obtained parsing result can be described as:

[0053] assetAddress:

[0054] 1.1.1.1

[0055] deviceReceiptTime:

[0056] Nov 27 15:25:10

[0057] startTime:

[0058] 2017-11-27 15:24:00

[0059] meessage:

[00...

Embodiment 2

[0100] The embodiment of the present invention also provides a big data platform log access analysis system, the big data platform log access analysis system is mainly used to implement the big data platform log access analysis method provided by the above content of the embodiment of the present invention, as follows The big data platform log access analysis system provided by the embodiment of the present invention is specifically introduced.

[0101] Figure 4 is a schematic diagram of a big data platform log access analysis system according to an embodiment of the present invention, such as Figure 4 As shown, the big data platform log access analysis system mainly includes: a receiving unit 41, a determining unit 42 and a processing unit 43, wherein:

[0102] The receiving unit 41 is configured to receive the log information sent by the log sending device, and confirm the device attributes of the log sending device, wherein the device attributes include: an original log ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a big data platform log access analysis method and system, which are applied to the big data platform, including: receiving the log information sent by the log sending device, and confirming the device attributes of the log sending device. The device attributes include: the original log device And / or the log storage server, the original log device is the device that generates the log, and the log storage server is the server that forwards the log; determine the processing method of the log information according to the attribute information; process the log information according to the processing method, and obtain the processing result, And store the processing result in the database; wherein, the processing result includes: the IP of the original log device and the original log information. The big data platform log access analysis method and system provided by the present invention can ensure the integrity of access log information.

Description

technical field [0001] The present invention relates to the technical field of big data analysis, in particular to a log access analysis method and system of a big data platform. Background technique [0002] With the continuous progress and development of information technology and the growth of business in various fields, the field of IT information security is facing more complex risks. With the advancement of network informatization, technologies such as log auditing and big data analysis have emerged as the times require. In the information age, every organization and department will deploy a large number of IT equipment. Every kind of IT equipment will generate a large number of different logs. Through these logs for log audit analysis and intelligent analysis of big data platform, more and deeper data can be mined. [0003] In daily applications, logs are very important, for example, you can troubleshoot problems based on logs. However, the log cannot be used to tr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/18
Inventor 周刚涛范渊刘博龙文洁
Owner HANGZHOU ANHENG INFORMATION TECH CO LTD