Log data processing method and device

A processing method and processing device technology, applied in the direction of electrical digital data processing, special data processing applications, network data retrieval, etc., can solve the problems of low log data efficiency and low query log data efficiency, achieve fast query, and improve collection capabilities , fast and efficient storage effect

Active Publication Date: 2015-01-14
QI-ANXIN LEGENDSEC INFORMATION TECH (BEIJING) INC
View PDF5 Cites 29 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of the low efficiency of storing massive log data and querying log data in the related technology using relational database, no effective solution has been proposed so far. Therefore, the main purpose of the present invention is to provide a log data processing method and device , to solve the above problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log data processing method and device
  • Log data processing method and device
  • Log data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] In order to enable those skilled in the art to better understand the solutions of the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only It is an embodiment of a part of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

[0028] It should be noted that the terms "first" and "second" in the description and claims of the present invention and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a log data processing method and device. The method includes: writing read log information of a network device into a log file according to a preset format; establishing a mapping relation between the time of the log information and the position of the log information to obtain a time index file; extracting preset fields from the log information of the log file, and establishing a mapping relation between the preset fields and the log information to generate an image file; after a user's search request is acquired, using the time index file or the image file to acquire logs indicated for search by the search request. The time index file and the image file are stored in a database. By the use of the log data processing method and device, the problem that the prior art is low in efficiency of storing the mass log data using the relational database and low in efficiency of searching the log data is solved; quick efficient storage of the log information is achieved, and the log information can be searched fast.

Description

technical field [0001] The invention relates to the field of data storage, in particular to a log data processing method and device. Background technique [0002] With the popularity of computers and smart terminals, the network has developed rapidly, resulting in an increasingly complex network environment. Today's enterprises and organizations are facing more and more severe situations in the field of IT information security. Various network devices, security devices, hosts, applications and business systems in the network will also generate more and more security events and logs during their work. How to store these massive events and provide accurate data for further analysis and mining is becoming more and more important. [0003] In the traditional log audit system, a relational database is used to store all log information. However, there are certain disadvantages in relational databases. Massive log information will not only greatly increase the burden on the data...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/951
Inventor 赵丰富
Owner QI-ANXIN LEGENDSEC INFORMATION TECH (BEIJING) INC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products