Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Log receiving and processing method and device, electronic equipment and storage medium

A processing method and log technology, applied in the field of data processing, can solve the problem of not providing, and achieve the effect of reducing resource occupation, facilitating query, and improving system performance

Pending Publication Date: 2021-12-17
BEIJING QIANXIN TECH +1
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The log system needs to support efficient online query of tens of billions of logs with complex conditions. This is a challenge for the CPU and memory resources in a stand-alone environment, and the current existing technologies do not provide corresponding solutions that can achieve better results. Realization of practical application effect

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log receiving and processing method and device, electronic equipment and storage medium
  • Log receiving and processing method and device, electronic equipment and storage medium
  • Log receiving and processing method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0068] In order to enable those skilled in the art to better understand the solutions of the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only It is an embodiment of a part of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

[0069] It should be noted that the terms "first" and "second" in the description and claims of the present invention and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a log receiving and processing method and device, electronic equipment and a storage medium. The log receiving and processing method comprises the following steps: receiving a log and caching the received log in a preset cache region; reading the log from the cache region, and analyzing the read log; enriching the analyzed log according to the type of the log, and adding required information associated with the log in the analyzed log; filtering the enriched logs, and extracting and converting corresponding fields in the logs; and storing the filtered log in a preset database. The data processing speed can be increased, the system performance can be improved, and resource occupation can be reduced.

Description

technical field [0001] The present application relates to the technical field of data processing, and in particular to a log receiving and processing method, device, electronic equipment and storage medium. Background technique [0002] In a resource-constrained environment (for example, limited memory and CPU), a single device generally needs to receive a large number of logs from multiple firewalls. Usually, the data volume of the logs received is about 10w / s; in addition, in While receiving logs, it is generally necessary to implement storage, statistics, analysis, and management functions for the received logs. Therefore, there are extremely high requirements for the performance and reliability of the log processing method. [0003] When processing logs, it is generally necessary to calculate and add multiple tags to each log in real time according to a custom policy. In addition, due to various needs such as traffic auditing, asset management, and security management, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F11/30G06F16/25H04L29/06
CPCG06F11/3072G06F11/3065G06F16/254H04L63/1425G06F2201/80
Inventor 罗盼杨涛左文建林元彬
Owner BEIJING QIANXIN TECH
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com