Log data processing method and device, computer device and storage medium

A data processing and log technology, applied in the Internet field, can solve problems such as time-consuming and low efficiency in obtaining email sending results

Active Publication Date: 2019-03-08
PING AN TECH (SHENZHEN) CO LTD
View PDF7 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the traditional technology, due to the large amount of information contained in the log file, there is a lot of useless information. When the mail gateway parses the log file to obtain the mail sending result, it takes a lot of time, resulting in low efficiency in obtaining the mail sending result.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log data processing method and device, computer device and storage medium
  • Log data processing method and device, computer device and storage medium
  • Log data processing method and device, computer device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

[0047] The log data processing method provided by this application can be applied to such as figure 1shown in the application environment. Wherein, the mail gateway 104 and the database 108 respectively communicate with the log server 106 through the network. After the mail gateway 104 sends the mail, the log file is output asynchronously, and the log file is pushed to the log server 106 for parsing. For the log files that need to be parsed, the log server 106 selects according to the order of creation time, and adds the selected log files to the first file queue , and t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The application relates to the basic operation technology, and discloses a log data processing method and device, a computer device and a storage medium. The method comprises the following steps of obtaining the creation time of each log file to be analyzed in the current log file collection to be analyzed, and selecting a preset number of log files to be analyzed to write into the first file queue according to the order of the creation time; calling a plurality of first threads to split the log files to be parsed to obtain the receiving log files and the state log files corresponding to eachlog file to be parsed; writing the received log file to the second file queue; calling a plurality of second threads to read the received log file to extract a first identification and a second identification associated with each other and store the associated identification in a database; selecting a target state log file from the split state log file, and writing the target state log file into athird file queue; calling the third thread to read the target status log file to extract the status description information and store it in the database.

Description

technical field [0001] The present application relates to the technical field of the Internet, in particular to a log data processing method, device, computer equipment and storage medium. Background technique [0002] With the rapid development of Internet technology, e-mail has gradually replaced paper letters as a common means of communication for people. In the process of sending e-mail, the mail gateway plays an important role. After the mail gateway (such as ironport gateway equipment) sends the mail, The processing status of each email will be recorded through the asynchronous output log, and the sending result of the email can be obtained by parsing the log. [0003] In the traditional technology, due to the large amount of information contained in the log file, there is a lot of useless information. When the mail gateway parses the log file to obtain the mail sending result, it needs to spend a lot of time, resulting in low efficiency in obtaining the mail sending r...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/18
CPCY02D10/00
Inventor 雷佼俊何蓉苏曼蓝
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap