Log parsing method, equipment and computer readable medium

A parsing method and log technology, applied in the field of communications, can solve the problems of long data synchronization time, cumbersome advertising log data parsing steps, and low timeliness, and achieve the effects of improving processing timeliness, reducing network overhead, and reducing processing time.

Inactive Publication Date: 2018-08-03
SHENZHEN GIONEE COMM EQUIP
View PDF0 Cites 31 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

It can be seen that the current log analysis method data synchronization takes a long

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log parsing method, equipment and computer readable medium
  • Log parsing method, equipment and computer readable medium
  • Log parsing method, equipment and computer readable medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Reference herein to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present invention. The occurrences of this phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is understood explicitly and implicitly by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0030] Based on the embodiments of the present invention, all other embodiments obtained ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a log parsing method, equipment and a computer readable medium. The method comprises the steps that a log processing request sent by an application server isreceived, wherein the log processing request carries initial log data and a target cluster theme corresponding to the initial log data; streaming data processing is conducted on the initial log data to obtain target log data; and the target log data is written into a partition under the target cluster theme. According to the method, data synchronization operations between a service server and a big data platform when a log is generally parsed through an off-line program can be reduced, the network overhead of data transmission and the IO overhead of a disk are reduced, the processing time is shortened, therefore, the processing timeliness of log parsing is improved, and by analyzing a log parsing result, the advertising popularity and the user distribution condition can be obtained, the expense of an advertiser can be reasonably charged, and the industry development direction can be provided.

Description

technical field [0001] The present invention relates to the technical field of communications, and in particular to a log parsing method, device and computer-readable medium. Background technique [0002] Advertising log data can be a treasure trove of valuable information. For example, advertising media service platform (Supply Side Platform, SSP), advertising trading platform (Ad Exchange, ADX), advertiser advertising demand platform (Demand-Side Platform) can be counted through advertising log data. , DSP) indicators, such as ad request, ad return, exposure (display) volume, click volume, download volume, installation volume, activation volume, activation volume, etc., conduct data analysis to obtain valuable information, which is convenient for all platforms Operation and maintenance. [0003] At present, the advertisement log will be stored in the local disk of the network server where the advertisement application is deployed, and the advertisement log analysis is to ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L12/24H04L29/08
CPCH04L41/069H04L67/1001
Inventor 杨仪军
Owner SHENZHEN GIONEE COMM EQUIP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products