Log transmission method and device, computing device and memory medium

A transmission method and log technology, applied in the field of log transmission, can solve problems such as unfavorable data standardization, low log transmission efficiency, and inability to determine key data, and achieve the effect of improving efficiency and data compression rate.

Active Publication Date: 2018-04-13
CHINA MOBILE GROUP JIANGSU +1
View PDF5 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, in the existing technical solutions, after Logstash collects the log data, it generally uses the built-in gzip algorithm to compress the data, but direct compression will make it impossible to judge key data after compression, which is not conducive to data standardization, and the log transmission efficiency is low. Low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log transmission method and device, computing device and memory medium
  • Log transmission method and device, computing device and memory medium
  • Log transmission method and device, computing device and memory medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] The characteristics and exemplary embodiments of various aspects of the present invention will be described in detail below. In order to make the purpose, technical solutions and advantages of the present invention more clear, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only configured to explain the present invention, not to limit the present invention. It will be apparent to one skilled in the art that the present invention may be practiced without some of these specific details. The following description of the embodiments is only to provide a better understanding of the present invention by showing examples of the present invention.

[0037] It should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a log transmission method and device, a computing device and a memory medium. The method comprises the steps of standardizing time parts of log lines into time data of a first preset length; compressing content parts of the log lines, thereby obtaining compressed content data; and combining the time data and the compressed content data into a sending datapacket according to a preset sequence. According to the scheme, the time parts in log data are standardized, a data compression ratio is improved, the follow-up system processing is facilitated, and the log transmission efficiency is improved.

Description

technical field [0001] The present invention relates to the technical field of network communication, in particular to a log transmission method, device, computing device and storage medium. Background technique [0002] Most of the current business support systems (including CRM\BOSS\BASS\BOMC, etc.) adopt a distributed architecture and transfer to the X86 platform, and the number of devices running applications has increased dramatically. At the same time, in order to maintain and realize end-to-end business monitoring, the system records a large number of logs for analyzing problems in case of failure. Existing solutions generally use Flume to collect logs and transmit them to the Kafka middleware for summary calculation and analysis on the stream processing platform. [0003] However, in the existing technical solutions, after Logstash collects the log data, it generally uses the built-in gzip algorithm to compress the data, but direct compression will make it impossibl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L12/24
CPCH04L41/069
Inventor 王鑫胡炜张愚
Owner CHINA MOBILE GROUP JIANGSU
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap