Unlock instant, AI-driven research and patent intelligence for your innovation.

Distributed log processing method and device, medium and electronic equipment

A processing method and distributed technology, applied in the Internet field, can solve the problems of large amount of log data, large computing power, and inability to achieve efficient log management, and achieve the effects of efficient log management, improved performance, and saving computing power and storage space.

Pending Publication Date: 2021-09-24
SHANGHAI PUDONG DEVELOPMENT BANK
View PDF11 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The amount of log data is large, the distribution is scattered, and management is difficult. The existing log management methods cannot achieve efficient management of logs
In the process of collection, storage and query, it usually consumes a lot of computing power and takes up a lot of storage space

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed log processing method and device, medium and electronic equipment
  • Distributed log processing method and device, medium and electronic equipment
  • Distributed log processing method and device, medium and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0026] Figure 1A It is a flow chart of the distributed log processing method provided in Embodiment 1 of the present application. This embodiment is applicable to any distributed log management scenario, and the method can be executed by the distributed log processing device provided in the embodiment of the present application. The The device can be implemented by software and / or hardware, and can be integrated into electronic equipment.

[0027] like Figure 1A As shown, the processing method of the distributed log includes:

[0028] S110, perform distributed log information collection on the target method through a preset entry point, and write the collected log information into a log file.

[0029] This solution is implemented by a platform capable of generating logs, and the platform may include one or more network devices, systems, service programs, and the like. The distributed storage method may be a distributed storage method. The distributed storage method is a dat...

Embodiment 2

[0046] This embodiment is a preferred embodiment provided on the basis of the foregoing embodiments. figure 2 It is a flow chart of distributed log processing provided by Embodiment 2 of the present invention, and this embodiment is optimized on the basis of the foregoing embodiments.

[0047] like figure 2 As shown, the method of this embodiment specifically includes the following steps:

[0048] S210, perform distributed log information collection on the target method through a preset entry point, and write the collected log information into a log file.

[0049] S220. Determine the synchronization rule of the log file according to the type of the log file; and determine the level of the log file according to the configuration information; wherein the level includes a program running level and a method performance level.

[0050] S230. Determine the processing result of the log file according to the synchronization rule of the log file and according to the corresponding r...

Embodiment 3

[0066] image 3 It is a structural block diagram of a distributed log processing device provided by Embodiment 3 of the present invention. The device can execute the distributed log processing method provided by any embodiment of the present invention, and has corresponding functional modules and beneficial effects for executing the method. like image 3 As shown, the device may include:

[0067] The log information writing module 310 is used to perform distributed log information collection on the target method through the preset entry point, and write the collected log information into the log file;

[0068] The level determination module 320 of the log file is used to determine the synchronization rule of the log file according to the type of the log file; and determine the level of the log file according to the configuration information; wherein, the level includes a program operation level and a method performance level ;

[0069] The log file processing result determi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a distributed log processing method and device, a medium and electronic equipment. The method comprises the steps: performing distributed log information collection on a target method through a preset entry point, and writing the collected log information into a log file; determining a synchronization rule of the log file according to the type of the log file; determining the level of the log file according to the configuration information, with the level comprising a program operation level and a method performance level; determining a processing result of the log file according to the synchronization rule of the log file and a corresponding relation between a preset printing screening condition of the log file and the level of the log file; wherein the processing result comprises a printing log file and a non-printing log file. According to the technical scheme, the problem of high resource consumption in the log processing process can be solved, efficient log management is achieved, and the performance of a distributed system is improved.

Description

technical field [0001] The embodiments of the present application relate to the technical field of the Internet, and in particular, to a distributed log processing method, device, medium, and electronic equipment. Background technique [0002] With the rapid development of Internet technology and the continuous expansion of the number of users, event records, namely logs, are generated all the time during the operation of network equipment, systems and service programs. Each line of log records the description of related operations such as date, time, user and action. [0003] At present, log collection and storage are managed in a centralized manner. However, with the continuous growth of business volume, the scale of log data is increasing rapidly. How to store massive log data and optimize the query efficiency of logs is an urgent task. [0004] The amount of log data is large, the distribution is scattered, and management is difficult. The existing log management method...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/17G06F16/18G06F16/182
CPCG06F16/1734G06F16/1815G06F16/182
Inventor 王继学沈忱唐明锋
Owner SHANGHAI PUDONG DEVELOPMENT BANK
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More