Method and device for collection of distributed logs

A collection method and collection device technology, applied in the field of log system, can solve problems such as time-consuming and energy-consuming, not necessarily fast and effective problem solving, so as to achieve the effect of reducing workload and ensuring effectiveness

Pending Publication Date: 2017-08-08
BEIJING 58 INFORMATION TECH
View PDF5 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Solving this kind of problem requires a lot of time and energy of developers from different lines of business, and it may not be able to solve the problem quickly and effectively

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for collection of distributed logs
  • Method and device for collection of distributed logs
  • Method and device for collection of distributed logs

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0049] In the first embodiment of the present invention, a distributed log collection method, such as figure 1 As shown, the process executed on the client side includes the following specific steps:

[0050] Step S101, when a business system in the client invokes the middleware corresponding to the business system based on a request, collect data related to the business system call through the preset buried point in the middleware, and collect the collected data The data is populated into log data along with middleware runtime data. The preset buried point is a segment of program executed at a set time point during the execution of the middleware.

[0051] Specifically, the data related to the business system call includes: the name of the business system, its type, the globally unique ID, the globally unique sequence ID, the current system time, the IP address and port of the calling business system, and the called The IP address and port of the business system on the othe...

no. 3 example

[0070] The third embodiment of the present invention corresponds to the first embodiment. This embodiment introduces a distributed log collection device, which is set on the client side. The device includes the following components:

[0071] The middleware module is used to collect the data related to the business system call through the preset buried point in the middleware when the business system in the client calls the middleware corresponding to the business system based on the request, and collects the The data and the runtime data of the middleware are filled into the log data; the log data is sent to the log collection server for unified storage.

[0072] Specifically, the data related to the business system call includes: the name of the business system, its type, the globally unique ID, the globally unique sequence ID, the current system time, the IP address and port of the calling business system, and the called The IP address and port of the business system on the ...

no. 4 example

[0087] The fourth embodiment of the present invention is a distributed log collection device. The device in this embodiment is substantially the same as that in the first embodiment. The difference is that the device in this embodiment also includes:

[0088] The request screening module is configured to select a corresponding number of requests from all the requests received by the business system according to a preset sampling rate, and call a middleware module for the selected requests.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and device for collection of distributed logs. Processes executed on a client side comprise (1) data related to calling of a service system is collected when the service system in the client side calls middleware corresponding to the service system based on a request, and the collected data together with running time data of the middleware will be filled into log data; and (2) the log data is sent to a log collection server for uniform storage. According to the invention, some log data which can reflect service logics can be collected during working courses of a large-scale service system cluster in time.

Description

technical field [0001] The invention relates to the technical field of log systems, in particular to a method and device for collecting distributed logs. Background technique [0002] At present, the services provided by Internet companies are all implemented based on complex large-scale distributed business system clusters, that is, a service is built on different business system clusters, and a front-end request will call multiple different back-end businesses. There are many ways to call, such as: remote procedure call, database, distributed cache, distributed file system, etc. These back-end business system clusters may be developed by different teams, or may be implemented using different programming languages, may be distributed on multiple servers, or may span multiple different data centers. With the continuous expansion of the company's business, business requirements will only increase, and the back-end business logic will become more and more complex. Developers ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30H04L12/24
CPCG06F16/1824G06F16/1815H04L41/069
Inventor 姚远王宇博郝新斌
Owner BEIJING 58 INFORMATION TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap