Log data processing method and device, and business system

A data processing device and data processing technology, applied in the field of databases, can solve the problems of limited parallelism of the log processing system, restricting the throughput of the log system, etc., and achieve the effect of increasing throughput and increasing parallelism

Inactive Publication Date: 2018-04-17
ALIBABA GRP HLDG LTD
View PDF8 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] For the implementation of the existing log system, since each log processing system needs to read the log data generated by the corresponding log source system in c

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log data processing method and device, and business system
  • Log data processing method and device, and business system
  • Log data processing method and device, and business system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0055] Further, in an optional implementation manner, a ring queue is assigned to each log source, the ring queue has a read location and a write location, and the ring queue has a certain size. Optionally, the ring queue can be designed as a memory space with a fixed size, but is not limited thereto. In this embodiment, the log data may be compressed according to the ring queue control, specifically referring to controlling the size of the log data that needs to be compressed. Such as image 3 Shown is a schematic diagram of log data compression based on ring queues. Specifically, the implementation of compressing the log data of each log source based on the ring queue includes:

[0056] For the log data of each log source, input the log data of the log source into the ring queue corresponding to the log source in chronological order; when the ring queue corresponding to the log source meets the set reading conditions, read The log data in the ring queue corresponding to t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a log data processing method, a log data processing device and a business system. The log data processing method comprises the steps of acquiring to-be-processed log data; carrying out distribution processing on the to-be-processed log data according to a distribution identifier to obtain the log data of each log source, wherein each value of the distribution identifier corresponds to one log source; respectively processing a corresponding business and according to the log data of each log source. According to the log data processing method, the log data processing device and the business system, the business may be conducted dependent on the log data, the parallelism of the businesses is improved and the throughput of a log system is enhanced.

Description

technical field [0001] The present application relates to the technical field of databases, in particular to a log data processing method, device and business system. Background technique [0002] Logging is a relatively broad concept in the computer field, and any application system may generate log data. Log data is actually a record of events or behaviors stored in chronological order. Log data usually includes the event subject, time of occurrence, event content, etc. In the log system, log data generated by all log sources is uniformly stored in chronological order. [0003] With the development of business requirements, many business scenarios relying on log data have emerged, such as tracking the running status of log sources, locating abnormal points in log sources, building search engines, and updating local failures Business scenarios for log caching, etc. Among them, each business system that relies on log data is called a log processing system respectively. F...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/128G06F16/1815
Inventor 楼江航
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap