Supercharge Your Innovation With Domain-Expert AI Agents!

Log processing method and device

A processing method and log technology, applied in the field of big data, can solve the problems of low efficiency, easy omission, cumbersome acquisition of slow logs, etc., and achieve the effect of improving query analysis

Pending Publication Date: 2021-06-11
CCB FINTECH CO LTD
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For a traditional stand-alone MySQL database, you can directly view the slow log files stored in the database server; for a distributed database such as GoldenDB, you must obtain slow log files on each node to analyze the slow log files of the entire system. The scale of distributed database clusters is large. Obtaining slow logs on each node will be very cumbersome and easy to miss. It takes a lot of time and energy to analyze the slow logs on each node separately. The efficiency is very low, and transactions across nodes cannot be analyzed. conduct overall analysis
If only the slow log files on a certain node of the distributed database are analyzed, the slow query situation of the entire database system cannot be fully analyzed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log processing method and device
  • Log processing method and device
  • Log processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] Exemplary embodiments of the present invention are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present invention to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0051] figure 1 is a schematic flow chart of the main steps of the log processing method of the embodiment of the present invention, such as figure 1 As shown, the method includes:

[0052] Step S101: Identify the role of the database node, and determine the storage path of the log stored on the database node according to the role;

[0053] Step S102: Collect log data b...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a log processing method and device, and relates to the technical field of big data. A specific embodiment of the method comprises the following steps: identifying a role of a database node, and determining a storage path of a log stored on the database node according to the role; based on the storage path, collecting log data, and sending the log data to a preset message queue; and obtaining the log data from the message queue, and storing the log data. According to the embodiment, the log data dispersed on each node of the cluster can be comprehensively collected and uniformly stored, and a plurality of indexes are established, so that query analysis from multiple dimensions is facilitated, and the analysis efficiency is improved.

Description

technical field [0001] The present invention relates to the technical field of big data, in particular to a log processing method and device. Background technique [0002] During performance testing, it is often necessary to analyze database-related performance problems through slow logs. For a traditional stand-alone MySQL database, you can directly view the slow log files stored in the database server; for a distributed database such as GoldenDB, you must obtain slow log files on each node to analyze the slow log files of the entire system. The scale of distributed database clusters is large. Obtaining slow logs on each node will be very cumbersome and easy to miss. It takes a lot of time and energy to analyze the slow logs on each node separately. The efficiency is very low, and transactions across nodes cannot be analyzed. Do a holistic analysis. If only the slow log files on a certain node of the distributed database are analyzed, the slow query situation of the entir...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/17G06F16/18G06F9/54
CPCG06F16/1734G06F16/1805G06F16/1815G06F9/546
Inventor 王川宋继兵
Owner CCB FINTECH CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com