Method and device for processing log data

A data processing and log technology, applied in the database field, can solve problems such as stand-alone queue bottlenecks, scalability and processing performance limitations, stand-alone queues do not support parallel writing of transaction logs, etc., to ensure sequence and determinism, and improve scalability And processing performance, the effect of solving the bottleneck of the stand-alone queue

Active Publication Date: 2017-03-15
ALIBABA GRP HLDG LTD
View PDF11 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] For a distributed database system, since the stand-alone queue does not support parallel writing to the transaction log, each application server needs to wait in line for the writing of the transaction log, which will be limited in scalability and processing performance
However, as far as the current technology is concerned, in order to ensure that the transactions are executed serially in the order of submission, the distributed database system also has to use a stand-alone queue, facing the bottleneck of the stand-alone queue

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for processing log data
  • Method and device for processing log data
  • Method and device for processing log data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

[0052] In the existing technology, in order to ensure that transactions are executed serially in the order of submission, no matter it is a stand-alone database or a distributed database system, only a stand-alone queue can be used to manage the transaction log, so as to ensure that the transactions are in the order of submission through the first-in-first-out...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The application provides a method and device for processing log data. The method is characterized in that multiple log queues are used to store affair logs; and parallel writing of the affair logs is allowed. During reading of the affair logs, the affair logs in each log queue between the at least two log queues stored in each time period is read successively according to a reading sequence of the designated log queues in combination with storage time of the affair logs. In this way, succession and certainty of the affair logs during queue exiting can be ensured; basic demands of a database for the affair logs can be satisfied; a stand-alone queue bottleneck faced by a distributed database system in the aspect of affair log management can be solved; and expansibility and processing performance of the distributed database system in the aspect of affair logs can be improved.

Description

[0001] 【Technical field】 [0002] The present application relates to the technical field of databases, in particular to a log data processing method and device. [0003] 【Background technique】 [0004] The transaction log is one of the important parts of the database, which mainly records the transaction behavior on the corresponding database and the log file for modifying the database. Databases use transaction logs to ensure features such as durability (Durability) and transaction rollback (Rollback). In the prior art, in order to ensure that the transactions can be executed serially according to the order of submission, a stand-alone queue is used to manage the transaction logs, so as to ensure the serial execution of the transactions through the first-in-first-out of the transaction logs. [0005] For a distributed database system, since the stand-alone queue does not support parallel writing to the transaction log, each application server needs to wait in line for the wri...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/1815G06F16/182G06F16/00
Inventor 王晶昱
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap