Log organization structure clustered based on transaction aggregation and method for realizing corresponding recovery protocol thereof

An organizational structure and log technology, applied in special data processing applications, instruments, electrical and digital data processing, etc., can solve problems such as scalability bottlenecks and large volume of a single log, improve operating efficiency, reduce storage costs, and remove waiting relationships. Effect

Inactive Publication Date: 2012-10-31
天津神舟通用数据技术有限公司
View PDF3 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

First of all, the volume of a single log is relatively large. Since each log must record the log sequence number S, transaction number A, and the previous item Sprev of the transaction log, the combined length of these fields often exceeds 20 bytes. When it is short, the space occupied by these domains is often close to 1 / 3 or even 1 / 2 of the entire log file space; secondly, because the action of generating logs must be globally synchronized to ensure the unique incrementality of the log sequence, and the current large computer often With dozens or even hundreds of CPUs, when updates occur intensively, it will cause scalability bottlenecks

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log organization structure clustered based on transaction aggregation and method for realizing corresponding recovery protocol thereof
  • Log organization structure clustered based on transaction aggregation and method for realizing corresponding recovery protocol thereof
  • Log organization structure clustered based on transaction aggregation and method for realizing corresponding recovery protocol thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] Below in conjunction with accompanying drawing, the present invention is described in further detail:

[0028] see figure 1 , which is an example diagram of the overall organizational structure of the log file. The log file is divided into log slices of different sizes, and the length of each log slice is an integer multiple of the basic unit of the external storage device. Each log slice is exclusive to one transaction, and different log slices of the same transaction are connected through the Sprev field on the log slice.

[0029] see figure 2 , the figure is a schematic diagram of the organizational structure of a single log slice. There are some fixed-length fields in the header of each log slice, which include:

[0030] 1) The unique serial number S of the log piece, according to which the log piece can be uniquely located. It should be noted that in some transactional data management systems, absolute displacement is used to locate log records. In this case, S...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a log organization structure clustered according to transaction aggregation and a recovery protocol based on the log organization structure clustered, which can be applied to a transactional data management system of a large-sized computer. A log file is sequentially organized to a plurality of log fragments and each log fragment is used for storing the log content of the same transaction and reserving a transaction number as well as a preceding log fragment pointer of the transaction; a data page number involved in a log entry of the same fragment is stored in the form of an array. When the system is operating, each transaction only writes its own log fragment and writes the log fragment in the log file when the transaction is submitted. In a recovering process, the system can be recovered to a lasting and consistent state by scanning all the log fragments for remake and returning the log fragments of all the active transactions for return. The problem of producing bottlenecks during writing logs in the traditional transactional data management system is resolved and log amount of the system can be effectively reduced.

Description

technical field [0001] The design of the invention belongs to the field of data information processing, and in particular relates to a transactional data management system that uses log technology to ensure data consistency. Background technique [0002] In the Fung computer architecture, persistent data is stored on slower, larger external storage devices (such as hard disks), and when data is accessed, it is read into faster, smaller external storage devices. In a memory device (such as RAM) and accessed by the CPU. However, due to performance requirements, when data is updated, only its memory image is updated, and the update of external memory is delayed by the buffer management unit. [0003] In a transactional data management system, a single transaction—that is, an operation process composed of several updates—is regarded as a basic unit of work, which has two important properties. One is consistency, that is, all pairs of data The updates must be seen at the same t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F11/34
Inventor 徐昶冯柯蔡华林蒋志勇何清法周丽霞顾云苏曹晖李阳饶路
Owner 天津神舟通用数据技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products