Unlock instant, AI-driven research and patent intelligence for your innovation.

A data block processing method and device

一种处理方法、数据块的技术，应用在通信领域，能够解决校验效率低下、无法持续的跟踪tablet数据块时间的变换状态、效率低下等问题，达到预警错乱与丢失、解决效率非常低下、准确错乱与丢失的效果

Active Publication Date: 2019-09-03
ALIBABA GRP HLDG LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Currently there is no ready-made method to track the tablet data blocks in the oceanbase database. Generally, when the tablet data blocks are missing or the tablet data blocks are inconsistent, manually search the root table in the oceanbase database to obtain the data information of the tablet data blocks for tracking. Now In the existing technology, the tablet data block information of each table is manually obtained from the oceanbase root table system table only when the tablet data block is lost or the tablet data block is inconsistent, and the tablet data block information of each table stored in the oceanbase root table is only The current latest tablet data block information, that is, the existing method can only obtain the current state data of the tablet data block, and cannot continuously track the changing state of the tablet data block over time
[0005] The existing verification method is to manually traverse the oceanbase storage server logs to obtain the relevant logs of the tablet data block, integrate the information of these logs, and compare it with the relevant data of the corresponding table's tablet data block in the oceanbase root table system table for verification Yes, the disadvantage of manually traversing the logs of the storage server of oceanbase is that the efficiency is very low; in addition, in order to prevent the disk space from being occupied by a large number of log files, oceanbase will regularly clean up the logs before a certain period of time. The log data of the tablet data block obtained from the storage server log is incomplete, which may lead to inaccurate verification results
[0006] Therefore, on the one hand, the existing technology cannot continuously track the transformation state of the tablet data block over time; on the other hand, the verification of the existing technology has the disadvantages of very low efficiency and inaccurate verification results

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data block processing method and device
  • A data block processing method and device
  • A data block processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0065] In order to overcome the shortcomings of the existing technology that cannot continuously track the transformation state of the tablet data block over time, and the verification efficiency is low and the verification result is inaccurate. This application proposes a data block processing method, such as figure 2 As shown, it is a schematic flow diagram of a data block processing method proposed in this application, which is applied to a system including a storage server, a control server and a merge server, and the method includes the following steps:

[0066] Step S201, when the control server receives the log carrying the tablet data block information sent by the storage server, the control server obtains the tablet data block information carried in the log.

[0067] In a preferred embodiment of the present application, this step specifically includes: the control server receives the log carrying the tablet data block information reported from the storage server, par...

Embodiment 2

[0085] The above description is the implementation flow of the application on the control server side. Correspondingly, this application also proposes the implementation flow of the above technical solution on the storage server side, as shown in image 3 As shown, it is a schematic flow chart of a data block processing method proposed in this application, the method is applied to a system including a storage server, a control server and a merge server, and the method includes the following steps:

[0086] Step S301, the storage server polls its own logs.

[0087] In a specific embodiment of the present application, this step is specifically: when the split or merge of tablet data blocks occurs on the storage server, a piece of log data will be generated in the local log file of the storage server, and the storage server will continuously poll its own log , so as to further determine whether new data information appears in the log.

[0088] Step S302, when the storage server ...

Embodiment 3

[0102] In order to further elaborate the technical solution of the present application, the technical solution of the present application is now described in conjunction with a specific application scenario. The specific application scenario of this embodiment is in a system including a storage server, a control server, and a merge server. This embodiment Deploy a storage server log parsing background program on the storage server, such as Figure 4a As shown, it is a schematic diagram of the process flow of the storage server log parsing background program in this application; the process flow of the storage server log parsing background program is as follows:

[0103] Step S401, after the log analysis background program is started, it continuously polls the log files generated by the storage server and reads the log data;

[0104] Step S402, the log parsing background program judges whether new log data is generated in the log file of the storage server;

[0105] If yes, ex...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present application discloses a data block processing method and device, the method comprising: when the control server receives the log carrying the tablet data block information sent by the storage server, acquiring the tablet data block information carried in the log; The server queries the tablet data block information in the root table; judges whether the tablet data block information carried in the log is consistent with the tablet data block information in the root table; combines the tablet data block information carried in the log with the The tablet data block information in the root table is summarized and stored, and if the judgment results are inconsistent, an alarm will be issued. In the embodiment of the present application, the changing state of the tablet data block can be continuously tracked, and the tablet data block can be checked efficiently and accurately.

Description

technical field [0001] The present application relates to the technical field of communications, and in particular to a data block processing method and a data block processing device. Background technique [0002] As cloud computing gradually becomes a reality, traditional databases have become increasingly difficult to support big data under cloud computing. In this context, distributed databases have developed rapidly. As an important part of cloud computing systems, distributed databases are becoming more and more mature, and will be widely used in various industries in the future, providing them with low-cost, easy-to-expand, and highly available data storage solutions. Oceanbase is currently a mainstream distributed database. Similar to other distributed databases, the oceanbase storage engine is implemented by combining the disks of thousands of ordinary PC servers for management, and the disks in each PC server are stored The engine is divided into a block of storag...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/22
CPCG06F16/2365G06F16/27G06F16/2358G06F16/00G06F11/327G06F2201/80
Inventor 饶志涛
Owner ALIBABA GRP HLDG LTD