Data reading method and device

A data reading and data technology, applied in the computer field, can solve problems such as low data reading efficiency, and achieve the effects of avoiding IOPS parameter restrictions, improving efficiency, and reducing the number of I/O requests.

Active Publication Date: 2019-10-29
ALIBABA GRP HLDG LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of this, the application provides a data reading method and device to solve the technical problem of low data reading efficiency in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data reading method and device
  • Data reading method and device
  • Data reading method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The implementation of the present invention will be described in detail below with reference to the drawings and examples, so as to fully understand and implement the implementation process of how to use technical means to solve technical problems and achieve technical effects in the present invention.

[0028] For the data volume of one page size for each I / O request that exists, the problem of low data reading efficiency will be caused. The inventors of the present application have found that the existing InnoDB database engine provides a pre-reading scheme, which The working principle is: in the process of scanning the leaf node page (leaf page), an asynchronous background thread is started to perform asynchronous pre-reading of the next leaf node page in advance to improve the reading efficiency, but each I / O The request is still for the data of a leaf node page. The improvement of reading efficiency lies in the pre-reading of asynchronous threads. The overall number...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A data reading method and device. The data reading method comprises: during a process of scanning an index clustering table, scanning leaf nodes and recording page numbers of the leaf nodes (S10); and merging I / O requests of the leaf nodes with consecutive page numbers into one I / O request (S11). Because data of multiple leaf nodes in physically consecutive storage locations is read by means of one I / O request, the data volume read by each I / O request is increased, thereby fully utilizing the overall disk throughput. In addition, to read data of the same storage volume, the number of I / O requests that need to be initiated can be reduced, thereby avoiding the limitation of the disk IOPS parameter, and effectively improving the data reading efficiency.

Description

technical field [0001] The invention belongs to the technical field of computers, and in particular relates to a data reading method and device. Background technique [0002] In relational databases, two-dimensional tables are usually used for data storage. Two-dimensional tables usually have two implementation methods, one is the implementation of the heap table, and the other is the implementation of the index cluster table. Among them, the heap table stores data in the free space in an unordered manner; the index cluster table is stored in the B-tree structure according to the order of the index keys. [0003] The B-tree of the indexed cluster table uses a page as a unit as a node, and uses a page number to locate a page. Nodes include three types, root (root) nodes, branch (branch) nodes and leaf (leaf) nodes. The data of the database is stored in the leaf nodes. In the process of reading data, it is necessary to scan the index cluster table. The process of scanning ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/22G06F16/2453G06F16/28
CPCG06F16/2246G06F16/2453G06F16/284G06F16/00
Inventor 赵建伟
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products