A data operation method and device

A data operation and access request technology, applied in the field of clustering algorithms, can solve the problems of inability to use new storage media with high concurrency and low efficiency of data access process, so as to avoid the cost of process switching, reduce CPU overhead, and reduce CPU consumption Effect

Active Publication Date: 2019-02-26
SHANGHAI YITU NETWORK SCI & TECH
View PDF6 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The embodiment of the present invention solves the problem in the prior art that the high concurrency capability of the new storage medium cannot be utilized, resulting in low efficiency of the entire data access process, by providing a data operation method and device

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data operation method and device
  • A data operation method and device
  • A data operation method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] In order to better understand the above-mentioned technical solution, the above-mentioned technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0048]B+ tree index is a common data index structure in the computer field, which is used to organize data or files in an orderly manner, so as to provide efficient data query. The B+ tree is a tree structure composed of several nodes. The bottom node is called a leaf node, which is responsible for storing the actual data in an orderly manner according to the key value of the data; the rest of the nodes are called non-leaf nodes, and each non-leaf node Stores the key value boundaries of the child nodes of the next layer. When inserting, deleting or querying, according to the key value involved, the indexing algorithm starts from the top node of the B+ tree (called the root node), and gradually visits the corresponding child nodes according to the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data operation method and device. The method comprises the following steps: determining whether the current time reaches the inquiry time of the completion queue of the NVMeinterface, wherein the completion queue of the NVMe interface stores the processing result after the NVMe interface processes the IO access request; If the inquiry time is not reached, obtaining a first IO access request from a queue to be submitted of the NVMe interface, wherein the IO access request of a data operation request with a ready state is stored in the queue to be submitted; sending the first IO access request to the NVMe interface, and marking the state of the first data operation request corresponding to the first IO access request as a waiting state; returing to the step of determining whether the current time reaches the query time of the completion queue of the NVMe interface until the query time is reached or there is no IO access request in the queue to be submitted of the NVMe interface.

Description

technical field [0001] The invention relates to the field of clustering algorithms, in particular to a data operation method and device. Background technique [0002] In recent years, storage hardware has continued to evolve, resulting in new storage media such as NAND Flash-based SSD (Solid State Disk), PCM, and 3D-XPoint Optane. These new storage media exhibit data access performance far exceeding that of disk. [0003] In order to improve data access efficiency, a common method is to process multiple IO operations in parallel, so as to maximize the use of the high concurrency capability inside the SSD and improve indexing efficiency. However, this method uses synchronous IO to read and write data blocks, and needs to run a large number of index threads at the same time, resulting in significant process switching costs and operating system thread scheduling costs. A large amount of CPU is wasted, and the efficiency of data reading and writing is very low. Contents of t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F13/16
CPCG06F13/1642
Inventor 王立张振杰周健
Owner SHANGHAI YITU NETWORK SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products