Unlock instant, AI-driven research and patent intelligence for your innovation.

Data writing and reading method and device and data reading and writing system

A data writing and data reading technology, which is applied in the field of devices, data writing and reading methods, and data reading and writing systems, can solve problems such as consuming system performance, reduce scanned data, eliminate system performance bottlenecks, and alleviate The effect of consuming system performance

Pending Publication Date: 2022-07-29
BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of this application is to provide a data writing and reading method, device and data reading and writing system, which can alleviate the problem of consuming system performance caused by the engine write amplification problem in the prior art, and on the other hand, when performing the reading operation , reducing the scanned data and eliminating potential system performance bottlenecks

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data writing and reading method and device and data reading and writing system
  • Data writing and reading method and device and data reading and writing system
  • Data writing and reading method and device and data reading and writing system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The technical solutions of the present application will be clearly and completely described below with reference to the embodiments. Obviously, the described embodiments are part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

[0032] At present, for key-value type data with a large byte length, due to the write amplification problem of the engine, a large amount of data needs to be written, which easily leads to system performance degradation; and when the system reads data, it needs to scan a large amount of data, which is easy to produce system bottlenecks.

[0033] Based on this, the embodiments of the present application provide a data writing and reading method, device, and data reading and writing system, which can allevi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data writing and reading method and device and a data reading and writing system. The data writing method is applied to a storage server. The method comprises the steps of receiving a data writing request of a user; wherein the data writing request carries a target key value pair; the target key value pair comprises a target key and a target key value; if the byte length of the target key value is greater than a preset length threshold, writing the target key value into a specified file of a target storage engine of the storage server; generating a new target key value corresponding to the target key value based on the position of the target key value in the specified file; and writing the new target key value and the target key as a new target key value pair into the target storage engine. The problem of system performance consumption caused by the engine write amplification problem in the prior art can be relieved, on the other hand, when data reading operation is carried out, scanned data is reduced, and potential system performance bottlenecks can be eliminated.

Description

technical field [0001] The present application relates to the technical field of software testing, and in particular, to a data writing and reading method, device and data reading and writing system. Background technique [0002] The distributed table storage service is a fully managed distributed key value (Key Value) database service, which mainly stores user data in the form of tables. Tables created by users are stored in a certain order, and are horizontally divided into multiple shards. The shard data is stored on the storage server, and the corresponding metadata (the key range of the shard and the corresponding storage server) is stored on the management server. , and the proxy server provides services to the outside world. [0003] Among them, the sharded data stored on the storage server generally adopts the method of single sharding and one engine, such as the commonly used single-machine database such as leveldb and rocksdb, etc. Such engines generally have such...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/06G06F16/22
CPCG06F3/067G06F16/2282G06F16/2228
Inventor 张作青
Owner BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD