A data writing method, data reading method, device and electronic device

A data writing and data technology, applied in the field of data processing, can solve the problems of large amount of data, poor distribution effect, storage node processing efficiency cannot meet business needs, etc., and achieve the effect of improving processing efficiency and good distribution effect.

Active Publication Date: 2022-08-05
BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, in some typical scenarios such as e-commerce, after the data table is split, the obtained sub-table may have the problem of excessive data volume. For example, a large amount of data is stored in one sub-table, so the distribution effect is not good. As a result, the processing efficiency of storage nodes still cannot meet business needs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data writing method, data reading method, device and electronic device
  • A data writing method, data reading method, device and electronic device
  • A data writing method, data reading method, device and electronic device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0077] The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art based on the present application fall within the protection scope of the present invention.

[0078] In the related art, in a distributed database system, a data splitting method is usually adopted to split a data table into several sub-tables according to specified rules, wherein the sub-tables may also be called physical sub-tables. In this way, by reducing the size of a single sub-table, the processing efficiency of a single engine (ie, a single storage node) is improved, and ultimately the processing efficiency of the dis...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Embodiments of the present invention provide a data writing method, a data reading method, an apparatus and an electronic device, which are applied in the field of data processing. The writing method includes: after receiving a writing request for a target file, obtaining the write the target data to be written carried in the request; determine the first sub-table for storing the target data based on the first data belonging to the split key in the target data; the second data of the implicit field, from a plurality of sub-tables corresponding to the first sub-table, determine the sub-table for storing the target data as the sub-table to be used; write the target data into the Subtables to be used. Through this solution, the processing efficiency in the distributed database system can be improved.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a data writing method, a data reading method, a device and an electronic device. Background technique [0002] In a distributed database system, any file is split into multiple sub-tables, and the split sub-tables are distributed and stored in multiple storage nodes, and data is written and data is written to each sub-table through the management node. read, etc. Among them, the splitting of the sub-table depends on the split key, which is one or more fields in the multiple fields in the file; and the sub-table in which the business data to be written is stored depends on the business The data content in the data that belongs to the split key. [0003] However, in some typical scenarios such as e-commerce, after the data table is split, the resulting sub-table may have a problem of excessive data volume. For example, a large amount of data is stored in one sub-table, so that the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/27G06F16/22
Inventor 王天宇
Owner BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap