Data storage method and device, electronic equipment and storage medium

A data storage and data technology, applied in the computer field, can solve the problems of long response time and low concurrent utilization, and achieve the effect of improving concurrency efficiency and reducing response time.

Pending Publication Date: 2021-03-12
SHANGHAI DAMENG DATABASE
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The concurrency utilization rate of this method is not high, and the response time is long

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method and device, electronic equipment and storage medium
  • Data storage method and device, electronic equipment and storage medium
  • Data storage method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0050] figure 1 It is a flow chart of a data storage method provided by Embodiment 1 of the present invention. This embodiment is applicable to the case where one or more sub-plans have a dependency relationship during execution. This method can be executed by a data storage device. The The device can be realized by means of software and / or hardware, and can be specifically inherited in an electronic device with storage and computing capabilities for data storage.

[0051]In the embodiment of the present invention, the parent plan can be understood as the parent node of the data storage node and the data loading node, and is used to schedule the data storage node and the data loading node to perform instruction operations. Among them, the data storage node and the data loading node are parallel sub-plans of the parent plan. The data storage node can be understood as a storage node or a data storage operator in a sub-plan in the parent plan, which is used to store correspondin...

Embodiment 2

[0089] figure 2 It is a flow chart of a data storage method provided by Embodiment 2 of the present invention. The technical solution of the embodiment of the present invention is further refined on the basis of the above technical solution, and is applied to the data loading node. The method specifically includes the following steps:

[0090] Step 210, obtaining the current access status of the data storage node;

[0091] In the embodiment of the present invention, the data loading node receives the data loading instruction sent by the parent plan according to the data loading requirement, so that the data loading node receives the data loading control authority of the parent plan. The data loading node performs corresponding data loading operations according to the data loading instructions sent by the parent plan. Before the data loading node performs corresponding operations, it needs to register with the corresponding data storage node before accessing.

[0092] Step 2...

Embodiment 3

[0107] image 3 It is a schematic structural diagram of a data storage device in Embodiment 3 of the present invention, which is applied to a data storage node, and the device includes:

[0108] The data storage module 310 is configured to determine the memory space corresponding to the data to be stored according to the acquired data to be stored of the left child node, the memory space includes one or more memory slices, and each memory slice corresponds to the to-be-stored data store subdata in the data;

[0109] The read trigger module 320 is configured to, after storing the sub-data into the corresponding memory slice, trigger the data loading node to read the sub-data stored in the corresponding memory slice until all the data to be stored is stored into the corresponding memory space.

[0110] Further, the data storage module 310 is specifically used for:

[0111] Determine the number of memory slices in the memory space corresponding to the data to be stored accordin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data storage method and device, electronic equipment and a storage medium. The method comprises the steps that according to obtained to-be-stored data of a left child node, amemory space corresponding to the to-be-stored data is determined, the memory space comprises one or more memory slices, and each memory slice corresponds to sub-data in the to-be-stored data; and after the sub-data is stored in the corresponding memory slice, a data loading node is triggered to read the sub-data stored in the corresponding memory slice until the to-be-stored data is completely stored in the corresponding memory space. According to the embodiment of the invention, the concurrence efficiency is effectively improved, and the response time is reduced.

Description

technical field [0001] The embodiments of the present invention relate to computer technology, and in particular to a parallel scheduling method, device, electronic equipment and storage medium. Background technique [0002] In order to make full use of multi-core CPU physical resources and improve the efficiency of query execution, the database management system usually supports multi-threaded concurrent execution. The framework of parallel query has a producer-consumer model. This model divides the query plan according to the data sending operator and the data receiving operator to obtain one or more sub-plans. The sub-plans are scheduled according to the dependencies during execution. Ensure that the dependent sub-plan C (ie the producer) schedules dependent on its parent sub-plan P (ie the consumer) after the execution is completed or the data is output for the first time. [0003] In the framework based on the producer-consumer concurrent scheduling model, the common s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/0644G06F3/0655
Inventor 宋鑫韩朱忠
Owner SHANGHAI DAMENG DATABASE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap