A data loading method and device
A data loading and data technology, applied in the field of data processing, can solve the problems of low utilization efficiency of data node resources and network bandwidth, etc.
Active Publication Date: 2017-09-26
HUAWEI TECH CO LTD
View PDF7 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0004] The embodiment of the present invention provides a data loading method and device, which are used to solve the problem of using the master node or the data import component as the data loading entrance in the distributed database system, which has relatively low utilization efficiency of the resources and network bandwidth of each data node in the system. low problem
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0072] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.
[0073] The embodiments of the present invention will be further described in detail below in conjunction with the accompanying drawings.
[0074] Such as figure 1 As shown, it is a flow chart of the data loading method provided by Embodiment 1 of the present invention;
[0075] The embodiment of the present invention is applied to the loading of...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention relates to the field of data processing, in particular to a data loading method and device which is used for improving utilization efficiency of resources and network bandwidth of various data nodes in the system. In the data loading method, the first data node acquires a data block from a load server and detects the data node which each logic record in the data block belongs to after receiving a data loading command transmitted by the main node of a database system which the first data node belongs to, for any one logic record, the logic record is stored locally after the logic record is detected to belong to the data node, and after the logic record is detected to belong to other data nodes of the database system, the logic record is transferred to the other data nodes. Data redistribution of the distributed database system is set in each data node of the database system, and accordingly, resources and network bandwidth of each data node in the database system can be sufficiently utilized.
Description
technical field [0001] The invention relates to the field of data processing, in particular to a data loading method and device. Background technique [0002] The distributed database system is developed on the basis of the centralized database system and is the product of the combination of computer technology and network technology. Compared with the centralized database system, the distributed database system has many advantages: firstly, the distributed database system can allow various decentralized departments to store their commonly used data locally, which can reduce the cost of data transmission and improve the response rate; secondly, due to The distributed database system allows the local database to be operated when the network fails, which can improve the reliability of the system. Again, because a new local database is added to the distributed database system, or a suitable server is expanded at a certain location Small computers are easy to implement, so the ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
CPCG06F16/27
Inventor 杨卓慧
Owner HUAWEI TECH CO LTD