A data computing method and device
A computing method and data technology, applied in the field of computer networks, can solve problems such as heavy burden and lower cluster computing efficiency, and achieve the effect of improving computing efficiency
Active Publication Date: 2018-11-20
HUAWEI TECH CO LTD
View PDF7 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0004] Therefore, when each server performs calculations on the data stored by itself, the server with a large amount of data is obviously more burdened than the server with a smaller amount of data, which reduces the efficiency of cluster computing.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0058] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.
[0059] see figure 1 , figure 1 It is a flowchart of a data operation method provided by an embodiment of the present invention. The data operation method provided by the embodiment of the present invention can be realized when the data in the distributed database is redistributed. Among them, the distributed database can be composed of at least one main control terminal and multiple servers, such as figure 2 As shown, the main control terminal...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The embodiment of the invention discloses a data operation method, which comprises the following steps: determining a data volume corresponding to each server; according to the data volume corresponding to a target server, judging whether the target server is subjected to data skewness or not; if the target server is subjected to the data skewness, copying data corresponding to the target server into a redundant server without data skewness, and revising routing information; and when data operation information which aims at a target data key value is received and the server where the target data key value is determined as the target server and the corresponding redundant server according to the revised routing information, distributing data to be processed for the target server and the corresponding redundant server so as to cause the target server and the corresponding redundant server to independently carry out operation on different pieces of data according to the data operation information. Correspondingly, the embodiment of the invention also discloses a data operation device. The embodiment of the invention is adopted to realize the automatic copying of skewed data when cluster data is redistributed and improve the operation efficiency of the cluster data.
Description
technical field [0001] The invention relates to the technical field of computer networks, in particular to a data operation method and device. Background technique [0002] With the maturity of traditional database technology and the rapid development of computer network technology, database applications have been generally established on computer networks. Among them, the centralized database adopts centralized processing, the communication overhead is large, and the processing efficiency is low. Moreover, the application program runs on the same computer. Once the computer fails, the entire system will be affected. Therefore, a distributed database is proposed on the basis of a centralized database. Compared with a centralized database, a distributed database can store data in different servers, that is, storage devices of different computers, according to different distribution requirements. [0003] In a distributed database, due to the irregularity of data distribution...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
Inventor 业韬陈系华张亮
Owner HUAWEI TECH CO LTD