Decentralized data processing method, electronic device and storage medium
A data processing and decentralization technology, applied in the field of data processing, can solve the problem of large computing load of big data clusters, and achieve the effect of reducing the computing load, purpose and advantages of big data clusters.
Active Publication Date: 2022-07-19
HANGZHOU ANHENG INFORMATION TECH CO LTD
View PDF6 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] The embodiment of the present application provides a decentralized data processing method, an electronic device and a storage medium, so as to at least solve the problem in the related art that big data clusters analyze and process big data, resulting in a large computing load of big data clusters
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0022] In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be described and illustrated below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application. Based on the embodiments provided in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application. In addition, it will also be appreciated that while such development efforts may be complex and lengthy, for those of ordinary skill in the art to which the present disclosure pertains, the techniques disclosed in this application Some changes in design, manufacture or production based on the content are only conventional technical means, and it should not be understood that ...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The present application relates to a decentralized data processing method, electronic device and storage medium. The method includes: the first node receives a data request message sent by the second node, wherein the data request message includes: a data processing identifier and description information of the requested data, and the data processing identifier is used to indicate the first node to the second node. The processing method of the requested data; the first node modifies the data processing identifier in the data request message according to preset rules, sends the modified data request message to the third node, and receives the third node's response to the data request message And the returned first data; the first node determines the second data requested by the data request message according to the description information; the first node processes the second data according to the processing method corresponding to the data processing identifier, obtains the third data, and stores the third data The data and the first data are sent to the second node for processing. Through the present application, the computing load of the big data cluster is reduced.
Description
technical field [0001] The present application relates to the field of data processing, and in particular, to a decentralized data processing method, electronic device and storage medium. Background technique [0002] During the data analysis process of the machine, if the data analysis results are temporarily stored, the additional I / O overhead caused by the temporary storage will increase; if the data analysis results are not temporarily stored, the data will be lost when the machine accidentally crashes The results of the data analysis. [0003] Such a problem is particularly prominent in big data processing: most of the current big data analysis methods are to collect various types of data from various devices into a big data cluster for unified storage, query and data analysis. In this case, the collection of data Not only will it take up a lot of bandwidth. In addition, the machines in the big data cluster also face the problem of high I / O overhead, or because the bi...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): H04L67/10H04L67/1097H04L67/63
CPCH04L67/10H04L67/1097H04L67/63
Inventor 张杰范渊
Owner HANGZHOU ANHENG INFORMATION TECH CO LTD