Decentralized data processing method, electronic device and storage medium
A data processing and decentralization technology, applied in the field of data processing, can solve the problem of large computing load of big data clusters, and achieve the effect of reducing computing load
Active Publication Date: 2021-01-01
HANGZHOU ANHENG INFORMATION TECH CO LTD
View PDF6 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] The embodiment of the present application provides a decentralized data processing method, an electronic device and a storage medium, so as to at least solve the problem in the related art that big data clusters analyze and process big data, resulting in a large computing load of big data clusters
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0022] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be described and illustrated below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application. Based on the embodiments provided in the present application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application. In addition, it can also be understood that although such development efforts may be complex and lengthy, for those of ordinary skill in the art relevant to the content disclosed in this application, the technology disclosed in this application Some design, manufacturing or production changes based on the content are just conventional technical means, and...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention relates to a decentralized data processing method, an electronic device and a storage medium. The method comprises the steps that a first node receives a data request message sent by a second node, wherein the data request message comprises a data processing identifier and the description information of requested data, and the data processing identifier is used for indicating a modeof processing the data requested by the second node executed by the first node; the first node modifies the data processing identifier in the data request message according to a preset rule, sends themodified data request message to a third node, and receives first data returned by the third node in response to the data request message; the first node determines second data requested by the datarequest message according to the description information; and the first node processes the second data according to a processing mode corresponding to the data processing identifier to obtain third data, and sends the third data and the first data to the second node for processing. According to the method, the operation load of the big data cluster is reduced.
Description
technical field [0001] The present application relates to the field of data processing, in particular to a decentralized data processing method, electronic device and storage medium. Background technique [0002] During the data analysis process of the machine, if the data analysis results are temporarily stored, the additional I / O overhead caused by temporary storage will be increased; if the data analysis results are not temporarily stored, they will be lost when the machine accidentally goes down The results of the data analysis done. [0003] Such problems are particularly prominent in big data processing: most of the current big data analysis methods are to collect all kinds of data from various devices into big data clusters for unified storage, query and data analysis. In this case, data collection Not only will it take up a lot of bandwidth. Moreover, the machines in the big data cluster also face the problem of high I / O overhead, or the problem of losing a large a...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
CPCH04L67/10H04L67/1097H04L67/63
Inventor 张杰范渊
Owner HANGZHOU ANHENG INFORMATION TECH CO LTD