Data processing method and device, equipment and storage medium
A processing equipment and data processing technology, which is applied in the direction of electrical digital data processing, multi-program device, program control design, etc., can solve the problems of high resource occupation rate and slow data processing rate, so as to reduce resource occupation rate and improve data processing rate. Effect of Processing Rate
Pending Publication Date: 2022-05-13
WEBANK (CHINA)
View PDF0 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] The main purpose of the present invention is to provide a data processing method, device, equipment and storage medium, aiming to solve the problem that the CPU needs to train the federated learning model according to the training data, and at the same time need to perform data processing on the database file to obtain multiple key-value pairs , so that the resource occupancy rate of the CPU is large, resulting in a technical problem that the data processing rate of the CPU is slow
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0042] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.
[0043] In this application, in order to reduce CPU resource usage and increase CPU data processing speed, this application provides a data processing method, in which a first processing device is set in the data processing server, and multiple key values are obtained through the first processing device Yes, so as to achieve the purpose of reducing the resource usage rate of the CPU and increasing the data processing speed of the C...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a data processing method and device, equipment and a storage medium. The method comprises the steps that first processing equipment receives a file address sent by second processing equipment; the first processing device obtains a data file from a second memory according to the file address and stores the data file into the first memory; the first processing device converts the data file in the first memory into a plurality of target key-value pairs and sends the plurality of target key-value pairs to a second server, and the first server and the second server belong to different clusters. The data file in the first memory is converted into the multiple target key value pairs through the first processing device, the resource occupancy rate of a CPU is reduced, and the data processing rate of the CPU is increased.
Description
technical field [0001] The present invention relates to the field of federated learning in financial technology, in particular to a data processing method, device, equipment and storage medium. Background technique [0002] In a federated learning scenario, a federated system includes clusters corresponding to multiple institutions, and each cluster includes a communication server and at least one data processing server. [0003] Among them, the communication server can perform data interaction with the communication servers in other clusters, and the data processing server can train the federated learning model according to the training data, and at the same time read the database file from its hard disk, process the database file, and obtain multiple key values pair, and sends multiple key-value pairs to a comm server in the same cluster as it. In related technologies, the CPU in the data processing server can train the federated learning model according to the training d...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCG06F9/5027G06F9/5016
Inventor 黄文赞黄启军黄铭毅
Owner WEBANK (CHINA)