Data transmission method and device, electronic equipment and storage medium
A data transmission method and data technology, applied in transmission systems, multi-programming devices, electrical components, etc., can solve the problems of reducing the training efficiency of reinforcement learning network, affecting data transmission efficiency, and large data transmission volume.
Pending Publication Date: 2022-04-12
BEIJING SENSETIME TECH DEV CO LTD
View PDF5 Cites 1 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0004] However, due to the large amount of data transmission between multiple devices, when transmitting through the central server, a large amount of data needs to be copied and forwarded, which not only affects the efficiency of data transmission, but also reduces the training efficiency of the reinforcement learning network
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0102] In order to make the purpose, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only It is a part of the embodiments of the present disclosure, but not all of them. The components of the disclosed embodiments generally described and illustrated in the figures herein may be arranged and designed in a variety of different configurations. Accordingly, the following detailed description of the embodiments of the present disclosure provided in the accompanying drawings is not intended to limit the scope of the claimed disclosure, but merely represents selected embodiments of the present disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those ski...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a data transmission method and device, electronic equipment and a storage medium, and the method comprises the steps: receiving metadata sent by a data production end, the metadata comprising network address information of the data production end and the data size of training data generated by the data production end; sending the metadata to the data consumption end in response to a data acquisition request of the data consumption end, so that the data consumption end acquires training data from the data production end based on the metadata; wherein the data consumption end establishes communication connection with the data production end based on the network address information, and the data volume of the training data is used for indicating the data volume of the training data required to be acquired by the data consumption end. According to the embodiment of the invention, the metadata sent by the data production end is sent to the data consumption end, so that the data consumption end can directly obtain the training data from the data production end based on the metadata, and the data transmission efficiency can be improved.
Description
technical field [0001] The present disclosure relates to the technical field of machine learning, and in particular, to a data transmission method, device, electronic equipment, and computer-readable storage medium. Background technique [0002] Machine learning technology is one of the important branches of artificial intelligence science, including supervised learning, unsupervised learning and reinforcement learning. In the training process of reinforcement learning, distributed training is often implemented through multiple devices to improve the training efficiency of reinforcement learning. [0003] In the existing distributed training technology, the transmission of training data is often completed through the central server. Specifically, multiple data producers (such as producers) send the generated training data to the central server, and then the central server transfers the training data to the central server. Data is sent to multiple data consumers (such as con...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): H04L41/0823H04L41/16H04L67/141H04L67/148H04L69/22H04L69/24G06F9/54G06N20/00
Inventor 周航刘宇王晓刚
Owner BEIJING SENSETIME TECH DEV CO LTD