Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Distributed vector processing method, device and system and medium

A distributed vector and processing system technology, applied in the field of devices, systems and media, and distributed vector processing methods to achieve the effect of speeding up development efficiency

Pending Publication Date: 2022-02-11
WEBANK (CHINA)
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The main purpose of the present invention is to provide a distributed vector processing method, device, system and medium, and provide a simple and convenient distributed development system. Through the development and application of this system, it can not only solve the problem of processing large amounts of data in federated learning scenarios problem, it can also be directly migrated to the distributed version for application

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed vector processing method, device and system and medium
  • Distributed vector processing method, device and system and medium
  • Distributed vector processing method, device and system and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0087] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0088] The design of the stand-alone version in the existing technology cannot solve the problem of large data volume. For the development of the distributed version, developers need to have distributed development experience, and the development threshold is high and difficult. Moreover, the current federated learning distributed framework interfaces only provide interfaces such as map, reduce, and aggregate, which are too low-leve...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a distributed vector processing method, device and system and a medium, the system comprises at least two clusters, each cluster comprises a plurality of nodes, and the number of the nodes in each cluster in the at least two clusters is the same. In each cluster, the plurality of nodes comprise an aggregation node and a computing node. Specifically, the aggregation node in each cluster is used for managing the data in the cluster where the aggregation node is located, and the computing node is used for storing and computing the data of at least one partition. According to the scheme provided by the invention, each computing node in each cluster can store and compute the data in parallel, and a local algorithm can be quickly transplanted without a distributed foundation, so that distributed computing is realized, and the development efficiency of a federated algorithm can be accelerated.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a distributed vector processing method, device, system and medium. Background technique [0002] With the continuous development of computer technology, federated learning (also known as federated machine learning) is also widely used in various technical fields. Federated learning is a machine learning framework that can effectively help multiple organizations meet user privacy protection, data security and government requirements. Data usage and machine learning modeling as required by regulations. [0003] In the current federated learning field, to develop a federated learning algorithm, there are differences between the single-machine development and implementation mode and the multi-machine distributed development and implementation. The programming of the stand-alone version is simple and intuitive. The participants can better organize and process the complete d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06N20/20G06F8/76G06F9/30
CPCG06N20/20G06F8/76G06F9/30036
Inventor 刘玉德黄启军陈瑞钦
Owner WEBANK (CHINA)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com