Distributed computing system and method and storage medium

A distributed computing and computing node technology, applied in the computer field, can solve problems such as high resource overhead, and achieve the effects of balancing, reducing memory space occupation, and avoiding idleness

Active Publication Date: 2018-11-23
TENCENT TECH (SHENZHEN) CO LTD
View PDF5 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the resources of a single node in the computing system provided by related technologies are limited, and the upgrade of the computing system often lags behind. The contradiction between the current situation of limited resources of a single node and the high resource overhead required for model training calculations has become difficult to solve. technical problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed computing system and method and storage medium
  • Distributed computing system and method and storage medium
  • Distributed computing system and method and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] The present invention will be described in further detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0041] Before the present invention is further described in detail, the nouns and terms involved in the embodiments of the present invention are described, and the nouns and terms involved in the embodiments of the present invention are applicable to the following explanations.

[0042] 1) Behavior data, including users (such as identification information descriptions in the form of serial numbers), items that users generate rating behaviors (such as commodities, articles, applications, etc., which can be described by serial numbers, etc.), and users' interest in items (also called scoring in this article), the behavior data of multiple users constitutes a behavioral data set (also called trai...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed computing system and method and a storage medium. The distributed computing system includes at least two computing nodes and at least two parameter service nodes.A computing node initializes vectors of corresponding users in a user matrix according to the users, which are included by a subset of training data, to obtain a user sub-matrix composed of the initialized vectors; the computing node carries out iterative computing on the user sub-matrix and an item sub-matrix according to the subset of the training data and the item sub-matrix obtained from a parameter service node, and transmits an item sub-matrix, which is obtained after each time of iterative computing, to the corresponding parameter service node; the parameter service node initializes vectors, which correspond to partial items, to obtain the item sub-matrix composed of the initialized vectors; and the parameter service node updates an item sub-matrix, which is stored by the parameterservice node, according to the item sub-matrix transmitted by the computing node. By implementing the system, computing tasks can be completed in an intensive manner.

Description

technical field [0001] The present invention relates to computer technology, in particular to a distributed computing system, method and storage medium. Background technique [0002] Artificial intelligence has developed rapidly and is widely used in various industries. Taking the application scenario of product recommendation as an example, according to the user's behavior data, the machine learning method is used to train a model that predicts the user's ratings for different products, so that the ranking of the user's ratings for different products can be calculated, and the products with high ratings can be selected. Recommending to users can help users quickly locate the products they are interested in, and realize accurate and efficient product marketing. [0003] For example, the current commodity recommendation relies on big data processing technology, and it is necessary to analyze and process the massive collected behavioral data in order to train a model with sco...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCG06F9/5083G06F9/50G06F16/00
Inventor 谭蕴琨余乐刘煜宏蒋杰
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap