Graph data flow processing method and device and storage medium

A processing method and technology of a processing device, applied in the computer field, can solve the problems of not supporting distribution, unable to meet application scenarios, limited operating system environment, etc., to achieve the effect of improving efficiency

Pending Publication Date: 2020-12-29
JINGDONG TECH HLDG CO LTD
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Graph data stream scheduling computing system is a single point, limited by the operating sy

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Graph data flow processing method and device and storage medium
  • Graph data flow processing method and device and storage medium
  • Graph data flow processing method and device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] In order to make the purpose, technical solution and advantages of the present application clearer, the present invention will be further described in detail below with reference to the accompanying drawings and examples.

[0040] Based on the problems in the prior art, the embodiment of the present application provides a graph data flow processing method, by abstracting each computing task into a graph node, and establishing a graph data flow computing model according to the dependencies between each computing task, Users can choose a sorting algorithm to sort the directed acyclic graph in the graph data flow computing model composed of various computing tasks, and determine the computing order of each computing task. At the same time, the algorithm calculation framework that may be used is abstracted into algorithm components. Users only need to select the algorithm components to be used and configure the parameters of the algorithm components. Run the configured grap...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a graph data flow processing method and device and a storage medium. The method specifically comprises the steps of obtaining a calculation task; connecting the graph nodes representing the calculation tasks into a directed acyclic graph by using direction lines according to the dependency relationship among the calculation tasks, and integrating the calculation tasks by adopting the directed acyclic graph to establish a graph data flow calculation model; configuring algorithm component parameters of each graph node in the graph data flow calculation model, the algorithm component being an algorithm calculation framework used by a calculation task; running the configured graph data flow calculation model, and generating a calculation result of each calculation task;rendering the calculation result on each graph node in the corresponding graph data flow calculation model, so as to display the corresponding calculation result after clicking the graph node. According to the embodiment of the invention, through visual modeling and integration of an algorithm calculation framework, the calculation development process is simplified, the calculation result is visually presented, and the efficiency of graph data flow modeling and scheduling calculation is improved.

Description

technical field [0001] The present application relates to the field of computer technology, and in particular to a processing method, processing device and storage medium of a graph data stream. Background technique [0002] From the perspective of data transmission and processing, graph data flow is used to express the logical function of the system, the logical flow of data in the system and the logical transformation process in a graphical way. It is the main expression tool for structured system analysis methods and used to represent software models. A graphical method. By processing data through the graph data flow, data analysis can be performed efficiently and quickly, and calculation results can be obtained. [0003] Graph data scheduling computing is a way of computing graph data using mainstream learning frameworks. Generally, the computing tasks (Tasks) included in the computing job (Job) are sorted according to a directed acyclic graph to form a certain path se...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/901G06F16/903
CPCG06F16/9024G06F16/90335
Inventor 李德友张磊
Owner JINGDONG TECH HLDG CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap