Method and apparatus for enabling autonomous acceleration of data stream AI applications

A technology of data flow and data flow graph, which can be used in electrical digital data processing, program code conversion, instruments, etc., and can solve problems such as high overhead.

Pending Publication Date: 2022-03-01
HUAWEI TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The overhead of offloading a single operator to a hardware accelerator can be cons

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and apparatus for enabling autonomous acceleration of data stream AI applications
  • Method and apparatus for enabling autonomous acceleration of data stream AI applications
  • Method and apparatus for enabling autonomous acceleration of data stream AI applications

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] Embodiments of the invention include methods and apparatus for improving the performance of dataflow applications based on operators scheduled to accelerator hardware for execution. Embodiments include systems that enable hardware accelerators to autonomously execute super-operators (the multi-operator portion) of a dataflow graph with minimal intervention from a host processor. Dataflow applications execute on a computer system that includes a host processing unit and one or more hardware accelerators. The host processing unit controls the overall execution of the program and can schedule operators or super-operators for execution on hardware accelerators. Scheduling operators (or super-operators) to hardware accelerators by the host processor's execution engine is called "offloading."

[0037]Embodiments include an architecture including a development environment and a runtime environment for dataflow programming applications. Users (such as application developers) ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A method includes analyzing a dataflow graph representing data dependencies between operators of a dataflow application to identify a plurality of candidate groups of the operators. Depending on characteristics of a given hardware accelerator and operators of a given candidate group of the plurality of candidate groups, it is determined whether the operators of the given candidate group are to be combined. Upon determining that the operators of the given candidate group are to be combined, retrieving executable binary code segments corresponding to the operators of the given candidate group; generating a binary code unit including the executable binary code segment and metadata representing execution of a control flow among the executable binary code segment; and scheduling the code unit to the given hardware accelerator to execute the code unit.

Description

[0001] Related Application Cross Reference [0002] This application requires the serial number 16 / 570,822 filed on September 13, 2019, and the title of the invention is "METHOD AND APPARATUS FOR ENABLINGAUTONOMOUS ACCELERATION OF DATAFLOW AI APPLICATIONS" priority of the U.S. patent application of , the contents of which are incorporated herein by reference in their entirety. technical field [0003] The present invention relates to the field of data flow applications, in particular to a method and device for improving the performance of data flow programming applications by reducing the offload overhead associated with offloading operators to hardware accelerators for execution. Background technique [0004] A dataflow application is a computer program (eg, software) written using dataflow programming methods. Modern dataflow applications use operator systems to maximize software compatibility and composability. Developers of modern dataflow applications use operators to...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F8/41
CPCG06F8/4441G06F8/451
Inventor 芮泽·阿兹米冯承祥愷婷·艾米·王高耀庆田野王翔
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap