Controlling data processing tasks

A task and data technology, applied in the direction of electrical digital data processing, program control design, program control device, etc., can solve the problems of calculation mismatch and difficulty in adapting

Active Publication Date: 2017-04-26
INITIO TECH
View PDF13 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although it is possible to efficiently perform computations that can be represented in the MapReduce framework and whose inputs and outputs can be modified for storage in the MapReduce framework's file system, many computations do not fit the framework and / or are not easily adaptable so that all of them Both input and output are in the distributed file system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Controlling data processing tasks
  • Controlling data processing tasks
  • Controlling data processing tasks

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0077] refer to figure 1 , the task-based computing system 100 uses the high-level program specification 110 to control the computing resources and storage resources of the computing platform 150 to perform calculations specified by the program specification 110 . Compiler / interpreter 120 receives high-level program specification 110 and generates task-based specification 130 in a form executable by task-based runtime interface / controller 140 . The compiler / interpreter 120 recognizes one or more "execution sets" of one or more "components", which may be instantiated individually or as a unit as fine-grained tasks to be applied to each of a plurality of data elements . As described in more detail below, part of the compilation or interpretation process involves identifying these execution sets and preparing them for execution. It should be understood that compiler / interpreter 120 may use any of a variety of algorithms including steps such as parsing high-level program specifi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Information representative of a graph-based program specification (110) has a plurality of components, each of which corresponds to a task, and directed links between ports of said components. A program corresponding to said graph-based program specification is executed at a node (152). A first component includes a first data port, a first control port, and a second control port. Said first data port is configured to receive data to be processed by a first task corresponding to said first component, or configured to provide data that was processed by said first task corresponding to said first component. Executing a program corresponding to said graph-based program specification includes: receiving said first control information at said first control port, in response to receiving said first control information, determining whether or not to invoke said first task, and after receiving said first control information, providing said second control information from said second control port.

Description

[0001] Cross References to Related Applications [0002] This application claims U.S. Application Serial No. 62 / 044,614 filed September 2, 2014, U.S. Application Serial No. 62 / 044,730 filed September 2, 2014, and U.S. Application Serial No. 62 / 044,730 filed May 20, 2015 62 / 164,175 priority. technical field [0003] This specification relates to a method for controlling data processing tasks. Background technique [0004] One approach to dataflow computation utilizes a graph-based representation in which computational components corresponding to the nodes (vertices) of the graph pass through dataflows corresponding to the links (directed edges) of the graph (called a "dataflow graph"). )coupling. A downstream component connected to an upstream component by a dataflow link receives an ordered stream of input data elements and processes the input data elements in the order received, optionally generating one or more corresponding streams of output data elements. A system for...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/44G06F9/48
CPCG06F8/34G06F9/4843G06F9/4494
Inventor C·W·斯坦菲尔R·夏皮罗A·韦斯A·F·罗伯茨约瑟夫·斯凯芬顿·沃莱三世J·古尔德
Owner INITIO TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap