Patents
Literature
Patsnap Copilot is an intelligent assistant for R&D personnel, combined with Patent DNA, to facilitate innovative research.
Patsnap Copilot

142 results about "Task dependency" patented technology

Pipeline parallelization method for coarse-grained streaming application

The invention discloses a pipeline parallelization method for coarse-grained streaming applications. The pipeline parallelization method includes performing classic data profiling and dependency analysis on serial C-codes to acquire a task dependence graph, performing dependence transformation on the task dependence graph to acquire a directed acyclic graph, building a system feature graph, performing task scheduling on the directed acyclic graph according to the system feature graph and judging whether a task scheduling result meets performance requirements or not, if not, then aggregating and splitting task of the directed acyclic graph to acquire a new directed acyclic graph, selecting and calculating the highest-cost task of the new directed acyclic graph to acquire a new calculated hot spot region, returning to performing the dependency analysis again, segmenting and modifying the serial C-codes according to the task scheduling result so as to obtain parallelized C-codes, encoding to generate parallel executable files through an encoder, and loading the parallel executable files to a target hardware platform to execute. The pipeline parallelization method is adaptable to multilayer nested loop structures and capable of extracting parallelism of the multilayer loop.
Owner:ZHEJIANG UNIV

Task scheduling processing method and device and computer equipment

The invention relates to a task scheduling processing method and device and computer equipment. The method comprises the steps of constructing a directed acyclic graph based on a dependency relationship between tasks, constructing a task scheduling queue by performing deep traversal on the constructed directed acyclic graph, and finally controlling scheduling and execution of the tasks based on the dependency relationship between the task scheduling queue and the tasks. The different tasks with the dependency relationship are executed in series according to the dependency relationship, and atleast part of the different tasks without the dependency relationship is executed in parallel. Based on a directed acyclic graph capable of reflecting a task dependency relationship, at least part ofthe different tasks are executed without the dependency relationship in parallel. The utilization rate of computing resources can be increased to a certain extent. Meanwhile, computing efficiency of the tasks is improved, in addition, the dependent tasks are executed in series according to the dependency relationship between the tasks, repeated execution of the tasks on the dependent preposed tasks is avoided, and the task execution efficiency is further improved.
Owner:TENCENT TECH (SHENZHEN) CO LTD

ETL task dependence relationship detecting method and device and ETL tool

The invention discloses an ETL task dependence relationship detecting method and device. The method comprises the following steps: for each task of ETL, obtaining a data operating order contained in the task; analyzing the data operating order to obtaining a source table and a target table related to the task; according to the target table, a task attribute table and a task dependence relationship configuration table, obtaining a source table of direct dependence by the target table and a source table of indirect dependence by the target table; and traversing the source table related to the task, the source table of direct dependence and the source table of indirect dependence and marking the error types and optimizable types of all task dependence relationships related to the task according to a preset rule. With adoption of the method provided by the invention, actual task dependence relationships and a preset task dependence relationship are compared according to a preset rule so as to automatically discover erroneous and optimizable task dependence relationships, thus reducing the occurrence frequency of faults caused by task dependence problem, saving time for manual task dependence problem check by testing personnel and further achieving the effect of improving testing efficiency.
Owner:ALIBABA GRP HLDG LTD

Task management method and system based on Hadoop

InactiveCN104461502AAvoid concurrent executionAvoid spare timeSpecific program execution arrangementsState managementRunning time
The invention relates to a task management method and system based on Hadoop. The method comprises the steps that a task dependency relationship configured by a user is acquired, a current task is loaded, and upper-level tasks and lower-level tasks of the current task are determined according to the task dependency relationship; the execution results of the upper-level tasks are queried in a task status manager, and if all the upper-level tasks are successfully executed, the current task is triggered to be executed; the execution result of the current task is monitored, and if the current task is successfully executed, the execution result is sent to the task status manager, and the lower-level tasks are triggered to be loaded. By means of the task management method and system, the situations that the tasks are executed independently, and consequently concurrent execution of the tasks is caused are avoided, and the tasks can be uniformly managed. Once the current task is successfully executed, the lower-level tasks are loaded; under the condition that the upper-level tasks are successfully executed, the lower-level tasks can be immediately triggered to be executed. Thus, the running time needed for executing all the tasks can be shortened, and accordingly the execution efficiency of Hadoop can be improved.
Owner:广州时代数据服务有限公司

Task scheduling method and device based on task dependency relationship and storage medium

PendingCN110427252ASolving Collaborative Execution ProblemsSimple processProgram initiation/switchingTask dependencyDependency relation
The invention discloses a task scheduling method based on a task dependency relationship. The method comprises the following steps: establishing a graphical dependency relationship between tasks; analyzing the graphical dependency relationship into a corresponding workflow rule; issuing the workflow rule to a task execution cluster for mutual exclusion execution, wherein the nodes of the task execution cluster execute the workflow rule according to the scheduling plan of the workflow rule and the plan. The invention further provides a task scheduling device based on the task dependency relationship and a computer readable storage medium. According to the invention, a graphical task dependency relationship is established in a visual manner; the established graphical dependency relationshipis analyzed into a corresponding rule, and the corresponding rule is issued to the execution cluser for mutual exclusion execution; due to the fact that the dependency relationship is established between the tasks, cooperation can be completed between the tasks, the problem of complex multi-task serial and parallel cooperative execution can be solved, and meanwhile the graphical dependency relationship established in a visualized mode is visual, simple in process and not prone to making mistakes.
Owner:PING AN BANK CO LTD

Task tree-based large scale remote-sensing image parallel embedding method

The invention relates to a task tree-based large scale remote-sensing image parallel embedding method, which comprising the following steps: 1) constructing an embedding task tree based on an abutting relation and a recursion task division, and constructing an embedding task tree according to the constructing method of a balance binary tree; 2) expressing a DAG (directed acyclic graph) model of the embedding task tree; 3) dynamically dispatching the embedding task tree based on CPDS-SQ (a dynamic DAG dispatching strategy based on a core path and a state queue); and 4) parallel processing a plurality of embedding tasks. The method has the following benefits: the data dependency relationship of a series of embedding tasks is decoupled from the MPI-based (message passing interface) parallel embedding realization process and is dispatched by the dynamic task tree for task dependency relationship control, so that the parallel control logic and parallel realization of the parallel embedding process can be greatly simplified, and the parallelism of large scale embedding is explored to the maximum extent to greatly improve the treatment performance and expansibility of large-scale embedding.
Owner:CENT FOR EARTH OBSERVATION & DIGITAL EARTH CHINESE ACADEMY OF SCI

Application program starting method and device, storage medium and electronic equipment

The invention relates to the technical field of data processing, in particular to an application program starting method, which comprises the steps of obtaining a to-be-initialized task required whena target application program is started and a task attribute corresponding to the to-be-initialized task; constructing a task dependence tree according to the to-be-initialized task and the task attribute; determining at least one target task in the task dependence tree; and running the task dependency tree, and starting first frame drawing after running of the target task is finished so as to display a first frame page of the target application program. According to the technical scheme provided by the embodiment of the invention, on one hand, the function of supporting mutual waiting among different task chain nodes can be realized, so that the time required before drawing the first frame of the application program interface is shortened; and on the other hand, the complex dependency relationship between the to-be-initialized tasks can be processed through the tree structure of the task dependency tree, so that the purpose of shortening the time required before the first frame of theapplication program interface is drawn can be achieved.
Owner:NETEASE (HANGZHOU) NETWORK CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products