Conflict handling system and method for multi-stream parallelism
A conflict processing and co-processor technology, applied in the field of multi-stream parallel conflict processing systems, can solve problems such as memory usage conflicts, achieve the effects of eliminating errors, increasing labor costs, reducing maintenance costs and the possibility of errors
Active Publication Date: 2022-03-18
BEIJING ONEFLOW TECH CO LTD
View PDF8 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
This leads to potential conflicts in memory usage
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0021] The present invention will be described in further detail below in conjunction with the embodiments and accompanying drawings, so that those skilled in the art can implement it with reference to the description.
[0022] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present disclosure as recited in the appended claims.
[0023] The terminology used in the present disclosure is for the purpose of describing particular embodiments only and is not intended to limit the present disclosure....
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The present disclosure relates to a conflict handling system and method for multi-stream parallelism. The system includes: an initial computation graph acquisition component that acquires an initial computation graph to be deployed on the CPU and one or more coprocessors, the initial computation graph includes a plurality of task flows belonging to a computational task, each task flow It includes a plurality of sequentially executed operation logic nodes and memory release logic nodes; the node relationship analysis component traverses all the tensors to be targeted in the calculation graph, and determines the first node for the first tensor and the first node for the first tensor for the first time. Whether the task flow to which the second node of the quantity belongs is the same; and the conflict resolution component, when the node relationship analysis component determines that the first node belongs to the first task flow and the second node belongs to a task flow different from the first task flow, in the second A waiting node marking the first task flow is generated before the node, so as to obtain the result calculation graph.
Description
technical field [0001] The present disclosure relates to a data processing technique. More specifically, the present disclosure relates to a conflict handling system and method for multi-stream parallelism. Background technique [0002] Now that deep learning is popular, in order to increase the speed of data processing, it is usually necessary to divide a task into multiple slice tasks to form multiple task flows, so that the task flows can be processed in parallel, thereby saving data processing time or speeding up tasks. Processing efficiency, this data processing method is multi-stream parallel processing. [0003] However, in the multi-stream parallel data processing method, there are often parameter exchanges between different streams and data dependencies between different streams. Therefore, if parameters are not synchronized in parallel, errors will occur when the results of each task flow are merged. This kind of error is often caused by the overlapping of the t...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/50
CPCG06F9/5022G06F9/5016G06F9/5027
Inventor 李新奇袁进辉张建浩
Owner BEIJING ONEFLOW TECH CO LTD