Distributed operation accelerating running method and system based on operation characteristic fingerprints
A feature fingerprint and accelerated operation technology, applied in the field of distributed operations, can solve the problems of not supporting rerunning at breakpoints, reducing operating efficiency, wasting computing resources, etc., to save time for repeated job operations, simplify scheduling, and improve efficiency Effect
Active Publication Date: 2016-02-10
BEIJING GENEDOCK TECH CO LTD
View PDF4 Cites 3 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0003] 1) The same job will be scheduled repeatedly, resulting in repeated operation, which not only wastes computing resources, but also reduces operating efficiency;
[0004] 2) Breakpoint rerun is not supported, that is, when a process fails for some reason when it runs to a certain step in the middle, when the system resubmits, it has to reschedule and run all the calculations that have been completed before, which increases the complexity of the calculation Spend
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0036] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in further detail below in conjunction with specific embodiments and with reference to the accompanying drawings.
[0037] Such as Figure 1(a)-Figure 1(b) As shown, it is the accelerated running method of distributed jobs based on job feature fingerprints in this embodiment. After inputting the jobs waiting to run, the following steps are included:
[0038] 1) Calculate the characteristic fingerprint of the job;
[0039] 1.1) Obtain the dependent program identification string of the job,
[0040] 1.2) Obtain the job running program parameters,
[0041] 1.3) Merge the obtained job-dependent program identification string and job running program parameters according to the preset to generate the characteristic fingerprint of the job,
[0042] 2) write the feature fingerprint of the job into the history log;
[0043] 3) according to th...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a distributed operation accelerating running method and system based on operation characteristic fingerprints. The method comprises the steps that 1, the characteristic fingerprints of an operation are calculated; 2, the characteristic fingerprints of the operation are written in a historical log; 3, according to the characteristic fingerprints of the operation, a historical operation with the same characteristic fingerprints is searched in the historical log; 4, if no operation is searched, the operation is completed continuously; 5, if the historical operation with the same characteristic fingerprints exists, the historical operation is output to be given to a newly submitted operation. According to the distributed operation accelerating running method and system based on the operation characteristic fingerprints, the concept of the operation characteristic fingerprints is put forward for the first time, and the operation characteristic fingerprints are obtained by acquiring an operation dependent program, acquiring operation running program parameters and combining the acquired operation dependent program and operation running program parameters. According to the distributed operation accelerating running system, the operation characteristic fingerprints are applied to distributed operation running, dispatching of distributed tasks is simplified, and the running efficiency of the distributed tasks is improved.
Description
technical field [0001] The invention relates to a distributed job method and system, in particular to a distributed job acceleration method and system based on job feature fingerprints, which are used to simplify the scheduling of computer distributed system jobs. Background technique [0002] In the existing distributed job running method, after the user submits the job, the back-end system will directly schedule the job to the corresponding machine for running according to the user's needs. The main steps of the distributed job running are: 1. The user specifies the running Process, submit input parameters; 2. The system generates the execution plan of the distributed job according to the input parameters; 3. The system schedules the actual operation of each step of the job according to the execution plan; 4. After all jobs are executed, the necessary results are output. Above technical scheme mainly has the following problems: [0003] 1) The same job will be scheduled r...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F9/48
Inventor 王海洋
Owner BEIJING GENEDOCK TECH CO LTD