High-throughput calculation method and system based on container technology

A container technology and computing method technology, applied in computing, instrumentation, program control design, etc., can solve problems such as difficult to reproduce results, single computing resource form, and difficult environmental compatibility, and achieve the effect of improving ease of use and flexibility

Active Publication Date: 2020-11-06
COMP NETWORK INFORMATION CENT CHINESE ACADEMY OF SCI
View PDF4 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention aims to solve the problems encountered in high-throughput computing scenarios, such as difficulty in environmental compatibility, difficulty in reproducing results, and single form of computing resources, and provides a high-throughput computing method and system based on container technology, using containers and related technologies to achieve

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • High-throughput calculation method and system based on container technology
  • High-throughput calculation method and system based on container technology

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] In order to make the purpose, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with specific embodiments and accompanying drawings.

[0049] The first aspect of the present invention is to define the whole process of a computing task in a high-throughput job in the form of a workflow.

[0050] A workflow job consists of one or more subtask jobs.

[0051] Subtasks can be executed serially or synchronously in parallel, and their dependencies can be defined through directed graphs.

[0052] The system obtains the definition of the workflow job through the workflow job description file, schedules each subtask step according to the dependency relationship, and manages the running status of the job and its subtasks in a unified manner.

[0053] A second aspect of the invention is to build and run subtasks in a workflow job based on containers.

[0054] The system creates a cont...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a high-throughput calculation method and system based on the container technology, and relates to the field of high-throughput calculation. The workflow jobs are defined througha workflow description file, each workflow job is composed of one or more subtask jobs, and the dependency relationship between the subtask jobs is defined through a directed graph; the sub-task jobsare constructed into job containers in a container mode, the job containers are in butt joint with a resource pool, and the resource pool comprises computing resources and storage resources which aremainly composed of local physical resources, grid resources and virtualization resources; and scheduling, distributing, running, monitoring and managing the sub-tasks according to the dependency relationship. A high-throughput computing platform for docking local physical resources, grid resources and virtualized cloud resources is realized by utilizing a container and related technologies, so that the influence factors of the environment are shielded for computing, the resource requirements under different scenes are met, the research efficiency and flexibility are improved, Meanwhile, the support of the system on a workflow form computing task is considered.

Description

technical field [0001] The invention relates to the field of high-throughput computing, in particular to a high-throughput computing method and system based on container technology. Background technique [0002] With the development of cloud computing and virtualization technology, containers standardize the packaging of applications and their dependent environments through the lightweight virtualization technology of the kernel, providing an isolated operating environment for applications and services, which is fast, efficient, and easy. Migration and other advantages. Compared with traditional virtual machines, the container environment runs directly on the host operating system, and the additional requirements for system resources are much lower than virtual machines, and related technologies such as container orchestration frameworks provide comprehensive support for multi-container orchestration and management. Therefore, it has a wide range of applications in multiple...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/455
CPCG06F9/45558
Inventor 黄荷徐蕴琪金钟
Owner COMP NETWORK INFORMATION CENT CHINESE ACADEMY OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap