A delay-oriented scientific workflow data layout method in hybrid cloud environment

A data layout and workflow technology, applied in data exchange networks, genetic laws, digital transmission systems, etc., can solve problems such as limited capacity of private cloud data centers

Active Publication Date: 2018-12-11
FUJIAN NORMAL UNIV
View PDF5 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

(2) For security reasons, private data is designated to be stored in a specific private cloud data center. Due to the limited capacity of the private cloud data center, it needs to be transmitted across data centers. Considering the impact of bandwidth factors and...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A delay-oriented scientific workflow data layout method in hybrid cloud environment
  • A delay-oriented scientific workflow data layout method in hybrid cloud environment
  • A delay-oriented scientific workflow data layout method in hybrid cloud environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0084] Such as Figure 1-7 As shown in one, the present invention discloses a delay-optimized scientific workflow data layout method in a hybrid cloud environment. The present invention will be described in detail below in conjunction with the accompanying drawings.

[0085] 1 Problem Definition and Analysis

[0086] This section will define the concepts related to the delay-optimized scientific workflow data layout problem in the hybrid cloud environment, and analyze the problem with examples. The problem definition mainly includes hybrid cloud environment, scientific workflow, and data layout scheme.

[0087] 1.1 Problem Definition

[0088] Hybrid cloud DC = {DC pub ,DC pri} mainly includes public cloud and private cloud, both of which are composed of multiple data centers. Public cloud data center DC pub ={dc 1 ,dc 2 ,...,dc n}Consists of n data centers, private cloud data center DC pri ={dc 1 ,dc 2 ,...,dc m} consists of m data centers. This paper focuses on ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a scientific workflow data layout method oriented to time delay optimization in a hybrid cloud environment, which considers the characteristics of data layout under the hybridcloud environment, combines the dependency relationship among scientific workflow data, and considers the influence of factors such as the bandwidth between cloud data centers, the number and capacityof private cloud data centers and the like on transmission time delay. Firstly, preprocessing is carried out to improve the efficiency of the data layout strategy in the later period. By introducingcrossover operator and mutation operator of genetic algorithm, the problem of premature convergence of particle swarm optimization algorithm is avoided, the diversity of population evolution is improved, the data transmission delay is effectively reduced, and the data transmission delay of scientific workflow in hybrid cloud environment is effectively reduced. The invention improves the executionefficiency of the data layout strategy and optimizes the transmission delay of the scientific workflow data layout.

Description

technical field [0001] The invention relates to a scientific workflow data layout method in the field of parallel and distributed high-performance computing, in particular to a time delay optimization-oriented scientific workflow data layout method in a hybrid cloud environment. Background technique [0002] Scientific workflow systems are data-intensive applications that have been widely used in scientific research fields such as astronomy, high-energy physics, and bioinformatics. Scientific workflow applications are data-driven, and there are complex data dependencies between computing task nodes, and the size of the processed data sets can usually reach TB or even PB levels. These datasets include existing original input datasets, as well as intermediate and final datasets generated during processing and analysis. Due to the complex nature of scientific workflow application structure and large data volume, it has strict requirements on the computing power and data storag...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L12/24H04L29/08G06N3/12
CPCG06N3/126H04L41/0823H04L41/083H04L41/142H04L41/145H04L67/10
Inventor 林兵项滔卢宇黄志高陈星郭文忠蔡飞雄
Owner FUJIAN NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap