Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

A method of fast deployment of parallel systems for the AWS platform

A fast and platform technology, applied in the field of information technology processing, which can solve the problems of wasting computing resources, unable to start the instance smoothly, and not publishing the technology or means, and achieve the effect of ensuring efficiency.

Active Publication Date: 2017-11-24
HOHAI UNIV
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When the cluster size exceeds 50 instances, it will take a certain amount of time and cost to broadcast and transmit updated files
[0005] Finally, due to the instability of the EC2 platform itself, when applying for a large number of instances, there will be a problem that some instances cannot be started smoothly, thus causing a waste of computing resources for other started instances
[0006] The instability of this AWS EC2 service and the limitation of not being able to obtain a fixed private IP address for free constitute a technical difficulty in deploying a Hadoop-based parallel processing system on this platform
[0007] At present, there is no published technology or means to solve this problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method of fast deployment of parallel systems for the AWS platform
  • A method of fast deployment of parallel systems for the AWS platform

Examples

Experimental program
Comparison scheme
Effect test

example I

[0043] Step 3-1: Use the "ec2-describe-instances" command in the EC2 command line tool to detect the status of all instances that need to be started. If the "instance-state-name" condition is not "running", it means that the instance is not running. It can be started normally; count the instance IDs that have not been started successfully, and return if all instances have been started;

[0044] Step 3-2, inform the user of the number of unstarted instances, and ask whether to continue to wait for a certain period (such as 10s), if so, return to step 3-1;

[0045] Step 3-3, use the "ec2-terminate-instances" command in the EC2 command line tool to terminate the failed instances, and use the "ec2-run-instances" command in the EC2 command line tool to start a corresponding number of new instances instance, and return to step 3-1 to continue waiting;

[0046] Step 4, use the "ec2-create-tags" command in the EC2 command line tool to add corresponding tags to the startup instance to...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a platform for an Amazon Web Services (AWS), and particularly discloses a quick parallel system allocation basic method for the AWS platform. The Elastic Compute Cloud (EC2) service provided on the basis of the AWS is explicit, an external initialization script is utilized for constructing a large-scale and stable computer trunking system, and meanwhile an internal initialization script is utilized for allocating basic procedures of a Hadoop expansion platform. On the premise that the allocation quality is guaranteed, the preparing time a cluster is shortened to be minimal, and expense cost of the cluster is reduced to be minimal.

Description

technical field [0001] The invention relates to an AWS platform-oriented parallel system rapid deployment method, belonging to the field of information technology processing. Background technique [0002] AWS (Amazon Web Services Amazon Web Services System) is a cloud computing platform started by Amazon in 2002, providing various types of remote Web services. The EC2 (Elastic Compute Cloud) service allows users to rent virtual computers (instances) to remotely use different types of computer systems and run any software they need. The price of renting a virtual computer varies with the amount of hardware resources provided, and users can create, run and terminate services at any time, so AWS EC2 is regarded as a flexible and relatively cheap cloud computing platform. The operating system and pre-installed software contained in the instance depend on the system image AMI selected when it starts. Not only AWS official, but any user can package the software environment set by...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08H04L12/24G06F9/44
Inventor 陆佳民冯钧
Owner HOHAI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products