Method for determining number of optimal communication agent nodes in cloud platform

A technology for the number of communication agents and nodes, which is applied in the field of cloud platform big data processing, and can solve the problem of not determining the optimal number of communication agent nodes in the cloud platform.

Active Publication Date: 2014-12-17
重庆宜邦科技有限责任公司
View PDF4 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the invention is to solve the problem that the prior art does not determine the number of optimal communication proxy nodes in the cloud platform

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for determining number of optimal communication agent nodes in cloud platform
  • Method for determining number of optimal communication agent nodes in cloud platform
  • Method for determining number of optimal communication agent nodes in cloud platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0023] This embodiment discloses a method for determining the number of optimal communication proxy nodes in the cloud platform. According to the prior art, a cloud platform including one control node server and m computing node servers will be constructed, and the number of the computing node servers is represented by variable i, i=1, 2...m. Build n on each (i-th) computing node server i , i=1, 2...m virtual machines, the number of the virtual machine is represented by variable j, j=1, 2...n i . If there is no virtual machine on some computing node servers, the corresponding n i =0. The cloud platform is built based on the OpenStack Havana version. K communication proxy nodes are constructed on the computing node server of the cloud platform, and the communication proxy nodes are used to manage virtual machines. It is worth noting that m and n i (i.e. {n 1 , n 2 ... n m}) is determined, and the number k of communication agent nodes is to be determined.

[0024] The ...

Embodiment 2

[0037]A method for determining the number of optimal communication agent nodes in a cloud platform is to construct a cloud platform including one control node server and three computing node servers. Several virtual machines are built on each computing node server, that is, 3 virtual machines are built on the first computing node server, 2 virtual machines are built on the second computing node server, and 3 virtual machines are built on the third computing node server. There are 3 virtual machines built on the server. The cloud platform is built based on the OpenStack Havana version.

[0038] The optimal communication agent number expression obtained by the present invention

[0039] k = NSn r μ total | BS - ( n r ...

Embodiment 3

[0043] Build a cloud platform based on OpenStack Havana. Constructed a cloud computing IaaS platform with 21 servers, including 1 control node and 20 computing nodes. The specific server configuration and virtual machines on each server are shown in Table 1. The platform provides users with the use of virtual resources in the form of virtual resources, and the template types of virtual resources provided are shown in Table 2. Choose a unified micro-hosting template. Then, 246 virtual machines were allocated in the IaaS platform, and a parallel computing cluster based on cloud computing was built. One virtual machine is configured as the master node of Hadoop, and the other 245 are slave nodes of Hadoop. In order to evaluate this method, the method is implemented in a computer programming language and integrated into the OpenStack platform. In the actual IaaS application scenario, this method is evaluated in detail.

[0044] Table 1 Cloud computing IaaS platform server conf...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for determining the number of optimal communication agent nodes in a cloud platform with an aim to solve the problem that the number of the optimal communication agent nodes in the cloud platform cannot be determined in the prior art. According to the technical scheme, the method for determining the number of the optimal communication agent nodes in the cloud platform includes that the cloud platform comprising a control node server and multiple compute node servers is structured, and multiple virtual machines are structured on each compute node server; the cloud platform is set up on the basis of an OpenStack Havana version; multiple communication agents are structured on the servers of the cloud platform and used for managing of the virtual machines. The acquired number of the optimal communication agent nodes in the cloud platform can be determined according to total time consumption in the map phase (namely the distributed processing phase), total time consumption of the Reduce phase (namely the merging processing phase) and time consumption of Map and Reduce process (namely big-data processing process).

Description

technical field [0001] The invention relates to cloud platform big data processing. Background technique [0002] The big data processing cluster based on the cloud platform is gradually being adopted by the industry due to its elastic and scalable computing framework and the new business model of "acquisition on demand". [0003] Starting from the OpenStack Grizzly version, in order to improve the performance and reliability of the virtual network, tenants can be allowed to deploy communication proxy nodes on multiple hosts. However, the virtual network component Neutron only implements the communication function of the virtual network, and does not pay further attention to the improvement of the communication performance of the virtual network. That is, no effective allocation strategy for communication agent node deployment is provided. For the Hadoop cluster based on OpenStack, how we need to design a communication agent allocation strategy to optimize the performance ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/06H04L29/08H04L12/24
Inventor 任海军龙澜潘璐璐吴良俊郭晓东吴海燕王博
Owner 重庆宜邦科技有限责任公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap