Execution strategy generation method and device under cross-IDC (Internet Data Center) big data processing architecture

A technique for executing policies and large numbers, applied in the field of big data, can solve problems such as difficult to meet QoS requirements

Active Publication Date: 2016-06-29
CHINA TELECOM CLOUD TECH CO LTD
View PDF6 Cites 36 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, the general scheduling strategy is generally based on batch processi...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Execution strategy generation method and device under cross-IDC (Internet Data Center) big data processing architecture
  • Execution strategy generation method and device under cross-IDC (Internet Data Center) big data processing architecture
  • Execution strategy generation method and device under cross-IDC (Internet Data Center) big data processing architecture

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that the relative arrangements of components and steps, numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present invention unless specifically stated otherwise.

[0046] At the same time, it should be understood that, for the convenience of description, the sizes of the various parts shown in the drawings are not drawn according to the actual proportional relationship.

[0047] The following description of at least one exemplary embodiment is merely illustrative in nature and in no way taken as any limitation of the invention, its application or uses.

[0048] Techniques, methods, and devices known to those of ordinary skill in the relevant art may not be discussed in detail, but where appropriate, techniques, methods, and devices should be considered part of the auth...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an execution strategy generation method and device under cross-IDC (Internet Data Center) big data processing architecture, and relates to the field of big data processing. According to the method, current available computing resources and internet transmission resources reported by each IDC cluster are received; on the basis of a task classification model base, optimum execution strategies of tasks are determined according to the types of the tasks; the optimum execution strategies of the tasks comprise the demanded computing resources and consumed time of the tasks; the current optimum execution strategies of the tasks are obtained through calculating according to every two of [cluster available computing resources and task data distribution] matrixes in an available resource pool and [demanded computing resources and consumed time of each task and cluster available internet resources] matrixes. Compared with the existing scheme, the technical scheme provided by the invention has the advantages that the computing and internet resources can be utilized in a high utilization rate on a big data processing platform built cross-IDC, the service quality demands of different services can be satisfied, and the flexible service extension capability is realized.

Description

technical field [0001] The present invention relates to the field of big data technology, in particular to a method and a device for generating an execution policy under a large number processing framework across an IDC (Internet Data Center, network data center). Background technique [0002] Currently, massive data processing platforms are built within a single IDC. Users do not need to understand the underlying technical details involved in distributed computing within the IDC, and can develop data processing programs conveniently and quickly. [0003] Under the current architecture, task strategies are developed by quantifying computing-related resources such as CPU and memory of devices in the cluster. [0004] 1. FIFO (FirstInFirstOut, first in first out) scheduling strategy [0005] The queue scheduling strategy is to process tasks from the work queue in a first-in-first-out manner. This strategy is the oldest and simplest way of doing things and is easy to achieve ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30G06F9/48
Inventor 刘凯毅
Owner CHINA TELECOM CLOUD TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap