Unlock instant, AI-driven research and patent intelligence for your innovation.

Control method and device for user task map end aggregation in mr computing platform

A computing platform and control method technology, applied in the field of communications, can solve the problems of inability to map-side aggregation, improve user task execution efficiency, map-side aggregation to reduce user task execution efficiency, etc., and achieve the effect of improving performance and improving execution efficiency.

Active Publication Date: 2019-03-01
ALIBABA GRP HLDG LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This "one size fits all" approach can neither use effective map-side aggregation to improve the execution efficiency of user tasks, nor can it avoid invalid map-side aggregation to reduce the execution efficiency of user tasks

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Control method and device for user task map end aggregation in mr computing platform
  • Control method and device for user task map end aggregation in mr computing platform
  • Control method and device for user task map end aggregation in mr computing platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0072] The principles and features of the present invention will be described below in conjunction with the accompanying drawings, and the examples given are only used to explain the present invention, and are not intended to limit the scope of the present invention. For those of ordinary skill in the art, all embodiments obtained according to the spirit of the present invention shall belong to the protection scope of the present invention without any creative effort.

[0073] figure 2 It is a flowchart of a control method for user task map-end aggregation in the MR computing platform in Embodiment 1 of the present invention. Such as figure 2 As shown, in this embodiment, the method for controlling user task map-side aggregation in the MR computing platform may include the following steps:

[0074] Step S201, receiving a submitted user task;

[0075] Step S202, detecting whether the received user task meets the preset enabling condition of map-side aggregation;

[0076] ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present application relates to a control method and device for user task map aggregation in an MR computing platform. Wherein, the control method for user task map-side aggregation in the MR computing platform includes: receiving a submitted user task; detecting whether the received user task meets the preset enabling condition of map-side aggregation; automatically controlling whether to enable the user task according to the detection result. The map-side aggregation of tasks. The embodiment of the present invention can autonomously control whether to perform map-side aggregation on user tasks according to specific conditions, so that user tasks can be effectively aggregated on the map side and avoid invalid map-side aggregation, thereby improving the execution efficiency of user tasks and improving MR calculation platform performance.

Description

technical field [0001] The present invention relates to the communication field, in particular to a control method and device for user task map aggregation in an MR computing platform. Background technique [0002] MR (short for MapReduce) task is an important task in a distributed system, which runs on the MR computing platform of the distributed system. [0003] On the MR computing platform, the execution process of user tasks is as follows: first, the submitted user tasks are converted into multiple independent MR Jobs; then each MR Job is executed in parallel to complete the user tasks. During the execution of MR Job, a kind of processing is involved, that is, map-side aggregation. Here is an example to illustrate what map-side aggregation is. Take the maximum value of 1, 2, 3, 4, and 5 as an example. The scheme of using map-side aggregation processing is: first divide the data into two groups according to the amount of data, such as [1, 2, 3] and [4, 5], and then cal...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/2453
CPCG06F16/24532G06F9/44G06F8/456G06F9/5027G06F16/24556G06F16/2282
Inventor 贾元乔孙伟光
Owner ALIBABA GRP HLDG LTD