Unlock instant, AI-driven research and patent intelligence for your innovation.

MapRuduce based average value calculating method and device

A calculation method and average technology, which is applied in the computer field and can solve problems such as average distortion

Inactive Publication Date: 2016-07-13
ULTRAPOWER SOFTWARE
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present invention provides an average value calculation based on MapReduce to solve the problem that the obtained average value is seriously distorted in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • MapRuduce based average value calculating method and device
  • MapRuduce based average value calculating method and device
  • MapRuduce based average value calculating method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0062] Aiming at the problem of severe distortion of the obtained average value existing in the prior art, the embodiment of the present invention provides a method for calculating the average value based on MapReduce, the flow of the method is as follows figure 1 As shown, the execution steps are as follows:

[0063]S11: Group the big data to be processed into groups according to set rules, and add a group identifier (Key) to each group of big data.

[0064] Since the amount of big data to be processed is very large, in order to reduce the difficulty of processing, after obtaining the big data to be processed, the big data to be processed can be grouped according to the set rules, and a group Key can be assigned to each group, and the group Key In the big data added to the corresponding group, those with the same group key indicate that they belong to the same group of big data. The group key can be in the form of numbers, letters, symbols, etc., and the setting rules can be ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a MapRuduce based average value calculating method and device. The MapRuduce based average value calculating method comprises the steps that big data to be processed is grouped according to set rules, and a group Key is added for each group of the big data; the grouped big data is allocated to at least one pre-set Map task; each Map task is called to process the allocated big data with row as unit so as to obtain an output value carrying the corresponding group Key, wherein the output values include processing values and volumes of the big data of corresponding rows; the groups Key allocate the output values processed by the Map tasks to Ruduce tasks and correspond to the Ruduce tasks in a one-to-one mode; the Ruduce tasks are called to calculate average values of the big data of the corresponding groups Key according to the allocated output values. By the adoption of the scheme, the severe distortion problem is avoided.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a method and device for calculating an average value based on MapReduce. Background technique [0002] Big Data (BigData) is usually used to describe a large amount of unstructured data and semi-structured data created by an enterprise. The enterprise will analyze and process the big data, and make decisions, project promotion, etc. based on the results of the analysis and processing. When analyzing and processing big data, the average value of big data is often used. Therefore, how to accurately calculate the average value of big data is very important. [0003] At present, the average value of large data is generally calculated using a progressive calculation method, specifically: usually set a large unit and a small unit, first calculate the average value of the small unit, and then calculate the average value of the large unit and the small unit based on the average value o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/50
Inventor 苏小明王庆磊张国波
Owner ULTRAPOWER SOFTWARE