Method and system for dynamic and real-time calculation of six sigma values ​​with large amount of data

Abstract

The present invention provides a method and system for dynamically and real-time calculating the Six Sigma value of a large amount of data, including the following steps: real-time incremental construction of the original measurement data step: constructing the original measurement data, deduplicating the original measurement data, and storing them in a parallel array ;Filter and calculate the Six Sigma numerical value step: perform the Six Sigma numerical calculation after filtering the data stored in the columnar array. The present invention solves the problems of traditional Six Sigma numerical calculation cycle length and calculation result lag by real-time incremental acquisition and data conversion of original measurement data, and greatly reduces the Six Sigma numerical calculation time in the scene of large data sets; the present invention accelerates The search, screening and combination of calculation data sets are realized, and the intermediate transmission cost of data is saved; the invention solves the problem of flexible loading and dynamic combination of data in different data dimension combinations and roll-up scenarios; it provides a novel and efficient calculation method.

Description

technical field

[0001] The invention relates to the field of data calculation, in particular to a method and system for dynamically and real-time calculating a large amount of six sigma values. Background technique

[0002] The existing data calculation system has high intermediate transmission costs, long calculation cycle, lag in calculation results, and low data processing efficiency.

[0003] The patent document CN 106557370A discloses a dynamic scheduling platform for computing resources based on real-time statistical data, which is characterized in that it includes a monitoring center, a scheduling center, a configuration center, and a registration center. The monitoring center includes a monitoring module, a database, and a monitoring center. Carry out data transmission with dispatching center, configuration center and registration center respectively. Its advantages lie in the reasonable scheduling of hardware device resources; the ability to dynamically allocate, s...

Images