Big data measuring method and system

Abstract

The invention belongs to the technical field of determination of big data. The invention discloses a big data determination method and system. The big data determination system comprises a user terminal, a data transmission module, a main control module, a big data analysis module, a loading module, a calculation task generation module, a big data migration module, an encryption module, a big datastorage module and a result display module. Through the big data migration module, the value return period of big data analysis is greatly shortened, and the problem of data security in the unstructured big data analysis process is solved; therefore, the problem of enterprise data security in the unstructured big data analysis process is solved; meanwhile, even if the big data platform is attacked or damaged by viruses or Trojans through the encryption module, the system which is completely the same as the original system can be accurately recovered by utilizing the system integrity checkingtechnology (Hash algorithm technology) provided by the invention.

Description

technical field [0001] The invention belongs to the technical field of big data measurement, and in particular relates to a big data measurement method and system. Background technique [0002] Big data refers to the collection of data that cannot be captured, managed and processed by conventional software tools within a certain time frame. , high growth rate and diversified information assets. With the advent of the cloud era, big data has also attracted more and more attention. According to the analyst team, big data is often used to describe the large amount of unstructured and semi-structured data created by a company that would take too much time and money to download to a relational database for analysis. Big data analysis is often associated with cloud computing because real-time analysis of large data sets requires a framework like MapReduce to distribute work to dozens, hundreds, or even thousands of computers. Big data requires special techniques to efficiently ...

AI Technical Summary

Problems solved by technology

[0003] To sum up, the problems existing in the existing technology are: the amount of data to be analyzed in the existing big data migration is huge, and the value return cycle of data analysis will be greatly extended; the access of the migrated data is uncontrollable, which greatly increases the risk of data leakage. risk; at the same time, the existing big data encryption method cannot restore the original data after being attacked, security; the signal obtained by the wireless transmitter is noisy, and the signal availability is low; the image is noisy and the edge information is blurred; the image display pixel is low

Images