Big data processing method based on blockchain and equipment

Abstract

The invention provides a big data processing method based on blockchain and equipment. The big data processing method comprises the following steps of S1, generating a user data processing account number, a password and authority for operating in the blockchain; S2, determining legality of carding data and transmitting reasonable data; S3, performing classified operation on the valid data; S4, inputting data in a stream format, and encrypting the data in a blockchain no-center storing mode; S5, performing backup of encrypted new data; and S6, performing data classified arrangement and re-storage through data preprocessing, data mining and machine learning manners. The big data processing method is a big data processing mode based on the blockchain, thereby reducing the number of times of acquiring the resource from a native resource database by a user terminal, and greatly reducing a data transmission load of a web server. Furthermore, in data encryption, the big data processing methodhas advantages of high strength, high speed, high attack resistance, etc. Furthermore the big data processing method has advantages of performing encryption and backup on the data, and ensuring highdata safety.

Description

technical field [0001] The present invention relates to the field of big data processing, specifically a block chain-based big data processing method and equipment. Background technique [0002] At present, with the increasing number of things or business processing through the network, the reliability of operational data is getting higher and higher, especially the concurrent read and write processing of data. At the same time, there is also a need for the system to provide auditing and log query. However, the business processing logic defined in the previous system usually mixes the read and write operations of core data, and each business processing logic provides audit logs according to its own needs. This data processing method reduces the maintainability and scalability of the system due to the complex business logic for specific operations. At the same time, this type of system cannot achieve a dynamic level of performance when the number of Internet user visits is un...

AI Technical Summary

Problems solved by technology

[0006] However, for data processing, when processing based on stream input and output only, there is how to transfer data when there are multiple outputs for one input and when data is in stream format even though the entity file has been materialized in the filter Inefficient problem when being returned; also unable to generate health report

Images