A big data processing method, device and system

Abstract

The present invention relates to the technical field of data analysis, in particular to a big data processing method, device and system. The method is: according to the number of user equipment corresponding to each analysis terminal, determine the analysis terminal with the least number of corresponding user equipment, send the original data to the analysis terminal, and trigger the analysis terminal to perform the following operations: The original data is converted and processed to obtain the corresponding unit status data, and the unit status data is published to the Kafka cluster, so that users can obtain the subscribed unit status data from the Kafka cluster. Using the above method, the dynamic load balancing between the analysis terminals is realized. Further, the user can obtain the unit status data corresponding to each user equipment in real time, and pre-detect each unit status data according to the unit status data corresponding to each user equipment. Whether there is any user equipment running abnormally in the user equipment, so as to reduce the failure rate of the user equipment and improve user experience.

Description

technical field [0001] The present invention relates to the technical field of data analysis, in particular to a big data processing method, device and system. Background technique [0002] With the increasing popularity of the network information age and the advent of the big data era, the application fields of big data are also becoming more and more common, such as the application in the field of air conditioning, specifically, real-time processing of big data of concurrent air conditioning equipment. [0003] At present, when processing the big data of air-conditioning equipment with high concurrency, the data analysis end analyzes and processes the raw data fed back by each air-conditioning equipment received, and directly writes the analyzed and processed data into the corresponding first database (such as, SQL Server), and according to the preset rule, the data written in the first database within the set time period is transferred to the second database at the preset...

AI Technical Summary

Problems solved by technology

[0007] The embodiments of the present invention provide a big data processing method, device and system to solve the unbalanced load of each data analysis terminal existing in the prior art, and the poor timeliness of the queried data, which leads to the failure of the air-conditioning equipment failure Before the occurrence, according to the real-time data of the air-conditioning equipment, the abnormal situation of the air-conditioning equipment is detected in advance, so that the problem can be dealt with in time

Images