A method and system for collecting, processing and storing high-concurrency mass data

Abstract

The invention provides a method and system for collection, processing and storage of high-concurrency mass data and relates to the technical field of energy conservation.The method comprises the steps that a conversation request sent by a client is received; the conversation request is processed through a selector distribution thread registered in a link channel to establish a conversation with the client, whether the conversation is legal or not is judged, and if yes, load data monitored by the client is received; the load data is cached into multiple data blocks through a selector distribution thread registered in a data processing channel, and the load data in the data blocks is sent to a data storage channel and synchronized to other node databases; the load data sent by the data blocks is received through a selector distribution thread registered in the data storage channel, and the load data is written into a main database.Through the method and system, collection, processing and storage of the high-concurrency data at multiple nodes can be realized, and high performance and stability of the databases are guaranteed.

Description

technical field [0001] The invention belongs to the technical field of energy saving, and in particular relates to a method and a system for collecting, processing and storing highly concurrent massive data. Background technique [0002] The management of building energy consumption has been highly valued by various functional authorities from the state to local governments, and various regulations, standards, and guidelines have been issued one after another. On June 24, 2008, the Ministry of Housing and Urban-Rural Development issued a notice on technical guidelines for the construction of energy consumption monitoring systems for office buildings and large public buildings of state agencies, using "sub-item measurement" as the guiding principle for energy management. [0003] The current building energy consumption management software system classifies or sub-items energy consumption equipment, automatically collects measurement data, realizes online dynamic monitoring of...

AI Technical Summary

Problems solved by technology

[0004] The purpose of the embodiments of the present invention is to provide a method and system for collecting, processing and storing high-concurrency massive data, aiming at solving the problem that the above-mentioned building energy consumption management software system cannot support the reception of tens of thousands of concurrent data and cannot effectively process large data. storage, low database performance, and the inability to quickly process billions of data

Images