A terminal equipment data acquisition system based on a Netty framework

Abstract

The invention relates to the technical field of data acquisition, and solves the problems that an existing data acquisition system does not have universality and the number of threads cannot be dynamically adjusted. The technical scheme is summarized as follows: the method comprises the steps of: the method is based on a Netty framework; wherein the data acquisition server is provided with a server side of a data acquisition service based on a Netty framework; providing a data acquisition interface, creating a thread pool I and a thread pool II; wherein a thread in the thread pool I is used for processing a connection request of the terminal equipment; wherein the threads in the thread pool II are used for processing network read-write operation and dynamically adjusting the number of thethreads running in the thread pool I and the thread pool II according to the number of connection requests initiated by the terminal equipment, and data are transmitted between the data acquisition server and the terminal equipment in a ByteBuf format. According to the invention, the terminal equipment data is acquired based on the Netty framework, the server and the terminal uniformly transmit the data according to the ByteBuf format, the universality is high, the number of running threads can be dynamically adjusted, and the resource consumption is reduced. The method is especially suitablefor big data acquisition systems.

Description

technical field [0001] The invention relates to the technical field of data collection, in particular to the data collection technology based on the Netty framework. Background technique [0002] With the development of the Internet of Things and big data, more and more terminal data requires access to the big data platform. The existing data collection is basically customized development: (1) According to the characteristics of the terminal equipment, the communication method and data protocol for reporting are agreed, and the back-end is based on the Spring framework, and the interface development based on the HTTP protocol is carried out, and provided to the terminal equipment for calling, Complete data reporting, not universal. (2) In order to meet the data collection needs of a large number of terminal devices, the existing collection mode relies on the monitoring, receiving and processing modes of traditional multi-threaded services. Blockage, interruption, data leak...

AI Technical Summary

Problems solved by technology

[0003] The present invention provides a terminal equipment data acquisition system based on the Netty framework to solve the technical problem that the existing terminal equipment data acquisition system does not have versatility when collecting data and cannot dynamically adjust the number of threads