Edge end data transmission and storage method and device

Abstract

The invention is suitable for the technical field of data transmission, and provides an edge end data transmission and storage method and device. The method comprises the steps: a data collection module creates and transmits an initial message queue to first message middleware according to collected edge end equipment data; The data processing module obtains and processes the initial message queue in the first message middleware, obtains and forwards message queue information and stores the message queue information to the second message middleware; The data storage module obtains and stores the storage message queue information; And the data forwarding module obtains forwarding message queue information. According to the data transmission method and device, the situation that in the data transmission process, data accumulation is likely to occur due to the fact that the data size or frequency is increased can be prevented, the problem that data of edge end equipment is likely to be lost under the service downtime condition of an edge end is solved, query can be conducted under the large data size, and the query result is quickly returned.

Description

technical field [0001] The invention belongs to the technical field of data transmission, and in particular relates to a method and device for data transmission and storage at an edge end. Background technique [0002] In the current related technologies, data transmission is mostly carried out through Http protocol ((Hypertext Transfer Protocol, hypertext transfer protocol) or Grpc protocol (Google Remote Procedure Call, Google remote procedure call). As the amount of data increases or the frequency increases It is easy to accumulate data, and even the downtime of one or several services at the edge will cause data loss. [0003] In the case of massive data, the edge end uses ordinary embedded databases, such as Sqlite (a software library) and H2 (a database), which have poor performance in storing and querying large amounts of data. On the one hand, it will increase the memory and CPU (central processing unit, central processing unit) overhead, on the other hand, it is al...

AI Technical Summary

Problems solved by technology

[0004] In view of this, the embodiment of the present invention provides a method and device for data transmission and storage at the edge end to solve the problem that data accumulation is prone to occur in the data transmission process in the prior art as the amount of data increases or the frequency increases. End service downtime will cause data loss and the large database memory, cpu, and disk are difficult to support for relatively small hardware

Images