A method and system for message processing of Internet of Things platform based on stream processing

Abstract

The present invention provides a message processing method for an Internet of Things platform based on stream processing, comprising: the Internet of Things platform data access service receives the data reported by the device, and pushes the original data reported by the device to the message middleware for storing the message; The front stream processing node configured with the first type of processing rules splits the original data stored in the message middleware into message branches based on the specified characteristic information, and then saves each message branch to the message middleware again ;Set the post-stream processing node configured with the second type of processing rules, process each message branch in the message middleware, and save the processed results to the database or continue to flow to the next message middleware; Repeat this process until the processed data meets the preset business requirements. The method of the present invention can support users to customize and configure stream processing rules according to business while improving the efficiency and real-time performance of message processing on the Internet of Things platform.

Description

technical field [0001] The invention relates to the technical field of the Internet of Things, in particular to a method for processing messages on an Internet of Things platform based on stream processing. Background technique [0002] With the continuous development of the Internet of Things technology, the Internet of Things platform and big data processing have been widely used in various industries. As the core component of the Internet of Things technology application, the performance of the Internet of Things platform plays a key role in the entire Internet of Things service. Although the existing Internet of Things platform technology has been widely used in all aspects of society, the Internet of Things platform still has the following shortcomings in processing high-concurrency timing messages of massive devices: [0003] Traditional IoT platform message processing is based on single-node distribution processing. This method has many defects: First, messages in th...

AI Technical Summary

Problems solved by technology

[0003] Traditional IoT platform message processing is based on single-node distribution processing. This method has many defects: First, messages in the processing platform cannot be consumed quickly, and it often takes a few minutes or even several minutes due to the huge amount of data. The various real-time data reported by the device in the IoT platform can be completely processed within an hour, and there is a large time delay, which makes it impossible to provide real-time processed feedback. Second, the traditional IoT platform message processing has limited applicable scenarios and cannot It adapts to the dynamic business needs of users and has poor scalability. It is generally a combination of platform-limited functional modules. It is difficult for users to customize development and cannot meet individual needs.

However, the scenario used by this solution has limitations. This method only performs streaming processing for alarm messages, which fails to expand the scope of its use, and is more dependent on relational databases to maintain its streaming engine rule configuration.

Images