Internet of Things platform message processing method and system based on streaming processing

Abstract

The invention provides an Internet of Things platform message processing method based on streaming processing, which comprises the following steps: by an Internet of Things platform data access service, receiving data reported by equipment, and pushing original data reported by the equipment to message-oriented middleware for storing messages; setting a pre-streaming processing node configured with a first type of processing rule, splitting the original data stored in the message-oriented middleware into message branches taking specified feature information as a division basis, and then storing each message branch in the message-oriented middleware again; setting a post-stream processing node configured with a second type of processing rules, processing each message branch in the message middleware, and storing a processed result in a database or transferring the processed result to the next message middleware; and repeating the process until the processed data meets a preset service requirement. According to the method provided by the invention, the efficiency and the real-time performance of the Internet of Things platform for processing the message are improved, and meanwhile, the user can be supported to configure the streaming processing rule according to the service.

Description

technical field [0001] The invention relates to the technical field of the Internet of Things, in particular to a method for processing messages on an Internet of Things platform based on stream processing. Background technique [0002] With the continuous development of the Internet of Things technology, the Internet of Things platform and big data processing have been widely used in various industries. As the core component of the Internet of Things technology application, the performance of the Internet of Things platform plays a key role in the entire Internet of Things service. Although the existing Internet of Things platform technology has been widely used in all aspects of society, the Internet of Things platform still has the following shortcomings in processing high-concurrency timing messages of massive devices: [0003] Traditional IoT platform message processing is based on single-node distribution processing. This method has many defects: First, messages in th...

AI Technical Summary

Problems solved by technology

[0003] Traditional IoT platform message processing is based on single-node distribution processing. This method has many defects: First, messages in the processing platform cannot be consumed quickly, and it often takes a few minutes or even several minutes due to the huge amount of data. The various real-time data reported by the device in the IoT platform can be completely processed within an hour, and there is a large time delay, which makes it impossible to provide real-time processed feedback. Second, the traditional IoT platform message processing has limited applicable scenarios and cannot It adapts to the dynamic business needs of users and has poor scalability. It is generally a combination of platform-limited functional modules. It is difficult for users to customize development and cannot meet individual needs.

However, the scenario used by this solution has limitations. This method only performs streaming processing for alarm messages, which fails to expand the scope of its use, and is more dependent on relational databases to maintain its streaming engine rule configuration.

Images