Unlock instant, AI-driven research and patent intelligence for your innovation.

A method for Internet device connection and data forwarding processing

A technology of Internet devices and processing methods, which is applied in the field of Internet of Things device connection, can solve problems such as high CPU usage and low operation stability, and achieve the goal of increasing reliability and stability, avoiding performance bottlenecks, and avoiding single point failure risks Effect

Active Publication Date: 2022-03-11
杭州玖欣物联科技有限公司
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The technical problem to be solved in the present invention is to provide an Internet device connection and data forwarding processing method for the above defects, including EMQ clusters and Kafka clusters. EMQ clusters and Kafka clusters communicate through data subscription and forwarding modules, and the data subscription and forwarding modules are responsible for Subscribe messages from the EMQ cluster, and then forward them to the Kafka cluster; the messages are distributed from the server to the EMQ cluster through the load balancer, and then subscribe to the messages from the EMQ cluster through the data subscription and forwarding module, and then forwarded to the Kafka cluster, and the application consumes from the Kafka cluster message, to solve the problems of low running stability and high CPU usage in the existing technology of using EMQ and Kafka through KafkaBridge

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method for Internet device connection and data forwarding processing
  • A method for Internet device connection and data forwarding processing
  • A method for Internet device connection and data forwarding processing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0019] Depend on image 3 Shown, an Internet connection device and a data forwarding processing method comprising Kafka EMQ clusters and clusters, cluster and Kafka EMQ cluster data communication subscription and forwarding module, data forwarding module is responsible for subscription and subscription message from the cluster by EMQ, and then forwarded to Kafka clusters;

[0020] Subscription data forwarding module and the prior art and things subscription data forwarding module;

[0021] After the message load balancer diversion from the server to the cluster EMQ, and then subscribe to the EMQ clusters through subscriptions and data forwarding module, and then forwarded to the cluster Kafka, Kafka application consumes messages from the cluster.

Embodiment 2

[0023] Depend on Figure 4 Shown, an Internet connection device and a data forwarding processing method comprising Kafka EMQ clusters and clusters, cluster and Kafka EMQ cluster data communication subscription and forwarding module, data forwarding module is responsible for subscription and subscription message from the cluster by EMQ, and then forwarded to Kafka clusters;

[0024] Subscription data forwarding module and the prior art and things subscription data forwarding module;

[0025] After the message load balancer diversion from the server to the cluster EMQ, and then subscribe to the EMQ clusters through subscriptions and data forwarding module, and then forwarded to the cluster Kafka, Kafka application consumes messages from the cluster;

[0026] To prevent data subscription and abnormal loss of data forwarding module, data forwarding module and the subscription used standby mode, data forwarding module, and is provided with two subscriptions, wherein the master module op...

Embodiment 3

[0028] Depend on Figure 5 Shown, an Internet connection device and a data forwarding processing method comprising Kafka EMQ clusters and clusters, cluster and Kafka EMQ cluster data communication subscription and forwarding module, data forwarding module is responsible for subscription and subscription message from the cluster by EMQ, and then forwarded to Kafka clusters;

[0029] Subscription data forwarding module and the prior art and things subscription data forwarding module;

[0030] After the message load balancer diversion from the server to the cluster EMQ, and then subscribe to the EMQ clusters through subscriptions and data forwarding module, and then forwarded to the cluster Kafka, Kafka application consumes messages from the cluster;

[0031] In this embodiment, in order to avoid data subscription and forwarding module become a performance bottleneck, and the data subscription EMQ clusters and forwarding module is provided with a plurality of sets;

[0032] Other feat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a processing method for Internet device connection and data forwarding, relates to the technical field of Internet of Things device connection, and solves the problem of low operational stability and high CPU usage in the prior art in which EMQ and Kafka are used together through Kafka Bridge problem, its technical points are: including EMQ cluster and Kafka cluster, EMQ cluster and Kafka cluster communicate through data subscription and forwarding module, data subscription and forwarding module is responsible for subscribing message from EMQ cluster, then forwarding to Kafka cluster; the present invention adopts data The subscription and forwarding module subscribes to all messages of the EMQ cluster and forwards them to the Kafka cluster. As long as one Kafka node is working, the message forwarding can be successful. Compared with the prior art, the present invention greatly increases the reliability and stability of the system , At the same time, the application consumes messages from the Kafka cluster, and there is no longer a single point of failure problem.

Description

Technical field [0001] The present invention relates to networked devices connected BACKGROUND thereof, particularly to a device connected to the Internet and data transfer processing method. Background technique [0002] EMQ X (Erlang / Enterprise / Elastic MQTT Broker) server supports message things device stop connectivity mass, and supports large-scale distributed, can be used for the cluster architecture, deployment elastically stretchable. Kafka is a high throughput of distributed publish-subscribe messaging system, can be used to decouple producers and consumers cache messages. Such as figure 1 Shown, EMQ, and Kafka by Kafka Bridge with the use of the mass may facilitate access to the cache and its associated equipment was massive message. [0003] Such as figure 2 As shown in prior art devices to support access to the mass, generally employed X-cluster EMQ distributed deployment, using each node EMQ Kafka message output to a buffer, but there is the connection method at i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L67/14H04L67/1097H04L41/0668
CPCH04L67/14H04L67/1097H04L41/0668
Inventor 黎冬生余福荣
Owner 杭州玖欣物联科技有限公司