Distributed high concurrent real-time message pushing method and system

Abstract

The invention provides a distributed high concurrent real-time message pushing method and a distributed high concurrent real-time message pushing system. The method comprises the steps of building a message connection between a first user and a web server, receiving a message sent by a second user to the web server after the second user logs in a web, verifying whether the message is valid, if no,ending an illegal access, if yes, performing high speed concurrent treatment on redis data, and performing kafka partition message treatment; synchronously consuming a kafka message via the web servers, and synchronously pushing same data via the multiple web servers to corresponding grouped users of a websocket connection, and receiving the message sent by the web server via the first user. According to the method and system provided by the invention, the retardance of the websocket instant messaging under the high concurrent scene can be reduced, and the expandability of the same can be improved.

Description

technical field [0001] The invention belongs to the technical field of message processing, and in particular relates to a distributed high-concurrency real-time message push method and system. Background technique [0002] At present, the web real-time push technology mainly adopts two methods, one is to use the http polling method, which mainly uses the browser XHR technology to regularly send http requests to the web server, and re-renders the user according to the results returned by the web server Interface, in order to achieve the purpose of data refresh, so as to achieve the effect of instant push, but this method has many serious defects, such as long delay time for pushing data, relatively large server and browser resource overhead, and the existence of transmitted data volume. Bottlenecks, etc.; Another way is to use a separate websocket server to transmit data. This method is to build a separate websocket server, and then all websocket connections request the serve...

AI Technical Summary

Problems solved by technology

[0002] At present, the web real-time push technology mainly adopts two methods, one is to use the http polling method, which mainly uses the browser XHR technology to regularly send http requests to the web server, and re-renders the user according to the results returned by the web server Interface, in order to achieve the purpose of data refresh, so as to achieve the effect of instant push, but this method has many serious defects, such as long delay time for pushing data, relatively large server and browser resource overhead, and the existence of transmitted data volume. Bottlenecks, etc.; Another way is to use a separate websocket server to transmit data. This method is to build a separate websocket server, and then all websocket connections request the server, so that all websockets are connected to the server, so that Only need to manage a single websocket server to realize the distribution of messages to all users. This method results in poor scalability. When there are too many users, user partitions need to be isolated, and the load of the server has not been exceeded.

Images