Message transmission method based on shared memory

Abstract

The invention discloses a message passing method based on a shared memory, which belongs to the technical field of message middleware, and comprises the following steps of: taking the shared memory as a data storage carrier, and finishing a message passing service process by calling api (Application Program Interface) by a service process of a server; packaging the shared memory into a message channel, and marking the message channel; when read-write operation of messages is executed, a batch read-write function is used, whether data exist in a current channel or not is obtained by judging marks of the channel, and for a scene that the messages cannot be lost, the messages which cannot be processed in time and cannot be discarded are sent to a distributed message system kafka to be stored, so that the technical problem of high-speed data transmission between processes is solved; the shared memory is used as a carrier for data storage. A shared memory is packaged into a message channel, and data can be transmitted between processes at a high speed in cooperation with system semaphore, a memory lock, a memory mark and sequential control. Wherein the message transmission speed between the processes is the copying speed of the memory.

Description

technical field

[0001] The invention belongs to the technical field of message middleware, and relates to a message delivery method based on shared memory. Background technique

[0002] Kafka was originally developed by Linkedin. It is a distributed, partition-supporting, replica-based distributed messaging system based on zookeeper coordination. Its biggest feature is that it can process large amounts of data in real time to meet Various demand scenarios: such as hadoop-based batch processing system, low-latency real-time system, storm / Spark streaming processing engine, web / nginx log, access log, message service, etc., written in scala language, contributed by Linkedin in 2010 Gave to the Apache Foundation and became a top open source project.

[0003] In terms of message middleware, there are many open source products on the market, such as Kafka based on distributed and disk storage, rabbitMQ based on memory, rocketMQ, redis and so on. In most of the backend solutions a...

Images