Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A Distributed and High Concurrency Message Matching Method

A matching method and distributed technology, applied in the direction of database distribution/replication, generation of response errors, retrieval of digital data information, etc., can solve the problems of increased data storage pressure, decreased response speed, and inability to handle redundant requests. Guaranteed response speed, not easy to lose, and the effect of improving data reading speed

Active Publication Date: 2022-05-20
BEIJING TESTOR TECH +1
View PDF12 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The essence of high concurrency is the limitation of resources. For example, if the number of online users in the system is 10W, it does not mean that the number of concurrent users in the system is 10W. There may be 10W users who view static articles on the homepage at the same time and do not send requests to the server. The high concurrency is based on the system The number of real users and sending requests require the server to consume resources for processing requests, and the server can only open 100 threads. Exactly one thread takes 1 second to process a request, so the server can only process 100 requests in 1 second
[0003] Under the access of large data, the database reads a large amount of data, which increases the pressure of data storage simultaneously. The security of data cannot be effectively guaranteed, and redundant requests cannot be processed. As for the high concurrency of data, its Data processing has been unable to achieve real-time processing, and at the same time, under the continuous backlog of a large amount of data, its database is under continuous high access volume, which puts a great pressure on the database server, and the response speed will also decrease, causing the processor to target The efficiency of high-concurrency message matching is further restricted, so it needs to be optimized

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0028] A distributed high-concurrency message matching method includes the following steps:

[0029] S1. Realize the hash calculation through the MurmurHash calculation method, establish the access data cache based on the lower layer of the processor, and realize the linear queue arrangement of the cached messages through the TreeMap of java.

[0030] S2. Establish an intermediate layer based on the data cache between the processor and mysql, and establish a search engine based on the intermediate layer located in mysql.

[0031] S3. A leaky bucket algorithm is introduced into the linear queue data cache of the lower layer of the processor to implement a smooth current limiting strategy for burst traffic.

[0032] S4. Establish multiple mysql lower-level data backup servers, and multiple data backup servers are loaded with independent mysql.

[0033] S5. The mysqls corresponding to the plurality of data backup servers all establish intermediate layers and connect to the same ...

Embodiment 2

[0054] A distributed high-concurrency message matching method includes the following steps:

[0055] S1. Realize the hash calculation through the MurmurHash calculation method, establish the access data cache based on the lower layer of the processor, and realize the linear queue arrangement of the cached messages through the TreeMap of java.

[0056] S2. Establish an intermediate layer based on the data cache between the processor and mysql, and establish a search engine based on the intermediate layer located in mysql.

[0057] S3. A leaky bucket algorithm is introduced into the linear queue data cache of the lower layer of the processor to implement a smooth current limiting strategy for burst traffic.

[0058] S4. Establish multiple mysql lower-level data backup servers, and multiple data backup servers are loaded with independent mysql.

[0059] S5. The mysqls corresponding to the plurality of data backup servers all establish intermediate layers and connect to the same ...

Embodiment 3

[0072] A distributed high-concurrency message matching method includes the following steps:

[0073] S1. Realize the hash calculation through the MurmurHash calculation method, establish the access data cache based on the lower layer of the processor, and realize the linear queue arrangement of the cached messages through the TreeMap of java.

[0074] S2. Establish an intermediate layer based on the data cache between the processor and mysql, and establish a search engine based on the intermediate layer located in mysql.

[0075] S3. A leaky bucket algorithm is introduced into the linear queue data cache of the lower layer of the processor to implement a smooth current limiting strategy for burst traffic.

[0076] S4. All the information rejected by the smooth current limiting policy is introduced into the backup processor, so as to realize the double-bucket shunting processing of data current limiting.

[0077] The backup processor is connected to the middle layer correspond...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a distributed high-concurrency message matching method, and specifically relates to the technical field of high-concurrency servers. The invention adopts a linear message queue arrangement method to realize data queues when data cannot be processed immediately. It is processed sequentially to ensure that each data can be processed, and with the leaky bucket algorithm, the cache of the lower layer of the processor can be adaptively allocated, and the parallel processing margin of the backup processor is adopted. Synchronous processing in the process of processing, forming a double-bucket strategy, with the cooperation of multiple backup servers for the database, can improve the data reading speed of the two processors without duplication of internal cache data in multiple intermediate layers, using multiple identical The method of synchronously reading different data from the data source guarantees the response speed of high access volume, and plays a decisive role in the stability of the database to adapt to the high reading state of high concurrent message matching.

Description

technical field [0001] The present invention relates to the technical field of high concurrency server, more specifically, the present invention relates to a distributed high concurrency message matching method. Background technique [0002] At the same time or in a very short period of time, a large number of requests arrive at the server, and each request requires the server to consume resources for processing and give corresponding feedback, such as the number of processes opened at the same time, the number of threads that can run at the same time, and the network connection The number, CPU operation, I / O, and memory are all limited, so the server can process requests at the same time is also limited. The essence of high concurrency is the limitation of resources. For example, if the number of online users in the system is 10W, it does not mean that the number of concurrent users in the system is 10W. There may be 10W users who view static articles on the homepage at the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/2453G06F9/54G06F16/22G06F16/2455G06F16/27G06F16/28G06F11/14
CPCG06F16/24532G06F9/546G06F16/2255G06F16/24552G06F16/27G06F16/284G06F11/1448Y02D10/00
Inventor 周鑫陈忠国李忱江何门殿春孟繁荣姚志强
Owner BEIJING TESTOR TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products